It sounds like a sebaceous cyst. I suggest to you to see a doctor preferably a dermatologist. For more information please click the link just below:
You do not have to have visible hairy area to have a sebaceous cyst to grow. You can see it in any place of your body covered with skin because skin has hair follicules in them. It can be your back , your tighs , your arms , your penis etc.