It sounds like you're describing fleas, Katie.
Unless you're using a preventative other than shampoo, your baby is still prone to fleas. A topical preventative such as Frontline would be much more effective than a shampoo which helps only a small portion of the time (please make sure the shampoo does not have a pyrethrin or permethrin as the active ingredient or it can make your baby sick. Read more here: http://www.petplace.com/cats/permethrin-and-pyrethrin-toxicity-in-cats/page1.aspx).
Here is what a full grown flea looks like: http://farm2.static.flickr.com/1204/1410420640_348856ab75.jpg. They can be smaller if they are younger. In addition, if they happen to be bugs other than fleas, frontline will help to keep them in check (however few other bugs ever are considered a consistant pest like fleas are...since fleas feed on blood and few other bugs aside from ticks do). To be thorough, here is a picture of a seed tick: http://cache.boston.com/bonzai-fba/Original_Photo/2007/06/25/1182784204_3852.jpg (they too can be smaller depending on their age and how much they've recently eaten).
If my answer has helped you, please click accept. If not, reply. I personally don't get paid for my hard work unless you click accept.