Get Pet Questions Answered by Pet Experts
This sounds like a vestibular or brain issue with this kitten. It could be viral or congenital...and it is hard to say without a complete exam if the kitten will "improve".
Many times these guys slowly become worse to the point that eating and proper grooming and bathroom habits are not achieved. Most of the time, owners will euthanize these little ones, but it is up to you.
I do recommend an exam to see if there is an underlying cause that your vet could treat.