You are most likely correct. If the burners are dirty. it allows gas to build up before it becomes ignited...this can happen at the very start and also a few seconds later.
To improve this the burners need to be cleaned out. If issue persist after that it could be a low pressure problem requiring a service tech to measure pressure.