You can use either language. It is at an early age that children learn languages. You don't need to worry about confusing him.
Even if it causes him to mix both languages in the same sentence? I do not, but He does not make the distinction and mixes it up sometimes.
Just nicely correct him and the benefit will be that he will be bilingual.
He'll get it together as he grows older.