Is there an appropriate time to teach grammar?

Should it be taught when children starts to learn English as a second language or until later when they have acquired competence in the language?