No the word agnostic means "without knowledge"
It is generally accepted to mean someone who does not know, or believes that it is impossible to know, if a god exists: (Cambridge ED)
A baby is not born with any opinion about gods at all, so it can't be agnostic.