By the time you’re born, you’ve been aware of the passage of time for, I’m guessing, at least six months, probably more. And the whole infinity problem dissolves when you consider that time awareness probably doesn’t just appear in one go, not to mention how that intermingles with consciousness and other levels of awareness.