You've been growing your knowledge of a language for longer than you think. Associating, comparing, contrasting new information we're learning to related information that we already know is where it all starts.
(I mean, you know the alphabet, you know how to read, so you can read a language using the alphabet you already know. You read words, you recognize some words and you use the knowledge you already have to figure these new words out...etc...etc)