Learning to read leads to functional and structural changes in cortical brain areas related to vision and language. Previous evidence suggests that the Visual Word Form Area (VWFA), a region devoted to the recognition of letter strings in literate persons, acts as an interface between both systems. While different studies have performed univariate analyses to study the effects of literacy on brain function, little is known about its impact on whole functional networks, especially when literacy is acquired during adulthood. We investigated functional connectivity in three groups of adults with different literacy status: illiterates, ex-illiterates (i.e., who learned to read during adulthood), and literates (i.e., who learned to read in childhood). We used a data-driven, multivariate whole brain approach (Independent Component Analysis [ICA]) combined with a region of interest (ROI) analysis in order to explore the functional connectivity of the VWFA with four ICA networks related to vision and language functions. ICA allowed for the identification of four networks of interest: left fronto-parietal, auditory, medial visual and lateral visual functional networks, plus a control right fronto-parietal network. We explored the effects literacy on the connectivity between the VWFA and these networks, trying furthermore to disentangle the roles of reading proficiency and age of acquisition (i.e., literacy status) in these changes. Results showed that functional connectivity between the VWFA and the left fronto-parietal and lateral visual networks increased and decreased, respectively, with literacy. Moreover, the functional coupling of the VWFA and the auditory network decreased with literacy. This study provides novel insights in the mechanisms of reading acquisition and brain plasticity, putting to light the emergence of the VWFA as a bridge between language and vision. Further studies are required to characterize the interplay of proficiency and age of reading acquisition, and its relevance to models of brain plasticity across lifespan.