In order to investigate biogeographic influences on xeric biota in the Brazilian Atlantic Forest (BAF), a biodiversity hotspot, we used a monophyletic group including three cactus taxa as a model to perform a phylogeographic study: Cereus fernambucensis subsp. fernambucensis, C. fernambucensis subsp. sericifer, and C. insularis. These cacti are allopatric and grow in xeric habitats along BAF, including isolated granite and gneiss rock outcrops (Inselbergs), sand dune vegetation (Restinga forest), and the rocky shore of an oceanic archipelago (islands of Fernando de Noronha). The nucleotide information from nuclear gene phytochrome C and plastid intergenic spacer trnS-trnG was used to perform different approaches and statistical analyses, comprising population structure, demographic changes, phylogenetic relationships, and biogeographic reconstruction in both spatial and temporal scales. We recovered four allopatric population groups with highly supported branches in the phylogenetic tree with divergence initiated in the middle Pleistocene: southern distribution of C. fernambucensis subsp. fernambucensis, northern distribution of C. fernambucensis subsp. fernambucensis together with C. insularis, southern distribution of C. fernambucensis subsp. sericifer, and northern distribution of C. fernambucensis subsp. sericifer. Further, the results suggest that genetic diversity of population groups was strongly shaped by an initial colonization event from south to north followed by fragmentation. The phylogenetic pattern found for C. insularis is plausible with peripatric speciation in the archipelago of Fernando de Noronha. To explain the phylogeographic patterns, the putative effects of both climatic and sea level changes as well as neotectonic activity during the Pleistocene are discussed.