Low pH with aluminum (Al) toxicity are the main limiting factors affecting crop production in acidic soil. Selection of legume crops with acid tolerance and nitrogen-fixation ability should be one of the effective measures to improve soil quality and promote agricultural production. The role of the rhizosphere microorganisms in this process has raised concerns among the research community. In this study, BX10 (Al-tolerant soybean) and BD2 (Al-sensitive soybean) were selected as plant materials. Acidic soil was used as growth medium. The soil layers from the outside to the inside of the root are bulk soil (BS), rhizosphere soil at two sides (SRH), rhizosphere soil after brushing (BRH) and rhizosphere soil after washing (WRH), respectively. High-throughput sequencing of 16S rDNA amplicons of the V4 region using the Illumina MiSeq platform was performed to compare the differences of structure, function and molecular genetic diversity of rhizosphere bacterial community of different genotypes of soybean. The results showed that there was no significant difference in alpha diversity and beta diversity in rhizosphere bacterial community among the treatments. PCA and PCoA analysis showed that BRH and WRH had similar species composition, while BS and SRH also had similar species composition, which indicated that plant mainly affected the rhizosphere bacterial community on sampling compartments BRH and WRH. The composition and abundance of rhizosphere bacterial community among the treatments were then compared at different taxonomic levels. The ternary diagram of phylum level showed that Cyanobacteria were enriched in WRH. Statistical analysis showed that the roots of Al-tolerant soybean BX10 had an enrichment effect on plant growth promoting rhizobacteria (PGPR), which included Cyanobacteria, Bacteroides, Proteobacteria and some genera and species related to the function of nitrogen fixation and aluminum tolerance. The rhizosphere bacterial community from different sampling compartments of the same genotype soybean also were selectively enriched in different PGPR. In addition, the functional prediction analysis showed that there was no significant difference in the classification and abundance of COG (clusters of orthologous groups of proteins) function among different treatments. Several COGs might be directly related to nitrogen fixation, including COG0347, COG1348, COG1433, COG2710, COG3870, COG4656, COG5420, COG5456 and COG5554. Al-sensitive soybean BD2 was more likely to be enriched in these COGs than BX10 in BRH and WRH, and the possible reason remains to be further investigated in the future.