Variations in serotoninergic signaling have been related to behavioral outcomes. Alterations in the genome, such as DNA methylation and histone modifications, are affected by serotonin neurotransmission. The amygdala is an important brain region involved in emotional responses and impulsivity, which receives serotoninergic input. In addition, studies suggest that the serotonin transporter gene network may interact with the environment and influence the risk for psychiatric disorders. We propose to investigate whether/how interactions between the exposure to early life adversity and serotonin transporter gene network in the amygdala associate with behavioral disorders. We constructed a co-expression-based polygenic risk score (ePRS) reflecting variations in the function of the serotonin transporter gene network in the amygdala and investigated its interaction with postnatal adversity on attention problems in two independent cohorts from Canada and Singapore. We also described how interactions between ePRS-5-HTT and postnatal adversity exposure predict brain gray matter density and variation in DNA methylation across the genome. We observed that the expression-based polygenic risk score, reflecting the function of the amygdala 5-HTT gene network, interacts with postnatal adversity, to predict attention and hyperactivity problems across both cohorts. Also, both postnatal adversity score and amygdala ePRS-5-HTT score, as well as their interaction, were observed to be associated with variation in DNA methylation across the genome. Variations in gray matter density in brain regions linked to attentional processes were also correlated to our ePRS score. These results confirm that the amygdala 5-HTT gene network is strongly associated with ADHD-related behaviors, brain cortical density, and epigenetic changes in the context of adversity in young children.