Background: Androgen deprivation therapy (ADT) for prostate cancer is implicated as a possible cause of cognitive impairment (CI). CI in dementia and Alzheimer's disease is associated with neuroinflammation. In this study, we investigated a potential role of neuroinflammation in ADT-related CI. Methods: Patients with prostate cancer on ADT for ≥3 months were categorized as having ADT-emergent CI or normal cognition (NC) based on self-report at interview. Neuroinflammation was evaluated using positron emission tomography (PET) with the translocator protein (TSPO) radioligand [11C]-PBR28. [11C]-PBR28 uptake in various brain regions was quantified as standardized uptake value (SUVR, normalized to cerebellum) and related to blood oxygen level-dependent functional magnetic resonance imaging (BOLD-fMRI) choice-reaction time task (CRT) activation maps. Results: Eleven patients underwent PET: four with reported CI (rCI), six with reported NC (rNC), and one status unrecorded. PET did not reveal any between-group differences in SUVR regionally or globally. There was no difference between groups on brain activation to the CRT. Regardless of the reported cognitive status, there was strong correlation between PET-TSPO signal and CRT activation in the hippocampus, amygdala, and medial cortex. Conclusions: We found no difference in neuroinflammation measured by PET-TSPO between patients with rCI and rNC. However, we speculate that the strong correlation between TSPO uptake and BOLD-fMRI activation in brain regions involved in memory and known to have high androgen-receptor expression mediating plasticity (hippocampus and amygdala) might reflect inflammatory effects of ADT with compensatory upregulated/increased synaptic functions. Further studies of this imaging readout are warranted to investigate ADT-related CI.