Your browser doesn't support javascript.
loading
Evaluating the relationship between citation set size, team size and screening methods used in systematic reviews: a cross-sectional study.
O'Hearn, Katie; MacDonald, Cameron; Tsampalieros, Anne; Kadota, Leo; Sandarage, Ryan; Jayawarden, Supun Kotteduwa; Datko, Michele; Reynolds, John M; Bui, Thanh; Sultan, Shagufta; Sampson, Margaret; Pratt, Misty; Barrowman, Nick; Nama, Nassr; Page, Matthew; McNally, James Dayre.
Afiliación
  • O'Hearn K; CHEO Research Institute, Ottawa, ON, Canada.
  • MacDonald C; School of Engineering and Applied Sciences, McMaster University, Hamilton, ON, Canada.
  • Tsampalieros A; CHEO Research Institute, Ottawa, ON, Canada.
  • Kadota L; Department of Pediatrics, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada.
  • Sandarage R; Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.
  • Jayawarden SK; Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.
  • Datko M; ECRI Information Center, ECRI, Plymouth Meeting, PA, USA.
  • Reynolds JM; Calder Memorial Library, University of Miami Miller School of Medicine, MLIS, Miami, FL, USA.
  • Bui T; Faculty of Arts & Science, University of Toronto, Toronto, ON, Canada.
  • Sultan S; Therapeutic Products Directorate, Health Canada, Ottawa, ON, Canada.
  • Sampson M; Library Services, CHEO, Ottawa, ON, Canada.
  • Pratt M; CHEO Research Institute, Ottawa, ON, Canada.
  • Barrowman N; CHEO Research Institute, Ottawa, ON, Canada.
  • Nama N; Department of Pediatrics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.
  • Page M; School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.
  • McNally JD; CHEO Research Institute, Ottawa, ON, Canada. dmcnally@cheo.on.ca.
BMC Med Res Methodol ; 21(1): 142, 2021 07 08.
Article en En | MEDLINE | ID: mdl-34238247
BACKGROUND: Standard practice for conducting systematic reviews (SRs) is time consuming and involves the study team screening hundreds or thousands of citations. As the volume of medical literature grows, the citation set sizes and corresponding screening efforts increase. While larger team size and alternate screening methods have the potential to reduce workload and decrease SR completion times, it is unknown whether investigators adapt team size or methods in response to citation set sizes. Using a cross-sectional design, we sought to understand how citation set size impacts (1) the total number of authors or individuals contributing to screening and (2) screening methods. METHODS: MEDLINE was searched in April 2019 for SRs on any health topic. A total of 1880 unique publications were identified and sorted into five citation set size categories (after deduplication): < 1,000, 1,001-2,500, 2,501-5,000, 5,001-10,000, and > 10,000. A random sample of 259 SRs were selected (~ 50 per category) for data extraction and analysis. RESULTS: With the exception of the pairwise t test comparing the under 1000 and over 10,000 categories (median 5 vs. 6, p = 0.049) no statistically significant relationship was evident between author number and citation set size. While visual inspection was suggestive, statistical testing did not consistently identify a relationship between citation set size and number of screeners (title-abstract, full text) or data extractors. However, logistic regression identified investigators were significantly more likely to deviate from gold-standard screening methods (i.e. independent duplicate screening) with larger citation sets. For every doubling of citation size, the odds of using gold-standard screening decreased by 15 and 20% at title-abstract and full text review, respectively. Finally, few SRs reported using crowdsourcing (n = 2) or computer-assisted screening (n = 1). CONCLUSIONS: Large citation set sizes present a challenge to SR teams, especially when faced with time-sensitive health policy questions. Our study suggests that with increasing citation set size, authors are less likely to adhere to gold-standard screening methods. It is possible that adjunct screening methods, such as crowdsourcing (large team) and computer-assisted technologies, may provide a viable solution for authors to complete their SRs in a timely manner.
Asunto(s)
Palabras clave

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Colaboración de las Masas Tipo de estudio: Diagnostic_studies / Observational_studies / Prevalence_studies / Prognostic_studies / Risk_factors_studies / Screening_studies / Systematic_reviews Límite: Humans Idioma: En Revista: BMC Med Res Methodol Asunto de la revista: MEDICINA Año: 2021 Tipo del documento: Article País de afiliación: Canadá Pais de publicación: Reino Unido

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Colaboración de las Masas Tipo de estudio: Diagnostic_studies / Observational_studies / Prevalence_studies / Prognostic_studies / Risk_factors_studies / Screening_studies / Systematic_reviews Límite: Humans Idioma: En Revista: BMC Med Res Methodol Asunto de la revista: MEDICINA Año: 2021 Tipo del documento: Article País de afiliación: Canadá Pais de publicación: Reino Unido