Your browser doesn't support javascript.
loading
Iterative guided machine learning-assisted systematic literature reviews: a diabetes case study.
Zimmerman, John; Soler, Robin E; Lavinder, James; Murphy, Sarah; Atkins, Charisma; Hulbert, LaShonda; Lusk, Richard; Ng, Boon Peng.
Afiliación
  • Zimmerman J; Deloitte Consulting, LLP, 191 Peachtree Street, Atlanta, GA, 30303, USA. Jzimmerman@deloitte.com.
  • Soler RE; Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Division of Diabetes Translation, 1600 Clifton Rd, Atlanta, GA, USA.
  • Lavinder J; Deloitte Consulting, LLP, 191 Peachtree Street, Atlanta, GA, 30303, USA.
  • Murphy S; Deloitte Consulting, LLP, 191 Peachtree Street, Atlanta, GA, 30303, USA.
  • Atkins C; Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Division of Diabetes Translation, 1600 Clifton Rd, Atlanta, GA, USA.
  • Hulbert L; Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Division of Diabetes Translation, 1600 Clifton Rd, Atlanta, GA, USA.
  • Lusk R; Deloitte Consulting, LLP, 191 Peachtree Street, Atlanta, GA, 30303, USA.
  • Ng BP; Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Division of Diabetes Translation, 1600 Clifton Rd, Atlanta, GA, USA.
Syst Rev ; 10(1): 97, 2021 04 02.
Article en En | MEDLINE | ID: mdl-33810798
BACKGROUND: Systematic Reviews (SR), studies of studies, use a formal process to evaluate the quality of scientific literature and determine ensuing effectiveness from qualifying articles to establish consensus findings around a hypothesis. Their value is increasing as the conduct and publication of research and evaluation has expanded and the process of identifying key insights becomes more time consuming. Text analytics and machine learning (ML) techniques may help overcome this problem of scale while still maintaining the level of rigor expected of SRs. METHODS: In this article, we discuss an approach that uses existing examples of SRs to build and test a method for assisting the SR title and abstract pre-screening by reducing the initial pool of potential articles down to articles that meet inclusion criteria. Our approach differs from previous approaches to using ML as a SR tool in that it incorporates ML configurations guided by previously conducted SRs, and human confirmation on ML predictions of relevant articles during multiple iterative reviews on smaller tranches of citations. We applied the tailored method to a new SR review effort to validate performance. RESULTS: The case study test of the approach proved a sensitivity (recall) in finding relevant articles during down selection that may rival many traditional processes and show ability to overcome most type II errors. The study achieved a sensitivity of 99.5% (213 out of 214) of total relevant articles while only conducting a human review of 31% of total articles available for review. CONCLUSIONS: We believe this iterative method can help overcome bias in initial ML model training by having humans reinforce ML models with new and relevant information, and is an applied step towards transfer learning for ML in SR.
Asunto(s)
Palabras clave
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Diabetes Mellitus / Aprendizaje Automático Tipo de estudio: Prognostic_studies / Screening_studies / Systematic_reviews Límite: Humans Idioma: En Revista: Syst Rev Año: 2021 Tipo del documento: Article País de afiliación: Estados Unidos Pais de publicación: Reino Unido
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Diabetes Mellitus / Aprendizaje Automático Tipo de estudio: Prognostic_studies / Screening_studies / Systematic_reviews Límite: Humans Idioma: En Revista: Syst Rev Año: 2021 Tipo del documento: Article País de afiliación: Estados Unidos Pais de publicación: Reino Unido