Your browser doesn't support javascript.
loading
Sample-Size Determination Methodologies for Machine Learning in Medical Imaging Research: A Systematic Review.
Balki, Indranil; Amirabadi, Afsaneh; Levman, Jacob; Martel, Anne L; Emersic, Ziga; Meden, Blaz; Garcia-Pedrero, Angel; Ramirez, Saul C; Kong, Dehan; Moody, Alan R; Tyrrell, Pascal N.
Afiliación
  • Balki I; Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada.
  • Amirabadi A; Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada; Department of Diagnostic Imaging, Hospital for Sick Children, Toronto, Ontario, Canada.
  • Levman J; Department of Mathematics, Statistics and Computer Science, St Francis Xavier University, Antigonish, Nova Scotia, Canada; Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
  • Martel AL; Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada.
  • Emersic Z; Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia.
  • Meden B; Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia.
  • Garcia-Pedrero A; Department of Botany, Universidad de Valladolid, Castile and Leon, Spain.
  • Ramirez SC; Computing School, Instituto Tecnológico de Costa Rica, Cartago, Costa Rica.
  • Kong D; Department of Statistical Sciences, University of Toronto, Toronto, Ontario, Canada.
  • Moody AR; Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada.
  • Tyrrell PN; Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada; Department of Statistical Sciences, University of Toronto, Toronto, Ontario, Canada. Electronic address: pascal.tyrrell@utoronto.ca.
Can Assoc Radiol J ; 70(4): 344-353, 2019 Nov.
Article en En | MEDLINE | ID: mdl-31522841
PURPOSE: The required training sample size for a particular machine learning (ML) model applied to medical imaging data is often unknown. The purpose of this study was to provide a descriptive review of current sample-size determination methodologies in ML applied to medical imaging and to propose recommendations for future work in the field. METHODS: We conducted a systematic literature search of articles using Medline and Embase with keywords including "machine learning," "image," and "sample size." The search included articles published between 1946 and 2018. Data regarding the ML task, sample size, and train-test pipeline were collected. RESULTS: A total of 167 articles were identified, of which 22 were included for qualitative analysis. There were only 4 studies that discussed sample-size determination methodologies, and 18 that tested the effect of sample size on model performance as part of an exploratory analysis. The observed methods could be categorized as pre hoc model-based approaches, which relied on features of the algorithm, or post hoc curve-fitting approaches requiring empirical testing to model and extrapolate algorithm performance as a function of sample size. Between studies, we observed great variability in performance testing procedures used for curve-fitting, model assessment methods, and reporting of confidence in sample sizes. CONCLUSIONS: Our study highlights the scarcity of research in training set size determination methodologies applied to ML in medical imaging, emphasizes the need to standardize current reporting practices, and guides future work in development and streamlining of pre hoc and post hoc sample size approaches.
Asunto(s)
Palabras clave
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Diagnóstico por Imagen / Investigación Biomédica / Aprendizaje Automático Tipo de estudio: Diagnostic_studies / Guideline / Qualitative_research / Systematic_reviews Límite: Humans Idioma: En Revista: Can Assoc Radiol J Asunto de la revista: RADIOLOGIA Año: 2019 Tipo del documento: Article País de afiliación: Canadá Pais de publicación: Estados Unidos
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Diagnóstico por Imagen / Investigación Biomédica / Aprendizaje Automático Tipo de estudio: Diagnostic_studies / Guideline / Qualitative_research / Systematic_reviews Límite: Humans Idioma: En Revista: Can Assoc Radiol J Asunto de la revista: RADIOLOGIA Año: 2019 Tipo del documento: Article País de afiliación: Canadá Pais de publicación: Estados Unidos