Your browser doesn't support javascript.
loading
TestFit: A plug-and-play one-pass test time method for medical image segmentation.
Zhang, Yizhe; Zhou, Tao; Tao, Yuhui; Wang, Shuo; Wu, Ye; Liu, Benyuan; Gu, Pengfei; Chen, Qiang; Chen, Danny Z.
Afiliación
  • Zhang Y; Nanjing University of Science and Technology, Jiangsu 210094, China. Electronic address: zhangyizhe@njust.edu.cn.
  • Zhou T; Nanjing University of Science and Technology, Jiangsu 210094, China.
  • Tao Y; Nanjing University of Science and Technology, Jiangsu 210094, China.
  • Wang S; Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China.
  • Wu Y; Nanjing University of Science and Technology, Jiangsu 210094, China.
  • Liu B; University of Massachusetts Lowell, MA 01854, USA.
  • Gu P; University of Notre Dame, IN 46556, USA.
  • Chen Q; Nanjing University of Science and Technology, Jiangsu 210094, China.
  • Chen DZ; University of Notre Dame, IN 46556, USA.
Med Image Anal ; 92: 103069, 2024 Feb.
Article en En | MEDLINE | ID: mdl-38154382
ABSTRACT
Deep learning (DL) based methods have been extensively studied for medical image segmentation, mostly emphasizing the design and training of DL networks. Only few attempts were made on developing methods for applying DL models in test time. In this paper, we study whether a given off-the-shelf segmentation network can be stably improved on-the-fly during test time in an online processing-and-learning fashion. We propose a new online test-time method, called TestFit, to improve results of a given off-the-shelf DL segmentation model in test time by actively fitting the test data distribution. TestFit first creates a supplementary network (SuppNet) from the given trained off-the-shelf segmentation network (this original network is referred to as OGNet) and applies SuppNet together with OGNet for test time inference. OGNet keeps its hypothesis derived from the original training set to prevent the model from collapsing, while SuppNet seeks to fit the test data distribution. Segmentation results and supervision signals (for updating SuppNet) are generated by combining the outputs of OGNet and SuppNet on the fly. TestFit needs only one pass on each test sample - the same as the traditional test model pipeline - and requires no training time preparation. Since it is challenging to look at only one test sample and no manual annotation for model update each time, we develop a series of technical treatments for improving the stability and effectiveness of our proposed online test-time training method. TestFit works in a plug-and-play fashion, requires minimal hyper-parameter tuning, and is easy to use in practice. Experiments on a large collection of 2D and 3D datasets demonstrate the capability of our TestFit method.
Asunto(s)
Palabras clave

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Procesamiento de Imagen Asistido por Computador / Diagnóstico por Imagen Límite: Humans Idioma: En Revista: Med Image Anal Asunto de la revista: DIAGNOSTICO POR IMAGEM Año: 2024 Tipo del documento: Article Pais de publicación: Países Bajos

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Procesamiento de Imagen Asistido por Computador / Diagnóstico por Imagen Límite: Humans Idioma: En Revista: Med Image Anal Asunto de la revista: DIAGNOSTICO POR IMAGEM Año: 2024 Tipo del documento: Article Pais de publicación: Países Bajos