Loss odyssey in medical image segmentation.

Journal: Medical image analysis
Published Date:

Abstract

The loss function is an important component in deep learning-based segmentation methods. Over the past five years, many loss functions have been proposed for various segmentation tasks. However, a systematic study of the utility of these loss functions is missing. In this paper, we present a comprehensive review of segmentation loss functions in an organized manner. We also conduct the first large-scale analysis of 20 general loss functions on four typical 3D segmentation tasks involving six public datasets from 10+ medical centers. The results show that none of the losses can consistently achieve the best performance on the four segmentation tasks, but compound loss functions (e.g. Dice with TopK loss, focal loss, Hausdorff distance loss, and boundary loss) are the most robust losses. Our code and segmentation results are publicly available and can serve as a loss function benchmark. We hope this work will also provide insights on new loss function development for the community.

Authors

  • Jun Ma
    State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin 150090, China.
  • Jianan Chen
    HUB of Intelligent Neuro-Engineering (HUBIN), Aspire CREATe, DSIS, University College London, London, HA7 4LP, UK.
  • Matthew Ng
    Sunnybrook Research Institute, University of Toronto, Toronto M4N 3M5, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada.
  • Rui Huang
    Department of Critical Care Medicine, The Second Affiliated Hospital of Harbin Medical University, Harbin, Heilongjiang, China.
  • Yu Li
    Department of Public Health, Shihezi University School of Medicine, 832000, China.
  • Chen Li
    School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, China.
  • Xiaoping Yang
    School of Information, Renmin University of China, Beijing 100872, China.
  • Anne L Martel
    Department of Medical Biophysics, University of Toronto, Canada; Department of Imaging Research, Sunnybrook Research Institute, Toronto, Canada.