Perspectives: Comparison of deep learning segmentation models on biophysical and biomedical data.

Journal: Biophysical journal
Published Date:

Abstract

Deep learning-based approaches are now widely used across biophysics to help automate a variety of tasks including image segmentation, feature selection, and deconvolution. However, the presence of multiple competing deep learning architectures, each with its own advantages and disadvantages, makes it challenging to select an architecture best suited for a specific application. As such, we present a comprehensive comparison of common models. Here, we focus on the task of segmentation assuming typical (often small) training dataset sizes available from biophysics experiments and compare the following four commonly used architectures: convolutional neural networks, U-Nets, vision transformers, and vision state space models. In doing so, we establish criteria for determining optimal conditions under which each model excels, thereby offering practical guidelines for researchers and practitioners in the field.

Authors

  • J Shepard Bryan
    Department of Physics, Arizona State University, Tempe, Arizona; Center for Biological Physics, Arizona State University, Tempe, Arizona.
  • Pedro Pessoa
    Department of Physics, Arizona State University, Tempe, Arizona; Center for Biological Physics, Arizona State University, Tempe, Arizona.
  • Meysam Tavakoli
    Department of Radiation Onc, ology, and Winship Cancer Institute, Emory University, Atlanta, Georgia, USA.
  • Steve Pressé
    Department of Physics, Arizona State University, Tempe, Arizona; Center for Biological Physics, Arizona State University, Tempe, Arizona; School of Molecular Sciences, Arizona State University, Tempe, Arizona. Electronic address: spresse@asu.edu.