CellSeg3D, Self-supervised 3D cell segmentation for fluorescence microscopy.

Journal: eLife
Published Date:

Abstract

Understanding the complex three-dimensional structure of cells is crucial across many disciplines in biology and especially in neuroscience. Here, we introduce a set of models including a 3D transformer (SwinUNetR) and a novel 3D self-supervised learning method (WNet3D) designed to address the inherent complexity of generating 3D ground truth data and quantifying nuclei in 3D volumes. We developed a Python package called CellSeg3D that provides access to these models in Jupyter Notebooks and in a napari GUI plugin. Recognizing the scarcity of high-quality 3D ground truth data, we created a fully human-annotated mesoSPIM dataset to advance evaluation and benchmarking in the field. To assess model performance, we benchmarked our approach across four diverse datasets: the newly developed mesoSPIM dataset, a 3D platynereis-ISH-Nuclei confocal dataset, a separate 3D Platynereis-Nuclei light-sheet dataset, and a challenging and densely packed Mouse-Skull-Nuclei confocal dataset. We demonstrate that our self-supervised model, WNet3D - trained without any ground truth labels - achieves performance on par with state-of-the-art supervised methods, paving the way for broader applications in label-scarce biological contexts.

Authors

  • Cyril Achard
    Brain Mind Institute and Neuro X, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
  • Timokleia Kousi
    Brain Mind Institute and Neuro X, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
  • Markus Frey
    Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, NTNU, Norwegian University of Science and Technology, Trondheim, Norway.
  • Maxime Vidal
    Brain Mind Institute and Neuro X, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
  • Yves Paychere
    Brain Mind Institute and Neuro X, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
  • Colin Hofmann
    Brain Mind Institute and Neuro X, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
  • Asim Iqbal
    Brain Mind Institute and Neuro X, École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland.
  • Sebastien B Hausmann
    EPFL, Swiss Federal Institute of Technology, Lausanne, Switzerland.
  • Stéphane Pagès
    Wyss Center for Bio and Neuroengineering, Geneva, Switzerland.
  • Mackenzie Weygandt Mathis
    Institute for Theoretical Physics and Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls Universität Tübingen, Tübingen, Germany. mackenzie@post.harvard.edu.