Contour proposal networks for biomedical instance segmentation.

Journal: Medical image analysis
Published Date:

Abstract

We present a conceptually simple framework for object instance segmentation, called Contour Proposal Network (CPN), which detects possibly overlapping objects in an image while simultaneously fitting closed object contours using a fixed-size representation based on Fourier Descriptors. The CPN can incorporate state-of-the-art object detection architectures as backbone networks into a single-stage instance segmentation model that can be trained end-to-end. We construct CPN models with different backbone networks and apply them to instance segmentation of cells in datasets from different modalities. In our experiments, CPNs outperform U-Net, Mask R-CNN and StarDist in instance segmentation accuracy. We present variants with execution times suitable for real-time applications. The trained models generalize well across different domains of cell types. Since the main assumption of the framework is closed object contours, it is applicable to a wide range of detection problems also beyond the biomedical domain. An implementation of the model architecture in PyTorch is freely available.

Authors

  • Eric Upschulte
    Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Wilhelm-Johnen-Str., Jülich 52428, Germany; Helmholtz AI, Research Centre Jülich, Wilhelm-Johnen-Str., Jülich 52428, Germany. Electronic address: e.upschulte@fz-juelich.de.
  • Stefan Harmeling
    Institute of Computer Science, Heinrich-Heine-University Düsseldorf, Germany.
  • Katrin Amunts
    Cécile and Oskar Vogt Institute of Brain Research, Univ. Hospital Düsseldorf, Heinrich-Heine University, Düsseldorf, Germany.
  • Timo Dickscheid
    Institute of Neuroscience and Medicine (INM-1), Forschungszentrum Jülich, Jülich, Germany.