Image Segmentation Using Deep Learning: A Survey.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Image segmentation is a key task in computer vision and image processing with important applications such as scene understanding, medical image analysis, robotic perception, video surveillance, augmented reality, and image compression, among others, and numerous segmentation algorithms are found in the literature. Against this backdrop, the broad success of deep learning (DL) has prompted the development of new image segmentation approaches leveraging DL models. We provide a comprehensive review of this recent literature, covering the spectrum of pioneering efforts in semantic and instance segmentation, including convolutional pixel-labeling networks, encoder-decoder architectures, multiscale and pyramid-based approaches, recurrent networks, visual attention models, and generative models in adversarial settings. We investigate the relationships, strengths, and challenges of these DL-based segmentation models, examine the widely used datasets, compare performances, and discuss promising research directions.

Authors

  • Shervin Minaee
  • Yuri Boykov
    Department of computer science, University of Waterloo, ON, Canada.
  • Fatih Porikli
    The Australian National University, Canberra ACT 0200, Australia. Electronic address: fatih.porikli@anu.edu.au.
  • Antonio Plaza
  • Nasser Kehtarnavaz
    Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX 75080, USA.
  • Demetri Terzopoulos
    University of California, Los Angeles, and VoxelCloud, Inc., Los Angeles, CA, USA.