Deep learning for cellular image analysis.

Journal: Nature methods
Published Date:

Abstract

Recent advances in computer vision and machine learning underpin a collection of algorithms with an impressive ability to decipher the content of images. These deep learning algorithms are being applied to biological images and are transforming the analysis and interpretation of imaging data. These advances are positioned to render difficult analyses routine and to enable researchers to carry out new, previously impossible experiments. Here we review the intersection between deep learning and cellular image analysis and provide an overview of both the mathematical mechanics and the programming frameworks of deep learning that are pertinent to life scientists. We survey the field's progress in four key applications: image classification, image segmentation, object tracking, and augmented microscopy. Last, we relay our labs' experience with three key aspects of implementing deep learning in the laboratory: annotating training data, selecting and training a range of neural network architectures, and deploying solutions. We also highlight existing datasets and implementations for each surveyed application.

Authors

  • Erick Moen
    Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA.
  • Dylan Bannon
    Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA.
  • Takamasa Kudo
    Department of Chemical and Systems Biology, Stanford University, Stanford, California, United States of America.
  • William Graf
    Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA.
  • Markus Covert
    Department of Bioengineering, Stanford University, Stanford, CA, USA.
  • David Van Valen
    Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA, USA. vanvalen@caltech.edu.