An End-to-End Platform for Digital Pathology Using Hyperspectral Autofluorescence Microscopy and Deep Learning-Based Virtual Histology.

Journal: Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc
Published Date:

Abstract

Conventional histopathology involves expensive and labor-intensive processes that often consume tissue samples, rendering them unavailable for other analyses. We present a novel end-to-end workflow for pathology powered by hyperspectral microscopy and deep learning. First, we developed a custom hyperspectral microscope to nondestructively image the autofluorescence of unstained tissue sections. We then trained a deep learning model to use autofluorescence to generate virtual histologic stains, which avoids the cost and variability of chemical staining procedures and conserves tissue samples. We showed that the virtual images reproduce the histologic features present in the real-stained images using a randomized nonalcoholic steatohepatitis (NASH) scoring comparison study, where both real and virtual stains are scored by pathologists (D.T., A.D.B., R.K.P.). The test showed moderate-to-good concordance between pathologists' scoring on corresponding real and virtual stains. Finally, we developed deep learning-based models for automated NASH Clinical Research Network score prediction. We showed that the end-to-end automated pathology platform is comparable with an independent panel of pathologists for NASH Clinical Research Network scoring when evaluated against the expert pathologist consensus scores. This study provides proof of concept for this virtual staining strategy, which could improve cost, efficiency, and reliability in pathology and enable novel approaches to spatial biology research.

Authors

  • Carson McNeil
    Verily Life Sciences LLC, South San Francisco, California. Electronic address: cmcneil@verily.com.
  • Pok Fai Wong
    Department of Pathology, Yale School of Medicine, New Haven, Connecticut.
  • Niranjan Sridhar
    Verily Life Sciences LLC, South San Francisco, California. Electronic address: nirsd@verily.com.
  • Yang Wang
    Department of General Surgery The First People's Hospital of Yunnan Province, The Affiliated Hospital of Kunming University of Science and Technology Kunming China.
  • Charles Santori
    Verily Life Sciences LLC, South San Francisco, California.
  • Cheng-Hsun Wu
    Verily Life Sciences LLC, South San Francisco, California.
  • Andrew Homyk
    Verily Life Sciences LLC, South San Francisco, California.
  • Michael Gutierrez
    Verily Life Sciences LLC, South San Francisco, California.
  • Ali Behrooz
    Verily Life Sciences, South San Francisco, CA, USA.
  • Dina Tiniakos
    Laboratory of Histology & Embryology, Medical School, National and Kapodistrian University of Athens (Dina Tiniakos), Athens, Greece.
  • Alastair D Burt
    Newcastle University, Newcastle upon Tyne, United Kingdom.
  • Rish K Pai
    Department of Pathology and Laboratory Medicine, Mayo Clinic Arizona, Scottsdale, AZ, USA.
  • Kamilla Tekiela
    Verily Life Sciences, South San Francisco, CA, USA.
  • Hardik Patel
    Verily Life Sciences, South San Francisco, CA, USA.
  • Po-Hsuan Cameron Chen
    Google LLC, Mountain View, California.
  • Laurent Fischer
    Allergan plc., Parsippany, New Jersey.
  • Eduardo Bruno Martins
    Allergan plc., Parsippany, New Jersey.
  • Star Seyedkazemi
    Allergan plc., Parsippany, New Jersey.
  • Daniel Freedman
  • Charles C Kim
    Verily Life Sciences LLC, South San Francisco, California.
  • Peter Cimermančič
    Department of Bioengineering and Therapeutic Sciences, University of California, San Francisco, San Francisco, California, USA.