Deep learning extended depth-of-field microscope for fast and slide-free histology.

Journal: Proceedings of the National Academy of Sciences of the United States of America
Published Date:

Abstract

Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells-a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.

Authors

  • Lingbo Jin
    Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005.
  • Yubo Tang
    Department of Bioengineering, Rice University, Houston, TX 77005, USA.
  • Yicheng Wu
    National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi'an 710072, China.
  • Jackson B Coole
    Department of Bioengineering, Rice University, Houston, TX 77005.
  • Melody T Tan
    Department of Bioengineering, Rice University, Houston, TX 77005.
  • Xuan Zhao
    Department of Orthopedics & Elderly Spinal Surgery, Xuanwu Hospital of Capital Medical University, National Clinical Research Center for Geriatric Diseases, Beijing, China.
  • Hawraa Badaoui
    Department of Head and Neck Surgery, University of Texas MD Anderson Cancer Center, Houston, TX 77030.
  • Jacob T Robinson
    Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005.
  • Michelle D Williams
    Department of Pathology, University of Texas MD Anderson Cancer Center, Houston, TX 77030.
  • Ann M Gillenwater
    Department of Head and Neck Surgery, University of Texas MD Anderson Cancer Center, Houston, TX 77030.
  • Rebecca R Richards-Kortum
    Department of Bioengineering, Rice University, Houston, TX 77005, USA.
  • Ashok Veeraraghavan
    Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005; rkortum@rice.edu vashok@rice.edu.