Deep learning-enabled filter-free fluorescence microscope.

Journal: Science advances
Published Date:

Abstract

Optical filtering is an indispensable part of fluorescence microscopy for selectively highlighting molecules labeled with a specific fluorophore and suppressing background noise. However, the utilization of optical filtering sets increases the complexity, size, and cost of microscopic systems, making them less suitable for multifluorescence channel, high-speed imaging. Here, we present filter-free fluorescence microscopic imaging enabled with deep learning-based digital spectral filtering. This approach allows for automatic fluorescence channel selection after image acquisition and accurate prediction of fluorescence by computing color changes due to spectral shifts with the presence of excitation scattering. Fluorescence prediction for cells and tissues labeled with various fluorophores was demonstrated under different magnification powers. The technique offers accurate identification of labeling with robust sensitivity and specificity, achieving consistent results with the reference standard. Beyond fluorescence microscopy, the deep learning-enabled spectral filtering strategy has the potential to drive the development of other biomedical applications, including cytometry and endoscopy.

Authors

  • Bo Dai
    School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China.
  • Shaojie You
    Engineering Research Center of Optical Instrument and System, the Ministry of Education, Shanghai Key Laboratory of Modern Optical System, University of Shanghai for Science and Technology, Shanghai 200093, China.
  • Kan Wang
    Department of Cardiovascular Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China.
  • Yan Long
    Engineering Research Center of Optical Instrument and System, the Ministry of Education, Shanghai Key Laboratory of Modern Optical System, University of Shanghai for Science and Technology, Shanghai 200093, China.
  • Junyi Chen
  • Neil Upreti
    Department of Mechanical Engineering and Materials Science, Duke University, Durham, NC 27709, USA.
  • Jing Peng
  • Lulu Zheng
    School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China.
  • Chenliang Chang
    Engineering Research Center of Optical Instrument and System, the Ministry of Education, Shanghai Key Laboratory of Modern Optical System, University of Shanghai for Science and Technology, Shanghai 200093, China.
  • Tony Jun Huang
  • Yangtai Guan
    Department of Neurology, Punan Branch of Renji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, 200125, PR China. Electronic address: yangtaiguan@sina.com.
  • Songlin Zhuang
    Engineering Research Center of Optical Instrument and System, the Ministry of Education, Shanghai Key Laboratory of Modern Optical System, University of Shanghai for Science and Technology, Shanghai 200093, China.
  • Dawei Zhang