3D high resolution generative deep-learning network for fluorescence microscopy imaging.

Journal: Optics letters
Published Date:

Abstract

Microscopic fluorescence imaging serves as a basic tool in many research areas including biology, medicine, and chemistry. With the help of optical clearing, large volume imaging of a mouse brain and even a whole body has been enabled. However, constrained by the physical principles of optical imaging, volume imaging has to balance imaging resolution and speed. Here, we develop a new, to the best of our knowledge, 3D deep learning network based on a dual generative adversarial network (dual-GAN) framework for recovering high-resolution (HR) volume images from high speed acquired low-resolution (LR) volume images. The proposed method does not require a precise image registration process and meanwhile guarantees the predicted HR volume image faithful to its corresponding LR volume image. The results demonstrated that our method can recover ${20} {\times} /1.0\text-{\rm NA}$20×/1.0-NA volume images from coarsely registered ${5} {\times} /0.16\text-{\rm NA}$5×/0.16-NA volume images collected by light-sheet microscopy. This method would provide great potential in applications which require high resolution volume imaging.

Authors

  • Hang Zhou
    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Ministry of Education of China, Shanghai, China.
  • Ruiyao Cai
    Institute for Tissue Engineering and Regenerative Medicine (iTERM), Helmholtz Zentrum München, 85764 Neuherberg, Germany; Institute for Stroke and Dementia Research, Klinikum der Universität München, Ludwig Maximilian University of Munich (LMU), 81377 Munich, Germany.
  • Tingwei Quan
    Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China. quantingwei@hust.edu.cn.
  • Shijie Liu
    Department of Chemical Engineering, SUNY College of Environmental Science and Forestry, Syracuse, NY 13210 USA.
  • Shiwei Li
    Department of Pediatric Surgery, West China Hospital, Sichuan University, Chengdu Sichuan, 610041, P.R.China.
  • Qing Huang
    Department of Environmental Health and Occupational Medicine,West China School of Public Health,Sichuan University,Chengdu 610041,China.
  • Ali Ertürk
    Institute for Tissue Engineering and Regenerative Medicine (iTERM), Helmholtz Zentrum München, 85764 Neuherberg, Germany; Institute for Stroke and Dementia Research, Klinikum der Universität München, Ludwig Maximilian University of Munich (LMU), 81377 Munich, Germany; Munich Cluster for Systems Neurology (SyNergy), 81377 Munich, Germany. Electronic address: erturk@helmholtz-muenchen.de.
  • Shaoqun Zeng
    Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China.