Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning.

Journal: Nature methods
Published Date:

Abstract

Light-field microscopy has emerged as a technique of choice for high-speed volumetric imaging of fast biological processes. However, artifacts, nonuniform resolution and a slow reconstruction speed have limited its full capabilities for in toto extraction of dynamic spatiotemporal patterns in samples. Here, we combined a view-channel-depth (VCD) neural network with light-field microscopy to mitigate these limitations, yielding artifact-free three-dimensional image sequences with uniform spatial resolution and high-video-rate reconstruction throughput. We imaged neuronal activities across moving Caenorhabditis elegans and blood flow in a beating zebrafish heart at single-cell resolution with volumetric imaging rates up to 200 Hz.

Authors

  • Zhaoqiang Wang
  • Lanxin Zhu
    School of Optical and Electronic Information-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.
  • Hao Zhang
    College of Mechanical and Electrical Engineering, Henan Agricultural University, Zhengzhou, 450002, China.
  • Guo Li
    School of Optical and Electronic Information-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.
  • Chengqiang Yi
    School of Optical and Electronic Information-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.
  • Yi Li
    Wuhan Zoncare Bio-Medical Electronics Co., Ltd, Wuhan, China.
  • Yicong Yang
    School of Optical and Electronic Information-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.
  • Yichen Ding
  • Mei Zhen
    Lunenfeld-Tanenbaum Research Institute, Mount Sinai Hospital, University of Toronto, Toronto, Ontario, Canada.
  • Shangbang Gao
    College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, China. sgao@hust.edu.cn.
  • Tzung K Hsiai
    School of Medicine, University of California Los Angeles, Los Angeles, CA 90073, USA. THsiai@mednet.ucla.edu.
  • Peng Fei
    Department of Hematology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, 430030, China.