Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy.

Journal: Scientific reports
Published Date:

Abstract

Simultaneous point-by-point raster scanning of optical and acoustic beams has been widely adapted to high-speed photoacoustic microscopy (PAM) using a water-immersible microelectromechanical system or galvanometer scanner. However, when using high-speed water-immersible scanners, the two consecutively acquired bidirectional PAM images are misaligned with each other because of unstable performance, which causes a non-uniform time interval between scanning points. Therefore, only one unidirectionally acquired image is typically used; consequently, the imaging speed is reduced by half. Here, we demonstrate a scanning framework based on a deep neural network (DNN) to correct misaligned PAM images acquired via bidirectional raster scanning. The proposed method doubles the imaging speed compared to that of conventional methods by aligning nonlinear mismatched cross-sectional B-scan photoacoustic images during bidirectional raster scanning. Our DNN-assisted raster scanning framework can further potentially be applied to other raster scanning-based biomedical imaging tools, such as optical coherence tomography, ultrasound microscopy, and confocal microscopy.

Authors

  • Jongbeom Kim
    Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH), Pohang, 37673, Republic of Korea.
  • Dongyoon Lee
    Departments of Electrical Engineering, Mechanical Engineering, Convergence IT Engineering, Interdisciplinary Bioscience and Bioengineering, Medical Device Innovation Center, Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), 77 Cheongam-ro, Nam-gu, Pohang, Gyeongbuk, 37673, Republic of Korea.
  • Hyokyung Lim
    Departments of Electrical Engineering, Mechanical Engineering, Convergence IT Engineering, Interdisciplinary Bioscience and Bioengineering, Medical Device Innovation Center, Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), 77 Cheongam-ro, Nam-gu, Pohang, Gyeongbuk, 37673, Republic of Korea.
  • Hyekyeong Yang
    Departments of Electrical Engineering, Mechanical Engineering, Convergence IT Engineering, Interdisciplinary Bioscience and Bioengineering, Medical Device Innovation Center, Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), 77 Cheongam-ro, Nam-gu, Pohang, Gyeongbuk, 37673, Republic of Korea.
  • Jaewoo Kim
    Departments of Electrical Engineering, Mechanical Engineering, Convergence IT Engineering, Interdisciplinary Bioscience and Bioengineering, Medical Device Innovation Center, Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), 77 Cheongam-ro, Nam-gu, Pohang, Gyeongbuk, 37673, Republic of Korea.
  • Jeesu Kim
    Department of Optics and Mechatronics Engineering, Pusan National University, Busan, 46241, Republic of Korea.
  • Yeonggeun Kim
    Departments of Electrical Engineering, Mechanical Engineering, Convergence IT Engineering, Interdisciplinary Bioscience and Bioengineering, Medical Device Innovation Center, Graduate School of Artificial Intelligence, Pohang University of Science and Technology (POSTECH), 77 Cheongam-ro, Nam-gu, Pohang, Gyeongbuk, 37673, Republic of Korea.
  • Hyung Ham Kim
    Department of Convergence IT Engineering, Pohang University of Science and Technology, Pohang, 37673, Republic of Korea.
  • Chulhong Kim