In Vivo Intelligent Fluorescence Endo-Microscopy by Varifocal Meta-Device and Deep Learning.

Journal: Advanced science (Weinheim, Baden-Wurttemberg, Germany)
Published Date:

Abstract

Endo-microscopy is crucial for real-time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta-device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo-microscope is developed based on varifocal meta-lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta-lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field-of-view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high-resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.

Authors

  • Yu-Hsin Chia
    Department of Biomedical Engineering, National Taiwan University, Taipei, 10051, Taiwan.
  • Wei-Hao Liao
    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital & National Taiwan University College of Medicine, Taipei, 10051, Taiwan.
  • Sunil Vyas
  • Cheng Hung Chu
    YongLin Institute of Health, National Taiwan University, Taipei, 10087, Taiwan.
  • Takeshi Yamaguchi
    Division of Medical Oncology, Japanese Red Cross Musashino Hospital.
  • Xiaoyuan Liu
    Department of Electrical Engineering, City University of Hong Kong, Kowloon, Hong Kong 999077.
  • Takuo Tanaka
    Innovative Photon Manipulation Research Team, RIKEN Center for Advanced Photonics, Saitama, 351-0198, Japan.
  • Yi-You Huang
  • Mu Ku Chen
    Department of Electrical Engineering, City University of Hong Kong, Kowloon, Hong Kong 999077.
  • Wen-Shiang Chen
  • Din Ping Tsai
    Department of Electrical Engineering, City University of Hong Kong, Kowloon, Hong Kong 999077.
  • Yuan Luo
    Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL 60611, USA.