Imaging depth adaptive resolution enhancement for optical coherence tomography via deep neural network with external attention.

Journal: Physics in medicine and biology
Published Date:

Abstract

Optical coherence tomography (OCT) is a promising non-invasive imaging technique that owns many biomedical applications. In this paper, a deep neural network is proposed for enhancing the spatial resolution of OCTimages. Different from the previous reports, the proposed can recover high-resolutionimages from low-resolutionimages at arbitrary imaging depth. This kind of imaging depth adaptive resolution enhancement is achieved through an external attention mechanism, which takes advantage of morphological similarity between the arbitrary-depth and full-depthimages. Firstly, the deep feature maps are extracted by a feature extraction network from the arbitrary-depth and full-depthimages. Secondly, the morphological similarity between the deep feature maps is extracted and utilized to emphasize the features strongly correlated to the vessel structures by using the external attention network. Finally, the SR image is recovered from the enhanced feature map through an up-sampling network. The proposed network is tested on a clinical skin OCT data set and an open-access retinal OCT dataset. The results show that the proposed external attention mechanism can suppress invalid features and enhance significant features in our tasks. For all tests, the proposed SR network outperformed the traditional image interpolation method, e.g. bi-cubic method, and the state-of-the-art image super-resolution networks, e.g. enhanced deep super-resolution network, residual channel attention network, and second-order attention network. The proposed method may increase the quantitative clinical assessment of micro-vascular diseases which is limited by OCT imaging device resolution.

Authors

  • Shangjie Ren
    Tianjin Key Laboratory of Process Measurement and Control, School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, People's Republic of China.
  • Xiongri Shen
    Tianjin Key Laboratory of Process Measurement and Control, School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, People's Republic of China.
  • Jingjiang Xu
    School of Physics and Optoelectronic Engineering, Foshan University, Foshan, 528000, People's Republic of China.
  • Liang Li
    School of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China.
  • Haixia Qiu
    Department of Laser Medicine, the First Medical Centre, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China.
  • Haibo Jia
    Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China.
  • Xining Wu
    Tianjin Horimed Technology Co., Ltd., Tianjin, 300308, People's Republic of China.
  • Defu Chen
    Institute of Engineering Medicine, Beijing Institute of Technology, Beijing, 100081, People's Republic of China.
  • Shiyong Zhao
    Tianjin Horimed Technology Co., Ltd., Tianjin, 300308, People's Republic of China.
  • Bo Yu
    Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China.
  • Ying Gu
    Department of Radiation Oncology, Jinling Hospital, Nanjing, Jiangsu, 210002, China.
  • Feng Dong
    School of Economics and Management, China University of Mining and Technology, Xuzhou 221116, China.