[Automatic anatomical site recognition of laryngoscopic images using convolutional neural network].

Journal: Lin chuang er bi yan hou tou jing wai ke za zhi = Journal of clinical otorhinolaryngology head and neck surgery
PMID:

Abstract

To explore the automatic recognition and classification of 20 anatomical sites in laryngoscopy by an artificial intelligence(AI) quality control system using convolutional neural network(CNN). Laryngoscopic image data archived from laryngoscopy examinations at the Department of Endoscopy, Cancer Hospital, Chinese Academy of Medical Sciences from January to December 2018 were collected retrospectively, and a CNN model was constructed using Inception-ResNet-V2+SENet. Using 14000 electronic laryngoscope images as the training set, these images were classified into 20 specific anatomical sites including the whole head and neck, and their performance was tested by 2000 laryngoscope images and 10 laryngoscope videos. The average time of the trained CNN model for recognition of each laryngoscopic image was(20.59 ± 1.55) ms, and the overall accuracy of recognition of 20 anatomical sites in laryngoscopic images was 97.75%(1955/2000), with average sensitivity, specificity, positive predictive value, and negative predictive value of 100%, 99.88%, 97.76%, and 99.88%, respectively. The model had an accuracy of ≥ 99% for the identification of 20 anatomical sites in laryngoscopic videos. This study confirms that the CNN-based AI system can perform accurate and fast classification and identification of anatomical sites in laryngoscopic pictures and videos, which can be used for quality control of photo documentation in laryngoscopy and shows potential application in monitoring the performance of laryngoscopy.

Authors

  • Meiling Wang
    School of Communications and Information Engineering, Xi'an University of Posts and Telecommunications, Xi'an, China.
  • Jiqing Zhu
    Department of Endoscopy,National Cancer Center,National Clinical Research Center for Cancer,Cancer Hospital,Chinese Academy of Medical Sciences and Peking Union Medical College,Beijing.
  • Ying Li
    School of Information Engineering, Chang'an University, Xi'an 710010, China.
  • Chengwei Tie
    Department of Endoscopy,National Cancer Center,National Clinical Research Center for Cancer,Cancer Hospital,Chinese Academy of Medical Sciences and Peking Union Medical College,Beijing.
  • Shixu Wang
    Department of Endoscopy,National Cancer Center,National Clinical Research Center for Cancer,Cancer Hospital,Chinese Academy of Medical Sciences and Peking Union Medical College,Beijing.
  • Wei Zhang
    The First Affiliated Hospital of Nanchang University, Nanchang, China.
  • Guiqi Wang
    Department of Endoscopy,National Cancer Center,National Clinical Research Center for Cancer,Cancer Hospital,Chinese Academy of Medical Sciences and Peking Union Medical College,Beijing.
  • Xiaoguang Ni
    Department of Endoscopy,National Cancer Center,National Clinical Research Center for Cancer,Cancer Hospital,Chinese Academy of Medical Sciences and Peking Union Medical College,Beijing.