Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning.

Journal: Cell
Published Date: Feb 22, 2018

Abstract

The implementation of clinical-decision support algorithms for medical imaging faces challenges with reliability and interpretability. Here, we establish a diagnostic tool based on a deep-learning framework for the screening of patients with common treatable blinding retinal diseases. Our framework utilizes transfer learning, which trains a neural network with a fraction of the data of conventional approaches. Applying this approach to a dataset of optical coherence tomography images, we demonstrate performance comparable to that of human experts in classifying age-related macular degeneration and diabetic macular edema. We also provide a more transparent and interpretable diagnosis by highlighting the regions recognized by the neural network. We further demonstrate the general applicability of our AI system for diagnosis of pediatric pneumonia using chest X-ray images. This tool may ultimately aid in expediting the diagnosis and referral of these treatable conditions, thereby facilitating earlier treatment, resulting in improved clinical outcomes. VIDEO ABSTRACT.

Authors

  • Daniel S Kermany
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Michael Goldbaum
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Wenjia Cai
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Carolina C S Valentim
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Huiying Liang
    Institute of Pediatrics, Guangzhou Women and Children's Medical Center, Guangzhou Medical University, Guangzhou, China.
  • Sally L Baxter
    Viterbi Family Department of Ophthalmology, University of California, San Diego, La Jolla.
  • Alex McKeown
    Heidelberg Engineering, Heidelberg, Germany.
  • Ge Yang
    Key Laboratory of Agricultural Animal Genetics, Breeding and Reproduction, Ministry of Education, Huazhong Agricultural University, Wuhan, Hubei Province, 430070 China.
  • Xiaokang Wu
    Molecular Medicine Research Center, State Key Laboratory of Biotherapy, The National Clinical Research Center of Senile Disease, West China Hospital, Sichuan University, Chengdu, China.
  • Fangbing Yan
    Molecular Medicine Research Center, State Key Laboratory of Biotherapy, The National Clinical Research Center of Senile Disease, West China Hospital, Sichuan University, Chengdu, China.
  • Justin Dong
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China.
  • Made K Prasadha
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Jacqueline Pei
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Magdalene Y L Ting
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Jie Zhu
    Department of Digestive Diseases, Huashan Hospital, Fudan University, Shanghai 200040, P.R. China.
  • Christina Li
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Sierra Hewett
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Jason Dong
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China.
  • Ian Ziyar
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Alexander Shi
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Runze Zhang
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Lianghong Zheng
    YouHealth AI, 510005 Guangzhou, China.
  • Rui Hou
    Guangzhou KangRui Biological Pharmaceutical Technology Company, 510005 Guangzhou, China.
  • William Shi
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Xin Fu
    State Key Laboratory of Fluid Power Transmission and Control, Zhejiang University, Hangzhou, China.
  • Yaou Duan
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Viet A N Huu
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Cindy Wen
    Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Edward D Zhang
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Charlotte L Zhang
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Oulan Li
    Guangzhou Women and Children's Medical Center, Guangzhou Medical University, 510005 Guangzhou, China; Shiley Eye Institute, Institute for Engineering in Medicine, Institute for Genomic Medicine, University of California, San Diego, La Jolla, CA 92093, USA.
  • Xiaobo Wang
    Beihai Hospital, Dalian, 116021, China.
  • Michael A Singer
    Department of Ophthalmology, University of Texas Health Science Center, San Antonio, TX 78229, USA.
  • Xiaodong Sun
    Shanghai Key Laboratory of Ocular Fundus Diseases, Shanghai General Hospital, Shanghai JiaoTong University, 200080 Shanghai, China.
  • Jie Xu
    Second Affiliated Hospital Zhejiang University School of Medicine, Hangzhou, Zhejiang Province 310000, China.
  • Ali Tafreshi
    Heidelberg Engineering, Heidelberg, Germany.
  • M Anthony Lewis
    Qualcomm, San Diego, CA 92121, USA.
  • Huimin Xia
    Department of Pediatric Surgery, Guangzhou Women and Children's Medical Center, Guangzhou Medical University, Guangzhou, China. xia-huimin@foxmail.com.
  • Kang Zhang
    Xifeng District People's Hospital, Qingyang, China.

Keywords

External Resources

Popular Topics
Recent Journals