JustRAIGS: Justified Referral in AI Glaucoma Screening Challenge.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

A major contributor to permanent vision loss is glaucoma. Early diagnosis is crucial for preventing vision loss due to glaucoma, making glaucoma screening essential. A more affordable method of glaucoma screening can be achieved by applying artificial intelligence to evaluate color fundus photographs (CFPs). We present the Justified Referral in AI Glaucoma Screening (JustRAIGS) challenge to further develop these AI algorithms for glaucoma screening and to assess their efficacy. To support this challenge, we have generated a distinctive big dataset containing more than 110,000 meticulously labeled CFPs obtained from approximately 60,000 patients and 500 distinct screening centers in the USA. Our objective is to assess the practicality of creating advanced and dependable AI systems that can take a CFP as input and produce the probability of referable glaucoma, as well as outputs for glaucoma justification by integrating both binary and multi-label classification tasks. This paper presents the evaluation of solutions provided by nine teams, recognizing the team with the highest level of performance. The highest achieved score of sensitivity at a specificity level of 95% was 85%, and the highest achieved score of Hamming losses average was 0.13. Additionally, we test the top three participants' algorithms on an external dataset to validate the performance and generalization of these models. The outcomes of this research can offer valuable insights into the development of intelligent systems for detecting glaucoma. Ultimately, findings can aid in the early detection and treatment of glaucoma patients, hence decreasing preventable vision impairment and blindness caused by glaucoma.

Authors

  • Yeganeh Madadi
  • Hina Raja
  • Koenraad A Vermeer
    Rotterdam Eye Hospital, Rotterdam, The Netherlands.
  • Hans G Lemij
    Rotterdam Eye Hospital, Rotterdam, The Netherlands.
  • Xiaoqin Huang
    The Pennsylvania State University Great Valley, Malvern, PA, USA.
  • Eunjin Kim
    Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, Republic of Korea.
  • Seunghoon Lee
    Department of Psychiatry, Myongji Hospital, Goyang, Republic of Korea.
  • Gitaek Kwon
    Department of Computer Science, Hanyang University, 222 Wangsimni-Ro, Seongdong-Gu, Seoul, 04763, Republic of Korea.
  • Hyunwoo Kim
    College of Pharmacy and Integrated Research Institute for Drug Development, Dongguk University Seoul, Goyang-si, Republic of Korea.
  • Jaeyoung Kim
    School of Electrical, Electronics, and Computer Engineering, University of Ulsan, Ulsan, South Korea m.m.manjurul@gmail.com, kjy7079@gmail.com, sherazalik@gmail.com, jongmyon.kim@gmail.com.
  • Adrian Galdran
  • Miguel A González Ballester
    Department of Information and Communication Technologies, Universitat Pompeu Fabra, Tànger 122-140, Barcelona 08018, Spain; ICREA, Pg. Lluis Companys 23, Barcelona 08010 Spain.
  • Dan Presil
    NEC Israeli Research Center, Herzliya, Israel.
  • Kristhian Aguilar
  • Victor Cavalcante
  • Celso Carvalho
    Center for R&D in Electronic and Information Technology (CETELI), Department of Electronics and Computing (DTEC), Federal University of Amazonas (UFAM), Manaus 69067005, Brazil.
  • Waldir Sabino
    Center for R&D in Electronic and Information Technology (CETELI), Department of Electronics and Computing (DTEC), Federal University of Amazonas (UFAM), Manaus 69067005, Brazil.
  • Mateus Oliveira
    School of Electrical and Computer Engineering, University of Campinas, Campinas, Brazil.
  • Hui Lin
    Department of Mechanical Aerospace and Nuclear Engineering, Rensselaer Polytechnic Institute, Troy, NY, United States of America.
  • Charilaos Apostolidis
  • Aggelos K Katsaggelos
    Department of Electrical and Computer Engineering, McCormick School of Engineering and Applied Science, Northwestern University, Evanston, Illinois.
  • Tomasz Kubrak
  • A Casado-Garcia
  • J Heras
    Department of Mathematics and Computer Science of University of La Rioja, Spain. Electronic address: jonathan.heras@unirioja.es.
  • M Ortega
  • L Ramos
    From the Department of Otolaryngology-Head and Neck Surgery (C.J.M., L.R., V.R.R.), University of Colorado School of Medicine, Aurora, Colorado.
  • Philippe Zhang
    Université de Bretagne Occidentale, Brest, Bretagne, 29200, France; Inserm, UMR 1101, Brest, F-29200, France; Evolucare Technologies, Villers-Bretonneux, F-80800, France.
  • Yihao Li
    LaTIM UMR 1101, Inserm, Brest, France; University of Western Brittany, Brest, France.
  • Jing Zhang
    MOEMIL Laboratory, School of Optoelectronic Information, University of Electronic Science and Technology of China, Chengdu, China.
  • Weili Jiang
    College of New Energy and Materials, China University of Petroleum-Beijing Beijing 102249 China zhouguanglin2@163.com.
  • Pierre-Henri Conze
    Inserm, UMR 1101, Brest F-29200, France; Institut Mines-Télécom Atlantique, Brest F-29200, France.
  • Mathieu Lamard
    Université de Bretagne Occidentale, 3 rue des Archives, Brest F-29200, France; Inserm, UMR 1101, 22 avenue Camille-Desmoulins, Brest F-29200, France.
  • Gwenolé Quellec
    Inserm, UMR 1101, 22 avenue Camille-Desmoulins, Brest F-29200, France. Electronic address: gwenole.quellec@inserm.fr.
  • Mostafa El Habib Daho
    Faculty of Technology, Biomedical Engineering Laboratory Abou Bekr Belkaid University , Tlemcen, Algeria.
  • Madukuri Shaurya
  • Anumeha Varma
  • Monika Agrawal
  • Siamak Yousefi
    Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, Tennessee, United States of America.

Keywords

No keywords available for this article.