Impact of Gold-Standard Label Errors on Evaluating Performance of Deep Learning Models in Diabetic Retinopathy Screening: Nationwide Real-World Validation Study.

Journal: Journal of medical Internet research
Published Date: Aug 14, 2024

Abstract

BACKGROUND: For medical artificial intelligence (AI) training and validation, human expert labels are considered the gold standard that represents the correct answers or desired outputs for a given data set. These labels serve as a reference or benchmark against which the model's predictions are compared.

Authors

  • Yueye Wang
    State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, 510060, China.
  • Xiaotong Han
    From the State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science (J.Z., A.J., X.H., Y.Z., X.Q., X.T., L.L., Y.L.), Guangzhou, China; Guangdong Provincial Clinical Research Center for Ocular Diseases (J.Z., A.J., X.H., Y.Z., X.Q., X.T., L.L., Y.L.), Guangzhou, China.
  • Cong Li
    Key Laboratory of Synthetic and Natural Functional Molecule Chemistry of Ministry of Education, College of Chemistry and Materials Science, National Demonstration Center for Experimental Chemistry Education, Northwest University, Xi'an, Shaanxi 710127, China. Electronic address: licong@nwu.edu.cn.
  • Lixia Luo
    State Key Laboratory of Ophthalmology, Clinical Research Center for Ocular Disease, Zhongshan Ophthalmic Centre, Sun Yat-sen University, Guangzhou, China.
  • Qiuxia Yin
    State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China.
  • Jian Zhang
    College of Pharmacy, Ningxia Medical University, Yinchuan, NingxiaHui Autonomous Region, China.
  • Guankai Peng
    Guangzhou Vision Tech Medical Technology Co., Ltd., Guangzhou, China.
  • Danli Shi
    State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China.
  • Mingguang He
    State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou 510060, China; Centre for Eye Research Australia; Departments of Ophthalmology and Surgery, University of Melbourne, Melbourne, Australia. Electronic address: mingguang.he@unimelb.edu.au.

Keywords

External Resources

Popular Topics
Recent Journals