Harvard Glaucoma Fairness: A Retinal Nerve Disease Dataset for Fairness Learning and Fair Identity Normalization.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Fairness (also known as equity interchangeably) in machine learning is important for societal well-being, but limited public datasets hinder its progress. Currently, no dedicated public medical datasets with imaging data for fairness learning are available, though underrepresented groups suffer from more health issues. To address this gap, we introduce Harvard Glaucoma Fairness (Harvard-GF), a retinal nerve disease dataset including 3,300 subjects with both 2D and 3D imaging data and balanced racial groups for glaucoma detection. Glaucoma is the leading cause of irreversible blindness globally with Blacks having doubled glaucoma prevalence than other races. We also propose a fair identity normalization (FIN) approach to equalize the feature importance between different identity groups. Our FIN approach is compared with various state-of-the-art fairness learning methods with superior performance in the racial, gender, and ethnicity fairness tasks with 2D and 3D imaging data, demonstrating the utilities of our dataset Harvard-GF for fairness learning. To facilitate fairness comparisons between different models, we propose an equity-scaled performance measure, which can be flexibly used to compare all kinds of performance metrics in the context of fairness. The dataset and code are publicly accessible via https://ophai.hms.harvard.edu/datasets/harvard-gf3300/.

Authors

  • Yan Luo
    School of Public Health and Management, Research Center for Medicine and Social Development, Innovation Center for Social risk Governance in Health, Chongqing Medical University, Chongqing 400016, China.
  • Yu Tian
    Key Laboratory of Development and Maternal and Child Diseases of Sichuan Province, Department of Pediatrics, Sichuan University, Chengdu, China.
  • Min Shi
    School of Education, Fuzhou University of International Studies and Trade, 350000, China.
  • Louis R Pasquale
    Eye and Vision Research Institute, Icahn School of Medicine at Mount Sinai, New York, New York; Channing Division of Network Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
  • Lucy Q Shen
    Massachusetts Eye and Ear, Harvard Medical School, Boston, Massachusetts.
  • Nazlee Zebardast
    Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston (A.V.S., T.E., J.L.W., N.Z.).
  • Tobias Elze
    Schepens Eye Research Institute, Harvard Medical School, Boston, Massachusetts; Complex Structures in Biology and Cognition, Max Planck Institute for Mathematics in the Sciences, Leipzig, Germany. Electronic address: tobias-elze@tobias-elze.de.
  • Mengyu Wang
    Schepens Eye Research Institute, Harvard Medical School, Boston, Massachusetts.