Training certified detectives to track down the intrinsic shortcuts in COVID-19 chest x-ray data sets.

Journal: Scientific reports
Published Date: Aug 4, 2023

Abstract

Deep learning faces a significant challenge wherein the trained models often underperform when used with external test data sets. This issue has been attributed to spurious correlations between irrelevant features in the input data and corresponding labels. This study uses the classification of COVID-19 from chest x-ray radiographs as an example to demonstrate that the image contrast and sharpness, which are characteristics of a chest radiograph dependent on data acquisition systems and imaging parameters, can be intrinsic shortcuts that impair the model's generalizability. The study proposes training certified shortcut detective models that meet a set of qualification criteria which can then identify these intrinsic shortcuts in a curated data set.

Authors

  • Ran Zhang
    Jiangsu Province Key Laboratory of Drug Metabolism and Pharmacokinetics, China Pharmaceutical University, Nanjing, Jiangsu, 210009, China.
  • Dalton Griner
    From the Departments of Medical Physics (R.Z., X.T., C.Z., D.G., J.W.G., K.L., S.B.R., G.H.C.) and Radiology (M.L.S., J.W.G., K.L., S.B.R., G.H.C.), University of Wisconsin-Madison School of Medicine and Public Health, 1111 Highland Ave, Madison, WI 53705; and Department of Radiology, Henry Ford Health System, Detroit, Mich (Z.Q., N.B.B., T.K.S., J.D.N,).
  • John W Garrett
    From the Departments of Medical Physics (R.Z., X.T., C.Z., D.G., J.W.G., K.L., S.B.R., G.H.C.) and Radiology (M.L.S., J.W.G., K.L., S.B.R., G.H.C.), University of Wisconsin-Madison School of Medicine and Public Health, 1111 Highland Ave, Madison, WI 53705; and Department of Radiology, Henry Ford Health System, Detroit, Mich (Z.Q., N.B.B., T.K.S., J.D.N,).
  • Zhihua Qi
    From the Departments of Medical Physics (R.Z., X.T., C.Z., D.G., J.W.G., K.L., S.B.R., G.H.C.) and Radiology (M.L.S., J.W.G., K.L., S.B.R., G.H.C.), University of Wisconsin-Madison School of Medicine and Public Health, 1111 Highland Ave, Madison, WI 53705; and Department of Radiology, Henry Ford Health System, Detroit, Mich (Z.Q., N.B.B., T.K.S., J.D.N,).
  • Guang-Hong Chen

Keywords

External Resources

Popular Topics
Recent Journals