Performance of CAD4TB artificial intelligence technology in TB screening programmes among the adult population in South Africa and Lesotho.

Journal: Journal of clinical tuberculosis and other mycobacterial diseases
Published Date: Jun 4, 2025

Abstract

There is growing evidence of the performance accuracy and potential impact of Computer-Aided Diagnosis (CAD) products in TB-burdened settings. It remains unclear, however, which factors of populations and settings can affect CAD performance. We aimed to investigate the parameters affecting the performance accuracy of the two latest versions of CAD4TB in TB screening programmes in South Africa and Lesotho. We included participants recruited for the Lesotho National Prevalence Survey and the TB TRIAGE + ACCURACY studies, who underwent digital chest radiography and microbiological reference testing for TB. In total, 6,524 chest images were included in the analysis: 288 cases and 6,236 controls. CAD4TB versions 6 and 7 interpreted the X-ray images, and the performance of both versions was investigated. Threshold analyses were performed, as well as subgroup analyses, including age, X-ray hardware and HIV status. CAD4TB v7 showed overall improved performance accuracy compared to v6 (p < 0.01). The area under the ROC curve was 0.833 (95 % CI 0.808-0.859) for v6 and 0.865 (95 % CI 0.842-0.889) for v7. At 90 % sensitivity, v7 showed a higher specificity of 65 % compared to the 54 % achieved by v6. Both versions showed lower performance in the older age group (≥60 years) and individuals with a previous history of TB. The threshold required to achieve the same sensitivity or specificity varies notably across the two versions. CAD4TB performed well as a TB screening tool; however, factors such as software version, age, TB history and X-ray hardware should be considered in threshold determination and performance evaluation.

Authors

  • Nonhlanhla Nzimande
    Division of Public Health Medicine, School of Nursing and Public Health, College of Health Sciences, University of KwaZulu-Natal, Durban, South Africa.
  • Keelin Murphy
    From the Diagnostic Image Analysis Group, Radboud University Medical Center, Geert Groteplein 10, Nijmegen 6500 HB, the Netherlands (K.M., E.T.S., S.S., C.M.S., B.v.G.); Department of Radiology, Bernhoven Hospital, Uden, the Netherlands (H.S.); Department of Radiology, Jeroen Bosch Hospital, 's-Hertogenbosch, the Netherlands (A.J.G.K., M.B.J.M.K., T.S., M.R.); Department of Radiology, Meander Medisch Centrum, Amersfoort, the Netherlands (C.M.S.); and Thirona, Nijmegen, the Netherlands (R.H.H.M.P., A.M., J.M.).
  • Klaus Reither
    Swiss Tropical and Public Health Institute, Basel, Switzerland.
  • Shannon Bosman
    Center for Community Based Research, Human Sciences Research Council, Pietermaritzburg, South Africa.
  • Irene Ayakaka
    SolidarMed, Partnerships for Health, Maseru, Lesotho.
  • Tracy R Glass
    Swiss Tropical and Public Health Institute, Allschwil, Switzerland.
  • Fiona Vanobberghen
    Swiss Tropical and Public Health Institute, Allschwil, Switzerland.
  • Bart K M Jacobs
    Department of Clinical Sciences, Institute of Tropical Medicine, Antwerp, Belgium.
  • Aita Signorell
    Swiss Tropical and Public Health Institute, Allschwil, Switzerland.
  • Jabulani Ncayiyana
    Division of Public Health Medicine, School of Nursing and Public Health, College of Health Sciences, University of KwaZulu-Natal, Durban, South Africa.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals