Collaborative Integration of AI and Human Expertise to Improve Detection of Chest Radiograph Abnormalities.

Journal: Radiology. Artificial intelligence
Published Date: Jul 16, 2025

Abstract

Purpose To develop a collaborative AI system that integrates eye gaze data and radiology reports to improve diagnostic accuracy in chest radiograph interpretation by identifying and correcting perceptual errors. Materials and Methods This retrospective study utilized public datasets REFLACX and EGD-CXR to develop a collaborative AI solution, named Collaborative Radiology Expert (CoRaX). It employs a large multimodal model to analyze image embeddings, eye gaze data, and radiology reports, aiming to rectify perceptual errors in chest radiology. The proposed system was evaluated using two simulated error datasets featuring random and uncertain alterations of five abnormalities. Evaluation focused on the system's referral-making process, the quality of referrals, and its performance within collaborative diagnostic settings. Results In the random masking-based error dataset, 28.0% (93/332) of abnormalities were altered. The system successfully corrected 21.3% (71/332) of these errors, with 6.6% (22/332) remaining unresolved. The accuracy of the system in identifying the correct regions of interest for missed abnormalities was 63.0% [95% CI: 59.0%, 68.0%], and 85.7% (240/280) of interactions with radiologists were deemed satisfactory, meaning that the system provided diagnostic aid to radiologists. In the uncertainty-masking-based error dataset, 43.9% (146/332) of abnormalities were altered. The system corrected 34.6% (115/332) of these errors, with 9.3% (31/332) unresolved. The accuracy of predicted regions of missed abnormalities for this dataset was 58.0% [95% CI: 55.0%, 62.0%], and 78.4% (233/297) of interactions were satisfactory. Conclusion The CoRaX system can collaborate efficiently with radiologists and address perceptual errors across various abnormalities in chest radiographs. ©RSNA, 2025.

Authors

  • Akash Awasthi
    Department of Electrical and Computer Engineering, University of Houston, 4222 Martin Luther King Blvd, Cullen College of Engineering Building-1, Rm N368, Houston, TX 77204.
  • Ngan Le
    AICV Lab, Department of EECS, University of Arkansas, AR 72701, USA. Electronic address: thile@uark.edu.
  • Zhigang Deng
    Department of Computer Science, University of Houston, Houston, Texas, USA.
  • Carol C Wu
    University of Texas MD Anderson Cancer Center, Houston, Texas.
  • Hien Van Nguyen
    Department of Biomedical Engineering, University of Houston, Houston, USA.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals