Radiologist-AI Collaboration for Ischemia Diagnosis in Small Bowel Obstruction: Multicentric Development and External Validation of a Multimodal Deep Learning Model
Journal:
medRxiv
Published Date:
Jan 1, 2025
Abstract
To develop and externally validate a multimodal AI model for detecting ischaemia complicating small-bowel obstruction (SBO). We combined 3D CT data with routine laboratory markers (C-reactive protein, neutrophil count) and, optionally, radiology report text. From two centers, 1,350 CT examinations were curated; 771 confirmed SBO scans were used for model development with patient-level splits. Ischemia labels were defined by surgical confirmation within 24 hours of imaging. Models (MViT, ResNet-101, DaViT) were trained as unimodal and multimodal variants. External testing was used for 66 independent cases from a third center. Two radiologists (attending, resident) read the test set with and without AI assistance. Performance was assessed using AUC, sensitivity, specificity, and 95% bootstrap confidence intervals; predictions included a confidence score. The image-plus-laboratory model performed best on external testing (AUC 0.69 [0.59–0.79], sensitivity 0.89 [0.76–1.00], and specificity 0.44 [0.35–0.54]). Adding report text improved internal validation but did not generalize externally; image+text and full multimodal variants did not exceed image+laboratory performance. Without AI, the attending outperformed the resident (AUC 0.745 [0.617–0.845] vs 0.706 [0.581–0.818]); with AI, both improved, attending 0.752 [0.637–0.853] and resident 0.752 [0.629–0.867], rising to 0.750 [0.631–0.839] and 0.773 [0.657–0.867] with confidence display; differences were not statistically significant. A multimodal AI that combines CT images with routine laboratory markers outperforms single-modality approaches and boosts radiologist readers’ performance notably junior, supporting earlier, more consistent decisions within the first 24 hours. A multimodal artificial intelligence (AI) model that combines CT images with laboratory markers detected ischemia in small-bowel obstruction with AUC 0.69 (95% CI 0.59–0.79) and sensitivity 0.89 (0.76–1.00) on external testing, outperforming single-modality models. Adding report text did not generalize across sites: the image+text model fell from AUC 0.82 (internal) to 0.53 (external), and adding text to image+biology left external AUC unchanged (0.69) with similar specificity (0.43–0.44). With AI assistance both junior and senior readers improved; the junior’s AUC rose from 0.71 to 0.77, reaching senior-level performance. A multicentric AI model combining CT and routine laboratory data (CRP and neutrophilia) improved radiologists’ detection of ischemia in small-bowel obstruction. This tool supports earlier decision-making within the first 24 hours.