Comparative evaluation of image-based vs. text-based vs. multimodal AI approaches for automatic breast density assessment in mammograms.

Journal: Computer methods and programs in biomedicine
PMID:

Abstract

BACKGROUND AND OBJECTIVES: In the last decade, there has been a growing interest in applying artificial intelligence (AI) systems to breast cancer assessment, including breast density evaluation. However, few models have been developed to integrate textual mammographic reports and mammographic images. Our aims are (1) to generate a natural language processing (NLP)-based AI system, (2) to evaluate an external image-based software, and (3) to develop a multimodal system, using the late fusion approach, by integrating image and text inferences for the automatic classification of breast density according to the American College of Radiology (ACR) guidelines in mammograms and radiological reports.

Authors

  • Pilar López-Úbeda
    Universidad de Jaén, Jaén, Andalucía, Spain.
  • Teodoro Martín-Noguerol
    MRI Unit, Radiology Department, HT médica Carmelo Torres 2, Jaén 23007, Spain. Electronic address: t.martin.f@htime.org.
  • Félix Paulano-Godino
    3D Printing Unit, Engineering Department, Health Time, Jaén, Spain.
  • Antonio Luna
    MRI Unit, Radiology Department, Health Time, Jaén, Spain. Electronic address: aluna70@htime.org.