Fusion Modeling: Combining Clinical and Imaging Data to Advance Cardiac Care.

Journal: Circulation. Cardiovascular imaging
Published Date: Dec 11, 2023

Abstract

In addition to the traditional clinical risk factors, an increasing amount of imaging biomarkers have shown value for cardiovascular risk prediction. Clinical and imaging data are captured from a variety of data sources during multiple patient encounters and are often analyzed independently. Initial studies showed that fusion of both clinical and imaging features results in superior prognostic performance compared with traditional scores. There are different approaches to fusion modeling, combining multiple data resources to optimize predictions, each with its own advantages and disadvantages. However, manual extraction of clinical and imaging data is time and labor intensive and often not feasible in clinical practice. An automated approach for clinical and imaging data extraction is highly desirable. Convolutional neural networks and natural language processing can be utilized for the extraction of electronic medical record data, imaging studies, and free-text data. This review outlines the current status of cardiovascular risk prediction and fusion modeling; and in addition gives an overview of different artificial intelligence approaches to automatically extract data from images and electronic medical records for this purpose.

Authors

  • Marly van Assen
    Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Ashley River Tower, 25 Courtenay Dr, Charleston, SC 29425-2260 (S.S.M., D.M., M.v.A., C.N.D.C., R.R.B., C.T., A.V.S., A.M.F., B.E.J., L.P.G., U.J.S.); Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany (S.S.M., T.J.V.); Stanford University School of Medicine, Department of Radiology, Stanford, Calif (D.M.); Division of Cardiothoracic Imaging, Nuclear Medicine and Molecular Imaging, Department of Radiology and Imaging Sciences, Emory University, Atlanta, Ga (C.N.D.C.); Division of Cardiology, Department of Medicine, Medical University of South Carolina, Charleston, SC (R.R.B.); Department of Cardiology and Intensive Care Medicine, Heart Center Munich-Bogenhausen, Munich, Germany (C.T.); Department of Cardiology, Munich University Clinic, Ludwig-Maximilians-University, Munich, Germany (C.T.); Siemens Medical Solutions USA, Malvern, Pa (P.S.); and Department of Emergency Medicine, Medical University of South Carolina, Charleston, SC (A.J.M.).
  • Amara Tariq
    Department of Biomedical Informatics, Emory School of Medicine, Atlanta, Georgia. Electronic address: amara.tariq2@emory.edu.
  • Alexander C Razavi
    Translational Laboratory for Cardiothoracic Imaging and Artificial Intelligence, Emory University, 2015 Uppergate Dr, Atlanta, GA 30307, USA.
  • Carl Yang
    Department of Computer Science, Emory University, Atlanta, United States.
  • Imon Banerjee
    Mayo Clinic, Department of Radiology, Scottsdale, AZ, USA.
  • Carlo N De Cecco
    Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Ashley River Tower, 25 Courtenay Dr, Charleston, SC 29425-2260 (S.S.M., D.M., M.v.A., C.N.D.C., R.R.B., C.T., A.V.S., A.M.F., B.E.J., L.P.G., U.J.S.); Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany (S.S.M., T.J.V.); Stanford University School of Medicine, Department of Radiology, Stanford, Calif (D.M.); Division of Cardiothoracic Imaging, Nuclear Medicine and Molecular Imaging, Department of Radiology and Imaging Sciences, Emory University, Atlanta, Ga (C.N.D.C.); Division of Cardiology, Department of Medicine, Medical University of South Carolina, Charleston, SC (R.R.B.); Department of Cardiology and Intensive Care Medicine, Heart Center Munich-Bogenhausen, Munich, Germany (C.T.); Department of Cardiology, Munich University Clinic, Ludwig-Maximilians-University, Munich, Germany (C.T.); Siemens Medical Solutions USA, Malvern, Pa (P.S.); and Department of Emergency Medicine, Medical University of South Carolina, Charleston, SC (A.J.M.).

Keywords

External Resources

Popular Topics
Recent Journals