Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction.

Journal: IEEE transactions on big data
Published Date:

Abstract

Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate. Early detection and prevention of HF could significantly reduce its impact. We introduce a novel methodology for predicting HF risk using 12-lead electrocardiograms (ECGs). We present a novel, lightweight dual attention ECG network designed to capture complex ECG features essential for early HF risk prediction, despite the notable imbalance between low and high-risk groups. This network incorporates a cross-lead attention module and 12 lead-specific temporal attention modules, focusing on cross-lead interactions and each lead's local dynamics. To further alleviate model overfitting, we leverage a large language model (LLM) with a public ECG-Report dataset for pretraining on an ECG-Report alignment task. The network is then fine-tuned for HF risk prediction using two specific cohorts from the UK Biobank study, focusing on patients with hypertension (UKB-HYP) and those who have had a myocardial infarction (UKB-MI). The results reveal that LLM-informed pre-training substantially enhances HF risk prediction in these cohorts. The dual attention design not only improves interpretability but also predictive accuracy, outperforming existing competitive methods with C-index scores of 0.6349 for UKB-HYP and 0.5805 for UKB-MI. This demonstrates our method's potential in advancing HF risk assessment with clinical complex ECG data.

Authors

  • Chen Chen
    The George Institute for Global Health, Faculty of Medicine, University of New South Wales, Sydney, NSW, Australia.
  • Lei Li
    Department of Thoracic Surgery, The Affiliated Huaian No.1 People's Hospital of Nanjing Medical University, Huai'an, China.
  • Marcel Beetz
  • Abhirup Banerjee
    Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, OX3 7DQ, UK. Electronic address: abhirup.banerjee@cardiov.ox.ac.uk.
  • Ramneek Gupta
    Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark.
  • Vicente Grau
    Department of Engineering Science, University of Oxford, Oxford, United Kingdom.

Keywords

No keywords available for this article.