An Electrocardiogram Multi-Task Benchmark with Comprehensive Evaluations and Insightful Findings.

Journal: Studies in health technology and informatics
Published Date:

Abstract

In the process of patient diagnosis, non-invasive measurements are widely used due to their low risks and quick results. Electrocardiogram (ECG), as a non-invasive method to collect heart activities, is used to diagnose cardiac conditions. Analyzing the ECG typically requires domain expertise, which is a roadblock to applying artificial intelligence (AI) for healthcare. Through advances in self-supervised learning and foundation models, AI systems can now acquire and leverage domain knowledge without relying solely on human expertise. However, there is a lack of comprehensive analyses over the foundation models' performance on ECG. This study aims to answer the research question: "Are Foundation Models Useful for ECG Analysis?" To address it, we evaluate language / general time-series / ECG foundation models in comparison with time-series deep learning models. The experimental results show that general time-series / ECG foundation models achieve a top performance rate of 80%, indicating their effectiveness in ECG analysis. In-depth analyses and insights are provided along with comprehensive experimental results. This study highlights the limitations and potential of foundation models in advancing physiological waveform analysis. The code and data for this benchmark are publicly available at https://github.com/yuhaoxu99/ECGMultitasks-Benchmark.

Authors

  • Yuhao Xu
    Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin, China.
  • Jiaying Lu
    State Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing, 100101, China.
  • Sirui Ding
    Bakar Computational Health Sciences Institute, University of California, San Francisco, CA 94158, United States.
  • Defu Cao
    Department of Computer Science, University of Southern California.
  • Xiao Hu
    Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, United States.
  • Carl Yang
    Department of Computer Science, Emory University, Atlanta, United States.