ProtoASNet: Comprehensive evaluation and enhanced performance with uncertainty estimation for aortic stenosis classification in echocardiography.

Journal: Medical image analysis
Published Date:

Abstract

Aortic stenosis (AS) is a prevalent heart valve disease that requires accurate and timely diagnosis for effective treatment. Current methods for automated AS severity classification rely on black-box deep learning techniques, which suffer from a low level of trustworthiness and hinder clinical adoption. To tackle this challenge, we propose ProtoASNet, a prototype-based neural network designed to classify the severity of AS from B-mode echocardiography videos. ProtoASNet bases its predictions exclusively on the similarity scores between the input and a set of learned spatio-temporal prototypes, ensuring inherent interpretability. Users can directly visualize the similarity between the input and each prototype, as well as the weighted sum of similarities. This approach provides clinically relevant evidence for each prediction, as the prototypes typically highlight markers such as calcification and restricted movement of aortic valve leaflets. Moreover, ProtoASNet utilizes abstention loss to estimate aleatoric uncertainty by defining a set of prototypes that capture ambiguity and insufficient information in the observed data. This feature augments prototype-based models with the ability to explain when they may fail. We evaluate ProtoASNet on a private dataset and the publicly available TMED-2 dataset. It surpasses existing state-of-the-art methods, achieving a balanced accuracy of 80.0% on our private dataset and 79.7% on the TMED-2 dataset, respectively. By discarding cases flagged as uncertain, ProtoASNet achieves an improved balanced accuracy of 82.4% on our private dataset. Furthermore, by offering interpretability and an uncertainty measure for each prediction, ProtoASNet improves transparency and facilitates the interactive usage of deep networks in aiding clinical decision-making. Our source code is available at: https://github.com/hooman007/ProtoASNet.

Authors

  • Ang Nan Gu
    Department of Electrical and Computer Engineering, The University of British Columbia, 2332 Main Mall, Vancouver, BC V6T 1Z4, Canada. Electronic address: guangnan@ece.ubc.ca.
  • Hooman Vaseli
  • Michael Y Tsang
    Vancouver General Hospital, Jim Pattison Pavilion, 899 W 12th Ave, Vancouver, BC V5Z 1M9, Canada.
  • Victoria Wu
    Department of Electrical and Computer Engineering, The University of British Columbia, 2332 Main Mall, Vancouver, BC V6T 1Z4, Canada.
  • S Neda Ahmadi Amiri
    Department of Electrical and Computer Engineering, The University of British Columbia, 2332 Main Mall, Vancouver, BC V6T 1Z4, Canada.
  • Nima Kondori
    Department of Electrical and Computer Engineering, The University of British Columbia, 2332 Main Mall, Vancouver, BC V6T 1Z4, Canada.
  • Andrea Fung
    Department of Electrical and Computer Engineering, The University of British Columbia, 2332 Main Mall, Vancouver, BC V6T 1Z4, Canada.
  • Teresa S M Tsang
    Division of Cardiology, University of British Columbia, Vancouver, BC, Canada. t.tsang@ubc.ca.
  • Purang Abolmaesumi