Hierarchically Optimized Multiple Instance Learning With Multi-Magnification Pathological Images for Cerebral Tumor Diagnosis.

Journal: IEEE journal of biomedical and health informatics
Published Date:

Abstract

Accurate diagnosis of cerebral tumors is crucial for effective clinical therapeutics and prognosis. However, limitations in brain biopsy tissues and the scarcity of pathologists specializing in cerebral tumors hinder comprehensive clinical tests for precise diagnosis. To address these challenges, we first established a brain tumor dataset of 3,520 cases collected from multiple centers. We then proposed a novel Hierarchically Optimized Multiple Instance Learning (HOMIL) method for classifying six common brain tumor types, glioma grading, and predicting the origin of brain metastatic cancers. The feature encoder and aggregator in HOMIL were trained alternately based on specific datasets and tasks. Compared to other multiple instance learning (MIL) methods, HOMIL achieved state-of-the-art performance with impressive accuracies: 93.29% / 85.60% for brain tumor classification, 91.21% / 96.93% for glioma grading, and 86.36% / 79.28% for origin determination on internal/external datasets. Additionally, HOMIL effectively located multi-scale regions of interest, enabling an in-depth analysis through features and heatmaps. Extensive visualization demonstrated HOMIL's ability to cluster features within the same type while establishing distinct boundaries between tumor types. It also identified critical areas on pathological slides, regardless of tumor size.

Authors

  • Lianghui Zhu
    Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China.
  • Renao Yan
    Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China.
  • Tian Guan
    Key Laboratory of Food Quality and Safety of Guangdong Province, College of Food Science, South China Agricultural University, Guangzhou, 510642, China.
  • Fenfen Zhang
    Department of Pathology, The First Affiliated Hospital, Sun Yat-Sen University Guangzhou, China.
  • Linlang Guo
    Department of Pathology, Zhujiang Hospital, Southern Medical University, Guangzhou, China.
  • Qiming He
    Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China.
  • Shanshan Shi
    CICU, Children's Hospital, Zhejiang University School of Medicine, 310052 Hangzhou, Zhejiang, China.
  • Huijuan Shi
    Department of Pathology, The First Affiliated Hospital, Sun Yat-Sen University Guangzhou, China.
  • Yonghong He
    Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China.
  • Anjia Han
    Department of Pathology, The First Affiliated Hospital, Sun Yat-Sen University Guangzhou, China.