Leveraging weak supervision for cell localization in digital pathology using multitask learning and consistency loss.

Journal: Computers in biology and medicine
Published Date:

Abstract

Cell detection and segmentation are integral parts of automated systems in digital pathology. Encoder-decoder networks have emerged as a promising solution for these tasks. However, training of these networks has typically required full boundary annotations of cells, which are labor-intensive and difficult to obtain on a large scale. However, in many applications, such as cell counting, weaker forms of annotations-such as point annotations or approximate cell counts-can provide sufficient supervision for training. This study proposes a new mixed-supervision approach for training multitask networks in digital pathology by incorporating cell counts derived from the eyeballing process-a quick visual estimation method commonly used by pathologists. This study has two main contributions: (1) It proposes a mixed-supervision strategy for digital pathology that utilizes cell counts obtained by eyeballing as an auxiliary supervisory signal to train a multitask network for the first time. (2) This multitask network is designed to concurrently learn the tasks of cell counting and cell localization, and this study introduces a consistency loss that regularizes training by penalizing inconsistencies between the predictions of these two tasks. Our experiments on two datasets of hematoxylin-eosin stained tissue images demonstrate that the proposed approach effectively utilizes the weakest form of annotation, improving performance when stronger annotations are limited. These results highlight the potential of integrating eyeballing-derived ground truths into the network training, reducing the need for resource-intensive annotations.

Authors

  • Berke Levent Cesur
    Department of Computer Engineering and KUIS AI Center, Koc University, Istanbul, 34450, Turkiye.
  • Ayşe Humeyra Dur Karasayar
    Graduate School of Health Sciences, Koc University, Istanbul, 34450, Turkiye.
  • Pinar Bulutay
    Department of Pathology, Koc University, Istanbul, 34450, Turkiye.
  • Nilgun Kapucuoglu
    Department of Pathology, Koc University, Istanbul, 34450, Turkiye.
  • Cisel Aydin Mericoz
    Department of Pathology, Koc University, Istanbul, 34450, Turkiye.
  • Handan Eren
    Department of Pathology, Basaksehir Cam and Sakura City Hospital, Istanbul, 34480, Turkiye.
  • Omer Faruk Dilbaz
    Department of Pathology, Sisli Hamidiye Etfal Health Application and Research Center, Istanbul, 34418, Turkiye.
  • Javidan Osmanli
    School of Medicine, Koc University, Istanbul, 34450, Turkiye.
  • Burhan Soner Yetkili
    School of Medicine, Koc University, Istanbul, 34450, Turkiye.
  • İbrahim Kulaç
    Department of Pathology, Koç University Hospital, İstanbul, Turkey.
  • Can Fahrettin Koyuncu
    Department of Computer Engineering, Bilkent University, Ankara TR-06800, Turkey. Electronic address: koyuncu@bilkent.edu.tr.
  • Cigdem Gunduz-Demir