Improved artificial intelligence discrimination of minor histological populations by supplementing with color-adjusted images.

Journal: Scientific reports
PMID:

Abstract

Despite the dedicated research of artificial intelligence (AI) for pathological images, the construction of AI applicable to histopathological tissue subtypes, is limited by insufficient dataset collection owing to disease infrequency. Here, we present a solution involving the addition of supplemental tissue array (TA) images that are adjusted to the tonality of the main data using a cycle-consistent generative adversarial network (CycleGAN) to the training data for rare tissue types. F1 scores of rare tissue types that constitute < 1.2% of the training data were significantly increased by improving recall values after adding color-adjusted TA images constituting < 0.65% of total training patches. The detector also enabled the equivalent discrimination of clinical images from two distinct hospitals and the capability was more increased following color-correction of test data before AI identification (F1 score from 45.2 ± 27.1 to 77.1 ± 10.3, p < 0.01). These methods also classified intraoperative frozen sections, while excessive supplementation paradoxically decreased F1 scores. These results identify strategies for building an AI that preserves the imbalance between training data with large differences in actual disease frequencies, which is important for constructing AI for practical histopathological classification.

Authors

  • Satomi Hatta
    Division of Molecular Pathology, Department of Pathological Sciences, University of Fukui, 23-3 Matsuoka-Shimoaizuki, Eiheiji, Fukui, 910-1193, Japan.
  • Yoshihito Ichiuji
    Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Yamaguchi, Japan.
  • Shingo Mabu
    Graduate School of Science and Engineering, Yamaguchi University, Tokiwadai 2-16-1, Ube, Yamaguchi, 755-8611, Japan. mabu@yamaguchi-u.ac.jp.
  • Mauricio Kugler
    Department of Computer Science, Nagoya Institute of Technology, Nagoya, Japan.
  • Hidekata Hontani
    Department of Computer Science, Nagoya Institute of Technology, Aichi, Japan; Center of Biomedical Physics and Information Technology, Nagoya Institute of Technology, Aichi, Japan. Electronic address: hontani@nitech.ac.jp.
  • Tadakazu Okoshi
    Department of Pathology, Fukui Red Cross Hospital, Fukui, Japan.
  • Haruki Fuse
    Department of Clinical Inspection, Maizuru Kyosai Hospital, Maizuru, Japan.
  • Takako Kawada
    Department of Clinical Inspection, Maizuru Kyosai Hospital, Maizuru, Japan.
  • Shoji Kido
    Graduate School of Medicine, Yamaguchi University, Tokiwadai 2-16-1, Ube, Yamaguchi, 755-8611, Japan.
  • Yoshiaki Imamura
    Division of Diagnostic/Surgical Pathology, University of Fukui Hospital, Eiheiji, Japan.
  • Hironobu Naiki
    Division of Molecular Pathology, Department of Pathological Sciences, University of Fukui, 23-3 Matsuoka-Shimoaizuki, Eiheiji, Fukui, 910-1193, Japan.
  • Kunihiro Inai
    Division of Molecular Pathology, Department of Pathological Sciences, University of Fukui, 23-3 Matsuoka-Shimoaizuki, Eiheiji, Fukui, 910-1193, Japan. kinai@u-fukui.ac.jp.