Independent real-world application of a clinical-grade automated prostate cancer detection system.

Journal: The Journal of pathology
Published Date:

Abstract

Artificial intelligence (AI)-based systems applied to histopathology whole-slide images have the potential to improve patient care through mitigation of challenges posed by diagnostic variability, histopathology caseload, and shortage of pathologists. We sought to define the performance of an AI-based automated prostate cancer detection system, Paige Prostate, when applied to independent real-world data. The algorithm was employed to classify slides into two categories: benign (no further review needed) or suspicious (additional histologic and/or immunohistochemical analysis required). We assessed the sensitivity, specificity, positive predictive values (PPVs), and negative predictive values (NPVs) of a local pathologist, two central pathologists, and Paige Prostate in the diagnosis of 600 transrectal ultrasound-guided prostate needle core biopsy regions ('part-specimens') from 100 consecutive patients, and to ascertain the impact of Paige Prostate on diagnostic accuracy and efficiency. Paige Prostate displayed high sensitivity (0.99; CI 0.96-1.0), NPV (1.0; CI 0.98-1.0), and specificity (0.93; CI 0.90-0.96) at the part-specimen level. At the patient level, Paige Prostate displayed optimal sensitivity (1.0; CI 0.93-1.0) and NPV (1.0; CI 0.91-1.0) at a specificity of 0.78 (CI 0.64-0.89). The 27 part-specimens considered by Paige Prostate as suspicious, whose final diagnosis was benign, were found to comprise atrophy (n = 14), atrophy and apical prostate tissue (n = 1), apical/benign prostate tissue (n = 9), adenosis (n = 2), and post-atrophic hyperplasia (n = 1). Paige Prostate resulted in the identification of four additional patients whose diagnoses were upgraded from benign/suspicious to malignant. Additionally, this AI-based test provided an estimated 65.5% reduction of the diagnostic time for the material analyzed. Given its optimal sensitivity and NPV, Paige Prostate has the potential to be employed for the automated identification of patients whose histologic slides could forgo full histopathologic review. In addition to providing incremental improvements in diagnostic accuracy and efficiency, this AI-based system identified patients whose prostate cancers were not initially diagnosed by three experienced histopathologists. © 2021 The Authors. The Journal of Pathology published by John Wiley & Sons, Ltd. on behalf of The Pathological Society of Great Britain and Ireland.

Authors

  • Leonard M da Silva
    Grupo Oncoclinicas, Sao Paulo, Brazil.
  • Emilio M Pereira
    Grupo Oncoclinicas, Sao Paulo, Brazil.
  • Paulo Go Salles
    Instituto Mario Penna, Belo Horizonte, Brazil.
  • Ran Godrich
    Paige.AI, 11 East Loop Road, FL5, New York, NY, 10044, USA.
  • Rodrigo Ceballos
    Paige.AI, 11 East Loop Road, FL5, New York, NY, 10044, USA.
  • Jeremy D Kunz
    Paige.AI, 11 East Loop Road, FL5, New York, NY, 10044, USA.
  • Adam Casson
    Paige, New York, NY, USA.
  • Julian Viret
    Paige, New York, NY, USA.
  • Sarat Chandarlapaty
    Human Oncology and Pathogenesis Program, Memorial Sloan Kettering Cancer Center, New York, New York.
  • Carlos Gil Ferreira
    Grupo Oncoclinicas, Sao Paulo, Brazil.
  • Bruno Ferrari
    Grupo Oncoclinicas, Sao Paulo, Brazil.
  • Brandon Rothrock
    Jet Propulsion Laboratory, Caltech, Los Angeles, CA 91109, USA.
  • Patricia Raciti
    Paige.AI, 11 East Loop Road, FL5, New York, NY, 10044, USA. patricia.raciti@paige.ai.
  • Victor Reuter
    Department of Pathology, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA.
  • Belma Dogdas
    Paige, New York, NY, USA.
  • George DeMuth
    Stat One, Wilmington, NC, USA.
  • Jillian Sue
    Paige.AI, 11 East Loop Road, FL5, New York, NY, 10044, USA.
  • Christopher Kanan
    Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, NY, USA.
  • Leo Grady
  • Thomas J Fuchs
    Weill Cornell Medicine, New York, USA; Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, USA; Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, USA. Electronic address: gac2010@med.cornell.edu.
  • Jorge S Reis-Filho
    Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.