Multidisciplinary Consensus Prostate Contours on Magnetic Resonance Imaging: Educational Atlas and Reference Standard for Artificial Intelligence Benchmarking.

Journal: International journal of radiation oncology, biology, physics
Published Date:

Abstract

PURPOSE: Evaluation of artificial intelligence (AI) algorithms for prostate segmentation is challenging because ground truth is lacking. We aimed to: (1) create a reference standard data set with precise prostate contours by expert consensus, and (2) evaluate various AI tools against this standard.

Authors

  • Yuze Song
    Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, California; Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, California.
  • Anna M Dornisch
    Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, California.
  • Robert T Dess
    University of Michigan, Ann Arbor, MI, USA.
  • Daniel J A Margolis
    Department of Radiology, Weill Cornell Medicine, New York, NY, USA. Electronic address: djm9016@med.cornell.edu.
  • Eric P Weinberg
    Department of Clinical Imaging Sciences, University of Rochester Medical Center, Rochester, New York.
  • Tristan Barrett
    Department of Radiology, University of Cambridge, Cambridge, UK.
  • Mariel Cornell
    Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, California.
  • Richard E Fan
    Department of Urology, Stanford University, Stanford, CA 94305, USA.
  • Mukesh Harisinghani
    From Digital Technology and Innovation, Siemens Healthineers, 755 College Rd E, Princeton, NJ 08540 (H. Li, H. Liu, D.C., A.K., B.L.); Diagnostic Imaging, Siemens Healthineers, Erlangen, Bavaria, Germany (H.v.B., R.G.); Vanderbilt University, Nashville, Tenn (H. Li, H. Liu, I.O.); Radboud University Medical Center, Nijmegen, the Netherlands (H.H.); New York University, New York, NY (A.T.); Universitätsspital Basel, Basel, Switzerland (D.W.); Charité, Universitätsmedizin Berlin, Berlin, Germany (T.P.); Patero Clinic, Moscow, Russia (I.S.); Eunpyeong St. Mary's Hospital, Catholic University of Korea, Seoul, Republic of Korea (M.H.C.); Department of Radiology, Changhai Hospital of Shanghai, Shanghai, China (Q.Y.); Diagnostikum Graz Süd-West, Graz, Austria (D.S.); Department of Radiology, Loyola University Medical Center, Maywood, Ill (S.S.); Department of Diagnostic Radiology, Oregon Health and Science University School of Medicine, Portland, Ore (F.C.); and Massachusetts General Hospital, Boston, Mass (M.H.).
  • Sophia C Kamran
    Department of Radiation Oncology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA.
  • Jeong Hoon Lee
    1 Division of Biomedical Informatics, Seoul National University Biomedical Informatics, Seoul National University College of Medicine , Seoul, Korea.
  • Cynthia Xinran Li
    Institute of Computational and Mathematical Engineering Stanford University Stanford CA USA.
  • Michael A Liss
    Department of Urology, University of Texas Health Sciences Center San Antonio, San Antonio, Texas.
  • Mirabela Rusu
    Department of Radiology, Stanford University, Stanford, CA 94305, USA. Electronic address: mirabela.rusu@stanford.edu.
  • Jason Santos
    Quibim, New York, New York.
  • Geoffrey A Sonn
    Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA; Department of Urology, Stanford University School of Medicine, Stanford, CA, USA.
  • Igor Vidić
    Department of Physics, NTNU - Norwegian University of Science and Technology, Trondheim, Norway.
  • Sean A Woolen
    From the University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Radiology and Nuclear Medicine, University of Maryland, Baltimore, MD (F.X.D.); Department of Radiology, University Hospital Basel, Basel, Switzerland (J.V., T.H.); Department of Radiology, New York University, New York, NY (J.V., L.M.); Department of Radiology, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pa (T.S.C.); Joint Department of Medical Imaging, University Health Network, Toronto, Ontario, Canada (E.P.R.P.A., K.H.); Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, Calif (S.A.W.); Department of Radiology and Imaging Sciences, Emory University, Atlanta, Ga (J.W.G.); Toronto General Hospital Research Institute, University Health Network, University of Toronto, 585 University Ave, 1 PMB-298, Toronto, ON, Cananda M5G 2N2 (K.H.); and Department of Medical Imaging, University Medical Imaging Toronto, University of Toronto, Toronto, Ontario, Canada (K.H.).
  • Anders M Dale
    From the Departments of Radiology (L.G., D.G., C.C., T.M.S., U.N., N.F., A.M.D., J.D.R.), Pathology (V.G.), Radiation Medicine and Applied Sciences (C.R.M., T.M.S., J.H.G.), Neurologic Surgery (T.B.), Bioengineering (T.M.S.), and Neurosciences (J.D.S., D.P., A.M.D.), University of California San Diego, 9500 Gillman Dr, La Jolla, CA 92093; Cortechs.ai, San Diego, Calif (G.M., N.W.); Department of Translational Neurosciences, Pacific Neuroscience Institute and Saint John's Cancer Institute at Providence Saint John's Health Center, Santa Monica, Calif (S.K.); and Department of Biophysics, Medical College of Wisconsin, Milwaukee, Wis (K.M.S.).
  • Tyler M Seibert
    Radiation Medicine Department and Applied Sciences, University of California, San Diego, La Jolla, CA 92093, USA; Radiology Department, University of California, San Diego, La Jolla, CA 92093, USA; Bioengineering Department, University of California, San Diego, La Jolla, CA 92093, USA.