Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge.

Journal: Nature communications
Published Date:

Abstract

Computational competitions are the standard for benchmarking medical image analysis algorithms, but they typically use small curated test datasets acquired at a few centers, leaving a gap to the reality of diverse multicentric patient data. To this end, the Federated Tumor Segmentation (FeTS) Challenge represents the paradigm for real-world algorithmic performance evaluation. The FeTS challenge is a competition to benchmark (i) federated learning aggregation algorithms and (ii) state-of-the-art segmentation algorithms, across multiple international sites. Weight aggregation and client selection techniques were compared using a multicentric brain tumor dataset in realistic federated learning simulations, yielding benefits for adaptive weight aggregation, and efficiency gains through client sampling. Quantitative performance evaluation of state-of-the-art segmentation algorithms on data distributed internationally across 32 institutions yielded good generalization on average, albeit the worst-case performance revealed data-specific modes of failure. Similar multi-site setups can help validate the real-world utility of healthcare AI algorithms in the future.

Authors

  • Maximilian Zenk
    German Cancer Research Center, Heidelberg, Germany.
  • Ujjwal Baid
    Perelman School of Medicine, Philadelphia, PA, USA.
  • Sarthak Pati
    Perelman School of Medicine, Philadelphia, PA, USA.
  • Akis Linardos
    Faculty of Mathematics and Computer Science, University of Barcelona, Barcelona, Spain.
  • Brandon Edwards
    Intel Corporation, Santa Clara, CA 95052, United States of America.
  • Micah Sheller
    Medical Research Group, MLCommons, San Francisco, CA, USA.
  • Patrick Foley
    Intel Corporation, Santa Clara, CA 95052, United States of America.
  • Alejandro Aristizabal
    Factored, Palo Alto, CA, USA.
  • David Zimmerer
    Medical Image Computing, German Cancer Research Center, Im Neuenheimer Feld 581, 69210, Heidelberg, Germany.
  • Alexey Gruzdev
    Intel Corporation, Santa Clara, CA, USA.
  • Jason Martin
    Intel Corporation, Santa Clara, CA 95052, United States of America.
  • Russell T Shinohara
    Artificial Intelligence in Biomedical Imaging Laboratory (AIBIL), Center for and Data Science for Integrated Diagnostics (AID), Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
  • Annika Reinke
    German Cancer Research Center DKFZ, Division of Computer Assisted Medical Interventions, Heidelberg, Germany. Electronic address: a.reinke@dkfz.de.
  • Fabian Isensee
  • Santhosh Parampottupadam
    German Cancer Research Center (DKFZ) Heidelberg, Division of Medical Image Computing, Heidelberg, Germany.
  • Kaushal Parekh
    German Cancer Research Center (DKFZ) Heidelberg, Division of Medical Image Computing, Heidelberg, Germany.
  • Ralf Floca
    Division of Medical Image Computing, German Cancer Research Center, Heidelberg, Germany.
  • Hasan Kassem
    University of Strasbourg, Strasbourg, France.
  • Bhakti Baheti
    Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine, Indianapolis, IN, USA; Indiana University Melvin and Bren Simon Comprehensive Cancer Center, Indianapolis, IN, USA.
  • Siddhesh Thakur
    Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine, Indianapolis, IN, USA.
  • Verena Chung
    Sage Bionetworks, Seattle, WA, USA.
  • Kaisar Kushibar
    Institute of Computer Vision and Robotics, University of Girona, Ed. P-IV, Campus Montilivi, Girona, 17003, Spain. Electronic address: kaisar.kushibar@udg.edu.
  • Karim Lekadir
    Information and Communication Technologies Department, Universitat Pompeu Fabra, Barcelona, Spain.
  • Meirui Jiang
    Department of Computer Science and Engineering, Ho Sin-Hang Engineering Building, The Chinese University of Hong Kong, Sha Tin, NT, Hong Kong.
  • Youtan Yin
    Department of Computer Science and Technology, Zhejiang University, Hangzhou, China.
  • Hongzheng Yang
    Department of Computer Science and Engineering, Beihang University, Beijing, China.
  • Quande Liu
  • Cheng Chen
    Key Laboratory of Precision and Intelligent Chemistry, School of Chemistry and Materials Science, University of Science and Technology of China, China.
  • Qi Dou
  • Pheng-Ann Heng
  • Xiaofan Zhang
  • Shaoting Zhang
  • Muhammad Irfan Khan
    School of Data Engineering and AI Technologies, Turku University of Applied Sciences, Turku, Finland.
  • Mohammad Ayyaz Azeem
    Riphah International University, Islamabad, Pakistan.
  • Mojtaba Jafaritadi
    Faculty of Engineering and Business, Turku University of Applied Sciences, Turku, Finland.
  • Esa Alhoniemi
    School of Data Engineering and AI Technologies, Turku University of Applied Sciences, Turku, Finland.
  • Elina Kontio
    School of Data Engineering and AI Technologies, Turku University of Applied Sciences, Turku, Finland.
  • Suleiman A Khan
    University of Helsinki, Helsinki, Finland.
  • Leon Mächler
    École Normale Supérieure, Paris, France.
  • Ivan Ezhov
    Technical University of Munich, Department of Computer Science, Munich, Germany.
  • Florian Kofler
    Department of Computer Science, Institute for AI in Medicine, Technical University of Munich, Munich, Germany; Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Technical University of Munich, Munich, Germany; TranslaTUM, Central Institute for Translational Cancer Research of the Technical University of Munich, Munich, Germany; Helmholtz AI, Helmholtz Munich, Neuherberg, Germany.
  • Suprosanna Shit
    Department of Computer Science, Technical University of Munich (TUM), Munich, Germany.
  • Johannes C Paetzold
    ITERM Institute Helmholtz Zentrum Muenchen, Neuherberg, Germany.
  • Timo Loehr
    Department of Informatics, Technical University of Munich, Munich, Germany.
  • Benedikt Wiestler
    Department of Neuroradiology, Klinikum rechts der Isar, Technical University of Munich (TUM), Ismaninger Straße 22, 81675 Munich, Germany; Deutsches Konsortium für Translationale Krebsforschung (DKTK), Partner Site Munich, Germany.
  • Himashi Peiris
    Monash Biomedical Imaging, Monash University, Melbourne, VIC, Australia.
  • Kamlesh Pawar
    Monash Biomedical Imaging, Monash University, Building 220, Clayton Campus, 770 Blackburn Rd, Clayton, Victoria, 3168, Australia.
  • Shenjun Zhong
    Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia.
  • Zhaolin Chen
    Monash Biomedical Imaging, Monash University, Building 220, Clayton Campus, 770 Blackburn Rd, Clayton, Victoria, 3168, Australia. zhaolin.chen@monash.edu.
  • Munawar Hayat
    University of Canberra, Bruce ACT 2617, Australia; Inception Institute of AI, Abu Dhabi, United Arab Emirates. Electronic address: munawar.hayat@canberra.edu.au.
  • Gary Egan
    Monash Biomedical Imaging, Monash University, Building 220, Clayton Campus, 770 Blackburn Rd, Clayton, Victoria, 3168, Australia.
  • Mehrtash Harandi
    Department of Electrical and Computer Systems Engineering, Faculty of Engineering, Monash University, Melbourne, VIC, Australia.
  • Ece Isik Polat
    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey.
  • Gorkem Polat
    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey.
  • Altan Kocyigit
    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey.
  • Alptekin Temizel
    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey.
  • Anup Tuladhar
    Department of Radiology, University of Calgary, Calgary, Alberta, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada. Electronic address: anup.tuladhar@ucalgary.ca.
  • Lakshay Tyagi
    Department of Chemical Engineering, Indian Institute of Technology Kanpur, Kanpur, Uttar Pradesh, India.
  • Raissa Souza
    Department of Radiology, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada.
  • Nils D Forkert
    Department of Radiology, University of Calgary, Calgary, Canada. nils.forkert@ucalgary.ca.
  • Pauline Mouches
    Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada.
  • Matthias Wilms
    Department of Radiology, University of Calgary, Calgary, AB, Canada.
  • Vishruth Shambhat
    Department of Engineering Design, IIT Madras, Chennai, India.
  • Akansh Maurya
    Robert Bosch Center of Data Science and AI, IIT Madras, Chennai, India.
  • Shubham Subhas Danannavar
    Department of Engineering Design, IIT Madras, Chennai, India.
  • Rohit Kalla
    Department of Engineering Design, IIT Madras, Chennai, India.
  • Vikas Kumar Anand
    Department of Engineering Design, IIT Madras, Chennai, India.
  • Ganapathy Krishnamurthi
  • Sahil Nalawade
    Dana-Farber Cancer Institute, Boston, MA, USA.
  • Chandan Ganesh
    Department of Radiology, UT Southwestern Medical Center, Dallas, Texas, USA.
  • Ben Wagner
    Department of Radiology, UT Southwestern Medical Center, Dallas, Texas, USA.
  • Divya Reddy
    University of Texas Southwestern Medical Center, Dallas, TX, USA.
  • Yudhajit Das
    University of Texas Southwestern Medical Center, Dallas, TX, USA.
  • Fang F Yu
    Department of Radiology, University of Texas Southwestern Medical Center, Dallas, Texas frankf.yu@utsouthwestern.edu.
  • Baowei Fei
  • Ananth J Madhuranthakam
    Department of Radiology, University of Texas Southwestern Medical Center, Dallas, Texas.
  • Joseph Maldjian
  • Gaurav Singh
    Department of Industrial and Enterprise Systems Engineering, University of Illinois Urbana-Champaign, Urbana, IL, United States of America.
  • Jianxun Ren
    Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, USA.
  • Wei Zhang
    The First Affiliated Hospital of Nanchang University, Nanchang, China.
  • Ning An
  • Qingyu Hu
    Changping Laboratory, Beijing, China.
  • Youjia Zhang
    Changping Laboratory, Beijing, China.
  • Ying Zhou
    Institute of Drug Metabolism and Pharmaceutical Analysis, College of Pharmaceutical Sciences, Zhejiang University, Hangzhou, 310058, China.
  • Vasilis Siomos
    City St George's, University of London, London, UK.
  • Giacomo Tarroni
    Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, UK.
  • Jonathan Passerrat-Palmbach
    City St George's, University of London, London, UK.
  • Ambrish Rawat
    IBM Research, Dublin, Ireland.
  • Giulio Zizzo
    IBM Research, Dublin, Ireland.
  • Swanand Ravindra Kadhe
    IBM Research, Dublin, Ireland.
  • Jonathan P Epperlein
    IBM Research Europe, Dublin, Ireland.
  • Stefano Braghin
    IBM Research, Dublin, Ireland.
  • Yuan Wang
    State Key Laboratory of Soil and Sustainable Agriculture, Changshu National Agro-Ecosystem Observation and Research Station, Institute of Soil Science, Chinese Academy of Sciences, Nanjing, China.
  • Renuga Kanagavelu
    Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore.
  • Qingsong Wei
    Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore.
  • Yechao Yang
    Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore.
  • Yong Liu
    Department of Critical care medicine, Shenzhen Hospital, Southern Medical University, Guangdong, Shenzhen, China.
  • Krzysztof Kotowski
    Future Processing, Bojkowska 37A, 44-100 Gliwice, Poland. Electronic address: kkotowski@future-processing.com.
  • Szymon Adamski
    Graylight Imaging, Gliwice, Poland.
  • Bartosz Machura
    Future Processing, Bojkowska 37A, 44-100 Gliwice, Poland. Electronic address: bmachura@future-processing.com.
  • Wojciech Malara
    Graylight Imaging, Gliwice, Poland.
  • Lukasz Zarudzki
    Department of Radiology and Diagnostic Imaging, Maria Skłodowska-Curie National Research Institute of Oncology, Gliwice Branch, Gliwice, Poland.
  • Jakub Nalepa
    Future Processing, Bojkowska 37A, 44-100 Gliwice, Poland; Institute of Informatics, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland. Electronic address: jakub.nalepa@polsl.pl.
  • Yaying Shi
    University of North Carolina at Charlotte, Charlotte, NC, USA.
  • Hongjian Gao
    Department of Biomedical Engineering, College of Chemistry and Life Science, Beijing University of Technology, Beijing 100124, China.
  • Salman Avestimehr
    University of Southern California, 3740 McClintock Ave, Los Angeles, CA, 90007, USA.
  • Yonghong Yan
    Key Laboratory of Speech Acoustics and Content Understanding, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China.
  • Agus S Akbar
    Universitas Islam Nahdlatul Ulama Jepara, Jepara, Indonesia.
  • Ekaterina Kondrateva
    Skolkovo Institute of Science and Technology, Moscow, Russia.
  • Hua Yang
  • Zhaopei Li
    Fuzhou University, Fuzhou, China.
  • Hung-Yu Wu
    National Tsing Hua University, Hsinchu, Taiwan.
  • Johannes Roth
    Children's Hospital of Central Switzerland and Center for Rare Diseases, Lucerne, Switzerland. Electronic address: johannes.roth@luks.ch.
  • Camillo Saueressig
    Brown University, Providence, RI, USA.
  • Alexandre Milesi
    NVIDIA, Santa Clara, CA, USA.
  • Quoc D Nguyen
    EPITA, Le Kremlin-Bicêtre, France.
  • Nathan J Gruenhagen
    Medical College of Wiconsin, Milwaukee, WI, USA.
  • Tsung-Ming Huang
    Department of Mathematics, National Taiwan Normal University, Taipei, Taiwan.
  • Jun Ma
    State Key Laboratory of Urban Water Resource and Environment, Harbin Institute of Technology, Harbin 150090, China.
  • Har Shwinder H Singh
    Hong Kong University of Science and Technology, Hong Kong, Hong Kong Special Administrative Region of China, China.
  • Nai-Yu Pan
    National Taiwan University of Science and Technology, Taipei, Taiwan.
  • Dingwen Zhang
  • Ramy A Zeineldin
    Research Group Computer Assisted Medicine (CaMed), Reutlingen University, 72762, Reutlingen, Germany. Ramy.Zeineldin@Reutlingen-University.DE.
  • Michal Futrega
    NVIDIA, Santa Clara, CA, USA.
  • Yading Yuan
  • Gian Marco Conte
    Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA.
  • Xue Feng
    Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia.
  • Quan D Pham
    VinBrain, Hanoi, Vietnam.
  • Yong Xia
  • Zhifan Jiang
    School of Computer Science, Guangdong University of Technology, Guangzhou 510006, China. Electronic address: 468788700@qq.com.
  • Huan Minh Luu
    Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Korea.
  • Mariia Dobko
    Ukrainian Catholic University, Lviv, Ukraine.
  • Alexandre Carré
    U1030 Molecular Radiotherapy, Paris-Sud University - Gustave Roussy - Inserm - Paris-Saclay University, Villejuif, France; Department of Medical Physics, Gustave Roussy - Paris-Saclay University, Villejuif, France.
  • Bair Tuchinov
    Novosibirsk State University, Novosibirsk, Russia.
  • Hassan Mohy-Ud-Din
  • Saruar Alam
    University of Bergen, Bergen, Norway.
  • Anup Singh
    Centre for Biomedical Engineering, IIT Delhi, New Delhi, India; Department of Biomedical Engineering, AIIMS Delhi, New Delhi, India. Electronic address: anupsm@iitd.ac.in.
  • Nameeta Shah
    Mazumdar Shaw Medical Foundation, NH Health City, Bangalore, India.
  • Weichung Wang
    Graduate Program of Data Science, National Taiwan University and Academia Sinica, Taipei, Taiwan.
  • Chiharu Sako
    Center for Biomedical Image Computing and Analytics.
  • Michel Bilello
    Center for Biomedical Image Computing and Analytics, University of Pennsylvania, Philadelphia, Pennsylvania.
  • Satyam Ghodasara
    Department of Radiology, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA.
  • Suyash Mohan
    Department of Radiology, Hospital of the University of Pennsylvania, 3400 Spruce St, Philadelphia, PA 19104 (J.D.R., L.X., A.K., J.M.E., T.C., I.M.N., S.M., J.C.G.); Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, Calif (J.D.R., A.M.R.); Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, Pa (X.L., J.W.); University of Pennsylvania Perelman School of Medicine, Philadelphia, Pa (M.T.D.); Mecklenburg Radiology Associates, Charlotte, NC (E.J.B.); Department of Radiology, University of Texas, Austin, Tex (R.N.B.); and Division of Nuclear Medicine and Clinical Molecular Imaging, Department of Radiology, University of Pennsylvania, Philadelphia, Pa (I.M.N.).
  • Christos Davatzikos
    Artificial Intelligence in Biomedical Imaging Laboratory (AIBIL), Center for and Data Science for Integrated Diagnostics (AID), Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
  • Evan Calabrese
    Department of Radiology and Biomedical Imaging, University of California At San Francisco, 350 Parnassus Ave, Suite 307H, San Francisco, CA, 94143-0628, USA. evan.calabrese@ucsf.edu.
  • Jeffrey Rudie
    Department of Radiology, University of California San Diego, San Diego, California, USA.
  • Javier Villanueva-Meyer
    Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, California, USA.
  • Soonmee Cha
    Department of Radiology and Biomedical Imaging, University of California At San Francisco, 350 Parnassus Ave, Suite 307H, San Francisco, CA, 94143-0628, USA.
  • Christopher Hess
    Department of Radiology and Biomedical Imaging (C.H.), University of California, San Francisco, San Francisco, California.
  • John Mongan
    From the Departments of Urology (T.C., M.U., H.C.C., M.S.) and Radiology and Biomedical Imaging (J.M., M.P.K., A.T., P.J., R.G., S.W.), University of California, San Francisco. 505 Parnassus Ave, M-391, San Francisco, CA 94143; and Division of Urology, Faculty of Medicine, King Chulalongkorn Memorial Hospital, Chulalongkorn University, The Thai Red Cross Society, Bangkok, Thailand (M.U.).
  • Madhura Ingalhalikar
    Symbiosis Center of Medical Image Analysis, Symbiosis International (Deemed) University, Pune, India. Electronic address: head@scmia.edu.in.
  • Manali Jadhav
    Symbiosis Center for Medical Image Analysis, Symbiosis International University, Pune, India.
  • Umang Pandey
    Symbiosis Center for Medical Image Analysis, Symbiosis International (Deemed) University, Lavale, Mulshi, Pune, Maharashtra, 412115, India.
  • Jitender Saini
    Department of Neuroimaging & Interventional Radiology, National Institute of Mental Health and Neurosciences, Bangalore, India.
  • Raymond Y Huang
    Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts. kalpathy@nmr.mgh.harvard.edu yangli762@gmail.com ryhuang@partners.org.
  • Ken Chang
    Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts.
  • Minh-Son To
    Health and Information, Adelaide, South Australia, Australia; Royal Adelaide Hospital, Adelaide, South Australia, Australia; Flinders Medical Centre, Flinders University, Adelaide, South Australia, Australia.
  • Sargam Bhardwaj
    College of Medicine and Public Health, Flinders University, Bedford Park, SA, Australia.
  • Chee Chong
    South Australia Medical Imaging, Flinders Medical Centre, Bedford Park, SA, Australia.
  • Marc Agzarian
    College of Medicine and Public Health Flinders University Australia; South Australia Medical Imaging Flinders Medical Centre Australia.
  • Michal Kozubek
    Faculty of Informatics, Masaryk University, Brno, Czech Republic.
  • Filip Lux
    Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.
  • Jan Michálek
    Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.
  • Petr Matula
    Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic.
  • Miloš Ker Kovský
    Department of Radiology and Nuclear Medicine, University Hospital Brno and Faculty of Medicine, Masaryk University, Brno, Czech Republic.
  • Tereza Kopr Ivová
    Department of Radiology and Nuclear Medicine, University Hospital Brno and Faculty of Medicine, Masaryk University, Brno, Czech Republic.
  • Marek Dostál
    Department of Radiology and Nuclear Medicine, University Hospital Brno and Faculty of Medicine, Masaryk University, Brno, Czech Republic.
  • Václav Vybíhal
    Department of Neurosurgery, University Hospital Brno and Faculty of Medicine, Masaryk University, Brno, Czech Republic.
  • Marco C Pinho
  • James Holcomb
    University of Texas Southwestern Medical Center, Dallas, TX, USA.
  • Marie Metz
    Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Technical University of Munich, Munich, Germany.
  • Rajan Jain
    1 Department of Radiology, New York University Langone Medical Center, 660 1st Ave, Rm 336, New York, NY 10016.
  • Matthew D Lee
    Department of Radiology, NYU Grossman School of Medicine, New York, NY.
  • Yvonne W Lui
    Center for Advanced Imaging Innovation and Research (CAI2R), School of Medicine, New York University, 660 First Avenue, New York, NY 10016, USA; Bernard and Irene Schwartz Center for Biomedical Imaging, School of Medicine, New York University, 660 First Avenue, New York, NY 10016, USA.
  • Pallavi Tiwari
    Department of Radiology, University of Wisconsin, Madison, WI, USA.
  • Ruchika Verma
  • Rohan Bareja
  • Ipsa Yadav
    Department of Biomedical Engineering, Emory Empathetic AI for Health Institute, Georgia Institute of Technology and Emory University, Atlanta, GA.
  • Jonathan Chen
    Center for Biomedical Informatics Research, Stanford University, Stanford, California.
  • Neeraj Kumar
  • Yuriy Gusev
    Innovation Center for Biomedical Informatics (ICBI), Georgetown University, Washington, DC, USA.
  • Krithika Bhuvaneshwar
    Innovation Center for Biomedical Informatics (ICBI), Georgetown University, Washington, DC, USA.
  • Anousheh Sayah
    Department of Radiology, MedStar Georgetown University Hospital, Washington, United States.
  • Camelia Bencheqroun
    Innovation Center for Biomedical Informatics (ICBI), Georgetown University, Washington, DC, USA.
  • Anas Belouali
    Innovation Center for Biomedical Informatics (ICBI), Georgetown University, Washington, DC.
  • Subha Madhavan
    Innovation Center For Biomedical Informatics, Georgetown University, Washington D.C, United States of America.
  • Rivka R Colen
    Department of Diagnostic Radiology, University of Texas MD Anderson Cancer Center, Houston, TX, USA.
  • Aikaterini Kotrotsou
    MD Anderson Cancer Center, University of Texas, Houston, Texas, USA.
  • Philipp Vollmuth
    Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany. Electronic address: philipp.vollmuth@med.uni-heidelberg.de.
  • Gianluca Brugnara
    Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
  • Chandrakanth J Preetha
    Division for Computational Neuroimaging, Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany; Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
  • Felix Sahm
    Department of Neuropathology, Institute of Pathology, Heidelberg University Hospital, Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Martin Bendszus
    Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany.
  • Wolfgang Wick
    Neurology Clinic, Heidelberg University Hospital, Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Abhishek Mahajan
    Department of Imaging, The Clatterbridge Cancer Centre NHS Foundation Trust, Liverpool L7 8YA, UK.
  • Carmen Balana
    B-ARGO Group, Institut Investigació Germans Trias i Pujol (IGTP), Badalona (Barcelona), Catalonia, Spain.
  • Jaume Capellades
    Research Unit (IDIR), Image Diagnosis Institute, Badalona, Spain.
  • Josep Puig
    Research Unit of Diagnostic Imaging Institute (IDI), Department of Radiology (Girona Biomedical Research Institute) IDIBGI, Hospital Universitari Dr. Josep Trueta, 17007 Girona, Spain.
  • Yoon Seong Choi
    Department of Radiology and Research Institute of Radiological Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea.
  • Seung-Koo Lee
    Department of Radiology and Research Institute of Radiological Science, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea.
  • Jong Hee Chang
    Department of Neurosurgery, Yonsei University College of Medicine, Seoul, South Korea.
  • Sung Soo Ahn
    Department of Radiology, Severance Hospital, Research Institute of Radiological Science and Center for Clinical Image Data Science, Yonsei University College of Medicine, Seoul, Korea. sungsoo@yuhs.ac.
  • Hassan F Shaykh
    University of Alabama in Birmingham, Birmingham, AL, USA.
  • Alejandro Herrera-Trujillo
    Clínica Imbanaco QuirónSalud, Cali, Colombia.
  • Maria Trujillo
    University of Valle, Computer and Systems Engineering School, Cali, Colombia.
  • William Escobar
    Clínica Imbanaco QuirónSalud, Cali, Colombia.
  • Ana Abello
    Universidad del Valle, Cali, Colombia.
  • Jose Bernal
    Institute of Computer Vision and Robotics, University of Girona, Ed. P-IV, Campus Montilivi, Girona, 17003, Spain. Electronic address: jose.bernal@udg.edu.
  • Jhon Gómez
    Universidad del Valle, Cali, Colombia.
  • Pamela LaMontagne
    Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA.
  • Daniel S Marcus
    Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA.
  • Mikhail Milchenko
    Department of Radiology, Washington University School of Medicine, St. Louis, Missouri, USA.
  • Arash Nazeri
    From the Department of Bioengineering, Rice University, Houston, Tex (S. Fan); Department of Radiology (S. Fan, M.R.P., P.X., S.M.H., J.J.L., S. Flores, P.L., B.G., C.A.R., D.S.M., A.N., T.L.S.B., A.S.), Charles F. and Joanne Knight Alzheimer Disease Research Center (B.G., B.M.A., R.B., J.C.M., T.L.S.B.), Department of Neurology (C.A.R., B.M.A., R.J.B., J.C.M.), and Institute for Informatics, Data Science and Biostatistics (A.S.), Washington University School of Medicine, 660 S Euclid Ave, Campus Box 8132, St Louis, MO 63110; Duke-NUS Medical School, Singapore (S. Fan); Department of Electrical and Systems Engineering, Washington University in St Louis, St Louis, Mo (S.C., A.S.); Brain Health Imaging Centre, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, Canada (A.N.); and Tracy Family SILQ Center for Neurodegenerative Biology, St Louis, Mo (R.J.B.).
  • Bennett Landman
  • Karthik Ramadass
    Computer Science, Vanderbilt University, Nashville, TN, USA.
  • Kaiwen Xu
    Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA.
  • Silky Chotai
    Department of Neurosurgery, Vanderbilt University Medical Center, Nashville, TN, USA.
  • Lola B Chambless
    Department of Neurosurgery, Vanderbilt University Medical Center, Vanderbilt University, Nashville, Tennessee, United States.
  • Akshitkumar Mistry
    Department of Neurosurgery, Vanderbilt University Medical Center, Nashville, TN, USA.
  • Reid C Thompson
    Vanderbilt-Ingram Cancer Center, Vanderbilt University Medical Center, Nashville, TN, USA.
  • Ashok Srinivasan
    Department of Radiology, University of Michigan, Ann Arbor, MI, USA.
  • J Rajiv Bapuraj
    Department of Neuroradiology, University of Michigan, Ann Arbor, MI, USA.
  • Arvind Rao
    Department of Bioinformatics and Computational Biology, The University of Texas MD Anderson Cancer Center, Houston, Texas.
  • Nicholas Wang
    Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI, USA.
  • Ota Yoshiaki
    Department of Neuroradiology, University of Michigan, Ann Arbor, MI, USA.
  • Toshio Moritani
    Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA.
  • Sevcan Turk
    Department of Radiology, University of Michigan, Ann Arbor, MI, USA.
  • Joonsang Lee
    Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI, USA.
  • Snehal Prabhudesai
    Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI, USA.
  • John Garrett
    Radiology, University of Wisconsin-Madison, Madison, United States of America.
  • Matthew Larson
    Department of Radiology, University of Wisconsin at Madison, Madison, WI, USA.
  • Robert Jeraj
  • Hongwei Li
    Department of Informatics, Technische Universität München, Munich, Germany.
  • Tobias Weiss
    Department of Neurology and Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland.
  • Michael Weller
    Department of Neurology, University Hospital and University of Zurich, Zurich, Switzerland.
  • Andrea Bink
    Department of Neuroradiology, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Switzerland.
  • Bertrand Pouymayou
    Department of Neuroradiology and Clinical Neuroscience Center, University Hospital Zurich and University of Zurich, Zurich, Switzerland.
  • Sonam Sharma
    Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
  • Tzu-Chi Tseng
    Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
  • Saba Adabi
    Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
  • Alexandre Xavier Falcão
    Institute of Computing, University of Campinas, Campinas, São Paulo, Brazil.
  • Samuel B Martins
    Federal Institute of Education, Science, and Technology of São Paulo, Araraquara, São Paulo, Brazil.
  • Bernardo C A Teixeira
    Instituto de Neurologia de Curitiba, Curitiba, Paraná, Brazil.
  • Flávia Sprenger
    Federal University of Parana, Curitiba, Paraná, Brazil.
  • David Menotti
    Department of Informatics, Federal University of Parana, Curitiba, Paraná, Brazil.
  • Diego R Lucio
    Department of Informatics, Federal University of Parana, Curitiba, Paraná, Brazil.
  • Simone P Niclou
    NORLUX Neuro-Oncology Laboratory, Luxembourg Institute of Health, Luxembourg, Luxembourg.
  • Olivier Keunen
    Brain Imaging and Neuro Epidemiology Group, Luxembourg Institute of Health, Luxembourg, Luxembourg.
  • Ann-Christin Hau
    NORLUX Neuro-Oncology Laboratory, Luxembourg Institute of Health, Luxembourg, Luxembourg.
  • Enrique Pelaez
    Escuela Superior Politecnica del Litoral, Guayaquil, Guayas, Ecuador.
  • Heydy Franco-Maldonado
    Sociedad de Lucha Contral el Cancer - SOLCA, Guayaquil, Ecuador.
  • Francis Loayza
    Escuela Superior Politecnica del Litoral, Guayaquil, Guayas, Ecuador.
  • Sebastian Quevedo
    Universidad Católica de Cuenca, Cuenca, Ecuador.
  • Richard McKinley
    Support Center for Advanced Neuroimaging - Institute for Diagnostic and Interventional Neuroradiology, University Hospital and University of Bern, Switzerland. Electronic address: RichardIain.McKinley@insel.ch.
  • Johannes Slotboom
    DRNN, Institute of Diagnostic and Interventional Neuroradiology/SCAN, University Hospital Bern, Bern, Switzerland.
  • Piotr Radojewski
    Support Center for Advanced Neuroimaging, University Institute of Diagnostic and Interventional Neuroradiology, University Hospital Bern, Inselspital, University of Bern, Bern, Switzerland.
  • Raphael Meier
    Institute for Surgical Technology and Biomechanics, University of Bern, Switzerland. Electronic address: raphael.meier@istb.unibe.ch.
  • Roland Wiest
    Institute for Diagnostic and Interventional Neuroradiology, University of Bern, Bern, Switzerland.
  • Johannes Trenkler
    Institute of Neuroradiology, Neuromed Campus (NMC), Kepler University Hospital Linz, Linz, Austria.
  • Josef Pichler
    Institute of Neuro-Oncology, Kepler University Hospital, Linz , Austria.
  • Georg Necker
    Institute of Neuroradiology, Neuromed Campus (NMC), Kepler University Hospital Linz, Linz, Austria.
  • Andreas Haunschmidt
    Institute of Neuroradiology, Neuromed Campus (NMC), Kepler University Hospital Linz, Linz, Austria.
  • Stephan Meckel
    Institute of Neuroradiology, Neuromed Campus (NMC), Kepler University Hospital Linz, Linz, Austria.
  • Pamela Guevara
    Faculty of Engineering, Department of Electrical Engineering, Universidad de Concepción, Concepción, Chile.
  • Esteban Torche
    Universidad de Concepción, Concepción, Chile.
  • Cristobal Mendoza
    Universidad de Concepción, Concepción, Chile.
  • Franco Vera
    Universidad de Concepción, Concepción, Chile.
  • Elvis Ríos
    Universidad de Concepción, Concepción, Chile.
  • Eduardo López
    Universidad de Concepción, Concepción, Chile.
  • Sergio A Velastin
    School of Electronic Engineering and Computer Science, Queen Mary University of London, London E1 4NS, UK.
  • Joseph Choi
    Department of Industrial and Systems Engineering, University of Iowa, Iowa City, IA, USA.
  • Stephen Baek
    Department of Mechanical and Industrial Engineering, The University of Iowa, Iowa City, IA 52242, USA.
  • Yusung Kim
    Department of Radiation Oncology, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA.
  • Heba Ismael
    Department of Radiation Oncology, University of Iowa, Iowa City, IA, USA.
  • Bryan Allen
    Department of Radiation Oncology, University of Iowa, Iowa City, IA, USA.
  • John M Buatti
    Department of Radiation Oncology, Carver College of Medicine, University of Iowa Carver College of Medicine, LL-W Pomerantz Family Pavilion, 200 Hawkins Drive, Iowa City, IA, 52242-1089, USA.
  • Peter Zampakis
    Department of NeuroRadiology, University of Patras, Patras, Greece.
  • Vasileios Panagiotopoulos
    Department of Neurosurgery, University of Patras, Patras, Greece.
  • Panagiotis Tsiganos
    Clinical Radiology Laboratory, Department of Medicine, University of Patras, Patras, Greece.
  • Sotiris Alexiou
    Department of Electrical and Computer Engineering, University of Patras, Patras, Greece.
  • Ilias Haliassos
    Department of Radiation Oncology, University of Patras, Patras, Greece.
  • Evangelia I Zacharaki
    Department of Radiology (G.C., S.D., M.P.R.) and Respiratory Medicine and National Cystic Reference Center (P.R.B.), Groupe Hospitalier Cochin-Hotel Dieu, AP-HP, Université Paris Descartes, 27 Rue du Faubourg Saint-Jacques, 75014 Paris, France; Center for Visual Computing, Ecole CentraleSupelec, Grande Voie des Vignes, Chatenay Malabry, France (G.C., E.I.Z., N.P.); U1016 Inserm, Institut Cochin, Paris, France (G.C., P.R.B., C.M., M.P.R.); Radiology Department (S.B.) and Pulmonary Department (R.C.), Hôpital Arnaud de Villeneuve, CHU de Montpellier, Université de Montpellier, Montpellier, France; ERN-Lung CF Network, France (P.R.B., C.M.); and TheraPanacea, Paris-Biotech-Santé, Paris, France (N.P.).
  • Konstantinos Moustakas
    Electrical & Computer Engineering Department, University of Patras, Patras, Greece.
  • Christina Kalogeropoulou
    Department of NeuroRadiology, University of Patras, Patras, Greece.
  • Dimitrios M Kardamakis
    Department of Radiation Oncology, University of Patras, Patras, Greece.
  • Bing Luo
  • Laila M Poisson
    Department of Public Health Sciences, Center for Bioinformatics, Henry Ford Health System, Detroit, Michigan, USA.
  • Ning Wen
    Department of Radiation Oncology, Henry Ford Hospital, Detroit, Michigan, USA.
  • Martin Vallières
    Medical Physics Unit, McGill University and Cedars Cancer Center, 1001 Décarie Blvd, Montréal, QC, H4A 3J1, Canada.
  • Mahdi Ait Lhaj Loutfi
    Department of Computer Science, Université de Sherbrooke, Sherbrooke, QC, Canada.
  • David Fortin
    Division of Neurosurgery and Neuro-Oncology, Faculty of Medicine and Health Science, Université de Sherbrooke, Sherbrooke, QC, Canada.
  • Martin Lepage
    Douglas Mental Health University Institute, 6875 Boulevard LaSalle, Verdun, QC H4H 1R3, Canada; Department of Psychiatry, McGill University, 845 Sherbrooke Street West, Montreal, Quebec H3A 0G4, Canada.
  • Fanny Morón
  • Jacob Mandel
    Department of Neurology, Baylor College of Medicine, Houston, TX, USA.
  • Gaurav Shukla
    Center for Biomedical Image Computing and Analytics, University of Pennsylvania, Philadelphia, Pennsylvania.
  • Spencer Liem
    Department of Radiation Oncology, Sidney Kimmel Cancer Center, Thomas Jefferson University, Philadelphia, Pennsylvania, USA.
  • Gregory S Alexandre
    Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, PA, USA.
  • Joseph Lombardo
    Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania, USA.
  • Joshua D Palmer
    Department of Radiation Oncology, The James Cancer Hospital and Solove Research Institute at the Ohio State University, Columbus, Ohio.
  • Adam E Flanders
  • Adam P Dicker
    Shivank Garg, Noelle L. Williams, and Adam P. Dicker, Sidney Kimmel Medical College at Thomas Jefferson University Philadelphia, PA; and Andrew Ip, Winship Cancer Institute at Emory University, Atlanta, GA.
  • Godwin Ogbole
    Department of Radiology, University College Hospital, Ibadan 200285, Nigeria.
  • Dotun Oyekunle
    Department of Radiology, University College Hospital, Ibadan 200285, Nigeria.
  • Olubunmi Odafe-Oyibotha
    Clinix Healthcare, Lagos, Lagos, Nigeria.
  • Babatunde Osobu
    Department of Radiology, University College Hospital Ibadan, Oyo, Nigeria.
  • Mustapha Shu'aibu Hikima
    Department of Radiology, Muhammad Abdullahi Wase Teaching Hospital, Kano, Nigeria.
  • Mayowa Soneye
    Department of Radiology, University College Hospital Ibadan, Oyo, Nigeria.
  • Farouk Dako
    Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA, USA.
  • Adeleye Dorcas
    Department of Radiology, Obafemi Awolowo University Ile-Ife, Ile-Ife, Osun, Nigeria.
  • Derrick Murcia
    Department of Neurosurgery, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.
  • Eric Fu
    Department of Neurosurgery, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.
  • Rourke Haas
    Department of Neurosurgery, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.
  • John A Thompson
    Department of Neurosurgery, University of Colorado Anschutz Medical Campus, Aurora, Colorado, United States of America.
  • David Ryan Ormond
    Department of Neurosurgery, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.
  • Stuart Currie
    Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, UK.
  • Kavi Fatania
    Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, UK. Kavi.fatania@nhs.net.
  • Russell Frood
    Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom.
  • Amber L Simpson
    Queen's University, Kingston, ON, CANADA.
  • Jacob J Peoples
    School of Computing, Queen's University, Kingston, ON, Canada.
  • Ricky Hu
  • Danielle Cutler
    School of Computing, Queen's University, Kingston, ON, Canada.
  • Fabio Y Moraes
    Department of Oncology, Queen's University, 25 King St W, Kingston, ON, K7L 5P9, Canada. fydm@queensu.ca.
  • Anh Tran
    School of Computing, Queen's University, Kingston, ON, Canada.
  • Mohammad Hamghalam
    National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, China; Faculty of Electrical, Biomedical and Mechatronics Engineering, Qazvin Branch, Islamic Azad University, Qazvin, Iran. Electronic address: m.hamghalam@gmail.com.
  • Michael A Boss
    Center for Research and Innovation, American College of Radiology, Philadelphia, PA, USA.
  • James Gimpel
    Center for Research and Innovation, American College of Radiology, Philadelphia, PA, USA.
  • Deepak Kattil Veettil
    American College of Radiology (ACR), Reston, VA, USA.
  • Kendall Schmidt
    American College of Radiology, Reston, Virginia.
  • Lisa Cimino
    American College of Radiology (ACR), Reston, VA, USA.
  • Cynthia Price
    American College of Radiology (ACR), Reston, VA, USA.
  • Brian Bialecki
    American College of Radiology (ACR), Reston, VA, USA.
  • Sailaja Marella
    American College of Radiology (ACR), Reston, VA, USA.
  • Charles Apgar
    American College of Radiology, Reston, Virginia.
  • Andras Jakab
  • Marc-André Weber
    Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany.
  • Errol Colak
    Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada.
  • Jens Kleesiek
    AG Computational Radiology, Abteilung Radiologie, Deutsches Krebsforschungszentrum (DKFZ), Im Neuenheimer Feld 280, 69120, Heidelberg, Deutschland. j.kleesiek@dkfz-heidelberg.de.
  • John B Freymann
    Cancer Imaging Informatics Lab, Frederick National Laboratory for Cancer Research, Frederick, MD, USA.
  • Justin S Kirby
    Leidos Biomedical Research, Inc., Frederick National Laboratory for Cancer Research, Frederick, MD, USA.
  • Lena Maier-Hein
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Jake Albrecht
    Sage Bionetworks, Seattle, WA, USA.
  • Peter Mattson
    MLCommons, San Francisco, CA, USA.
  • Alexandros Karargyris
    IHU Strasbourg, Strasbourg, France.
  • Prashant Shah
    Intel, Santa Clara, CA, USA.
  • Bjoern Menze
  • Klaus Maier-Hein
    Medical Image Analysis, Division Medical Image Computing, DKFZ Heidelberg, Germany.
  • Spyridon Bakas
    Perelman School of Medicine, Philadelphia, PA, USA.