Machine Learning for Health: Algorithm Auditing & Quality Control.

Journal: Journal of medical systems
Published Date:

Abstract

Developers proposing new machine learning for health (ML4H) tools often pledge to match or even surpass the performance of existing tools, yet the reality is usually more complicated. Reliable deployment of ML4H to the real world is challenging as examples from diabetic retinopathy or Covid-19 screening show. We envision an integrated framework of algorithm auditing and quality control that provides a path towards the effective and reliable application of ML systems in healthcare. In this editorial, we give a summary of ongoing work towards that vision and announce a call for participation to the special issue  Machine Learning for Health: Algorithm Auditing & Quality Control in this journal to advance the practice of ML4H auditing.

Authors

  • Luis Oala
    Department of Artificial Intelligence, Fraunhofer HHI, Berlin, Germany. luis.oala@hhi.fraunhofer.de.
  • Andrew G Murchison
    Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom.
  • Pradeep Balachandran
    Technical Consultant (Digital Health), Thiruvananthapuram, India.
  • Shruti Choudhary
    University of Oxford, Oxford, United Kingdom.
  • Jana Fehr
    Hasso-Plattner-Institute of Digital Engineering, Potsdam, Germany.
  • Alixandro Werneck Leite
    Machine Learning Laboratory in Finance and Organizations, Universidade de Brasília, Brasília, Brazil.
  • Peter G Goldschmidt
    World Development Group Inc, Bethesda, MD, USA.
  • Christian Johner
    Johner Institute, Konstanz, Germany.
  • Elora D M Schörverth
    Fraunhofer HHI, Berlin, Germany.
  • Rose Nakasi
    Makerere University, Kampala, Uganda.
  • Martin Meyer
    Siemens Healthineers, Erlangen, Germany.
  • Federico Cabitza
    Department of Informatics, Systems and Communication, University of Milano-Bicocca, Milano, Italy.
  • Pat Baird
  • Carolin Prabhu
    Office of the Auditor General of Norway, Oslo, Norway.
  • Eva Weicken
    Fraunhofer Institute for Telecommunications Heinrich-Hertz-Institute HHI, Berlin, Germany.
  • Xiaoxuan Liu
    Birmingham Health Partners Centre for Regulatory Science and Innovation University of Birmingham Birmingham Reino Unido Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, Reino Unido.
  • Markus Wenzel
    Fraunhofer Heinrich Hertz Institute and Technische Universität Berlin, Berlin 10587, Germany.
  • Steffen Vogler
    Bayer AG, Berlin, Germany.
  • Darlington Akogo
    minoHealth AI Labs, Accra, Ghana.
  • Shada Alsalamah
    Information Systems Department, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.
  • Emre Kazim
    University College London, London, United Kingdom.
  • Adriano Koshiyama
    University College London, London, United Kingdom.
  • Sven Piechottka
    Open Regulatory, Bonn, Germany.
  • Sheena Macpherson
    MIOTIFY LTD, London, United Kingdom.
  • Ian Shadforth
    A4L (US), Morrisville, North Carolina, United States of America.
  • Regina Geierhofer
    IEC TC62 and Siemens Healthineers, Erlangen, Germany.
  • Christian Matek
    Institute of Computational Biology, Helmholtz Zentrum München-German Research Center for Environmental Health, Neuherberg, Germany.
  • Joachim Krois
    Department of Operative and Preventive Dentistry, Charité - Universitätsmedizin Berlin, Berlin, Germany.
  • Bruno Sanguinetti
    Dotphoton AG, Zug, Switzerland.
  • Matthew Arentz
    Department of Global Health, University of Washington, Washington, USA.
  • Pavol Bielik
    LatticeFlow & ETH Zurich, Zürich, Switzerland.
  • Saul Calderon-Ramirez
    De Montfort University & Instituto Tecnologico de Costa Rica, Cartago, Costa Rica.
  • Auss Abbood
    Robert Koch Institute (RKI), Berlin, Germany.
  • Nicolas Langer
    Department of Psychology, University of Zurich, Zürich, Switzerland.
  • Stefan Haufe
    Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany.
  • Ferath Kherif
    Laboratory for Research in Neuroimaging, Department of Clinical Neuroscience, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.
  • Sameer Pujari
    World Health Organization, Geneva, Switzerland.
  • Wojciech Samek
    Machine Learning Group, Fraunhofer Heinrich Hertz Institute, Berlin, Germany.
  • Thomas Wiegand
    Fraunhofer Heinrich Hertz Institute and Technische Universität Berlin, Berlin 10587, Germany. Electronic address: thomas.wiegand@hhi.fraunhofer.de.