Multiple Holdouts With Stability: Improving the Generalizability of Machine Learning Analyses of Brain-Behavior Relationships.

Journal: Biological psychiatry
PMID:

Abstract

BACKGROUND: In 2009, the National Institute of Mental Health launched the Research Domain Criteria, an attempt to move beyond diagnostic categories and ground psychiatry within neurobiological constructs that combine different levels of measures (e.g., brain imaging and behavior). Statistical methods that can integrate such multimodal data, however, are often vulnerable to overfitting, poor generalization, and difficulties in interpreting the results.

Authors

  • Agoston Mihalik
    Centre for Medical Image Computing, Department of Computer Science, University College London, London, United Kingdom; Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom. Electronic address: a.mihalik@ucl.ac.uk.
  • Fabio S Ferreira
    Centre for Medical Image Computing, Department of Computer Science, University College London, London, United Kingdom; Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom.
  • Michael Moutoussis
    Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom.
  • Gabriel Ziegler
    Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; Institute of Cognitive Neurology and Dementia Research, Otto von Guericke University, Magdeburg, Magdeburg, Germany; German Center for Neurodegenerative Diseases, Bonn, Germany.
  • Rick A Adams
    Centre for Medical Image Computing, Department of Computer Science, University College London, London, United Kingdom; Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom.
  • Maria J Rosa
    Centre for Medical Image Computing, Department of Computer Science, University College London, London, United Kingdom; Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom.
  • Gita Prabhu
    Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom.
  • Leticia de Oliveira
    Laboratory of Neurophysiology of Behaviour, Department of Physiology and Pharmacology, Biomedical Institute, Federal Fluminense University, Niterói, Brazil.
  • Mirtes Pereira
    Laboratory of Neurophysiology of Behaviour, Department of Physiology and Pharmacology, Biomedical Institute, Federal Fluminense University, Niterói, Brazil.
  • Edward T Bullmore
    Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom; Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, United Kingdom; Cambridgeshire and Peterborough NHS Foundation Trust, Cambridge, United Kingdom; ImmunoPsychiatry, GlaxoSmithKline Research and Development, Stevenage, United Kingdom.
  • Peter Fonagy
    Research Department of Clinical, Educational, and Health Psychology, University College London, London, United Kingdom.
  • Ian M Goodyer
    Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom; Cambridgeshire and Peterborough NHS Foundation Trust, Cambridge, United Kingdom.
  • Peter B Jones
    Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom; Cambridgeshire and Peterborough NHS Foundation Trust, Cambridge, United Kingdom.
  • John Shawe-Taylor
    Department of Computer Science, University College London, London, United Kingdom.
  • Raymond Dolan
    Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom.
  • Janaina Mourão-Miranda
    Centre for Medical Image Computing, Department of Computer Science, University College London, London, United Kingdom; Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom.