Robust diagnostic classification via Q-learning.

Journal: Scientific reports
Published Date:

Abstract

Machine learning (ML) models have demonstrated the power of utilizing clinical instruments to provide tools for domain experts in gaining additional insights toward complex clinical diagnoses. In this context these tools desire two additional properties: interpretability, being able to audit and understand the decision function, and robustness, being able to assign the correct label in spite of missing or noisy inputs. This work formulates diagnostic classification as a decision-making process and utilizes Q-learning to build classifiers that meet the aforementioned desired criteria. As an exemplary task, we simulate the process of differentiating Autism Spectrum Disorder from Attention Deficit-Hyperactivity Disorder in verbal school aged children. This application highlights how reinforcement learning frameworks can be utilized to train more robust classifiers by jointly learning to maximize diagnostic accuracy while minimizing the amount of information required.

Authors

  • Victor Ardulov
    University of Southern California, Los Angeles, USA. ardulov@usc.edu.
  • Victor R Martinez
    Department of Computer Science.
  • Krishna Somandepalli
    University of Southern California, Los Angeles, USA.
  • Shuting Zheng
    University of California San Francisco, San Francisco, USA.
  • Emma Salzman
    University of California San Francisco, San Francisco, USA.
  • Catherine Lord
    Center for Autism and the Developing Brain, Weill Cornell Medical College, New York, NY, USA.
  • Somer Bishop
    University of California San Francisco, San Francisco, USA.
  • Shrikanth Narayanan
    Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States.