A controlled trial examining large Language model conformity in psychiatric assessment using the Asch paradigm.

Journal: BMC psychiatry
PMID:

Abstract

BACKGROUND: Despite significant advances in AI-driven medical diagnostics, the integration of large language models (LLMs) into psychiatric practice presents unique challenges. While LLMs demonstrate high accuracy in controlled settings, their performance in collaborative clinical environments remains unclear. This study examined whether LLMs exhibit conformity behavior under social pressure across different diagnostic certainty levels, with a particular focus on psychiatric assessment.

Authors

  • Dorit Hadar Shoval
    The Center for Psychobiological Research, Department of Psychology and Educational Counseling, Max Stern Yezreel Valley College, Yezreel Valley, Israel. dorith@yvc.ac.il.
  • Karny Gigi
    The Institute for Research and Development, The Artificial Third, Tel Aviv, Israel.
  • Yuval Haber
    The Institute for Research and Development, The Artificial Third, Tel Aviv, Israel.
  • Amir Itzhaki
    The Institute for Research and Development, The Artificial Third, Tel Aviv, Israel.
  • Kfir Asraf
    The Center for Psychobiological Research, Department of Psychology and Educational Counseling, Max Stern Yezreel Valley College, Yezreel Valley, Israel.
  • David Piterman
    Faculty of Education, School of Therapy, Counseling, and Human Development, University of Haifa, Haifa, Israel.
  • Zohar Elyoseph
    The Institute for Research and Development, The Artificial Third, Tel Aviv, Israel.