GPT-4 generated psychological reports in psychodynamic perspective: a pilot study on quality, risk of hallucination and client satisfaction.

Journal: Frontiers in psychiatry
Published Date: Mar 19, 2025

Abstract

BACKGROUND: Recently, there have been active proposals on how to utilize large language models (LLMs) in the fields of psychiatry and counseling. It would be interesting to develop programs with LLMs that generate psychodynamic assessments to help individuals gain insights about themselves, and to evaluate the features of such services. However, studies on this subject are rare. This pilot study aims to evaluate quality, risk of hallucination (incorrect AI-generated information), and client satisfaction with psychodynamic psychological reports generated by GPT-4.

Authors

  • Namwoo Kim
    Department of Clinical Medical Sciences, Seoul National University, Seoul, Republic of Korea.
  • Jiseon Lee
    Department of Psychiatry, Uijeongbu Eulji Medical Center, Eulji University School of Medicine, Uijeongbu, Republic of Korea.
  • Sung Hyeon Park
    Department of Medical Informatics, The Catholic University of Korea College of Medicine, Seoul, Republic of Korea.
  • Yoonseo On
    College of Medicine, Ewha Women's University, Seoul, Republic of Korea.
  • Jieun Lee
    Department of Pediatrics, Inje University College of Medicine, Ilsan Paik Hospital, Goyang, Republic of Korea.
  • Musung Keum
    Department of Neuropsychiatry, Hallym University Dongtan Sacred Heart Hospital, Gyeonggi, Republic of Korea.
  • Sanghoon Oh
    Department of Psychiatry, Uijeongbu Eulji Medical Center, Eulji University School of Medicine, Uijeongbu, Republic of Korea.
  • Yoojin Song
    Department of Psychiatry, Kangwon National University Hospital, Chuncheon, Republic of Korea.
  • Junhee Lee
    Department of Psychiatry, Seoul St. Mary's Hospital, The Catholic University of Korea, College of Medicine, Seoul, Republic of Korea.
  • Geun Hui Won
    Department of Psychiatry, Chungnam National University Sejong Hospital, Sejong, Republic of Korea.
  • Joon Sung Shin
    Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea.
  • Silvia Kyungjin Lho
    Department of Psychiatry, SMG-SNU Boramae Medical Center, Seoul, Republic of Korea.
  • Yoon Jung Hwang
    Department of Psychiatry, Seoul St. Mary's Hospital, The Catholic University of Korea, College of Medicine, Seoul, Republic of Korea.
  • Tae-Suk Kim
    Department of Psychiatry, Seoul St. Mary's Hospital, The Catholic University of Korea, College of Medicine, Seoul, Republic of Korea.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals