Large language models to facilitate pregnancy prediction after in vitro fertilization.

Journal: Acta obstetricia et gynecologica Scandinavica
Published Date:

Abstract

We evaluated the efficacy of large language models (LLMs), specifically, generative pre-trained transformer-4 (GPT-4), in predicting pregnancy following in vitro fertilization (IVF) treatment and compared its accuracy with results from an original published study. Our findings revealed that GPT-4 can autonomously develop and refine advanced machine learning models for pregnancy prediction with minimal human intervention. The prediction accuracy was 0.79, and the area under the receiver operating characteristic curve (AUROC) was 0.89, exceeding or being at least equivalent to the metrics reported in the original study, that is, 0.78 for accuracy and 0.87 for AUROC. The results suggest that LLMs can facilitate data processing, optimize machine learning models in predicting IVF success rates, and provide data interpretation methods. This capacity can help bridge the knowledge gap between data scientists and medical personnel to solve the most pressing clinical challenges. However, more experiments on diverse and larger datasets are needed to validate and promote broader applications of LLMs in assisted reproduction.

Authors

  • Ping Cao
    Department of Clinical Genetics, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands.
  • Ganesh Acharya
    Department of Clinical Medicine, UiT The Arctic Univ. of Norway, Tromsø, Norway.
  • Andres Salumets
    Division of Obstetrics and Gynecology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet and Karolinska University Hospital, Stockholm, Sweden; Competence Centre on Health Technologies, Tartu, Estonia; Department of Obstetrics and Gynaecology, Institute of Clinical Medicine, University of Tartu, Tartu, Estonia.
  • Masoud Zamani Esteki
    Department of Clinical Genetics, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands.