Machine learning center-specific models show improved IVF live birth predictions over US national registry-based model.

Journal: Nature communications
PMID:

Abstract

Expanding in vitro fertilization (IVF) access requires improved patient counseling and affordability via cost-success transparency. Clinicians ask how two types of live birth prediction (LBP) models perform: machine learning, center-specific (MLCS) models and the multicenter, US national registry-based model produced by Society for Assisted Reproductive Technology (SART). In a retrospective model validation study, we tested whether MLCS performs better than SART using 4635 patients' first-IVF cycle data from 6 centers. MLCS significantly improved minimization of false positives and negatives overall (precision recall area-under-the-curve) and at the 50% LBP threshold (F1 score) compared to SART (p < 0.05). To contextualize, MLCS more appropriately assigned 23% and 11% of all patients to LBP ≥ 50% and LBP ≥ 75% whereas SART gave lower LBPs. Here, we show MLCS improves model metrics relevant for clinical utility - personalizing prognostic counseling and cost-success transparency - and is externally validated. We recommend evaluating MLCS in a larger sample of fertility centers.

Authors

  • Mylene W M Yao
    R&D Department, Univfy, Los Altos, California.
  • Elizabeth T Nguyen
    R&D Department, Univfy, Los Altos, California.
  • Matthew G Retzloff
    Fertility Center of San Antonio, San Antonio, TX, USA.
  • L April Gago
    Gago Center for Fertility, Brighton, MI, USA.
  • John E Nichols
    Piedmont Reproductive Endocrinology Group, Greenville, South Carolina.
  • John F Payne
    Piedmont Reproductive Endocrinology Group, Greenville, SC, USA.
  • Barry A Ripps
    NewLIFE Fertility, Pensacola, FL, USA.
  • Michael Opsahl
    Poma Fertility, Kirkland, WA, USA.
  • Jeremy Groll
    SpringCreek Fertility, Dayton, OH, USA.
  • Ronald Beesley
    Poma Fertility, Kirkland, WA, USA.
  • Gregory Neal
    Fertility Center of San Antonio, San Antonio, TX, USA.
  • Jaye Adams
    Fertility Center of San Antonio, San Antonio, TX, USA.
  • Lorie Nowak
    SpringCreek Fertility, Dayton, OH, USA.
  • Trevor Swanson
    R&D Department, Univfy, Los Altos, California.
  • Xiaocong Chen
    R&D Department, Univfy, Los Altos, CA, USA.