{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T04:04:28Z","timestamp":1790741068168,"version":"4.1.0"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T00:00:00Z","timestamp":1749772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100004587","name":"ISCIII","doi-asserted-by":"publisher","award":["PI21\/00283"],"award-info":[{"award-number":["PI21\/00283"]}],"id":[{"id":"10.13039\/501100004587","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>STUDY QUESTION<\/jats:title>\n                    <jats:p>What is the clinical utility of embryo selection algorithms in estimating the time to live birth (TTLB)?<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>SUMMARY ANSWER<\/jats:title>\n                    <jats:p>Using multiple imputations, the clinical utility of embryo selection algorithms was estimated, showing their potential to improve prediction of TTLB compared to manual ranking.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>WHAT IS KNOWN ALREADY<\/jats:title>\n                    <jats:p>Estimation of the clinical utility of embryo selection algorithms is challenging due to the unknown outcomes of non-transferred embryos. Existing studies have tried to mitigate the unknown outcome by using a biased subsample of the observed treatments or constructing treatments based on embryos from different patients.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>STUDY DESIGN, SIZE, DURATION<\/jats:title>\n                    <jats:p>Retrospective cohort study in a university-affiliated private IVF center. Treatments performed from 2015 through 2022 were included.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>PARTICIPANTS\/MATERIALS, SETTING, METHODS<\/jats:title>\n                    <jats:p>Three thousand seven hundred and eighty-three treatments with a total of 17\u00a0914 usable embryos, among these, 7571 embryos were transferred in either fresh or vitrified\/warmed transfers. The outcome of non-transferred embryos was estimated using the multiple imputation by chained equations (MICE) procedure.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>MAIN RESULTS AND THE ROLE OF CHANCE<\/jats:title>\n                    <jats:p>The average TTLB for the deep learning algorithm was 1.68 (95% CI: 1.63\u20131.72) transfers which was 6.1% shorter than the average TTLB of 1.78 (95% CI: 1.73\u20131.83) transfers for manual ranking. Measuring the algorithm ranking performance on the population level resulted in an area under the receiver operating characteristic curve (AUC) of 0.633 (95% CI: 0.620\u20130.645) while the average performance on the treatment level was 0.672 (95% CI: 0.656\u20130.687).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>LIMITATIONS, REASONS FOR CAUTION<\/jats:title>\n                    <jats:p>The proposed methods rely on an accurate prediction of the missing outcomes. As many other factors besides embryo quality will impact the actual outcome, the estimated TTLB can only approximate the actual clinical utility. In addition, the estimated TTLB in this study is only applicable to the specific dataset.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>WIDER IMPLICATIONS OF THE FINDINGS<\/jats:title>\n                    <jats:p>This study suggests that embryo selection algorithms could potentially improve clinical outcomes in IVF treatments by increasing the likelihood of live births compared to traditional morphological gradings hence increasing the efficacy and success rates of assisted reproductive technology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>STUDY FUNDING\/COMPETING INTEREST(S)<\/jats:title>\n                    <jats:p>No funding was received to support this study. L.B. reports Contract in Fundaci\u00f3n IVI, Instituto de Investigaci\u00f3n Sanitaria, La Fe (Valencia, Spain). M. J. is an employee at Vitrolife A\/S. J.B. is an employee and shareholder at Vitrolife A\/S. E.T.P. has no financial or personal interests related to the research. M.M. reports funding from ISCIII (PI21\/00283), cofounded by ERDF, \u2018A way to make Europe\u2019 awarded to M.M. for the submitted work; Contract in Fundaci\u00f3n IVI, Instituto de Investigaci\u00f3n Sanitaria, La Fe (Valencia, Spain), and Contract in IVIRMA Valencia; and honoraria from various companies, including Merck, Vitrolife, MSD Ferring, AiVF, Theramex, Gedeon Richter, Genea Biomedx, and Life Whisperer.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>TRIAL REGISTRATION NUMBER<\/jats:title>\n                    <jats:p>N\/A.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/humrep\/deaf102","type":"journal-article","created":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T08:53:24Z","timestamp":1747817604000},"page":"1516-1525","source":"Crossref","is-referenced-by-count":8,"title":["Predicting time to live birth with deep learning embryo ranking: a novel multiple imputation approach"],"prefix":"10.1093","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1495-2646","authenticated-orcid":false,"given":"Lorena","family":"Bori","sequence":"first","affiliation":[{"name":"IVIRMA Global Research Alliance, IVIRMA Valencia, IVI Foundation, Instituto de Investigaci\u00f3n Sanitaria La Fe (IIS La Fe) , Valencia,","place":["Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9790-0985","authenticated-orcid":false,"given":"Martin Nyg\u00e5rd","family":"Johansen","sequence":"additional","affiliation":[{"name":"Vitrolife A\/S , Viby J,","place":["Denmark"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5976-1002","authenticated-orcid":false,"given":"J\u00f8rgen","family":"Berntsen","sequence":"additional","affiliation":[{"name":"Vitrolife A\/S , Viby J,","place":["Denmark"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik Thorlund","family":"Parner","sequence":"additional","affiliation":[{"name":"Section for Biostatistics, Department of Public Health, Aarhus University , Aarhus,","place":["Denmark"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcos","family":"Meseguer","sequence":"additional","affiliation":[{"name":"IVIRMA Global Research Alliance, IVIRMA Valencia, IVI Foundation, Instituto de Investigaci\u00f3n Sanitaria La Fe (IIS La Fe) , Valencia,","place":["Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,6,13]]},"reference":[{"key":"2025080101520508300_deaf102-B1","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1002\/mpr.329","article-title":"Multiple imputation by chained equations: what is it and how does it work?","volume":"20","author":"Azur","year":"2011","journal-title":"Int J Methods Psych Res"},{"key":"2025080101520508300_deaf102-B2","doi-asserted-by":"crossref","first-page":"e0262661","DOI":"10.1371\/journal.pone.0262661","article-title":"Robust and generalizable embryo selection based on artificial intelligence and time-lapse image sequences","volume":"17","author":"Berntsen","year":"2022","journal-title":"PLos One"},{"key":"2025080101520508300_deaf102-B3","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1016\/j.fertnstert.2024.10.006","article-title":"External validation of a fully automated evaluation tool: a retrospective analysis on 68,471 scored embryos","volume":"123","author":"Bori","year":"2025","journal-title":"Fertil Steril"},{"key":"2025080101520508300_deaf102-B4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v045.i03","article-title":"mice: multivariate imputation by chained equations in R","volume":"45","author":"Buuren","year":"2011","journal-title":"J Stat Soft"},{"key":"2025080101520508300_deaf102-B5","doi-asserted-by":"crossref","first-page":"e0020","DOI":"10.5041\/RMMJ.10297","article-title":"Impact of endometrial preparation protocols for frozen embryo transfer on live birth rates","volume":"8","author":"Cerrillo","year":"2017","journal-title":"Rambam Maimonides Med J"},{"key":"2025080101520508300_deaf102-B6","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.3390\/jcm12051806","article-title":"Towards automation in IVF: pre-clinical validation of a deep learning-based embryo grading system during PGT-A cycles","volume":"12","author":"Cimadomo","year":"2023","journal-title":"J Clin Med"},{"key":"2025080101520508300_deaf102-B7","doi-asserted-by":"crossref","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"},{"key":"2025080101520508300_deaf102-B8","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1007\/s10815-021-02077-5","article-title":"Fertility technologies and how to optimize laboratory performance to support the shortening of time to birth of a healthy singleton: a Delphi consensus","volume":"38","author":"Coticchio","year":"2021","journal-title":"J Assist Reprod Genet"},{"key":"2025080101520508300_deaf102-B9","doi-asserted-by":"crossref","first-page":"1746","DOI":"10.1093\/humrep\/deac131","article-title":"Development of an artificial intelligence model for predicting the likelihood of human embryo euploidy based on blastocyst images from multiple imaging systems during IVF","volume":"37","author":"Diakiw","year":"2022","journal-title":"Human Reproduction"},{"key":"2025080101520508300_deaf102-B10","doi-asserted-by":"crossref","first-page":"103887","DOI":"10.1016\/j.rbmo.2024.103887","article-title":"Artificial intelligence-powered assisted ranking of sibling embryos to increase first cycle pregnancy rate","volume":"49","author":"Dissler","year":"2024","journal-title":"Reprod BioMed Online"},{"key":"2025080101520508300_deaf102-B11","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1093\/humrep\/deaa050","article-title":"Choice of statistical model in observational studies of ART","volume":"35","author":"Dodge","year":"2020","journal-title":"Hum Reprod"},{"key":"2025080101520508300_deaf102-B12","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1016\/j.fertnstert.2018.02.130","article-title":"Burden of care is the primary reason why insured women terminate in vitro fertilization treatment","volume":"109","author":"Domar","year":"2018","journal-title":"Fertil Steril"},{"key":"2025080101520508300_deaf102-B13","first-page":"378","volume-title":"Towards Reproductive Certainty: Infertility and Genetics Beyond","author":"Gardner","year":"1999"},{"key":"2025080101520508300_deaf102-B14","author":"Heymans","year":"2021"},{"key":"2025080101520508300_deaf102-B15","doi-asserted-by":"crossref","first-page":"3114","DOI":"10.1038\/s41591-024-03166-5","article-title":"Deep learning versus manual morphology-based embryo selection in IVF: a randomized, double-blind noninferiority trial","volume":"30","author":"Illingworth","year":"2024","journal-title":"Nat Med"},{"key":"2025080101520508300_deaf102-B16","doi-asserted-by":"crossref","first-page":"1675","DOI":"10.1007\/s10815-021-02254-6","article-title":"Embryo selection with artificial intelligence: how to evaluate and compare methods?","volume":"38","author":"Kragh","year":"2021","journal-title":"J Assist Reprod Genet"},{"key":"2025080101520508300_deaf102-B17","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1016\/j.fertnstert.2021.11.022","article-title":"Characterization of an artificial intelligence model for ranking static images of blastocyst stage embryos","volume":"117","author":"Loewke","year":"2022","journal-title":"Fertil Steril"},{"key":"2025080101520508300_deaf102-B18","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1007\/s10815-023-02790-3","article-title":"Time to live birth: towards a common agreement","volume":"40","author":"Marques","year":"2023","journal-title":"J Assist Reprod Genet"},{"key":"2025080101520508300_deaf102-B19","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/1471-2288-9-57","article-title":"Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines","volume":"9","author":"Marshall","year":"2009","journal-title":"BMC Med Res Methodol"},{"key":"2025080101520508300_deaf102-B20","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1093\/humrep\/der256","article-title":"The use of morphokinetics as a predictor of embryo implantation","volume":"26","author":"Meseguer","year":"2011","journal-title":"Human Reproduction"},{"key":"2025080101520508300_deaf102-B21","doi-asserted-by":"crossref","first-page":"567","DOI":"10.2307\/2533958","article-title":"Nonparametric analysis of clustered ROC curve data","volume":"53","author":"Obuchowski","year":"1997","journal-title":"Biometrics"},{"key":"2025080101520508300_deaf102-B22","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1080\/00031305.1992.10475842","article-title":"A note on the delta method","volume":"46","author":"Oehlert","year":"1992","journal-title":"Am Statist"},{"key":"2025080101520508300_deaf102-B23","volume-title":"R: A Language and Environment for Statistical Computing","author":"Core Team","year":"2024"},{"key":"2025080101520508300_deaf102-B24","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/j.rbmo.2021.08.012","article-title":"Measuring success in IVF is a complex multidisciplinary task: time for a consensus?","volume":"43","author":"Rienzi","year":"2021","journal-title":"Reprod BioMed Online"},{"key":"2025080101520508300_deaf102-B25","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1186\/1471-2105-12-77","article-title":"pROC: an open-source package for R and S+ to analyze and compare ROC curves","volume":"12","author":"Robin","year":"2011","journal-title":"BMC Bioinformatics"},{"key":"2025080101520508300_deaf102-B26","doi-asserted-by":"crossref","first-page":"b2393","DOI":"10.1136\/bmj.b2393","article-title":"Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls","volume":"338","author":"Sterne","year":"2009","journal-title":"BMJ"},{"key":"2025080101520508300_deaf102-B27","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","article-title":"Assessing the performance of prediction models: a framework for traditional and novel measures","volume":"21","author":"Steyerberg","year":"2010","journal-title":"Epidemiology"},{"key":"2025080101520508300_deaf102-B28","doi-asserted-by":"crossref","first-page":"4235","DOI":"10.1038\/s41598-023-31136-3","article-title":"Development and validation of deep learning based embryo selection across multiple days of transfer","volume":"13","author":"Theilgaard Lassen","year":"2023","journal-title":"Sci Rep"}],"container-title":["Human Reproduction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/humrep\/article-pdf\/40\/8\/1516\/63488341\/deaf102.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/humrep\/article-pdf\/40\/8\/1516\/63488341\/deaf102.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,1]],"date-time":"2025-08-01T05:52:28Z","timestamp":1754027548000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/humrep\/article\/40\/8\/1516\/8162410"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,13]]},"references-count":28,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2025,6,13]]},"published-print":{"date-parts":[[2025,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/humrep\/deaf102","relation":{},"ISSN":["0268-1161","1460-2350"],"issn-type":[{"value":"0268-1161","type":"print"},{"value":"1460-2350","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,8]]},"published":{"date-parts":[[2025,6,13]]}}}