{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T23:00:33Z","timestamp":1789340433257,"version":"build-2803163510"},"reference-count":68,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T00:00:00Z","timestamp":1660003200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Embryonics Ltd is an Israel-based company"},{"name":"Israeli Innovation Authority"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>STUDY QUESTION<\/jats:title>\n                    <jats:p>What is the accuracy and agreement of embryologists when assessing the implantation probability of blastocysts using time-lapse imaging (TLI), and can it be improved with a data-driven algorithm?<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>SUMMARY ANSWER<\/jats:title>\n                    <jats:p>The overall interobserver agreement of a large panel of embryologists was moderate and prediction accuracy was modest, while the purpose-built artificial intelligence model generally resulted in higher performance metrics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>WHAT IS KNOWN ALREADY<\/jats:title>\n                    <jats:p>Previous studies have demonstrated significant interobserver variability amongst embryologists when assessing embryo quality. However, data concerning embryologists\u2019 ability to predict implantation probability using TLI is still lacking. Emerging technologies based on data-driven tools have shown great promise for improving embryo selection and predicting clinical outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>STUDY DESIGN, SIZE, DURATION<\/jats:title>\n                    <jats:p>TLI video files of 136 embryos with known implantation data were retrospectively collected from two clinical sites between 2018 and 2019 for the performance assessment of 36 embryologists and comparison with a deep neural network (DNN).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>PARTICIPANTS\/MATERIALS, SETTING, METHODS<\/jats:title>\n                    <jats:p>We recruited 39 embryologists from 13 different countries. All participants were blinded to clinical outcomes. A total of 136 TLI videos of embryos that reached the blastocyst stage were used for this experiment. Each embryo\u2019s likelihood of successfully implanting was assessed by 36 embryologists, providing implantation probability grades (IPGs) from 1 to 5, where 1 indicates a very low likelihood of implantation and 5 indicates a very high likelihood. Subsequently, three embryologists with over 5 years of experience provided Gardner scores. All 136 blastocysts were categorized into three quality groups based on their Gardner scores. Embryologist predictions were then converted into predictions of implantation (IPG\u2009\u2265\u20093) and no implantation (IPG\u2009\u2264\u20092). Embryologists\u2019 performance and agreement were assessed using Fleiss kappa coefficient. A 10-fold cross-validation DNN was developed to provide IPGs for TLI video files. The model\u2019s performance was compared to that of the embryologists.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>MAIN RESULTS AND THE ROLE OF CHANCE<\/jats:title>\n                    <jats:p>Logistic regression was employed for the following confounding variables: country of residence, academic level, embryo scoring system, log years of experience and experience using TLI. None were found to have a statistically significant impact on embryologist performance at \u03b1\u2009=\u20090.05. The average implantation prediction accuracy for the embryologists was 51.9% for all embryos (N\u2009=\u2009136). The average accuracy of the embryologists when assessing top quality and poor quality embryos (according to the Gardner score categorizations) was 57.5% and 57.4%, respectively, and 44.6% for fair quality embryos. Overall interobserver agreement was moderate (\u03ba\u2009=\u20090.56, N\u2009=\u2009136). The best agreement was achieved in the poor + top quality group (\u03ba\u2009=\u20090.65, N\u2009=\u200977), while the agreement in the fair quality group was lower (\u03ba\u2009=\u20090.25, N\u2009=\u200959). The DNN showed an overall accuracy rate of 62.5%, with accuracies of 62.2%, 61% and 65.6% for the poor, fair and top quality groups, respectively. The AUC for the DNN was higher than that of the embryologists overall (0.70 DNN vs 0.61 embryologists) as well as in all of the Gardner groups (DNN vs embryologists\u2014Poor: 0.69 vs 0.62; Fair: 0.67 vs 0.53; Top: 0.77 vs 0.54).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>LIMITATIONS, REASONS FOR CAUTION<\/jats:title>\n                    <jats:p>Blastocyst assessment was performed using video files acquired from time-lapse incubators, where each video contained data from a single focal plane. Clinical data regarding the underlying cause of infertility and endometrial thickness before the transfer was not available, yet may explain implantation failure and lower accuracy of IPGs. Implantation was defined as the presence of a gestational sac, whereas the detection of fetal heartbeat is a more robust marker of embryo viability. The raw data were anonymized to the extent that it was not possible to quantify the number of unique patients and cycles included in the study, potentially masking the effect of bias from a limited patient pool. Furthermore, the lack of demographic data makes it difficult to draw conclusions on how representative the dataset was of the wider population. Finally, embryologists were required to assess the implantation potential, not embryo quality. Although this is not the traditional approach to embryo evaluation, morphology\/morphokinetics as a means of assessing embryo quality is believed to be strongly correlated with viability and, for some methods, implantation potential.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>WIDER IMPLICATIONS OF THE FINDINGS<\/jats:title>\n                    <jats:p>Embryo selection is a key element in IVF success and continues to be a challenge. Improving the predictive ability could assist in optimizing implantation success rates and other clinical outcomes and could minimize the financial and emotional burden on the patient. This study demonstrates moderate agreement rates between embryologists, likely due to the subjective nature of embryo assessment. In particular, we found that average embryologist accuracy and agreement were significantly lower for fair quality embryos when compared with that for top and poor quality embryos. Using data-driven algorithms as an assistive tool may help IVF professionals increase success rates and promote much needed standardization in the IVF clinic. Our results indicate a need for further research regarding technological advancement in this field.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>STUDY FUNDING\/COMPETING INTEREST(S)<\/jats:title>\n                    <jats:p>Embryonics Ltd is an Israel-based company. Funding for the study was partially provided by the Israeli Innovation Authority, grant #74556.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>TRIAL REGISTRATION NUMBER<\/jats:title>\n                    <jats:p>N\/A.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/humrep\/deac171","type":"journal-article","created":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T15:08:31Z","timestamp":1660057711000},"page":"2275-2290","source":"Crossref","is-referenced-by-count":53,"title":["Embryologist agreement when assessing blastocyst implantation probability: is data-driven prediction the solution to embryo assessment subjectivity?"],"prefix":"10.1093","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5394-7973","authenticated-orcid":false,"given":"Daniel E","family":"Fordham","sequence":"first","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dror","family":"Rosentraub","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5105-9198","authenticated-orcid":false,"given":"Avital L","family":"Polsky","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Talia","family":"Aviram","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yotam","family":"Wolf","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oriel","family":"Perl","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asnat","family":"Devir","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shahar","family":"Rosentraub","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David H","family":"Silver","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yael","family":"Gold Zamir","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex M","family":"Bronstein","sequence":"additional","affiliation":[{"name":"Embryonics, Embryonics R&D Center , Haifa, Israel"},{"name":"Computer Science, Technion\u2014Israel Institute of Technology , Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miguel","family":"Lara Lara","sequence":"additional","affiliation":[{"name":"Unidad de Reproducci\u00f3n Centro Gutenberg , M\u00e1laga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jara","family":"Ben Nagi","sequence":"additional","affiliation":[{"name":"Centre for Reproductive and Genetic Health , London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrian","family":"Alvarez","sequence":"additional","affiliation":[{"name":"Overture Life, AI Department , New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Santiago","family":"Munn\u00e9","sequence":"additional","affiliation":[{"name":"Overture Life, AI Department , New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,8,9]]},"reference":[{"key":"2022100305590890200_deac171-B1","author":"2019 Assisted Reproductive Technology Fertility Clinic and National Summary Report | CDC","year":"2022"},{"key":"2022100305590890200_deac171-B2","doi-asserted-by":"crossref","first-page":"hoab040","DOI":"10.1093\/hropen\/hoab040","article-title":"Interpretable, not black-box, artificial intelligence should be used for embryo selection","volume":"2021","author":"Afnan","year":"2021","journal-title":"Hum Reprod Open"},{"key":"2022100305590890200_deac171-B3","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1093\/humrep\/deac020","article-title":"A double-blind randomized controlled trial investigating a time-lapse algorithm for selecting Day 5 blastocysts for transfer","volume":"37","author":"Ahlstr\u00f6m","year":"2022","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B4","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.1093\/humrep\/der037","article-title":"The Istanbul consensus workshop on embryo assessment: proceedings of an expert meeting","volume":"26","author":"Alpha Scientists in Reproductive Medicine and ESHRE Special Interest Group of Embryology","year":"2011","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B5","doi-asserted-by":"crossref","DOI":"10.1201\/9780429258589","volume-title":"Practical Statistics for Medical Research","author":"Altman","year":"1990"},{"key":"2022100305590890200_deac171-B6","doi-asserted-by":"crossref","first-page":"205520762210744","DOI":"10.1177\/20552076221074488","article-title":"Re-focusing explainability in medicine","volume":"8","author":"Arbelaez Ossa","year":"2022","journal-title":"Digit Health"},{"key":"2022100305590890200_deac171-B7","doi-asserted-by":"crossref","first-page":"2141","DOI":"10.1093\/humrep\/del106","article-title":"Interobserver agreement and intraobserver reproducibility of embryo quality assessments","volume":"21","author":"Arce","year":"2006","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B8","first-page":"CD011320","article-title":"Time-lapse systems for embryo incubation and assessment in assisted reproduction","volume":"5","author":"Armstrong","year":"2019","journal-title":"Cochrane Database Syst Rev"},{"key":"2022100305590890200_deac171-B9","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: a deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"2022100305590890200_deac171-B10","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1016\/j.rbmo.2010.11.003","article-title":"Clinical outcome of intracytoplasmic injection of spermatozoa morphologically selected under high magnification: a prospective randomized study","volume":"22","author":"Balaban","year":"2011","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B11","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/j.rbmo.2017.02.011","article-title":"Preliminary investigation of the prevalence and implantation potential of abnormal embryonic phenotypes assessed using time-lapse imaging","volume":"34","author":"Barrie","year":"2017","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B12","doi-asserted-by":"crossref","first-page":"1608","DOI":"10.1016\/j.fertnstert.2006.05.037","article-title":"Interobserver and intraobserver variation in day 3 embryo grading","volume":"86","author":"Bendus","year":"2006","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B13","doi-asserted-by":"crossref","first-page":"e0262661","DOI":"10.1371\/journal.pone.0262661","article-title":"Robust and generalizable embryo selection based on artificial intelligence and time-lapse image sequences","volume":"17","author":"Berntsen","year":"2022","journal-title":"PLoS One"},{"key":"2022100305590890200_deac171-B14","doi-asserted-by":"crossref","first-page":"e55301","DOI":"10.7554\/eLife.55301","article-title":"Performance of a deep learning based neural network in the selection of human blastocysts for implantation","volume":"9","author":"Bormann","year":"2020","journal-title":"eLife"},{"key":"2022100305590890200_deac171-B15","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1093\/humupd\/dms041","article-title":"Added value of ovarian reserve testing on patient characteristics in the prediction of ovarian response and ongoing pregnancy: an individual patient data approach","volume":"19","author":"Broer","year":"2013","journal-title":"Hum Reprod Update"},{"key":"2022100305590890200_deac171-B16","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s10815-014-0341-x","article-title":"Relative kinetic expressions defining cleavage synchronicity are better predictors of blastocyst formation and quality than absolute time points","volume":"32","author":"Cetinkaya","year":"2015","journal-title":"J Assist Reprod Genet"},{"key":"2022100305590890200_deac171-B92023329","doi-asserted-by":"crossref","first-page":"4394","DOI":"10.1038\/s41598-020-61357-9","article-title":"Predicting pregnancy test results after embryo transfer by image feature extraction and analysis using machine learning","volume":"10","author":"Chavez-Badiola","year":"2020","journal-title":"Sci Rep"},{"key":"2022100305590890200_deac171-B18","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1016\/j.rbmo.2020.07.003","article-title":"Embryo Ranking Intelligent Classification Algorithm (ERICA): artificial intelligence clinical assistant predicting embryo ploidy and implantation","volume":"41","author":"Chavez-Badiola","year":"2020","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B19","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1016\/j.fertnstert.2020.09.159","article-title":"Evaluating predictive models in reproductive medicine","volume":"114","author":"Curchoe","year":"2020","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B555","author":"Dosovitskiy"},{"key":"2022100305590890200_deac171-B20","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1007\/s10815-017-0964-9","article-title":"National survey on use of time-lapse imaging systems in IVF laboratories","volume":"34","author":"Dolinko","year":"2017","journal-title":"J Assist Reprod Genet"},{"key":"2022100305590890200_deac171-B21","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1016\/j.rbmo.2017.06.015","article-title":"The Vienna consensus: report of an expert meeting on the development of ART laboratory performance indicators","volume":"35","author":"ESHRE Special Interest Group of Embryology and Alpha Scientists in Reproductive Medicine","year":"2017","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B22","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/0093-691X(95)00189-F","article-title":"Agreement among evaluators of bovine embryos produced in vivo or in vitro","volume":"44","author":"Farin","year":"1995","journal-title":"Theriogenology"},{"key":"2022100305590890200_deac171-B23","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol Bull"},{"key":"2022100305590890200_deac171-B24","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1016\/S0015-0282(00)00518-5","article-title":"Blastocyst score affects implantation and pregnancy outcome: towards a single blastocyst transfer","volume":"73","author":"Gardner","year":"2000","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B25","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1093\/humrep\/13.12.3434","article-title":"A prospective randomized trial of blastocyst culture and transfer in in-vitro fertilization","volume":"13","author":"Gardner","year":"1998","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B26","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1093\/humrep\/deaa060","article-title":"Should we freeze it? Agreement on fate of borderline blastocysts is poor and does not improve with a modified blastocyst grading system","volume":"35","author":"Hammond","year":"2020","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B27","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1016\/j.fertnstert.2013.07.2002","article-title":"Diminished effect of maternal age on implantation after preimplantation genetic diagnosis with array comparative genomic hybridization","volume":"100","author":"Harton","year":"2013","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B28","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1093\/humupd\/dmu023","article-title":"Clinical outcomes following selection of human preimplantation embryos with time-lapse monitoring: a systematic review","volume":"20","author":"Kaser","year":"2014","journal-title":"Hum Reprod Update"},{"key":"2022100305590890200_deac171-B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0096-y","article-title":"Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization","volume":"2","author":"Khosravi","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2022100305590890200_deac171-B30","author":"Kingma","year":"2017"},{"key":"2022100305590890200_deac171-B31","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.fertnstert.2014.11.003","article-title":"Choosing the best embryo by time lapse versus standard morphology","volume":"103","author":"Kirkegaard","year":"2015","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B32","doi-asserted-by":"crossref","first-page":"1675","DOI":"10.1007\/s10815-021-02254-6","article-title":"Embryo selection with artificial intelligence: how to evaluate and compare methods?","volume":"38","author":"Kragh","year":"2021","journal-title":"J Assist Reprod Genet"},{"key":"2022100305590890200_deac171-B33","doi-asserted-by":"crossref","first-page":"103494","DOI":"10.1016\/j.compbiomed.2019.103494","article-title":"Automatic grading of human blastocysts from time-lapse imaging","volume":"115","author":"Kragh","year":"2019","journal-title":"Comput Biol Med"},{"key":"2022100305590890200_deac171-B34","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1093\/humupd\/dmx017","article-title":"GnRH antagonist versus long agonist protocols in IVF: a systematic review and meta-analysis accounting for patient type","volume":"23","author":"Lambalk","year":"2017","journal-title":"Hum Reprod Update"},{"key":"2022100305590890200_deac171-B35","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1016\/j.fertnstert.2014.07.1235","article-title":"Prevalence, consequence, and significance of reverse cleavage by human embryos viewed with the use of the embryoscope time-lapse video system","volume":"102","author":"Liu","year":"2014","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B36","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1016\/j.fertnstert.2021.11.022","article-title":"Characterization of an artificial intelligence model for ranking static images of blastocyst stage embryos","volume":"117","author":"Loewke","year":"2022","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B37","first-page":"2703","article-title":"Cumulative live birth rate: time for a consensus?","volume":"30","author":"Maheshwari","year":"2015","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B38","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/j.fertnstert.2015.11.001","article-title":"Morphokinetic analysis and embryonic prediction for blastocyst formation through an integrated time-lapse system","volume":"105","author":"Motato","year":"2016","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B39","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/j.rbmo.2018.08.001","article-title":"Status of preimplantation genetic testing and embryo selection","volume":"37","author":"Munn\u00e9","year":"2018","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B40","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.fertnstert.2017.05.002","article-title":"Detailed investigation into the cytogenetic constitution and pregnancy outcome of replacing mosaic blastocysts detected with the use of high-resolution next-generation sequencing","volume":"108","author":"Munn\u00e9","year":"2017","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B41","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1016\/j.fertnstert.2019.07.1346","article-title":"Preimplantation genetic testing for aneuploidy versus morphology as selection criteria for single frozen-thawed embryo transfer in good-prognosis patients: a multicenter randomized clinical trial","volume":"112","author":"Munn\u00e9","year":"2019","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B42","first-page":"5949","article-title":"Exploring generalization in deep learning","volume":"30","author":"Neyshabur","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"2022100305590890200_deac171-B43","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1056\/NEJMoa053524","article-title":"In vitro fertilization with single blastocyst-stage versus single cleavage-stage embryos","volume":"354","author":"Papanikolaou","year":"2006","journal-title":"N Engl J Med"},{"key":"2022100305590890200_deac171-B44","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1186\/1477-7827-7-105","article-title":"Intra- and inter-observer analysis in the morphological assessment of early-stage embryos","volume":"7","author":"Paternot","year":"2009","journal-title":"Reprod Biol Endocrinol"},{"key":"2022100305590890200_deac171-B45","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1093\/humrep\/dew188","article-title":"Development of a generally applicable morphokinetic algorithm capable of predicting the implantation potential of embryos transferred on Day 3","volume":"31","author":"Petersen","year":"2016","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B46","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1016\/j.conb.2012.07.011","article-title":"Value normalization in decision making: theory and evidence","volume":"22","author":"Rangel","year":"2012","journal-title":"Curr Opin Neurobiol"},{"key":"2022100305590890200_deac171-B47","doi-asserted-by":"crossref","first-page":"150","DOI":"10.5935\/1518-0557.20160033","article-title":"Methods for assessing the quality of mammalian embryos: how far we are from the gold standard?","volume":"20","author":"Rocha","year":"2016","journal-title":"JBRA Assist Reprod"},{"key":"2022100305590890200_deac171-B48","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10815-021-02078-4","article-title":"Utilization of preimplantation genetic testing in the USA","volume":"38","author":"Roche","year":"2021","journal-title":"J Assist Reprod Genet"},{"key":"2022100305590890200_deac171-B49","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.1016\/j.fertnstert.2012.07.1135","article-title":"Limited implantation success of direct-cleaved human zygotes: a time-lapse study","volume":"98","author":"Rubio","year":"2012","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B50","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol Bull"},{"key":"2022100305590890200_deac171-B51","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.fertnstert.2017.10.036","article-title":"Time-lapse algorithms and morphological selection of day-5 embryos for transfer: a preclinical validation study","volume":"109","author":"Storr","year":"2018","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B52","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1093\/humrep\/dew330","article-title":"Inter-observer and intra-observer agreement between embryologists during selection of a single Day 5 embryo for transfer: a multicenter study","volume":"32","author":"Storr","year":"2017","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B53","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1093\/humrep\/det366","article-title":"Inter- and intra-observer variability of time-lapse annotations","volume":"28","author":"Sundvall","year":"2013","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B54","author":"Tan","year":"2021"},{"key":"2022100305590890200_deac171-B55","doi-asserted-by":"crossref","first-page":"1577","DOI":"10.1007\/s10815-013-0100-4","article-title":"Blastocyst expansion score and trophectoderm morphology strongly predict successful clinical pregnancy and live birth following elective single embryo blastocyst transfer (eSET): a national study","volume":"30","author":"Thompson","year":"2013","journal-title":"J Assist Reprod Genet"},{"key":"2022100305590890200_deac171-B56","doi-asserted-by":"crossref","first-page":"e32","DOI":"10.1016\/j.fertnstert.2020.08.115","article-title":"Transfer outcomes of embryos with preimplantation genetic testing for aneuploidy (PGT-A) diagnoses of undetermined reproductive potential: results from a prospective, blinded, multi-center non-selection study","volume":"114","author":"Tiegs","year":"2020","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B57","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1093\/humrep\/dez064","article-title":"Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer","volume":"34","author":"Tran","year":"2019","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B58","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1126\/science.7455683","article-title":"The framing of decisions and the psychology of choice","volume":"211","author":"Tversky","year":"1981","journal-title":"Science"},{"key":"2022100305590890200_deac171-B59","doi-asserted-by":"crossref","first-page":"1172","DOI":"10.1016\/j.fertnstert.2021.06.001","article-title":"Pregnancy prediction performance of an annotation-free embryo scoring system on the basis of deep learning after single vitrified-warmed blastocyst transfer: a single-center large cohort retrospective study","volume":"116","author":"Ueno","year":"2021","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B60","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.rbmo.2013.07.006","article-title":"Association between blastocyst morphology and outcome of single-blastocyst transfer","volume":"27","author":"Van den Abbeel","year":"2013","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B61","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1093\/humrep\/deaa013","article-title":"Development of an artificial intelligence-based assessment model for prediction of embryo viability using static images captured by optical light microscopy during IVF","volume":"35","author":"VerMilyea","year":"2020","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B62","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/j.rbmo.2012.08.001","article-title":"IVF versus ICSI for the fertilization of in-vitro matured human oocytes","volume":"25","author":"Walls","year":"2012","journal-title":"Reprod Biomed Online"},{"key":"2022100305590890200_deac171-B63","doi-asserted-by":"crossref","first-page":"18927","DOI":"10.1109\/ACCESS.2021.3053098","article-title":"A deep learning framework design for automatic blastocyst evaluation with multifocal images","volume":"9","author":"Wang","year":"2021","journal-title":"IEEE Access"},{"key":"2022100305590890200_deac171-B64","first-page":"CD005354","article-title":"Recombinant versus urinary gonadotrophin for ovarian stimulation in assisted reproductive technology cycles","volume":"2011","author":"van Wely","year":"2011","journal-title":"Cochrane Database Syst Rev"},{"key":"2022100305590890200_deac171-B65","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1093\/humrep\/des417","article-title":"Use of hyaluronan in the selection of sperm for intracytoplasmic sperm injection (ICSI): significant improvement in clinical outcomes\u2013multicenter, double-blinded and randomized controlled trial","volume":"28","author":"Worrilow","year":"2013","journal-title":"Hum Reprod"},{"key":"2022100305590890200_deac171-B66","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/j.fertnstert.2017.06.005","article-title":"The international glossary on infertility and fertility care, 2017","volume":"108","author":"Zegers-Hochschild","year":"2017","journal-title":"Fertil Steril"},{"key":"2022100305590890200_deac171-B67","author":"Zhang","year":"2016"}],"container-title":["Human Reproduction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/humrep\/article-pdf\/37\/10\/2275\/46286339\/deac171.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/humrep\/article-pdf\/37\/10\/2275\/46286339\/deac171.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,3]],"date-time":"2022-10-03T02:01:25Z","timestamp":1664762485000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/humrep\/article\/37\/10\/2275\/6659059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,9]]},"references-count":68,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,8,9]]},"published-print":{"date-parts":[[2022,9,30]]}},"URL":"https:\/\/doi.org\/10.1093\/humrep\/deac171","relation":{},"ISSN":["0268-1161","1460-2350"],"issn-type":[{"value":"0268-1161","type":"print"},{"value":"1460-2350","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,10,1]]},"published":{"date-parts":[[2022,8,9]]}}}