{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T14:15:12Z","timestamp":1778854512985,"version":"3.51.4"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T00:00:00Z","timestamp":1644883200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T00:00:00Z","timestamp":1644883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In vitro fertilization is typically associated with high failure rates per transfer,\n leading to an acute need for the identification of embryos with high developmental potential. Current methods are tailored to specific times after fertilization, often require expert inspection, and have low predictive power. Automatic methods are challenged by ambiguous labels, clinical heterogeneity, and the inability to utilize multiple developmental points. In this work, we propose a novel method that trains a classifier conditioned on the time since fertilization. This classifier is then integrated over time and its output is used to assign soft labels to pairs of samples. The classifier obtained by training on these soft labels presents a significant improvement in accuracy, even as early as 30\u00a0h post-fertilization. By integrating the classification scores, the predictive power is further improved. Our results are superior to previously reported methods, including the commercial KIDScore-D3 system, and a group of eight senior professionals, in classifying multiple groups of favorable embryos into groups defined as less favorable based on implantation outcomes, expert decisions based on developmental trajectories, and\/or genetic tests.<\/jats:p>","DOI":"10.1038\/s41598-022-06336-y","type":"journal-article","created":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T11:03:01Z","timestamp":1644922981000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Pseudo contrastive labeling for predicting IVF embryo developmental potential"],"prefix":"10.1038","volume":"12","author":[{"given":"I.","family":"Erlich","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Ben-Meir","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"I.","family":"Har-Vardi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Grifo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"F.","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Mccaffrey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"McCulloh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Y.","family":"Or","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"L.","family":"Wolf","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,2,15]]},"reference":[{"key":"6336_CR1","doi-asserted-by":"crossref","unstructured":"Gardner, D. K. & Balaban, B. Assessment of human embryo development using morphological criteria in an era of time-lapse, algorithms and \u2018omics\u2019: Is looking good still important?. Mol. Hum. Reprod.22, 704\u2013718 (2016).","DOI":"10.1093\/molehr\/gaw057"},{"key":"6336_CR2","doi-asserted-by":"crossref","unstructured":"American\u00a0College of\u00a0Obstetricians, Gynecologists, et\u00a0al. Multiple gestation: Complicated twin, triplet, and high-order multifetal pregnancy, ACOG practice bullatin no. 56. Obstet. Gynecol., 104, 869\u2013883 (2004).","DOI":"10.1097\/00006250-200410000-00046"},{"issue":"5","key":"6336_CR3","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1016\/j.rbmo.2017.02.002","volume":"34","author":"Y Tian","year":"2017","unstructured":"Tian, Y. et al. Predicting pregnancy rate following multiple embryo transfers using algorithms developed through static image analysis. Reprod. Biomed. Online 34(5), 473\u2013479 (2017).","journal-title":"Reprod. Biomed. Online"},{"issue":"6","key":"6336_CR4","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1016\/S0015-0282(00)00518-5","volume":"73","author":"DK Gardner","year":"2000","unstructured":"Gardner, D. K., Lane, M., Stevens, J., Schlenker, T. & Schoolcraft, W. B. Blastocyst score affects implantation and pregnancy outcome: Towards a single blastocyst transfer. Fertil. Steril. 73(6), 1155\u20131158 (2000).","journal-title":"Fertil. Steril."},{"issue":"4","key":"6336_CR5","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1016\/j.rbmo.2020.07.003","volume":"41","author":"A Chavez-Badiola","year":"2020","unstructured":"Chavez-Badiola, A., Flores-Saiffe-Far\u00edas, A., Mendizabal-Ruiz, G., Drakeley, A. J. & Cohen, J. Embryo ranking intelligent classification algorithm (ERICA): Artificial intelligence clinical assistant predicting embryo ploidy and implantation. Reprod. BioMed. Online 41(4), 585\u2013593 (2020).","journal-title":"Reprod. BioMed. Online"},{"issue":"6","key":"6336_CR6","doi-asserted-by":"publisher","first-page":"1232","DOI":"10.1016\/j.fertnstert.2020.08.023","volume":"114","author":"L Bori","year":"2020","unstructured":"Bori, L. et al. Novel and conventional embryo parameters as input data for artificial neural networks: An artificial intelligence model applied for prediction of the implantation potential. Fertil. Steril. 114(6), 1232\u20131241 (2020).","journal-title":"Fertil. Steril."},{"issue":"3","key":"6336_CR7","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.jare.2013.05.002","volume":"5","author":"L van Loendersloot","year":"2014","unstructured":"van Loendersloot, L., Repping, S., Bossuyt, P. M. M., van der Veen, F. & van Wely, M. Prediction models in in vitro fertilization; where are we? A mini review. J. Adv. Res. 5(3), 295\u2013301 (2014).","journal-title":"J. Adv. Res."},{"issue":"3","key":"6336_CR8","doi-asserted-by":"publisher","first-page":"205","DOI":"10.5455\/aim.2019.27.205-211","volume":"27","author":"B Raef","year":"2019","unstructured":"Raef, B. & Ferdousi, R. A review of machine learning approaches in assisted reproductive technologies. Acta Inform. Med. 27(3), 205 (2019).","journal-title":"Acta Inform. Med."},{"issue":"7","key":"6336_CR9","doi-asserted-by":"publisher","first-page":"2283","DOI":"10.1007\/s00521-018-3693-9","volume":"32","author":"Md.R Hassan","year":"2020","unstructured":"Hassan, Md. .R., Al-Insaif, S., Hossain, M. I. & Kamruzzaman, J. A machine learning approach for prediction of pregnancy outcome following IVF treatment. Neural Comput. Appl. 32(7), 2283\u20132297 (2020).","journal-title":"Neural Comput. Appl."},{"issue":"1","key":"6336_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12958-016-0145-1","volume":"14","author":"F Chen","year":"2016","unstructured":"Chen, F. et al. Selecting the embryo with the highest implantation potential using a data mining based prediction model. Reprod. Biol. Endocrinol. 14(1), 1\u201312 (2016).","journal-title":"Reprod. Biol. Endocrinol."},{"issue":"4","key":"6336_CR11","doi-asserted-by":"publisher","first-page":"4437","DOI":"10.1016\/j.eswa.2010.09.112","volume":"38","author":"R-S Guh","year":"2011","unstructured":"Guh, R.-S., Wu, T.-C.J. & Weng, S.-P. Integrating genetic algorithm and decision tree learning for assistance in predicting in vitro fertilization outcomes. Expert Syst. Appl. 38(4), 4437\u20134449 (2011).","journal-title":"Expert Syst. Appl."},{"issue":"11","key":"6336_CR12","doi-asserted-by":"publisher","first-page":"1783","DOI":"10.1016\/j.compbiomed.2013.07.035","volume":"43","author":"G Corani","year":"2013","unstructured":"Corani, G., Magli, C., Giusti, A., Gianaroli, L. & Gambardella, L. M. A Bayesian network model for predicting pregnancy after in vitro fertilization. Comput. Biol. Med. 43(11), 1783\u20131792 (2013).","journal-title":"Comput. Biol. Med."},{"issue":"1","key":"6336_CR13","doi-asserted-by":"publisher","first-page":"67","DOI":"10.2478\/slgr-2014-0044","volume":"39","author":"P Malinowski","year":"2014","unstructured":"Malinowski, P. et al. The use of data mining methods to predict the result of infertility treatment using the IVF ET method. Stud. Log. Gramm. Rhetor. 39(1), 67\u201374 (2014).","journal-title":"Stud. Log. Gramm. Rhetor."},{"issue":"2","key":"6336_CR14","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1093\/humrep\/del403","volume":"22","author":"J Holte","year":"2007","unstructured":"Holte, J. et al. Construction of an evidence-based integrated morphology cleavage embryo score for implantation potential of embryos scored and transferred on day 2 after oocyte retrieval. Hum. Reprod. 22(2), 548\u2013557 (2007).","journal-title":"Hum. Reprod."},{"key":"6336_CR15","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.cmpb.2016.09.013","volume":"137","author":"SA Mirroshandel","year":"2016","unstructured":"Mirroshandel, S. A., Ghasemian, F. & Monji-Azad, S. Applying data mining techniques for increasing implantation rate by selecting best sperms for intra-cytoplasmic sperm injection treatment. Comput. Methods Programs Biomed. 137, 215\u2013229 (2016).","journal-title":"Comput. Methods Programs Biomed."},{"issue":"6","key":"6336_CR16","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1016\/S0015-0282(01)02870-9","volume":"76","author":"KS Richter","year":"2001","unstructured":"Richter, K. S., Harris, D. C., Daneshmand, S. T. & Shapiro, B. S. Quantitative grading of a human blastocyst: Optimal inner cell mass size and shape. Fertil. Steril. 76(6), 1157\u20131167 (2001).","journal-title":"Fertil. Steril."},{"issue":"2","key":"6336_CR17","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1016\/j.fertnstert.2007.06.062","volume":"90","author":"BS Shapiro","year":"2008","unstructured":"Shapiro, B. S., Daneshmand, S. T., Garner, F. C., Aguirre, M. & Thomas, S. Large blastocyst diameter, early blastulation, and low preovulatory serum progesterone are dominant predictors of clinical pregnancy in fresh autologous cycles. Fertil. Steril. 90(2), 302\u2013309 (2008).","journal-title":"Fertil. Steril."},{"issue":"1","key":"6336_CR18","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1093\/humrep\/dem339","volume":"23","author":"EG Papanikolaou","year":"2008","unstructured":"Papanikolaou, E. G. et al. Live birth rates after transfer of equal number of blastocysts or cleavage-stage embryos in IVF. A systematic review and meta-analysis. Hum. Reprod 23(1), 91\u201399 (2008).","journal-title":"Hum. Reprod"},{"issue":"1","key":"6336_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-019-0096-y","volume":"2","author":"P Khosravi","year":"2019","unstructured":"Khosravi, P. et al. Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization. NPJ Digit. Med. 2(1), 1\u20139 (2019).","journal-title":"NPJ Digit. Med."},{"issue":"1","key":"6336_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-020-61357-9","volume":"10","author":"A Chavez-Badiola","year":"2020","unstructured":"Chavez-Badiola, A. et al. Predicting pregnancy test results after embryo transfer by image feature extraction and analysis using machine learning. Sci. Rep. 10(1), 1\u20136 (2020).","journal-title":"Sci. Rep."},{"key":"6336_CR21","doi-asserted-by":"publisher","DOI":"10.3109\/9780203008935","volume-title":"An Atlas of Human Blastocysts","author":"LL Veeck","year":"2003","unstructured":"Veeck, L. L. & Zaninovic, N. An Atlas of Human Blastocysts (CRC Press, 2003)."},{"key":"6336_CR22","doi-asserted-by":"publisher","first-page":"103494","DOI":"10.1016\/j.compbiomed.2019.103494","volume":"115","author":"MF Kragh","year":"2019","unstructured":"Kragh, M. F., Rimestad, J., Berntsen, J. & Karstoft, H. Automatic grading of human blastocysts from time-lapse imaging. Comput. Biol. Med. 115, 103494 (2019).","journal-title":"Comput. Biol. Med."},{"key":"6336_CR23","doi-asserted-by":"crossref","unstructured":"Chen, F., Debrock, S., Peeraer, K., D\u2019hooghe, T. & Spiessens, C. Selecting the embryo with the highest implantation potential using developmental and morphometric scoring. Arch. Public Health73, 1 (2015).","DOI":"10.1186\/2049-3258-73-S1-P48"},{"issue":"8","key":"6336_CR24","doi-asserted-by":"publisher","first-page":"648","DOI":"10.1002\/bdr2.1226","volume":"110","author":"B Aparicio-Ruiz","year":"2018","unstructured":"Aparicio-Ruiz, B., Romany, L. & Meseguer, M. Selection of preimplantation embryos using time-lapse microscopy in in vitro fertilization: State of the technology and future directions. Birth Defects Res. 110(8), 648\u2013653 (2018).","journal-title":"Birth Defects Res."},{"issue":"10","key":"6336_CR25","doi-asserted-by":"publisher","first-page":"2658","DOI":"10.1093\/humrep\/der256","volume":"26","author":"M Meseguer","year":"2011","unstructured":"Meseguer, M. et al. The use of morphokinetics as a predictor of embryo implantation. Hum. Reprod. 26(10), 2658\u20132671 (2011).","journal-title":"Hum. Reprod."},{"key":"6336_CR26","doi-asserted-by":"publisher","DOI":"10.5772\/intechopen.73709","volume-title":"Cell Culture","author":"RA Mehanna","year":"2019","unstructured":"Mehanna, R. A. Cell Culture (BoD-Books on Demand, 2019)."},{"issue":"3","key":"6336_CR27","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1097\/GCO.0000000000000166","volume":"27","author":"N Basile","year":"2015","unstructured":"Basile, N., Caiazzo, M. & Meseguer, M. What does morphokinetics add to embryo selection and in-vitro fertilization outcomes?. Curr. Opin. Obstet. Gynecol. 27(3), 193\u2013200 (2015).","journal-title":"Curr. Opin. Obstet. Gynecol."},{"issue":"5","key":"6336_CR28","doi-asserted-by":"publisher","first-page":"513","DOI":"10.33549\/physiolres.932287","volume":"61","author":"D Hlinka","year":"2012","unstructured":"Hlinka, D. et al. Time-lapse cleavage rating predicts human embryo viability. Physiol. Res. 61(5), 513 (2012).","journal-title":"Physiol. Res."},{"issue":"10","key":"6336_CR29","doi-asserted-by":"publisher","first-page":"677","DOI":"10.5603\/GP.2016.0067","volume":"87","author":"R Milewski","year":"2016","unstructured":"Milewski, R., Czerniecki, J., Kuczy\u0144ska, A., Stankiewicz, B. & Kuczy\u0144ski, W. Morphokinetic parameters as a source of information concerning embryo developmental and implantation potential. Ginekol. Pol. 87(10), 677\u2013684 (2016).","journal-title":"Ginekol. Pol."},{"key":"6336_CR30","doi-asserted-by":"publisher","first-page":"380","DOI":"10.1016\/j.rbmo.2018.01.001","volume":"36","author":"A Reignier","year":"2018","unstructured":"Reignier, A., Lammers, J., Barriere, P. & Freour, T. Can time-lapse parameters predict embryo ploidy? A systematic review. Reprod. Biomed. Online 36, 380\u2013387 (2018).","journal-title":"Reprod. Biomed. Online"},{"issue":"8","key":"6336_CR31","doi-asserted-by":"publisher","first-page":"1081","DOI":"10.1007\/s10815-013-0048-4","volume":"30","author":"JE Swain","year":"2013","unstructured":"Swain, J. E. Could time-lapse embryo imaging reduce the need for biopsy and PGS?. J. Assist. Reprod. Genet. 30(8), 1081\u20131090 (2013).","journal-title":"J. Assist. Reprod. Genet."},{"issue":"4","key":"6336_CR32","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1016\/j.rbmo.2013.11.014","volume":"28","author":"J Aguilar","year":"2014","unstructured":"Aguilar, J. et al. The human first cell cycle: Impact on implantation. Reprod. Biomed. Online 28(4), 475\u2013484 (2014).","journal-title":"Reprod. Biomed. Online"},{"issue":"11","key":"6336_CR33","doi-asserted-by":"publisher","first-page":"2394","DOI":"10.1093\/humrep\/15.11.2394","volume":"15","author":"L Scott","year":"2000","unstructured":"Scott, L., Alvero, R., Leondires, M. & Miller, B. The morphology of human pronuclear embryos is positively related to blastocyst development and implantation. Hum. Reprod. 15(11), 2394\u20132403 (2000).","journal-title":"Hum. Reprod."},{"issue":"11","key":"6336_CR34","first-page":"21699","volume":"8","author":"M Li","year":"2015","unstructured":"Li, M., Zhao, W., Li, W., Zhao, X. & Shi, J. Prognostic value of three pro-nuclei (3pn) incidence in elective single blastocyst-stage embryo transfer. Int. J. Clin. Exp. Med. 8(11), 21699 (2015).","journal-title":"Int. J. Clin. Exp. Med."},{"issue":"3","key":"6336_CR35","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1016\/j.fertnstert.2015.11.003","volume":"105","author":"Y Liu","year":"2016","unstructured":"Liu, Y., Chapple, V., Feenan, K., Roberts, P. & Matson, P. Time-lapse deselection model for human day 3 in vitro fertilization embryos: The combination of qualitative and quantitative measures of embryo growth. Fertil. Steril. 105(3), 656\u2013662 (2016).","journal-title":"Fertil. Steril."},{"key":"6336_CR36","doi-asserted-by":"publisher","first-page":"2231","DOI":"10.1093\/humrep\/dew188","volume":"31","author":"BM Petersen","year":"2016","unstructured":"Petersen, B. M., Boel, M., Montag, M. & Gardner, D. K. Development of a generally applicable morphokinetic algorithm capable of predicting the implantation potential of embryos transferred on day 3. Hum. Reprod. 31, 2231\u20132244 (2016).","journal-title":"Hum. Reprod."},{"issue":"1","key":"6336_CR37","first-page":"55","volume":"24","author":"E Gazzo","year":"2020","unstructured":"Gazzo, E. et al. The kidscoretm d5 algorithm as an additional tool to morphological assessment and PGT-A in embryo selection: A time-lapse study. JBRA Assist. Reprod. 24(1), 55 (2020).","journal-title":"JBRA Assist. Reprod."},{"key":"6336_CR38","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1080\/09513590.2019.1632090","volume":"35","author":"NV Saraeva","year":"2019","unstructured":"Saraeva, N. V. et al. Experience of using time lapse microscopy in the IVF program in patients with good ovarian reserve. Gynecol. Endocrinol. 35, 15\u201317 (2019).","journal-title":"Gynecol. Endocrinol."},{"issue":"6","key":"6336_CR39","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.1093\/humrep\/dez064","volume":"34","author":"D Tran","year":"2019","unstructured":"Tran, D., Cooke, S., Illingworth, P. J. & Gardner, D. K. Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer. Hum. Reprod. 34(6), 1011\u20131018 (2019).","journal-title":"Hum. Reprod."},{"issue":"1","key":"6336_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s42003-021-01937-1","volume":"4","author":"Q Liao","year":"2021","unstructured":"Liao, Q. et al. Development of deep learning algorithms for predicting blastocyst formation and quality by time-lapse monitoring. Commun. Biol. 4(1), 1\u20139 (2021).","journal-title":"Commun. Biol."},{"key":"6336_CR41","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), LNCS, Vol. 9351, 234\u2013241 (Springer, 2015). arXiv:1505.04597 [cs.CV].","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"6336_CR42","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Doll\u00e1r, P. Focal loss for dense object detection. In Proceedings of the IEEE International Conference on Computer Vision 2980\u20132988 (2017).","DOI":"10.1109\/ICCV.2017.324"},{"key":"6336_CR43","unstructured":"Shalev-Shwartz, S., Wexler, Y. & Shashua, A. Shareboost: Efficient Multiclass Learning with Feature Sharing. arXiv preprint arXiv:1109.0820 (2011)."},{"key":"6336_CR44","first-page":"951","volume":"3","author":"K Crammer","year":"2003","unstructured":"Crammer, K. & Singer, Y. Ultraconservative online algorithms for multiclass problems. J. Mach. Learn. Res. 3, 951\u2013991 (2003).","journal-title":"J. Mach. Learn. Res."},{"key":"6336_CR45","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep Residual Learning for Image Recognition. arXiv preprint arXiv:1512.03385 (2015).","DOI":"10.1109\/CVPR.2016.90"},{"key":"6336_CR46","volume-title":"Time Series Analysis: Forecasting and Control","author":"GEP Box","year":"2015","unstructured":"Box, G. E. P., Jenkins, G. M., Reinsel, G. C. & Ljung, G. M. Time Series Analysis: Forecasting and Control (Wiley, 2015)."},{"issue":"12","key":"6336_CR47","doi-asserted-by":"publisher","first-page":"2634","DOI":"10.1093\/humrep\/15.12.2634","volume":"15","author":"M Alikani","year":"2000","unstructured":"Alikani, M. et al. Cleavage anomalies in early human embryos and survival after prolonged culture in-vitro. Hum. Reprod. 15(12), 2634\u20132643 (2000).","journal-title":"Hum. Reprod."},{"issue":"6","key":"6336_CR48","doi-asserted-by":"publisher","first-page":"1270","DOI":"10.1093\/humrep\/der037","volume":"26","author":"A Scientists","year":"2011","unstructured":"Scientists, A. The Istanbul consensus workshop on embryo assessment: Proceedings of an expert meeting. Hum. Reprod. 26(6), 1270\u20131283 (2011).","journal-title":"Hum. Reprod."},{"key":"6336_CR49","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","volume":"44","author":"ER DeLong","year":"1988","unstructured":"DeLong, E. R., DeLong, D. M. & Clarke-Pearson, D. L. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 44, 837\u2013845 (1988).","journal-title":"Biometrics"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-06336-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-06336-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-06336-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T22:53:10Z","timestamp":1669330390000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-06336-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,15]]},"references-count":49,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["6336"],"URL":"https:\/\/doi.org\/10.1038\/s41598-022-06336-y","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,15]]},"assertion":[{"value":"20 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2488"}}