{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T03:47:48Z","timestamp":1790048868127,"version":"4.0.1"},"reference-count":50,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T00:00:00Z","timestamp":1640822400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["PID2020-116873GB-I00"],"award-info":[{"award-number":["PID2020-116873GB-I00"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010067","name":"Gobierno de Arag\u00f3n","doi-asserted-by":"publisher","award":["E46_20R"],"award-info":[{"award-number":["E46_20R"]}],"id":[{"id":"10.13039\/501100010067","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Background: Electronic fetal monitoring (EFM) is the universal method for the surveillance of fetal well-being in intrapartum. Our objective was to predict acidemia from fetal heart signal features using machine learning algorithms. Methods: A case\u2013control 1:2 study was carried out compromising 378 infants, born in the Miguel Servet University Hospital, Spain. Neonatal acidemia was defined as pH &lt; 7.10. Using EFM recording logistic regression, random forest and neural networks models were built to predict acidemia. Validation of models was performed by means of discrimination, calibration, and clinical utility. Results: Best performance was attained using a random forest model built with 100 trees. The discrimination ability was good, with an area under the Receiver Operating Characteristic curve (AUC) of 0.865. The calibration showed a slight overestimation of acidemia occurrence for probabilities above 0.4. The clinical utility showed that for 33% cutoff point, missing 5% of acidotic cases, 46% of unnecessary cesarean sections could be prevented. Logistic regression and neural networks showed similar discrimination ability but with worse calibration and clinical utility. Conclusions: The combination of the variables extracted from EFM recording provided a predictive model of acidemia that showed good accuracy and provides a practical tool to prevent unnecessary cesarean sections.<\/jats:p>","DOI":"10.3390\/e24010068","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T21:41:21Z","timestamp":1640900481000},"page":"68","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Machine Learning Algorithm to Predict Acidemia Using Electronic Fetal Monitoring Recording Parameters"],"prefix":"10.3390","volume":"24","author":[{"given":"Javier","family":"Esteban-Esca\u00f1o","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering and Communications, Escuela Universitaria Polit\u00e9cnica de La Almunia, Universidad de Zaragoza, Calle Mayor 5, 50100 La Almunia de Do\u00f1a Godina, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Berta","family":"Cast\u00e1n","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, San Pedro Hospital, Calle Piqueras 98, 26006 Logro\u00f1o, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sergio","family":"Cast\u00e1n","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Miguel Servet University Hospital, Paseo Isabel La Cat\u00f3lica 3, 50009 Zaragoza, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marta","family":"Ch\u00f3liz-Ezquerro","sequence":"additional","affiliation":[{"name":"Department of Obstetrics, Dexeus University Hospital, Gran Via de Carles III 71-75, 08028 Barcelona, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"C\u00e9sar","family":"Asensio","sequence":"additional","affiliation":[{"name":"Department of Applied Mathematics, Escuela Universitaria Polit\u00e9cnica de La Almunia, Universidad de Zaragoza, Calle Mayor 5, 50100 La Almunia de Do\u00f1a Godina, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio R.","family":"Laliena","sequence":"additional","affiliation":[{"name":"Department of Applied Mathematics, Escuela Universitaria Polit\u00e9cnica de La Almunia, Universidad de Zaragoza, Calle Mayor 5, 50100 La Almunia de Do\u00f1a Godina, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerardo","family":"Sanz-Enguita","sequence":"additional","affiliation":[{"name":"Department of Applied Physics, Escuela Universitaria Polit\u00e9cnica de La Almunia, Universidad de Zaragoza, Calle Mayor 5, 50100 La Almunia de Do\u00f1a Godina, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6474-2252","authenticated-orcid":false,"given":"Gerardo","family":"Sanz","sequence":"additional","affiliation":[{"name":"Department of Statistical Methods and Institute for Biocomputation and Physics of Complex Systems-BIFI, University of Zaragoza, Calle Pedro Cerbuna 12, 50009 Zaragoza, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3007-302X","authenticated-orcid":false,"given":"Luis Mariano","family":"Esteban","sequence":"additional","affiliation":[{"name":"Department of Applied Mathematics, Escuela Universitaria Polit\u00e9cnica de La Almunia, Universidad de Zaragoza, Calle Mayor 5, 50100 La Almunia de Do\u00f1a Godina, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9585-0187","authenticated-orcid":false,"given":"Ricardo","family":"Savir\u00f3n","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Hospital Cl\u00ednico San Carlos and Instituto de Investigaci\u00f3n Sanitaria San Carlos (IdISSC), Universidad Complutense, Calle del Prof Mart\u00edn Lagos s\/n, 28040 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.bpobgyn.2015.02.009","article-title":"Computer analysis of foetal monitoring signals","volume":"30","author":"Nunes","year":"2016","journal-title":"Best Pract. Res. Clin. Obstet. Gynaecol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.bpobgyn.2015.05.005","article-title":"Technical characteristics of current cardiotocographic monitors","volume":"30","year":"2016","journal-title":"Best Pract. Res. Clin. Obstet. Gynaecol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1111\/j.1471-0528.1993.tb10630.x","article-title":"Doppler ultrasound monitoring technology","volume":"100","author":"Docker","year":"1993","journal-title":"BJOG Int. J. Obstet. Gynaecol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1515\/jpm-2012-0067","article-title":"An overview of central fetal monitoring systems in labour","volume":"41","author":"Nunes","year":"2013","journal-title":"J. Perinat. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1126\/science.1204553","article-title":"Information transduction capacity of noisy biochemical signaling networks","volume":"334","author":"Cheong","year":"2011","journal-title":"Science"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/j.1749-6632.2011.06422.x","article-title":"The use of information theory in evolutionary biology","volume":"1256","author":"Adami","year":"2012","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"ref_8","unstructured":"Fr\u00e9nay, B. (2013). Uncertainty and Label Noise in Machine Learning. [Ph.D. Dissertation, Catholic University of Louvain]."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"163.e1","DOI":"10.1016\/j.ajog.2016.10.009","article-title":"The limits of electronic fetal heart rate monitoring in the prevention of neonatal metabolic acidemia","volume":"216","author":"Clark","year":"2017","journal-title":"Am. J. Obstet. Gynecol."},{"key":"ref_10","unstructured":"American College of Obstetricians and Gynecologists (1974). Fetal heart rate monitoring: Guidelines. ACOG Tech. Bull., 32, 1\u201310."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"American College of Obstetricians and Gynecologists (2010). Practice bulletin no. 116: Management of intrapartum fetal heart rate tracings. Obstet. Gynecol., 116, 1232\u20131240.","DOI":"10.1097\/AOG.0b013e3182004fa9"},{"key":"ref_12","first-page":"6479","article-title":"Diagnostic capacity and interobserver variability in FIGO, ACOG, NICE and Chandraharan cardiotocographic guidelines to predict neonatal acidemia","volume":"80","author":"Zamora","year":"2021","journal-title":"J. Matern. Fetal Neonatal Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.ejogrb.2016.08.017","article-title":"Interobserver agreement in CTG interpretation using the 2015 FIGO guidelines for intrapartum fetal monitoring","volume":"205","author":"Rei","year":"2016","journal-title":"Eur. J. Obstet. Gynecol. Reprod. Biol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"523.e1","DOI":"10.1016\/j.ajog.2018.01.026","article-title":"A prospective cohort study of fetal heart rate monitoring: Deceleration area is predictive of fetal acidemia","volume":"218","author":"Cahill","year":"2018","journal-title":"Am. J. Obstet. Gynecol."},{"key":"ref_15","first-page":"5977","article-title":"Total intrapartum fetal reperfusion time (fetal resilience) and neonatal acidemia","volume":"91","author":"Esteban","year":"2021","journal-title":"J. Matern. Fetal Neonatal Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.cmpb.2017.12.030","article-title":"eCTG: An automatic procedure to extract digital cardiotocographic signals from digital images","volume":"156","author":"Sbrollini","year":"2018","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1055\/s-0030-1268713","article-title":"Multifractal analysis of fetal heart rate variability in fetuses with and without severe acidosis during labor","volume":"28","author":"Doret","year":"2011","journal-title":"Am. J. Perinatol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Doret, M., Spilka, J., Chud\u00e1\u010dek, V., Gon\u00e7alves, P., and Abry, P. (2015). Fractal analysis and hurst parameter for intrapartum fetal heart rate variability analysis: A versatile alternative to frequency bands and LF\/HF ratio. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0136661"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1007\/s13224-018-1118-4","article-title":"Artificial intelligence: The future of obstetrics and gynecology","volume":"68","author":"Desai","year":"2018","journal-title":"J. Obstet. Gynecol. India"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/s00404-019-05151-7","article-title":"Use of artificial intelligence (AI) in the interpretation of intrapartum fetal heart rate (FHR) tracings: A systematic review and meta-analys.sis","volume":"300","author":"Balayla","year":"2019","journal-title":"Arch. Gynecol. Obstet."},{"key":"ref_21","first-page":"e7124","article-title":"Artificial intelligence: A new paradigm in obstetrics and gynecology research and clinical practice","volume":"12","author":"Iftikhar","year":"2020","journal-title":"Cureus"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.21873\/invivo.11635","article-title":"Artificial intelligence in obstetrics and gynaecology: Is this the way forward?","volume":"33","author":"Emin","year":"2019","journal-title":"Vivo"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Aznar-Gimeno, R., Esteban, L.M., Labata-Lezaun, G., del-Hoyo-Alonso, R., Abadia-Gallego, D., Pa\u00f1o-Pardo, J.R., Esquillor Rodrigo, M.J., Lanas, A., and Serrano, M. (2021). A Clinical Decision Web to Predict ICU Admission or Death for Patients Hospitalised with COVID-19 Using Machine Learning Algorithms. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph18168677"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Zhang, Y., and Deng, Y. (2018). A comprehensive feature analysis of the fetal heart rate signal for the intelligent assessment of fetal state. J. Clin. Med., 7.","DOI":"10.3390\/jcm7080223"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.bspc.2018.05.016","article-title":"Open-access software for analysis of fetal heart rate signals","volume":"45","author":"Kocamaz","year":"2018","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.compbiomed.2018.06.003","article-title":"Prognostic model based on image-based time-frequency features and genetic algorithm for fetal hypoxia assessment","volume":"99","author":"Kocamaz","year":"2018","journal-title":"Comput. Biol. Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"8568617","DOI":"10.1155\/2018\/8568617","article-title":"The design and implementation of cardiotocography signals classification algorithm based on neural network","volume":"2018","author":"Tang","year":"2018","journal-title":"Comput. Math. Methods Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-019-1007-5","article-title":"DeepFHR: Intelligent prediction of fetal Acidemia using fetal heart rate signals based on convolutional neural network","volume":"19","author":"Zhao","year":"2019","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.artmed.2019.03.005","article-title":"Prediction of fetal state from the cardiotocogram recordings using neural network models","volume":"96","author":"Iraji","year":"2019","journal-title":"Artif. Intell. Med."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1109\/TIT.1981.1056373","article-title":"Properties of cross-entropy minimization","volume":"27","author":"Shore","year":"1981","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Aznar-Gimeno, R., Labata-Lezaun, G., Adell-Lamora, A., Abad\u00eda-Gallego, D., del-Hoyo-Alonso, R., and Gonz\u00e1lez-Mu\u00f1oz, C. (2021). Deep Learning for Walking Behaviour Detection in Elderly People Using Smart Footwear. Entropy, 23.","DOI":"10.3390\/e23060777"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","article-title":"The meaning and use of the area under a receiver operating characteristic (ROC) curve","volume":"143","author":"Hanley","year":"1982","journal-title":"Radiology"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Steyerberg, E.W. (2019). Clinical Prediction Models, Springer.","DOI":"10.1007\/978-3-030-16399-0"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"c1471","DOI":"10.1136\/bmj.c1471","article-title":"Strength of association between umbilical cord pH and perinatal and long term outcomes: Systematic review and meta-analysis","volume":"340","author":"Malin","year":"2010","journal-title":"BMJ"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"206.e1","DOI":"10.1016\/j.ajog.2012.06.046","article-title":"Association and prediction of neonatal acidemia","volume":"207","author":"Cahill","year":"2012","journal-title":"Am. J. Obs. Gynecol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3115","DOI":"10.1080\/14767058.2018.1456523","article-title":"Temporal and quantitative associations of electronic fetal heart rate monitoring patterns and neonatal outcomes","volume":"32","author":"Ogunyemi","year":"2019","journal-title":"J. Matern. Fetal Neonatal Med."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2578","DOI":"10.1080\/14767058.2016.1256993","article-title":"Deceleration area and fetal acidemia","volume":"30","author":"Lapresta","year":"2017","journal-title":"J. Matern. Fetal Neonatal Med."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4711","DOI":"10.1113\/JP271205","article-title":"The myths and physiology surrounding intrapartum decelerations: The critical role of the peripheral chemoreflex","volume":"594","author":"Lear","year":"2016","journal-title":"J. Physiol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5611","DOI":"10.1113\/JP274937","article-title":"The peripheral chemoreflex: Indefatigable guardian of fetal physiological adaptation to labour","volume":"596","author":"Lear","year":"2018","journal-title":"J. Physiol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1159\/000475927","article-title":"The \u201cFetal Reserve Index\u201d: Re-engineering the interpretation and responses to fetal heart rate patterns","volume":"43","author":"Eden","year":"2018","journal-title":"Fetal Diagn."},{"key":"ref_41","unstructured":"(2021, November 28). Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), Available online: https:\/\/www.nih.gov\/about-nih\/what-we-do\/nih-almanac\/eunice-kennedy-shriver-national-institute-child-health-human-development-nichd."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1016\/j.recesp.2011.04.017","article-title":"Performance measures for prediction models and markers: Evaluation of predictions and classifications","volume":"64","author":"Steyerberg","year":"2011","journal-title":"Rev. Esp. Cardiol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach","volume":"44","author":"DeLong","year":"1988","journal-title":"Biometrics"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1186\/s41512-019-0064-7","article-title":"A simple, step-by-step guide to interpreting decision curve analysis","volume":"3","author":"Vickers","year":"2019","journal-title":"Diagn. Progn. Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1093\/aje\/kwm305","article-title":"Integrating the predictiveness of a marker with its performance as a classifier","volume":"167","author":"Pepe","year":"2008","journal-title":"Am. J. Epidemiol."},{"key":"ref_46","first-page":"155","article-title":"A preliminary study of the ability of the 4Kscore test, the Prostate Cancer Prevention Trial-Risk Calculator and the European Research Screening Prostate-Risk Calculator for predicting high-grade prostate cancer","volume":"40","year":"2016","journal-title":"Actas Urol\u00f3gicas Espa\u00f1olas"},{"key":"ref_47","unstructured":"R Core Team (2020). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing. Available online: https:\/\/www.R-project.org\/."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1002\/sim.7803","article-title":"Standard errors and confidence intervals for variable importance in random forest regression, classification, and survival","volume":"38","author":"Ishwaran","year":"2019","journal-title":"Stat. Med."},{"key":"ref_49","first-page":"46","article-title":"Interpreting neural network connection weights","volume":"6","author":"Garson","year":"1991","journal-title":"Artif. Intell. Expert"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Cruces \u00c1lvarez, S.A., Mart\u00edn Clemente, R., and Samek, W. (2019). Information Theory Applications in Signal Processing. Entropy, 21.","DOI":"10.3390\/e21070653"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/68\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:56:03Z","timestamp":1760169363000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/68"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,30]]},"references-count":50,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010068"],"URL":"https:\/\/doi.org\/10.3390\/e24010068","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,30]]}}}