{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T18:20:44Z","timestamp":1780424444767,"version":"3.54.1"},"reference-count":60,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2019,6,18]],"date-time":"2019-06-18T00:00:00Z","timestamp":1560816000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010198","name":"Ministerio de Econom\u00eda, Industria y Competitividad, Gobierno de Espa\u00f1a","doi-asserted-by":"publisher","award":["TEC2016-75361-R"],"award-info":[{"award-number":["TEC2016-75361-R"]}],"id":[{"id":"10.13039\/501100010198","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004587","name":"Instituto de Salud Carlos III","doi-asserted-by":"publisher","award":["DTS 17\/00158"],"award-info":[{"award-number":["DTS 17\/00158"]}],"id":[{"id":"10.13039\/501100004587","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The presence of bacteria with resistance to specific antibiotics is one of the greatest threats to the global health system. According to the World Health Organization, antimicrobial resistance has already reached alarming levels in many parts of the world, involving a social and economic burden for the patient, for the system, and for society in general. Because of the critical health status of patients in the intensive care unit (ICU), time is critical to identify bacteria and their resistance to antibiotics. Since common antibiotics resistance tests require between 24 and 48 h after the culture is collected, we propose to apply machine learning (ML) techniques to determine whether a bacterium will be resistant to different families of antimicrobials. For this purpose, clinical and demographic features from the patient, as well as data from cultures and antibiograms are considered. From a population point of view, we also show graphically the relationship between different bacteria and families of antimicrobials by performing correspondence analysis. Results of the ML techniques evidence non-linear relationships helping to identify antimicrobial resistance at the ICU, with performance dependent on the family of antimicrobials. A change in the trend of antimicrobial resistance is also evidenced.<\/jats:p>","DOI":"10.3390\/e21060603","type":"journal-article","created":{"date-parts":[[2019,6,19]],"date-time":"2019-06-19T02:42:46Z","timestamp":1560912166000},"page":"603","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":54,"title":["Machine Learning Techniques to Identify Antimicrobial Resistance in the Intensive Care Unit"],"prefix":"10.3390","volume":"21","author":[{"given":"Sergio","family":"Mart\u00ednez-Ag\u00fcero","sequence":"first","affiliation":[{"name":"Department of Signal Theory and Communications, Telematics and Computing Systems, Rey Juan Carlos University, Madrid 28943, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0735-367X","authenticated-orcid":false,"given":"Inmaculada","family":"Mora-Jim\u00e9nez","sequence":"additional","affiliation":[{"name":"Department of Signal Theory and Communications, Telematics and Computing Systems, Rey Juan Carlos University, Madrid 28943, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jon","family":"L\u00e9rida-Garc\u00eda","sequence":"additional","affiliation":[{"name":"Department of Signal Theory and Communications, Telematics and Computing Systems, Rey Juan Carlos University, Madrid 28943, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joaqu\u00edn","family":"\u00c1lvarez-Rodr\u00edguez","sequence":"additional","affiliation":[{"name":"Intensive Care Department, University Hospital of Fuenlabrada, Madrid 28942, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5817-989X","authenticated-orcid":false,"given":"Cristina","family":"Soguero-Ruiz","sequence":"additional","affiliation":[{"name":"Department of Signal Theory and Communications, Telematics and Computing Systems, Rey Juan Carlos University, Madrid 28943, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"145","DOI":"10.3389\/fpubh.2014.00145","article-title":"The antimicrobial resistance crisis: Causes, consequences, and management","volume":"2","author":"Michael","year":"2014","journal-title":"Front. Public Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"364","DOI":"10.3389\/fphar.2017.00364","article-title":"Antimicrobial activity and resistance: Influencing factors","volume":"8","author":"Li","year":"2017","journal-title":"Front. Pharmacol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1128\/CMR.00015-06","article-title":"Modes and modulations of antibiotic resistance gene expression","volume":"20","author":"Depardieu","year":"2007","journal-title":"Clin. Microbiol. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1136\/emj.2005.029934","article-title":"Critical care in the emergency department: Severe sepsis and septic shock","volume":"23","author":"Nee","year":"2006","journal-title":"Emerg. Med. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1093\/bja\/aex234","article-title":"Epidemiology of sepsis and septic shock in critical care units: Comparison between sepsis-2 and sepsis-3 populations using a national critical care database","volume":"119","author":"Harrison","year":"2017","journal-title":"Br. J. Anaesth."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1080\/23744235.2017.1383630","article-title":"The influence of a change in septic shock definitions on intensive care epidemiology and outcome: Comparison of sepsis-2 and sepsis-3 definitions","volume":"50","author":"Driessen","year":"2018","journal-title":"Infect. Dis."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1097\/CCM.0000000000003342","article-title":"Epidemiology and Costs of Sepsis in the United States\u2014An Analysis Based on Timing of Diagnosis and Severity Level","volume":"46","author":"Paoli","year":"2018","journal-title":"Crit. Care Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.chest.2018.05.004","article-title":"Sepsis-3 Septic Shock Criteria and Associated Mortality Among Infected Hospitalized Patients Assessed by a Rapid Response Team","volume":"154","author":"Fernando","year":"2018","journal-title":"Chest"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1907","DOI":"10.1097\/CCM.0000000000001142","article-title":"The Impact of Timing of Antibiotics on Outcomes in Severe Sepsis and Septic Shock: A Systematic Review and Meta-Analysis","volume":"43","author":"Sterling","year":"2015","journal-title":"Crit. Care Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1016\/j.jemermed.2016.12.009","article-title":"Does Early and Appropriate Antibiotic Administration Improve Mortality in Emergency Department Patients with Severe Sepsis or Septic Shock?","volume":"53","author":"Sherwin","year":"2017","journal-title":"J. Emerg. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1016\/j.amjsurg.2010.09.001","article-title":"Evaluation of empiric antibiotic use in surgical sepsis","volume":"200","author":"Fitousis","year":"2010","journal-title":"Am. J. Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1097\/CCM.0000000000000330","article-title":"Empiric antibiotic treatment reduces mortality in severe sepsis and septic shock from the first hour: Results from a guideline-based performance improvement program","volume":"42","author":"Ferrer","year":"2014","journal-title":"Crit. Care Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1378\/chest.118.1.146","article-title":"The influence of inadequate antimicrobial treatment of bloodstream infections on patient outcomes in the ICU setting","volume":"118","author":"Ibrahim","year":"2000","journal-title":"Chest"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1186\/s13054-015-1000-z","article-title":"Adequate antibiotic therapy prior to ICU admission in patients with severe sepsis and septic shock reduces hospital mortality","volume":"19","year":"2015","journal-title":"Crit. Care"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1378\/chest.115.2.462","article-title":"Inadequate antimicrobial treatment of infections: A risk factor for hospital mortality among critically ill patients","volume":"115","author":"Kollef","year":"1999","journal-title":"Chest"},{"key":"ref_16","unstructured":"World Health Organization (2012). Global Action Plan to Control the Spread and Impact of Antimicrobial Resistance in Neisseria gonorrhoeae, World Health Organization."},{"key":"ref_17","unstructured":"European Center for Disease Prevention and Control (2009). The Bacterial Challenge: Time to React, European Center for Disease Prevention and Control."},{"key":"ref_18","unstructured":"O\u2019neill, J. (2019, June 14). Tackling Drug-Resistant Infections Globally: Final Report and Recommendations; Review on Antimicrobial Resistance; 2016. Available online: https:\/\/amr-review.org\/Publications.html."},{"key":"ref_19","unstructured":"World Health Organization (2014). Antimicrobial Resistance: Global Report on Surveillance, World Health Organization."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e01260-18","DOI":"10.1128\/JCM.01260-18","article-title":"Using machine learning to predict antimicrobial MICs and associated genomic features for nontyphoidal Salmonella","volume":"57","author":"Nguyen","year":"2019","journal-title":"J. Clin. Microbiol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Moradigaravand, D., Palm, M., Farewell, A., Mustonen, V., Warringer, J., and Parts, L. (2018). Prediction of antibiotic resistance in Escherichia coli from large-scale pan-genome data. PLoS Comput. Biol., 14.","DOI":"10.1101\/338194"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e01405-18","DOI":"10.1128\/JCM.01405-18","article-title":"Genome-Based prediction of bacterial antibiotic resistance","volume":"57","author":"Su","year":"2019","journal-title":"J. Clin. Microbiol."},{"key":"ref_23","first-page":"135","article-title":"Antimicrobial susceptibility testing by the Kirby-Bauer disc diffusion method","volume":"3","author":"Biemer","year":"1973","journal-title":"Ann. Clin. Lab. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1093\/jac\/48.suppl_1.5","article-title":"Determination of minimum inhibitory concentrations","volume":"48","author":"Andrews","year":"2001","journal-title":"J. Antimicrob. Chemother."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4318","DOI":"10.1128\/JCM.41.9.4318-4323.2003","article-title":"Antimicrobial susceptibility testing of aquatic bacteria: Quality control disk diffusion ranges for Escherichia coli ATCC 25922 and Aeromonas salmonicida subsp. salmonicida ATCC 33658 at 22 and 28 C","volume":"41","author":"Miller","year":"2003","journal-title":"J. Clin. Microbiol."},{"key":"ref_26","unstructured":"Mitchell, T. (1997). Machine Learning, McGraw-Hill."},{"key":"ref_27","unstructured":"Duda, O., Hart, P., and Stork, D. (2001). Pattern Classification, John Wiley & Sons."},{"key":"ref_28","unstructured":"Ripley, B. (2008). Pattern Recognition and Neural Networks, Cambridge University Press."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning with Applications in R, Springer.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e12286","DOI":"10.2196\/12286","article-title":"Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature","volume":"21","author":"Triantafyllidis","year":"2019","journal-title":"J. Med. Internet Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Revuelta-Zamorano, P., S\u00e1nchez, A., Rojo-\u00c1lvarez, J., \u00c1lvarez Rodr\u00edguez, J., Ramos-L\u00f3pez, J., and Soguero-Ruiz, C. (2016). Prediction of Healthcare Associated Infections in an Intensive Care Unit Using Machine Learning and Big Data Tools. XIV Mediterranean Conference on Medical and Biological Engineering and Computing, Springer.","DOI":"10.1007\/978-3-319-32703-7_163"},{"key":"ref_32","unstructured":"Mart\u00ednez-Ag\u00fcero, S., L\u00e9rida-Garc\u00eda, J., \u00c1lvarez Rodr\u00edguez, J., Mora-Jim\u00e9nez, I., and Soguero-Ruiz, C. (2018, January 21\u201323). Estudio de la evoluci\u00f3n temporal de la resistencia antimicrobiana de g\u00e9rmenes en la unidad de cuidados intensivos. Proceedings of the XXXVI Congreso Anual de la Sociedad Espa\u00f1ola de Ingenier\u00eda Biom\u00e9dica (CASEIB 2018), Ciudad Real, Spain."},{"key":"ref_33","unstructured":"L\u00e9rida-Garc\u00eda, J., Mart\u00ednez-Ag\u00fcero, S., \u00c1lvarez Rodr\u00edguez, J., Mora-Jim\u00e9nez, I., and Soguero-Ruiz, C. (2018, January 21\u201323). An\u00e1lisis de correspondencias para el estudio de la sensibilidad antibi\u00f3tica de g\u00e9rmenes en la UCI. Proceedings of the XXXVI Congreso Anual de la Sociedad Espa\u00f1ola de Ingenier\u00eda Biom\u00e9dica (CASEIB 2018), Ciudad Real, Spain."},{"key":"ref_34","unstructured":"Greenacre, M.J. (1984). Correspondence Analysis, Academic Press."},{"key":"ref_35","first-page":"1","article-title":"A review of canonical coordinates and an alternative to correspondence analysis using Hellinger distance","volume":"19","author":"Rao","year":"1995","journal-title":"Questii\u00f3"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.artmed.2005.03.002","article-title":"Learning from imbalanced data in surveillance of nosocomial infection","volume":"37","author":"Cohen","year":"2006","journal-title":"Artif. Intell. Med."},{"key":"ref_37","first-page":"1263","article-title":"Learning from imbalanced data","volume":"21","author":"He","year":"2008","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yen, S.J., and Lee, Y.S. (2006). Under-sampling approaches for improving prediction of the minority class in an imbalanced dataset. Intelligent Control and Automation, Springer.","DOI":"10.1007\/978-3-540-37256-1_89"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Liu, H., and Motoda, H. (1998). Feature Selection for Knowledge Discover and data Mining, Kluwer Academic Publishers.","DOI":"10.1007\/978-1-4615-5689-3"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lee, K.C., Orten, B., Dasdan, A., and Li, W. (2012, January 12\u201316). Estimating conversion rate in display advertising from past erformance data. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Beijing, China.","DOI":"10.1145\/2339530.2339651"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest Neighbor Pattern Classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of Decision Trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_43","unstructured":"Breiman, L., Friedman, J., Olshen, R., and Stone, C. (1984). Classification and Regression Trees, Chapman and Hall."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0925-2312(93)90006-O","article-title":"Backpropagation and stochastic gradient descent method","volume":"5","author":"Amari","year":"1993","journal-title":"Neurocomputing"},{"key":"ref_46","unstructured":"Wittner, B., and Denker, J. (2019, June 18). Strategies for teaching layered neural networks classification tasks. Available online: https:\/\/papers.nips.cc\/paper\/85-strategies-for-teaching-layered-networks-classification-tasks."},{"key":"ref_47","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_48","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_49","first-page":"1415","article-title":"Feature extraction by non parametric mutual information maximization","volume":"3","author":"Torkkola","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene selection for cancer classification using support vector machines","volume":"46","author":"Guyon","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1097\/00003246-198510000-00009","article-title":"APACHE II: A severity of disease classification system","volume":"13","author":"Knaus","year":"1985","journal-title":"Crit. Care Med."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1336","DOI":"10.1007\/s00134-005-2762-6","article-title":"SAPS 3\u2014From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description","volume":"31","author":"Metnitz","year":"2005","journal-title":"Intensive Care Med."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1404","DOI":"10.1109\/JBHI.2014.2361688","article-title":"Support vector feature selection for early detection of anastomosis leakage from bag-of-words in electronic health records","volume":"20","author":"Hindberg","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_56","first-page":"87","article-title":"What is the relevance of antimicrobial resistance on the outcome of community-acquired pneumonia caused by Streptococcus pneumoniae?(should macrolide monotherapy be used for mild pneumonia?)","volume":"27","author":"Low","year":"2013","journal-title":"Infect. Dis. Clin."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1514","DOI":"10.1016\/j.addr.2005.04.005","article-title":"Clinical impact and relevance of antibiotic resistance","volume":"57","author":"French","year":"2005","journal-title":"Adv. Drug Deliv. Rev."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"3774","DOI":"10.21037\/jtd.2016.12.89","article-title":"Duration of antibiotic therapy in the intensive care unit","volume":"8","author":"Zilahi","year":"2016","journal-title":"J. Thorac. Dis."},{"key":"ref_59","unstructured":"Ulukilic, A., Cevahir, F., and Mese, E.A. (2017, January 22\u201325). Risk factors for multidrug-resistant Gram-negatives in the first episode of intensive care unit infection. Proceedings of the 27th European Congress of Clinical Microbiology and Infectious Diseases (ECCMID), Vienna, Austria."},{"key":"ref_60","unstructured":"Choi, E., Biswal, S., Malin, B., Duke, J., Stewart, W.F., and Sun, J. (2017). Generating multi-label discrete patient records using generative adversarial networks. arXiv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/6\/603\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:59:21Z","timestamp":1760187561000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/6\/603"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,18]]},"references-count":60,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["e21060603"],"URL":"https:\/\/doi.org\/10.3390\/e21060603","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,18]]}}}