{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T03:34:01Z","timestamp":1784864041737,"version":"3.55.0"},"reference-count":48,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T00:00:00Z","timestamp":1666310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Big Data"],"abstract":"<jats:p>As Big Data Analysis meets healthcare applications, domain-specific challenges and opportunities materialize in all aspects of data science. Advanced statistical methods and Artificial Intelligence (AI) on Electronic Health Records (EHRs) are used both for knowledge discovery purposes and clinical decision support. Such techniques enable the emerging Predictive, Preventative, Personalized, and Participatory Medicine (P4M) paradigm. Working with the Infectious Disease Clinic of the University Hospital of Modena, Italy, we have developed a range of Data\u2013Driven (DD) approaches to solve critical clinical applications using statistics, Machine Learning (ML) and Big Data Analytics on real-world EHR. Here, we describe our perspective on the challenges we encountered. Some are connected to medical data and their sparse, scarce, and unbalanced nature. Others are bound to the application environment, as medical AI tools can affect people's health and life. For each of these problems, we report some available techniques to tackle them, present examples drawn from our experience, and propose which approaches, in our opinion, could lead to successful real-world, end-to-end implementations.<\/jats:p><jats:sec><jats:title>DESY report number<\/jats:title><jats:p>DESY-22-153.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdata.2022.1021621","type":"journal-article","created":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T05:37:05Z","timestamp":1666330625000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Real-world data mining meets clinical practice: Research challenges and perspective"],"prefix":"10.3389","volume":"5","author":[{"given":"Federica","family":"Mandreoli","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davide","family":"Ferrari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Veronica","family":"Guidetti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Federico","family":"Motta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Missier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,10,21]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"2439","DOI":"10.3390\/sym13122439","article-title":"A review of interpretable ML in healthcare: taxonomy, applications, challenges, and future directions","volume":"13","author":"Abdullah","year":"2021","journal-title":"Symmetry"},{"key":"B2","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1145\/3233547.3233667","article-title":"\u201cInterpretable machine learning in healthcare,\u201d","author":"Ahmad","year":"2018","journal-title":"Proceedings of the ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics"},{"key":"B3","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1002\/mpr.329","article-title":"Multiple imputation by chained equations: what is it and how does it work?","volume":"20","author":"Azur","year":"2011","journal-title":"Int. J. Methods Psychiatr. Res"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3502287","article-title":"A systematic review on data scarcity problem in deep learning: solution and applications","volume":"54","author":"Bansal","year":"2021","journal-title":"ACM Comput. Surveys"},{"key":"B5","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1214\/aoms\/1177697196","article-title":"A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains","volume":"41","author":"Baum","year":"1970","journal-title":"Ann. Math. Stat"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533090","article-title":"\u201cIt's just not that simple: an empirical study of the accuracy-explainability trade-off in machine learning for public policy,\u201d","author":"Bell","year":"2022","journal-title":"2022 ACM Conference on Fairness, Accountability, and Transparency"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1908.09635","article-title":"Fairness in machine learning: a survey","author":"Caton","year":"2020","journal-title":"arXiv:1908.09635v3"},{"key":"B8","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1810.08810","article-title":"The frontiers of fairness in machine learning","author":"Chouldechova","year":"2018","journal-title":"arXiv preprint"},{"key":"B10","doi-asserted-by":"publisher","first-page":"973","DOI":"10.5555\/1642194.1642224","article-title":"\u201cThe foundations of cost-sensitive learning,\u201d","author":"Elkan","year":"2001","journal-title":"Proceedings of the"},{"key":"B11","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1145\/2783258.2783311","article-title":"\u201cCertifying and removing disparate impact,\u201d","author":"Feldman","year":"2015","journal-title":"Proceedings of the"},{"key":"B12","article-title":"\u201cData-driven vs. knowledge-driven inference of health outcomes in the ageing population: a case study,\u201d","author":"Ferrari","year":"","journal-title":"Proceedings of the Workshops of the EDBT-ICDT Joint Conference, Vol. 2578"},{"key":"B13","first-page":"32","article-title":"\u201cPredicting respiratory failure in patients with COVID-19 pneumonia: a case study from Northern Italy,\u201d","author":"Ferrari","year":"","journal-title":"Proceedings of the 1"},{"key":"B14","doi-asserted-by":"publisher","first-page":"e239172","DOI":"10.1371\/journal.pone.0239172","article-title":"Machine learning in predicting respiratory failure in patients with COVID-19 pneumonia\u2013Challenges, strengths, and opportunities in a global health emergency","volume":"15","author":"Ferrari","year":"","journal-title":"PLoS ONE"},{"key":"B15","doi-asserted-by":"publisher","first-page":"565","DOI":"10.2217\/pme.13.57","article-title":"P4 Medicine: how systems medicine will transform the healthcare sector and society","volume":"10","author":"Flores","year":"2013","journal-title":"Pers. Med"},{"key":"B16","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/978-3-540-74553-2_28","article-title":"\u201cCost-sensitive decision trees applied to medical data,\u201d","author":"Freitas","year":"2007","journal-title":"Data Warehousing and Knowledge Discovery"},{"key":"B17","article-title":"\u201cPATE-GAN: generating synthetic data with differential privacy guarantees,\u201d","author":"Jordon","year":"2019","journal-title":"International Conference on Learning Representations"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-8193-6","author":"Jung","year":"2022","journal-title":"Machine Learning: The Basics"},{"key":"B19","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1145\/3287560.3287592","article-title":"\u201cAn empirical study of rich subgroup fairness for machine learning,\u201d","author":"Kearns","year":"2019","journal-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1610.02527","article-title":"Federated optimization: distributed machine learning for on-device intelligence","author":"Kone\u010dn\u1ef3","year":"2016","journal-title":"arXiv preprint"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2938","DOI":"10.1038\/s41598-021-82459-y","article-title":"Data-driven identification of ageing-related diseases from electronic health records","volume":"11","author":"Kuan","year":"2021","journal-title":"Sci. Rep"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/679","article-title":"Graph neural networks meet neural-symbolic computing: a survey and perspective","author":"Lamb","year":"2020","journal-title":"arXiv preprint"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-018-0151-6","article-title":"A survey on addressing high-class imbalance in big data","volume":"5","author":"Leevy","year":"2018","journal-title":"J. Big Data"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2431211.2431215","article-title":"A survey of cost-sensitive decision tree induction algorithms","volume":"45","author":"Lomax","year":"2013","journal-title":"ACM Comput. Surveys"},{"key":"B25","doi-asserted-by":"publisher","first-page":"2522","DOI":"10.1038\/s42256-019-0138-9","article-title":"From local explanations to global understanding with explainable AI for trees","volume":"2","author":"Lundberg","year":"2020","journal-title":"Nat. Mach. Intell"},{"key":"B26","article-title":"\u201cA unified approach to interpreting model predictions,\u201d","author":"Lundberg","year":"2017","journal-title":"Advances in Neural Information Processing Systems, Vol. 30"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.1109\/ICMLA52953.2021.00211","article-title":"\u201cAn HMM-ensemble approach to predict severity progression of ICU treatment for hospitalized COVID-19 patients,\u201d","author":"Mandreoli","year":"2021"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3457607","article-title":"A survey on bias and fairness in machine learning","volume":"54","author":"Mehrabi","year":"2021","journal-title":"ACM Comput. Surveys"},{"key":"B29","doi-asserted-by":"publisher","first-page":"100690","DOI":"10.1016\/j.imu.2021.100690","article-title":"Performance analysis of cost-sensitive learning methods with application to imbalanced medical data","volume":"25","author":"Mienye","year":"2021","journal-title":"Inform. Med. Unlock"},{"key":"B30","doi-asserted-by":"publisher","first-page":"5704","DOI":"10.1109\/EMBC.2019.8857234","article-title":"\u201cPredicting stroke from electronic health records,\u201d","author":"Nwosu","year":"2019"},{"key":"B31","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1007\/978-3-030-43883-8_7","article-title":"\u201cFairness in machine learning,\u201d","author":"Oneto","year":"2020","journal-title":"Recent Trends in Learning From Data: Tutorials from the INNS Big Data and Deep Learning Conference"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/RTSI.2017.8065914","article-title":"\u201cMy Smart Age with HIV: an innovative mobile and IoMT framework for patient's empowerment,\u201d","author":"Orsini","year":"2017","journal-title":"IEEE"},{"key":"B33","doi-asserted-by":"publisher","first-page":"2722","DOI":"10.1111\/j.1365-2702.2011.03854.x","article-title":"Approaches for dealing with missing data in health care studies","volume":"21","author":"Penny","year":"2012","journal-title":"J. Clin. Nurs"},{"key":"B34","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat. Mach. Intell"},{"key":"B35","doi-asserted-by":"publisher","first-page":"220638","DOI":"10.1098\/rsos.220638","article-title":"Causal machine learning for healthcare and precision medicine","volume":"9","author":"Sanchez","year":"2022","journal-title":"R. Soc. Open Sci"},{"key":"B36","doi-asserted-by":"publisher","first-page":"52","DOI":"10.3390\/jimaging6060052","article-title":"Explainable deep learning models in medical image analysis","volume":"6","author":"Singh","year":"2020","journal-title":"J. Imaging"},{"key":"B37","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.jclinepi.2020.03.028","article-title":"Missing data should be handled differently for prediction than for description or causal explanation","volume":"125","author":"Sperrin","year":"2020","journal-title":"J. Clin. Epidemiol"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3465416.3483305","article-title":"\u201cA framework for understanding sources of harm throughout the machine learning life cycle,\u201d","author":"Suresh","year":"2021","journal-title":"Equity and Access in Algorithms, Mechanisms, and Optimization"},{"key":"B39","doi-asserted-by":"publisher","author":"Tan","year":"2022","DOI":"10.1101\/2022.05.08.22274724"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.cs\/0212034","article-title":"Types of cost in inductive concept learning","author":"Turney","year":"2002","journal-title":"arXiv preprint"},{"key":"B41","author":"van Rijsbergen","year":"1979","journal-title":"Information Retrieval, 2nd Edn"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1968","DOI":"10.1109\/TCBB.2018.2827029","article-title":"Predicting hospital readmission via cost-sensitive deep learning","volume":"15","author":"Wang","year":"2018","journal-title":"ACM Trans. Comput. Biol. Bioinformatics"},{"key":"B43","unstructured":"Hidden Markov models and the Baum-Welch algorithm1013\n            WelchL. R.\n          IEEE Inform. Theory Soc. Newslett532003"},{"key":"B44","doi-asserted-by":"publisher","first-page":"1520","DOI":"10.1016\/j.healun.2022.07.001","article-title":"Incompleteness of health-related quality of life assessments before left ventricular assist device implant: a novel quality metric","volume":"41","author":"Yang","year":"2022","journal-title":"J. Heart Lung Transplant"},{"key":"B45","first-page":"325","article-title":"\u201cLearning fair representations,\u201d","author":"Zemel","year":"2013","journal-title":"Proceedings of the"},{"key":"B46","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1111\/rssa.12227","article-title":"Interpretable classification models for recidivism prediction","volume":"180","author":"Zeng","year":"2017","journal-title":"J. R. Stat. Soc. Ser. A"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3134428","article-title":"PrivBayes: private data release via Bayesian networks","volume":"42","author":"Zhang","year":"2017","journal-title":"ACM Trans. Database Syst"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2009.01492","article-title":"Explainable empirical risk minimization","author":"Zhang","year":"2020","journal-title":"arXiv preprint"}],"container-title":["Frontiers in Big Data"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2022.1021621\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T05:37:29Z","timestamp":1666330649000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2022.1021621\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,21]]},"references-count":48,"alternative-id":["10.3389\/fdata.2022.1021621"],"URL":"https:\/\/doi.org\/10.3389\/fdata.2022.1021621","relation":{},"ISSN":["2624-909X"],"issn-type":[{"value":"2624-909X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,21]]},"article-number":"1021621"}}