{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T14:51:53Z","timestamp":1779202313115,"version":"3.51.4"},"reference-count":49,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,6,8]],"date-time":"2020-06-08T00:00:00Z","timestamp":1591574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Hospital critical infrastructures have a distinct threat vector, due to (i) a dependence on legacy software; (ii) the vast levels of interconnected medical devices; (iii) the use of multiple bespoke software and that (iv) electronic devices (e.g., laptops and PCs) are often shared by multiple users. In the UK, hospitals are currently upgrading towards the use of electronic patient record (EPR) systems. EPR systems and their data are replacing traditional paper records, providing access to patients\u2019 test results and details of their overall care more efficiently. Paper records are no-longer stored at patients\u2019 bedsides, but instead are accessible via electronic devices for the direct insertion of data. With over 83% of hospitals in the UK moving towards EPRs, access to this healthcare data needs to be monitored proactively for malicious activity. It is paramount that hospitals maintain patient trust and ensure that the information security principles of integrity, availability and confidentiality are upheld when deploying EPR systems. In this paper, an investigation methodology is presented towards the identification of anomalous behaviours within EPR datasets. Many security solutions focus on a perimeter-based approach; however, this approach alone is not enough to guarantee security, as can be seen from the many examples of breaches. Our proposed system can be complementary to existing security perimeter solutions. The system outlined in this research employs an internal-focused methodology for anomaly detection by using the Local Outlier Factor (LOF) and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithms for benchmarking behaviour, for assisting healthcare data analysts. Out of 90,385 unique IDs, DBSCAN finds 102 anomalies, whereas 358 are detected using LOF.<\/jats:p>","DOI":"10.3390\/fi12060100","type":"journal-article","created":{"date-parts":[[2020,6,9]],"date-time":"2020-06-09T04:19:39Z","timestamp":1591676379000},"page":"100","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Patient Privacy Violation Detection in Healthcare Critical Infrastructures: An Investigation Using Density-Based Benchmarking"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8287-0330","authenticated-orcid":false,"given":"William","family":"Hurst","sequence":"first","affiliation":[{"name":"Department of Computer Science, Liverpool John Moores University, Liverpool L3 3AF, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron","family":"Boddy","sequence":"additional","affiliation":[{"name":"Aintree Hospital, Liverpool L9 7AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Madjid","family":"Merabti","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Sharjah, Sharjah, UAE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathan","family":"Shone","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Liverpool John Moores University, Liverpool L3 3AF, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,8]]},"reference":[{"key":"ref_1","unstructured":"(2020, March 20). Data Security Incident Trends, ICO: Information Commissioner\u2019s Office. Available online: ico.org.uk\/action-weve-taken\/data-security-incident-trends."},{"key":"ref_2","unstructured":"Rooney, L. (2016). A Digital NHS: An Introduction to the Digital Agenda and Plans for Implementation, Digital Health and Care Institute."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/j.ijmedinf.2014.04.006","article-title":"We Work with Them? Healthcare Workers Interpretation of Organizational relations Mined from Electronic Health Records","volume":"83","author":"Chen","year":"2014","journal-title":"Int. J. Med Inf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7042","DOI":"10.1136\/bmj.f7042","article-title":"Patient Confidentiality in a Time of Care","volume":"347","author":"Sheather","year":"2013","journal-title":"Data Br. Med J."},{"key":"ref_5","first-page":"17","article-title":"McArthur, Visual Analytics for Dimension Reduction and Cluster Analysis of High Dimensional Electronic Health Records","volume":"7","author":"Abdullah","year":"2020","journal-title":"MDPI Spec. Issue Feature Pap. Health Inform."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Qing, L., Linhong, W., and Xuehai, D. (2019). A Novel Neural Network-Based Method for Medical Text Classification. Future Internet, 11.","DOI":"10.3390\/fi11120255"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Livieris, I.E., Kanavos, A., Tampakas, V., and Pintelas, P. (2018). An Ensemble SSL Algorithm for Efficient Chest X-Ray Image Classification. J. Imaging, 4.","DOI":"10.3390\/jimaging4070095"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Joloudari, J.H., Hassannataj Joloudari, E., Saadatfar, H., GhasemiGol, M., Razavi, S.M., Mosavi, A., Nabipour, N., Shamshirband, S., and Nadai, L. (2020). Coronary Artery Disease Diagnosis; Ranking the Significant Features Using a Random Trees Model. Int. J. Environ. Res. Public Health, 17.","DOI":"10.20944\/preprints202001.0220.v1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1136\/amiajnl-2011-000217","article-title":"Using Statistical and Machine Learning to Help Institutions Detect Suspicious Access to Electronic Health Records","volume":"18","author":"Boxwala","year":"2011","journal-title":"J. Am. Med Inform. Assoc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s10994-013-5376-1","article-title":"Detecting Inappropriate Access to Electronic Health Records using Collaborative Filtering","volume":"95","author":"Menon","year":"2014","journal-title":"Mach. Learn."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijmedinf.2019.01.014","article-title":"Understanding the patient privacy perspective on health information exchange: A systematic review","volume":"125","author":"Shen","year":"2019","journal-title":"Int. J. Med Inform."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chen, Y., and Malin, B. (2011, January 21\u201323). Detection of Anomalous Insiders in Collaborative Environments via Relational Analysis of Access Logs. Proceedings of the ACM Conference on Data Applications, Security and Privacy, San Antonio, TX, USA.","DOI":"10.1145\/1943513.1943524"},{"key":"ref_13","unstructured":"Zhang, W., Gunter, C., and Liebovitz, D. (2011). Role prediction using Electronic Medical Record system audits. AMIA Annual Symposium, Europe PMC."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/MC.2015.33","article-title":"Attribute-Based Access Control","volume":"48","author":"Hu","year":"2015","journal-title":"Computer"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ferreira, A. (2006, January 22\u201323). How to Break Access Control in a Controlled Manner. Proceedings of the 19th IEEE Symposium on Computer-Based Medical Systems, Salt Lake City, UT, USA.","DOI":"10.1109\/CBMS.2006.95"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Georgiadis, C.K., Mavridis, I., Pangalos, G., and Thomas, R.K. (2001, January 3\u20134). Flexible team-based Access Control using Contexts. Proceedings of the sixth ACM Symposium on Access Control Models and Technologies, Chantilly, VA, USA.","DOI":"10.1145\/373256.373259"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1056\/NEJMp1706754","article-title":"Cyberattack on Britain\u2019s national health service\u2014A wake-up call for modern medicine","volume":"377","author":"Clarke","year":"2017","journal-title":"N. Engl. J. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1007\/s11606-017-4030-1","article-title":"Ethical Implications of the Electronic Health Record: In the Service of the Patient","volume":"32","author":"Sulmasy","year":"2017","journal-title":"J. Gen. Intern. Med."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MCC.2018.011791712","article-title":"Blockchain: A Panacea for Healthcare Cloud-Based Data Security and Privacy?","volume":"5","author":"Esposito","year":"2018","journal-title":"IEEE Cloud Comput."},{"key":"ref_20","first-page":"149","article-title":"Revisiting Public Health Informatics: Patient Privacy Concerns","volume":"23","author":"Birnbaum","year":"2018","journal-title":"Int. J. Health Gov."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-017-0110-7","article-title":"Big Healthcare Data: Preserving Security and Privacy","volume":"5","author":"Abouelmehdi","year":"2018","journal-title":"J. Big Data"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1007\/s11920-014-0494-4","article-title":"Privacy in the Digital World: Medical and Health Data Outside of HIPAA Protections","volume":"16","author":"Glenn","year":"2014","journal-title":"Curr. Psychiatry Rep."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1177\/1460458217704258","article-title":"Exploring Patients\u2019 Perceptions of Accessing Electronic Health Records: Innovation in Healthcare","volume":"25","author":"Sofie","year":"2019","journal-title":"Health Inform. J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.ijmedinf.2017.12.004","article-title":"Public and Physician\u2019s Expectations and Ethical Concerns about Electronic Health Records","volume":"110","author":"Entzeridou","year":"2018","journal-title":"Int. J. Med. Inform."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Papoutsi, C., Reed, J.E., Marston, C., Lewis, R., Majeed, A., and Bell, D. (2015). Patient and Public Views about the Security and Privacy of Electronic Health Records (EHRs) in the UK: Results from a Mixed Methods Study. BMC Med. Inf. Decis. Mak., 15.","DOI":"10.1186\/s12911-015-0202-2"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1136\/amiajnl-2013-002079","article-title":"Concern about security and privacy, and perceived control over collection and use of health information are related to withholding of health information from healthcare providers","volume":"21","author":"Agaku","year":"2014","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1136\/amiajnl-2012-001062","article-title":"Consumer experience with and attitudes toward health information technology: A nationwide survey","volume":"20","author":"Ancker","year":"2013","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_28","unstructured":"Capps, K. (2012). Making IT Meaningful: How Consumers Value and Trust Health IT, The National Parnership for Women and Families."},{"key":"ref_29","unstructured":"Keckley, P. (2012). 2012 SURVEY of U.S. Health Care Consumers: The Performance of the Health Care System and Health Care Reform, Deloitte Center for Health Solutions."},{"key":"ref_30","unstructured":"Partners, L.R. (2010). Topline Results from a National Consumer Survey on HIT, California Health Care Foundation."},{"key":"ref_31","unstructured":"(2009). Harvard School of Public Health\/Robert Wood Johnson Foundation Poll, Roper Center for Public Opinion Research."},{"key":"ref_32","first-page":"1","article-title":"The 2008 Health Confidence Survey: Rising Costs Continue to Change the Way Americans Use the Health Care System","volume":"29","author":"Helman","year":"2008","journal-title":"EBRI Notes"},{"key":"ref_33","unstructured":"Lake Research Partners, American Viewpoint, and Markle Foundation (2020, June 03). Survey Finds Americans Want Electronic Personal Health Information to Improve Own Health Care. Available online: https:\/\/www.markle.org\/sites\/default\/files\/research_doc_120706.pdf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kim, H., Jeong, Y.-S., Kang, A., Jung, W., Chung, Y.H., Koo, B.S., and Kim, S.H. (2020). Prediction of Post-Intubation Tachycardia Using Machine-Learning Models. Appl. Sci., 10.","DOI":"10.3390\/app10031151"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lee, S., Lim, C.-M., Koh, Y., Hong, S.-B., and Huh, J.W. (2020). Effect of an Electronic Medical Record-Based Screening System on a Rapid Response System: 8-Years\u2019 Experience of a Single Center Cohort. J. Clin. Med., 9.","DOI":"10.3390\/jcm9020383"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Redmond, S., Paterson, N., Shoemaker-Hunt, S.J., and Ramalho-de-Oliveira, D. (2019). Development, Testing and Results of a Patient Medication Experience Documentation Tool for Use in Comprehensive Medication Management Services. Pharm. J., 7.","DOI":"10.3390\/pharmacy7020071"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhu, H., and Hou, M. (2018, January 21\u201323). Research on an Electronic Medical Record System Based on the Internet. Proceedings of the 2nd International Conference on Data Science and Business Analytics (ICDSBA), Changsha, China.","DOI":"10.1109\/ICDSBA.2018.00106"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mandel, A., Maksakov, V., Dorofeyuk, Y., and Shifrin, M. (2019, January 1\u20133). Electronic Medical Records as a Tool of a Large Hospital Management. Proceedings of the Twelfth International Conference on Management of Large-Scale System Development (MLSD), Moscow, Russia.","DOI":"10.1109\/MLSD.2019.8911098"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Selleh, M.A.S., and Saudi, A. (2019, January 2\u20133). Augmented Reality with Hand Gestures Control for Electronic Medical Record. Proceedings of the IEEE 10th Control and System Graduate Research Colloquium (ICSGRC), Shah Alam, Malaysia.","DOI":"10.1109\/ICSGRC.2019.8837061"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"90705","DOI":"10.1109\/ACCESS.2019.2923333","article-title":"Semi-supervised Patient Similarity Clustering Algorithm based on Electronic Medical Records","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"61656","DOI":"10.1109\/ACCESS.2019.2916503","article-title":"A Review of Secure and Privacy-Preserving Medical Data Sharing","volume":"7","author":"Jin","year":"2019","journal-title":"IEEE Access"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"40713","DOI":"10.1109\/ACCESS.2018.2857205","article-title":"Cloud Storage for Electronic Health Records Based on Secret Sharing with Verifiable Reconstruction Outsourcing","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"22313","DOI":"10.1109\/ACCESS.2017.2757844","article-title":"A Security Model for Preserving the Privacy of Medical Big Data in a Healthcare Cloud Using a Fog Computing Facility with Pairing-Based Cryptography","volume":"5","author":"Hamid","year":"2017","journal-title":"IEEE Access"},{"key":"ref_44","unstructured":"Marangio, F., Ciampi, M., Sicuranza, M., Schmid, G., and Esposito, A. (2019, January 24\u201328). A Blockchain Architecture for the Italian EHR System, in HEALTHINFO 2019. Proceedings of the Fourth International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing, Valencia, Spain."},{"key":"ref_45","unstructured":"Alsalamah, S., Alsuwailem, G., and Alrajeh, F. (2019, January 24\u201328). Building a Patient-Centered Blockchain Ecosystem for Caregivers: Diabetes Type II Case Study. Proceedings of the Fourth International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing, Valencia, Spain."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"40285","DOI":"10.1109\/ACCESS.2019.2906503","article-title":"Density-Based Outlier Detection for Safeguarding","volume":"7","author":"Boddy","year":"2019","journal-title":"IEEE Access"},{"key":"ref_47","unstructured":"Foundation, R. (2020, March 23). An Introduction to Corrplot Package, R. Available online: cran.r-project.org\/web\/packages\/corrplot\/vignettes\/corrplot-intro.html."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Bosse, S., and Engel, U. (2019). Real-Time Human-In-The-Loop Simulation with Mobile Agents, Chat Bots, and Crowd Sensing for Smart Cities. Sensors, 19.","DOI":"10.3390\/s19204356"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1007\/s10618-015-0444-8","article-title":"On the evaluation of unsupervised outlier detection: Measures, datasets, and an empirical study","volume":"30","author":"Campos","year":"2016","journal-title":"Data Min. Knowl. Discov."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/12\/6\/100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:36:53Z","timestamp":1760175413000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/12\/6\/100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,8]]},"references-count":49,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["fi12060100"],"URL":"https:\/\/doi.org\/10.3390\/fi12060100","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,8]]}}}