{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T11:26:44Z","timestamp":1772796404851,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,9]],"date-time":"2021-12-09T00:00:00Z","timestamp":1639008000000},"content-version":"vor","delay-in-days":8,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"European Union, Third Health Programme","award":["InfAct Joint Action 801553"],"award-info":[{"award-number":["InfAct Joint Action 801553"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Arch Public Health"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Information for Action! is a Joint Action (JA-InfAct) on Health Information promoted by the EU Member States and funded by the European Commission within the Third EU Health Programme (2014\u20132020) to create and develop solid sustainable infrastructure on EU health information. The main objective of this the JA-InfAct is to build an EU health information system infrastructure and strengthen its core elements by a) establishing a sustainable research infrastructure to support population health and health system performance assessment, b) enhancing the European health information and knowledge bases, as well as health information research capacities to reduce health information inequalities, and c) supporting health information interoperability and innovative health information tools and data sources.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Following a federated analysis approach, JA-InfAct developed an ad hoc federated infrastructure based on distributing a well-defined process-mining analysis methodology to be deployed at each participating partners\u2019 systems to reproduce the analysis and pool the aggregated results from the analyses. To overcome the legal interoperability issues on international data sharing, data linkage and management, partners (EU regions) participating in the case studies worked coordinately to query their real-world healthcare data sources complying with a common data model, executed the process-mining analysis pipeline on their premises, and shared the results enabling international comparison and the identification of best practices on stroke care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The ad hoc federated infrastructure was designed and built upon open source technologies, providing partners with the capacity to exploit their data and generate dashboards exploring the stroke care pathways. These dashboards can be shared among the participating partners or to a coordination hub without legal issues, enabling the comparative evaluation of the caregiving activities for acute stroke across regions.<\/jats:p>\n                    <jats:p>Nonetheless, the approach is not free of a number of challenges that have been solved, and new challenges that should be addressed in the eventual case of scaling up. For that eventual case, 12 recommendations considering the different layers of interoperability have been provided.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The proposed approach, when successfully deployed as a federated analysis infrastructure, such as the one developed within the JA-InfAct, can concisely tackle all levels of the interoperability requirements from organisational to technical interoperability, supported by the close collaboration of the partners participating in the study. Any proposal for extension, should require further thinking on how to deal with new challenges on interoperability.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13690-021-00731-z","type":"journal-article","created":{"date-parts":[[2021,12,8]],"date-time":"2021-12-08T21:02:46Z","timestamp":1638997366000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Coping with interoperability in the development of a federated research infrastructure: achievements, challenges and recommendations from the JA-InfAct"],"prefix":"10.1186","volume":"79","author":[{"given":"Juan","family":"Gonz\u00e1lez-Garc\u00eda","sequence":"first","affiliation":[]},{"given":"Francisco","family":"Estupi\u00f1\u00e1n-Romero","sequence":"additional","affiliation":[]},{"given":"Carlos","family":"Teller\u00eda-Orriols","sequence":"additional","affiliation":[]},{"given":"Javier","family":"Gonz\u00e1lez-Galindo","sequence":"additional","affiliation":[]},{"given":"Luigi","family":"Palmieri","sequence":"additional","affiliation":[]},{"given":"Andrea","family":"Faragalli","sequence":"additional","affiliation":[]},{"given":"Ivan","family":"Prist\u0101s","sequence":"additional","affiliation":[]},{"given":"Jakov","family":"Vukovi\u0107","sequence":"additional","affiliation":[]},{"given":"Janis","family":"Misin\u0161","sequence":"additional","affiliation":[]},{"given":"Irisa","family":"Zile","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0961-3298","authenticated-orcid":false,"given":"Enrique","family":"Bernal-Delgado","sequence":"additional","affiliation":[]},{"name":"on behalf of the InfAct Joint Action consortium","sequence":"additional","affiliation":[]},{"given":"Brigid","family":"Unim","sequence":"additional","affiliation":[]},{"given":"Flavia","family":"Carle","sequence":"additional","affiliation":[]},{"given":"Rosaria","family":"Gesuita","sequence":"additional","affiliation":[]},{"given":"Damir","family":"Ivankovi\u0107","sequence":"additional","affiliation":[]},{"given":"Marko","family":"Brki\u0107","sequence":"additional","affiliation":[]},{"given":"Jelena","family":"Dimnjakovi\u0107","sequence":"additional","affiliation":[]},{"given":"Jane","family":"Lyons","sequence":"additional","affiliation":[]},{"given":"Ronan","family":"Lyons","sequence":"additional","affiliation":[]},{"given":"Zeynep","family":"Ors","sequence":"additional","affiliation":[]},{"given":"Metka","family":"Zaletel","sequence":"additional","affiliation":[]},{"given":"Paulo","family":"Nogueira","sequence":"additional","affiliation":[]},{"given":"Lu\u00eds Velez","family":"Lap\u00e3o","sequence":"additional","affiliation":[]},{"given":"H\u00e5kon","family":"Haaheim","sequence":"additional","affiliation":[]},{"given":"Petronille","family":"Bogaert","sequence":"additional","affiliation":[]},{"given":"Linda","family":"Abboud","sequence":"additional","affiliation":[]},{"given":"Herman","family":"van Oyen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,12,9]]},"reference":[{"key":"731_CR1","unstructured":"Directorate-General for Informatics (European Commission). The New European Interoperability Framework | ISA\u00b2. Brussels; 2007 (n.d.). Retrieved November 22, 2021, from. https:\/\/ec.europa.eu\/isa2\/eif_en. https:\/\/doi.org\/10.2799\/78681."},{"issue":"9","key":"731_CR2","doi-asserted-by":"publisher","first-page":"2671","DOI":"10.1109\/JBHI.2020.2971146","volume":"24","author":"J Gonzalez-Garcia","year":"2020","unstructured":"Gonzalez-Garcia J, Telleria-Orriols C, Estupinan-Romero F, Bernal-Delgado E. Construction of Empirical Care Pathways Process Models From Multiple Real-World Datasets. IEEE J Biomed Health Informa. 2020;24(9):2671\u201380. https:\/\/doi.org\/10.1109\/JBHI.2020.2971146.","journal-title":"IEEE J Biomed Health Informa"},{"key":"731_CR3","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-49851-4","volume-title":"Process Mining: Data Science in Action","author":"WMP van der Aalst","year":"2016","unstructured":"van der Aalst WMP. Process Mining: Data Science in Action. 2nd ed. Berlin, Heidelberg: Springer; 2016.","edition":"2"},{"key":"731_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-16071-9","volume-title":"Process Mining in Healthcare: Evaluating and Exploiting Operational Healthcare Processes","author":"RS Mans","year":"2015","unstructured":"Mans RS, van der Aalst WMP, Vanwersch RJB. Process Mining in Healthcare: Evaluating and Exploiting Operational Healthcare Processes. Cham: Springer International Publishing; 2015."},{"issue":"10","key":"731_CR5","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1161\/01.STR.25.10.1920","volume":"25","author":"CR Gomez","year":"1994","unstructured":"Gomez CR, Malkoff MD, Sauer CM, Tulyapronchote R, Burch CM, Banet GA. Code Stroke. An attempt to shorten in hospital therapeutic delays. Stroke. 1994;25(10):1920\u20133. https:\/\/doi.org\/10.1161\/01.STR.25.10.1920.","journal-title":"Stroke"},{"key":"731_CR6","unstructured":"European Parliament and Council of the European Union, Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95\/46\/EC (General Data Protection Regulation). Brussels: European Parliament and Council of the European Union, 2016."},{"key":"731_CR7","unstructured":"World Health Organization. International classification of diseases : [\u200e9th]\u200e ninth revision, basic tabulation list with alphabetic index. Geneva: World Health Organization; 1978. https:\/\/apps.who.int\/iris\/handle\/10665\/39473."},{"key":"731_CR8","unstructured":"World Health Organization. ICD-10 International Statistical Classification of Diseases and related health problems. 10th revision. 5th ed. World Health Organization. Geneva. 2015. Retrieved November 22, 2021, from https:\/\/www.who.int\/classifications\/icd\/ICD10Volume2_en_2010.pdf."},{"key":"731_CR9","doi-asserted-by":"publisher","unstructured":"Boettiger C, An introduction to Docker for reproducible research, Operating Systems Review (ACM), Jan. 2015, 49, 1, 71\u201379, https:\/\/doi.org\/10.1145\/2723872.2723882.","DOI":"10.1145\/2723872.2723882"},{"key":"731_CR10","unstructured":"DMTF. Distributed Management Task Force Inc., Open Virtualization Format Specification. Document Number: DSP0243. Date: 2015-08-27. Version: 2.1.1. DMTF. 2015. Retrieved November 22, 2021, from https:\/\/www.dmtf.org\/sites\/default\/files\/standards\/documents\/DSP0243_2.1.1.pd."},{"key":"731_CR11","unstructured":"[MS-VHDX]: Virtual Hard Disk v2 (VHDX) File Format. 5th revision. Microsoft Corporation 2021 (n.d.). Retrieved November 22, 2021, from https:\/\/winprotocoldoc.blob.core.windows.net\/productionwindowsarchives\/MS-VHDX\/%5BMS-VHDX%5D.pdf."},{"key":"731_CR12","doi-asserted-by":"publisher","unstructured":"Gonz\u00e1lez-Garc\u00eda J, Estupi\u00f1\u00e1n-Romero F, Teller\u00eda-Orriols C, Bernal-Delgado E. Stroke Process Mining Analysis Virtual Machine Image (OVFv2 \/ VHD formats) (Version Data Model Slides v13 (Effective Data Model v11). Run Slides v7.). Zenodo. 2020. https:\/\/doi.org\/10.5281\/zenodo.3952495.","DOI":"10.5281\/zenodo.3952495"},{"key":"731_CR13","unstructured":"Health Data Research UK Data Quality and Standards Strategy Green Paper for Consultation September 2019; available at: https:\/\/ukhealthdata.org\/wp-content\/uploads\/2019\/09\/HDRUK_Data_Quality_Standards_Green_Paper_Sept2019circulate.pdf (last access, 2021, 31st May)."},{"key":"731_CR14","unstructured":"DCAT Data Application Profile for Data Portal in Europe, European Commission 2021, available at https:\/\/ec.europa.eu\/isa2\/solutions\/dcat-application-profile-data-portals-europe_en (last access, 2021, 31st of May)."},{"key":"731_CR15","unstructured":"N.-N. Nordic Council of Ministers, NOMESCO Classification of Surgical Procedures (NCSP), Version 1.14. Copenhagen, 2009."},{"key":"731_CR16","unstructured":"National Clinical Coding Standards OPCS. Terminology and classifications delivery service. NHS Digital, 2021. Available at: https:\/\/classbrowser.nhs.uk\/ref_books\/OPCS-4.9_NCCS-2021.pdf (last access, 2021, 31st May)."},{"key":"731_CR17","unstructured":"Leistsungkatalog, Ministry of Health Austria, 2021. Available at https:\/\/www.sozialministerium.at\/public.html (last access, 2021, 31st May)."},{"key":"731_CR18","unstructured":"ICD-10-AM\/ACHI\/ACS, IHAP 2021. Available at https:\/\/www.ihpa.gov.au\/publications\/icd-10-amachiacs-ninth-edition (last access, 2021, 31st May)."},{"key":"731_CR19","unstructured":"Common LOINC Laboratory Observation Codes, LOINC, 2021. Available at https:\/\/loinc.org\/usage\/obs\/ (last access, 2021, 31st May)."},{"key":"731_CR20","first-page":"640","volume":"4","author":"KA Spackman","year":"1997","unstructured":"Spackman KA, Campbell KE, C\u00f4t\u00e9 RA. SNOMED RT: A Reference Terminology for Health Care. J Am. Med Inform Assoc. 1997;4:640\u20134 Accessed: Apr. 27, 2021. [Online]. Available: \/pmc\/articles\/PMC2233423\/?report=abstract.","journal-title":"J Am. Med Inform Assoc"},{"key":"731_CR21","unstructured":"BBMRI-ERIC standardization services Available at https:\/\/www.bbmri-eric.eu\/services\/standardisation\/ (last access, 2021, 31st May)."},{"key":"731_CR22","unstructured":"ELIXIR-ERIC interoperability and standards. Available at https:\/\/elixir-europe.org\/services\/tag\/interoperability-and-standards (last access, 2021, 31st May)."},{"key":"731_CR23","unstructured":"OHDSI, Observational data sciences and informatics, 2021. Available at https:\/\/ohdsi.github.io\/TheBookOfOhdsi\/ (last access, 2021, 31st May)."},{"key":"731_CR24","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/978-981-15-1899-7_20","volume-title":"Communications in Computer and Information Science","author":"P Shi","year":"2019","unstructured":"Shi P, Wang P, Zhang H. Distributed Logistic Regression for Separated Massive Data. In: Communications in Computer and Information Science, vol. 1120 CCIS; 2019. p. 285\u201396. https:\/\/doi.org\/10.1007\/978-981-15-1899-7_20."},{"issue":"6","key":"731_CR25","doi-asserted-by":"publisher","first-page":"1212","DOI":"10.1093\/jamia\/ocv083","volume":"22","author":"C-L Lu","year":"2015","unstructured":"Lu C-L, et al. WebDISCO: a web service for distributed cox model learning without patient-level data sharing. J Am Med Inform Assoc. 2015;22(6):1212\u20139. https:\/\/doi.org\/10.1093\/jamia\/ocv083.","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"731_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3298981","volume":"10","author":"Q Yang","year":"2019","unstructured":"Yang Q, Liu Y, Chen T, Tong Y. Federated machine learning: Concept and applications. ACM Trans Intell Syst Technol. 2019;10(2):1\u201319. https:\/\/doi.org\/10.1145\/3298981.","journal-title":"ACM Trans Intell Syst Technol"},{"key":"731_CR27","unstructured":"Bonawitz K, et al., Towards Federated Learning at Scale: System Design, 2019. Available: https:\/\/arxiv.org\/abs\/1902.01046."},{"issue":"3","key":"731_CR28","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MSP.2020.2975749","volume":"37","author":"T Li","year":"2020","unstructured":"Li T, Sahu AK, Talwalkar A, Smith V. Federated Learning: Challenges, Methods, and Future Directions. IEEE Signal Process Mag. 2020;37(3):50\u201360. https:\/\/doi.org\/10.1109\/MSP.2020.2975749.","journal-title":"IEEE Signal Process Mag"},{"issue":"05","key":"731_CR29","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1142\/S0218488502001648","volume":"10","author":"L Sweeney","year":"2002","unstructured":"Sweeney L. k-anonymity: A model for protecting privacy. Int J Uncertaint Fuzziness Knowl-Based Syst. 2002;10(05):557\u201370.","journal-title":"Int J Uncertaint Fuzziness Knowl-Based Syst"}],"updated-by":[{"DOI":"10.1186\/s13690-022-00877-4","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,4,11]],"date-time":"2022-04-11T00:00:00Z","timestamp":1649635200000}}],"container-title":["Archives of Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13690-021-00731-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13690-021-00731-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13690-021-00731-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,11]],"date-time":"2022-04-11T07:20:00Z","timestamp":1649661600000},"score":1,"resource":{"primary":{"URL":"https:\/\/archpublichealth.biomedcentral.com\/articles\/10.1186\/s13690-021-00731-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["731"],"URL":"https:\/\/doi.org\/10.1186\/s13690-021-00731-z","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-632073\/v1","asserted-by":"object"}]},"ISSN":["2049-3258"],"issn-type":[{"value":"2049-3258","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"21 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 April 2022","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1186\/s13690-022-00877-4","URL":"https:\/\/doi.org\/10.1186\/s13690-022-00877-4","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study, observational in design, used retrospective pseudonymized, non-identifiable and non-traceable data, and was conducted in accordance with the amended Helsinki Declaration, the International Guidelines for Ethical Review of Epidemiological Studies, and European legislation on data protection and patients\u2019 rights. The study implies the use of pseudonymised data, accesses and\/or curated and\/or treated under the ethical and legal provisions of application in the different participant institutions. The work has been developed in the context of a federated infrastructure where no individual data is pooled or exchanged across institutions but just aggregated outputs.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The content of this report represents the views of the authors only and is their sole responsibility; it cannot be considered to reflect the views of the European Commission and\/or the Consumers, Health, Agriculture and Food Executive Agency (CHAFEA) or any other body of the European Union. The European Commission and the Agency do not accept any responsibility for use that may be made of the information it contains.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"221"}}