{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T09:24:28Z","timestamp":1781688268108,"version":"3.54.5"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Digit. Gov.: Res. Pract."],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>The achievement of organizational interoperability is a crucial factor for the successful digital transformation and a catalyst for Digital Decade's 2030 main targets. The aim of this article is to develop and test a new conceptual model of organizational interoperability assessment. A new model to assess in an effective, holistic way the organizational interoperability of digital services has been developed, using a mixed qualitative and quantitative approach, based on literature research and feedback from experts in the field, composing a valid and effective model for evaluating the achievement of organizational interoperability. The developed model consists of 9 factors and 34 variables and is evaluated in terms of statistical reliability, relevance, and coherence of factors and variables. The evaluation of the model in terms of reliability and internal consistency is achieved through data collected from a sample survey responded to by 112 domain experts. The collected data analyzed with the aid of descriptive and inductive statistical methods such as Cronbach's Alpha coefficient and Factor analysis, from which resulted alpha= 0.869 for the total interoperability scale, which is satisfactory enough, as well as the total variance explained from the Factor Analysis found to be 60% or higher, resulted in a well-established model in statistical terms.<\/jats:p>","DOI":"10.1145\/3721137","type":"journal-article","created":{"date-parts":[[2025,3,7]],"date-time":"2025-03-07T06:12:02Z","timestamp":1741327922000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Evaluation of Reliability and Consistency of a new Model for Organizational Interoperability Assessment"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9863-8982","authenticated-orcid":false,"given":"Vasiliki","family":"Margariti","sequence":"first","affiliation":[{"name":"Informatics and Telematics, Harokopio University of Athens","place":["Athens, Greece"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6971-3832","authenticated-orcid":false,"given":"Teta","family":"Stamati","sequence":"additional","affiliation":[{"name":"Informatics and Telematics, Harokopio University of Athens","place":["Athens, Greece"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0747-4252","authenticated-orcid":false,"given":"Dimosthenis","family":"Anagnostopoulos","sequence":"additional","affiliation":[{"name":"Informatics and Telematics, Harokopio University of Athens","place":["Athens, Greece"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4541-961X","authenticated-orcid":false,"given":"Mara","family":"Nikolaidou","sequence":"additional","affiliation":[{"name":"Informatics and Telematics, Harokopio University of Athens","place":["Athens, Greece"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5588-665X","authenticated-orcid":false,"given":"Athanassios","family":"Raptis","sequence":"additional","affiliation":[{"name":"National Centre for Public Administration and Local Government","place":["Athens, Greece"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,8,27]]},"reference":[{"key":"e_1_3_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11133-019-9413-7"},{"key":"e_1_3_1_3_1","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1007\/978-3-540-25952-7_37","article-title":"Information sharing and collaboration policies within government agencies","author":"Atabakhsh H.","year":"2004","unstructured":"H. Atabakhsh, C. Larson, T. Petersen, C. Violette, and H. Chen. 2004. Information sharing and collaboration policies within government agencies. In 2nd Symposium on Intelligence and Security Informatics: Intelligence and Security Informatics (ISI\u201904). Springer Berlin, 467\u2013475.","journal-title":"2nd Symposium on Intelligence and Security Informatics: Intelligence and Security Informatics (ISI\u201904)"},{"key":"e_1_3_1_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781119970583"},{"key":"e_1_3_1_5_1","volume-title":"Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming","author":"Byrne B. M.","year":"2010","unstructured":"B. M. Byrne. 2010. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming (2nd ed.). Routledge.","edition":"2"},{"key":"e_1_3_1_6_1","volume-title":"IIE Annual Conference","author":"Cestari J. M. A.","year":"2014","unstructured":"J. M. A. Cestari, E. R. Loures, E. A. P. Santos, and M. Lezoche. 2014. A research strategy for public administration interoperability assessment. In IIE Annual Conference. Institute of Industrial and Systems Engineers (IISE)."},{"key":"e_1_3_1_7_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen J.","year":"1988","unstructured":"J. Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates.","edition":"2"},{"key":"e_1_3_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/bf02310555"},{"key":"e_1_3_1_9_1","unstructured":"European Parliament and Council of the European Union. 2022. Decision (EU) 2022\/2481 of the European Parliament and of the Council of 14 December 2022 establishing the Digital Decade Policy Program 2030 Retrieved from: http:\/\/data.europa.eu\/eli\/dec\/2022\/2481\/oj"},{"key":"e_1_3_1_10_1","doi-asserted-by":"publisher","unstructured":"European Commission DG DIGIT Directorate General for Informatics. 2020. Recommendations for organizing and governing integrated public services. DOI:10.2799\/85943","DOI":"10.2799\/85943"},{"key":"e_1_3_1_11_1","unstructured":"European Commission. 2017. New European interoperability framework: Promoting seamless services and data flows for European public administrations. Retrieved from: eif_brochure_final.pdf"},{"key":"e_1_3_1_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.4.3.272"},{"key":"e_1_3_1_13_1","doi-asserted-by":"publisher","DOI":"10.3758\/BRM.41.4.1149"},{"key":"e_1_3_1_14_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193146"},{"key":"e_1_3_1_15_1","unstructured":"A. Field. 2024. Discovering statistics using IBM SPSS statistics. Sage publications limited."},{"key":"e_1_3_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2005.02.001"},{"key":"e_1_3_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-2015-6"},{"key":"e_1_3_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/17517575.2013.805246"},{"key":"e_1_3_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2006.05.003"},{"key":"e_1_3_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-36001-5_26"},{"key":"e_1_3_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2012.10.006"},{"key":"e_1_3_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-5251-4_109"},{"key":"e_1_3_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2017.10.007"},{"key":"e_1_3_1_24_1","doi-asserted-by":"crossref","unstructured":"M. R. Knight J. T. Kolln S. E. Widergren D. Narang A. Khandekar and B. Nordman. 2020. Interoperability maturity model (No. PNNL-29683). Pacific Northwest National Lab (PNNL) Richland WA (United States).","DOI":"10.2172\/1804457"},{"key":"e_1_3_1_25_1","doi-asserted-by":"publisher","DOI":"10.1504\/EG.2016.078422"},{"key":"e_1_3_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3085228.3085235"},{"key":"e_1_3_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-79851-2_12"},{"key":"e_1_3_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-658-35666-8_5"},{"key":"e_1_3_1_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/0033-3352.00023"},{"key":"e_1_3_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2019.01.002"},{"key":"e_1_3_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-79851-2_3"},{"key":"e_1_3_1_32_1","volume-title":"Sampling of Populations","author":"Levy P.","year":"1999","unstructured":"P. Levy and S. Lemeshow. 1999. Sampling of Populations. Wiley Series in Statistics."},{"key":"e_1_3_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2020.102153"},{"key":"e_1_3_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2007.04.003"},{"key":"e_1_3_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2022.101712"},{"key":"e_1_3_1_36_1","author":"Miles M. B.","year":"2014","unstructured":"M. B. Miles, A. M. Huberman, and J. Salda\u00f1a. 2014. Qualitative Data Analysis: A Methods Sourcebook (3rd ed.). Sage.","journal-title":"Qualitative Data Analysis: A Methods Sourcebook"},{"key":"e_1_3_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40299-021-00619-0"},{"key":"e_1_3_1_38_1","volume-title":"Psychometric Theory","author":"Nunnally J. C.","year":"1994","unstructured":"J. C. Nunnally and I. H. Bernstein. 1994. Psychometric Theory (3rd ed.). McGraw-Hill.","edition":"3"},{"key":"e_1_3_1_39_1","unstructured":"M. A. A. R. J. A. Olesk. 2020. Challenges of collaborative digital government: e-participation. Open Government Data and Cross-Border Interoperability. Tallinn University of Technology."},{"key":"e_1_3_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pursup.2023.100821"},{"key":"e_1_3_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2007.08.004"},{"key":"e_1_3_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/IESA.2009.24"},{"key":"e_1_3_1_43_1","doi-asserted-by":"publisher","DOI":"10.1631\/jzus.C1300013"},{"key":"e_1_3_1_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/239700221402800402"},{"key":"e_1_3_1_45_1","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.2.27338.38084"},{"key":"e_1_3_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2014.01.008"},{"key":"e_1_3_1_47_1","first-page":"1","article-title":"Towards standardizing interoperability levels for information systems of public administrations","volume":"2","author":"Sarantis D.","year":"2008","unstructured":"D. Sarantis, Y. Charalabidis, and J. Psarras. 2008. Towards standardizing interoperability levels for information systems of public administrations. Electron. J. E-comm. Tool Applic. Spec. Issue Interop. Enterp. Admin. Worldw. 2 (2008), 1\u201315.","journal-title":"Electron. J. E-comm. Tool Applic. Spec. Issue Interop. Enterp. Admin. Worldw."},{"key":"e_1_3_1_48_1","doi-asserted-by":"publisher","DOI":"10.1080\/07036337.2021.2011267"},{"key":"e_1_3_1_49_1","volume-title":"Interpreting Qualitative Data, Methods for Analyzing Talk, Text and lnteraction","author":"Silverman D.","year":"1993","unstructured":"D. Silverman. 1993. Interpreting Qualitative Data, Methods for Analyzing Talk, Text and lnteraction. SAGE, Thousand Oaks, CA."},{"key":"e_1_3_1_50_1","volume-title":"Wirtschaftsinformatik 2023 Proceedings","unstructured":"L. Stegemann. 2023. Interoperability maturity model: Orchestrator tool for platform ecosystems. Wirtschaftsinformatik 2023 Proceedings."},{"key":"e_1_3_1_51_1","doi-asserted-by":"publisher","DOI":"10.5116\/ijme.4dfb.8dfd"},{"key":"e_1_3_1_52_1","volume":"46","author":"Tashakkori A.","year":"1998","unstructured":"A. Tashakkori, C. Teddlie, and C. B. Teddlie. 1998. Mixed Methodology: Combining Qualitative and Quantitative Approaches (Vol. 46). SAGE.","journal-title":"Mixed Methodology: Combining Qualitative and Quantitative Approaches"},{"key":"e_1_3_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11165-016-9602-2"},{"key":"e_1_3_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2022.101681"},{"key":"e_1_3_1_55_1","first-page":"1","article-title":"Interoperability governance: A definition and insights from case studies in Europe","author":"Wimmer M. A.","year":"2018","unstructured":"M. A. Wimmer, R. Boneva, and D. Di Giacomo. 2018. Interoperability governance: A definition and insights from case studies in Europe. In 19th Annual International Conference on Digital Government Research: Governance in the Data Age. 1\u201311.","journal-title":"19th Annual International Conference on Digital Government Research: Governance in the Data Age"}],"container-title":["Digital Government: Research and Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3721137","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T12:39:35Z","timestamp":1756298375000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721137"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,27]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3721137"],"URL":"https:\/\/doi.org\/10.1145\/3721137","relation":{},"ISSN":["2691-199X","2639-0175"],"issn-type":[{"value":"2691-199X","type":"print"},{"value":"2639-0175","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,27]]},"assertion":[{"value":"2024-01-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}