{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,6]],"date-time":"2026-08-06T23:10:41Z","timestamp":1786057841921,"version":"3.56.0"},"reference-count":98,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T00:00:00Z","timestamp":1761436800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In the current scenario of universal accessibility of data, organisations face highly complex challenges related to integrating and processing diverse sets of data in order to meet their analytical needs. This review paper analyses traditional and innovative methods used for data storage and integration, with particular focus on their implications for scalability, consistency, and interoperability within an analytical ecosystem. In particular, it contributes a cross-layer taxonomy linking integration mechanisms (schema matching, entity resolution, and semantic enrichment) to storage\/query substrates (row\/column stores, NoSQL, lakehouse, and federation), together with comparative tables and figures that synthesise trade-offs and performance\/governance levers. Through schema mapping solutions addressing the challenges brought about by structural heterogeneity, storage architectures varying from traditional storage solutions all the way to cloud storage solutions, and ETL pipeline integration using federated query processors, the research provides specific attention for the application of metadata management, with a focus on semantic enrichment using ontologies and lineage management to enable end-to-end traceability and governance. It also covers performance hotspots and caching techniques, along with consistency trade-offs arising out of distributed systems. Empirical case studies from real applications in enterprise lakehouses, scientific exploration activities, and public governance applications serve to invoke this review. Following this work is the possibility of future directions in convergent analytical platforms with support for multiple workloads, along with metadata-centric orchestration with provisions for AI-based integration. Combining technological advancement with practical considerations results in an enabling resource for researchers and practitioners seeking the creation of fault-tolerant, reliable, and future-ready data infrastructure. This review is primarily aimed at researchers, system architects, and advanced practitioners who design and evaluate heterogeneous analytical platforms. It also offers value to graduate students by serving as a structured overview of contemporary methods, thereby bridging academic knowledge with industrial practice.<\/jats:p>","DOI":"10.3390\/info16110932","type":"journal-article","created":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T03:44:39Z","timestamp":1761795879000},"page":"932","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Data Integration and Storage Strategies in Heterogeneous Analytical Systems: Architectures, Methods, and Interoperability Challenges"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1183-9878","authenticated-orcid":false,"given":"Paraskevas","family":"Koukaras","sequence":"first","affiliation":[{"name":"School of Science and Technology, International Hellenic University, 14th km Thessaloniki-Moudania, 57001 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3044","DOI":"10.14778\/3611479.3611507","article-title":"A Deep Dive into Common Open Formats for Analytical DBMSs","volume":"16","author":"Liu","year":"2023","journal-title":"Proc. VLDB Endow."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"148","DOI":"10.14778\/3626292.3626298","article-title":"An Empirical Evaluation of Columnar Storage Formats","volume":"17","author":"Zeng","year":"2023","journal-title":"Proc. VLDB Endow."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3411","DOI":"10.14778\/3415478.3415560","article-title":"Delta lake: High-performance ACID table storage over cloud object stores","volume":"13","author":"Armbrust","year":"2020","journal-title":"Proc. VLDB Endow."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Abadi, D.J., Madden, S.R., and Hachem, N. (2008, January 9\u201312). Column-stores vs. row-stores: How different are they really?. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, BC, Canada.","DOI":"10.1145\/1376616.1376712"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"12571","DOI":"10.1109\/TKDE.2023.3270101","article-title":"Data Lakes: A Survey of Functions and Systems","volume":"35","author":"Hai","year":"2023","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_6","first-page":"107","article-title":"A systematic overview of data federation systems","volume":"15","author":"Gu","year":"2024","journal-title":"Semant. Web"},{"key":"ref_7","first-page":"1","article-title":"Presto: A Decade of SQL Analytics at Meta","volume":"1","author":"Sun","year":"2023","journal-title":"Proc. ACM Manag. Data"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3043","DOI":"10.14778\/3476311.3476382","article-title":"Hyperspace: The Indexing Subsystem of Azure Synapse","volume":"14","author":"Potharaju","year":"2021","journal-title":"Proc. Vldb Endow."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dong, X.L., and Srivastava, D. (2015). Big Data Integration, Synthesis Lectures on Data Management; Springer Nature Switzerland AG.","DOI":"10.1007\/978-3-031-01853-4"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4159","DOI":"10.14778\/3685800.3685834","article-title":"Petabyte-Scale Row-Level Operations in Data Lakehouses","volume":"17","author":"Okolnychyi","year":"2024","journal-title":"Proc. VLDB Endow."},{"key":"ref_11","first-page":"3","article-title":"Integration Approaches for Heterogeneous Big Data: A Survey","volume":"24","author":"Quraan","year":"2024","journal-title":"Cybern. Inf. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3372","DOI":"10.14778\/3554821.3554829","article-title":"Velox: Meta\u2019s unified execution engine","volume":"15","author":"Pedreira","year":"2022","journal-title":"Proc. VLDB Endow."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1007\/s42979-024-02737-0","article-title":"The Lakehouse: State of the Art on Concepts and Technologies","volume":"5","author":"Schneider","year":"2024","journal-title":"SN Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3778","DOI":"10.14778\/3554821.3554898","article-title":"Unified Data Analytics: State-of-the-Art and Open Problems","volume":"15","author":"Kaoudi","year":"2022","journal-title":"Proc. Vldb Endow."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Fan, M., Han, X., Fan, J., Chai, C., Tang, N., Li, G., and Du, X. (2024, January 13\u201316). Cost-Effective In-Context Learning for Entity Resolution: A Design Space Exploration. Proceedings of the 2024 IEEE 40th International Conference on Data Engineering (ICDE), Utrecht, The Netherlands.","DOI":"10.1109\/ICDE60146.2024.00284"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"102816","DOI":"10.1016\/j.inffus.2024.102816","article-title":"Active in-context learning for cross-domain entity resolution","volume":"117","author":"Zhang","year":"2025","journal-title":"Inf. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"103254","DOI":"10.1016\/j.inffus.2025.103254","article-title":"Ontology matching with Large Language Models and prioritized depth-first search","volume":"123","author":"Taboada","year":"2025","journal-title":"Inf. Fusion"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mero\u00f1o Pe\u00f1uela, A., Corcho, O., Groth, P., Simperl, E., Tamma, V., Nuzzolese, A.G., Poveda-Villal\u00f3n, M., Sabou, M., Presutti, V., and Celino, I. (2024, January 26\u201330). LLMs4OM: Matching Ontologies with Large Language Models. Proceedings of the Semantic Web: ESWC 2024 Satellite Events, Hersonissos, Greece.","DOI":"10.1007\/978-3-031-78955-7"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Barbon Junior, S., Ceravolo, P., Groppe, S., Jarrar, M., Maghool, S., S\u00e8des, F., Sahri, S., and Van Keulen, M. (2024, January 9\u201315). Are Large Language Models the New Interface for Data Pipelines?. Proceedings of the International Workshop on Big Data in Emergent Distributed Environments, Santiago, Chile.","DOI":"10.1145\/3663741.3664785"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alidu, A., Ciavotta, M., and Paoli, F.D. (2024, January 3\u20136). LLM-Based DAG Creation for Data Enrichment Pipelines in SemT Framework. Proceedings of the Service-Oriented Computing\u2014ICSOC 2024 Workshops: ASOCA, AI-PA, WESOACS, GAISS, LAIS, AI on Edge, RTSEMS, SQS, SOCAISA, SOC4AI and Satellite Events, Tunis, Tunisia.","DOI":"10.1007\/978-981-96-7238-7_11"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1007\/s007780100057","article-title":"A Survey of Approaches to Automatic Schema Matching","volume":"10","author":"Rahm","year":"2001","journal-title":"VLDB J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1456650.1456651","article-title":"Data Fusion","volume":"41","author":"Bleiholder","year":"2008","journal-title":"ACM Comput. Surv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1561\/1900000006","article-title":"Provenance in Databases: Why, How, and Where","volume":"1","author":"Cheney","year":"2009","journal-title":"Found. Trends Databases"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Euzenat, J., and Shvaiko, P. (2013). Ontology Matching, Springer. [2nd ed.].","DOI":"10.1007\/978-3-642-38721-0"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Christen, P. (2012). Data Matching: Concepts and Techniques for Record Linkage, Entity Resolution, and Duplicate Detection, Springer.","DOI":"10.1007\/978-3-642-31164-2"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3377455","article-title":"Blocking and Filtering Techniques for Entity Resolution: A Survey","volume":"53","author":"Papadakis","year":"2020","journal-title":"ACM Comput. Surv."},{"key":"ref_27","first-page":"316","article-title":"Why and Where: A Characterization of Data Provenance","volume":"Volume 1973","author":"Buneman","year":"2001","journal-title":"Proceedings of the 8th International Conference on Database Theory (ICDT)"},{"key":"ref_28","unstructured":"(2019). Date and Time\u2014Representations for Information Interchange\u2014Part 2: Extensions (Standard No. ISO 8601-2:2019). Confirmed 2024; Amendment 1:2025."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bellahsene, Z., Bonifati, A., and Rahm, E. (2011). Schema Matching and Mapping. Schema Matching and Mapping, Springer.","DOI":"10.1007\/978-3-642-16518-4"},{"key":"ref_30","unstructured":"Parciak, M., Vandevoort, B., Neven, F., Peeters, L.M., and Vansummeren, S. (2025, January 22\u201327). LLM-Matcher: A Name-Based Schema Matching Tool using Large Language Models. Proceedings of the Companion of the 2025 International Conference on Management of Data, Berlin, Germany."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"102837","DOI":"10.1016\/j.rcim.2024.102837","article-title":"Dual data mapping with fine-tuned large language models and asset administration shells toward interoperable knowledge representation","volume":"91","author":"Shi","year":"2025","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1145\/321796.321811","article-title":"The String-to-String Correction Problem","volume":"21","author":"Wagner","year":"1974","journal-title":"J. ACM"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13173-021-00119-5","article-title":"A Study on Machine Learning Techniques for the Schema Matching Network Problem","volume":"27","author":"Rodrigues","year":"2021","journal-title":"J. Braz. Comput. Soc."},{"key":"ref_34","unstructured":"Bernstein, P.A., Ioannidis, Y.E., Ramakrishnan, R., and Papadias, D. (2002). Chapter 52\u2014Translating Web Data. VLDB \u201902: Proceedings of the 28th International Conference on Very Large Databases, Hong Kong, China, 20\u201323 August 2002, Morgan Kaufmann."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"eabi8021","DOI":"10.1126\/sciadv.abi8021","article-title":"(Almost) All of Entity Resolution","volume":"8","author":"Binette","year":"2022","journal-title":"Sci. Adv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kemper, A., and Neumann, T. (2011, January 11\u201316). HyPer: A Hybrid OLTP&OLAP Main Memory Database System Based on Virtual Memory Snapshots. Proceedings of the 2011 IEEE 27th International Conference on Data Engineering (ICDE), Hannover, Germany.","DOI":"10.1109\/ICDE.2011.5767867"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1790","DOI":"10.14778\/2367502.2367518","article-title":"The Vertica Analytic Database: C-Store 7 Years Later","volume":"5","author":"Lamb","year":"2012","journal-title":"Proc. Vldb Endow."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3731","DOI":"10.14778\/3685800.3685802","article-title":"ClickHouse\u2014Lightning Fast Analytics for Everyone","volume":"17","author":"Schulze","year":"2024","journal-title":"Proc. VLDB Endow."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, J., Lin, C., Papakonstantinou, Y., and Swanson, S. (2017, January 14\u201319). An Experimental Study of Bitmap Compression vs. Inverted List Compression. Proceedings of the 2017 ACM International Conference on Management of Data, Chicago, IL, USA.","DOI":"10.1145\/3035918.3064007"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1002\/spe.2325","article-title":"Better bitmap performance with Roaring bitmaps","volume":"46","author":"Chambi","year":"2016","journal-title":"Softw. Pract. Exp."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e5523","DOI":"10.1002\/cpe.5523","article-title":"The Impact of Columnar File Formats on SQL-on-Hadoop Engine Performance: A Study on ORC and Parquet","volume":"32","author":"Ivanov","year":"2020","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Abadi, D., Madden, S., and Ferreira, M. (2006, January 27\u201329). Integrating Compression and Execution in Column-Oriented Database Systems. Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, Chicago, IL, USA.","DOI":"10.1145\/1142473.1142548"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Sikka, V., F\u00e4rber, F., Lehner, W., Cha, S.K., Peh, T., and Bornh\u00f6vd, C. (2012, January 20\u201324). Efficient transaction processing in SAP HANA database: The end of a column store myth. Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, Scottsdale, AZ, USA.","DOI":"10.1145\/2213836.2213946"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"DeCandia, G., Hastorun, D., Jampani, M., Kakulapati, G., Lakshman, A., Pilchin, A., Sivasubramanian, S., Vosshall, P., and Vogels, W. (2007, January 14\u201317). Dynamo: Amazon\u2019s highly available key-value store. Proceedings of the Twenty-First ACM SIGOPS Symposium on Operating Systems Principles, Stevenson, WA, USA.","DOI":"10.1145\/1294261.1294281"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s002360050048","article-title":"The Log-Structured Merge-Tree (LSM-Tree)","volume":"33","author":"Cheng","year":"1996","journal-title":"Acta Inform."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Idreos, S., and Callaghan, M. (2020, January 14\u201319). Key-Value Storage Engines. Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, Portland, OR, USA.","DOI":"10.1145\/3318464.3383133"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1905","DOI":"10.14778\/2733085.2733096","article-title":"AsterixDB: A scalable, open source BDMS","volume":"7","author":"Alsubaiee","year":"2014","journal-title":"Proc. VLDB Endow."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Carvalho, I., S\u00e1, F., and Bernardino, J. (2023). Performance Evaluation of NoSQL Document Databases: Couchbase, CouchDB, and MongoDB. Algorithms, 16.","DOI":"10.3390\/a16020078"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3604932","article-title":"Demystifying Graph Databases: Analysis and Taxonomy of Data Organization, System Designs, and Graph Queries","volume":"56","author":"Besta","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Francis, N., Green, A., Guagliardo, P., Libkin, L., Lindaaker, T., Marsault, V., Plantikow, S., Rydberg, M., Selmer, P., and Taylor, A. (2018, January 10\u201315). Cypher: An Evolving Query Language for Property Graphs. Proceedings of the 2018 International Conference on Management of Data, Houston, TX, USA.","DOI":"10.1145\/3183713.3190657"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1145\/1953122.1953148","article-title":"Dremel: Interactive analysis of web-scale datasets","volume":"54","author":"Melnik","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3725329","article-title":"Nested Parquet Is Flat, Why Not Use It? How To Scan Nested Data With On-the-Fly Key Generation and Joins","volume":"3","author":"Rey","year":"2025","journal-title":"Proc. ACM Manag. Data"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Ghemawat, S., Gobioff, H., and Leung, S. (2003, January 19\u201322). The Google File System. Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP), Bolton Landing, NY, USA.","DOI":"10.1145\/945449.945450"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3\u20137). The Hadoop Distributed File System. Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), Incline Village, NV, USA.","DOI":"10.1109\/MSST.2010.5496972"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Sethi, R., Traverso, M., Sundstrom, D., Phillips, D., Xie, W., Sun, Y., Yegitbasi, N., Jin, H., Hwang, E., and Shingte, N. (2019, January 8\u201311). Presto: SQL on Everything. Proceedings of the 2019 IEEE 35th International Conference on Data Engineering (ICDE), Macao, China.","DOI":"10.1109\/ICDE.2019.00196"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/jdwm.2009070101","article-title":"A Survey of Extract\u2013Transform\u2013Load Technology","volume":"5","author":"Vassiliadis","year":"2009","journal-title":"Int. J. Data Warehous. Min."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"100892","DOI":"10.1016\/j.softx.2021.100892","article-title":"BIcenter: A Collaborative Web ETL Solution Based on a Reflective Software Approach","volume":"16","author":"Almeida","year":"2021","journal-title":"SoftwareX"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1007\/s10619-015-7185-y","article-title":"Cloudmdsql: Querying heterogeneous cloud data stores with a common language","volume":"34","author":"Kolev","year":"2015","journal-title":"Distrib. Parallel Databases"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Behm, A., Palkar, S., Agarwal, U., Armstrong, T., Cashman, D., Dave, A., Greenstein, T., Hovsepian, S., Johnson, R., and Sai Krishnan, A. (2022, January 12\u201317). Photon: A Fast Query Engine for Lakehouse Systems. Proceedings of the 2022 International Conference on Management of Data, Philadelphia, PA, USA.","DOI":"10.1145\/3514221.3526054"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1089\/big.2013.0011","article-title":"Apache Drill: Interactive Ad-Hoc Analysis at Scale","volume":"1","author":"Hausenblas","year":"2013","journal-title":"Big Data"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"101931","DOI":"10.1016\/j.datak.2021.101931","article-title":"Modeling metadata in data lakes\u2014A generic model","volume":"134","author":"Eichler","year":"2021","journal-title":"Data Knowl. Eng."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1007\/s00778-017-0486-1","article-title":"A survey on provenance: What for? What form? What from?","volume":"26","author":"Herschel","year":"2017","journal-title":"Vldb J."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/s13222-023-00445-2","article-title":"Data Catalogs in the Enterprise: Applications and Integration","volume":"23","author":"Jahnke","year":"2023","journal-title":"Datenbank-Spektrum"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"D325","DOI":"10.1093\/nar\/gkaa1113","article-title":"The Gene Ontology resource: Enriching a GOld mine","volume":"49","author":"Consortium","year":"2020","journal-title":"Nucleic Acids Res."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1016\/j.cageo.2004.12.004","article-title":"Knowledge representation in the Semantic Web for Earth and Environmental Terminology (SWEET)","volume":"31","author":"Raskin","year":"2005","journal-title":"Comput. Geosci."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s00799-016-0198-y","article-title":"Extending, mapping, and focusing the CIDOC CRM","volume":"18","author":"Niccolucci","year":"2017","journal-title":"Int. J. Digit. Libr."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"012116","DOI":"10.1088\/1742-6596\/803\/1\/012116","article-title":"Application of the Financial Industry Business Ontology (FIBO) for development of a financial organization ontology","volume":"803","author":"Petrova","year":"2017","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1093\/jamia\/ocv189","article-title":"SMART on FHIR: A standards-based, interoperable apps platform for electronic health records","volume":"23","author":"Mandel","year":"2016","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/2629489","article-title":"Wikidata: A free collaborative knowledgebase","volume":"57","year":"2014","journal-title":"Commun. Acm"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.websem.2009.07.002","article-title":"DBpedia\u2014A crystallization point for the Web of Data","volume":"7","author":"Bizer","year":"2009","journal-title":"J. Web Semant."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.websem.2015.04.001","article-title":"The rationale of PROV","volume":"35","author":"Moreau","year":"2015","journal-title":"J. Web Semant."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Kim, B., Niu, S., Ding, B., Kraska, T., Luo, J., Luo, W., Tang, C., Wang, Z., Zhang, C., and Zhou, J. (2022, January 12\u201317). Learned Cardinality Estimation: An In-depth Study. Proceedings of the 2022 International Conference on Management of Data (SIGMOD), Philadelphia, PA, USA.","DOI":"10.1145\/3514221.3526154"},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Marcus, R., and Papaemmanouil, O. (2018, January 10). Deep Reinforcement Learning for Join Order Enumeration. Proceedings of the 1st International Workshop on Exploiting Artificial Intelligence Techniques for Data Management (aiDM@SIGMOD), Houston, TX, USA.","DOI":"10.1145\/3211954.3211957"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Marcus, R., Negi, P., Mao, H., Tatbul, N., Alizadeh, M., and Kraska, T. (2021, January 20\u201325). Bao: Making Learned Query Optimization Practical. Proceedings of the 2021 International Conference on Management of Data (SIGMOD), Xi\u2019an, China.","DOI":"10.1145\/3448016.3452838"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"968","DOI":"10.14778\/2336664.2336670","article-title":"DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views","volume":"5","author":"Ahmad","year":"2012","journal-title":"Proc. Vldb Endow."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"1601","DOI":"10.14778\/3587136.3587137","article-title":"DBSP: Automatic Incremental View Maintenance for Rich Query Languages","volume":"16","author":"Budiu","year":"2023","journal-title":"Proc. VLDB Endow."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"586","DOI":"10.14778\/2168651.2168659","article-title":"ReStore: Reusing Results of MapReduce Jobs","volume":"5","author":"Elghandour","year":"2012","journal-title":"Proc. Vldb Endow."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Armbrust, M., Das, T., Torres, J., Yavuz, B., Zhu, S., Xin, R., Ghodsi, A., Stoica, I., and Zaharia, M. (2018, January 10\u201315). Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark. Proceedings of the 2018 International Conference on Management of Data, Houston, TX, USA.","DOI":"10.1145\/3183713.3190664"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"3135","DOI":"10.14778\/3476311.3476389","article-title":"Watermarks in stream processing systems: Semantics and comparative analysis of Apache Flink and Google cloud dataflow","volume":"14","author":"Akidau","year":"2021","journal-title":"Proc. VLDB Endow."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1145\/1435417.1435432","article-title":"Eventually Consistent","volume":"52","author":"Vogels","year":"2009","journal-title":"Commun. ACM"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"1781","DOI":"10.14778\/3229863.3229867","article-title":"Automating Large-Scale Data Quality Verification","volume":"11","author":"Schelter","year":"2018","journal-title":"Proc. Vldb Endow."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/s42488-024-00132-1","article-title":"The evolution of data storage architectures: Examining the secure value of the data lakehouse","volume":"6","author":"Janssen","year":"2024","journal-title":"J. Data, Inf. Manag."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"160018","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR Guiding Principles for Scientific Data Management and Stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Sci. Data"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1038\/s41597-024-03171-w","article-title":"An open source knowledge graph ecosystem for the life sciences","volume":"11","author":"Callahan","year":"2024","journal-title":"Sci. Data"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1175\/JTECH-D-21-0106.1","article-title":"Using Cloud Computing to Analyze Model Output Archived in Zarr Format","volume":"39","author":"Gowan","year":"2022","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s00418-023-02209-1","article-title":"Ome-zarr: A cloud-optimized bioimaging file format with international community support","volume":"160","author":"Moore","year":"2023","journal-title":"Histochem. Cell Biol."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"104859","DOI":"10.1016\/j.cities.2024.104859","article-title":"Smart City Development: Data Sharing vs. Data Protection Legislations","volume":"148","author":"Joyce","year":"2024","journal-title":"Cities"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"030006","DOI":"10.1063\/5.0164724","article-title":"OpenRefine: An Approachable Tool for Cleaning and Harmonizing Bibliographical Data","volume":"2827","author":"Ahmi","year":"2023","journal-title":"AIP Conf. Proc."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.4054\/DemRes.2023.49.40","article-title":"Programmatic Access to Open Statistical Data for Population Studies: The SDMX Standard","volume":"49","author":"Willekens","year":"2023","journal-title":"Demogr. Res."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"2104","DOI":"10.14778\/3659437.3659461","article-title":"Chorus: Foundation Models for Unified Data Discovery and Exploration","volume":"17","author":"Kayali","year":"2024","journal-title":"Proc. Vldb Endow."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"100322","DOI":"10.1016\/j.patter.2021.100322","article-title":"The role of metadata in reproducible computational research","volume":"2","author":"Leipzig","year":"2021","journal-title":"Patterns"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Ahmad, T. (2022, January 2\u20136). Benchmarking Apache Arrow Flight - A wire-speed protocol for data transfer, querying and microservices. Proceedings of the Benchmarking in the Data Center: Expanding to the Cloud, Seoul, Republic of Korea.","DOI":"10.1145\/3527199.3527264"},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3483423","article-title":"PoWareMatch: A Quality-aware Deep Learning Approach to Improve Human Schema Matching","volume":"14","author":"Shraga","year":"2022","journal-title":"J. Data Inf. Qual."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1007\/978-3-030-82472-3_19","article-title":"SMAT: An Attention-Based Deep Learning Solution to the Automation of Schema Matching","volume":"Volume 12843","author":"Zhang","year":"2021","journal-title":"Advances in Databases and Information Systems (ADBIS 2021)"},{"key":"ref_95","first-page":"10","article-title":"Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data","volume":"679","author":"Union","year":"2016","journal-title":"Off. J. Eur. Union"},{"key":"#cr-split#-ref_96.1","unstructured":"European Union (2024). Regulation"},{"key":"#cr-split#-ref_96.2","unstructured":"(EU) 2024\/1689 of the European Parliament and of the Council of 13 June 2024 on harmonised rules on artificial intelligence. Off. J. Eur. Union, Available online: https:\/\/eur-lex.europa.eu\/eli\/reg\/2024\/1689\/oj\/eng."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10676-024-09746-w","article-title":"Policy advice and best practices on bias and fairness in ai","volume":"26","author":"Colmenarejo","year":"2024","journal-title":"Ethics Inf. Technol."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/11\/932\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T04:03:08Z","timestamp":1761796988000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/11\/932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,26]]},"references-count":98,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["info16110932"],"URL":"https:\/\/doi.org\/10.3390\/info16110932","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,26]]}}}