{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T19:50:04Z","timestamp":1781812204553,"version":"3.54.5"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T00:00:00Z","timestamp":1670630400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T00:00:00Z","timestamp":1670630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["FJC2020-045809-I"],"award-info":[{"award-number":["FJC2020-045809-I"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["PID2020-117191RB-I00"],"award-info":[{"award-number":["PID2020-117191RB-I00"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The ability to cross data from multiple sources represents a competitive advantage for organizations. Yet, the governance of the data lifecycle, from the data sources into valuable insights, is largely performed in an ad-hoc or manual manner. This is specifically concerning in scenarios where tens or hundreds of continuously evolving data sources produce semi-structured data. To overcome this challenge, we develop a framework for operationalizing and automating data governance. For the first, we propose a zoned data lake architecture and a set of data governance processes that allow the systematic ingestion, transformation and integration of data from heterogeneous sources, in order to make them readily available for business users. For the second, we propose a set of metadata artifacts that allow the automatic execution of data governance processes, addressing a wide range of data management challenges. We showcase the usefulness of the proposed approach using a real world use case, stemming from the collaborative project with the World Health Organization for the management and analysis of data about Neglected Tropical Diseases. Overall, this work contributes on facilitating organizations the adoption of data-driven strategies into a cohesive framework operationalizing and automating data governance.<\/jats:p>","DOI":"10.1186\/s40537-022-00673-5","type":"journal-article","created":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T10:02:38Z","timestamp":1670666558000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Operationalizing and automating Data Governance"],"prefix":"10.1186","volume":"9","author":[{"given":"Sergi","family":"Nadal","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Petar","family":"Jovanovic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Besim","family":"Bilalli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oscar","family":"Romero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,12,10]]},"reference":[{"issue":"6","key":"673_CR1","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/MIC.2016.121","volume":"20","author":"I Horrocks","year":"2016","unstructured":"Horrocks I, Giese M, Kharlamov E, Waaler A. Using semantic technology to tame the data variety challenge. IEEE Internet Comput. 2016;20(6):62\u20136. https:\/\/doi.org\/10.1109\/MIC.2016.121.","journal-title":"IEEE Internet Comput"},{"issue":"2","key":"673_CR2","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1007\/s10796-016-9720-4","volume":"20","author":"A Popovic","year":"2018","unstructured":"Popovic A, Hackney R, Tassabehji R, Castelli M. The impact of big data analytics on firms\u2019 high value business performance. Inf Syst Front. 2018;20(2):209\u201322. https:\/\/doi.org\/10.1007\/s10796-016-9720-4.","journal-title":"Inf Syst Front"},{"key":"673_CR3","volume-title":"IT Governance: How Top Performers Manage IT Decision Rights for Superior Results","author":"P Weill","year":"2004","unstructured":"Weill P, Ross JW. IT Governance: How Top Performers Manage IT Decision Rights for Superior Results. New York: Harvard Business Press; 2004."},{"issue":"1","key":"673_CR4","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1145\/1629175.1629210","volume":"53","author":"V Khatri","year":"2010","unstructured":"Khatri V, Brown CV. Designing data governance. Commun ACM. 2010;53(1):148\u201352. https:\/\/doi.org\/10.1145\/1629175.1629210.","journal-title":"Commun ACM"},{"key":"673_CR5","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1016\/j.jss.2016.03.046","volume":"117","author":"S Garc\u00eda","year":"2016","unstructured":"Garc\u00eda S, Romero O, Ravent\u00f3s R. DSS from an RE perspective: a systematic mapping. J Syst Softw. 2016;117:488\u2013507. https:\/\/doi.org\/10.1016\/j.jss.2016.03.046.","journal-title":"J Syst Softw"},{"key":"673_CR6","unstructured":"Russom P. Data lakes: Purposes, practices, patterns, and platforms. TDWI white paper. 2017."},{"issue":"11","key":"673_CR7","doi-asserted-by":"publisher","first-page":"2033","DOI":"10.14778\/3407790.3407807","volume":"13","author":"D Petersohn","year":"2020","unstructured":"Petersohn D, Ma WW, Lee DJL, Macke S, Xin D, Mo X, Gonzalez J, Hellerstein JM, Joseph AD, Parameswaran AG. Towards scalable dataframe systems. Proc VLDB Endow. 2020;13(11):2033\u201346.","journal-title":"Proc VLDB Endow"},{"key":"673_CR8","unstructured":"Jagals M, Karger E. Inter-organizational data governance: a literature review. In: Rowe F, Amrani RE, Limayem M, Matook S, Rosenkranz C, Whitley EA, Quammah AE (eds.) 28th European Conference on Information Systems - Liberty, Equality, and Fraternity in a Digitizing World , ECIS 2020, Marrakech, Morocco, 2021;June 15-17, 2020. https:\/\/aisel.aisnet.org\/ecis2021_rp\/57."},{"issue":"2","key":"673_CR9","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1007\/s10796-019-09923-z","volume":"22","author":"OB Nielsen","year":"2020","unstructured":"Nielsen OB, Persson JS, Madsen S. Data governance as a collective action problem. Inf Syst Front. 2020;22(2):299\u2013313. https:\/\/doi.org\/10.1007\/s10796-019-09923-z.","journal-title":"Inf Syst Front"},{"key":"673_CR10","doi-asserted-by":"publisher","unstructured":"Prado R, Prado EPV, Grotta A, Barata AM. Benefits of the enterprise data governance in industry: A qualitative research. In: Filipe J, Smialek M, Brodsky A, Hammoudi S, (eds.) Proceedings of the 23rd International Conference on Enterprise Information Systems, ICEIS 2021, Online Streaming, 2021;April 26-28, 2021, Volume 2, pp. 699\u2013706. SCITEPRESS, ???. https:\/\/doi.org\/10.5220\/0010418606990706.","DOI":"10.5220\/0010418606990706"},{"key":"673_CR11","volume-title":"Database Systems - the Complete Book","author":"H Garcia-Molina","year":"2009","unstructured":"Garcia-Molina H, Ullman JD, Widom J. Database Systems - the Complete Book. New York: Pearson Education; 2009."},{"key":"673_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-63962-8_7-1","volume-title":"Encyclopedia of Big Data Technologies","author":"C Quix","year":"2019","unstructured":"Quix C, Hadfi R. Data lake. In: Sakr S, Zomaya AY, editors. Encyclopedia of Big Data Technologies. Berlin: Springer; 2019. https:\/\/doi.org\/10.1007\/978-3-319-63962-8_7-1."},{"key":"673_CR13","volume-title":"Big Data: Principles and Best Practices of Scalable Realtime Data Systems","author":"J Warren","year":"2015","unstructured":"Warren J, Marz N. Big Data: Principles and Best Practices of Scalable Realtime Data Systems. New York: Simon and Schuster; 2015."},{"key":"673_CR14","volume-title":"Data Lake Architecture: Designing the Data Lake and Avoiding the Garbage Dump","author":"B Inmon","year":"2016","unstructured":"Inmon B. Data Lake Architecture: Designing the Data Lake and Avoiding the Garbage Dump. New York: Technics publications; 2016."},{"key":"673_CR15","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/978-3-030-33223-5_7","volume-title":"Conceptual Modeling - 38th International Conference, ER 2019, Salvador, Brazil, November 4\u20137, 2019, Proceedings","author":"C Giebler","year":"2019","unstructured":"Giebler C, Gr\u00f6ger C, Hoos E, Schwarz H, Mitschang B. Modeling Data Lakes with Data Vault: Practical Experiences, Assessment, and Lessons Learned. In: Laender AHF, Pernici B, Lim E, de Oliveira JM, editors. Conceptual Modeling - 38th International Conference, ER 2019, Salvador, Brazil, November 4\u20137, 2019, Proceedings, vol. 11788. Lecture Notes in Computer Science. New York: Springer; 2019. p. 63\u201377."},{"key":"673_CR16","volume-title":"Architecting Data Lakes: Data Management Architectures for Advanced Business Use Cases","author":"B Sharma","year":"2018","unstructured":"Sharma B. Architecting Data Lakes: Data Management Architectures for Advanced Business Use Cases. Sebastopol: O\u2019Reilly Media; 2018."},{"key":"673_CR17","doi-asserted-by":"crossref","unstructured":"Sawadogo PN, Kibata T, Darmont J. Metadata management for textual documents in data lakes. In: Filipe J, Smialek M, Brodsky A, Hammoudi S (eds) Proceedings of the 21st International Conference on Enterprise Information Systems, ICEIS 2019, Heraklion, Crete, Greece, May 3-5, 2019, Volume 1, pp. 72\u201383. SciTePress,New York. 2019.","DOI":"10.5220\/0007706300720083"},{"key":"673_CR18","volume-title":"Building a Scalable Data Warehouse with Data Vault 2.0","author":"D Linstedt","year":"2015","unstructured":"Linstedt D, Olschimke M. Building a Scalable Data Warehouse with Data Vault 2.0. Bridlington: Morgan Kaufmann; 2015."},{"key":"673_CR19","unstructured":"Quix C, Hai R, Vatov I. GEMMS: A generic and extensible metadata management system for data lakes. In: Espa\u00f1a S, Ivanovic M, Savic M. (eds.) Proceedings of the CAiSE\u201916 Forum, at the 28th International Conference on Advanced Information Systems Engineering (CAiSE 2016), Ljubljana, Slovenia, June 13-17, 2016. CEUR Workshop Proceedings, vol. 1612, pp. 129\u2013136. CEUR-WS.org, 2016. http:\/\/ceur-ws.org\/Vol-1612\/paper17.pdf"},{"key":"673_CR20","doi-asserted-by":"publisher","unstructured":"Walker C, Alrehamy HH. Personal data lake with data gravity pull. In: Li K, Qi H, Gaudiot J, Kishigami J, Wu H, Li K, Wu Y (eds.) Fifth IEEE International Conference on Big Data and Cloud Computing, BDCloud 2015, Dalian, China, August 26-28, 2015, pp. 160\u2013167. IEEE Computer Society, 2015. https:\/\/doi.org\/10.1109\/BDCloud.2015.62.","DOI":"10.1109\/BDCloud.2015.62"},{"key":"673_CR21","doi-asserted-by":"publisher","unstructured":"Hai R, Geisler S, Quix C. Constance: An intelligent data lake system. In: \u00d6zcan F, Koutrika G, Madden S. (eds.) Proceedings of the 2016 International Conference on Management of Data, SIGMOD Conference 2016, San Francisco, CA, USA, June 26 - July 01, 2016, pp. 2097\u20132100. ACM, New York. 2016. https:\/\/doi.org\/10.1145\/2882903.2899389.","DOI":"10.1145\/2882903.2899389"},{"issue":"4","key":"673_CR22","doi-asserted-by":"publisher","first-page":"4303","DOI":"10.1007\/s12652-021-03171-3","volume":"12","author":"A Visvizi","year":"2021","unstructured":"Visvizi A, Lytras MD, Aljohani NR. Big data research for politics: human centric big data research for policy making, politics, governance and democracy. J Ambient Intell Humaniz Comput. 2021;12(4):4303\u20134. https:\/\/doi.org\/10.1007\/s12652-021-03171-3.","journal-title":"J Ambient Intell Humaniz Comput"},{"issue":"2","key":"673_CR23","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/3432247","volume":"21","author":"M Garriga","year":"2021","unstructured":"Garriga M, Aarns K, Tsigkanos C, Tamburri DA, van den Heuvel W. Dataops for cyber-physical systems governance: The airport passenger flow case. ACM Trans Internet Techn. 2021;21(2):36\u201313625. https:\/\/doi.org\/10.1145\/3432247.","journal-title":"ACM Trans Internet Techn."},{"issue":"3","key":"673_CR24","first-page":"5","volume":"39","author":"AY Halevy","year":"2016","unstructured":"Halevy AY, Korn F, Noy NF, Olston C, Polyzotis N, Roy S, Whang SE. Managing google\u2019s data lake: an overview of the goods system. IEEE Data Eng Bull. 2016;39(3):5\u201314.","journal-title":"IEEE Data Eng Bull"},{"key":"673_CR25","doi-asserted-by":"publisher","unstructured":"Theodorou V, Hai R, Quix C. A metadata framework for data lagoons. In: Welzer T, Eder J, Podgorelec V, Wrembel R, Ivanovic M, Gamper J, Morzy M, Tzouramanis T, Darmont, J., Latific, A.K. (eds.) New Trends in Databases and Information Systems, ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium, Bled, Slovenia, September 8-11, 2019, Proceedings. Communications in Computer and Information Science, vol. 1064, pp. 452\u2013462. Springer, Berlin; 2019. https:\/\/doi.org\/10.1007\/978-3-030-30278-8_44.","DOI":"10.1007\/978-3-030-30278-8_44"},{"key":"673_CR26","unstructured":"Stonebraker M, Bruckner D, Ilyas IF, Beskales G. Cherniack M, Zdonik SB, Pagan A, Xu S. Data curation at scale: The data tamer system. In: Sixth Biennial Conference on Innovative Data Systems Research, CIDR 2013, Asilomar, CA, USA, January 6-9, 2013, Online Proceedings. www.cidrdb.org, 2013. http:\/\/cidrdb.org\/cidr2013\/Papers\/CIDR13_Paper28.pdf"},{"key":"673_CR27","doi-asserted-by":"publisher","unstructured":"Rezig EK, Cao L, Stonebraker M, Simonini G, Tao W, Madden S, Ouzzani M, Tang N, Elmagarmid AK. Data civilizer 20: A holistic framework for data preparation and analytics. Proc VLDB Endow. 2019;12(12), 1954\u20131957. https:\/\/doi.org\/10.14778\/3352063.3352108","DOI":"10.14778\/3352063.3352108"},{"key":"673_CR28","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1186\/s40537-019-0237-9","volume":"6","author":"N Konstantinou","year":"2019","unstructured":"Konstantinou N, Abel E, Bellomarini L, Bogatu A, Civili C, Irfanie E, Koehler M, Mazilu L, Sallinger E, Fernandes AAA, Gottlob G, Keane JA, Paton NW. VADA: an architecture for end user informed data preparation. J Big Data. 2019;6:74. https:\/\/doi.org\/10.1186\/s40537-019-0237-9.","journal-title":"J Big Data"},{"key":"673_CR29","doi-asserted-by":"publisher","unstructured":"Bogatu A, Fernandes AAA, Paton NW, Konstantinou N. Dataset discovery in data lakes. In: 36th IEEE International Conference on Data Engineering, ICDE 2020, Dallas, TX, USA, April 20-24, 2020, pp. 709\u2013720. IEEE, 2020. https:\/\/doi.org\/10.1109\/ICDE48307.2020.00067.","DOI":"10.1109\/ICDE48307.2020.00067"},{"key":"673_CR30","doi-asserted-by":"publisher","unstructured":"Golshan B, Halevy AY, Mihaila GA, Tan W. Data integration: After the teenage years. In: Sallinger E, den Bussche JV, Geerts F (eds.) Proceedings of the 36th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems, PODS 2017, Chicago, IL, USA, May 14-19, 2017, pp. 101\u2013106. ACM, New York; 2017. https:\/\/doi.org\/10.1145\/3034786.3056124.","DOI":"10.1145\/3034786.3056124"},{"issue":"2","key":"673_CR31","first-page":"3","volume":"41","author":"M Stonebraker","year":"2018","unstructured":"Stonebraker M, Ilyas IF. Data integration: The current status and the way forward. IEEE Data Eng Bull. 2018;41(2):3\u20139.","journal-title":"IEEE Data Eng Bull"},{"key":"673_CR32","doi-asserted-by":"publisher","unstructured":"Tadesse S, G\u00f3mez C, Romero O, Hose, K, Rabbani K. ARDI: automatic generation of RDFS models from heterogeneous data sources. In: 23rd IEEE International Enterprise Distributed Object Computing Conference, EDOC 2019, Paris, France, 2019;October 28-31, 2019, pp. 190\u2013196. IEEE, New York. https:\/\/doi.org\/10.1109\/EDOC.2019.00031.","DOI":"10.1109\/EDOC.2019.00031"},{"issue":"4","key":"673_CR33","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1145\/505248.5060010","volume":"45","author":"L Pipino","year":"2002","unstructured":"Pipino L, Lee YW, Wang RY. Data quality assessment. Commun ACM. 2002;45(4):211\u20138. https:\/\/doi.org\/10.1145\/505248.5060010.","journal-title":"Commun ACM"},{"key":"673_CR34","doi-asserted-by":"publisher","unstructured":"Morton K, Balazinska M, Grossman D, Mackinlay JD. Support the data enthusiast: Challenges for next-generation data-analysis systems. Proc VLDB Endow. 2014; 7(6), 453\u2013456. https:\/\/doi.org\/10.14778\/2732279.2732282","DOI":"10.14778\/2732279.2732282"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-022-00673-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-022-00673-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-022-00673-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T10:05:57Z","timestamp":1670666757000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-022-00673-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,10]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["673"],"URL":"https:\/\/doi.org\/10.1186\/s40537-022-00673-5","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,10]]},"assertion":[{"value":"28 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 December 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"117"}}