{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,25]],"date-time":"2025-03-25T14:21:18Z","timestamp":1742912478680,"version":"3.40.3"},"publisher-location":"Cham","reference-count":23,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030986353"},{"type":"electronic","value":"9783030986360"}],"license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,9]],"date-time":"2022-09-09T00:00:00Z","timestamp":1662681600000},"content-version":"vor","delay-in-days":251,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The main goal of this chapter is to share the technical details and best practices for setting up a scalable Big Data platform that addresses the data challenges of the food industry. The amount of data that is generated in our food supply chain is rapidly increasing. The data is published by hundreds of organizations on a daily basis, in many different languages and formats making its aggregation, processing, and exchange a challenge. The efficient linking and mining of the global food data can enable the generation of insights and predictions that can help food safety experts to make critical decisions. All the food companies as well as national authorities and agencies may highly benefit from the data services of such a data platform. The chapter focuses on the architecture and software stack that was used to set up a data platform for a specific business use case. We describe how the platform was designed following data and technology standards to ensure the interoperability between systems and the interconnection of data. We share best practices on the deployment of data platforms such as identification of records, orchestrating pipelines, automating the aggregation workflow, and monitoring of a Big Data platform. The platform was developed in the context of the H2020 BigDataGrapes project, was awarded by communities such as Elasticsearch, and is further developed in H2020 The Food Safety Market project in order to enable the setup of a data space for the food safety sector.<\/jats:p>","DOI":"10.1007\/978-3-030-98636-0_11","type":"book-chapter","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T08:53:55Z","timestamp":1662627235000},"page":"227-248","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Deploying a Scalable Big Data Platform to Enable a Food Safety Data Space"],"prefix":"10.1007","author":[{"given":"Mihalis","family":"Papakonstantinou","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manos","family":"Karvounis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giannis","family":"Stoitsis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikos","family":"Manouselis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,9,9]]},"reference":[{"key":"11_CR1","volume-title":"Building the future of food safety technology: Blockchain and beyond","author":"S Sklare","year":"2020","unstructured":"Sklare, S., Kontogiannis, T., & Stoitsis, G. (2020). The case of chocolate: Lessons for food authenticity and big data. In  Building the future of food safety technology: Blockchain and beyond."},{"issue":"10","key":"11_CR2","doi-asserted-by":"publisher","first-page":"697","DOI":"10.2533\/chimia.2018.697","volume":"72","author":"C Cavin","year":"2018","unstructured":"Cavin, C., Cottenet, G., Cooper, K. M., & Zbinden, P. (2018). Meat vulnerabilities to economic food adulteration require new analytical solutions. Chimia, 72(10), 697\u2013703. https:\/\/doi.org\/10.2533\/chimia.2018.697","journal-title":"Chimia"},{"key":"11_CR3","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1038\/s41538-019-0036-x","volume":"3","author":"J Spink","year":"2019","unstructured":"Spink, J., Elliott, C., Dean, M., & Speier-Pero, C. (2019). Food fraud data collection needs survey. NPJ Science of Food, 3, 8. https:\/\/doi.org\/10.1038\/s41538-019-0036-x","journal-title":"NPJ Science of Food"},{"key":"11_CR4","unstructured":"RASFF \u2013 Rapid Alert System for Food and Feed. (1979). https:\/\/ec.europa.eu\/food\/safety\/rasff-en"},{"key":"11_CR5","unstructured":"HorizonScan. (2015). FERA. https:\/\/horizon-scan.fera.co.uk\/"},{"key":"11_CR6","unstructured":"gComply. (2015). Decernis. https:\/\/decernis.com\/solutions\/gcomply\/"},{"key":"11_CR7","unstructured":"DigiComply. (2017). SGS. https:\/\/www.digicomply.com\/"},{"key":"11_CR8","volume-title":"European big data value strategic research & innovation agenda","author":"S Zillner","year":"2017","unstructured":"Zillner, S., Curry, E., Metzger, A., Auer, S., & Seidl, R. (2017). European big data value strategic research & innovation agenda. Big Data Value Association."},{"key":"11_CR9","unstructured":"BDVA, CLAIRE, ELLIS, EurAI and euRobotics, Joint Strategic Research Innovation and Deployment Agenda (SRIDA) for the AI, Data and Robotics Partnership, September 2020."},{"key":"11_CR10","doi-asserted-by":"crossref","unstructured":"Jin, C., Bouzembrak, Y., Zhou, J., Liang, Q., van den Bulk, L. M., Gavai, A., Liu, N., van den Heuvel, L. J., Hoenderdaal, W., & Marvin, H. J. P. (2020). Big Data in food safety - A review. Current Opinion in Food Science, 36, 24\u201332. ISSN 2214-7993","DOI":"10.1016\/j.cofs.2020.11.006"},{"key":"11_CR11","volume-title":"Microservices for the enterprise - Apress, Berkeley","author":"K Indrasiri","year":"2018","unstructured":"Indrasiri, K., & Siriwardena, P. (2018). Microservices for the enterprise - Apress, Berkeley. Springer."},{"key":"11_CR12","unstructured":"EFSA. (2015). The food classification and description system FoodEx2 (revision 2). EFSA supporting publication EN-804. 90 p."},{"key":"11_CR13","unstructured":"FAO. (1994). Commodity categories. http:\/\/www.fao.org\/fao-who-codexalimentarius\/codex-texts\/dbs\/pestres\/commodities\/en\/"},{"key":"11_CR14","unstructured":"GS1. (2016). EPC Information Services (EPCIS) Standard. https:\/\/www.gs1.org\/sites\/default\/files\/docs\/epc\/EPCIS-Standard-1.2-r-2016-09-29.pdf"},{"key":"11_CR15","unstructured":"Polychronou, I., Stoitsis, G., Papakonstantinou, M., & Manouselis, N. (2022). Stress-testing big data platform to extract smart and interoperable food safety analytics. International Journal of Metadata Semantics and Ontologies."},{"issue":"1","key":"11_CR16","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1080\/00031305.2017.1380080","volume":"72","author":"SJ Taylor","year":"2018","unstructured":"Taylor, S. J., & Letham, B. (2018). Forecasting at scale. The American Statistician, 72(1), 37\u201345.","journal-title":"The American Statistician"},{"key":"11_CR17","unstructured":"U.S Food and Drug Administration. (2020). New era of smarter food safety, FDA\u2019s Blueprint for the Future."},{"key":"11_CR18","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1007\/s12525-019-00362-x","volume":"29","author":"B Otto","year":"2019","unstructured":"Otto, B., & Jarke, M. (2019). Designing a multi-sided data platform: Findings from the International Data Spaces case. Electron Markets, 29, 561\u2013580. https:\/\/doi.org\/10.1007\/s12525-019-00362-x","journal-title":"Electron Markets"},{"issue":"4","key":"11_CR19","doi-asserted-by":"publisher","first-page":"217","DOI":"10.5771\/0943-7444-2016-4-217","volume":"43","author":"PA Gaona-Garc\u00eda","year":"2016","unstructured":"Gaona-Garc\u00eda, P. A., Stoitsis, G., S\u00e1nchez-Alonso, S., & Biniari, K. (2016). An exploratory study of user perception in visual search interfaces based on SKOS. KO Knowledge Organization, 43(4), 217\u2013238.","journal-title":"KO Knowledge Organization"},{"key":"11_CR20","volume-title":"Functional requirements for bibliographic records: Final report","author":"K.G. Saur Verlag","year":"1998","unstructured":"K.G. Saur Verlag. (1998). Functional requirements for bibliographic records: Final report. KG Saur."},{"key":"11_CR21","volume-title":"Fraud in meat and poultry products, Food Fraud Book","author":"A Lianou","year":"2021","unstructured":"Lianou, A., Papakonstantinou, M., Nychas, G.-J. E., & Stoitsis, J. (2021). Fraud in meat and poultry products, Food Fraud Book. Academic Press."},{"key":"11_CR22","doi-asserted-by":"publisher","unstructured":"Polychronou, I., Katsivelis, P., Papakonstantinou, M., Stoitsis, G., & Manouselis, N. (2020) Machine learning algorithms for food intelligence: Towards a method for more accurate predictions. In: Athanasiadis I., Frysinger S., Schimak G., Knibbe W. (eds) Environmental software systems. Data science in action. ISESS 2020. IFIP Advances in Information and Communication Technology, vol. 554. Springer. doi:https:\/\/doi.org\/10.1007\/978-3-030-39815-6_16","DOI":"10.1007\/978-3-030-39815-6_16"},{"key":"11_CR23","unstructured":"The Food Safety Market: an SME-powered industrial data platform to boost the competitiveness of European food certification. (2020). https:\/\/foodsafetymarket.eu\/."}],"container-title":["Data Spaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-98636-0_11","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T09:18:38Z","timestamp":1662628718000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-98636-0_11"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"ISBN":["9783030986353","9783030986360"],"references-count":23,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-98636-0_11","relation":{},"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"9 September 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}