{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:48:50Z","timestamp":1767340130821,"version":"3.37.3"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"ICEIS 2022","award":["Best Student Paper (#26)"],"award-info":[{"award-number":["Best Student Paper (#26)"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SN COMPUT. SCI."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Companies often build their businesses based on product information and therefore try to automate the process of information extraction (IE). Since the information source is usually heterogeneous and non-standardized, classic extract, transform, load techniques reach their limits. Hence, companies must implement the newest findings from research to tackle the challenges of process automation. They require a flexible and robust system that is extendable and ensures the optimal processing of the different document types. This paper provides a distributed microservice architecture pattern that enables the automated generation of IE pipelines. Since their optimal design is individual for each input document, the system ensures the ad-hoc generation of pipelines depending on specific document characteristics at runtime. Furthermore, it introduces the automated quality determination of each available pipeline and controls the integration of new microservices based on their impact on the business value. The introduced system enables fast prototyping of the newest approaches from research and supports companies in automating their IE processes. Based on the automated quality determination, it ensures that the generated pipelines always meet defined business requirements when they come into productive use.<\/jats:p>","DOI":"10.1007\/s42979-023-02256-4","type":"journal-article","created":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T08:02:15Z","timestamp":1698480135000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Distributed Microservice Architecture Pattern for the Automated Generation of Information Extraction Pipelines"],"prefix":"10.1007","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0227-6951","authenticated-orcid":false,"given":"Michael","family":"Sildatke","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hendrik","family":"Karwanni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bodo","family":"Kraft","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Albert","family":"Z\u00fcndorf","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,10,28]]},"reference":[{"key":"2256_CR1","unstructured":"Cardie C. Empirical Methods in Information Extraction. AI Mag. 1997;18(4):5. https:\/\/doi.org\/10.1609\/aimag.v18i4.1322."},{"key":"2256_CR2","unstructured":"Hashmi KA, et\u00a0al. Current status and performance analysis of table recognition in document images with deep neural networks. http:\/\/arxiv.org\/abs\/2104.14272. arXiv:2104.14272 (2021)."},{"key":"2256_CR3","volume-title":"Software design for flexibility\u2014how to avoid programming yourself into a corner","author":"C Hanson","year":"2021","unstructured":"Hanson C, Sussman GJ. Software design for flexibility\u2014how to avoid programming yourself into a corner. Cambridge: MIT Press; 2021."},{"key":"2256_CR4","doi-asserted-by":"crossref","unstructured":"Jamshidi P, Pahl C, Mendon\u00e7a NC, Lewis J, Tilkov S. Microservices: the journey so far and challenges ahead. IEEE Softw. 2018;35(3):24\u201335.","DOI":"10.1109\/MS.2018.2141039"},{"key":"2256_CR5","volume-title":"Building microservices: designing fine-grained systems","author":"S Newman","year":"2015","unstructured":"Newman S. Building microservices: designing fine-grained systems. 1st ed. Sebastopol: O\u2019Reilly Media; 2015.","edition":"1"},{"key":"2256_CR6","volume-title":"Extreme programming\u2014die revolution\u00e4re Methode f\u00fcr Softwareentwicklung in kleinen Teams; [das Manifest]","author":"K Beck","year":"2003","unstructured":"Beck K. Extreme programming\u2014die revolution\u00e4re Methode f\u00fcr Softwareentwicklung in kleinen Teams; [das Manifest]. M\u00fcnchen: Pearson Deutschland GmbH; 2003."},{"key":"2256_CR7","volume-title":"Essential scrum\u2014a practical guide to the most popular agile process","author":"KS Rubin","year":"2012","unstructured":"Rubin KS. Essential scrum\u2014a practical guide to the most popular agile process. 01 ed. Boston: Addison-Wesley Professional; 2012.","edition":"01"},{"key":"2256_CR8","doi-asserted-by":"publisher","unstructured":"Sildatke M, Karwanni H, Kraft B, Z\u00fcndorf A. ARTIFACT: Architecture for Automated Generation of Distributed Information Extraction Pipelines. In Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS; ISBN 978-989-758-569-2; ISSN 2184-4992, SciTePress, pp. 17\u201328. https:\/\/doi.org\/10.5220\/0010987000003179.","DOI":"10.5220\/0010987000003179."},{"key":"2256_CR9","doi-asserted-by":"publisher","unstructured":"Sildatke M, Karwanni H, Kraft B, Z\u00fcdorf A. FUSION: Feature-based Processing of Heterogeneous Documents for Automated Information Extraction. In Proceedings of the 17th International Conference on Software Technologies - ICSOFT; ISBN 978-989-758-588-3; ISSN 2184-2833, SciTePress, pp. 250\u2013260. https:\/\/doi.org\/10.5220\/0011351100003266.","DOI":"10.5220\/0011351100003266."},{"key":"2256_CR10","unstructured":"ene\u2019t GmbH. Markdaten Endkundentarife Strom and Gas 2022. Retrieved from https:\/\/download.enet.eu\/uebersicht\/datenbanken. Accessed 30 Sept 2023."},{"key":"2256_CR11","doi-asserted-by":"crossref","unstructured":"Dragoni N, et\u00a0al. Microservices: yesterday, today, and tomorrow 2017. eprint http:\/\/arxiv.org\/abs\/1606.04036 [cs].","DOI":"10.1007\/978-3-319-67425-4_12"},{"key":"2256_CR12","unstructured":"Lewis J, Fowler M. Microservices. https:\/\/martinfowler.com\/articles\/microservices.html (2014). Accessed 30 Sept 2023."},{"key":"2256_CR13","doi-asserted-by":"crossref","unstructured":"Chowdhury SR, Salahuddin MA, Limam N, Boutaba R. Re-architecting NFV ecosystem with microservices: state of the art and research challenges 2019;33(3):168\u2013176. https:\/\/ieeexplore.ieee.org\/document\/8688711\/. https:\/\/doi.org\/10.1109\/MNET.2019.1800082. Accessed 30 Sept 2023.","DOI":"10.1109\/MNET.2019.1800082"},{"key":"2256_CR14","volume-title":"Enterprise integration patterns\u2014designing, building and deploying messaging solutions","author":"G Hohpe","year":"2003","unstructured":"Hohpe G. Enterprise integration patterns\u2014designing, building and deploying messaging solutions. Boston: Addison-Wesley Professional; 2003."},{"key":"2256_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-7211-4","volume-title":"Cloud native integration with apache camel\u2014building agile and scalable integrations for Kubernetes platforms","author":"G Camposo","year":"2021","unstructured":"Camposo G. Cloud native integration with apache camel\u2014building agile and scalable integrations for Kubernetes platforms. New York: Apress; 2021."},{"key":"2256_CR16","unstructured":"Fuld I, Partner J, Fisher M, Bogoevici M. Spring integration in action. New York: Simon and Schuster; 2012."},{"key":"2256_CR17","unstructured":"Richardson, C. (2019) Microservices patterns: With examples in Java. Shelter Island: Manning Publications."},{"key":"2256_CR18","doi-asserted-by":"crossref","unstructured":"Peltz C. Web services orchestration and choreography 2003;36(10):46\u201352. http:\/\/ieeexplore.ieee.org\/document\/1236471\/. https:\/\/doi.org\/10.1109\/MC.2003.1236471. Accessed 30 Sept 2023.","DOI":"10.1109\/MC.2003.1236471"},{"key":"2256_CR19","unstructured":"Fowler M. An appropriate use of metrics (2013). https:\/\/martinfowler.com\/articles\/useOfMetrics.html#WhatsWrongWithHowWeUseMetrics. Accessed 30 Sept 2023."},{"key":"2256_CR20","doi-asserted-by":"publisher","unstructured":"Schreiber M, Kraft B, Z\u00fcndorf A. Metrics driven research collaboration: focusing on common project goals continuously 41\u201347 (2017). https:\/\/doi.org\/10.1109\/SER-IP.2017..6.","DOI":"10.1109\/SER-IP.2017..6"},{"key":"2256_CR21","doi-asserted-by":"crossref","unstructured":"Oliver Schmidts, Bodo Kraft, Marc Schreiber, and Albert Z\u00fcndorf. 2018. Continuously evaluated research projects in collaborative decoupled environments. In Proceedings of the 5th International Workshop on Software Engineering Research and Industrial Practice (SER &IP \u201918). Association for Computing Machinery, New York, NY, USA, 2\u20139. https:\/\/doi.org\/10.1145\/3195546.3195549.","DOI":"10.1145\/3195546.3195549"},{"key":"2256_CR22","unstructured":"Kimball R, Caserta J. The data warehouse ETL toolkit: practical techniques for extracting, cleaning, conforming, and delivering data. Hoboken: Wiley; 2011."},{"key":"2256_CR23","doi-asserted-by":"crossref","unstructured":"Seidler K, Schil A. Service-oriented information extraction 25\u201331 (2011). http:\/\/portal.acm.org\/citation.cfm?doid=1966874.1966879. https:\/\/doi.org\/10.1145\/1966874.1966879. Accessed 30 Sept 2023.","DOI":"10.1145\/1966874.1966879"},{"key":"2256_CR24","doi-asserted-by":"crossref","unstructured":"Saggion H, Funk A, Maynard D, Bontcheva K. Ontology-based information extraction for business intelligence 843\u2013856 (2007).","DOI":"10.1007\/978-3-540-76298-0_61"},{"issue":"3","key":"2256_CR25","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1177\/0165551509360123","volume":"36","author":"DC Wimalasuriya","year":"2010","unstructured":"Wimalasuriya DC, Dou D. Ontology-based information extraction: an introduction and a survey of current approaches. J Inf Sci. 2010;36(3):306\u201323.","journal-title":"J Inf Sci"},{"key":"2256_CR26","doi-asserted-by":"crossref","unstructured":"Ivan\u010di\u0107, Lucija & Su\u0161a Vugec, Dalia & Vuksic, Vesna. (2019). Robotic Process Automation: Systematic Literature Review. https:\/\/doi.org\/10.1007\/978-3-030-30429-4_19.","DOI":"10.1007\/978-3-030-30429-4_19"},{"key":"2256_CR27","doi-asserted-by":"crossref","unstructured":"Aguirre, Santiago & Rodriguez, Alejandro. (2017). Automation of a Business Process Using Robotic Process Automation (RPA): A Case Study. 65\u201371. https:\/\/doi.org\/10.1007\/978-3-319-66963-2_7.","DOI":"10.1007\/978-3-319-66963-2_7"},{"issue":"1","key":"2256_CR28","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.1016\/j.eswa.2011.08.040","volume":"39","author":"S Jiang","year":"2012","unstructured":"Jiang S, Pang G, Wu M, Kuang L. An improved k-nearest-neighbor algorithm for text categorization. J Expert Syst Appl. 2012;39(1):1503\u20139.","journal-title":"J Expert Syst Appl"},{"key":"2256_CR29","doi-asserted-by":"crossref","unstructured":"Lilleberg, Joseph, Yun Zhu and Yanqing Zhang. \u201cSupport vector machines and Word2vec for text classification with semantic features.\u201d 2015 IEEE 14th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) (2015): 136\u2013140.","DOI":"10.1109\/ICCI-CC.2015.7259377"}],"container-title":["SN Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-023-02256-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42979-023-02256-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-023-02256-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T08:26:07Z","timestamp":1698481567000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42979-023-02256-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,28]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["2256"],"URL":"https:\/\/doi.org\/10.1007\/s42979-023-02256-4","relation":{},"ISSN":["2661-8907"],"issn-type":[{"type":"electronic","value":"2661-8907"}],"subject":[],"published":{"date-parts":[[2023,10,28]]},"assertion":[{"value":"1 November 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors declare no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical standards"}}],"article-number":"833"}}