{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:17:56Z","timestamp":1750220276791,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":12,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,2,11]]},"DOI":"10.1145\/3488560.3502196","type":"proceedings-article","created":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T21:42:57Z","timestamp":1644961377000},"page":"1561-1564","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Quality Assurance of a German COVID-19 Question Answering Systems using Component-based Microbenchmarking"],"prefix":"10.1145","author":[{"given":"Andreas","family":"Both","sequence":"first","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Paul","family":"Heinze","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Aleksandr","family":"Perevalov","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Johannes Richard","family":"Bartsch","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Rostislav","family":"Iudin","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Johannes Rudolf","family":"Herkner","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Tim","family":"Schrader","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Jonas","family":"Wunsch","sequence":"additional","affiliation":[{"name":"Anhalt University of Applied Sciences, K\u00f6then (Anhalt), Germany"}]},{"given":"Ren\u00e9","family":"G\u00fcrth","sequence":"additional","affiliation":[{"name":"Informationstechnikzentrum Bund (ITZBund), Bonn, Germany"}]},{"given":"Ann Kristin","family":"Falkenhain","sequence":"additional","affiliation":[{"name":"Federal Ministry of the Interior, Building and Community, Berlin, Germany"}]}],"member":"320","published-online":{"date-parts":[[2022,2,15]]},"reference":[{"volume-title":"European Semantic Web Conference. Springer, 625--641","author":"Both A.","key":"e_1_3_2_2_1_1","unstructured":"A. Both, D. Diefenbach, K. Singh, S. Shekarpour, D. Cherix, and C. Lange. 2016. Qanary--a methodology for vocabulary-driven open question answering systems. In European Semantic Web Conference. Springer, 625--641."},{"volume-title":"Joint Proceedings of the Semantics co-located events: Poster&Demo track and Workshop on Ontology-Driven Conceptual Modelling of Digital Twins co-located with SEMANTiCS 2021 (CEUR Workshop Proc.","author":"Both A.","key":"e_1_3_2_2_2_1","unstructured":"A. Both, A. Perevalov, J. R. Bartsch, P. Heinze, R. Iudin, J. R. Herkner, T. Schrader, J. Wunsch, A. K. Falkenhain, and R. G\u00fcrth. 2021. A Question Answering System for retrieving German COVID-19 data driven and quality-controlled by Semantic Technology. In Joint Proceedings of the Semantics co-located events: Poster&Demo track and Workshop on Ontology-Driven Conceptual Modelling of Digital Twins co-located with SEMANTiCS 2021 (CEUR Workshop Proc., Vol. 2774). CEUR-WS.org."},{"key":"e_1_3_2_2_3_1","volume-title":"OpenTapioca: Lightweight Entity Linking for Wikidata. CoRR","author":"Delpeuch A.","year":"2019","unstructured":"A. Delpeuch. 2019. OpenTapioca: Lightweight Entity Linking for Wikidata. CoRR , Vol. abs\/1904.09131 (2019). showeprint[arXiv]1904.09131 http:\/\/arxiv.org\/abs\/1904.09131"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-017--1100-y"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"crossref","unstructured":"D. Diefenbach K. Singh A. Both D. Cherix C. Lange and S. Auer. 2017. The Qanary Ecosystem: Getting New Insights by Composing Question Answering Pipelines. In Web Engineering - 17th International Conference ICWE (LNCS Vol. 10360). Springer.","DOI":"10.1007\/978-3-319-60131-1_10"},{"key":"e_1_3_2_2_6_1","volume-title":"International Semantic Web Conference (ISWC","author":"Dubey M.","year":"2019","unstructured":"M. Dubey, D. Banerjee, A. Abdelkawi, and J. Lehmann. 2019. LC-QuAD 2.0: A large dataset for complex question answering over Wikidata and DBpedia. In International Semantic Web Conference (ISWC 2019). Springer, 69--78."},{"key":"e_1_3_2_2_7_1","first-page":"2","article-title":"2011. The QALL-ME Framework: A specifiable-domain multilingual Question Answering architecture","volume":"9","author":"Spurk C.","year":"2011","unstructured":"\u00d3. Ferr\u00e1ndez, C. Spurk, M. Kouylekov, I. Dornescu, S. Ferr\u00e1ndez, M. Negri, R. Izquierdo, D. Tom\u00e1s, C. Orasan, G. Neumann, B. Magnini, and J. L. Vicedo. 2011. The QALL-ME Framework: A specifiable-domain multilingual Question Answering architecture. Journal of Web Semantics , Vol. 9, 2 (2011), 137 -- 145.","journal-title":"Journal of Web Semantics"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186023"},{"key":"e_1_3_2_2_9_1","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the ACL: Human Language Technologies","volume":"1","author":"Talmor A.","unstructured":"A. Talmor and J. Berant. 2018. The Web as a Knowledge-Base for Answering Complex Questions. In Proceedings of the 2018 Conference of the North American Chapter of the ACL: Human Language Technologies, Volume 1 (Long Papers). 641--651."},{"volume-title":"Joint proceedings of the SemDeep-4 and NLIWoD4 and 9th Question Answering over Linked Data challenge co-located with 17th International Semantic Web Conference (ISWC 2018)","author":"Usbeck R.","key":"e_1_3_2_2_10_1","unstructured":"R. Usbeck, R. H. Gusmita, A.-C. N. Ngomo, and M. Saleem. 2018. 9th Challenge on Question Answering over Linked Data (QALD-9). In Joint proceedings of the SemDeep-4 and NLIWoD4 and 9th Question Answering over Linked Data challenge co-located with 17th International Semantic Web Conference (ISWC 2018) ."},{"volume-title":"Proceedings of the 24th International Conference on World Wide Web (WWW '15)","author":"Usbeck R.","key":"e_1_3_2_2_11_1","unstructured":"R. Usbeck, M. R\u00f6der, A.-C. N. Ngomo, C. Baron, A. Both, M. Br\u00fcmmer, D. Ceccarelli, M. Cornolti, D. Cherix, B. Eickmann, P. Ferragina, C. Lemke, A. Moro, R. Navigli, F. Piccinno, G. Rizzo, H. Sack, R. Speck, R. Troncy, J. Waitelonis, and L. Wesemann. 2015. GERBIL: General Entity Annotator Benchmarking Framework. In Proceedings of the 24th International Conference on World Wide Web (WWW '15). 1133--1143."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-1403"}],"event":{"name":"WSDM '22: The Fifteenth ACM International Conference on Web Search and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Virtual Event AZ USA","acronym":"WSDM '22"},"container-title":["Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3488560.3502196","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3488560.3502196","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:12Z","timestamp":1750188672000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3488560.3502196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":12,"alternative-id":["10.1145\/3488560.3502196","10.1145\/3488560"],"URL":"https:\/\/doi.org\/10.1145\/3488560.3502196","relation":{},"subject":[],"published":{"date-parts":[[2022,2,11]]},"assertion":[{"value":"2022-02-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}