{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T19:17:46Z","timestamp":1773861466513,"version":"3.50.1"},"publisher-location":"New York, New York, USA","reference-count":35,"publisher":"ACM Press","license":[{"start":{"date-parts":[[2018,1,1]],"date-time":"2018-01-01T00:00:00Z","timestamp":1514764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EU H2020 R&I programme for the Marie Skodowska-Curie action","award":["WDAqua (GA No 642795)"],"award-info":[{"award-number":["WDAqua (GA No 642795)"]}]},{"name":"EU H2020 R&I","award":["HOBBIT (GA688227)"],"award-info":[{"award-number":["HOBBIT (GA688227)"]}]},{"name":"Eurostars project","award":["QAMEL (E!9725)"],"award-info":[{"award-number":["QAMEL (E!9725)"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018]]},"DOI":"10.1145\/3178876.3186023","type":"proceedings-article","created":{"date-parts":[[2018,4,13]],"date-time":"2018-04-13T15:53:48Z","timestamp":1523634828000},"page":"1247-1256","source":"Crossref","is-referenced-by-count":55,"title":["Why Reinvent the Wheel"],"prefix":"10.1145","author":[{"given":"Kuldeep","family":"Singh","sequence":"first","affiliation":[{"name":"Fraunhofer IAIS & University of Bonn, Sankt Augustin, Germany"}]},{"given":"Christoph","family":"Lange","sequence":"additional","affiliation":[{"name":"University of Bonn & Fraunhofer IAIS, Bonn, Germany"}]},{"given":"Maria Esther","family":"Vidal","sequence":"additional","affiliation":[{"name":"Leibniz Information Centre for Science and Technology University Library & Fraunhofer IAIS, Hannover, Germany"}]},{"given":"Jens","family":"Lehmann","sequence":"additional","affiliation":[{"name":"Fraunhofer IAIS & University of Bonn, Sankt Augustin, Germany"}]},{"given":"S\u00f6ren","family":"Auer","sequence":"additional","affiliation":[{"name":"Leibniz Information Centre for Science and Technology University Library & University of Hannover, Hannover, Germany"}]},{"given":"Arun Sethupat","family":"Radhakrishna","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}]},{"given":"Andreas","family":"Both","sequence":"additional","affiliation":[{"name":"DATEV eG, Germany, Nuremberg, Germany"}]},{"given":"Saeedeh","family":"Shekarpour","sequence":"additional","affiliation":[{"name":"University of Dayton, Dayton, OH, USA"}]},{"given":"Ioanna","family":"Lytra","sequence":"additional","affiliation":[{"name":"University of Bonn & Fraunhofer IAIS, Bonn, Germany"}]},{"given":"Ricardo","family":"Usbeck","sequence":"additional","affiliation":[{"name":"University of Paderborn, Paderborn, Germany"}]},{"given":"Akhilesh","family":"Vyas","sequence":"additional","affiliation":[{"name":"Fraunhofer IAIS & University of Bonn, Sankt Augustin, Germany"}]},{"given":"Akmal","family":"Khikmatullaev","sequence":"additional","affiliation":[{"name":"Fraunhofer IAIS & University of Bonn, Sankt Augustin, Germany"}]},{"given":"Dharmen","family":"Punjani","sequence":"additional","affiliation":[{"name":"University of Athens, Athens, Greece"}]}],"member":"320","reference":[{"key":"key-10.1145\/3178876.3186023-1","doi-asserted-by":"crossref","unstructured":"Sören Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and Zachary G. Ives. 2007. DBpedia: A Nucleus for a Web of Open Data. In The Semantic Web, 6th International Semantic Web Conference, 2nd Asian Semantic Web Conference, ISWC 2007","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"key-10.1145\/3178876.3186023-2","doi-asserted-by":"crossref","unstructured":"ASWC 2007, Busan, Korea, November 11--15, 2007.","DOI":"10.1787\/fmt-v2007-art12-en"},{"key":"key-10.1145\/3178876.3186023-3","doi-asserted-by":"crossref","unstructured":"Rainer Berbner, Michael Spahn, Nicolas Repp, Oliver Heckmann, and Ralf Steinmetz. 2006. Heuristics for QoS-aware Web Service Composition. 2006 IEEE International Conference on Web Services (ICWS 2006), 18--22 September 2006, Chicago, Illinois, USA. 72--82. https:\/\/doi.org\/10.1109\/ICWS.2006.69","DOI":"10.1109\/ICWS.2006.69"},{"key":"key-10.1145\/3178876.3186023-4","doi-asserted-by":"crossref","unstructured":"Phil Blunsom, Krystle Kocik, and James R. Curran. 2006. Question classification with log-linear models. In SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6--11, 2006. ACM, 615--616.","DOI":"10.1145\/1148170.1148282"},{"key":"key-10.1145\/3178876.3186023-5","unstructured":"Andreas Both, Dennis Diefenbach, Kuldeep Singh, Saeedeh Shekarpour, Didier Cherix, and Christoph Lange. 2016. Qanary - A Methodology for Vocabulary-Driven Open Question Answering Systems The Semantic Web. Latest Advances and New Domains - 13th International Conference, ESWC 2016, Heraklion, Crete, Greece, May 29 - June 2, 2016, Proceedings. Springer, 625--641."},{"key":"key-10.1145\/3178876.3186023-6","unstructured":"Andreas Both, Axel-Cyrille Ngonga Ngomo, Ricardo Usbeck, Denis Lukovnikov, Christiane Lemke, and Maximilian Speicher. 2014. A service-oriented search framework for full text, geospatial and semantic search Proceedings of the 10th International Conference on Semantic Systems, SEMANTICS 2014, Leipzig, Germany, September 4--5, 2014. ACM, 65--72."},{"key":"key-10.1145\/3178876.3186023-7","unstructured":"Dennis Diefenbach, Kuldeep Singh, Andreas Both, Didier Cherix, Christoph Lange, and Sören Auer. 2017. The Qanary Ecosystem: Getting New Insights by Composing Question Answering Pipelines Web Engineering - 17th International Conference, ICWE 2017, Rome, Italy, June 5--8, 2017, Proceedings. Springer, 171--189."},{"key":"key-10.1145\/3178876.3186023-8","unstructured":"Milan Dojchinovski and Tomas Kliegr. 2013. Entityclassifier.eu: Real-time Classification of Entities in Text with Wikipedia Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECMLPKDD'13). Springer-Verlag, 654--658."},{"key":"key-10.1145\/3178876.3186023-9","doi-asserted-by":"crossref","unstructured":"Paolo Ferragina and Ugo Scaiella. 2010. TAGME: on-the-fly annotation of short text fragments (by wikipedia entities) Proceedings of the 19th ACM Conference on Information and Knowledge Management, CIKM 2010, Toronto, Ontario, Canada, October 26--30, 2010. 1625--1628. https:\/\/doi.org\/10.1145\/1871437.1871689","DOI":"10.1145\/1871437.1871689"},{"key":"key-10.1145\/3178876.3186023-10","doi-asserted-by":"crossref","unstructured":"Óscar Ferrández, Christian Spurk, Milen Kouylekov, Iustin Dornescu, Sergio Ferrández, Matteo Negri, Rubén Izquierdo, David Tomás, Constantin Orasan, Guenter Neumann, Bernardo Magnini, and José Luis Vicedo González. 2011. The QALL-ME Framework: A specifiable-domain multilingual Question Answering architecture. J. Web Sem., Vol. 9, 2 (2011), 137--145.","DOI":"10.1016\/j.websem.2011.01.002"},{"key":"key-10.1145\/3178876.3186023-11","doi-asserted-by":"crossref","unstructured":"Jenny Rose Finkel, Trond Grenager, and Christopher D. Manning. 2005. Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling. In ACL 2005, 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, 25--30 June 2005, University of Michigan, USA. The Association for Computer Linguistics, 363--370.","DOI":"10.3115\/1219840.1219885"},{"key":"key-10.1145\/3178876.3186023-12","unstructured":"Johannes Hoffart, Mohamed Amir Yosef, Ilaria Bordino, Hagen Fürstenau, Manfred Pinkal, Marc Spaniol, Bilyana Taneva, Stefan Thater, and Gerhard Weikum. 2011. Robust Disambiguation of Named Entities in Text. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, 27--31 July 2011, John McIntyre Conference Centre, Edinburgh, UK, A meeting of SIGDAT, a Special Interest Group of the ACL. 782--792. http:\/\/www.aclweb.org\/anthology\/D11--1072"},{"key":"key-10.1145\/3178876.3186023-13","doi-asserted-by":"crossref","unstructured":"Konrad Höffner, Sebastian Walter, Edgard Marx, Ricardo Usbeck, Jens Lehmann, and Axel-Cyrille Ngonga Ngomo. 2017. Survey on challenges of Question Answering in the Semantic Web. Semantic Web (2017).","DOI":"10.3233\/SW-160247"},{"key":"key-10.1145\/3178876.3186023-14","doi-asserted-by":"crossref","unstructured":"Zhiheng Huang, Marcus Thint, and Asli cCelikyilmaz. 2009. Investigation of Question Classifier in Question Answering Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, EMNLP 2009, 6--7 August 2009, Singapore, A meeting of SIGDAT, a Special Interest Group of the ACL.","DOI":"10.3115\/1699571.1699583"},{"key":"key-10.1145\/3178876.3186023-15","unstructured":"Zhiheng Huang, Marcus Thint, and Zengchang Qin. 2008. Question Classification using Head Words and their Hypernyms 2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Proceedings of the Conference, 25--27 October 2008, Honolulu, Hawaii, USA, A meeting of SIGDAT, a Special Interest Group of the ACL. ACL, 927--936."},{"key":"key-10.1145\/3178876.3186023-16","unstructured":"Jin-Dong Kim, Christina Unger, Axel-Cyrille Ngonga Ngomo, André Freitas, Young-gyun Hahm, Jiseong Kim, Sangha Nam, Gyu-Hyun Choi, Jeong-uk Kim, Ricardo Usbeck, et almbox.. 2017. OKBQA Framework for collaboration on developing natural language question answering systems. (2017). http:\/\/sigir2017.okbqa.org\/papers\/OKBQA2017_paper_9.pdf"},{"key":"key-10.1145\/3178876.3186023-17","doi-asserted-by":"crossref","unstructured":"Atanas Kiryakov, Borislav Popov, Ivan Terziev, Dimitar Manov, and Damyan Ognyanoff. 2004. Semantic annotation, indexing, and retrieval. J. Web Sem. (2004), 49--79. https:\/\/doi.org\/10.1016\/j.websem.2004.07.005","DOI":"10.1016\/j.websem.2004.07.005"},{"key":"key-10.1145\/3178876.3186023-18","doi-asserted-by":"crossref","unstructured":"Edgard Marx, Ricardo Usbeck, Axel-Cyrille Ngonga Ngomo, Konrad Höffner, Jens Lehmann, and Sören Auer. 2014. Towards an open question answering architecture. Proceedings of the 10th International Conference on Semantic Systems, SEMANTICS 2014, Leipzig, Germany, September 4--5, 2014. ACM, 57--60. https:\/\/doi.org\/10.1145\/2660517.2660519","DOI":"10.1145\/2660517.2660519"},{"key":"key-10.1145\/3178876.3186023-19","doi-asserted-by":"crossref","unstructured":"Pablo N. Mendes, Max Jakob, Andrés Garc'ıa-Silva, and Christian Bizer. 2011. DBpedia spotlight: shedding light on the web of documents Proceedings the 7th International Conference on Semantic Systems, I-SEMANTICS 2011, Graz, Austria, September 7--9, 2011. ACM, 1--8. https:\/\/doi.org\/10.1145\/2063518.2063519","DOI":"10.1145\/2063518.2063519"},{"key":"key-10.1145\/3178876.3186023-20","unstructured":"Andrea Moro, Alessandro Raganato, and Roberto Navigli. 2014. Entity Linking meets Word Sense Disambiguation: a Unified Approach. TACL Vol. 2 (2014), 231--244. https:\/\/tacl2013.cs.columbia.edu\/ojs\/index.php\/tacl\/article\/view\/291"},{"key":"key-10.1145\/3178876.3186023-21","unstructured":"Isaiah Onando Mulang, Kuldeep Singh, and Fabrizio Orlandi. 2017. Matching Natural Language Relations to Knowledge Graph Properties for Question Answering Semantics 2017."},{"key":"key-10.1145\/3178876.3186023-22","unstructured":"Jun-Ping Ng and Min-Yen Kan. 2015. QANUS: An Open-source Question-Answering Platform. CoRR Vol. abs\/1501.00311 (2015). http:\/\/arxiv.org\/abs\/1501.00311"},{"key":"key-10.1145\/3178876.3186023-23","unstructured":"Muhammad Saleem, Samaneh Nazari Dastjerdi, Ricardo Usbeck, and Axel-Cyrille Ngonga Ngomo. 2017. Question Answering Over Linked Data: What is Difficult to Answer? What Affects the F scores?. In Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data co-located with 16th International Semantic Web Conference (ISWC 2017), Vienna, Austria, October 21st - to - 22nd, 2017. CEUR-WS.org. http:\/\/ceur-ws.org\/Vol-1932\/paper-02.pdf"},{"key":"key-10.1145\/3178876.3186023-24","doi-asserted-by":"crossref","unstructured":"Saeedeh Shekarpour, Edgard Marx, Axel-Cyrille Ngonga Ngomo, and Sören Auer. 2015. SINA: Semantic interpretation of user queries for question answering on interlinked data. J. Web Sem. Vol. 30 (2015), 39--51. https:\/\/doi.org\/10.1016\/j.websem.2014.06.002","DOI":"10.1016\/j.websem.2014.06.002"},{"key":"key-10.1145\/3178876.3186023-25","doi-asserted-by":"crossref","unstructured":"Kuldeep Singh, Andreas Both, Dennis Diefenbach, and Saeedeh Shekarpour. 2016 a. Towards a Message-Driven Vocabulary for Promoting the Interoperability of Question Answering Systems. In Tenth IEEE International Conference on Semantic Computing, ICSC 2016, Laguna Hills, CA, USA, February 4--6, 2016. IEEE Computer Society, 386--389. https:\/\/doi.org\/10.1109\/ICSC.2016.59","DOI":"10.1109\/ICSC.2016.59"},{"key":"key-10.1145\/3178876.3186023-26","unstructured":"Kuldeep Singh, Andreas Both, Dennis Diefenbach, Saeedeh Shekarpour, Didier Cherix, and Christoph Lange. 2016 b. Qanary - The Fast Track to Creating a Question Answering System with Linked Data Technology The Semantic Web - ESWC 2016 Satellite Events, Heraklion, Crete, Greece, May 29 - June 2, 2016, Revised Selected Papers. 183--188. https:\/\/doi.org\/10.1007\/978--3--319--47602--5_36"},{"key":"key-10.1145\/3178876.3186023-27","unstructured":"Kuldeep Singh, Ioanna Lytra, Maria-Esther Vidal, Dharmen Punjani, Harsh Thakkar, Christoph Lange, and Sören Auer. 2017 a. QAestro - Semantic-Based Composition of Question Answering Pipelines Database and Expert Systems Applications - 28th International Conference, DEXA 2017, Lyon, France, August 28--31, 2017, Proceedings, Part I. Springer, 19--34. https:\/\/doi.org\/10.1007\/978--3--319--64468--4_2"},{"key":"key-10.1145\/3178876.3186023-28","doi-asserted-by":"crossref","unstructured":"Kuldeep Singh, Isaiah Onando Mulang, Ioanna Lytra, Mohamad Yaser Jaradeh, Ahmad Sakor, Maria-Esther Vidal, Christoph Lange, and Sören Auer. 2017 b. Capturing Knowledge in Semantically-typed Relational Patterns to Enhance Relation Linking Proceedings of the Knowledge Capture Conference, K-CAP 2017, Austin, TX, USA, December 4--6, 2017. 31:1--31:8. https:\/\/doi.org\/10.1145\/3148011.3148031","DOI":"10.1145\/3148011.3148031"},{"key":"key-10.1145\/3178876.3186023-29","unstructured":"Priyansh Trivedi, Gaurav Maheshwari, Mohnish Dubey, and Jens Lehmann. 2017. LC-QuAD: A Corpus for Complex Question Answering over Knowledge Graphs The Semantic Web - ISWC 2017 - 16th International Semantic Web Conference, Vienna, Austria, October 21--25, 2017, Proceedings, Part II. Springer, 210--218. https:\/\/doi.org\/10.1007\/978--3--319--68204--4_22"},{"key":"key-10.1145\/3178876.3186023-30","doi-asserted-by":"crossref","unstructured":"Christina Unger, Lorenz Bühmann, Jens Lehmann, Axel-Cyrille Ngonga Ngomo, Daniel Gerber, and Philipp Cimiano. 2012. Template-based question answering over RDF data. Proceedings of the 21st World Wide Web Conference 2012, WWW 2012, Lyon, France, April 16--20, 2012. ACM, 639--648. https:\/\/doi.org\/10.1145\/2187836.2187923","DOI":"10.1145\/2187836.2187923"},{"key":"key-10.1145\/3178876.3186023-31","unstructured":"Christina Unger, Corina Forascu, Vanessa López, Axel-Cyrille Ngonga Ngomo, Elena Cabrio, Philipp Cimiano, and Sebastian Walter. 2015. Question Answering over Linked Data (QALD-5). In Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum, Toulouse, France, September 8--11, 2015. CEUR-WS.org. http:\/\/ceur-ws.org\/Vol-1391\/173-CR.pdf"},{"key":"key-10.1145\/3178876.3186023-32","unstructured":"Ricardo Usbeck, Michael Hoffmann, Michael Röder, Jens Lehmann, and Axel-Cyrille Ngonga Ngomo. 2017. Using Multi-Label Classification for Improved Question Answering. CoRR (submitted) (2017). https:\/\/arxiv.org\/abs\/1710.08634"},{"key":"key-10.1145\/3178876.3186023-33","unstructured":"Ricardo Usbeck, Axel-Cyrille Ngonga Ngomo, Michael Röder, Daniel Gerber, Sandro Athaide Coelho, Sören Auer, and Andreas Both. 2014. AGDISTIS - Graph-Based Disambiguation of Named Entities Using Linked Data The Semantic Web - ISWC 2014. Springer, 457--471. https:\/\/doi.org\/10.1007\/978--3--319--11964--9_29"},{"key":"key-10.1145\/3178876.3186023-34","unstructured":"Ricardo Usbeck, Michael Röder, Michael Hoffmann, Felix Conrads, Jonathan Huthmann, Axel-Cyrille Ngonga Ngomo, Christian Demmler, and Christina Unger. [n. d.]. Benchmarking Question Answering Systems. Semantic Web Journal (to be published) ([n. d.]). http:\/\/www.semantic-web-journal.net\/content\/benchmarking-question-answering-systems"},{"key":"key-10.1145\/3178876.3186023-35","doi-asserted-by":"crossref","unstructured":"Zi Yang, Elmer Gardu no, Yan Fang, Avner Maiberg, Collin McCormack, and Eric Nyberg. 2013. Building optimal information systems automatically: configuration space exploration for biomedical information systems. In 22nd ACM International Conference on Information and Knowledge Management, CIKM'13, San Francisco, USA. ACM, 1421--1430.","DOI":"10.1145\/2505515.2505692"}],"event":{"name":"the 2018 World Wide Web Conference","location":"Lyon, France","acronym":"WWW '18","number":"2018","sponsor":["SIGWEB, ACM Special Interest Group on Hypertext, Hypermedia, and Web","IW3C2, International World Wide Web Conference Committee"],"start":{"date-parts":[[2018,4,23]]},"end":{"date-parts":[[2018,4,27]]}},"container-title":["Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3178876.3186023","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/dl.acm.org\/ft_gateway.cfm?id=3186023&ftid=1957391&dwn=1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:59Z","timestamp":1750213619000},"score":1,"resource":{"primary":{"URL":"http:\/\/dl.acm.org\/citation.cfm?doid=3178876.3186023"}},"subtitle":["Let's Build Question Answering Systems Together"],"proceedings-subject":"World Wide Web","short-title":[],"issued":{"date-parts":[[2018]]},"references-count":35,"URL":"https:\/\/doi.org\/10.1145\/3178876.3186023","relation":{},"subject":[],"published":{"date-parts":[[2018]]}}}