{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T06:13:16Z","timestamp":1775283196657,"version":"3.50.1"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2012,8,1]],"date-time":"2012-08-01T00:00:00Z","timestamp":1343779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["TIN2009-14715-C04-04"],"award-info":[{"award-number":["TIN2009-14715-C04-04"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2012,8]]},"abstract":"<jats:p>In this article, we present a factoid question-answering system, Sibyl, specifically tailored for question answering (QA) on spoken-word documents. This work explores, for the first time, which techniques can be robustly adapted from the usual QA on written documents to the more difficult spoken document scenario. More specifically, we study new information retrieval (IR) techniques designed or speech, and utilize several levels of linguistic information for the speech-based QA task. These include named-entity detection with phonetic information, syntactic parsing applied to speech transcripts, and the use of coreference resolution. Sibyl is largely based on supervised machine-learning techniques, with special focus on the answer extraction step, and makes little use of handcrafted knowledge. Consequently, it should be easily adaptable to other domains and languages. Sibyl and all its modules are extensively evaluated on the European Parliament Plenary Sessions English corpus, comparing manual with automatic transcripts obtained by three different automatic speech recognition (ASR) systems that exhibit significantly different word error rates. This data belongs to the CLEF 2009 track for QA on speech transcripts. The main results confirm that syntactic information is very useful for learning to rank question candidates, improving results on both manual and automatic transcripts, unless the ASR quality is very low. At the same time, our experiments on coreference resolution reveal that the state-of-the-art technology is not mature enough to be effectively exploited for QA with spoken documents. Overall, the performance of Sibyl is comparable or better than the state-of-the-art on this corpus, confirming the validity of our approach.<\/jats:p>","DOI":"10.1145\/2328967.2328972","type":"journal-article","created":{"date-parts":[[2012,9,11]],"date-time":"2012-09-11T22:21:06Z","timestamp":1347402066000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Sibyl, a factoid question-answering system for spoken documents"],"prefix":"10.1145","volume":"30","author":[{"given":"Pere R.","family":"Comas","sequence":"first","affiliation":[{"name":"TALP Research Center, Technical University of Catalonia, Barcelona, Spain"}]},{"given":"Jordi","family":"Turmo","sequence":"additional","affiliation":[{"name":"TALP Research Center, Technical University of Catalonia, Barcelona, Spain"}]},{"given":"Llu\u00eds","family":"M\u00e0rquez","sequence":"additional","affiliation":[{"name":"TALP Research Center, Technical University of Catalonia, Barcelona, Spain"}]}],"member":"320","published-online":{"date-parts":[[2012,9,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Aktolga E. Allan J. and Smith D. 2011. Passage reranking for question answering using syntactic structures and answer types. In Advances in Information Retrieval.   Aktolga E. Allan J. and Smith D. 2011. Passage reranking for question answering using syntactic structures and answer types. In Advances in Information Retrieval.","DOI":"10.1007\/978-3-642-20161-5_62"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Altschul S. Gish W. Miller W. Meyers E. W. and Lipman D. J. 1990. Basic local alignment search tool. J. Molecular Biol. 215.  Altschul S. Gish W. Miller W. Meyers E. W. and Lipman D. J. 1990. Basic local alignment search tool. J. Molecular Biol. 215.","DOI":"10.1016\/S0022-2836(05)80360-2"},{"key":"e_1_2_1_3_1","volume-title":"Working Notes for the CLEF'07 Workshop. Springer","author":"Alzghool M."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2008.05.008"},{"key":"e_1_2_1_5_1","article-title":"Bridging the lexical chasm: Statistical approaches to answer-finding. ACM","author":"Berger A.","year":"2000","journal-title":"Trans. Inf. Syst.."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the LREC'10 Conference.","author":"Bernard G."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the CLEF'09 Workshop. Springer","author":"Bernard G."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871498"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3115\/974147.974178"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the NLP-KE Conference.","author":"Brun C."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the III Jornadas PLN-TIMM.","author":"Buscaldi D."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the CLEF'08 Workshop.","author":"Comas P. R."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-87391-4_37"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the INTERSPEECH Conference.","author":"Comas P. R."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1162\/jmlr.2003.3.4-5.951"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076103"},{"key":"e_1_2_1_17_1","volume-title":"Overview of the TREC 2007 question answering track. In Proceedings of the 16th Text Retrieval Conference (TREC-16)","author":"Dang H. T."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3115\/1075096.1075099"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220637"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871840.1871849"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v31i3.2303"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/1735921.1735928"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 14th Text Retrieval Conference (TREC-14)","author":"Harabagiu S."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3115\/1072228.1072397"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Hartrumpf S. Glockner I. and Leveling J. 2009. Efficient question answering with question decomposition and multiple answer streams. In Evaluating Systems for Multilingual and Multimodal Information Access.   Hartrumpf S. Glockner I. and Leveling J. 2009. Efficient question answering with question decomposition and multiple answer streams. In Evaluating Systems for Multilingual and Multimodal Information Access.","DOI":"10.1007\/978-3-642-04447-2_49"},{"key":"e_1_2_1_26_1","volume-title":"CLEF 2009. Question answering experiments at Tokyo Institute of Technology. In Proceedings of the CLEF'09 Workshop. Springer","author":"Heie M. H."},{"key":"e_1_2_1_27_1","volume-title":"Phonetic comparison algorithms. Trans","author":"Kessler B."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the NAACL Conference.","author":"Kondrak G.","year":"2000"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the CLEF'08 Workshop.","author":"Kursten J."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324905003955"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the CoNLL 09 Shared Task Session.","author":"Lluis X."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the DARPA Broadcast News Workshop.","author":"Makhoul J."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the16th Text Retrieval Conference (TREC-16)","author":"Moldovan D."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jal.2005.12.005"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 8th Text Retrieval Conference (TREC-8).","author":"Moldovan D."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2007.33.1.41"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the CLEF'07 Workshop.","author":"Molla D.","year":"2007"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-010-9131-y"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2010.06.002"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the CLEF'07 Workshop.","author":"Neumann G."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the CoNLL Shared Task Session of EMNLP-CoNLL.","author":"Nivre J."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220175.1220288"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC.2009.78"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the CLEF'08 Workshop.","author":"Pardino M."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. (ICASSP '08)","author":"Paulik M."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the CLEF'07 Workshop.","author":"Pecina P.","year":"2007"},{"key":"e_1_2_1_49_1","volume-title":"Working Notes of the CLEF'10 Workshop.","author":"Penas A."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073092"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the CLEF 2009 Workshop","author":"Reyes-Barragan A."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the COLING Conference.","author":"Sapena E."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220175.1220287"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the EMNLP-CoNLL.","author":"Shen D."},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the INTERSPEECH Conference.","author":"Stenchikova S."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the INTERSPEECH Conference.","author":"Surdeanu M."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the INTERSPEECH Conference.","author":"Surdeanu M."},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the 13th Text Retrieval Conference (TREC-13)","author":"Tanev H."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119176.1119195"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the CLEF'07 Workshop.","author":"Turmo J."},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the CLEF'09 Workshop.","author":"Turmo J."},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the CLEF'08 Workshop.","author":"Turmo J."},{"key":"e_1_2_1_63_1","volume-title":"Eds.","volume":"32","author":"Vicedo J."},{"key":"e_1_2_1_64_1","volume-title":"Overview of the TREC 2004 question answering track. In Proceedings of the13th Text Retrieval Conference (TREC-13)","author":"Voorhees E. M.","year":"2004"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing. ACL.","author":"Wang R."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2328967.2328972","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2328967.2328972","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:01:10Z","timestamp":1750276870000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2328967.2328972"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,8]]},"references-count":63,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,8]]}},"alternative-id":["10.1145\/2328967.2328972"],"URL":"https:\/\/doi.org\/10.1145\/2328967.2328972","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,8]]},"assertion":[{"value":"2011-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-09-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}