{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:27:28Z","timestamp":1777854448901,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2011,2,16]],"date-time":"2011-02-16T00:00:00Z","timestamp":1297814400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2011,4]]},"abstract":"<jats:p>Question answering systems (QA systems) stand as a new alternative for information retrieval systems. We conducted a study to evaluate the efficiency of QA systems as terminological sources for physicians, specialized translators and users in general. To this end we analysed the performance of two open-domain and two restricted-domain QA systems. The research entailed a collection of 150 definitional questions from WebMed. We studied the sources that QA systems used to retrieve the answers, and later applied a range of evaluation measures to mark the quality of answers. Through analysing the results obtained by asking the 150 questions in the QA systems MedQA, START, QuALiM and HONqa, it was possible to evaluate the systems\u2019 operation through applying specific metrics (MRR, FHS, TRR, Precision, Recall). Despite the limitations demonstrated by these systems, it has been confirmed that these four QA systems are valid and useful for obtaining definitional medical information in that they offer coherent and precise answers.<\/jats:p>","DOI":"10.1177\/0165551511398575","type":"journal-article","created":{"date-parts":[[2011,2,16]],"date-time":"2011-02-16T22:19:35Z","timestamp":1297894775000},"page":"152-162","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":13,"title":["Open- vs. Restricted-Domain QA Systems in the Biomedical Field"],"prefix":"10.1177","volume":"37","author":[{"given":"Mar\u00eda-Dolores","family":"Olvera-Lobo","sequence":"first","affiliation":[{"name":"CSIC, Unidad Asociada Grupo SCImago, Madrid, Spain and Universidad de                         Granada, Department of Library and Information Science, Granada,                         Spain"}]},{"given":"Juncal","family":"Guti\u00e9rrez-Artacho","sequence":"additional","affiliation":[{"name":"Universidad de Granada, Department of Translation and Interpretation,                         Granada, Spain,"}]}],"member":"179","published-online":{"date-parts":[[2011,2,16]]},"reference":[{"key":"atypb1","volume-title":"Modern Information Retrieval","author":"R. Baeza-Yates","year":"1999"},{"key":"atypb2","volume-title":"Information Storage and Retrieval","author":"R.R. Korfhage","year":"1997"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630210305"},{"key":"atypb4","volume-title":"Introduction to Modern Information Retrieval","author":"G. Salton","year":"1983"},{"key":"atypb5","volume-title":"Information Retrieval","author":"C.J. Rijsbergen","year":"1979","edition":"2"},{"key":"atypb6","volume-title":"Text Information Retrieval Systems","author":"C.T. Meadow","year":"1993"},{"key":"atypb7","volume-title":"Proceedings of the Second International Atlantic Web Intelligence Conference","author":"M. P\u00e9rez-Couti\u00f1o"},{"key":"atypb8","volume-title":"AQUAINT Pilot Knowledge-Based Evaluation: Annotation Guidelines","author":"D. Crouch","year":"2005"},{"key":"atypb9","first-page":"469","author":"M. Lee","year":"2006","journal-title":"AMIA 2006 Annual Symposium Proceedings"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2007.03.002"},{"key":"atypb11","volume-title":"Proceedings of the 8th Text REtrieval Conference","author":"E.M. Voorhees"},{"key":"atypb12","first-page":"336","author":"S.B. Blair-Goldensohn","year":"2003","journal-title":"Proceedings of TREC 2003"},{"key":"atypb13","volume":"42","author":"M.R. Kangavari","year":"2008","journal-title":"World Academy of Science, Engineering and Technology"},{"key":"atypb14","volume-title":"Question answering systems: a partial answer","author":"L.F. Costa","year":"2007"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1111\/j.1471-1842.2010.00896.x"},{"key":"atypb16","author":"H. Cui","year":"2004","journal-title":"SIGIR Workshop on Information retrieval for Question Answering"},{"key":"atypb17","volume-title":"Definitional question-answering using trainable text classifiers","author":"O. Tsur","year":"2003"},{"key":"atypb18","volume":"9","author":"G.O. Sing","year":"2005","journal-title":"Proceedings of World Academy of Science, Engineering and Technology"},{"key":"atypb19","volume-title":"Proceedings of the 10th Text Retrieval Conference (TREC-10)","author":"E. Alfonseca"},{"key":"atypb20","volume-title":"Proceedings of Medical Informatics Europe (MIE \u201803), Volume 95 of Studies in Health Technology and Informatics","author":"P. Jacquemart"},{"key":"atypb21","volume-title":"Proceedings Workshop on Natural Language Processing for Question Answering","author":"P. Zweigenbaum"},{"key":"atypb22","volume-title":"Using English for indexing and retrieving","author":"B. Katz","year":"1990"},{"key":"atypb23","volume-title":"Acquiring syntactic and semantic transformations in question answering","author":"M. Kaisser","year":"2009"},{"key":"atypb24","volume-title":"Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Demo Session","author":"M. Kaisser"},{"key":"atypb25","volume-title":"Automatic term and relation extraction for medical question answering system","author":"I. Fahmi.","year":"2009"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.321.7258.429"},{"key":"atypb27","author":"S. Cruchet","year":"2009","journal-title":"AMIA 2009 Annual Symposium"},{"key":"atypb28","first-page":"336","author":"S.B. Blair-Goldensohn","year":"2003","journal-title":"Proceedings of TREC 2003"},{"key":"atypb29","first-page":"328","volume":"12","author":"H. Yu","year":"2007","journal-title":"Pacific Symposium on Biocomputing"},{"key":"atypb30","volume-title":"Proceedings of the 7th International Workshop on Applications of Natural Language to Information Systems","author":"B. Katz"},{"key":"atypb31","unstructured":"J.R. Taylor, An Introduction to Error Analysis: The Study                     of Uncertainties in Physical Measurements, (University Science Books, 1999),                     128-129."},{"key":"atypb32","volume-title":"Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"T. Saracevic"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.07.007"},{"key":"atypb34","volume-title":"New Directions in Question Answering","author":"M.T. Maybury","year":"2004"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551511398575","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551511398575","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:07:57Z","timestamp":1777504077000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0165551511398575"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,2,16]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2011,4]]}},"alternative-id":["10.1177\/0165551511398575"],"URL":"https:\/\/doi.org\/10.1177\/0165551511398575","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,2,16]]}}}