{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T14:10:02Z","timestamp":1761487802877},"reference-count":44,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2007,3,19]],"date-time":"2007-03-19T00:00:00Z","timestamp":1174262400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIEDAM"],"published-print":{"date-parts":[[2007,4]]},"abstract":"<jats:p>Question\u2013answering (QA) systems have proven to be helpful, especially to those who feel uncomfortable entering keywords, sometimes extended with search symbols such as +, *, and so forth. In developing such systems, the main focus has been on the enhanced retrieval performance of searches, and recent trends in QA systems center on the extraction of exact answers. However, when their usability was evaluated, some users indicated that they found it difficult to accept the answers because of the absence of supporting context and rationale. Current approaches to address this problem include providing answers with linking paragraphs or with summarizing extensions. Both methods are believed to be sufficient to answer questions seeking the names of objects or quantities that have only a single answer. However, neither method addresses the situation when an answer requires the comparison and integration of information appearing in multiple documents or in several places in a single document. This paper argues that coherent answer generation is crucial for such questions, and that the key to this coherence is to analyze texts to a level beyond sentence annotations. To demonstrate this idea, a prototype has been developed based on rhetorical structure theory, and a preliminary evaluation has been carried out. The evaluation indicates that users prefer to see the extended answers that can be generated using such semantic annotations, provided that additional context and rationale information are made available.<\/jats:p>","DOI":"10.1017\/s0890060407070205","type":"journal-article","created":{"date-parts":[[2007,3,19]],"date-time":"2007-03-19T03:47:12Z","timestamp":1174276032000},"page":"155-171","source":"Crossref","is-referenced-by-count":2,"title":["Answering engineers' questions using semantic annotations"],"prefix":"10.1017","volume":"21","author":[{"given":"SANGHEE","family":"KIM","sequence":"first","affiliation":[]},{"given":"ROB H.","family":"BRACEWELL","sequence":"additional","affiliation":[]},{"given":"KEN M.","family":"WALLACE","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2007,3,19]]},"reference":[{"key":"S0890060407070205_ref013","unstructured":"Diekema, A.R. , Yilmazel, O. , Chen, J. , Harwell, S. , He, L. , & Liddy, E.D. (2004).Finding answers to complex questions. InNew Directions in Question Answering( Maybury, M.T. , Ed.), pp.141\u2013152.Cambridge, MA:AAAI\u2013MIT Press."},{"key":"S0890060407070205_ref025","doi-asserted-by":"crossref","unstructured":"Liddy, E.D. (1998).Enhanced text retrieval using natural language processing.Bulletin of the American Society for Information Science andTechnology 24(4),14\u201316.","DOI":"10.1002\/bult.91"},{"key":"S0890060407070205_ref039","unstructured":"Salton, G. (1989).Advanced information-retrieval models. InAutomatic Text Processing( Salton, G. , Ed.),chap. 10.Reading, MA:Addison\u2013Wesley."},{"key":"S0890060407070205_ref029","unstructured":"Mann, W. & Thompson, S. (1988).Rhetorical structure theory: toward a functional theory of textorganization.Text 8(3),243\u2013281"},{"key":"S0890060407070205_ref036","doi-asserted-by":"crossref","unstructured":"O'Donnell, M. (2000).RSTTool 2.4\u2014a markup tool for rhetorical structuretheory.Proc. Int. Natural Language Generation Conf.(INLG'2000), pp.253\u2013256.","DOI":"10.3115\/1118253.1118290"},{"key":"S0890060407070205_ref022","doi-asserted-by":"crossref","unstructured":"Knott, A. & Dale, R. (1995).Using linguistic phenomena to motivate a set of coherencerelations.Discourse Processes 18(1),35\u201362.","DOI":"10.1080\/01638539409544883"},{"key":"S0890060407070205_ref030","unstructured":"Marcu, D. (1999).Discourse trees are good indicators of importance in text.InAdvances in Automatic Text Summarization( Mani, I. & Maybury, M. , Eds.).Cambridge, MA:MIT Press."},{"key":"S0890060407070205_ref026","unstructured":"Lin, J. , Quan, D. , Sinha, V. , Bakshi, K. , Huynh, D. , Katz, B. , & Karger, D.R. (2003).What makes a good answer? The role of context in questionanswering.Proc. IFIP TC13 Ninth Int. Conf. Human\u2013ComputerInteraction."},{"key":"S0890060407070205_ref027","unstructured":"Lopez, V. , Pasin, M. , & Motta, E. (2005).AquaLog: an ontology-portable question answering system for thesemantic Web.Proc. Second European Semantic Web Conf. (ESWC), pp.546\u2013562."},{"key":"S0890060407070205_ref005","unstructured":"Aunimo, L. & Kuuskoski, R. (2005).Question answering using semantic annotation.Proc. Cross Language Evaluation Forum (CLEF)."},{"key":"S0890060407070205_ref012","doi-asserted-by":"crossref","unstructured":"Burstein, J. , Marcu, D. , & Knight, K. (2003).Finding the WRITE stuff: automatic identification of discoursestructure in student essays.IEEE Intelligent Systems,18 (January\/February)32\u201339.","DOI":"10.1109\/MIS.2003.1179191"},{"key":"S0890060407070205_ref017","doi-asserted-by":"crossref","unstructured":"Hovy, E.H. (1993).Automated discourse generation using discourse structurerelations.Artificial Intelligence 63(1\u20132),341\u2013385.","DOI":"10.1016\/0004-3702(93)90021-3"},{"key":"S0890060407070205_ref024","doi-asserted-by":"crossref","unstructured":"Kwok, C. , Etzioni, O. , & Weld, D. S. (2001).Scaling question answering to the Web.Proc. 10th Int. Conf. World Wide Web, pp.150\u2013161,Hong Kong.","DOI":"10.1145\/371920.371973"},{"key":"S0890060407070205_ref002","doi-asserted-by":"crossref","unstructured":"Ahmed, S. (2005).Encouraging reuse of design knowledge: a method to indexknowledge.Design Studies Journal 26(6),565\u2013592.","DOI":"10.1016\/j.destud.2005.02.005"},{"key":"S0890060407070205_ref020","unstructured":"Kim, S. , Ahmed, S. , & Wallace, K.M. (2006a).Improving document accessibility through ontology-based informationsharing.Proc. Int. Symp. Series on Tools and Methods of CompetitiveEngineering, pp.923\u2013934."},{"key":"S0890060407070205_ref011","unstructured":"Burger, J. , Cardie, C. , Chaudhri, V. , Gaizauskas, R. , and et al .(2001).Issues, Tasks and Program Structures to Roadmap research in Question& Answering (QA).Washington, DC:NIST."},{"key":"S0890060407070205_ref007","unstructured":"Bosma, W. (2005).Extending answers using discourse structure.Proc. Workshop on Crossing Barriers in Text SummarizationResearch in RANLP, pp.2\u20139."},{"key":"S0890060407070205_ref034","doi-asserted-by":"crossref","unstructured":"Mukherjee, R. & Mao, J. (2004).Enterprise search tough stuff.ACM Queue 2(2),36\u201346.","DOI":"10.1145\/988392.988406"},{"key":"S0890060407070205_ref041","doi-asserted-by":"crossref","unstructured":"Taboada, M. & Mann, W. (2006).Rhetorical structure theory: looking back and moving ahead.Discourse Studies 8(3),423\u2013459.","DOI":"10.1177\/1461445606061881"},{"key":"S0890060407070205_ref006","unstructured":"Barzilay, R. , McKeown, K.R. , & Elhadad, M. (1999).Information fusion in the context of multi-documentsummarization.Proc. Annual Computational Language, pp.550\u2013557."},{"key":"S0890060407070205_ref021","unstructured":"Kim, S. , Bracewell, R.H. , Ahmed, S. , & Wallace, K.M. (2006b).Semantic annotation to support automatic taxonomyclassification.Proc. Int. Design Conf. (Design 2006), pp.1171\u20131178."},{"key":"S0890060407070205_ref015","unstructured":"Hai, D. & Kosseim, L. (2004).The problem of precision in restricted-domain question-answering:some proposed methods of improvement.Proc. Workshop on Question Answering in Restricted Domains inACL, pp.8\u201315,Barcelona."},{"key":"S0890060407070205_ref040","unstructured":"Sekine, S. & Grishman, R. (2001).A corpus-based probabilistic grammar with only twonon-terminals.Proc. Fourth Int. Workshop on Parsing Technologies,pp.216\u2013223."},{"key":"S0890060407070205_ref016","unstructured":"Hickl, A. , Lehmann, J. , Williams, J. , & Harabagiu, S. (2004).Experiments with interactive question answering in complexscenarios.Proc. North American Chapter of the Association forComputational Linguistics Annual Meeting (HLT-NAACL)."},{"key":"S0890060407070205_ref001","unstructured":"80-20 Software .(2003).80-20 Retriever Enterprise Edition. Accessed at http:\/\/www.80-20.com\/brochures\/Personal_Email_Search_Solution.pdf"},{"key":"S0890060407070205_ref008","unstructured":"Bracewell, R.H. & Wallace, K.M. (2003).A tool for capturing design rationale.Proc. 14th Int. Conf. Engineering Design, pp.185\u2013186,Stockholm."},{"key":"S0890060407070205_ref009","doi-asserted-by":"crossref","unstructured":"Bracewell, R.H. , Ahmed, S. , & Wallace, K.M. (2004).DRed and design folders: a way of capturing, storing and passing onknowledge generated during design projects.Proc. ASME Design Automation Conf.","DOI":"10.1115\/DETC2004-57165"},{"key":"S0890060407070205_ref035","unstructured":"Nyberg, E. , Mitamura, T. , Frederking, R. , Pedro, V. , Bilotti, M. , Schlaikjer, A. , & Hannan, K. (2005).Extending the JAVELIN QA system with domain semantics.Proc. Workshop on Question Answering in Restricted Domains atAAAI."},{"key":"S0890060407070205_ref010","unstructured":"Brill, E. , Lin, J. , Banko, M. , Dumais, S.T. , & Ng, A.Y. (2001).Data-intensive question answering.Proc. Tenth Text Retrieval Conf. (TREC 2001), pp.183\u2013189."},{"key":"S0890060407070205_ref042","unstructured":"Teufel, S. (2001).Task-based evaluation of summary quality: describing relationshipsbetween scientific papers.Proc. Int. Workshop on Automatic Summarization atNAACL."},{"key":"S0890060407070205_ref014","unstructured":"Franz, M. & Roukos, S. (1994).TREC-6 ad-hoc retrieval.Proc. Sixth Text Retrieval Conf. (TREC-6), pp.511\u2013516."},{"key":"S0890060407070205_ref033","doi-asserted-by":"crossref","unstructured":"Miller, G.A. , Beckwith, R.W. , Fellbaum, C. , Gross, D. , & Miller, K. (1993).Introduction to wordnet: an on-line lexical database.International Journal of Lexicography 3(4),235\u2013312.","DOI":"10.1093\/ijl\/3.4.235"},{"key":"S0890060407070205_ref043","unstructured":"Voorhess, E.M. (2002).Overview of the TREC 2002 question answering track.Proc. Text Retrieval Conf. (TREC)."},{"key":"S0890060407070205_ref038","unstructured":"Robertson, S.E. , Walker, S. , Jones, S. , & Hancock-Beaulieu, M.G. (1995).Okapi at TREC-3.Proc. Third Text Retreval Conf. (TREC-3), pp.550\u2013225."},{"key":"S0890060407070205_ref004","unstructured":"Allen, J. (1987).Natural Language Understanding.London:Benjamin\/Cummings."},{"key":"S0890060407070205_ref018","unstructured":"Jing, H. & McKeown, K.R. (2000).Cut and paste based text summarization.Proc. 1st Meeting of the North American Chapter of theAssociation for Computational Linguistics (HLT-NAACL), pp.178\u2013185."},{"key":"S0890060407070205_ref037","unstructured":"Resnik, P. (1995).Using information content to evaluate semantic similarity intaxonomy.Proc. 14th Int. Joint Conf. Artificial Intelligence,pp.448\u2013453."},{"key":"S0890060407070205_ref028","unstructured":"Mani, I. & Maybury, M. (1999).Advances in Automatic Text Summarisation.Cambridge, MA:MIT Press."},{"key":"S0890060407070205_ref003","doi-asserted-by":"crossref","unstructured":"Ahmed, S. , Kim, S. , & Wallace, K.M. (2005).A methodology for creating ontologies for engineering design.Proc. ASME 2005 Int. Design Engineering Technical Conf.Computers and Information in Engineering,Paper No. DETC 2005-84729.","DOI":"10.1115\/DETC2005-84729"},{"key":"S0890060407070205_ref019","unstructured":"Kim, S. , Bracewell, R.H. , & Wallace, K.M. (2004).From discourse analysis to answering design questions.Proc. Int. Workshop on the Application of Language and SemanticTechnologies to Support Knowledge Management Processes, pp.43\u201349."},{"key":"S0890060407070205_ref031","unstructured":"Marcu, D. & Echihabi, A. (2002).An unsupervised approach to recognising discourse relations.Proc. 40th Annual Meeting of the Association for ComputationalLinguistics, pp.368\u2013375."},{"key":"S0890060407070205_ref044","unstructured":"Williams, S. & Reiter, E. (2003).A corpus analysis of discourse relations for natural languagegeneration.Proc. Corpus Linguistics, pp.899\u2013908."},{"key":"S0890060407070205_ref023","unstructured":"Kunz, W. & Rittel, H.W.J. (1970).Issues as Elements of Information Systems, pp.55\u2013169,Working Paper 131,Center for Planning and Development Research,Berkeley, CA."},{"key":"S0890060407070205_ref032","unstructured":"Marcus, M.P. , Santorini, B. , & Marcinkiewicz, M.A. (1993).Building a large annotated corpus of English: The PennTreebank.Computational Linguistics 19(2),313\u2013330."}],"container-title":["Artificial Intelligence for Engineering Design, Analysis and Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0890060407070205","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,4,26]],"date-time":"2019-04-26T12:21:23Z","timestamp":1556281283000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0890060407070205\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,3,19]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2007,4]]}},"alternative-id":["S0890060407070205"],"URL":"https:\/\/doi.org\/10.1017\/s0890060407070205","relation":{},"ISSN":["0890-0604","1469-1760"],"issn-type":[{"value":"0890-0604","type":"print"},{"value":"1469-1760","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,3,19]]}}}