{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T23:35:29Z","timestamp":1775000129418,"version":"3.50.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2016,1,4]],"date-time":"2016-01-04T00:00:00Z","timestamp":1451865600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"funder":[{"name":"Arab Open University"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Speech Technol"],"published-print":{"date-parts":[[2016,6]]},"DOI":"10.1007\/s10772-015-9330-4","type":"journal-article","created":{"date-parts":[[2016,1,4]],"date-time":"2016-01-04T14:49:57Z","timestamp":1451918997000},"page":"373-383","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Usefulness, localizability, humanness, and language-benefit: additional evaluation criteria for natural language dialogue systems"],"prefix":"10.1007","volume":"19","author":[{"given":"Bayan","family":"AbuShawar","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Atwell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2016,1,4]]},"reference":[{"key":"9330_CR1","unstructured":"Abu Shawar, B. (2008). Chatbots are natural web interface to information portals. In Proceedings of INFOS2008, (pp. NLP101\u2013NLP107)."},{"issue":"1","key":"9330_CR2","first-page":"37","volume":"6","author":"B Abu Shawar","year":"2011","unstructured":"Abu Shawar, B. (2011). A chatbot as a natural web Interface to Arabic web QA. International Journal of Emerging Technologies in Education (iJET), 6(1), 37\u201343.","journal-title":"International Journal of Emerging Technologies in Education (iJET)"},{"key":"9330_CR3","unstructured":"Abu Shawar, B., & Atwell, E. (2010). Chatbots: Can they serve as natural language interfaces to QA corpus? In Proceedings of the sixth IASTED international conference advances in computer science and engineering (ACSE 2010), (pp. 183\u2013188)."},{"key":"9330_CR4","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/0167-6393(95)00028-M","volume":"17","author":"H Aust","year":"1995","unstructured":"Aust, H., Oerder, M., Seide, F., & Steinbiss, V. (1995). The Philips Automatic Train Timetable Information System. Speech Communication, 17, 249\u2013262.","journal-title":"Speech Communication"},{"key":"9330_CR5","unstructured":"Chai, J., Horvath, V., Nicolov, N., Stys-Budzikowska, M., Kambhatla, N., & Zadrozny, W. (2001b). Natural language sales assistant\u2014A web-based dialog system for online sales. In Proceedings of the thirteenth innovative applications of artificial intelligence conference, (pp. 19\u201326). The AAAI Press."},{"issue":"3\/4","key":"9330_CR6","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1023\/A:1011316909641","volume":"4","author":"J Chai","year":"2001","unstructured":"Chai, J., Lin, J., Zadrozny, W., Ye, Y., Stys-Budzikowska, M., Horvath, V., et al. (2001a). The role of a natural language conversational interface in online sales: a case study. International Journal of Speech Technology, 4(3\/4), 285\u2013295.","journal-title":"International Journal of Speech Technology"},{"key":"9330_CR7","first-page":"251","volume-title":"Computer Models of Thought and Language","author":"K Colby","year":"1973","unstructured":"Colby, K. (1973). Simulation of belief systems. In R. Schank & K. Colby (Eds.), Computer Models of Thought and Language (pp. 251\u2013286). San Francisco: Freeman."},{"key":"9330_CR8","volume-title":"Artificial Paranoia: A Computer Simulation of Paranoid Processes","author":"K Colby","year":"1975","unstructured":"Colby, K. (1975). Artificial Paranoia: A Computer Simulation of Paranoid Processes. New York, NY: Pergamon Press."},{"key":"9330_CR9","unstructured":"Crockett, K., Bandar, Z., O\u2019Shea, J. & Mclean, D. (2009). Bullying and debt: Developing novel applications of dialogue systems. In A. J\u00f6nsson, J. Alexandersson, D. Traum and I. Zukerman (Eds.), Proceedings of the 6th IJCAI Workshop on knowledge and reasoning in practical dialogue systems, Palo Alto, CA: AAAI ( www.aaai.org )."},{"issue":"1","key":"9330_CR10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S1351324999002144","volume":"5","author":"H Cunningham","year":"1999","unstructured":"Cunningham, H. (1999). A definition and short history of language engineering. Journal of Natural Language Engineering, 5(1), 1\u201316.","journal-title":"Journal of Natural Language Engineering"},{"key":"9330_CR11","doi-asserted-by":"crossref","unstructured":"Dahlbaeck, N., Jonsson, A., & Ahrenberg, A. (1993). In Wizard of Oz studies: Why and how? Proceedings of intelligent user interfaces (IUI 93) (pp. 193\u2013200). New York, NY: ACM Press.","DOI":"10.1145\/169891.169968"},{"issue":"1\u20132","key":"9330_CR12","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.specom.2004.02.001","volume":"43","author":"L Dybkjaer","year":"2004","unstructured":"Dybkjaer, L., Bernsen, N. O., & Minker, W. (2004). Evaluation and usability of multimodal spoken language dialogue systems. Speech Communication, 43(1\u20132), 33\u201354.","journal-title":"Speech Communication"},{"key":"9330_CR13","unstructured":"Elliott D., Atwell E., & Hartley A. (2004). Compiling and using a shareable parallel corpus for MT evaluation. In Proceedings of the workshop on the amazing utility of parallel and comparable corpora, fourth international conference on language resources and evaluation (LREC), Lisbon, Portugal, (pp. 18\u201321)."},{"key":"9330_CR14","unstructured":"Gandhe, S. & Traum, D. (2007). First steps towards dialogue modeling from an un-annotated human-human corpus. In Proceedings of the 5th workshop on knowledge and reasoning in practical dialogue systems, Hyderabad, India, (pp. 22\u201327)."},{"key":"9330_CR16","doi-asserted-by":"crossref","unstructured":"Glass, J., Polifroni, J., Seneff, S., & Zue, V. (2000). Data collection and performance evaluation of spoken dialogue systems: The MIT experience. In Proceedings international conference on spoken language processing, Beijing, China, October 2000","DOI":"10.21437\/ICSLP.2000-737"},{"issue":"2","key":"9330_CR17","first-page":"1","volume":"4","author":"G G\u00fczeldere","year":"1995","unstructured":"G\u00fczeldere, G., & Franchi, S. (1995). Dialogue with colourful \u201cpersonalities\u201d of early AI. Stanford Electronic Humanities Review, 4(2), 1\u20139.","journal-title":"Stanford Electronic Humanities Review"},{"key":"9330_CR18","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/978-1-4757-5687-6_10","volume-title":"Machine Conversations","author":"K Hasida","year":"1999","unstructured":"Hasida, K., & Den, Y. (1999). A synthetic evaluation of dialogue systems. In Y. Wilks (Ed.), Machine Conversations (pp. 113\u2013126). Boston: Kluwer."},{"key":"9330_CR19","first-page":"217","volume-title":"Voice Communication between Humans and Machines","author":"L Hirschman","year":"1995","unstructured":"Hirschman, L. (1995). The roles of language processing in a spoken language interface. In D. Roe & J. Wilpon (Eds.), Voice Communication between Humans and Machines (pp. 217\u2013237). Washington, DC: National Academy Press."},{"key":"9330_CR20","first-page":"475","volume-title":"State of the Art in Natural Language Processing","author":"L Hirschman","year":"1997","unstructured":"Hirschman, L., & Thompson, H. (1997). Overview of evaluation in speech and natural language processing. In R. A. Cole, J. Mariani, H. Uzkoreit, A. Zaanen, & V. Zue (Eds.), State of the Art in Natural Language Processing (pp. 475\u2013518). Cambridge: Cambridge University Press."},{"key":"9330_CR21","first-page":"535","volume-title":"Proceedings of ECAI\u201994: 11th European Conference on Artificial Intelligence","author":"J Hughes","year":"1994","unstructured":"Hughes, J., & Atwell, E. (1994). The automated evaluation of inferred word classifications. In A. G. Cohn (Ed.), Proceedings of ECAI\u201994: 11th European Conference on Artificial Intelligence (pp. 535\u2013540). Chichester: John Wiley."},{"key":"9330_CR22","unstructured":"Inui, N., Koiso, T., & Kotani Y. (2002). Using patterns for syntactic parsing, In Proceedings of IASTED international conference artificial intelligence and applications, (pp. 522\u2013527)."},{"key":"9330_CR23","first-page":"58","volume-title":"Fully corpus-based natural language dialogue system, AAAI Spring Symposium on Natural Language Generation in Spoken and Written Dialogue, AAAI Technical Report S-03-06","author":"N Inui","year":"2003","unstructured":"Inui, N., Koiso, T., Nakamura, J., & Kotani, Y. (2003). Fully corpus-based natural language dialogue system, AAAI Spring Symposium on Natural Language Generation in Spoken and Written Dialogue, AAAI Technical Report S-03-06 (pp. 58\u201364). Palo Alto, CA: AAAI."},{"key":"9330_CR24","unstructured":"Kelly, D., Kantor, P., Morse, E., Scholtz, J. & Sun, Y. (2006). User-centered evaluation of interactive question-answering Systems, In Proceedings of the interactive question answering workshop at HLT-NAACL 2006, June, Stroudsburg, PA: Association for Computational Linguistics, (pp. 49\u201356)."},{"key":"9330_CR25","unstructured":"Koiso, T., Ikeda, T., Inui, N., and Kotani, Y. (2002). A dialog system which chooses a response using similarity between a surface case rule patterns. In Proceedings of the IPSJ Conference, IM-03, 2002."},{"key":"9330_CR26","doi-asserted-by":"crossref","unstructured":"Kruschwitz, U., De Roeck, A., Scott, P., Steel, S., Turner, R., & Webb N. (2000). Extracting semistructured data-lessons learnt. In Proceedings of the 2nd international conference on natural language processing (NLP2000), (pp. 406\u2013417).","DOI":"10.1007\/3-540-45154-4_37"},{"key":"9330_CR27","doi-asserted-by":"crossref","unstructured":"Kruschwitz, U., De Roeck, A., Scott, P., Steel, S., Turner, R., & Webb, N. (1999). Natural language access to yellow pages. In Proceedings of third International conference on knowledge-based intelligent information engineering systems, (pp. 34\u201337).","DOI":"10.1109\/KES.1999.820113"},{"key":"9330_CR28","first-page":"1","volume-title":"Dialogue Processing in Spoken Language Systems","author":"E Maier","year":"1996","unstructured":"Maier, E., Mast, M., & Luperfoy, S. (1996). Overview. In E. Maier, M. Mast, & S. Luperfoy (Eds.), Dialogue Processing in Spoken Language Systems (pp. 1\u201313). Berlin: Springer."},{"issue":"1","key":"9330_CR29","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1145\/505282.505285","volume":"34","author":"M McTear","year":"2002","unstructured":"McTear, M. (2002). Spoken dialogue technology: Enabling the conversational user interface. ACM Computing Surveys, 34(1), 90\u2013169.","journal-title":"ACM Computing Surveys"},{"key":"9330_CR30","doi-asserted-by":"crossref","unstructured":"Mikic, F. A., Burguillo, J. C., Rodr\u00edguez, D. A., Rodr\u00edguez, E., &d Llamas, M. (2008). T-BOT and Q-BOT: A couple of AIML-based bots for tutoring courses and evaluating students. In Proceedings of 38th ASEE\/IEEE frontiers in education conference, (pp. S3A-7-S3A-12).","DOI":"10.1109\/FIE.2008.4720469"},{"key":"9330_CR31","doi-asserted-by":"crossref","unstructured":"Quarteroni, S. (2008). Personalized, interactive question answering on the Web. Proceedings of the Workshop on Knowledge and Reasoning for Answering Questions (KRAQ \u201808), COLING 2008, Stroudsburg, PA: ACL, (pp. 33\u201340).","DOI":"10.3115\/1642004.1642009"},{"key":"9330_CR32","unstructured":"Quarteroni, S., & Manandhar, S. (2006). User modeling for adaptive question answering and Information retrieval. G.C.J. Sutcliiffe & R. G. Goebel (Eds.), In Proceedings of the nineteenth international florida artificial intelligence research society conference (FLAIRS-19), Melbourne Beach, FL, May 2006, (pp. np)."},{"key":"9330_CR33","unstructured":"Quarteroni, S. and Manandhar, S. (2007). A chatbot-based interactive question answering system. In Proceedings of the 11th workshop on the semantics and pragmatics of dialogue (SemDial 11), Rovereto, (DECALOG 2007), (pp. 83\u201390)."},{"key":"9330_CR34","unstructured":"Rayson, P. (2003). Matrix: a statistical method and software tool for linguistic analysis through corpus comparison. Ph.D. thesis, Bailrigg, Lancaster: Lancaster University."},{"key":"9330_CR35","unstructured":"Schuetzler, R., Grimes, G. M., Giboney, J., & Buckman, J. (2014). Facilitating natural conversational agent interactions: Lessons from a deception experiment. International conference on information systems. Auckland, December 14\u201317, 2014, pp. 1\u201316."},{"issue":"2","key":"9330_CR36","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1162\/COLI_a_00178","volume":"40","author":"K Shaalan","year":"2014","unstructured":"Shaalan, K. (2014). A Survey of Arabic Named Entity Recognition and Classification. Computational Linguistics, 40(2), 469\u2013510.","journal-title":"Computational Linguistics"},{"key":"9330_CR37","unstructured":"Traum, D. R., Swartout, W., Marsella, S. & Gratch, J. (2005). Virtual humans for non-team interaction training. In proceedings of the AAMAS Workshop on creating bonds with embodied conversational Agents."},{"key":"9330_CR38","unstructured":"Van Zaanen, M., Roberts, A., & Atwell, E.S. (2004). A multilingual parallel parsed corpus as gold standard for grammatical inference evaluation. In Proceedings of the workshop on the amazing utility of parallel and comparable corpora. Fourth International Conference on Language Resources and Evaluation (LREC), Lisbon, (pp. 58\u201361)."},{"key":"9330_CR39","doi-asserted-by":"crossref","unstructured":"Walker, M., Litman, A., Kamm, D., and Abella, A. (1997). Evaluating interactive Dialogue systems: Extending component evaluation to integrated system evaluation. In Proceedings of the ACL\/EACL workshop on spoken dialogue systems (pp. 1\u20138).","DOI":"10.3115\/1641462.1641463"},{"key":"9330_CR40","volume-title":"The Elements of AIML Style","author":"R Wallace","year":"2003","unstructured":"Wallace, R. (2003). The Elements of AIML Style. Foundation: ALICE A.I."},{"issue":"8","key":"9330_CR41","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1145\/365153.365168","volume":"10","author":"J Weizenbaum","year":"1966","unstructured":"Weizenbaum, J. (1966). ELIZA-A computer program for the study of natural language communication between man and machine. Communications of the ACM, 10(8), 36\u201345.","journal-title":"Communications of the ACM"}],"container-title":["International Journal of Speech Technology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10772-015-9330-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10772-015-9330-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10772-015-9330-4","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,16]],"date-time":"2023-08-16T10:50:52Z","timestamp":1692183052000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10772-015-9330-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,1,4]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,6]]}},"alternative-id":["9330"],"URL":"https:\/\/doi.org\/10.1007\/s10772-015-9330-4","relation":{},"ISSN":["1381-2416","1572-8110"],"issn-type":[{"value":"1381-2416","type":"print"},{"value":"1572-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,1,4]]}}}