{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T15:56:31Z","timestamp":1784044591405,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":78,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,25]],"date-time":"2020-10-25T00:00:00Z","timestamp":1603584000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,25]]},"DOI":"10.1145\/3395035.3425319","type":"proceedings-article","created":{"date-parts":[[2020,12,28]],"date-time":"2020-12-28T05:36:37Z","timestamp":1609133797000},"page":"280-286","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["Trends &amp; Methods in Chatbot Evaluation"],"prefix":"10.1145","author":[{"given":"Jacky","family":"Casas","sequence":"first","affiliation":[{"name":"University of Applied Sciences and Arts Western Switzerland, Fribourg, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc-Olivier","family":"Tricot","sequence":"additional","affiliation":[{"name":"University of Fribourg, Fribourg, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omar","family":"Abou Khaled","sequence":"additional","affiliation":[{"name":"University of Applied Sciences and Arts Western Switzerland, Fribourg, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elena","family":"Mugellini","sequence":"additional","affiliation":[{"name":"University of Applied Sciences and Arts Western Switzerland, Fribourg, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philippe","family":"Cudr\u00e9-Mauroux","sequence":"additional","affiliation":[{"name":"University of Fribourg, Fribourg, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,12,27]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025869312943"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10772-015-9330-4"},{"key":"e_1_3_2_1_3_1","volume-title":"AI-based chatbots in customer service and their effects on user compliance. Electronic Markets","author":"Adam Martin","year":"2020","unstructured":"Martin Adam , Michael Wessel , and Alexander Benlian . 2020. AI-based chatbots in customer service and their effects on user compliance. Electronic Markets ( 2020 ), 1--19. Martin Adam, Michael Wessel, and Alexander Benlian. 2020. AI-based chatbots in customer service and their effects on user compliance. Electronic Markets (2020), 1--19."},{"key":"e_1_3_2_1_4_1","unstructured":"Daniel Adiwardana Minh-Thang Luong David R So Jamie Hall Noah Fiedel Romal Thoppilan Zi Yang Apoorv Kulshreshtha Gaurav Nemade Yifeng Lu etal 2020. Towards a human-like open-domain chatbot. arXiv preprint arXiv:2001.09977 (2020). Daniel Adiwardana Minh-Thang Luong David R So Jamie Hall Noah Fiedel Romal Thoppilan Zi Yang Apoorv Kulshreshtha Gaurav Nemade Yifeng Lu et al. 2020. Towards a human-like open-domain chatbot. arXiv preprint arXiv:2001.09977 (2020)."},{"key":"e_1_3_2_1_5_1","unstructured":"Dana Al-Ghadhban and Nora Al-Twairesh. [n.d.]. Nabiha: An Arabic Dialect Chatbot. ( [n. d.]). Dana Al-Ghadhban and Nora Al-Twairesh. [n.d.]. Nabiha: An Arabic Dialect Chatbot. ( [n. d.])."},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations. 208--212","author":"Ali Dana Abu","year":"2016","unstructured":"Dana Abu Ali and Nizar Habash . 2016 . Botta: An arabic dialect chatbot . In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations. 208--212 . Dana Abu Ali and Nizar Habash. 2016. Botta: An arabic dialect chatbot. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations. 208--212."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3274146"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.03.051"},{"key":"e_1_3_2_1_9_1","volume-title":"Intelligent Chatbot for Medical Assistance in Rural Areas. nternational Journal of Innovative Technology and Exploring Engineering","author":"Arulmangainayaki V.","year":"2020","unstructured":"V. Arulmangainayaki , M. Harini , M. Keerthiga , and M. Deva Priya . 2020. Intelligent Chatbot for Medical Assistance in Rural Areas. nternational Journal of Innovative Technology and Exploring Engineering , Vol. 9 ( 2020 ). V. Arulmangainayaki, M. Harini, M. Keerthiga, and M. Deva Priya. 2020. Intelligent Chatbot for Medical Assistance in Rural Areas. nternational Journal of Innovative Technology and Exploring Engineering, Vol. 9 (2020)."},{"key":"e_1_3_2_1_10_1","volume-title":"Evaluation of the Naturalness of Chatbot Applications. In 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT). IEEE, 359--365","author":"Atiyah Ayah","year":"2019","unstructured":"Ayah Atiyah , Shaidah Jusoh , and Firas Alghanim . 2019 . Evaluation of the Naturalness of Chatbot Applications. In 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT). IEEE, 359--365 . Ayah Atiyah, Shaidah Jusoh, and Firas Alghanim. 2019. Evaluation of the Naturalness of Chatbot Applications. In 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT). IEEE, 359--365."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Eva Bittner and Omid Shoury. 2019. Designing Automated Facilitation for Design Thinking: A Chatbot for Supporting Teams in the Empathy Map Method. In HICSS . Eva Bittner and Omid Shoury. 2019. Designing Automated Facilitation for Design Thinking: A Chatbot for Supporting Teams in the Empathy Map Method. In HICSS .","DOI":"10.24251\/HICSS.2019.029"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5220\/0007772704960501"},{"key":"e_1_3_2_1_14_1","unstructured":"Jacky Casas. 2018. The state of conversational agents: a 2017--2018 review . Jacky Casas. 2018. The state of conversational agents: a 2017--2018 review ."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3274191"},{"key":"e_1_3_2_1_16_1","volume-title":"Consumers Say No to Chatbot Silos in US and UK Survey. https:\/\/www.chatbots.org\/images\/news\/chatbot_survey_2018.pdf [Online","year":"2020","unstructured":"Chatbots.org. 2018. Consumers Say No to Chatbot Silos in US and UK Survey. https:\/\/www.chatbots.org\/images\/news\/chatbot_survey_2018.pdf [Online ; accessed 24- January - 2020 ]. Chatbots.org. 2018. Consumers Say No to Chatbot Silos in US and UK Survey. https:\/\/www.chatbots.org\/images\/news\/chatbot_survey_2018.pdf [Online; accessed 24-January-2020]."},{"key":"e_1_3_2_1_17_1","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)","author":"Chiar\u00e1in Neasa N'i","year":"2016","unstructured":"Neasa N'i Chiar\u00e1in and Ailbhe N'i Chasaide . 2016 . Chatbot Technology with Synthetic Voices in the Acquisition of an Endangered Language: Motivation, Development and Evaluation of a Platform for Irish . In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16) . European Language Resources Association (ELRA), Portorovz, Slovenia, 3429--3435. https:\/\/www.aclweb.org\/anthology\/L16--1547 Neasa N'i Chiar\u00e1in and Ailbhe N'i Chasaide. 2016. Chatbot Technology with Synthetic Voices in the Acquisition of an Endangered Language: Motivation, Development and Evaluation of a Platform for Irish. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16). European Language Resources Association (ELRA), Portorovz, Slovenia, 3429--3435. https:\/\/www.aclweb.org\/anthology\/L16--1547"},{"key":"e_1_3_2_1_18_1","volume-title":"Meet Percy: The CS 221 Teaching Assistant Chatbot. ( [n.,d.]).","author":"Chopra Sahil","unstructured":"Sahil Chopra , Rachel Gianforte , and John Sholar . [n.d.]. Meet Percy: The CS 221 Teaching Assistant Chatbot. ( [n.,d.]). Sahil Chopra, Rachel Gianforte, and John Sholar. [n.d.]. Meet Percy: The CS 221 Teaching Assistant Chatbot. ( [n.,d.])."},{"key":"e_1_3_2_1_19_1","volume-title":"Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research (11","author":"Chung Minjee","year":"2018","unstructured":"Minjee Chung , Eunju Ko , Heerim Joung , and Sang Kim . 2018. Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research (11 2018 ). https:\/\/doi.org\/10.1016\/j.jbusres.2018.10.004 10.1016\/j.jbusres.2018.10.004 Minjee Chung, Eunju Ko, Heerim Joung, and Sang Kim. 2018. Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research (11 2018). https:\/\/doi.org\/10.1016\/j.jbusres.2018.10.004"},{"key":"e_1_3_2_1_20_1","unstructured":"K. Coperich Elizabeth A. Cudney and H. B. Nembhard. [n.d.]. Continuous Improvement Study of Chatbot Technologies using a Human Factors Methodology. K. Coperich Elizabeth A. Cudney and H. B. Nembhard. [n.d.]. Continuous Improvement Study of Chatbot Technologies using a Human Factors Methodology."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-4017"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3274188"},{"key":"e_1_3_2_1_24_1","unstructured":"Endang Wahyu Pamungkas. 2019. Emotionally-Aware Chatbots: A Survey. Endang Wahyu Pamungkas. 2019. Emotionally-Aware Chatbots: A Survey."},{"key":"e_1_3_2_1_25_1","volume-title":"chatbots.org [Online","author":"Lun Erwin Van","year":"2020","unstructured":"Erwin Van Lun . 2020. Chatbots.org - Chatbot Reviews , Community & News . chatbots.org [Online ; accessed 8- January - 2020 ]. Erwin Van Lun. 2020. Chatbots.org - Chatbot Reviews, Community & News. chatbots.org [Online; accessed 8-January-2020]."},{"key":"e_1_3_2_1_26_1","unstructured":"Cheong Sik Feng Lim Jing Chieu Hai Leong and Wong Jialiang Joshua. [n.d.]. QUORA QUESTION ANSWERING CHATBOT. ( [n. d.]). Cheong Sik Feng Lim Jing Chieu Hai Leong and Wong Jialiang Joshua. [n.d.]. QUORA QUESTION ANSWERING CHATBOT. ( [n. d.])."},{"key":"e_1_3_2_1_27_1","volume-title":"Commun. ACM","volume":"59","author":"Ferrara Emilio","year":"2014","unstructured":"Emilio Ferrara , Onur Varol , Clayton Davis , Filippo Menczer , and Alessandro Flammini . 2014 . The Rise of Social Bots . Commun. ACM , Vol. 59 (07 2014). https:\/\/doi.org\/10.1145\/2818717 10.1145\/2818717 Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2014. The Rise of Social Bots. Commun. ACM, Vol. 59 (07 2014). https:\/\/doi.org\/10.1145\/2818717"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-3022"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357842"},{"key":"e_1_3_2_1_30_1","unstructured":"gk_. 2017. Soul of the Machine: How Chatbots Work. http:\/\/web.archive.org\/web\/20190202142330\/https:\/\/medium.com\/@gk_\/how-chat-bots-work-dfff656a35e2 gk_. 2017. Soul of the Machine: How Chatbots Work. http:\/\/web.archive.org\/web\/20190202142330\/https:\/\/medium.com\/@gk_\/how-chat-bots-work-dfff656a35e2"},{"key":"e_1_3_2_1_31_1","unstructured":"Ulrich Gnewuch Stefan Morana Marc Adam and Alexander Maedche. 2018. Faster is not always better: understanding the effect of dynamic response delays in human-chatbot interaction. (2018). Ulrich Gnewuch Stefan Morana Marc Adam and Alexander Maedche. 2018. Faster is not always better: understanding the effect of dynamic response delays in human-chatbot interaction. (2018)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"H. James Wilson Paul R. Daugherty and Nicola Morini-Bianzino. 2017. The Jobs That Artificial Intelligence Will Create. http:\/\/sloanreview.mit.edu\/article\/will-ai-create-as-many-jobs-as-it-eliminates\/ [Online; accessed 14-January-2020]. H. James Wilson Paul R. Daugherty and Nicola Morini-Bianzino. 2017. The Jobs That Artificial Intelligence Will Create. http:\/\/sloanreview.mit.edu\/article\/will-ai-create-as-many-jobs-as-it-eliminates\/ [Online; accessed 14-January-2020].","DOI":"10.7551\/mitpress\/11645.003.0020"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1358"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2016.070304"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/3304222.3304342"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5614\/sostek.itbj.2019.18.3.17"},{"key":"e_1_3_2_1_37_1","volume-title":"Perspectives for Evaluating Conversational AI. ArXiv","author":"Jadeja Mahipal","year":"2017","unstructured":"Mahipal Jadeja and Neelanshi Varia . 2017. Perspectives for Evaluating Conversational AI. ArXiv , Vol. abs\/ 1709 .04734 ( 2017 ). Mahipal Jadeja and Neelanshi Varia. 2017. Perspectives for Evaluating Conversational AI. ArXiv, Vol. abs\/1709.04734 (2017)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196735"},{"key":"e_1_3_2_1_39_1","volume-title":"Enterprise to Computer: Star Trek chatbot. ArXiv","author":"Jena Grishma","year":"2017","unstructured":"Grishma Jena , Mansi Vashisht , Abheek Basu , Lyle H. Ungar , and Jo ao Sedoc . 2017. Enterprise to Computer: Star Trek chatbot. ArXiv , Vol. abs\/ 1708 .00818 ( 2017 ). Grishma Jena, Mansi Vashisht, Abheek Basu, Lyle H. Ungar, and Jo ao Sedoc. 2017. Enterprise to Computer: Star Trek chatbot. ArXiv, Vol. abs\/1708.00818 (2017)."},{"key":"e_1_3_2_1_40_1","volume-title":"4 Trends in Gartner Hype Cycle for Customer Service and Customer Engagement. https:\/\/www.gartner.com\/smarterwithgartner\/4-trends-gartner-hype-cycle-customer-service-customer-engagement\/ [Online","author":"Bryan Jordan","year":"2020","unstructured":"Jordan Bryan . 2018. 4 Trends in Gartner Hype Cycle for Customer Service and Customer Engagement. https:\/\/www.gartner.com\/smarterwithgartner\/4-trends-gartner-hype-cycle-customer-service-customer-engagement\/ [Online ; accessed 8- January - 2020 ]. Jordan Bryan. 2018. 4 Trends in Gartner Hype Cycle for Customer Service and Customer Engagement. https:\/\/www.gartner.com\/smarterwithgartner\/4-trends-gartner-hype-cycle-customer-service-customer-engagement\/ [Online; accessed 8-January-2020]."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.2196\/13863"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.21512\/commit.v12i2.4813"},{"key":"e_1_3_2_1_43_1","volume-title":"ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . 2004 . ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out . Association for Computational Linguistics , Barcelona, Spain , 74--81. https:\/\/www.aclweb.org\/anthology\/W04--1013 Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics, Barcelona, Spain, 74--81. https:\/\/www.aclweb.org\/anthology\/W04--1013"},{"key":"e_1_3_2_1_44_1","unstructured":"Pedro Manuel Dias Braga Lino. 2018. Travel Booking Chatbot. Pedro Manuel Dias Braga Lino. 2018. Travel Booking Chatbot."},{"key":"e_1_3_2_1_45_1","volume-title":"Ke Min Zhu, and Shen Ba","author":"Liu Qingtang","year":"2019","unstructured":"Qingtang Liu , Jingxiu Huang , Linjing Wu , Ke Min Zhu, and Shen Ba . 2019 . CBET: design and evaluation of a domain-specific chatbot for mobile learning. Universal Access in the Information Society ( 2019), 1--19. Qingtang Liu, Jingxiu Huang, Linjing Wu, Ke Min Zhu, and Shen Ba. 2019. CBET: design and evaluation of a domain-specific chatbot for mobile learning. Universal Access in the Information Society (2019), 1--19."},{"key":"e_1_3_2_1_46_1","unstructured":"Andreas Lommatzsch and Jonas Katins. 2019. An Information Retrieval-based Approach for Building Intuitive Chatbots for Large Knowledge Bases. In LWDA . Andreas Lommatzsch and Jonas Katins. 2019. An Information Retrieval-based Approach for Building Intuitive Chatbots for Large Knowledge Bases. In LWDA ."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3323771.3323824"},{"key":"e_1_3_2_1_48_1","unstructured":"Mitch Mason. 2017. 3 types of business chatbots you can build. http:\/\/web.archive.org\/web\/20190814211438\/https:\/\/www.ibm.com\/blogs\/watson\/2017\/12\/3-types-of-business-chatbots-you-can-build\/ Mitch Mason. 2017. 3 types of business chatbots you can build. http:\/\/web.archive.org\/web\/20190814211438\/https:\/\/www.ibm.com\/blogs\/watson\/2017\/12\/3-types-of-business-chatbots-you-can-build\/"},{"key":"e_1_3_2_1_49_1","volume-title":"Developing a Chatbot for Customer Service to Metropolia UAS Student Affairs Office. Master Thesis","author":"Merisalo Sonja","unstructured":"Sonja Merisalo . 2018. Developing a Chatbot for Customer Service to Metropolia UAS Student Affairs Office. Master Thesis . Metropolia University of Applied Sciences , Helsinki, Finland . Sonja Merisalo. 2018. Developing a Chatbot for Customer Service to Metropolia UAS Student Affairs Office. Master Thesis. Metropolia University of Applied Sciences, Helsinki, Finland."},{"key":"e_1_3_2_1_50_1","first-page":"2","article-title":"A comparative Study of Chatbots and Humans","volume":"2","author":"Mittal Amit","year":"2016","unstructured":"Amit Mittal , Ayushi Agrawal , Ayushi Chouksey , Rachna Shriwas , and Saloni Agrawal . 2016 . A comparative Study of Chatbots and Humans . Situations , Vol. 2 (2016), 2 . Amit Mittal, Ayushi Agrawal, Ayushi Chouksey, Rachna Shriwas, and Saloni Agrawal. 2016. A comparative Study of Chatbots and Humans. Situations, Vol. 2 (2016), 2.","journal-title":"Situations"},{"key":"e_1_3_2_1_51_1","unstructured":"Jay Morgan Adeline Paiement Monika Seisenberger Jane Williams and Adam Zachary Wyner. 2018. A Chatbot Framework for the Children's Legal Centre. In JURIX . Jay Morgan Adeline Paiement Monika Seisenberger Jane Williams and Adam Zachary Wyner. 2018. A Chatbot Framework for the Children's Legal Centre. In JURIX ."},{"key":"e_1_3_2_1_52_1","unstructured":"Khalil Mrini Marc Laperrouza and Pierre Dillenbourg. 2018. Building a Question-Answering Chatbot using Forum Data in the Semantic Space. Khalil Mrini Marc Laperrouza and Pierre Dillenbourg. 2018. Building a Question-Answering Chatbot using Forum Data in the Semantic Space."},{"key":"e_1_3_2_1_53_1","volume-title":"Muhammad Hafeez Javed, and Tayyaba Arshad","author":"Mujeeb Sana","year":"2017","unstructured":"Sana Mujeeb , Muhammad Hafeez Javed, and Tayyaba Arshad . 2017 . Aquabot: a diagnostic chatbot for achluophobia and autism. Int J Adv Comput Sci Appl , Vol. 8 (2017). Sana Mujeeb, Muhammad Hafeez Javed, and Tayyaba Arshad. 2017. Aquabot: a diagnostic chatbot for achluophobia and autism. Int J Adv Comput Sci Appl, Vol. 8 (2017)."},{"key":"e_1_3_2_1_54_1","unstructured":"Huyen Nguyen David Morales and Tessera Chin. 2017. A neural chatbot with personality. Huyen Nguyen David Morales and Tessera Chin. 2017. A neural chatbot with personality."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3358960.3375792"},{"key":"e_1_3_2_1_56_1","volume-title":"Khairul Kasmiran, and Azreen Azman.","author":"Palasundram Kulothunkan","year":"2019","unstructured":"Kulothunkan Palasundram , Nurfadhlina Sharef , Nurul Amelina Nasharuddin , Khairul Kasmiran, and Azreen Azman. 2019 . Sequence to Sequence Model Performance for Education Chatbot. International Journal of Emerging Technologies in Learning ( iJET), Vol. 14 (12 2019), 56. https:\/\/doi.org\/10.3991\/ijet.v14i24.12187 10.3991\/ijet.v14i24.12187 Kulothunkan Palasundram, Nurfadhlina Sharef, Nurul Amelina Nasharuddin, Khairul Kasmiran, and Azreen Azman. 2019. Sequence to Sequence Model Performance for Education Chatbot. International Journal of Emerging Technologies in Learning (iJET), Vol. 14 (12 2019), 56. https:\/\/doi.org\/10.3991\/ijet.v14i24.12187"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.20943\/01201606.120123"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"crossref","unstructured":"Stefanus Ardhito Prasetya Alva Erwin and Maulahikmah Galinium. 2018. IMPLEMENTING INDONESIAN LANGUAGE CHATBOT FOR ECOMMERCE SITE USING ARTIFICIAL INTELLIGENCE MARKUP LANGUAGE (AIML). Stefanus Ardhito Prasetya Alva Erwin and Maulahikmah Galinium. 2018. IMPLEMENTING INDONESIAN LANGUAGE CHATBOT FOR ECOMMERCE SITE USING ARTIFICIAL INTELLIGENCE MARKUP LANGUAGE (AIML).","DOI":"10.25105\/pakar.v0i0.2652"},{"key":"#cr-split#-e_1_3_2_1_60_1.1","unstructured":"Minghui Qiu Feng-Lin Li Siyu Wang Xing Gao Yan Chen Weipeng Zhao Haiqing Chen Jun Huang and Wei Chu. 2017. AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine. 498--503. https:\/\/doi.org\/10.18653\/v1\/P17--2079 10.18653\/v1"},{"key":"#cr-split#-e_1_3_2_1_60_1.2","unstructured":"Minghui Qiu Feng-Lin Li Siyu Wang Xing Gao Yan Chen Weipeng Zhao Haiqing Chen Jun Huang and Wei Chu. 2017. AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine. 498--503. https:\/\/doi.org\/10.18653\/v1\/P17--2079"},{"key":"e_1_3_2_1_61_1","volume-title":"Evaluating Quality of Chatbots and Intelligent Conversational Agents. (04","author":"Radziwill Nicole","year":"2017","unstructured":"Nicole Radziwill and Morgan Benton . 2017. Evaluating Quality of Chatbots and Intelligent Conversational Agents. (04 2017 ). Nicole Radziwill and Morgan Benton. 2017. Evaluating Quality of Chatbots and Intelligent Conversational Agents. (04 2017)."},{"key":"e_1_3_2_1_62_1","volume-title":"Screw the Turing test ? chatbots don't need to act human. https:\/\/venturebeat.com\/2017\/02\/03\/screw-the-turing-test-chatbots-dont-need-to-act-human\/ [Online","author":"Ramos Rick","year":"2020","unstructured":"Rick Ramos . 2017. Screw the Turing test ? chatbots don't need to act human. https:\/\/venturebeat.com\/2017\/02\/03\/screw-the-turing-test-chatbots-dont-need-to-act-human\/ [Online ; accessed 14- January - 2020 ]. Rick Ramos. 2017. Screw the Turing test ? chatbots don't need to act human. https:\/\/venturebeat.com\/2017\/02\/03\/screw-the-turing-test-chatbots-dont-need-to-act-human\/ [Online; accessed 14-January-2020]."},{"key":"e_1_3_2_1_63_1","volume-title":"Sai Mudumba, Alexandre de Br\u00e9bisson, Jose Sotelo, Dendi Suhubdy, Vincent Michalski, Alexandre Nguyen, Joelle Pineau, and Yoshua Bengio.","author":"Serban Iulian","year":"2017","unstructured":"Iulian Serban , Chinnadhurai Sankar , Mathieu Germain , Saizheng Zhang , Zhouhan Lin , Sandeep Subramanian , Taesup Kim , Michael Pieper , A. P. Sarath Chandar , Nan Rosemary Ke , Sai Mudumba, Alexandre de Br\u00e9bisson, Jose Sotelo, Dendi Suhubdy, Vincent Michalski, Alexandre Nguyen, Joelle Pineau, and Yoshua Bengio. 2017 . A Deep Reinforcement Learning Chatbot. ArXiv , Vol. abs\/ 1709 .02349 (2017). Iulian Serban, Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim, Michael Pieper, A. P. Sarath Chandar, Nan Rosemary Ke, Sai Mudumba, Alexandre de Br\u00e9bisson, Jose Sotelo, Dendi Suhubdy, Vincent Michalski, Alexandre Nguyen, Joelle Pineau, and Yoshua Bengio. 2017. A Deep Reinforcement Learning Chatbot. ArXiv, Vol. abs\/1709.02349 (2017)."},{"key":"e_1_3_2_1_64_1","volume-title":"Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education","author":"Smutny Pavel","year":"2020","unstructured":"Pavel Smutny and Petra Schreiberova . 2020. Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education ( 2020 ), 103862. Pavel Smutny and Petra Schreiberova. 2020. Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education (2020), 103862."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341105.3374129"},{"key":"e_1_3_2_1_66_1","unstructured":"Timo Spring Jacky Casas Karl Daher Elena Mugellini and Omar Abou Khaled. 2019. Empathic Response Generation in Chatbots. Timo Spring Jacky Casas Karl Daher Elena Mugellini and Omar Abou Khaled. 2019. Empathic Response Generation in Chatbots."},{"key":"e_1_3_2_1_68_1","volume-title":"Should we be making chatbots that will pass the Turing Test? https:\/\/www.fifthquadrant.com.au\/cx-spotlight-news\/should-we-be-making-chatbots-that-will-pass-the-turing-test [Online","author":"Kostarelis Stefan","year":"2020","unstructured":"Stefan Kostarelis . 2018. Should we be making chatbots that will pass the Turing Test? https:\/\/www.fifthquadrant.com.au\/cx-spotlight-news\/should-we-be-making-chatbots-that-will-pass-the-turing-test [Online ; accessed 14- January - 2020 ]. Stefan Kostarelis. 2018. Should we be making chatbots that will pass the Turing Test? https:\/\/www.fifthquadrant.com.au\/cx-spotlight-news\/should-we-be-making-chatbots-that-will-pass-the-turing-test [Online; accessed 14-January-2020]."},{"key":"e_1_3_2_1_69_1","unstructured":"Sebastian Stephan. 2017. Die Arten von Chatbots. http:\/\/web.archive.org\/web\/20200511161241\/https:\/\/cloud-blog.arvato.com\/die-arten-von-chatbots\/ Sebastian Stephan. 2017. Die Arten von Chatbots. http:\/\/web.archive.org\/web\/20200511161241\/https:\/\/cloud-blog.arvato.com\/die-arten-von-chatbots\/"},{"key":"e_1_3_2_1_70_1","volume-title":"How 13 Global Industries Use Artificial Intelligence. https:\/\/sites.tcs.com\/artificial-intelligence\/wp-content\/uploads\/TCS-GTS-how-13-global-industries-use-artificial-intelligence.pdf [Online - PDF","author":"Services Tata Consultancy","year":"2020","unstructured":"Tata Consultancy Services . 2017. How 13 Global Industries Use Artificial Intelligence. https:\/\/sites.tcs.com\/artificial-intelligence\/wp-content\/uploads\/TCS-GTS-how-13-global-industries-use-artificial-intelligence.pdf [Online - PDF ; accessed 23- January - 2020 ]. Tata Consultancy Services. 2017. How 13 Global Industries Use Artificial Intelligence. https:\/\/sites.tcs.com\/artificial-intelligence\/wp-content\/uploads\/TCS-GTS-how-13-global-industries-use-artificial-intelligence.pdf [Online - PDF; accessed 23-January-2020]."},{"key":"e_1_3_2_1_71_1","unstructured":"Navid Tavanapour and Eva Bittner. 2018. Automated Facilitation for Idea Platforms: Design and Evaluation of a Chatbot Prototype. Navid Tavanapour and Eva Bittner. 2018. Automated Facilitation for Idea Platforms: Design and Evaluation of a Chatbot Prototype."},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173632"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"crossref","unstructured":"Milena Tsvetkova Ruth Garc\u00eda-Gavilanes Luciano Floridi and Taha Yasseri. 2017. Even good bots fight: The case of Wikipedia. In PloS one . Milena Tsvetkova Ruth Garc\u00eda-Gavilanes Luciano Floridi and Taha Yasseri. 2017. Even good bots fight: The case of Wikipedia. In PloS one .","DOI":"10.1371\/journal.pone.0171774"},{"key":"e_1_3_2_1_74_1","volume-title":"On Evaluating and Comparing Conversational Agents. (01","author":"Venkatesh Anu","year":"2018","unstructured":"Anu Venkatesh , Chandra Khatri , Ashwin Ram , Fenfei Guo , Raefer Gabriel , Ashish Nagar , Rohit Prasad , Ming Cheng , Behnam Hedayatnia , Angeliki Metallinou , Rahul Goel , Shaohua Yang , and Anirudh Raju . 2018. On Evaluating and Comparing Conversational Agents. (01 2018 ). Anu Venkatesh, Chandra Khatri, Ashwin Ram, Fenfei Guo, Raefer Gabriel, Ashish Nagar, Rohit Prasad, Ming Cheng, Behnam Hedayatnia, Angeliki Metallinou, Rahul Goel, Shaohua Yang, and Anirudh Raju. 2018. On Evaluating and Comparing Conversational Agents. (01 2018)."},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/365153.365168"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025496"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098148"},{"key":"e_1_3_2_1_78_1","volume-title":"Proceedings of the chatbot workshop of LREC","volume":"63","author":"Yu Zhou","year":"2016","unstructured":"Zhou Yu , Ziyu Xu , Alan W Black , and Alexander Rudnicky . 2016 . Chatbot evaluation and database expansion via crowdsourcing . In Proceedings of the chatbot workshop of LREC , Vol. 63 . 102. Zhou Yu, Ziyu Xu, Alan W Black, and Alexander Rudnicky. 2016. Chatbot evaluation and database expansion via crowdsourcing. In Proceedings of the chatbot workshop of LREC, Vol. 63. 102."},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3125739.3125766"},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00368"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Virtual Event Netherlands","acronym":"ICMI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Companion Publication of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3395035.3425319","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3395035.3425319","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:47Z","timestamp":1750197767000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3395035.3425319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,25]]},"references-count":78,"alternative-id":["10.1145\/3395035.3425319","10.1145\/3395035"],"URL":"https:\/\/doi.org\/10.1145\/3395035.3425319","relation":{},"subject":[],"published":{"date-parts":[[2020,10,25]]},"assertion":[{"value":"2020-12-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}