{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T01:15:32Z","timestamp":1780449332900,"version":"3.54.1"},"reference-count":65,"publisher":"MIT Press - Journals","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2020,3]]},"abstract":"<jats:p> This article describes the development of Microsoft XiaoIce, the most popular social chatbot in the world. XiaoIce is uniquely designed as an artifical intelligence companion with an emotional connection to satisfy the human need for communication, affection, and social belonging. We take into account both intelligent quotient and emotional quotient in system design, cast human\u2013machine social chat as decision-making over Markov Decision Processes, and optimize XiaoIce for long-term user engagement, measured in expected Conversation-turns Per Session (CPS). We detail the system architecture and key components, including dialogue manager, core chat, skills, and an empathetic computing module. We show how XiaoIce dynamically recognizes human feelings and states, understands user intent, and responds to user needs throughout long conversations. Since the release in 2014, XiaoIce has communicated with over 660 million active users and succeeded in establishing long-term relationships with many of them. Analysis of large-scale online logs shows that XiaoIce has achieved an average CPS of 23, which is significantly higher than that of other chatbots and even human conversations. <\/jats:p>","DOI":"10.1162\/coli_a_00368","type":"journal-article","created":{"date-parts":[[2020,1,2]],"date-time":"2020-01-02T18:51:49Z","timestamp":1577991109000},"page":"53-93","source":"Crossref","is-referenced-by-count":481,"title":["The Design and Implementation of XiaoIce, an Empathetic Social                     Chatbot"],"prefix":"10.1162","volume":"46","author":[{"given":"Li","family":"Zhou","sequence":"first","affiliation":[{"name":"Microsoft."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianfeng","family":"Gao","sequence":"additional","affiliation":[{"name":"Microsoft Research."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Di","family":"Li","sequence":"additional","affiliation":[{"name":"Microsoft."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heung-Yeung","family":"Shum","sequence":"additional","affiliation":[{"name":"Microsoft."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"bib1","first-page":"880","volume-title":"Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics","author":"Albrecht Joshua","year":"2007"},{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_24"},{"key":"bib3","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00636"},{"key":"bib4","volume-title":"\u201cThe Bicentennial Man\u201d in I. Asimov, The Bicentennial Man and Other Stories","author":"Asimov I.","year":"1984"},{"key":"bib5","first-page":"65","volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization","author":"Banerjee Satanjeev","year":"2005"},{"key":"bib6","first-page":"62","author":"Brahnam Sheryl","year":"2005","journal-title":"Abuse: The Darker Side of Human Computer Interaction"},{"key":"bib7","doi-asserted-by":"publisher","DOI":"10.1007\/11825890_3"},{"key":"bib8","author":"Cheng Wen-Feng","year":"2018","journal-title":"arXiv preprint arXiv:1808.03090"},{"key":"bib9","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4012"},{"key":"bib10","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(71)90002-6"},{"key":"bib11","volume-title":"NeurIPS Workshop on Conversational AI","author":"Cuay\u00e1huitl Heriberto","year":"2018"},{"key":"bib12","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-0802"},{"key":"bib13","author":"Dinan Emily","year":"2018","journal-title":"CoRR"},{"key":"bib14","volume-title":"Alexa Prize Proceedings","author":"Fang Hao","year":"2017"},{"key":"bib15","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-5020"},{"key":"bib16","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298754"},{"key":"bib17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01204-5_9"},{"key":"bib18","author":"Fung Pascale","year":"2016","journal-title":"CoRR"},{"key":"bib19","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-2073"},{"key":"bib20","first-page":"3137","volume-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","author":"Gan Chuang","year":"2017"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.1561\/1500000074"},{"key":"bib22","doi-asserted-by":"publisher","DOI":"10.1162\/089120105775299177"},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1002"},{"key":"bib24","first-page":"5111","volume-title":"Proceedings of AAAI","author":"Ghazvininejad Marjan","year":"2018"},{"key":"bib25","author":"Huang Minlie","year":"2019","journal-title":"arXiv preprint arXiv:1905.05709"},{"key":"bib26","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505665"},{"key":"bib27","unstructured":"Huang,\n                                Qiuyuan,                                 Pei Liu,                                 Lei Zhang,                                 Dapeng Wu, and                                 Jianfeng Gao. 2019.                         Interweaved hierarchical neural networks for image                         commenting. Unpublished                     report."},{"key":"bib28","author":"Khatri Chandra","year":"2018","journal-title":"arXiv preprint arXiv:1812.10757"},{"key":"bib29","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1014"},{"key":"bib30","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1094"},{"key":"bib31","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1127"},{"key":"bib32","first-page":"74","volume-title":"Proceedings of the ACL workshop","author":"Lin Chin-Yew","year":"2004"},{"key":"bib33","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1230"},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1103"},{"key":"bib35","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809071"},{"key":"bib36","doi-asserted-by":"publisher","DOI":"10.1037\/h0054346"},{"key":"bib37","first-page":"3574","volume-title":"AAAI","author":"Mathews Alexander Patrick","year":"2016"},{"key":"bib38","first-page":"84","volume-title":"Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue","author":"Misu Teruhisa","year":"2012"},{"key":"bib39","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858116"},{"key":"bib40","first-page":"462","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Mostafazadeh Nasrin","year":"2017"},{"key":"bib41","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni Kishore","year":"2002"},{"key":"bib42","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1237"},{"key":"bib43","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1140.001.0001"},{"key":"bib44","author":"Ram Ashwin","year":"2018","journal-title":"arXiv preprint arXiv:1801.03604"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.131"},{"key":"bib46","first-page":"7281","volume-title":"Proceedings of AAAI 2019","volume":"33","author":"Sai Ananya","year":"2019"},{"key":"bib47","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1101"},{"key":"bib48","first-page":"3776","volume-title":"AAAI","volume":"16","author":"Serban Iulian Vlad","year":"2016"},{"key":"bib49","first-page":"3295","volume-title":"AAAI","author":"Serban Iulian Vlad","year":"2017"},{"key":"bib50","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1152"},{"key":"bib51","doi-asserted-by":"publisher","DOI":"10.3115\/1556328.1556341"},{"key":"bib52","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661935"},{"key":"bib53","author":"Shum Heung-Yeung","year":"2018","journal-title":"CoRR"},{"key":"bib54","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1020"},{"key":"bib55","first-page":"3104","volume-title":"NIPS","author":"Sutskever Ilya","year":"2014"},{"key":"bib56","doi-asserted-by":"crossref","unstructured":"Sutton, Richard\n                                S.,                                 Doina Precup, and                                 Satinder P. Singh.                     1999. Between MDPs and semi-MDPs: A framework for                         temporal abstraction in reinforcement learning.                         Artificial Intelligence,                         112(1\u20132):181\u2013211.                         [An earlier version appeared as Technical Report 98\u201374,                         Department of Computer Science, University of Massachusetts, Amherst, MA                         01003.]","DOI":"10.1016\/S0004-3702(99)00052-1"},{"key":"bib57","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"bib58","volume-title":"ICML Deep Learning Workshop","author":"Vinyals Oriol","year":"2015"},{"key":"bib59","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"bib60","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-6710-5_13"},{"key":"bib61","doi-asserted-by":"publisher","DOI":"10.1145\/365153.365168"},{"key":"bib62","first-page":"652","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers","author":"Wu Bowen","year":"2016"},{"key":"bib63","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9112-1"},{"key":"bib64","first-page":"3351","volume-title":"AAAI","volume":"17","author":"Xing Chen","year":"2017"},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1145\/2835776.2835786"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/coli_a_00368","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:28:29Z","timestamp":1615584509000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/46\/1\/53-93\/93380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3]]},"references-count":65,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,3]]}},"alternative-id":["10.1162\/coli_a_00368"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00368","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3]]}}}