{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:29:38Z","timestamp":1777854578455,"version":"3.51.4"},"reference-count":50,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2022,9,12]],"date-time":"2022-09-12T00:00:00Z","timestamp":1662940800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71774125"],"award-info":[{"award-number":["71774125"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71921002"],"award-info":[{"award-number":["71921002"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72074173"],"award-info":[{"award-number":["72074173"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:p>While previous studies of customer service chat systems (CSCS) understood user satisfaction as individuals\u2019 subjective perceptions and depended heavily on self-report methods for satisfaction measurement, this article presents an obtrusive chat log analysis that followed the established approaches of search log analysis and examined the relationships between dialog patterns and user satisfaction. An 81-day chat log was obtained from a real-world CSCS that involves both a chatbot and human representatives. A total of 75,918 chat sessions\/147,972 sub-sessions containing 251,556 user messages and 349,416 system messages were extracted after data processing and analysed in terms of topic, length and path. As found in this study, the users were more likely to get satisfied on low-difficulty topics. The dialog between the CSCS and users was shallow in general. While human representatives\u2019 elaboration contributed to user satisfaction, the chatbot was responsible for damaging user satisfaction. The significance of this study consists not only in providing objective evidence about user satisfaction in online chat but also in generating practical implications for the CSCS to improve user satisfaction.<\/jats:p>","DOI":"10.1177\/01655515221124066","type":"journal-article","created":{"date-parts":[[2022,9,13]],"date-time":"2022-09-13T02:38:13Z","timestamp":1663036693000},"page":"1541-1556","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":6,"title":["Investigating the relationships between dialog patterns and user satisfaction in customer service chat systems based on chat log analysis"],"prefix":"10.1177","volume":"50","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5310-2073","authenticated-orcid":false,"given":"Tingting","family":"Jiang","sequence":"first","affiliation":[{"name":"School of Information Management, Wuhan University, China; Center for Studies of Information Resources, Wuhan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qian","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Information Management, Wuhan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuhan","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Information Management, Wuhan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qikai","family":"Cheng","sequence":"additional","affiliation":[{"name":"School of Information Management, Wuhan University, China; Center for Studies of Information Resources, Wuhan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0929-7416","authenticated-orcid":false,"given":"Wei","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Information Management, Wuhan University, China; Center for Studies of Information Resources, Wuhan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2022,9,12]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"194","volume-title":"Proceedings of the 5th international conference on internet science (INSCI)","author":"F\u00f8lstad A","unstructured":"F\u00f8lstad A, Nordheim CB, Bj\u00f8rkli CA. What makes users trust a chatbot for customer service? An exploratory interview study. In: Proceedings of the 5th international conference on internet science (INSCI), St. Petersburg, Russia, 24\u201326 October 2018, pp. 194\u2013208. Berlin; Heidelberg: Springer."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2018.10.004"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2019.05.017"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2021.102630"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102415"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-021-01158-4"},{"key":"e_1_3_2_8_2","first-page":"173","volume-title":"Proceedings of the international workshop on chatbot research and design","author":"Van der Goot MJ","unstructured":"Van der Goot MJ, Pilgrim T. Exploring age differences in motivations for and acceptance of chatbot communication in a customer service context. In: Proceedings of the international workshop on chatbot research and design, Amsterdam, 19\u201320 November 2019, pp. 173\u2013186. Berlin; Heidelberg: Springer."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12066"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-02264-7"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.diin.2014.10.001"},{"key":"e_1_3_2_12_2","first-page":"1000","article-title":"Hotspot detection and analysis in chat environment","volume":"6","author":"Devi KN","year":"2016","unstructured":"Devi KN. Hotspot detection and analysis in chat environment. Asian J Res Soc Sci Human 2016; 6: 1000\u20131007.","journal-title":"Asian J Res Soc Sci Human"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102349"},{"key":"e_1_3_2_14_2","first-page":"878","article-title":"Personalised Web search and user satisfaction: a user-centred evaluation","volume":"25","author":"Salehi S","year":"2020","unstructured":"Salehi S, Du JT, Ashman H. Personalised Web search and user satisfaction: a user-centred evaluation. Inform Res 2020; 25: 878.","journal-title":"Inform Res"},{"key":"e_1_3_2_15_2","first-page":"2019","volume-title":"Proceedings of the 22nd ACM international conference on information and knowledge management","author":"Hassan A","unstructured":"Hassan A, Shi X, Craswell N et al. Beyond clicks: query reformulation as a predictor of search satisfaction. In: Proceedings of the 22nd ACM international conference on information and knowledge management, San Francisco, CA, 27 October\u20131 November 2013, pp. 2019\u20132028. New York: Association for Computing Machinery (ACM)."},{"key":"e_1_3_2_16_2","first-page":"143975","volume-title":"Proceedings of the European conference on information systems (ECIS\u20192018)","author":"Gnewuch U","unstructured":"Gnewuch U, Morana S, Adam M et al. Faster is not always better: understanding the effect of dynamic response delays in human-chatbot interaction. In: Proceedings of the European conference on information systems (ECIS\u20192018), Portsmouth, 23\u201328 June 2018, p. 143975. Atlanta: AIS eLibrary."},{"key":"e_1_3_2_17_2","first-page":"1115","volume-title":"Proceedings of the 14th international conference on Wirtschaftsinformatik","author":"Feine J","unstructured":"Feine J, Morana S, Gnewuch U. Measuring service encounter satisfaction with customer service chatbots using sentiment analysis. In: Proceedings of the 14th international conference on Wirtschaftsinformatik, Siegen, 24\u201327 February 2019, pp. 1115\u20131129. Atlanta: AIS eLibrary."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1080\/10919392.2015.1033935"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2012.06.009"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.08.005"},{"key":"e_1_3_2_21_2","first-page":"1642","volume-title":"Proceedings of the 14th international conference on Wirtschaftsinformatik","author":"Rietz T","unstructured":"Rietz T, Benke I, Maedche A. The impact of anthropomorphic and functional chatbot design features in enterprise collaboration systems on user acceptance. In: Proceedings of the 14th international conference on Wirtschaftsinformatik, Siegen, 24\u201327 February 2019, pp. 1642\u20131656. Atlanta: AIS eLibrary."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444821993801."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.04.009"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1177\/0165551520985495."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.107007"},{"key":"e_1_3_2_26_2","first-page":"301","volume-title":"Proceedings of the 2019 conference on human information interaction and retrieval","author":"Elsholz E","unstructured":"Elsholz E, Chamberlain J, Kruschwitz U. Exploring language style in chatbots to increase perceived product value and user engagement. In: Proceedings of the 2019 conference on human information interaction and retrieval, Glasgow, 10\u201314 March 2019, pp. 301\u2013305. New York: Association for Computing Machinery (ACM)."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ausmj.2020.03.005"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.02.026"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.12.039"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20564"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2018.11.003"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2316794"},{"key":"e_1_3_2_33_2","first-page":"35","volume-title":"Proceedings of the 4th ACM international conference on web search and data mining","author":"Teevan J","unstructured":"Teevan J, Ramage D, Morris MR. #TwitterSearch: a comparison of microblog search and web search. In: Proceedings of the 4th ACM international conference on web search and data mining, Hong Kong, China, 9\u201312 February 2011, pp. 35\u201344. New York: Association for Computing Machinery (ACM)."},{"key":"e_1_3_2_34_2","first-page":"4285","volume-title":"Proceedings of the extended abstracts on human factors in computing systems (CHI\u201910)","author":"Jansen BJ","unstructured":"Jansen BJ, Booth D. Classifying web queries by topic and user intent. In: Proceedings of the extended abstracts on human factors in computing systems (CHI\u201910), Atlanta, GA, 10\u201315 April 2010, pp. 4285\u20134290. New York: Association for Computing Machinery (ACM)."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21300"},{"key":"e_1_3_2_36_2","first-page":"801","volume-title":"Proceedings of the 18th international conference on World wide web","author":"Kamvar M","unstructured":"Kamvar M, Kellar M, Patel R et al. Computers and iPhones and mobile phones, oh my! A logs-based comparison of search users on different devices. In: Proceedings of the 18th international conference on World wide web, Madrid, 20\u201324 April 2009, pp. 801\u2013810. New York: Association for Computing Machinery (ACM)."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.acalib.2020.102202"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23782"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2017.04.001"},{"key":"e_1_3_2_40_2","first-page":"66","volume-title":"Proceedings of the international conference on knowledge-based intelligent information and engineering systems and the XVII Italian workshop on neural networks","author":"Ting HI","unstructured":"Ting HI, Clark L, Kimble C et al. APD-A tool for identifying behavioural patterns automatically from clickstream data. In: Proceedings of the international conference on knowledge-based intelligent information and engineering systems and the XVII Italian workshop on neural networks, Vietri sul Mare, 12\u201314 September 2007, pp. 66\u201373. Berlin; Heidelberg: Springer."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.lisr.2017.07.004"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1162\/089120100561737"},{"key":"e_1_3_2_43_2","first-page":"2","volume-title":"Proceedings of the workshops at the 25th AAAI conference on artificial intelligence","author":"Carpenter T","unstructured":"Carpenter T, Fujioka E. The role and identification of dialog acts in online chat. In: Proceedings of the workshops at the 25th AAAI conference on artificial intelligence, San Francisco, CA, 7\u201311 August 2011, pp. 2\u20137. Menlo Park, CA: AAAI Press."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2704"},{"key":"e_1_3_2_45_2","first-page":"363","volume-title":"Proceedings of the international conference on human centered computing","author":"Tang S","unstructured":"Tang S, Liu Q, Tan W-A. Intention classification based on transfer learning: a case study on insurance data. In: Proceedings of the international conference on human centered computing, \u010ca\u010dak, 5\u20137 August 2019, pp. 363\u2013370. Berlin; Heidelberg: Springer."},{"key":"e_1_3_2_46_2","first-page":"8","article-title":"Chi-square test is statistically significant: now what?","volume":"20","author":"Sharpe D","year":"2015","unstructured":"Sharpe D. Chi-square test is statistically significant: now what? Pract Assess Res Eval 2015; 20: 8.","journal-title":"Pract Assess Res Eval"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","unstructured":"Koetter F Blohm M Kochanowski M et al. Motivations classification and model trial of conversational agents for insurance companies 2018 https:\/\/arxiv.org\/abs\/1812.07339","DOI":"10.5220\/0007252100190030"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14505001121"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-011-0228-8"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23617"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.12.011"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515221124066","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01655515221124066","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515221124066","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:09:51Z","timestamp":1777504191000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01655515221124066"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,12]]},"references-count":50,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["10.1177\/01655515221124066"],"URL":"https:\/\/doi.org\/10.1177\/01655515221124066","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,12]]}}}