{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T10:37:25Z","timestamp":1771670245013,"version":"3.50.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"crossref","award":["(A) 17H00771"],"award-info":[{"award-number":["(A) 17H00771"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>Chatbots are regarded as a promising technology for delivering guidance. Prior studies show that chatbots have the potential of coaching users to learn different skills; however, several limitations of chatbot-based approaches remain. People may become disengaged from using chatbot-guided systems and fail to follow the guidance for complex tasks. In this paper, we design chatbots with (HC) and without (OC) human support to deliver guidance for people to practice journaling skills. We conducted a mixed-method study with 35 participants to investigate their actual interaction, perceived interaction, and the effects of interacting with the two chatbots. The participants were randomly assigned to use one of the chatbots for four weeks. Our results show that the HC participants followed the guidance more faithfully during journaling practices and perceived a significantly higher level of engagement and trust with the chatbot system than the OC participants. However, after finishing the journaling-skill training session, the OC participants were more willing to keep using the learned skills than the HC participants. Our work provides new insights into the design of integrating human support into chatbot-based interventions for delivering guidance.<\/jats:p>","DOI":"10.1145\/3449196","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:47:59Z","timestamp":1619113679000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Exploring the Effects of Incorporating Human Experts to Deliver Journaling Guidance through a Chatbot"],"prefix":"10.1145","volume":"5","author":[{"given":"Yi-Chieh","family":"Lee","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign &amp; NTT Communication Science Laboratories, Champaign, IL, USA"}]},{"given":"Naomi","family":"Yamashita","sequence":"additional","affiliation":[{"name":"NTT Communication Science Laboratories, Keihanna, Japan"}]},{"given":"Yun","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Champaign, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive behaviour therapy","author":"Andersson Gerhard","year":"2009","unstructured":"Gerhard Andersson and Pim Cuijpers. 2009. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive behaviour therapy, Vol. 38, 4 (2009), 196--205."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146167297234003"},{"key":"e_1_2_1_3_1","volume-title":"Emotional and physical health benefits of expressive writing. Advances in psychiatric treatment","author":"Baikie Karen A","year":"2005","unstructured":"Karen A Baikie and Kay Wilhelm. 2005. Emotional and physical health benefits of expressive writing. Advances in psychiatric treatment, Vol. 11, 5 (2005), 338--346."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1089\/cpb.2006.9938"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00065"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.57.5.792"},{"key":"e_1_2_1_7_1","unstructured":"Timothy Bickmore and Justine Cassell. 1999. Small talk and conversational storytelling in embodied conversational interface agents. In AAAI fall symposium on narrative intelligence. 87--92."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/08839514.2010.492259"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2005.09.002"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/HCI2017.24"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173765"},{"key":"e_1_2_1_12_1","volume-title":"Self-disclosure: a literature review. Psychological bulletin","author":"Cozby Paul C","year":"1973","unstructured":"Paul C Cozby. 1973. Self-disclosure: a literature review. Psychological bulletin, Vol. 79, 2 (1973), 73."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/cou0000107"},{"key":"e_1_2_1_14_1","first-page":"1","article-title":"A self-diagnosis medical chatbot using artificial intelligence","volume":"3","author":"Divya S","year":"2018","unstructured":"S Divya, V Indumathi, S Ishwarya, M Priyasankari, and S Kalpana Devi. 2018. A self-diagnosis medical chatbot using artificial intelligence. Journal of Web Development and Web Designing, Vol. 3, 1 (2018), 1--7.","journal-title":"Journal of Web Development and Web Designing"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188600"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2458-14-807"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2196\/mental.7785"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.2196\/16762"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.10159"},{"key":"e_1_2_1_20_1","volume-title":"Development and validation of the situational self-awareness scale. Consciousness and cognition","author":"Govern John M","year":"2001","unstructured":"John M Govern and Lisa A Marsch. 2001. Development and validation of the situational self-awareness scale. Consciousness and cognition, Vol. 10, 3 (2001), 366--378."},{"key":"e_1_2_1_21_1","volume-title":"The self-reflection and insight scale: A new measure of private self-consciousness. Social Behavior and Personality: an international journal","author":"Grant Anthony M","year":"2002","unstructured":"Anthony M Grant, John Franklin, and Peter Langford. 2002. The self-reflection and insight scale: A new measure of private self-consciousness. Social Behavior and Personality: an international journal, Vol. 30, 8 (2002), 821--835."},{"key":"e_1_2_1_22_1","volume-title":"Journaling: Identification of challenges and reflection on strategies. Nurse researcher","author":"Hayman Brenda","year":"2012","unstructured":"Brenda Hayman, Lesley Wilkes, and Debra Jackson. 2012. Journaling: Identification of challenges and reflection on strategies. Nurse researcher, Vol. 19, 3 (2012)."},{"key":"e_1_2_1_23_1","volume-title":"Self-Disclosure","author":"Hill Charles T","unstructured":"Charles T Hill and Donald E Stull. 1987. Gender and self-disclosure. In Self-Disclosure. Springer, 81--100."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1511\/2019.107.2.86"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/105382590502800107"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675252"},{"key":"e_1_2_1_27_1","volume-title":"International Journal of Human-Computer Interaction","author":"Jang Jinkyu","year":"2019","unstructured":"Jinkyu Jang and Jinwoo Kim. 2019. Healthier Life with Digital Companions: Effects of Reflection-Level and Statement-Type of Messages on Behavior Change via a Perceived Companion. International Journal of Human-Computer Interaction (2019), 1--18."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025750"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214273"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1178222619829083"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2010.41"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300932"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2017.02.005"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392836"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376175"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2017.00051"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274383"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3322340"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0022575"},{"key":"e_1_2_1_40_1","volume-title":"Key considerations for incorporating conversational AI in psychotherapy. Frontiers in psychiatry","author":"Miner Adam S","year":"2019","unstructured":"Adam S Miner, Nigam Shah, Kim D Bullock, Bruce A Arnow, Jeremy Bailenson, and Jeff Hancock. 2019. Key considerations for incorporating conversational AI in psychotherapy. Frontiers in psychiatry, Vol. 10 (2019)."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1602"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/191666.191703"},{"key":"e_1_2_1_43_1","volume-title":"A foundation for the study of behavior change support systems. Personal and ubiquitous computing","author":"Oinas-Kukkonen Harri","year":"2013","unstructured":"Harri Oinas-Kukkonen. 2013. A foundation for the study of behavior change support systems. Personal and ubiquitous computing, Vol. 17, 6 (2013), 1223--1235."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.01.004"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.2202\/1940-1639.1042"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.2196\/12231"},{"key":"e_1_2_1_47_1","first-page":"23","article-title":"Expressive writing in a clinical setting","volume":"30","author":"Pennebaker James W","year":"2010","unstructured":"James W Pennebaker. 2010. Expressive writing in a clinical setting. The Independent Practitioner, Vol. 30 (2010), 23--25.","journal-title":"The Independent Practitioner"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-019-1237-1"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/mpr.1349"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5030"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.alcohol.2015.05.001"},{"key":"e_1_2_1_52_1","volume-title":"Emily G Lattie, and David C Mohr.","author":"Schueller Stephen M","year":"2016","unstructured":"Stephen M Schueller, Kathryn Noth Tomasino, Emily G Lattie, and David C Mohr. 2016. Human support for behavioral intervention technologies for mental health: the efficiency model. management, Vol. 21 (2016), 22."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/cpsp.12173"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.5"},{"key":"e_1_2_1_55_1","volume-title":"Positive psychology progress: empirical validation of interventions. American psychologist","author":"Seligman Martin EP","year":"2005","unstructured":"Martin EP Seligman, Tracy A Steen, Nansook Park, and Christopher Peterson. 2005. Positive psychology progress: empirical validation of interventions. American psychologist, Vol. 60, 5 (2005), 410."},{"key":"e_1_2_1_56_1","volume-title":"How to increase and sustain positive emotion: The effects of expressing gratitude and visualizing best possible selves. The journal of positive psychology","author":"Sheldon Kennon M","year":"2006","unstructured":"Kennon M Sheldon and Sonja Lyubomirsky. 2006. How to increase and sustain positive emotion: The effects of expressing gratitude and visualizing best possible selves. The journal of positive psychology, Vol. 1, 2 (2006), 73--82."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376843"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267851.3267909"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/15401383.2011.557312"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/FADS.2017.8253198"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376561"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2958.1977.tb00523.x"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173662"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376781"},{"key":"e_1_2_1_65_1","volume-title":"Beyond Mobile Apps: A Survey of Technologies for Mental Well-being. arXiv preprint arXiv:1905.00288","author":"Woodward Kieran","year":"2019","unstructured":"Kieran Woodward, Eiman Kanjo, David Brown, T Martin McGinnity, Becky Inkster, Donald J Macintyre, and Athanasios Tsanas. 2019. Beyond Mobile Apps: A Survey of Technologies for Mental Well-being. arXiv preprint arXiv:1905.00288 (2019)."},{"key":"e_1_2_1_66_1","volume-title":"Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys. arXiv preprint arXiv:1905.10700","author":"Xiao Ziang","year":"2019","unstructured":"Ziang Xiao, Michelle X Zhou, Q Vera Liao, Gloria Mark, Changyan Chi, Wenxi Chen, and Huahai Yang. 2019. Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys. arXiv preprint arXiv:1905.10700 (2019)."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMR.2018.8333308"},{"key":"e_1_2_1_68_1","volume-title":"Validating the Equivalency of Trust in Human-Robot Healthcare Scenarios. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 442--447","author":"Xu Jin","year":"2018","unstructured":"Jin Xu, G Bryant De'Aira, and Ayanna Howard. 2018a. Would You Trust a Robot Therapist? Validating the Equivalency of Trust in Human-Robot Healthcare Scenarios. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 442--447."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.2196\/22845"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449196","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449196","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:17Z","timestamp":1750191497000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":69,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449196"],"URL":"https:\/\/doi.org\/10.1145\/3449196","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}