{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T00:35:18Z","timestamp":1777941318945,"version":"3.51.4"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:00:00Z","timestamp":1736812800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:00:00Z","timestamp":1736812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>To equip new counsellors at a Dutch child helpline with the needed counselling skills, the helpline uses role-playing, a form of learning through simulation in which one counsellor-in-training portrays a child seeking help and the other portrays a counsellor. However, this process is time-intensive and logistically challenging-issues that a conversational agent could help address. In this paper, we propose an initial design for a computer agent that acts as a child help-seeker to be used in a role-play setting. Our agent, Lilobot, is based on a Belief-Desire-Intention (BDI) model to simulate the reasoning process of a child who is being bullied at school. Through interaction with Lilobot, counsellors-in-training can practise the Five Phase Model, a conversation strategy that underpins the helpline\u2019s counselling principle of keeping conversations child-centred. We compared a training session with Lilobot to a text-based training, inviting experienced counsellors from the Dutch child helpline to participate in both sessions. We conducted pre- and post-measurement comparisons for both training sessions. Contrary to our expectations, the results show a decrease in counselling self-efficacy at post-measurement, particularly in Lilobot\u2019s condition. Still, the counsellors\u2019 qualitative feedback indicated that, with further development and refinements, they believed Lilobot could potentially serve as a useful supplementary tool for training new helpline counsellors. Our work also highlights three future research directions for training simulators in this domain: integrating emotions into the model, providing guided feedback to the counsellor, and incorporating Large Language Models (LLMs) into the conversations.<\/jats:p>","DOI":"10.1007\/s10916-024-02121-8","type":"journal-article","created":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:22:07Z","timestamp":1736814127000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Lilobot: A Cognitive Conversational Agent to Train Counsellors at Children\u2019s Helplines"],"prefix":"10.1007","volume":"49","author":[{"given":"Sharon","family":"Grundmann","sequence":"first","affiliation":[]},{"given":"Mohammed","family":"Al Owayyed","sequence":"additional","affiliation":[]},{"given":"Merijn","family":"Bruijnes","sequence":"additional","affiliation":[]},{"given":"Ellen","family":"Vroonhof","sequence":"additional","affiliation":[]},{"given":"Willem-Paul","family":"Brinkman","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,1,14]]},"reference":[{"key":"2121_CR1","doi-asserted-by":"crossref","unstructured":"Axboe, M.K., Christensen, K.S., Kofoed, P.E., et\u00a0al., Development and validation of a self-efficacy questionnaire (se-12) measuring the clinical communication skills of health care professionals. BMC Med. Educ. 16(1):1\u201310, 2016.","DOI":"10.1186\/s12909-016-0798-7"},{"key":"2121_CR2","unstructured":"Bangor, A., Kortum, P., and Miller, J., Determining what individual sus scores mean: Adding an adjective rating scale. J. Usability Stud. 4(3):114\u2013123, 2009."},{"key":"2121_CR3","doi-asserted-by":"crossref","unstructured":"Boivin, M., and Hymel, S., Peer experiences and social self-perceptions: a sequential model. Dev. Psychol. 33(1):135, 1997.","DOI":"10.1037\/\/0012-1649.33.1.135"},{"key":"2121_CR4","doi-asserted-by":"crossref","unstructured":"Braun, V., and Clarke, V., Using thematic analysis in psychology. Qual. Res. Psychol. 3(2):77\u2013101, 2006.","DOI":"10.1191\/1478088706qp063oa"},{"key":"2121_CR5","unstructured":"Brooke, J., et\u00a0al., Sus-a quick and dirty usability scale. Usability Evaluation in Industry 189(194):4\u20137, 1996."},{"key":"2121_CR6","unstructured":"Bruijnes, M., Believable suspect agents: response and interpersonal style selection for an artificial suspect. PhD thesis, University of Twente, 2016."},{"key":"2121_CR7","doi-asserted-by":"crossref","unstructured":"Bruijnes, M., Kesteloo, M., and Brinkman, W.P., Reducing social diabetes distress with a conversational agent support system: a three-week technology feasibility evaluation. Front. Digit. Health 5:1149374, 2023.","DOI":"10.3389\/fdgth.2023.1149374"},{"key":"2121_CR8","unstructured":"Carroll, J., Minimalist design for active users. In: Unknown Host Publication Title. North-Holland, p 39\u201344, 1985."},{"key":"2121_CR9","doi-asserted-by":"crossref","unstructured":"Consorti, F., Mancuso, R., Nocioni, M., et\u00a0al., Efficacy of virtual patients in medical education: A meta-analysis of randomized studies. Comput. Educ. 59(3):1001\u20131008, 2012.","DOI":"10.1016\/j.compedu.2012.04.017"},{"key":"2121_CR10","doi-asserted-by":"crossref","unstructured":"Demasi, O., Li, Y., and Yu, Z., A multi-persona chatbot for hotline counselor training. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp 3623\u20133636, 2020.","DOI":"10.18653\/v1\/2020.findings-emnlp.324"},{"key":"2121_CR11","doi-asserted-by":"crossref","unstructured":"Froehle, T.C., Robinson, S.E., and De\u00a0Kurpius, W.J., Enhancing the effects of modeling through role-play practice. Couns. Educ. Superv. 22(3):197\u2013206, 1983.","DOI":"10.1002\/j.1556-6978.1983.tb01736.x"},{"key":"2121_CR12","doi-asserted-by":"crossref","unstructured":"Glew, G.M., Fan, M.Y., Katon, W., et\u00a0al., Bullying, psychosocial adjustment, and academic performance in elementary school. Arch. Pediatr. Adolesc. Med.159(11):1026\u20131031, 2005.","DOI":"10.1001\/archpedi.159.11.1026"},{"key":"2121_CR13","doi-asserted-by":"crossref","unstructured":"Gratch, J., DeVault, D., and Lucas, G., The benefits of virtual humans for teaching negotiation. In: International Conference on Intelligent Virtual Agents, Springer, pp. 283\u2013294, 2016.","DOI":"10.1007\/978-3-319-47665-0_25"},{"key":"2121_CR14","unstructured":"Grundmann, S., A bdi-based virtual agent for training child helpline counsellors, 2022."},{"key":"2121_CR15","unstructured":"International, C.H., Voices of children and young people in the eu 2018, 2018."},{"key":"2121_CR16","doi-asserted-by":"crossref","unstructured":"Jiang, H., Vidal, J.M., and Huhns, M.N., Ebdi: an architecture for emotional agents. In: Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems, pp 1\u20133, 2007.","DOI":"10.1145\/1329125.1329139"},{"key":"2121_CR17","doi-asserted-by":"publisher","unstructured":"Kang, N., Public speaking in virtual reality: Audience design and speaker experiences. Dissertation (tu delft), Delft University of Technology, 2016. https:\/\/doi.org\/10.4233\/uuid:e920dec8-2b71-4377-bc0f-8f9c950fff42.","DOI":"10.4233\/uuid:e920dec8-2b71-4377-bc0f-8f9c950fff42"},{"key":"2121_CR18","doi-asserted-by":"crossref","unstructured":"Kasneci, E., Se\u00dfler, K., K\u00fcchemann, S., et\u00a0al., Chatgpt for good? on opportunities and challenges of large language models for education. Learn. Individ. Differ. 103:102274, 2023.","DOI":"10.35542\/osf.io\/5er8f"},{"key":"2121_CR19","doi-asserted-by":"crossref","unstructured":"Klomek, A.B., Marrocco, F., Kleinman, M., et\u00a0al., Bullying, depression, and suicidality in adolescents. J. Am. Acad. Child Adolesc. Psychiatry 46(1):40\u201349, 2007.","DOI":"10.1097\/01.chi.0000242237.84925.18"},{"key":"2121_CR20","unstructured":"Koning, D., Ontwerp van een online zelf-assessment voor het meten van de fysieke activiteit bij ouderen tussen de 55 en 75 jaar. Master\u2019s thesis, University of Twente, 2016."},{"key":"2121_CR21","doi-asserted-by":"crossref","unstructured":"Kononowicz, A.A, Woodham, L.A., Edelbring, S., et\u00a0al., Virtual patient simulations in health professions education: systematic review and meta-analysis by the digital health education collaboration. J. Med. Int. Res. 21(7):e14676, 2019.","DOI":"10.2196\/14676"},{"key":"2121_CR22","doi-asserted-by":"crossref","unstructured":"Kruger, J., and Dunning, D., Unskilled and unaware of it: how difficulties in recognizing one\u2019s own incompetence lead to inflated self-assessments. J. Person. Social Psychol. 77(6):1121, 1999.","DOI":"10.1037\/\/0022-3514.77.6.1121"},{"key":"2121_CR23","doi-asserted-by":"crossref","unstructured":"Landis, J.R., and Koch, G.G., The measurement of observer agreement for categorical data. Biometrics 159\u2013174, 1977.","DOI":"10.2307\/2529310"},{"key":"2121_CR24","unstructured":"Langelier CA, and Connell JD (2005) Emotions and learning: Where brain based research and cognitive-behavioral counseling strategies meet the road. Rivier College Online Academic Journal 1(1):1\u201313."},{"key":"2121_CR25","doi-asserted-by":"crossref","unstructured":"Larson, L.M., and Daniels, J.A., Review of the counseling self-efficacy literature. Couns. Psychol. 26(2):179\u2013218, 1998.","DOI":"10.1177\/0011000098262001"},{"key":"2121_CR26","doi-asserted-by":"crossref","unstructured":"Larson, L.M., Suzuki, L.A., Gillespie, K.N., et\u00a0al., Development and validation of the counseling self-estimate inventory. J. Couns. Psychol. 39(1):105, 1992.","DOI":"10.1037\/\/0022-0167.39.1.105"},{"key":"2121_CR27","unstructured":"Lie, H., Design and evaluation of a bdi-based virtual patient for the education of shared decision making. Master\u2019s thesis, Delft University of Technology, 2018."},{"key":"2121_CR28","unstructured":"Lu, D., Emotion model for child helpline training tool. Master\u2019s thesis, Delft University of Technology, 2003."},{"key":"2121_CR29","unstructured":"Maier HW (2002) Role playing: structures and educational objectives. The International Child and Youth Care Network 36."},{"key":"2121_CR30","doi-asserted-by":"crossref","unstructured":"Mascarenhas, S., Dias, J., Prada, R., et\u00a0al., A dimensional model for cultural behavior in virtual agents. Appl. Artif. Intell. 24(6):552\u2013574, 2010.","DOI":"10.1080\/08839514.2010.492163"},{"key":"2121_CR31","doi-asserted-by":"crossref","unstructured":"McHugh, M.L., Interrater reliability: The kappa statistic. Biochemia Med. 22(3):276\u2013282, 2012.","DOI":"10.11613\/BM.2012.031"},{"key":"2121_CR32","unstructured":"Van\u00a0der Meij, H., Principles and heuristics for designing minimalist instruction. Techn. Commun. 42(2):243\u2013261, 1995."},{"key":"2121_CR33","doi-asserted-by":"crossref","unstructured":"Nissen-Lie, H.A., R\u00f8nnestad, M.H., H\u00f8glend, P.A., et\u00a0al., Love yourself as a person, doubt yourself as a therapist? Clin. Psychol. Psychother. 24(1):48\u201360, 2017.","DOI":"10.1002\/cpp.1977"},{"key":"2121_CR34","doi-asserted-by":"crossref","unstructured":"Pereira, D., Oliveira, E., Moreira, N., et\u00a0al., Towards an architecture for emotional bdi agents. In: 2005 portuguese conference on artificial intelligence, IEEE, pp 40\u201346, 2005.","DOI":"10.1109\/EPIA.2005.341262"},{"key":"2121_CR35","doi-asserted-by":"crossref","unstructured":"Rogers, L., Developing simulations in multi-user virtual environments to enhance healthcare education. British J. Educ. Technol. 42(4):608\u2013615, 2011.","DOI":"10.1111\/j.1467-8535.2010.01057.x"},{"key":"2121_CR36","doi-asserted-by":"crossref","unstructured":"Salmi, S., M\u00e9relle, S., Gilissen, R., et\u00a0al., Content-based recommender support system for counselors in a suicide prevention chat helpline: Design and evaluation study. J. Med. Int. Res. 23(1):e21690, 2021.","DOI":"10.2196\/21690"},{"key":"2121_CR37","doi-asserted-by":"publisher","unstructured":"Shorey, S., Ang, E., Yap, J., et\u00a0al., A virtual counseling application using artificial intelligence for communication skills training in nursing education: Development study. J. Med. Int. Res. 21(10), 2019.https:\/\/doi.org\/10.2196\/14658.","DOI":"10.2196\/14658"},{"key":"2121_CR38","unstructured":"Sindahl, T.N., Chat Counselling for Children and Youth - A Handbook, 2011."},{"key":"2121_CR39","unstructured":"Sirocki, J., Design and evaluation of a conversational agent model based on stance and bdi providing situated learning for triage-psychologists in the helpline of 113 suicide prevention. Master\u2019s thesis, Delft University of Technology, 2019."},{"key":"2121_CR40","unstructured":"Stichting De Kindertelefoon, and De Kindertelefoon Jaarverslag 2020, 2020. https:\/\/jaarverslag.kindertelefoon.nl\/2020, Accessed 2-May-2022."},{"key":"2121_CR41","doi-asserted-by":"crossref","unstructured":"Wever, D., Hermens, H., and Vollenbroek-Hutten, M., Differences in use of a exercise-based tele-rehabilitation service delivered as substitute of or supplement to conventional care. In: Sixth International Symposium on E-Health Services and Technologies, pp 44\u201351, 2012.","DOI":"10.5220\/0004473900440051"}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-024-02121-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10916-024-02121-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-024-02121-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:22:30Z","timestamp":1736814150000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10916-024-02121-8"}},"subtitle":["Design and Initial Evaluation"],"short-title":[],"issued":{"date-parts":[[2025,1,14]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2121"],"URL":"https:\/\/doi.org\/10.1007\/s10916-024-02121-8","relation":{},"ISSN":["1573-689X"],"issn-type":[{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,14]]},"assertion":[{"value":"19 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}},{"value":"The experiment was approved by the TU Delft Human Ethics Research Committee (HREC reference number: 1622), and its design was pre-registered on the Open Science Framework (OSF) ahead of data collection","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"Informed consent was obtained from all participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}}],"article-number":"5"}}