{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T10:49:45Z","timestamp":1782989385469,"version":"3.54.5"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686684","type":"electronic"}],"license":[{"start":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T00:00:00Z","timestamp":1782691200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,6,29]]},"abstract":"<jats:p>Publicly available, large language models (LLMs) can enhance citizen management of their health and chronic illnesses, yet there are few research methods that can be used to understand the technology\u2019s impact upon cognitive processes such as information seeking, decision-making, problem solving and mental model development. Even less research has examined how these cognitive interactions influence subsequent use of the citizens socio-technical system which includes health services (e.g. regional health authorities), community services that support health (e.g. physiotherapy services, pharmacies), visits to health professionals (e.g. physicians, nurse practitioners or physiotherapists) and interactions with informal caregivers (e.g., family, friends). In this paper we outline a methodology we have developed to assess the impacts of LLMs on the cognitive and sociotechnical activities of their users which represents an integration of Think Aloud Protocols with Prompted Reflections called Think-Reflect LLM (TR-LLM). The methodology is described as well as key considerations for data collection and analysis.<\/jats:p>","DOI":"10.3233\/shti260900","type":"book-chapter","created":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T10:02:33Z","timestamp":1782986553000},"source":"Crossref","is-referenced-by-count":0,"title":["Think-Reflect LLM: A Multi-Method Approach to Using Think Aloud Protocol Analysis and Prompted Reflections to Understand LLM Use"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0928-8867","authenticated-orcid":false,"given":"Elizabeth M.","family":"Borycki","sequence":"first","affiliation":[{"name":"School of Health Information Science, University of Victoria, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2557-9288","authenticated-orcid":false,"given":"Andre W.","family":"Kushniruk","sequence":"additional","affiliation":[{"name":"School of Health Information Science, University of Victoria, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","Health Sciences Informatics Leads and Empowers the Digital Health Transformation"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI260900","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T10:02:33Z","timestamp":1782986553000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI260900"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,29]]},"ISBN":["9781643686684"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti260900","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,29]]}}}