{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T09:09:01Z","timestamp":1784020141967,"version":"3.55.0"},"reference-count":150,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T00:00:00Z","timestamp":1756857600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2112633,2442593"],"award-info":[{"award-number":["2112633,2442593"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["P30DA029926"],"award-info":[{"award-number":["P30DA029926"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2025,9,3]]},"abstract":"<jats:p>Passive tracking methods, such as phone and wearable sensing, have become dominant in monitoring human behaviors in modern ubiquitous computing studies. While there have been significant advances in machine-learning approaches to translate periods of raw sensor data to model momentary behaviors, (e.g., physical activity recognition), there still remains a significant gap in the translation of these sensing streams into meaningful, high-level, context-aware insights that are required for various applications (e.g., summarizing an individual's daily routine). To bridge this gap, experts often need to employ a context-driven sensemaking process in real-world studies to derive insights. For instance, current approaches in the field can reliably predict \"walking outdoors\" by contextualizing accelerometer and GPS data. Sensemaking, however, involves being able to notice patterns of periodic \"walking\" and \"stationary\" events, and even infer \"walking the dog\" after realizing the alignment with regular routines reported through surveys or self-reports. This process often requires manual effort and can be challenging even for experienced researchers due to the complexity of human behaviors.<\/jats:p>\n          <jats:p>We conducted three rounds of user studies with 21 experts to explore solutions to address challenges with sensemaking. We follow a human-centered design process to identify needs and design, iterate, build, and evaluate Vital Insight (VI), a novel, LLM-assisted, prototype system to enable human-in-the-loop inference (sensemaking) and visualizations of multimodal passive sensing data from smartphones and wearables. Using the prototype as a technology probe, we observe experts' interactions with it and develop an expert sensemaking model that explains how experts move between direct data representations and AI-supported inferences to explore, question, and validate insights. Through this iterative process, we also synthesize and discuss a list of design implications for the design of future AI-augmented visualization systems to better assist experts' sensemaking processes in multi-modal health sensing data.<\/jats:p>","DOI":"10.1145\/3749508","type":"journal-article","created":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T17:15:45Z","timestamp":1756919745000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-in-the-Loop LLM"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6084-5131","authenticated-orcid":false,"given":"Jiachen","family":"Li","sequence":"first","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3602-0392","authenticated-orcid":false,"given":"Xiwen","family":"Li","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-9880-0021","authenticated-orcid":false,"given":"Justin","family":"Steinberg","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7969-322X","authenticated-orcid":false,"given":"Akshat","family":"Choube","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8329-4610","authenticated-orcid":false,"given":"Bingsheng","family":"Yao","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5930-3899","authenticated-orcid":false,"given":"Xuhai","family":"Xu","sequence":"additional","affiliation":[{"name":"Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9371-9441","authenticated-orcid":false,"given":"Dakuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8486-9384","authenticated-orcid":false,"given":"Elizabeth","family":"Mynatt","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3891-5460","authenticated-orcid":false,"given":"Varun","family":"Mishra","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,9,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI1523_5"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 8(4):1--33","author":"Adler Daniel A","year":"2024","unstructured":"Daniel A Adler, Yuewen Yang, Thalia Viranda, Xuhai Xu, David C Mohr, Anna R Van Meter, Julia C Tartaglia, Nicholas C Jacobson, Fei Wang, Deborah Estrin, et al. Beyond detection: Towards actionable sensing research in clinical mental healthcare. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 8(4):1--33, 2024."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1155\/2023\/9990933"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACIIW59127.2023.10388164"},{"key":"e_1_2_1_5_1","first-page":"3","article-title":"Achieving saturation in thematic analysis: development and refinement of a codebook","author":"Ando Hikari","year":"2014","unstructured":"Hikari Ando, Rosanna Cousins, and Carolyn A. Young. Achieving saturation in thematic analysis: development and refinement of a codebook. Comprehensive Psychology, 3, 2014.","journal-title":"Comprehensive Psychology"},{"key":"e_1_2_1_6_1","first-page":"1","volume-title":"IEEE VIS","volume":"15","author":"Aurisano Jillian","year":"2015","unstructured":"Jillian Aurisano, Abhinav Kumar, Alberto Gonzales, Khairi Reda, Jason Leigh, Barbara Di Eugenio, and Andrew Johnson. Show me data\": Observational study of a conversational interface in visual data exploration. In IEEE VIS, volume 15, page 1, 2015."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12615"},{"key":"e_1_2_1_8_1","volume-title":"Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3):114--123","author":"Bangor Aaron","year":"2009","unstructured":"Aaron Bangor, Philip Kortum, and James Miller. Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3):114--123, 2009."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"e_1_2_1_10_1","unstructured":"Emma Caroline Barrett. The interpretation and exploitation of information in criminal investigations. PhD thesis University of Birmingham 2009."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2971459"},{"key":"e_1_2_1_12_1","first-page":"135","volume-title":"VIS 05","author":"Bavoil Louis","year":"2005","unstructured":"Louis Bavoil, Steven P Callahan, Patricia J Crossno, Juliana Freire, Carlos E Scheidegger, Cl\u00e1udio T Silva, and Huy T Vo. Vistrails: Enabling interactive multiple-view visualizations. In VIS 05. IEEE Visualization, 2005., pages 135--142. IEEE, 2005."},{"key":"e_1_2_1_13_1","volume-title":"Opportunities and challenges in the use of personal health data for health research. Journal of the American Medical Informatics Association, 23(e1):e42-e48","author":"Bietz Matthew J","year":"2016","unstructured":"Matthew J Bietz, Cinnamon S Bloss, Scout Calvert, Job G Godino, Judith Gregory, Michael P Claffey, Jerry Sheehan, and Kevin Patrick. Opportunities and challenges in the use of personal health data for health research. Journal of the American Medical Informatics Association, 23(e1):e42-e48, 2016."},{"key":"e_1_2_1_14_1","volume-title":"Jo Vermeulen, Charles Perin, Wesley Willett, Thomas Ertl, and Sheelagh Carpendale. Exploration strategies for discovery of interactivity in visualizations","author":"Blascheck Tanja","year":"2018","unstructured":"Tanja Blascheck, Lindsay MacDonald Vermeulen, Jo Vermeulen, Charles Perin, Wesley Willett, Thomas Ertl, and Sheelagh Carpendale. Exploration strategies for discovery of interactivity in visualizations. IEEE transactions on visualization and computer graphics, 25(2):1407--1420, 2018."},{"key":"e_1_2_1_15_1","first-page":"1","volume-title":"The 25th Annual International Conference on Mobile Computing and Networking","author":"Boateng George","year":"2019","unstructured":"George Boateng, Vivian Genaro Motti, Varun Mishra, John A Batsis, Josiah Hester, and David Kotz. Experience: Design, development and evaluation of a wearable device for mhealth applications. In The 25th Annual International Conference on Mobile Computing and Networking, pages 1--14, 2019."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13218-015-0349-0"},{"key":"e_1_2_1_17_1","volume-title":"IntechOpen","author":"Bourguet Marie-Luce","year":"2011","unstructured":"Marie-Luce Bourguet. Uncertainty and error handling in pervasive computing: a user's perspective. In Ubiquitous computing. IntechOpen, 2011."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03093.x"},{"key":"e_1_2_1_19_1","volume-title":"Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77","author":"Braun Virginia","year":"2006","unstructured":"Virginia Braun and Victoria Clarke. Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77, 2006."},{"key":"e_1_2_1_20_1","volume-title":"Sus-a quick and dirty usability scale. Usability evaluation in industry, 189(194):4--7","author":"John Brooke","year":"1996","unstructured":"John Brooke et al. Sus-a quick and dirty usability scale. Usability evaluation in industry, 189(194):4--7, 1996."},{"key":"e_1_2_1_21_1","first-page":"157","volume-title":"Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction","author":"Calvillo-G\u00e3mez Eduardo H","year":"2011","unstructured":"Eduardo H Calvillo-G\u00e3mez, Ana I Grimaldo-Mart\u00ednez, V\u00edctor M Gonz\u00e3lez, and Rafael Llamas Contreras. Pamphlet vs. mobile: Sensemaking of health information. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction, pages 157--161, 2011."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.2196\/45556"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-0641-5_7"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSA.2002.1017490"},{"key":"e_1_2_1_25_1","volume-title":"Can large language models be an alternative to human evaluations? arXiv preprint arXiv:2305.01937","author":"Chiang Cheng-Han","year":"2023","unstructured":"Cheng-Han Chiang and Hung-yi Lee. Can large language models be an alternative to human evaluations? arXiv preprint arXiv:2305.01937, 2023."},{"key":"e_1_2_1_26_1","volume-title":"Vedant Das Swain, and Varun Mishra. Gloss: Group of llms for open-ended sensemaking of passive sensing data for health and wellbeing. arXiv preprint arXiv:2507.05461","author":"Choube Akshat","year":"2025","unstructured":"Akshat Choube, Ha Le, Jiachen Li, Kaixin Ji, Vedant Das Swain, and Varun Mishra. Gloss: Group of llms for open-ended sensemaking of passive sensing data for health and wellbeing. arXiv preprint arXiv:2507.05461, 2025."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.2196\/56764"},{"key":"e_1_2_1_28_1","volume-title":"Examining daily activity routines of older adults using workflow. Journal of biomedical informatics, 71:82--90","author":"Chung Jane","year":"2017","unstructured":"Jane Chung, Mustafa Ozkaynak, and George Demiris. Examining daily activity routines of older adults using workflow. Journal of biomedical informatics, 71:82--90, 2017."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00988593"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2016.2628346"},{"key":"e_1_2_1_31_1","volume-title":"Logan Douglas Schneider, et al. Towards a personal health large language model. arXiv preprint arXiv:2406.06474","author":"Cosentino Justin","year":"2024","unstructured":"Justin Cosentino, Anastasiya Belyaeva, Xin Liu, Nicholas A Furlotte, Zhun Yang, Chace Lee, Erik Schenck, Yojan Patel, Jian Cui, Logan Douglas Schneider, et al. Towards a personal health large language model. arXiv preprint arXiv:2406.06474, 2024."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2022.2075637"},{"key":"e_1_2_1_33_1","volume-title":"H is for human and how (not) to evaluate qualitative research in hci. arXiv preprint arXiv:2409.01302","author":"Crabtree Andy","year":"2024","unstructured":"Andy Crabtree. H is for human and how (not) to evaluate qualitative research in hci. arXiv preprint arXiv:2409.01302, 2024."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637528.3671458"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637528.3671882"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/LDAV.2012.6378980"},{"key":"e_1_2_1_37_1","volume-title":"Qualitative Research in Information Management\/Libraries Unlimited","author":"Dervin Brenda","year":"1992","unstructured":"Brenda Dervin. From the mind's eye of the \"user\": The sense-making qualitative-quantitative methodology. Qualitative Research in Information Management\/Libraries Unlimited, 1992."},{"key":"e_1_2_1_38_1","volume-title":"An overview of sense-making research: Concepts, methods, and results to date","author":"Brenda Dervin","year":"1983","unstructured":"Brenda Dervin et al. An overview of sense-making research: Concepts, methods, and results to date. 1983."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2017.7917542"},{"key":"e_1_2_1_40_1","volume-title":"Recognizing grabbing actions from inertial and video sensor data in a warehouse scenario. Procedia computer science, 110:16--23","author":"Diete Alexander","year":"2017","unstructured":"Alexander Diete, Timo Sztyler, Lydia Weiland, and Heiner Stuckenschmidt. Recognizing grabbing actions from inertial and video sensor data in a warehouse scenario. Procedia computer science, 110:16--23, 2017."},{"key":"e_1_2_1_41_1","volume-title":"Tracking human activity and well-being in natural environments using wearable sensors and experience sampling. Social science & medicine, 106:83--92","author":"Doherty Sean T","year":"2014","unstructured":"Sean T Doherty, Christopher J Lemieux, and Culum Canally. Tracking human activity and well-being in natural environments using wearable sensors and experience sampling. Social science & medicine, 106:83--92, 2014."},{"key":"e_1_2_1_42_1","first-page":"10","article-title":"The large language model (llm) bias evaluation (age bias)","author":"Duan Yucong","year":"2024","unstructured":"Yucong Duan. The large language model (llm) bias evaluation (age bias). DIKWP Research Group International Standard Evaluation. DOI, 10, 2024.","journal-title":"DIKWP Research Group International Standard Evaluation. DOI"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45427-6_22"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3659604"},{"key":"e_1_2_1_45_1","volume-title":"A classification of sensemaking representations","author":"Faisal Sarah","year":"2009","unstructured":"Sarah Faisal, Simon Attfield, and Ann Blandford. A classification of sensemaking representations. 2009."},{"key":"e_1_2_1_46_1","volume-title":"Physiollm: Supporting personalized health insights with wearables and large language models. arXiv preprint arXiv:2406.19283","author":"Fang Cathy Mengying","year":"2024","unstructured":"Cathy Mengying Fang, Valdemar Danry, Nathan Whitmore, Andria Bao, Andrew Hutchison, Cayden Pierce, and Pattie Maes. Physiollm: Supporting personalized health insights with wearables and large language models. arXiv preprint arXiv:2406.19283, 2024."},{"key":"e_1_2_1_47_1","first-page":"022013","volume-title":"IOP Conference Series: Materials Science and Engineering","volume":"782","author":"Fang Yujie","unstructured":"Yujie Fang, Hui Xu, and Jie Jiang. A survey of time series data visualization research. In IOP Conference Series: Materials Science and Engineering, volume 782, page 022013. IOP Publishing, 2020."},{"key":"e_1_2_1_48_1","volume-title":"Aging in place: A state survey of livability policies and practices","author":"Farber Nicholas","year":"2011","unstructured":"Nicholas Farber, Douglas Shinkle, Jana Lynott, Wendy Fox-Grage, and Rodney Harrell. Aging in place: A state survey of livability policies and practices. 2011."},{"issue":"1","key":"e_1_2_1_49_1","first-page":"295","article-title":"Interactive prompt engineering for text-to-image creation","volume":"30","author":"Feng Yingchaojie","year":"2024","unstructured":"Yingchaojie Feng, Xingbo Wang, Kam Kwai Wong, Sijia Wang, Yuhong Lu, Minfeng Zhu, Baicheng Wang, and Wei Chen. Prompt-magician: Interactive prompt engineering for text-to-image creation. IEEE Transactions on Visualization and Computer Graphics, 30(1):295--305, 2024.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_1_50_1","doi-asserted-by":"crossref","unstructured":"Emilio Ferrara. Large language models for wearable sensor-based human activity recognition health monitoring and behavioral modeling: A survey of early trends datasets and challenges. arXiv preprint arXiv:2407.07196 2024.","DOI":"10.20944\/preprints202407.0970.v1"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000080"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2010.09.001"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557383"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1097\/00006199-196807000-00014"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1177\/1059601195202007"},{"key":"e_1_2_1_56_1","first-page":"36","article-title":"Large language models are zero-shot time series forecasters","author":"Gruver Nate","year":"2024","unstructured":"Nate Gruver, Marc Finzi, Shikai Qiu, and Andrew G Wilson. Large language models are zero-shot time series forecasters. Advances in Neural Information Processing Systems, 36, 2024.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"59","key":"e_1_2_1_57_1","first-page":"82","article-title":"How many interviews are enough?","volume":"18","author":"Guest Greg","year":"2006","unstructured":"Greg Guest, Arwen E. Bunce, and Laura Johnson. How many interviews are enough? Field Methods, 18:59 - 82, 2006.","journal-title":"Field Methods"},{"key":"e_1_2_1_58_1","volume-title":"Annots: A multi-activity annotation tool for accelerometer data. CommonHealth, 4(2)","author":"Hagen Cole","year":"2023","unstructured":"Cole Hagen, Tessa Johnson, and Shivayogi Hiremath. Annots: A multi-activity annotation tool for accelerometer data. CommonHealth, 4(2), 2023."},{"key":"e_1_2_1_59_1","volume-title":"Information graphics: A comprehensive illustrated reference","author":"Harris Robert L","year":"1999","unstructured":"Robert L Harris. Information graphics: A comprehensive illustrated reference. Oxford University Press, 1999."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-015-3994-4"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.2019.8933766"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518897"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055100"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517351.2517368"},{"key":"e_1_2_1_65_1","first-page":"17","volume-title":"Proceedings of the SIGCHI conference on Human factors in computing systems","author":"Hutchinson Hilary","year":"2003","unstructured":"Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, St\u00e9phane Conversy, Helen Evans, Heiko Hansen, et al. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 17--24, 2003."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.162"},{"key":"e_1_2_1_67_1","volume-title":"Hargpt: Are llms zero-shot human activity recognizers? arXiv preprint arXiv:2403.02727","author":"Ji Sijie","year":"2024","unstructured":"Sijie Ji, Xinzhe Zheng, and Chenshu Wu. Hargpt: Are llms zero-shot human activity recognizers? arXiv preprint arXiv:2403.02727, 2024."},{"key":"e_1_2_1_68_1","volume-title":"ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2016","author":"Jones Simon","year":"2016","unstructured":"Simon Jones and Ryan Kelly. Sensemaking challenges in personal informatics and self-monitoring systems. In ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2016). Association for Computing Machinery, 2016."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-022-00750-2"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3664630"},{"key":"e_1_2_1_71_1","volume-title":"Visualization and visual analysis of multifaceted scientific data: A survey","author":"Kehrer Johannes","year":"2012","unstructured":"Johannes Kehrer and Helwig Hauser. Visualization and visual analysis of multifaceted scientific data: A survey. IEEE transactions on visualization and computer graphics, 19(3):495--513, 2012."},{"key":"e_1_2_1_72_1","volume-title":"Before and beyond trust: reliance in medical ai. Journal of medical ethics, 48(11):852--856","author":"Kerasidou Charalampia Xaroula","year":"2022","unstructured":"Charalampia Xaroula Kerasidou, Angeliki Kerasidou, Monika Buscher, and Stephen Wilkinson. Before and beyond trust: reliance in medical ai. Journal of medical ethics, 48(11):852--856, 2022."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445421"},{"key":"e_1_2_1_74_1","volume-title":"Health-llm: Large language models for health prediction via wearable sensor data. arXiv preprint arXiv:2401.06866","author":"Kim Yubin","year":"2024","unstructured":"Yubin Kim, Xuhai Xu, Daniel McDuff, Cynthia Breazeal, and Hae Won Park. Health-llm: Large language models for health prediction via wearable sensor data. arXiv preprint arXiv:2401.06866, 2024."},{"issue":"1","key":"e_1_2_1_75_1","first-page":"1","article-title":"creative goal-oriented reasoning in smart homes with large language models. Proceedings of the ACM on Interactive, Mobile","volume":"8","author":"King Evan","year":"2024","unstructured":"Evan King, Haoxiang Yu, Sangsu Lee, and Christine Julien. Sasha: creative goal-oriented reasoning in smart homes with large language models. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(1):1--38, 2024.","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_76_1","volume-title":"Making sense of sensemaking 1: Alternative perspectives","author":"Klein Gary","year":"2006","unstructured":"Gary Klein, Brian Moon, and Robert R Hoffman. Making sense of sensemaking 1: Alternative perspectives. IEEE intelligent systems, 21(4):70--73, 2006."},{"key":"e_1_2_1_77_1","first-page":"118","volume-title":"Expertise out of context","author":"Klein Gary","year":"2007","unstructured":"Gary Klein, Jennifer K Phillips, Erica L Rall, and Deborah A Peluso. A data-frame theory of sensemaking. In Expertise out of context, pages 118--160. Psychology Press, 2007."},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","unstructured":"Anastasia Kononova Lin Li Kendra Kamp Marie Bowen RV Rikard Shelia Cotten Wei Peng et al. The use of wearable activity trackers among older adults: focus group study of tracker perceptions motivators and barriers in the maintenance stage of behavior change. JMIR mHealth and uHealth 7(4):e9832 2019.","DOI":"10.2196\/mhealth.9832"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3433987"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA476579"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNS.2009.79"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3061925"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369805"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3714086"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745978"},{"key":"e_1_2_1_86_1","volume-title":"Same task, more tokens: the impact of input length on the reasoning performance of large language models. arXiv preprint arXiv:2402.14848","author":"Levy Mosh","year":"2024","unstructured":"Mosh Levy, Alon Jacoby, and Yoav Goldberg. Same task, more tokens: the impact of input length on the reasoning performance of large language models. arXiv preprint arXiv:2402.14848, 2024."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaaiss.v4i1.31790"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610202"},{"key":"e_1_2_1_89_1","volume-title":"Jian-Yun Nie, and Ji-Rong Wen. Halueval: A large-scale hallucination evaluation benchmark for large language models. arXiv preprint arXiv:2305.11747","author":"Li Junyi","year":"2023","unstructured":"Junyi Li, Xiaoxue Cheng, Wayne Xin Zhao, Jian-Yun Nie, and Ji-Rong Wen. Halueval: A large-scale hallucination evaluation benchmark for large language models. arXiv preprint arXiv:2305.11747, 2023."},{"key":"e_1_2_1_90_1","volume-title":"Paolo Di Achille, and Shwetak Patel. Large language models are few-shot health learners. arXiv preprint arXiv:2305.15525","author":"Liu Xin","year":"2023","unstructured":"Xin Liu, Daniel McDuff, Geza Kovacs, Isaac Galatzer-Levy, Jacob Sunshine, Jiening Zhan, Ming-Zher Poh, Shun Liao, Paolo Di Achille, and Shwetak Patel. Large language models are few-shot health learners. arXiv preprint arXiv:2305.15525, 2023."},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/2387238.2387241"},{"key":"e_1_2_1_92_1","volume-title":"Toby Jia-Jun Li, and Dakuo Wang. Human Still Wins over LLM: An Empirical Study of Active Learning on Domain-Specific Annotation Tasks. arXiv preprint arXiv:2311.09825","author":"Lu Yuxuan","year":"2023","unstructured":"Yuxuan Lu, Bingsheng Yao, Shao Zhang, Yun Wang, Peng Zhang, Tun Lu, Toby Jia-Jun Li, and Dakuo Wang. Human Still Wins over LLM: An Empirical Study of Active Learning on Domain-Specific Annotation Tasks. arXiv preprint arXiv:2311.09825, 2023."},{"key":"e_1_2_1_93_1","volume-title":"Personal discovery in diabetes self-management: discovering cause and effect using self-monitoring data. Journal of biomedical informatics, 76:1--8","author":"Mamykina Lena","year":"2017","unstructured":"Lena Mamykina, Elizabeth M Heitkemper, Arlene M Smaldone, Rita Kukafka, Heather J Cole-Lewis, Patricia G Davidson, Elizabeth D Mynatt, Andrea Cassells, Jonathan N Tobin, and George Hripcsak. Personal discovery in diabetes self-management: discovering cause and effect using self-monitoring data. Journal of biomedical informatics, 76:1--8, 2017."},{"key":"e_1_2_1_94_1","volume-title":"Large language models are geographically biased. arXiv preprint arXiv:2402.02680","author":"Manvi Rohin","year":"2024","unstructured":"Rohin Manvi, Samar Khanna, Marshall Burke, David Lobell, and Stefano Ermon. Large language models are geographically biased. arXiv preprint arXiv:2402.02680, 2024."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2018.8480193"},{"key":"e_1_2_1_96_1","volume-title":"Ashley Mae Conard, and Amanda K. Hall. Ai-enhanced sensemaking: Exploring the design of a generative ai-based assistant to support genetic professionals","author":"Mastrianni Angela","year":"2024","unstructured":"Angela Mastrianni, Hope Twede, Aleksandra Sarcevic, Jeremiah Wander, Christina Austin-Tse, Scott Saponas, Heidi Rehm, Ashley Mae Conard, and Amanda K. Hall. Ai-enhanced sensemaking: Exploring the design of a generative ai-based assistant to support genetic professionals, 2024."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.626960"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01710.x"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.5555\/AAI28771044"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267537"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463492"},{"key":"e_1_2_1_102_1","volume-title":"Continuous detection of physiological stress with commodity hardware. ACM transactions on computing for healthcare, 1(2):1--30","author":"Mishra Varun","year":"2020","unstructured":"Varun Mishra, Gunnar Pope, Sarah Lord, Stephanie Lewia, Byron Lowens, Kelly Caine, Sougata Sen, Ryan Halter, and David Kotz. Continuous detection of physiological stress with commodity hardware. ACM transactions on computing for healthcare, 1(2):1--30, 2020."},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432220"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445290"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365126"},{"key":"e_1_2_1_106_1","volume-title":"On the role of active memory processes in perception and cognition","author":"Norman Donald A","year":"1975","unstructured":"Donald A Norman and Daniel Gureasko Bobrow. On the role of active memory processes in perception and cognition. Center for Human Information Processing, Department of Psychology..., 1975."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2006.70"},{"key":"e_1_2_1_108_1","volume-title":"Towards pervasive computing in health care-a literature review. BMC medical informatics and decision making, 8:1--18","author":"Orwat Carsten","year":"2008","unstructured":"Carsten Orwat, Andreas Graefe, and Timm Faulwasser. Towards pervasive computing in health care-a literature review. BMC medical informatics and decision making, 8:1--18, 2008."},{"key":"e_1_2_1_109_1","volume-title":"Llmsense: Harnessing llms for high-level reasoning over spatiotemporal sensor traces. arXiv preprint arXiv:2403.19857","author":"Ouyang Xiaomin","year":"2024","unstructured":"Xiaomin Ouyang and Mani Srivastava. Llmsense: Harnessing llms for high-level reasoning over spatiotemporal sensor traces. arXiv preprint arXiv:2403.19857, 2024."},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1109\/VIS54172.2023.00014"},{"key":"e_1_2_1_111_1","first-page":"2","volume-title":"Proceedings of international conference on intelligence analysis","volume":"5","author":"Pirolli Peter","year":"2005","unstructured":"Peter Pirolli and Stuart Card. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis, volume 5, pages 2--4. McLean, VA, USA, 2005."},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerComWorkshops51409.2021.9431110"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025804"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2971461"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978945"},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19030448"},{"key":"e_1_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169209"},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11948-020-00228-y"},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055028"},{"key":"e_1_2_1_120_1","first-page":"1","volume-title":"International Journal of Human-Computer Interaction","author":"Schomakers Eva-Maria","year":"2022","unstructured":"Eva-Maria Schomakers and Martina Ziefle. Privacy vs. security: Trade-offs in the acceptance of smart technologies for aging-in-place. International Journal of Human-Computer Interaction, pages 1--16, 2022."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1177\/2055207617740088"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2023.102040"},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3643022"},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1080\/00207543.2023.2221743"},{"key":"e_1_2_1_125_1","volume-title":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA '21","author":"Shen Haifeng","year":"2021","unstructured":"Haifeng Shen, Kewen Liao, Zhibin Liao, Job Doornberg, Maoying Qiao, Anton van den Hengel, and Johan W. Verjans. Human-ai interactive and continuous sensemaking: A case study of image classification using scribble attention maps. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA '21, New York, NY, USA, 2021. Association for Computing Machinery."},{"key":"e_1_2_1_126_1","volume-title":"Towards natural language interfaces for data visualization: A survey","author":"Shen Leixian","year":"2022","unstructured":"Leixian Shen, Enya Shen, Yuyu Luo, Xiaocong Yang, Xuming Hu, Xiongshuai Zhang, Zhiwei Tai, and Jianmin Wang. Towards natural language interfaces for data visualization: A survey. IEEE transactions on visualization and computer graphics, 29(6):3121--3144, 2022."},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860915-0\/50046-9"},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2016.7456521"},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1145\/967900.968153"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2024.3375299"},{"key":"e_1_2_1_131_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2011.6091176"},{"key":"e_1_2_1_132_1","volume-title":"The silence of the llms: Cross-lingual analysis of political bias and false information prevalence in chatgpt, google bard, and bing chat","author":"Urman Aleksandra","year":"2023","unstructured":"Aleksandra Urman and Mykola Makhortykh. The silence of the llms: Cross-lingual analysis of political bias and false information prevalence in chatgpt, google bard, and bing chat. 2023."},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12106"},{"key":"e_1_2_1_134_1","doi-asserted-by":"publisher","DOI":"10.1145\/3402523"},{"key":"e_1_2_1_135_1","volume-title":"joseph is a role model\": Gender biases in llm-generated reference letters. arXiv preprint arXiv:2310.09219","author":"Wan Yixin","year":"2023","unstructured":"Yixin Wan, George Pu, Jiao Sun, Aparna Garimella, Kai-Wei Chang, and Nanyun Peng. \"kelly is a warm person, joseph is a role model\": Gender biases in llm-generated reference letters. arXiv preprint arXiv:2310.09219, 2023."},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191773"},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1109\/TREX53765.2021.00012"},{"key":"e_1_2_1_138_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.03.001"},{"key":"e_1_2_1_139_1","doi-asserted-by":"crossref","unstructured":"Dylan Wootton. Charting EDA: Characterizing Interactive Visualization Use in Computational Notebooks with a Mixed-Methods Formalism. PhD thesis Massachusetts Institute of Technology 2024.","DOI":"10.1109\/TVCG.2024.3456217"},{"key":"e_1_2_1_140_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3099002"},{"key":"e_1_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3714272"},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351274"},{"key":"e_1_2_1_143_1","volume-title":"Drhouse: An llm-empowered diagnostic reasoning system through harnessing outcomes from sensor data and expert knowledge. arXiv preprint arXiv:2405.12541","author":"Yang Bufang","year":"2024","unstructured":"Bufang Yang, Siyang Jiang, Lilin Xu, Kaiwei Liu, Hai Li, Guoliang Xing, Hongkai Chen, Xiaofan Jiang, and Zhenyu Yan. Drhouse: An llm-empowered diagnostic reasoning system through harnessing outcomes from sensor data and expert knowledge. arXiv preprint arXiv:2405.12541, 2024."},{"issue":"2","key":"e_1_2_1_144_1","first-page":"1","article-title":"An llm-based voice assistant for communication between healthcare providers and older adults. Proceedings of the ACM on Interactive, Mobile","volume":"8","author":"Yang Ziqi","year":"2024","unstructured":"Ziqi Yang, Xuhai Xu, Bingsheng Yao, Ethan Rogers, Shao Zhang, Stephen Intille, Nawar Shara, Guodong Gordon Gao, and Dakuo Wang. Talk2care: An llm-based voice assistant for communication between healthcare providers and older adults. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(2):1--35, 2024.","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_145_1","volume-title":"John Stasko, and Julie A Jacko. Toward a deeper understanding of the role of interaction in information visualization","author":"Yi Ji Soo","year":"2007","unstructured":"Ji Soo Yi, Youn ah Kang, John Stasko, and Julie A Jacko. Toward a deeper understanding of the role of interaction in information visualization. IEEE transactions on visualization and computer graphics, 13(6):1224--1231, 2007."},{"key":"e_1_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642237"},{"key":"e_1_2_1_147_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23125"},{"key":"e_1_2_1_148_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642343"},{"key":"e_1_2_1_149_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642343"},{"key":"e_1_2_1_150_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76856-2_64"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3749508","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3749508","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T16:34:55Z","timestamp":1758818095000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3749508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,3]]},"references-count":150,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,3]]}},"alternative-id":["10.1145\/3749508"],"URL":"https:\/\/doi.org\/10.1145\/3749508","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,3]]},"assertion":[{"value":"2025-09-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}