{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:59:50Z","timestamp":1776110390921,"version":"3.50.1"},"reference-count":117,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01MH132138"],"award-info":[{"award-number":["R01MH132138"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>Quality patient-provider communication is critical to improve clinical care and patient outcomes. While progress has been made with communication skills training for clinicians, significant gaps exist in how to best monitor, measure, and evaluate the implementation of communication skills in the actual clinical setting. Advancements in ubiquitous technology and natural language processing make it possible to realize more objective, real-time assessment of clinical interactions and in turn provide more timely feedback to clinicians about their communication effectiveness. In this paper, we propose CommSense, a computational sensing framework that combines smartwatch audio and transcripts with natural language processing methods to measure selected \"best-practice'' communication metrics captured by wearable devices in the context of palliative care interactions, including understanding, empathy, presence, emotion, and clarity. We conducted a pilot study involving N=40 clinician participants, to test the technical feasibility and acceptability of CommSense in a simulated clinical setting. Our findings demonstrate that CommSense effectively captures most communication metrics and is well-received by both practicing clinicians and student trainees. Our study also highlights the potential for digital technology to enhance communication skills training for healthcare providers and students, ultimately resulting in more equitable delivery of healthcare and accessible, lower cost tools for training with the potential to improve patient outcomes.<\/jats:p>","DOI":"10.1145\/3686952","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["CommSense: A Wearable Sensing Computational Framework for Evaluating Patient-Clinician Interactions"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1611-2053","authenticated-orcid":false,"given":"Zhiyuan","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5237-1831","authenticated-orcid":false,"given":"Nusayer","family":"Hassan","sequence":"additional","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1299-4730","authenticated-orcid":false,"given":"Virginia","family":"LeBaron","sequence":"additional","affiliation":[{"name":"School of Nursing, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8820-2536","authenticated-orcid":false,"given":"Tabor","family":"Flickinger","sequence":"additional","affiliation":[{"name":"School of Medicine, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1536-980X","authenticated-orcid":false,"given":"David","family":"Ling","sequence":"additional","affiliation":[{"name":"School of Medicine, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8728-192X","authenticated-orcid":false,"given":"James","family":"Edwards","sequence":"additional","affiliation":[{"name":"School of Nursing, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6410-1375","authenticated-orcid":false,"given":"Congyu","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6295-2523","authenticated-orcid":false,"given":"Mehdi","family":"Boukhechba","sequence":"additional","affiliation":[{"name":"Johnson &amp; Johnson Innovative Medicine, Titusville, NJ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8224-5164","authenticated-orcid":false,"given":"Laura E.","family":"Barnes","sequence":"additional","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"373","article-title":"Writing and designing readable patient education materials","volume":"31","author":"Aldridge Michael D","year":"2004","unstructured":"Michael D Aldridge. 2004. Writing and designing readable patient education materials. Nephrology Nursing Journal, Vol. 31, 4 (2004), 373--377.","journal-title":"Nephrology Nursing Journal"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2589--7500(23)00048--1"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpain.2009.10.002"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/med\/9780198736134.003.0056"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.19.00128"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.167.5.453"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.cco.0000167738.49325.2c"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2014.5271"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/oncolo\/oyac238"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12875-015-0374-y"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","unstructured":"Mehdi Boukhechba and Laura E Barnes. 2020. Swear: Sensing using wearables. Generalized human crowdsensing on smartwatches. In Advances in Usability User Experience Wearable and Assistive Technology: Proceedings of the AHFE 2020 Virtual Conferences on Usability and User Experience Human Factors and Assistive Technology Human Factors and Wearable Technologies and Virtual Environments and Game Design July 16--20 2020 USA. Springer 510--516. https:\/\/doi.org\/10.1007\/978--3-030--51828--8_67","DOI":"10.1007\/978--3-030--51828--8_67"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.soncn.2017.10.003"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2104.04045"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2017.04.008"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2005.14165"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/02687038.2012.676864"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s005200100290"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1097\/00006199-196905000-00007"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.34133\/2021\/9819851"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/1827074"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979438"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e3181edfe13"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","unstructured":"Malcolm Cox Patricia Cuff Barbara Brandt Scott Reeves and Brenda Zierler. 2016. Measuring the impact of interprofessional education on collaborative practice and patient outcomes. 3 pages. https:\/\/doi.org\/10.3109\/13561820.2015.1111052","DOI":"10.3109\/13561820.2015.1111052"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2013.282081"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--47665-0_53"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.296.9.1094"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1101\/2021.08.20.21262082"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-015-0856-x"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1810.04805"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13073-019-0689--8"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359259"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooad009"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2015.07.008"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-012--2077--6"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1188\/20.CJON.547--553"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-012--9168-0"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2022.10.251"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1097\/NJH.0000000000000493"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2018.0487"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2017.75.2311"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1188\/13.CJON.163--167"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1525--1497.2003.21017.x"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020--2669-y"},{"key":"e_1_2_1_44_1","unstructured":"Harvard Medical School. 2023. Harvard Medical Dictionary. https:\/\/www.health.harvard.edu\/a-through-c. Accessed: 2022--12--26."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2012.658897"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","unstructured":"Paul A Hemmer and Reena Karani. 2019. Let's face it: we are biased and it should not be that way. 649--651 pages. https:\/\/doi.org\/10.1007\/s11606-019-04923-w","DOI":"10.1007\/s11606-019-04923-w"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaa8685"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i14.17539"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.22992"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcna.2019.12.001"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1186\/1472--6947--14--94"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460636"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2010.2065210"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888--200308000-00011"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2020.0022"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2010.5560598"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.2196\/36879"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.2196\/37975"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1177\/20552076231184991"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2019.09.017"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.19.5.112"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2018.0326"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2013.0214"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1097\/MPH.0b013e318230dfb4"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2021.18459"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinternmed.2010.322"},{"key":"e_1_2_1_67_1","unstructured":"Mahhos. 2023. Empathy. https:\/\/github.com\/Mahhos\/Empathy."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2007.025247"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.21037\/apm.2019.03.03"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1002\/pon.3317"},{"key":"e_1_2_1_71_1","unstructured":"Julian McAuley. 2023. Amazon Question\/Answer data. https:\/\/cseweb.ucsd.edu\/ jmcauley\/datasets\/amazon\/qa\/."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmh730"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-clinpsy-032816-044949"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1111\/josl.1_12177"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD003751.pub4"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMcp035232"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1037\/1089--2680.2.2.175"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445383"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.PERVASIVEHEALTH2009.6033"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2020.0067"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1002\/cam4.3102"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2014.55.5060"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.33546\/bnj.2789"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2000.0070453"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1148\/rg.2018180034"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3434170"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2007.10.002"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382892"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1007\/0--306--48019--13"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2010.1455"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2019.11.021"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/s0738--3991(02)00012--5"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2019.0335"},{"key":"e_1_2_1_94_1","unstructured":"Daniel L Schacter. 2002. The Seven Sins of Memory: How the Mind Forgets and Remembers. HMH."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2021.07.024"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11948-017--9872--8"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.zefq.2012.07.018"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.suc.2019.06.011"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1177\/136346150203900202"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2022--100731"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12528-022-09313--6"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2007.11.010"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.12688\/wellcomeopenres.15042.1"},{"key":"e_1_2_1_105_1","first-page":"44","article-title":"Natural language processing and clinical outcomes: the promise and progress of NLP for improved care","volume":"84","author":"Townsend Hilary","year":"2013","unstructured":"Hilary Townsend. 2013. Natural language processing and clinical outcomes: the promise and progress of NLP for improved care. Journal of AHIMA, Vol. 84, 2 (2013), 44--45.","journal-title":"Journal of AHIMA"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1080\/09546634.2017.1309348"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1002\/adhm.202100127"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2017.2005"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M3000"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1111\/ijcp.12686"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0060"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2022.3161046"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2017.09.012"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.soncn.2018.06.007"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15--1091"},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.1109\/TALE54877.2022.00071"},{"key":"e_1_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e31819a5accshowDOIt"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686952","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686952","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:24:51Z","timestamp":1755768291000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686952"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":117,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3686952"],"URL":"https:\/\/doi.org\/10.1145\/3686952","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}