{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T06:26:29Z","timestamp":1792823189394,"version":"4.5.0"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Cancer Institute of the National Institutes of Health","award":["R01CA252966"],"award-info":[{"award-number":["R01CA252966"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,8,22]]},"abstract":"<jats:p>\u03bcEMA is a data collection method that prompts research participants with quick, answer-at-a-glance, single-multiple-choice self-report behavioral questions, thus enabling high-temporal-density self-report of up to four times per hour when implemented on a smartwatch. However, due to the small watch screen, \u03bcEMA is better used to select among 2 to 5 multiple-choice answers versus allowing the collection of open-ended responses. We introduce an alternative and novel form of micro-interaction self-report using speech input - audio-\u03bcEMA- where a short beep or vibration cues participants to verbally report their behavioral states, allowing for open-ended, temporally dense self-reports. We conducted a one-hour usability study followed by a within-subject, 6-day to 21-day free-living feasibility study in which participants self-reported their physical activities and postures once every 2 to 5 minutes. We qualitatively explored the usability of the system and identified factors impacting the response rates of this data collection method. Despite being interrupted 12 to 20 times per hour, participants in the free-living study were highly engaged with the system, with an average response rate of 67.7% for audio-\u03bcEMA for up to 14 days. We discuss the factors that impacted feasibility; some implementation, methodological, and participant challenges we observed; and important considerations relevant to deploying audio-\u03bcEMA in real-time activity recognition systems.<\/jats:p>","DOI":"10.1145\/3678584","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T14:36:21Z","timestamp":1725892581000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Collecting Self-reported Physical Activity and Posture Data Using Audio-based Ecological Momentary Assessment"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-8942-5364","authenticated-orcid":false,"given":"Ha","family":"Le","sequence":"first","affiliation":[{"name":"Khoury College of Computer Sciences, Northeastern University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3720-9206","authenticated-orcid":false,"given":"Rithika","family":"Lakshminarayanan","sequence":"additional","affiliation":[{"name":"Khoury College of Computer Sciences and Bouv\u00e9 College of Health Sciences, Northeastern University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5581-0065","authenticated-orcid":false,"given":"Jixin","family":"Li","sequence":"additional","affiliation":[{"name":"Khoury College of Computer Sciences and Bouv\u00e9 College of Health Sciences, Northeastern University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3891-5460","authenticated-orcid":false,"given":"Varun","family":"Mishra","sequence":"additional","affiliation":[{"name":"Khoury College of Computer Sciences and Bouv\u00e9 College of Health Sciences, Northeastern University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0287-2553","authenticated-orcid":false,"given":"Stephen","family":"Intille","sequence":"additional","affiliation":[{"name":"Khoury College of Computer Sciences and Bouv\u00e9 College of Health Sciences, Northeastern University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,9,9]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351228"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.3390\/s22186881"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448090"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581265"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP49357.2023.10095793"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569504"},{"key":"e_1_2_2_7_1","unstructured":"Andrew Asuncion and David Newman. UCI machine learning repository. https:\/\/archive.ics.uci.edu\/dataset\/240\/human+activity+recognition+using+smartphones"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3410530.3414366"},{"key":"e_1_2_2_9_1","volume-title":"Retrieved","author":"AWARE.","year":"2019","unstructured":"AWARE. 2019. AWARE: Open-source context instrumentation framework for everyone. Retrieved September 10, 2021 from https:\/\/awareframework.com\/"},{"key":"e_1_2_2_10_1","volume-title":"Determining what individual SUS scores mean: Adding an adjective rating scale","author":"Bangor Aaron","year":"2009","unstructured":"Aaron Bangor. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Usability Professionals' Association, 4, 3 (2009)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24646-6_1"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341163.3347735"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130902"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.201600523"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACIIW.2019.8925104"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461615.3485670"},{"key":"e_1_2_2_18_1","unstructured":"John Brooke. SUS - A quick and dirty usability scale."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3382507.3418826"},{"key":"e_1_2_2_20_1","volume-title":"Retrieved","author":"Chatterjee Soumyajit","year":"2022","unstructured":"Soumyajit Chatterjee, Arun Singh, Bivas Mitra, and Sandip Chakraborty. 2022. Accoustate: Auto-annotation of IMU-generated activity signatures under smart infrastructure. Retrieved September 19, 2023 from http:\/\/arxiv.org\/abs\/2112.06651"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597638.3608378"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462456.2464438"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2003.1203750"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME55011.2023.00110"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2011.05.002"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2014.01.048"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1026653.1026659"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2905207"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/1541931218621313"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01842"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2012.11.010"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597638.3608419"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971717"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2023.2219259"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2021.04.062"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/computers2020088"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2012.11.006"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2012.11.004"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517457"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130930"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1080\/02640414.2016.1161218"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-059871"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341163.3347744"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550293"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462074"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376616"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462145"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3484508"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432230"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721416680611"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3211960.3211970"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSensT.2016.7796224"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550284"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581392"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI.2016.7850188"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517259"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.2196\/23391"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","unstructured":"Aditya Ponnada Shirlene Wang Daniel Chu Bridgette Do Genevieve Dunton and Stephen Intille. 2021. Intensive longitudinal data collection using microinteraction ecological momentary assessment: Pilot and preliminary results. JMIR Formative Research. https:\/\/doi.org\/10.2196\/preprints.32772","DOI":"10.2196\/preprints.32772"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373759"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369806"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550314"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501908"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161187"},{"key":"e_1_2_2_65_1","unstructured":"Ibrahim1 Sheriff Jamin Patel and Tarun Katapally. 2023. Digital citizen science for ethical surveillance of physical activity among youth: mobile ecological momentary assessments vs. retrospective recall. Retrieved from https:\/\/arxiv.org\/pdf\/2308.10626.pdf"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3604256"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-29666-x"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1023657221954"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-87757-z"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.17760\/D20416559"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1249\/MSS.0000000000002973"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701405"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2017.3971131"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161192"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632054"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517432"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569485"},{"key":"e_1_2_2_79_1","unstructured":"Shokz Inc. Retrieved from https:\/\/shokz.com\/"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678584","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3678584","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T14:42:06Z","timestamp":1755787326000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678584"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"references-count":79,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,8,22]]}},"alternative-id":["10.1145\/3678584"],"URL":"https:\/\/doi.org\/10.1145\/3678584","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,22]]},"assertion":[{"value":"2023-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}