{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T06:44:43Z","timestamp":1767854683318,"version":"3.49.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2017-06618"],"award-info":[{"award-number":["RGPIN-2017-06618"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2023,9,27]]},"abstract":"<jats:p>Prior work has shown the utility of acoustic analysis in controlled settings for assessing chronic obstructive pulmonary disease (COPD) --- one of the most common respiratory diseases that impacts millions of people worldwide. However, such assessments require active user input and may not represent the true characteristics of a patient's voice. We propose PulmoListener, an end-to-end speech processing pipeline that identifies segments of the patient's speech from smartwatch audio collected during daily living and analyzes them to classify COPD symptom severity. To evaluate our approach, we conducted a study with 8 COPD patients over 164 \u00b1 92 days on average. We found that PulmoListener achieved an average sensitivity of 0.79 \u00b1 0.03 and a specificity of 0.83 \u00b1 0.05 per patient when classifying their symptom severity on the same day. PulmoListener can also predict the severity level up to 4 days in advance with an average sensitivity of 0.75 \u00b1 0.02 and a specificity of 0.74 \u00b1 0.07. The results of our study demonstrate the feasibility of leveraging natural speech for monitoring COPD in real-world settings, offering a promising solution for disease management and even diagnosis.<\/jats:p>","DOI":"10.1145\/3610889","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T15:45:03Z","timestamp":1695829503000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["PulmoListener"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4772-7815","authenticated-orcid":false,"given":"Sejal","family":"Bhalla","sequence":"first","affiliation":[{"name":"University of Toronto, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6193-2614","authenticated-orcid":false,"given":"Salaar","family":"Liaqat","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6895-1107","authenticated-orcid":false,"given":"Robert","family":"Wu","sequence":"additional","affiliation":[{"name":"University Health Network, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0246-594X","authenticated-orcid":false,"given":"Andrea S.","family":"Gershon","sequence":"additional","affiliation":[{"name":"Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6730-555X","authenticated-orcid":false,"given":"Eyal","family":"de Lara","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Ontario, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9986-3345","authenticated-orcid":false,"given":"Alex","family":"Mariakakis","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Canada"}]}],"member":"320","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1136\/thoraxjnl-2011-200768"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3223444"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2019.8771072"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381014"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-106-2-196"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494994"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRAIE.2016.7939548"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376444"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1089\/tmj.2017.0008"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerCom45495.2020.9127380"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1136\/thx.2010.139881"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2022.105037"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683887"},{"key":"e_1_2_2_15_1","volume-title":"Smartwatch adoption rate among consumers in the United States from 2013 to","year":"2018","unstructured":"Deloitte. 2018. Smartwatch adoption rate among consumers in the United States from 2013 to 2018. https:\/\/www2.deloitte.com\/content\/dam\/Deloitte\/us\/Documents\/technology-media-telecommunications\/us-tmt-global-mobile-consumer-survey-extended-deck-2018.pdf."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2004.1326145"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874246"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/app11177999"},{"key":"e_1_2_2_19_1","unstructured":"Global Initiative for Chronic Obstructive Lung Disease. 2019. Global strategy for the diagnosis management and prevention of chronic obstructive pulmonary disease 2019 report. https:\/\/goldcopd.org\/wp-content\/uploads\/2018\/11\/GOLD-2019-v1.7-FINAL-14Nov2018- WMS.pdf."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1513\/AnnalsATS.201708-685MG"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858401"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP39728.2021.9414576"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2211.04060"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2017.09.027"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478123"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","unstructured":"Ju-ho Kim Jungwoo Heo Hye-jin Shim and Ha-Jin Yu. 2022. Extended U-Net for Speaker Verification in Noisy Environments. (2022). https:\/\/doi.org\/10.48550\/ARXIV.2206.13044 Publisher: arXiv Version Number: 1.","DOI":"10.48550\/ARXIV.2206.13044"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370261"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","unstructured":"Chao Li Xiaokong Ma Bing Jiang Xiangang Li Xuewei Zhang Xiao Liu Ying Cao Ajay Kannan and Zhenyao Zhu. 2017. Deep Speaker: an End-to-End Neural Speaker Embedding System. (2017). https:\/\/doi.org\/10.48550\/ARXIV.1705.02304 Publisher: arXiv Version Number: 1.","DOI":"10.48550\/ARXIV.1705.02304"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP39728.2021.9414881"},{"key":"e_1_2_2_30_1","unstructured":"Julia Merkus Ferdy Hubers Catia Cucchiarini and Helmer Strik. 2020. Digital Eavesdropper -Acoustic Speech Characteristics as Markers of Exacerbations in COPD Patients."},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Ben P. Milner Jonathan Darch and Ibrahim Almajai. 2009. Reconstructing clean speech from noisy MFCC vectors. In Interspeech.","DOI":"10.21437\/Interspeech.2009-572"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chest.2021.07.1920"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP43922.2022.9747785"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2019.8771043"},{"key":"e_1_2_2_35_1","volume-title":"Estimation of the Lung Function Using Acoustic Features of the Voluntary Cough. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)","author":"Nemati Ebrahim","year":"2020","unstructured":"Ebrahim Nemati, Md. Juber Rahman, Erin Blackstock, Viswam Nathan, Md. Mahbubur Rahman, Korosh Vatanparvar, and Jilong Kuang. 2020. Estimation of the Lung Function Using Acoustic Features of the Voluntary Cough. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE, Montreal, QC, Canada, 4491--4497. https:\/\/doi.org\/10.1109\/ EMBC44109.2020.9175986"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSPCS.2010.5709770"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2015.7178964"},{"key":"e_1_2_2_38_1","unstructured":"K Pearsons R Bennett and S Fidell. 1977. Speech levels in various noise environments."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806390"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3382507.3418852"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerCom45495.2020.9127355"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-29897-5_22"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC44109.2020.9175597"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2015.7146519"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7953222"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1164\/rccm.201710-2029OC"},{"key":"e_1_2_2_47_1","volume-title":"visualizing, and quantifying latent structure across diverse animal vocal repertoires. PLoS computational biology 16, 10","author":"Sainburg Tim","year":"2020","unstructured":"Tim Sainburg, Marvin Thielk, and Timothy Q Gentner. 2020. Finding, visualizing, and quantifying latent structure across diverse animal vocal repertoires. PLoS computational biology 16, 10 (2020), e1008228."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379503.3403543"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2016-129"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/PerComWorkshops53856.2022.9767283"},{"key":"e_1_2_2_51_1","volume-title":"Effect of exacerbation on quality of life in patients with chronic obstructive pulmonary disease. American journal of respiratory and critical care medicine 157, 5","author":"Seemungal Terence AR","year":"1998","unstructured":"Terence AR Seemungal, Gavin C Donaldson, Elizabeth A Paul, Janine C Bestall, Donald J Jeffries, and Jadwiga A Wedzicha. 1998. Effect of exacerbation on quality of life in patients with chronic obstructive pulmonary disease. American journal of respiratory and critical care medicine 157, 5 (1998), 1418--1422."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1164\/ajrccm.161.5.9908022"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2010.16071"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1136\/thoraxjnl-2011-201518"},{"key":"e_1_2_2_55_1","unstructured":"Silero Team. 2021. Silero VAD: pre-trained enterprise-grade Voice Activity Detector (VAD) Number Detector and Language Classifier. https:\/\/github.com\/snakers4\/silero-vad."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC46164.2021.9629949"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1709.08243"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSPA48919.2020"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478085"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","unstructured":"Varun Viswanath Jake Garrison and Shwetak Patel. 2018. SpiroConfidence: Determining the Validity of Smartphone Based Spirometry Using Machine Learning. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE Honolulu HI 5499--5502. https:\/\/doi.org\/10.1109\/EMBC.2018.8513516","DOI":"10.1109\/EMBC.2018.8513516"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.3897\/rio.2.e9173"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1164\/rccm.200310-1443OC"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.2196\/10046"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2022.1015876"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448124"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.21629\/JSEE.2017.01.18"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP43922.2022.9746471"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610889","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610889","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T16:26:37Z","timestamp":1753719997000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610889"}},"subtitle":["Continuous Acoustic Monitoring of Chronic Obstructive Pulmonary Disease in the Wild"],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":67,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,27]]}},"alternative-id":["10.1145\/3610889"],"URL":"https:\/\/doi.org\/10.1145\/3610889","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"2023-09-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}