{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,24]],"date-time":"2025-09-24T00:15:24Z","timestamp":1758672924606,"version":"3.44.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation of U.S.","doi-asserted-by":"crossref","award":["2146497, 2416872, 2315596, 2244219, 2416871, 2244220, 2343619"],"award-info":[{"award-number":["2146497, 2416872, 2315596, 2244219, 2416871, 2244220, 2343619"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>There is no doubt that the popularity of smart devices and the development of deep learning models bring individuals too much convenience. However, some rancorous attackers can also implement unexpected privacy inferences on sensed data from smart devices via advanced deep learning tools. Nonetheless, up to now, no work has investigated the possibility of the riskier overheard, which refers to inferring an integral event about humans by analyzing polyphonic audios. To this end, we propose an Audio-based integraL evenT infERence (ALTER) model and two upgraded models (ALTER-p and ALTER-pp) to achieve the integral event inference. Specifically, ALTER applies a link-like multi-label inference scheme to consider the short-term co-occurrence dependency among multiple labels for the event inference. Moreover, ALTER-p uses a newly designed attention mechanism, which fully exploits audio information and the importance of all data points, to mitigate information loss in audio data feature learning for the event inference performance improvement. Furthermore, ALTER-pp takes into account the long-term co-occurrence dependency among labels to infer an event with more diverse elements, where another devised attention mechanism is utilized to conduct a graph-like multi-label inference. Finally, extensive real-data experiments demonstrate that our models are effective in integral event inference and also outperform the state-of-the-art models.<\/jats:p>","DOI":"10.1145\/3695771","type":"journal-article","created":{"date-parts":[[2024,9,13]],"date-time":"2024-09-13T03:59:24Z","timestamp":1726199964000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Overheard: Audio-based Integral Event Inference"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9128-8454","authenticated-orcid":false,"given":"Honghui","family":"Xu","sequence":"first","affiliation":[{"name":"Information Technology, Kennesaw State University","place":["Marietta, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7352-6140","authenticated-orcid":false,"given":"Zhipeng","family":"Cai","sequence":"additional","affiliation":[{"name":"Computer Science, Georgia State University College of Arts and Sciences","place":["Atlanta, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1003-1770","authenticated-orcid":false,"given":"Liran","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, Miami University","place":["Oxford, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1906-7112","authenticated-orcid":false,"given":"Yingshu","family":"Li","sequence":"additional","affiliation":[{"name":"Computer Science, Georgia State University College of Arts and Sciences","place":["Atlanta, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9676-9604","authenticated-orcid":false,"given":"Daehee","family":"Seo","sequence":"additional","affiliation":[{"name":"National Center of Excellence in Software, Sangmyung University","place":["Jongno-gu, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1837-4759","authenticated-orcid":false,"given":"Wei","family":"Li","sequence":"additional","affiliation":[{"name":"Computer Science, Georgia State University College of Arts and Sciences","place":["Atlanta, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,9,23]]},"reference":[{"key":"e_1_3_1_2_2","article-title":"A report on sound event detection with different binaural features","author":"Adavanne Sharath","year":"2017","unstructured":"Sharath Adavanne and Tuomas Virtanen. 2017. A report on sound event detection with different binaural features. arXiv preprint arXiv:1710.02997 (2017).","journal-title":"arXiv preprint arXiv:1710.02997"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.23919\/EUSIPCO.2017.8081521"},{"key":"e_1_3_1_4_2","article-title":"Soundnet: Learning sound representations from unlabeled video","volume":"29","author":"Aytar Yusuf","year":"2016","unstructured":"Yusuf Aytar, Carl Vondrick, and Antonio Torralba. 2016. Soundnet: Learning sound representations from unlabeled video. Advances in Neural Information Processing Systems 29 (2016), 1\u20139.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2018.8462659"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2019.01.005"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2017.08.250"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2013.2270402"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2017.59"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-814601-9.00014-6"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10772-020-09681-3"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3322240"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2967413.2967429"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.3311\/PPee.19961"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2021.108327"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.260"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316782.3321534"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP43922.2022.9746828"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.3390\/rs12203295"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCAS.2006.1692543"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00176"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSPA.2010.5605491"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-53692-6_11"},{"key":"e_1_3_1_24_2","first-page":"136","volume-title":"International Conference on Pattern Recognition Applications and Methods","author":"Marras Mirko","year":"2019","unstructured":"Mirko Marras, Pedro A. Mar\u00edn-Reyes, Javier Lorenzo-Navarro, Modesto Castrill\u00f3n-Santana, and Gianni Fenu. 2019. Deep multi-biometric fusion for audio-visual user re-identification and verification. In International Conference on Pattern Recognition Applications and Methods. Springer, 136\u2013157."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/EUSIPCO.2016.7760424"},{"key":"e_1_3_1_26_2","article-title":"Voice recognition algorithms using mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques","author":"Muda Lindasalwa","year":"2010","unstructured":"Lindasalwa Muda, Mumtaj Begam, and Irraivan Elamvazuthi. 2010. Voice recognition algorithms using mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques. arXiv preprint arXiv:1003.4083 (2010).","journal-title":"arXiv preprint arXiv:1003.4083"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2172422"},{"key":"e_1_3_1_28_2","unstructured":"Yan Pin Ong Chun Meng Tan and Carmen Jia Yi Siau. 2019. Systems and Methods for Processing a Video Stream During Live Video Sharing. US Patent 10 412 318."},{"key":"e_1_3_1_29_2","unstructured":"Takashi Onohara Roka Ueda Keishi Daini Taichi Yoshio Yuji Kawabe Seizi Iwayagano Higo Takuma and Eri Sakai. 2019. Information-sharing Device Method and Terminal Device for Sharing Application Information. US Patent 10 282 316."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806390"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2638207"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2017.2657381"},{"key":"e_1_3_1_33_2","volume-title":"Mathematics of the Discrete Fourier Transform (DFT): With Audio Applications","author":"Smith Julius Orion","year":"2008","unstructured":"Julius Orion Smith. 2008. Mathematics of the Discrete Fourier Transform (DFT): With Audio Applications. Julius Smith."},{"issue":"1","key":"e_1_3_1_34_2","first-page":"19","article-title":"MFCC and its applications in speaker recognition","volume":"1","author":"Tiwari Vibha","year":"2010","unstructured":"Vibha Tiwari. 2010. MFCC and its applications in speaker recognition. International Journal on Emerging Technologies 1, 1 (2010), 19\u201322.","journal-title":"International Journal on Emerging Technologies"},{"key":"e_1_3_1_35_2","unstructured":"Sagar Kumar Verma. 2020. Method and System for Sharing an Output Device between Multimedia Devices to Transmit and Receive Data. US Patent 10 581 933."}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3695771","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T11:43:44Z","timestamp":1758627824000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3695771"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,23]]},"references-count":34,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3695771"],"URL":"https:\/\/doi.org\/10.1145\/3695771","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2025,9,23]]},"assertion":[{"value":"2024-01-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}