{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T02:54:41Z","timestamp":1764557681750,"version":"3.41.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"MHCI","license":[{"start":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T00:00:00Z","timestamp":1694390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004032","name":"Jilin University","doi-asserted-by":"publisher","award":["419021422420"],"award-info":[{"award-number":["419021422420"]}],"id":[{"id":"10.13039\/501100004032","id-type":"DOI","asserted-by":"publisher"}]},{"name":"JST CREST","award":["JP-MJCR17A1"],"award-info":[{"award-number":["JP-MJCR17A1"]}]},{"name":"JST ACT-X","award":["JP-MJAX21AG"],"award-info":[{"award-number":["JP-MJAX21AG"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,11]]},"abstract":"<jats:p>Manual audio segmentation is a time-consuming process, especially when there is more than one sound playing simultaneously that needs to be segmented and annotated (e.g., target and background sounds). In conventional audio annotation interfaces, users need to repeatedly pause and replay the audio to complete an overlap segmentation task, which is very inefficient. In this paper, we propose \"SyncLabeling,\" a synchronized audio segmentation interface for smartphones that allows users to segment and annotate two overlapping sounds in a single audio stream at a time using a game-like labeling interface on mobile devices. We conducted a user study to compare the proposed SyncLabeling interface with a conventional audio annotation interface on four types of audio segmentation tasks. The results showed that the proposed interface is much more efficient than the conventional interface (2.4\u00d7 faster) under comparable annotation accuracy in most tasks. In addition, more than half of the participants enjoyed using the proposed SyncLabeling interface and showed willingness to use it.<\/jats:p>","DOI":"10.1145\/3604273","type":"journal-article","created":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T15:16:20Z","timestamp":1694618180000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["SyncLabeling: A Synchronized Audio Segmentation Interface for Mobile Devices"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-6594-8152","authenticated-orcid":false,"given":"Yi","family":"Tang","sequence":"first","affiliation":[{"name":"Jilin University, Jilin, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0390-6361","authenticated-orcid":false,"given":"Chia-Ming","family":"Chang","sequence":"additional","affiliation":[{"name":"The University of Tokyo, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5039-3680","authenticated-orcid":false,"given":"Xi","family":"Yang","sequence":"additional","affiliation":[{"name":"Jilin University &amp; Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Changchun, Jilin, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5495-6441","authenticated-orcid":false,"given":"Takeo","family":"Igarashi","sequence":"additional","affiliation":[{"name":"The University of Tokyo, Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Human Benchmark. [n. d.]. Human Benchmark. https:\/\/humanbenchmark.com\/tests\/reactiontime"},{"key":"e_1_2_2_2_1","volume-title":"International Conference on Intelligent User-Interfaces (IUI), Workshop on Interactive Machine Learning. Santa Monica.","author":"Bryan Nicholas J","year":"2013","unstructured":"Nicholas J Bryan and Gautham J Mysore. 2013. Interactive user-feedback for sound source separation. In International Conference on Intelligent User-Interfaces (IUI), Workshop on Interactive Machine Learning. Santa Monica."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9053096"},{"key":"e_1_2_2_4_1","unstructured":"Chris Cannam Christian Landone Mark B Sandler and Juan Pablo Bello. 2006. The Sonic Visualiser: A Visualisation Platform for Semantic Descriptors from Musical Signals.. In ISMIR. 324--327."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-007-9040-x"},{"key":"e_1_2_2_6_1","volume-title":"IUI Workshops.","author":"Carr CJ","year":"2019","unstructured":"CJ Carr and Zack Zukowski. 2019. Curating generative raw audio music with DOME. In IUI Workshops."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.502"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445165"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2019.2922832"},{"key":"e_1_2_2_10_1","volume-title":"Voxceleb2: Deep speaker recognition. arXiv preprint arXiv:1806.05622","author":"Chung Joon Son","year":"2018","unstructured":"Joon Son Chung, Arsha Nagrani, and Andrew Zisserman. 2018. Voxceleb2: Deep speaker recognition. arXiv preprint arXiv:1806.05622 (2018)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00147"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350535"},{"key":"e_1_2_2_13_1","unstructured":"RIOT GAMES. 2009. League of Legends. https:\/\/lol.garena.tw\/"},{"key":"e_1_2_2_14_1","unstructured":"RIOT GAMES. 2020. League of Legends: Wild Rift. https:\/\/wildrift.leagueoflegends.com\/en-gb\/"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7952261"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13636-020-00172-6"},{"key":"e_1_2_2_17_1","volume-title":"Do left-handed competitors have an innate superiority in sports? Perceptual and motor skills","author":"Grouios George","year":"2000","unstructured":"George Grouios, Haralambos Tsorbatzoudis, Konstantinos Alexandris, and Vassilis Barkoukis. 2000. Do left-handed competitors have an innate superiority in sports? Perceptual and motor skills, Vol. 90, 3_suppl (2000), 1273--1282."},{"key":"e_1_2_2_18_1","volume-title":"audino: A modern annotation tool for audio and speech. arXiv preprint arXiv:2006.05236","author":"Grover Manraj Singh","year":"2020","unstructured":"Manraj Singh Grover, Pakhi Bamdev, Yaman Kumar, Mika Hama, and Rajiv Ratn Shah. 2020. audino: A modern annotation tool for audio and speech. arXiv preprint arXiv:2006.05236 (2020)."},{"key":"e_1_2_2_19_1","volume-title":"Correlates of human handedness in primary motor cortex: a review and hypothesis. Neuroscience & biobehavioral reviews","author":"Hammond Geoffrey","year":"2002","unstructured":"Geoffrey Hammond. 2002. Correlates of human handedness in primary motor cortex: a review and hypothesis. Neuroscience & biobehavioral reviews, Vol. 26, 3 (2002), 285--292."},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Sheng-Jun Huang Chen-Chen Zong Kun-Peng Ning and Hai-Bo Ye. 2021. Asynchronous Active Learning with Distributed Label Querying.. In IJCAI. 2570--2576.","DOI":"10.24963\/ijcai.2021\/354"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"MAH Huijbregts David A van Leeuwen and FM Jong. 2009. Speech overlap detection in a two-pass speaker diarization system. (2009).","DOI":"10.21437\/Interspeech.2009-326"},{"key":"e_1_2_2_22_1","volume-title":"6m: Large scale datasets and predictive methods for 3d human sensing in natural environments","author":"Ionescu Catalin","year":"2013","unstructured":"Catalin Ionescu, Dragos Papava, Vlad Olaru, and Cristian Sminchisescu. 2013. Human3. 6m: Large scale datasets and predictive methods for 3d human sensing in natural environments. IEEE transactions on pattern analysis and machine intelligence, Vol. 36, 7 (2013), 1325--1339."},{"key":"e_1_2_2_23_1","unstructured":"Will Kay Joao Carreira Karen Simonyan Brian Zhang Chloe Hillier Sudheendra Vijayanarasimhan Fabio Viola Tim Green Trevor Back Paul Natsev et al. 2017. The kinetics human action video dataset. arXiv preprint arXiv:1705.06950 (2017)."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3173149"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214366"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.21437\/Eurospeech.2001-354"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180652"},{"key":"e_1_2_2_28_1","volume-title":"SLATE: a super-lightweight annotation tool for experts. arXiv preprint arXiv:1907.08236","author":"Kummerfeld Jonathan K","year":"2019","unstructured":"Jonathan K Kummerfeld. 2019. SLATE: a super-lightweight annotation tool for experts. arXiv preprint arXiv:1907.08236 (2019)."},{"key":"e_1_2_2_29_1","volume-title":"Deep learning. nature","author":"LeCun Yann","year":"2015","unstructured":"Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. nature, Vol. 521, 7553 (2015), 436--444."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3406324.3410710"},{"key":"e_1_2_2_31_1","unstructured":"Golan Levy Raquel Sitman Ido Amir Eduard Golshtein Ran Mochary Eilon Reshef Roi Reichart and Omri Allouche. 2019. GECKO-A Tool for Effective Annotation of Human Conversations.. In INTERSPEECH. 3677--3678."},{"key":"e_1_2_2_32_1","unstructured":"Google LLC. [n. d.]. YouTube. https:\/\/www.youtube.com\/"},{"key":"e_1_2_2_33_1","volume-title":"Left-Handed Control Configuration for Side-Scrolling Games. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1--6.","author":"Crotte Alain Maubert","year":"2019","unstructured":"Alain Maubert Crotte, Daryl H Hepting, and Anastasia Roshchina. 2019. Left-Handed Control Configuration for Side-Scrolling Games. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1--6."},{"key":"e_1_2_2_34_1","volume-title":"BAT: An open-source, web-based audio events annotation tool.","author":"Catal\u00e1n Blai Mel\u00e9ndez","year":"2017","unstructured":"Blai Mel\u00e9ndez Catal\u00e1n, Emilio Molina, and Emilia G\u00f3mez Guti\u00e9rrez. 2017. BAT: An open-source, web-based audio events annotation tool. (2017)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308557.3308700"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240754"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2015.7178964"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682467"},{"key":"e_1_2_2_39_1","volume-title":"First DIHARD challenge evaluation plan","author":"Ryant Neville","year":"2018","unstructured":"Neville Ryant, Kenneth Church, Christopher Cieri, Alejandrina Cristia, Jun Du, Sriram Ganapathy, and Mark Liberman. 2018. First DIHARD challenge evaluation plan. 2018, tech. Rep. (2018)."},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. 102--107","author":"Stenetorp Pontus","year":"2012","unstructured":"Pontus Stenetorp, Sampo Pyysalo, Goran Topi\u0107, Tomoko Ohta, Sophia Ananiadou, and Jun'ichi Tsujii. 2012. BRAT: a web-based tool for NLP-assisted text annotation. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. 102--107."},{"key":"e_1_2_2_42_1","unstructured":"LIGHTSPEED STUDIOS. 2012. Rhythm Master. https:\/\/da.qq.com\/index.shtml"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01216-8_16"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2013.25"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3173003"},{"key":"e_1_2_2_47_1","volume-title":"5th international conference on language resources and evaluation (LREC","author":"Wittenburg Peter","year":"2006","unstructured":"Peter Wittenburg, Hennie Brugman, Albert Russel, Alex Klassmann, and Han Sloetjes. 2006. ELAN: A professional framework for multimodality research. In 5th international conference on language resources and evaluation (LREC 2006). 1556--1559."},{"key":"e_1_2_2_48_1","unstructured":"Sree Harsha Yella and Fabio Valente. 2012. Speaker diarization of overlapping speech based on silence distribution in meeting recordings. In Interspeech."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447526.3472064"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376808"},{"key":"e_1_2_2_51_1","volume-title":"RelRoll: A Relative Elicitation Mechanism for Scoring Annotation with A Case Study on Speech Emotion. In The 49th International Conference on Graphics Interface and Human-Computer Interaction (GI","author":"Zhou Yijun","year":"2023","unstructured":"Yijun Zhou, JinHong Lu, Xiang 'Anthony' Chen, Chia-Ming Chang, and Takeo Igarashi. 2023. RelRoll: A Relative Elicitation Mechanism for Scoring Annotation with A Case Study on Speech Emotion. In The 49th International Conference on Graphics Interface and Human-Computer Interaction (GI 2023)."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604273","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3604273","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:17Z","timestamp":1750178837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604273"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,11]]},"references-count":50,"journal-issue":{"issue":"MHCI","published-print":{"date-parts":[[2023,9,11]]}},"alternative-id":["10.1145\/3604273"],"URL":"https:\/\/doi.org\/10.1145\/3604273","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2023,9,11]]},"assertion":[{"value":"2023-09-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}