{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T15:38:23Z","timestamp":1777477103360,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":24,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["826506"],"award-info":[{"award-number":["826506"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3479879","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T15:01:58Z","timestamp":1634310118000},"page":"788-792","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Towards Sonification in Multimodal and User-friendlyExplainable Artificial Intelligence"],"prefix":"10.1145","author":[{"given":"Bj\u00f6rn W.","family":"Schuller","sequence":"first","affiliation":[{"name":"Chair of Embedded Intelligence for Health Care & Wellbeing, University of Augsburg, Germany and GLAM -- Group on Language, Audio, & Music, Imperial College London, United Kingdom"}]},{"given":"Tuomas","family":"Virtanen","sequence":"additional","affiliation":[{"name":"Audio Research Group, Tampere University, Finland"}]},{"given":"Maria","family":"Riveiro","sequence":"additional","affiliation":[{"name":"Department of Computing, J\u00f6nk\u00f6ping University, Sweden"}]},{"given":"Georgios","family":"Rizos","sequence":"additional","affiliation":[{"name":"GLAM -- Group on Language, Audio, & Music, Imperial College London, United Kingdom"}]},{"given":"Jing","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, University of Cambridge, United Kingdom"}]},{"given":"Annamaria","family":"Mesaros","sequence":"additional","affiliation":[{"name":"Audio Research Group, Tampere University, Finland"}]},{"given":"Konstantinos","family":"Drossos","sequence":"additional","affiliation":[{"name":"Audio Research Group, Tampere University, Finland"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Peeking inside the black-box: a survey on explainable artificial intelligence (XAI)","author":"Adadi Amina","year":"2018","unstructured":"Amina Adadi and Mohammed Berrada . 2018. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI) . IEEE access 6( 2018 ), 52138\u201352160. Amina Adadi and Mohammed Berrada. 2018. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE access 6(2018), 52138\u201352160."},{"key":"e_1_3_2_2_2_1","volume-title":"Human and Machine Learning","author":"Boukhelifa Nadia","unstructured":"Nadia Boukhelifa , Anastasia Bezerianos , and Evelyne Lutton . 2018. Evaluation of interactive machine learning systems . In Human and Machine Learning . Springer , 341\u2013360. Nadia Boukhelifa, Anastasia Bezerianos, and Evelyne Lutton. 2018. Evaluation of interactive machine learning systems. In Human and Machine Learning. Springer, 341\u2013360."},{"key":"e_1_3_2_2_3_1","unstructured":"Chun-Hao Chang Elliot Creager Anna Goldenberg and David Duvenaud. 2018. Explaining image classifiers by counterfactual generation. arXiv preprint arXiv:1807.08024(2018).  Chun-Hao Chang Elliot Creager Anna Goldenberg and David Duvenaud. 2018. Explaining image classifiers by counterfactual generation. arXiv preprint arXiv:1807.08024(2018)."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3382507.3418874"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23765-2_11"},{"key":"e_1_3_2_2_6_1","volume-title":"Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 447\u2013459","author":"Danilevsky Marina","year":"2020","unstructured":"Marina Danilevsky , Kun Qian , Ranit Aharonov , Yannis Katsis , Ban Kawas , and Prithviraj Sen . 2020 . A Survey of the State of Explainable AI for Natural Language Processing . In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 447\u2013459 . Marina Danilevsky, Kun Qian, Ranit Aharonov, Yannis Katsis, Ban Kawas, and Prithviraj Sen. 2020. A Survey of the State of Explainable AI for Natural Language Processing. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 447\u2013459."},{"key":"e_1_3_2_2_7_1","volume-title":"Demucs: Deep extractor for music sources with extra unlabeled data remixed. arXiv preprint arXiv:1909.01174(2019).","author":"D\u00e9fossez Alexandre","year":"2019","unstructured":"Alexandre D\u00e9fossez , Nicolas Usunier , L\u00e9on Bottou , and Francis Bach . 2019 . Demucs: Deep extractor for music sources with extra unlabeled data remixed. arXiv preprint arXiv:1909.01174(2019). Alexandre D\u00e9fossez, Nicolas Usunier, L\u00e9on Bottou, and Francis Bach. 2019. Demucs: Deep extractor for music sources with extra unlabeled data remixed. arXiv preprint arXiv:1909.01174(2019)."},{"key":"e_1_3_2_2_8_1","volume-title":"Advances in Neural Information Processing Systems, Z.\u00a0Ghahramani, M.\u00a0Welling, C.\u00a0Cortes, N.\u00a0Lawrence, and K.\u00a0Q. Weinberger(Eds.), Vol.\u00a027. Curran Associates","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014. Generative Adversarial Nets . In Advances in Neural Information Processing Systems, Z.\u00a0Ghahramani, M.\u00a0Welling, C.\u00a0Cortes, N.\u00a0Lawrence, and K.\u00a0Q. Weinberger(Eds.), Vol.\u00a027. Curran Associates , Inc .https:\/\/proceedings.neurips.cc\/paper\/ 2014 \/file\/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Z.\u00a0Ghahramani, M.\u00a0Welling, C.\u00a0Cortes, N.\u00a0Lawrence, and K.\u00a0Q. Weinberger(Eds.), Vol.\u00a027. Curran Associates, Inc.https:\/\/proceedings.neurips.cc\/paper\/2014\/file\/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf"},{"key":"e_1_3_2_2_9_1","volume-title":"A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Fosca Giannotti , and Dino Pedreschi . 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 ( 2018 ), 1\u201342. Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 1\u201342."},{"key":"e_1_3_2_2_10_1","volume-title":"Generating Counterfactual Explanations with Natural Language. In ICML Workshop on Human Interpretability in Machine Learning. 95\u201398","author":"Hendricks Lisa\u00a0Anne","year":"2018","unstructured":"Lisa\u00a0Anne Hendricks , Ronghang Hu , Trevor Darrell , and Zeynep Akata . 2018 . Generating Counterfactual Explanations with Natural Language. In ICML Workshop on Human Interpretability in Machine Learning. 95\u201398 . Lisa\u00a0Anne Hendricks, Ronghang Hu, Trevor Darrell, and Zeynep Akata. 2018. Generating Counterfactual Explanations with Natural Language. In ICML Workshop on Human Interpretability in Machine Learning. 95\u201398."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2016.7471631"},{"key":"e_1_3_2_2_12_1","unstructured":"Robert\u00a0R Hoffman Shane\u00a0T Mueller Gary Klein and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608(2018).  Robert\u00a0R Hoffman Shane\u00a0T Mueller Gary Klein and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608(2018)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21103558"},{"key":"e_1_3_2_2_14_1","volume-title":"Mental models: Towards a cognitive science of language, inference, and consciousness. Number\u00a06","author":"Johnson-Laird Philip\u00a0Nicholas","unstructured":"Philip\u00a0Nicholas Johnson-Laird . 1983. Mental models: Towards a cognitive science of language, inference, and consciousness. Number\u00a06 . Harvard University Press . Philip\u00a0Nicholas Johnson-Laird. 1983. Mental models: Towards a cognitive science of language, inference, and consciousness. Number\u00a06. Harvard University Press."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01216-8_35"},{"key":"e_1_3_2_2_16_1","unstructured":"Diederik\u00a0P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013).  Diederik\u00a0P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013)."},{"key":"e_1_3_2_2_17_1","volume-title":"Conv-tasnet: Surpassing ideal time\u2013frequency magnitude masking for speech separation","author":"Luo Yi","year":"2019","unstructured":"Yi Luo and Nima Mesgarani . 2019 . Conv-tasnet: Surpassing ideal time\u2013frequency magnitude masking for speech separation . IEEE\/ACM transactions on audio, speech, and language processing 27, 8(2019), 1256\u20131266. Yi Luo and Nima Mesgarani. 2019. Conv-tasnet: Surpassing ideal time\u2013frequency magnitude masking for speech separation. IEEE\/ACM transactions on audio, speech, and language processing 27, 8(2019), 1256\u20131266."},{"key":"e_1_3_2_2_18_1","volume-title":"Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence 267","author":"Miller Tim","year":"2019","unstructured":"Tim Miller . 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence 267 ( 2019 ), 1\u201338. Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence 267 (2019), 1\u201338."},{"key":"e_1_3_2_2_19_1","unstructured":"Sina Mohseni Niloofar Zarei and Eric\u00a0D Ragan. 2018. A multidisciplinary survey and framework for design and evaluation of explainable AI systems. arXiv preprint arXiv:1811.11839(2018).  Sina Mohseni Niloofar Zarei and Eric\u00a0D Ragan. 2018. A multidisciplinary survey and framework for design and evaluation of explainable AI systems. arXiv preprint arXiv:1811.11839(2018)."},{"key":"e_1_3_2_2_20_1","unstructured":"W\u00a0James Murdoch Chandan Singh Karl Kumbier Reza Abbasi-Asl and Bin Yu. 2019. Interpretable machine learning: definitions methods and applications. arXiv preprint arXiv:1901.04592(2019).  W\u00a0James Murdoch Chandan Singh Karl Kumbier Reza Abbasi-Asl and Bin Yu. 2019. Interpretable machine learning: definitions methods and applications. arXiv preprint arXiv:1901.04592(2019)."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00754"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_2_23_1","volume-title":"Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR)","author":"Thill Serge","year":"2019","unstructured":"Serge Thill and Maria Riveiro . 2019 . Memento hominibus: on the fundamental role of end users in real-world interactions with neuromorphic systems . In Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR) 2019, 26\u201328 August, University of Edinburgh, United Kingdom. Serge Thill and Maria Riveiro. 2019. Memento hominibus: on the fundamental role of end users in real-world interactions with neuromorphic systems. In Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR) 2019, 26\u201328 August, University of Edinburgh, United Kingdom."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2006.885253"}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Montr\u00e9al QC Canada","acronym":"ICMI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479879","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3479879","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:54Z","timestamp":1750193334000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479879"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":24,"alternative-id":["10.1145\/3462244.3479879","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3479879","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}