{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:08:21Z","timestamp":1755839301973,"version":"3.41.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T00:00:00Z","timestamp":1648598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,3,30]]},"abstract":"<jats:p>Facebook Reactions are a collection of animated icons that enable users to share and express their emotions when interacting with Facebook content. The current design of Facebook Reactions utilizes visual stimuli (animated graphics and text) to convey affective information, which presents usability and accessibility barriers for visually-impaired Facebook users. In this paper, we investigate the use of sonification as a universally-accessible modality to aid in the conveyance of affect for blind and sighted social media users. We discuss the design and evaluation of 48 sonifications, leveraging Facebook Reactions as a conceptual framework. We conducted an online sound-matching study with 75 participants (11 blind, 64 sighted) to evaluate the performance of these sonifications. We found that sonification is an effective tool for conveying emotion for blind and sighted participants, and we highlight sonification design strategies that contribute to improved efficacy. Finally, we contextualize these findings and discuss the implications of this research with respect to HCI and the accessibility of online communities and platforms.<\/jats:p>","DOI":"10.1145\/3512966","type":"journal-article","created":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T16:54:59Z","timestamp":1649350499000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Sonification of Emotion in Social Media: Affect and Accessibility in Facebook Reactions"],"prefix":"10.1145","volume":"6","author":[{"given":"Stanley J.","family":"Cantrell","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"given":"R. Michael","family":"Winters","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"given":"Prakriti","family":"Kaini","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"given":"Bruce N.","family":"Walker","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,4,7]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2005.03.002"},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the Association for Computing Machinery Conference on Human Factors in Computing Systems","volume":"14","author":"Akoumianakis Demosthenes","year":"2001","unstructured":"Demosthenes Akoumianakis and Constantine Stephanidis . 2001 . Universal design in HCI: A critical review of current research and practice . Proceedings of the Association for Computing Machinery Conference on Human Factors in Computing Systems , Vol. 14 (2001), 4 pp. Demosthenes Akoumianakis and Constantine Stephanidis. 2001. Universal design in HCI: A critical review of current research and practice. Proceedings of the Association for Computing Machinery Conference on Human Factors in Computing Systems, Vol. 14 (2001), 4 pp."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/004912418101000205"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0401_1"},{"key":"e_1_2_2_5_1","volume-title":"ICAD 1998","volume":"2","author":"Terri","year":"2005","unstructured":"Terri L. Bonebright and Nadine E. Miner. 2005. Evaluation of Auditory Displays: Comments on Bonebright et al ., ICAD 1998 . ACM Transactions on Applied Perception , Vol. 2 , 4 ( 2005 ), 517--520. https:\/\/doi.org\/10.1145\/1101530.1101551 10.1145\/1101530.1101551 Terri L. Bonebright and Nadine E. Miner. 2005. Evaluation of Auditory Displays: Comments on Bonebright et al., ICAD 1998. ACM Transactions on Applied Perception, Vol. 2, 4 (2005), 517--520. https:\/\/doi.org\/10.1145\/1101530.1101551"},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW (CSCW '13)","author":"Brady Erin","year":"1915","unstructured":"Erin Brady , Yu Zhong , Meredith Ringel Morris , and Jeffrey P. Bigham . 2013. Investigating the appropriateness of social network question asking as a resource for blind users . In Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW (CSCW '13) . Association for Computing Machinery, New York, NY, USA, 1225--1236. https:\/\/doi.org\/10.1145\/2441776.244 1915 10.1145\/2441776.2441915 Erin Brady, Yu Zhong, Meredith Ringel Morris, and Jeffrey P. Bigham. 2013. Investigating the appropriateness of social network question asking as a resource for blind users. In Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW (CSCW '13). Association for Computing Machinery, New York, NY, USA, 1225--1236. https:\/\/doi.org\/10.1145\/2441776.2441915"},{"volume-title":"Conference on Human Factors in Computing Systems - Proceedings (CHI '93)","author":"Brewster Stephen A.","key":"e_1_2_2_7_1","unstructured":"Stephen A. Brewster , Peter C. Wright , and Alistair D.N. Edwards . 1993. Evaluation of earcons for use in auditory human-computer interfaces . In Conference on Human Factors in Computing Systems - Proceedings (CHI '93) . Association for Computing Machinery, New York, NY, USA, 222--227. https:\/\/doi.org\/10.1145\/169059.169179 10.1145\/169059.169179 Stephen A. Brewster, Peter C. Wright, and Alistair D.N. Edwards. 1993. Evaluation of earcons for use in auditory human-computer interfaces. In Conference on Human Factors in Computing Systems - Proceedings (CHI '93). Association for Computing Machinery, New York, NY, USA, 222--227. https:\/\/doi.org\/10.1145\/169059.169179"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213601699"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494091.2494173"},{"key":"e_1_2_2_10_1","first-page":"494","article-title":"Chunking and Phrasing and the Design of Human-Computer Dialogues","volume":"1","author":"Buxton William","year":"1995","unstructured":"William Buxton . 1995 . Chunking and Phrasing and the Design of Human-Computer Dialogues . In Readings in Human--Computer Interaction. Number 1. 494 -- 499 . https:\/\/doi.org\/10.1016\/b978-0-08-051574--8.50051-0 10.1016\/b978-0-08-051574--8.50051-0 William Buxton. 1995. Chunking and Phrasing and the Design of Human-Computer Dialogues. In Readings in Human--Computer Interaction. Number 1. 494--499. https:\/\/doi.org\/10.1016\/b978-0-08-051574--8.50051-0","journal-title":"Readings in Human--Computer Interaction. Number"},{"key":"e_1_2_2_11_1","volume-title":"International Symposium on Technology and Society, Proceedings. 327--336","author":"Buzzi Maria Claudia","year":"2010","unstructured":"Maria Claudia Buzzi , Marina Buzzi , Barbara Leporini , and Fahim Akhter . 2010 . Is Facebook really \"open\" to all? . In International Symposium on Technology and Society, Proceedings. 327--336 . https:\/\/doi.org\/10.1109\/ISTAS.2010.5514621 10.1109\/ISTAS.2010.5514621 Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, and Fahim Akhter. 2010. Is Facebook really \"open\" to all?. In International Symposium on Technology and Society, Proceedings. 327--336. https:\/\/doi.org\/10.1109\/ISTAS.2010.5514621"},{"key":"e_1_2_2_12_1","volume-title":"Conference on Human Factors in Computing Systems - Proceedings. 153--154","author":"Clayton Lewis","year":"1996","unstructured":"Lewis Clayton . 1996 . Universal design: everyone has special needs . In Conference on Human Factors in Computing Systems - Proceedings. 153--154 . Lewis Clayton. 1996. Universal design: everyone has special needs. In Conference on Human Factors in Computing Systems - Proceedings. 153--154."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/amp0000399"},{"key":"e_1_2_2_14_1","unstructured":"Anna De Witt. 2007. Designing sonification of user data in affective interaction. (2007) 92.  Anna De Witt. 2007. Designing sonification of user data in affective interaction. (2007) 92."},{"key":"e_1_2_2_15_1","series-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","volume-title":"Sound design for affective interaction","author":"Witt Anna De","unstructured":"Anna De Witt and Roberto Bresin . 2007. Sound design for affective interaction . In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , Vol. 4738 LNCS. 523--533. https:\/\/doi.org\/10.1007\/978--3--540--74889--2_46 10.1007\/978--3--540--74889--2_46 Anna De Witt and Roberto Bresin. 2007. Sound design for affective interaction. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 4738 LNCS. 523--533. https:\/\/doi.org\/10.1007\/978--3--540--74889--2_46"},{"key":"e_1_2_2_16_1","volume-title":"Bos","author":"Derks Daantje","year":"2008","unstructured":"Daantje Derks , Agneta H. Fischer , and Arjan E.R . Bos . 2008 . The role of emotion in computer-mediated communication: A review., Vol. 24 , 3 (may 2008), 766--785. https:\/\/doi.org\/10.1016\/j.chb.2007.04.004 10.1016\/j.chb.2007.04.004 Daantje Derks, Agneta H. Fischer, and Arjan E.R. Bos. 2008. The role of emotion in computer-mediated communication: A review., Vol. 24, 3 (may 2008), 766--785. https:\/\/doi.org\/10.1016\/j.chb.2007.04.004"},{"key":"e_1_2_2_17_1","first-page":"140","article-title":"Universal Facial Expressions in Emotion","volume":"15","author":"Ekman Paul","year":"1973","unstructured":"Paul Ekman . 1973 . Universal Facial Expressions in Emotion . Studia Psychologica , Vol. 15 , 2 (1973), 140 -- 147 . Paul Ekman. 1973. Universal Facial Expressions in Emotion. Studia Psychologica, Vol. 15, 2 (1973), 140--147.","journal-title":"Studia Psychologica"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2533682.2533683"},{"key":"#cr-split#-e_1_2_2_19_1.1","doi-asserted-by":"crossref","unstructured":"Alexander Fiannaca Ilias Apostolopoulous and Eelke Folmer. 2014. Headlock: A wearable navigation aid that helps blind cane users traverse large open spaces. ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility (oct 2014) 19--26. https:\/\/doi.org\/10.1145\/2661334.2661453 10.1145\/2661334.2661453","DOI":"10.1145\/2661334.2661344"},{"key":"#cr-split#-e_1_2_2_19_1.2","doi-asserted-by":"crossref","unstructured":"Alexander Fiannaca Ilias Apostolopoulous and Eelke Folmer. 2014. Headlock: A wearable navigation aid that helps blind cane users traverse large open spaces. ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility (oct 2014) 19--26. https:\/\/doi.org\/10.1145\/2661334.2661453","DOI":"10.1145\/2661334.2661344"},{"key":"e_1_2_2_20_1","first-page":"367","article-title":"The Role of Structure in the Musical Expression of Emotions. Handbook of Music and Emotion: Theory, Research","volume":"367400","author":"Gabrielsson Aalf","year":"2012","unstructured":"Aalf Gabrielsson and Erik Lindstr\u00f6 m. 2012 . The Role of Structure in the Musical Expression of Emotions. Handbook of Music and Emotion: Theory, Research , Applications , Vol. 367400 (2012), 367 -- 400 . https:\/\/doi.org\/10.1093\/acprof:oso\/9780199230143.003.0014 10.1093\/acprof:oso Aalf Gabrielsson and Erik Lindstr\u00f6 m. 2012. The Role of Structure in the Musical Expression of Emotions. Handbook of Music and Emotion: Theory, Research, Applications, Vol. 367400 (2012), 367--400. https:\/\/doi.org\/10.1093\/acprof:oso\/9780199230143.003.0014","journal-title":"Applications"},{"key":"e_1_2_2_21_1","first-page":"1","article-title":"Mental health problems and social media exposure during COVID-19 outbreak","volume":"15","author":"Gao Junling","year":"2020","unstructured":"Junling Gao , Pinpin Zheng , Yingnan Jia , Hao Chen , Yimeng Mao , Suhong Chen , Yi Wang , Hua Fu , and Junming Dai . 2020 . Mental health problems and social media exposure during COVID-19 outbreak . PLoS ONE , Vol. 15 , 4 (2020), 1 -- 10 . https:\/\/doi.org\/10.1371\/journal.pone.0231924 10.1371\/journal.pone.0231924 Junling Gao, Pinpin Zheng, Yingnan Jia, Hao Chen, Yimeng Mao, Suhong Chen, Yi Wang, Hua Fu, and Junming Dai. 2020. Mental health problems and social media exposure during COVID-19 outbreak. PLoS ONE, Vol. 15, 4 (2020), 1--10. https:\/\/doi.org\/10.1371\/journal.pone.0231924","journal-title":"PLoS ONE"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0202_3"},{"volume-title":"The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc, 549--559","author":"Gleason Cole","key":"e_1_2_2_23_1","unstructured":"Cole Gleason , Meredith Ringel Morris , Patrick Carrington , Kris M. Kitani , Cameron Cassidy , and Jeffrey P. Bigham . 2019 a. \"It's almost like they're trying to hide it\": How user-provided image descriptions have failed to make twitter accessible . In The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc, 549--559 . https:\/\/doi.org\/10.1145\/3308558.3313605 10.1145\/3308558.3313605 Cole Gleason, Meredith Ringel Morris, Patrick Carrington, Kris M. Kitani, Cameron Cassidy, and Jeffrey P. Bigham. 2019 a. \"It's almost like they're trying to hide it\": How user-provided image descriptions have failed to make twitter accessible. In The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019. Association for Computing Machinery, Inc, 549--559. https:\/\/doi.org\/10.1145\/3308558.3313605"},{"key":"e_1_2_2_24_1","volume-title":"Making GIFs Accessible. In ASSETS 2020 - 22nd International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc. https:\/\/doi.org\/10","author":"Gleason Cole","year":"2020","unstructured":"Cole Gleason , Amy Pavel , Himalini Gururaj , Kris Kitani , and Jeffrey Bigham . 2020 . Making GIFs Accessible. In ASSETS 2020 - 22nd International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc. https:\/\/doi.org\/10 .1145\/3373625.3417027 10.1145\/3373625.3417027 Cole Gleason, Amy Pavel, Himalini Gururaj, Kris Kitani, and Jeffrey Bigham. 2020. Making GIFs Accessible. In ASSETS 2020 - 22nd International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc. https:\/\/doi.org\/10.1145\/3373625.3417027"},{"volume-title":"ASSETS 2019 - 21st International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 367--376","author":"Gleason Cole","key":"e_1_2_2_25_1","unstructured":"Cole Gleason , Amy Pavel , Xingyu Liu , Patrick Carrington , Lydia B. Chilton , and Jeffrey P. Bigham . 2019 b. Making memes accessible . In ASSETS 2019 - 21st International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 367--376 . https:\/\/doi.org\/10.1145\/3308561.3353792 10.1145\/3308561.3353792 Cole Gleason, Amy Pavel, Xingyu Liu, Patrick Carrington, Lydia B. Chilton, and Jeffrey P. Bigham. 2019 b. Making memes accessible. In ASSETS 2019 - 21st International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 367--376. https:\/\/doi.org\/10.1145\/3308561.3353792"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.59.2.93"},{"volume-title":"The sonification handbook","author":"Hermann Thomas","key":"e_1_2_2_27_1","unstructured":"Thomas Hermann , Andy Hunt , and John G Neuhoff . 2011. The sonification handbook . Logos Verlag Berlin . Thomas Hermann, Andy Hunt, and John G Neuhoff. 2011. The sonification handbook .Logos Verlag Berlin."},{"key":"e_1_2_2_28_1","volume-title":"Proceedings of the 18th International Conference on Auditory Display","author":"Hermann Thomas","year":"2012","unstructured":"Thomas Hermann , Anselm V Nehls , Florian Eitel , Tarik Barri , and Marcus Gammel . 2012 . Tweetscapes - Real-time Sonification of Twitter data streams for Radio Broadcasting . In Proceedings of the 18th International Conference on Auditory Display , Atlanta, GA, USA, 18- -21 June 2012. Georgia Institute of Technology, 113--120. Thomas Hermann, Anselm V Nehls, Florian Eitel, Tarik Barri, and Marcus Gammel. 2012. Tweetscapes - Real-time Sonification of Twitter data streams for Radio Broadcasting. In Proceedings of the 18th International Conference on Auditory Display, Atlanta, GA, USA, 18--21 June 2012. Georgia Institute of Technology, 113--120."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/13506285.2013.835367"},{"volume-title":"Music and emotion: theory and research","author":"Juslin Patrik N","key":"e_1_2_2_30_1","unstructured":"Patrik N Juslin and John A Sloboda . 2002. Music and emotion: theory and research . Vol. 40 . Oxford University Press . 40--0198--40--0198 pages. https:\/\/doi.org\/10.5860\/choice.40-0198 10.5860\/choice.40-0198 Patrik N Juslin and John A Sloboda. 2002. Music and emotion: theory and research. Vol. 40. Oxford University Press. 40--0198--40--0198 pages. https:\/\/doi.org\/10.5860\/choice.40-0198"},{"volume-title":"ASSETS'08: The 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press","author":"Kane Shaun K.","key":"e_1_2_2_31_1","unstructured":"Shaun K. Kane , Jeffrey P. Bigham , and Jacob O. Wobbrock . 2008. Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques . In ASSETS'08: The 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press , New York, New York, USA, 73--80. https:\/\/doi.org\/10.1145\/1414471.1414487 10.1145\/1414471.1414487 Shaun K. Kane, Jeffrey P. Bigham, and Jacob O. Wobbrock. 2008. Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. In ASSETS'08: The 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM Press, New York, New York, USA, 73--80. https:\/\/doi.org\/10.1145\/1414471.1414487"},{"key":"e_1_2_2_32_1","volume-title":"Ladner","author":"Kane Shaun K.","year":"2011","unstructured":"Shaun K. Kane , Jacob O. Wobbrock , and Richard E . Ladner . 2011 . Usable gestures for blind people: Understanding preference and performance. ACM Press , New York. 413--422 pages. https:\/\/doi.org\/10.1145\/1978942.1979001 10.1145\/1978942.1979001 Shaun K. Kane, Jacob O. Wobbrock, and Richard E. Ladner. 2011. Usable gestures for blind people: Understanding preference and performance. ACM Press, New York. 413--422 pages. https:\/\/doi.org\/10.1145\/1978942.1979001"},{"key":"e_1_2_2_33_1","volume-title":"Flowers","author":"Kramer Gregory","year":"1999","unstructured":"Gregory Kramer , Bruce Walker , Terri Bonebright , Perry Cook , and John H . Flowers . 1999 . Sonification Report : Status of the Field and Research Agenda . (1999). Gregory Kramer, Bruce Walker, Terri Bonebright, Perry Cook, and John H. Flowers. 1999. Sonification Report: Status of the Field and Research Agenda. (1999)."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-015-0445-9"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/10919399209540190"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.98.2.224"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142405.1142457"},{"volume-title":"Conference on Human Factors in Computing Systems - Proceedings (CHI '16)","author":"Morris Meredith Ringel","key":"e_1_2_2_38_1","unstructured":"Meredith Ringel Morris , Annuska Zolyomi , Catherine Yao , Sina Bahram , Jeffrey P. Bigham , and Shaun K. Kane . 2016. \"With most of it being pictures now, I rarely use it\": Understanding Twitter's evolving accessibility to blind users . In Conference on Human Factors in Computing Systems - Proceedings (CHI '16) . Association for Computing Machinery, New York, NY, USA, 5506--5516. https:\/\/doi.org\/10.1145\/2858036.2858116 10.1145\/2858036.2858116 Meredith Ringel Morris, Annuska Zolyomi, Catherine Yao, Sina Bahram, Jeffrey P. Bigham, and Shaun K. Kane. 2016. \"With most of it being pictures now, I rarely use it\": Understanding Twitter's evolving accessibility to blind users. In Conference on Human Factors in Computing Systems - Proceedings (CHI '16). Association for Computing Machinery, New York, NY, USA, 5506--5516. https:\/\/doi.org\/10.1145\/2858036.2858116"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1230819.1241668"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X14534297"},{"key":"e_1_2_2_42_1","series-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","volume-title":"Cultural issues in HCI: Challenges and opportunities","author":"Salgado Luciana","year":"2090","unstructured":"Luciana Salgado , Roberto Pereira , and Isabela Gasparini . 2015. Cultural issues in HCI: Challenges and opportunities . In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , Masaaki Kurosu (Ed.), Vol. 9169 . Springer International Publishing , Cham , 60--70. https:\/\/doi.org\/10.1007\/978--3--319-- 2090 1--2_6 10.1007\/978--3--319--20901--2_6 Luciana Salgado, Roberto Pereira, and Isabela Gasparini. 2015. Cultural issues in HCI: Challenges and opportunities. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Masaaki Kurosu (Ed.), Vol. 9169. Springer International Publishing, Cham, 60--70. https:\/\/doi.org\/10.1007\/978--3--319--20901--2_6"},{"key":"e_1_2_2_43_1","volume-title":"Am\u00ed lcar Cardoso","author":"Mariana Seicc","year":"2018","unstructured":"Mariana Seicc a, Rui (Buga) Lopes , Pedro Martins , and F. Am\u00ed lcar Cardoso . 2018 . Sonifying Twitter's Emotions Through Music. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Mitsuko Aramaki, Matthew E P Davies, Richard Kronland-Martinet, and S\u00f8lvi Ystad (Eds.), Vol. 11265 LNCS. Springer International Publishing , Cham, 586--608. https:\/\/doi.org\/10.1007\/978--3-030-01692-0_39 10.1007\/978--3-030-01692-0_39 Mariana Seicc a, Rui (Buga) Lopes, Pedro Martins, and F. Am\u00ed lcar Cardoso. 2018. Sonifying Twitter's Emotions Through Music. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Mitsuko Aramaki, Matthew E P Davies, Richard Kronland-Martinet, and S\u00f8lvi Ystad (Eds.), Vol. 11265 LNCS. Springer International Publishing, Cham, 586--608. https:\/\/doi.org\/10.1007\/978--3-030-01692-0_39"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/332833.332843"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/acp.1146"},{"key":"e_1_2_2_46_1","volume-title":"4th ERCIM Workshop on User Interfaces for All","author":"Stephanidis C","year":"1998","unstructured":"C Stephanidis , D Akoumianakis , M Sfyrakis , and A Paramythis . 1998 . Universal accessibility in HCI : Process-oriented design guidelines and tool requirements . 4th ERCIM Workshop on User Interfaces for All December 2012 (1998), 19--21. http:\/\/www.w3.org\/WAI C Stephanidis, D Akoumianakis, M Sfyrakis, and A Paramythis. 1998. Universal accessibility in HCI : Process-oriented design guidelines and tool requirements. 4th ERCIM Workshop on User Interfaces for All December 2012 (1998), 19--21. http:\/\/www.w3.org\/WAI"},{"key":"e_1_2_2_47_1","series-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","volume-title":"Auditory emoticons: Iterative design and acoustic characteristics of emotional auditory icons and earcons","author":"Sterkenburg Jason","unstructured":"Jason Sterkenburg , Myounghoon Jeon , and Christopher Plummer . 2014. Auditory emoticons: Iterative design and acoustic characteristics of emotional auditory icons and earcons . In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , Masaaki Kurosu (Ed.), Vol. 8511 LNCS. Springer International Publishing , Cham , 633--640. https:\/\/doi.org\/10.1007\/978--3--319-07230--2_60 10.1007\/978--3--319-07230--2_60 Jason Sterkenburg, Myounghoon Jeon, and Christopher Plummer. 2014. Auditory emoticons: Iterative design and acoustic characteristics of emotional auditory icons and earcons. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Masaaki Kurosu (Ed.), Vol. 8511 LNCS. Springer International Publishing, Cham, 633--640. https:\/\/doi.org\/10.1007\/978--3--319-07230--2_60"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1080\/10400435.1998.10131955"},{"key":"e_1_2_2_49_1","volume-title":"Emoji Accessibility for Visually Impaired People. In Conference on Human Factors in Computing Systems - Proceedings (CHI '20)","author":"Tigwell Garreth W.","year":"2020","unstructured":"Garreth W. Tigwell , Benjamin M. Gorman , and Rachel Menzies . 2020 . Emoji Accessibility for Visually Impaired People. In Conference on Human Factors in Computing Systems - Proceedings (CHI '20) . Association for Computing Machinery, New York, NY, USA, 1--14. https:\/\/doi.org\/10.1145\/3313831.3376267 10.1145\/3313831.3376267 Garreth W. Tigwell, Benjamin M. Gorman, and Rachel Menzies. 2020. Emoji Accessibility for Visually Impaired People. In Conference on Human Factors in Computing Systems - Proceedings (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https:\/\/doi.org\/10.1145\/3313831.3376267"},{"key":"e_1_2_2_50_1","volume-title":"Sonification for Process Monitoring. The Sonification Handbook","author":"Vickers Paul","year":"2011","unstructured":"Paul Vickers . 2011. Sonification for Process Monitoring. The Sonification Handbook ( 2011 ), 455--492. http:\/\/nrl.northumbria.ac.uk\/5532\/ Paul Vickers. 2011. Sonification for Process Monitoring. The Sonification Handbook (2011), 455--492. http:\/\/nrl.northumbria.ac.uk\/5532\/"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820013"},{"key":"e_1_2_2_52_1","volume-title":"Nees","author":"Walker Bruce N.","year":"2011","unstructured":"Bruce N. Walker and Michael A . Nees . 2011 . Theory of Sonification. Principles of Sonification: An Introduction to Auditory Display and Sonification June (2011), 1--32. http:\/\/sonify.psych.gatech.edu\/publications\/pdfs\/2006preprint-WalkerNees-SonificationChapter_v09.pdf Bruce N. Walker and Michael A. Nees. 2011. Theory of Sonification. Principles of Sonification: An Introduction to Auditory Display and Sonification June (2011), 1--32. http:\/\/sonify.psych.gatech.edu\/publications\/pdfs\/2006preprint-WalkerNees-SonificationChapter_v09.pdf"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-0992(1998110)28:6<879::AID-EJSP901>3.0.CO;2-W"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1515\/cogl.1990.1.1.99"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2007.4373786"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijma.2012.4602"},{"key":"e_1_2_2_57_1","unstructured":"R. Michael Winters. 2013. Exploring Music Through Sound: Sonification of Emotion Gesture and Corpora. Ph. D. Dissertation.  R. Michael Winters. 2013. Exploring Music Through Sound: Sonification of Emotion Gesture and Corpora. Ph. D. Dissertation."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/1064804618788098"},{"key":"e_1_2_2_59_1","volume-title":"Sonification of Emotion: Strategies for Continuous Display of Arousal and Valence. In The 3rd International Conference on Music & Emotion, Jyv\"a skyl\"a, Finland, June 11--15","author":"Michael Winters R.","year":"2011","unstructured":"R. Michael Winters and Marcelo M Wanderley . 2011 . Sonification of Emotion: Strategies for Continuous Display of Arousal and Valence. In The 3rd International Conference on Music & Emotion, Jyv\"a skyl\"a, Finland, June 11--15 , 2013. University of Jyv\"a skyl\"a, Department of Music, 11--15. R. Michael Winters and Marcelo M Wanderley. 2011. Sonification of Emotion: Strategies for Continuous Display of Arousal and Valence. In The 3rd International Conference on Music & Emotion, Jyv\"a skyl\"a, Finland, June 11--15, 2013. University of Jyv\"a skyl\"a, Department of Music, 11--15."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771813000411"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557415"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2015.1093856"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.147"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512966","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3512966","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:19Z","timestamp":1750188679000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512966"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,30]]},"references-count":63,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2022,3,30]]}},"alternative-id":["10.1145\/3512966"],"URL":"https:\/\/doi.org\/10.1145\/3512966","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2022,3,30]]},"assertion":[{"value":"2022-04-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}