{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:25:35Z","timestamp":1776083135124,"version":"3.50.1"},"reference-count":55,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T00:00:00Z","timestamp":1726704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100013974","name":"GRAMMY Museum Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100013974","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Cochlear implants (CIs) provide hundreds of thousands of users with increased access to sound, particularly speech, but experiences of music are more varied. Can greater engagement by CI users in the music mixing process mutually benefit them as well as audio engineers? This paper presents an exploratory mixed-methods study that leverages insights from CI users and professional audio engineers (AEs) in the investigation of techniques to enhance CI user music enjoyment and promote empathetic practices in AEs. Analysis of data collected over a multi-step process of surveys, interviews, and iterative cycles of sound mixing and feedback revealed two mixing strategies\u2014namely essentializing and exaggeration of musical elements\u2014common among mixes preferred by CI users. Participant responses also highlighted systemic ableism and audism in the music industry\u2014an industry from which CI users report feeling excluded. Specifically, AEs felt inadequately trained around aural diversity considerations and experienced anxiety around their own aural diversity. In sum, this work contributes to insights into CI user music listening preferences; how AEs approach mixing for an aurally diverse audience; and discussion around the efficacy of CI simulation, user feedback, and AE peer feedback on mix enjoyment by CI users. Based on these findings, we offer several design insights that emphasize the need for customizable music listening tools centered around user agency and enjoyment.<\/jats:p>","DOI":"10.3389\/fcomp.2024.1371728","type":"journal-article","created":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T04:39:14Z","timestamp":1726720754000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Designing audio processing strategies to enhance cochlear implant users' music enjoyment"],"prefix":"10.3389","volume":"6","author":[{"given":"Lloyd","family":"May","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron","family":"Hodges","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"So Yeon","family":"Park","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Blair","family":"Kaneshiro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Berger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,9,19]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"23312165241245219","DOI":"10.1177\/23312165241245219","article-title":"Remixing preferences for western instrumental classical music of bilateral cochlear implant users","volume":"28","author":"Althoff","year":"2024","journal-title":"Trends Hear"},{"key":"B2","first-page":"335","article-title":"\u201cMusic for the cochlear implant: audience response to six commissioned compositions,\u201d","volume-title":"Seminars in Hearing","author":"Au","year":"2012"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300528","article-title":"\u201cThe promise of empathy: design, disability, and knowing the\u201d other\u201d,\u201d","author":"Bennett","year":"2019","journal-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems"},{"key":"B4","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1016\/j.concog.2005.06.004","article-title":"Responding to the emotions of others: Dissociating forms of empathy through the study of typical and psychiatric populations","volume":"14","author":"Blair","year":"2005","journal-title":"Conscious. Cogn"},{"key":"B5","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1080\/2159676X.2019.1628806","article-title":"Reflecting on reflexive thematic analysis","volume":"11","author":"Braun","year":"2019","journal-title":"Qualit. Res. Sport, Exer. Health"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.4324\/9780429464515-18","article-title":"\u201cAddressing gender equality in music production,\u201d","author":"Brereton","year":"2020","journal-title":"Gender in Music Production"},{"key":"B7","unstructured":"Disability-related simulations: If, when, and how to use them in professional development385\n            BurgstahlerS.\n            DoeT.\n          30844926Rev. Disab. Stud12004"},{"key":"B8","doi-asserted-by":"crossref","first-page":"971","DOI":"10.23919\/EUSIPCO.2017.8081352","article-title":"\u201cA model for music complexity applied to music preprocessing for cochlear implants,\u201d","volume-title":"2017 25th European Signal Processing Conference (EUSIPCO)","author":"Buyens","year":"2017"},{"key":"B9","doi-asserted-by":"publisher","first-page":"294","DOI":"10.3109\/14992027.2013.873955","article-title":"Music mixing preferences of cochlear implant recipients: a pilot study","volume":"53","author":"Buyens","year":"2014","journal-title":"Int. J. Audiol"},{"key":"B10","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1002\/lio2.71","article-title":"Assessment and improvement of sound quality in cochlear implant users","volume":"2","author":"Caldwell","year":"2017","journal-title":"Laryngos. Invest. Otolaryngol"},{"key":"B11","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1109\/ISCSLP.2014.6936705","article-title":"\u201cEffect of vocoder type to mandarin speech recognition in cochlear implant simulation,\u201d","volume-title":"The 9th International Symposium on Chinese Spoken Language Processing","author":"Chen","year":"2014"},{"key":"B12","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1177\/1754073914558466","article-title":"Empathy: a review of the concept","volume":"8","author":"Cuff","year":"2016","journal-title":"Emot. Rev"},{"key":"B13","doi-asserted-by":"publisher","first-page":"691984","DOI":"10.3389\/frvir.2021.691984","article-title":"Hearmevirtual reality: using virtual reality to facilitate empathy between hearing impaired children and their parents","volume":"2","author":"Emb\u00f8l","year":"2021","journal-title":"Front. Virtual Real"},{"key":"B14","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1177\/07419325070280020601","article-title":"Meta-analysis of disability simulation research","volume":"28","author":"Flower","year":"2007","journal-title":"Remed. Special Educ"},{"key":"B15","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1080\/02674649266780261","article-title":"Simulation exercises in disability awareness training: a critique","volume":"7","author":"French","year":"1992","journal-title":"Disab. Handicap Soc"},{"key":"B16","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1109\/ICASSP.2018.8461675","article-title":"\u201cBinaural spectral complexity reduction of music signals for cochlear implant listeners,\u201d","volume-title":"2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","author":"Gauer","year":"2018"},{"key":"B17","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1055\/s-0042-1748126","article-title":"Musical backgrounds, listening habits, and aesthetic enjoyment of adult cochlear implant recipients","volume":"11","author":"Gfeller","year":"2000","journal-title":"J. Am. Acad. Audiol"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1368","DOI":"10.3389\/fnins.2019.01368","article-title":"Practices and attitudes that enhance music engagement of adult cochlear implant users","volume":"13","author":"Gfeller","year":"2019","journal-title":"Front. Neurosci"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.4324\/9781351252225","author":"Gibson","year":"2019","journal-title":"The Art of Mixing: a Visual Guide to Recording, Engineering, and Production"},{"key":"B20","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.specom.2019.03.003","article-title":"Temporal envelope cues and simulations of cochlear implant signal processing","volume":"109","author":"Goldsworthy","year":"2019","journal-title":"Speech Commun"},{"key":"B21","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/978-0-387-22585-2_6","article-title":"\u201cCentral responses to electrical stimulation,\u201d","volume-title":"Cochlear Implants: Auditory Prostheses and Electric Hearing","author":"Hartmann","year":"2004"},{"key":"B22","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/j.conb.2008.07.012","article-title":"I feel how you feel but not always: the empathic brain and its modulation","volume":"18","author":"Hein","year":"2008","journal-title":"Curr. Opin. Neurobiol"},{"key":"B23","doi-asserted-by":"publisher","first-page":"2154","DOI":"10.21105\/joss.02154","article-title":"Spleeter: a fast and efficient music source separation tool with pre-trained models","volume":"5","author":"Hennequin","year":"2020","journal-title":"J. Open Source Softw"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-240-81126-0.00023-8","author":"Hepworth-Sawyer","year":"2011","journal-title":"What is Music Production? A Producer's Guide: the Role, the People, the Process"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1347","DOI":"10.1097\/MAO.0000000000003262","article-title":"Novel web-based music re-engineering software for enhancement of music enjoyment among cochlear implantees","volume":"42","author":"Hwa","year":"2021","journal-title":"Otol. Neurotol"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2015\/829680","article-title":"Music engineering as a novel strategy for enhancing music enjoyment in the cochlear implant recipient","volume":"2015","author":"Kohlberg","year":"2015","journal-title":"Behav. Neurol"},{"key":"B27","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1080\/09544820902875033","article-title":"A framework for empathy in design: stepping into and out of the user's life","volume":"20","author":"Kouprie","year":"2009","journal-title":"J. Eng. Des"},{"key":"B28","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1097\/AUD.0000000000001121","article-title":"Phantom stimulation for cochlear implant users with residual low-frequency hearing","volume":"43","author":"Kr\u00fcger","year":"2022","journal-title":"Ear Hear"},{"key":"B29","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.heares.2013.04.009","article-title":"Technological, biological, and acoustical constraints to music perception in cochlear implant users","volume":"308","author":"Limb","year":"2014","journal-title":"Hear. Res"},{"key":"B30","doi-asserted-by":"publisher","first-page":"424","DOI":"10.3109\/14992027.2012.762606","article-title":"A cochlear implant user with exceptional musical hearing ability","volume":"52","author":"Maarefvand","year":"2013","journal-title":"Int. J. Audiol"},{"key":"B31","doi-asserted-by":"publisher","first-page":"20","DOI":"10.2752\/146069299790303570","article-title":"Using focus groups to support the designer in the evaluation of existing products: a case study","volume":"2","author":"McDonagh-Philp","year":"1999","journal-title":"Des. J"},{"key":"B32","author":"McGranahan","year":"2010","journal-title":"Mashnography: creativity, consumption, and copyright in the mashup community"},{"key":"B33","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1007\/s10162-017-0632-x","article-title":"Vocoder simulations explain complex pitch perception limitations experienced by cochlear implant users","volume":"18","author":"Mehta","year":"2017","journal-title":"J. Assoc. Res. Otolaryngol"},{"key":"B34","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1179\/cim.2003.4.2.85","article-title":"Appreciation of music in adult patients with cochlear implants: a patient questionnaire","volume":"4","author":"Mirza","year":"2003","journal-title":"Cochl. Implants Int"},{"key":"B35","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1109\/TASLP.2015.2511623","article-title":"Spectral complexity reduction of music signals for mitigating effects of cochlear hearing loss","volume":"24","author":"Nagathil","year":"2015","journal-title":"IEEE\/ACM Trans. Audio, Speech Lang. Proc"},{"key":"B36","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1097\/MAO.0000000000001250","article-title":"Reduction of the harmonic series influences musical enjoyment with cochlear implants","volume":"38","author":"Nemer","year":"2017","journal-title":"Otol. Neurotol"},{"key":"B37","year":"2021","journal-title":"NIDCD Fact Sheet: Cochlear Implants. National Institute of Deafness and Other Communication Disorders."},{"key":"B38","article-title":"\u201cEvaluation of new music compositions in live concerts by cochlear implant users and normal hearing listeners,\u201d","author":"Nogueira","year":"2019","journal-title":"14th International Symposium on Computer Music Multidisciplinary Research"},{"key":"B39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2009\/531213","article-title":"Signal processing strategies for cochlear implants using current steering","volume":"2009","author":"Nogueira","year":"2009","journal-title":"EURASIP J. Adv. Signal Process"},{"key":"B40","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1109\/MSP.2018.2874059","article-title":"Making music more accessible for cochlear implant listeners: recent developments","volume":"36","author":"Nogueira","year":"2018","journal-title":"IEEE Signal Process. Mag"},{"key":"B41","doi-asserted-by":"publisher","first-page":"4338","DOI":"10.1121\/1.4971424","article-title":"Remixing music using source separation algorithms to improve the musical experience of cochlear implant users","volume":"140","author":"Pons","year":"2016","journal-title":"J. Acoust. Soc. Am"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1177\/0194599818760559","article-title":"Music appreciation after cochlear implantation in adult patients: a systematic review","volume":"158","author":"Riley","year":"2018","journal-title":"Otolaryngol. Head Neck Surg"},{"key":"B43","doi-asserted-by":"publisher","first-page":"882","DOI":"10.1097\/MAO.0000000000001107","article-title":"Effects of stimulation rate with the fs4 and hdcis coding strategies in cochlear implant recipients","volume":"37","author":"Riss","year":"2016","journal-title":"Otol. Neurotol"},{"key":"B44","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1177\/001100007500500202","article-title":"Empathic: an unappreciated way of being","volume":"5","author":"Rogers","year":"1975","journal-title":"Couns. Psychol"},{"key":"B45","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1097\/MAO.0b013e31824296a9","article-title":"Assessment of sound quality perception in cochlear implant users during music listening","volume":"33","author":"Roy","year":"2012","journal-title":"Otol. Neurotol"},{"key":"B46","doi-asserted-by":"publisher","first-page":"S105","DOI":"10.1179\/1467010015Z.000000000262","article-title":"Reverberation negatively impacts musical sound quality for cochlear implant users","volume":"16","author":"Roy","year":"2015","journal-title":"Cochlear Implants Int"},{"key":"B47","author":"School","year":"2018","journal-title":"An introduction to design thinking"},{"key":"B48","author":"Series","year":"2014","journal-title":"Method for the subjective assessment of intermediate quality level of audio systems"},{"key":"B49","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1080\/21695717.2020.1719787","article-title":"Music perception in adult patients with cochlear implant","volume":"18","author":"Sorrentino","year":"2020","journal-title":"Hearing, Bal. Commun"},{"key":"B50","doi-asserted-by":"publisher","first-page":"987","DOI":"10.3389\/fnins.2019.00987","article-title":"Perception of musical tension in cochlear implant listeners","volume":"13","author":"Spangmose","year":"2019","journal-title":"Front. Neurosci"},{"key":"B51","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1080\/09687591003755849","article-title":"Implants and ethnocide: learning from the cochlear implant controversy","volume":"25","author":"Sparrow","year":"2010","journal-title":"Disab. Soc"},{"key":"B52","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1093\/deafed\/enm018","article-title":"Cochlear implants: the young people's perspective","volume":"12","author":"Wheeler","year":"2007","journal-title":"J. Deaf Stud. Deaf Educ"},{"key":"B53","doi-asserted-by":"publisher","first-page":"2376","DOI":"10.1121\/1.2773993","article-title":"Speech intelligibility in cochlear implant simulations: effects of carrier type, interfering noise, and subject experience","volume":"122","author":"Whitmal","year":"2007","journal-title":"J. Acoust. Soc. Am"},{"key":"B54","doi-asserted-by":"publisher","first-page":"350","DOI":"10.3766\/jaaa.23.5.6","article-title":"Music perception and appraisal: cochlear implant users and simulated cochlear implant listening","volume":"23","author":"Wright","year":"2012","journal-title":"J. Am. Acad. Audiol"},{"key":"B55","doi-asserted-by":"publisher","first-page":"e88662","DOI":"10.1371\/journal.pone.0088662","article-title":"Abnormal pitch perception produced by cochlear implant stimulation","volume":"9","author":"Zeng","year":"2014","journal-title":"PLoS ONE"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1371728\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T04:39:18Z","timestamp":1726720758000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1371728\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,19]]},"references-count":55,"alternative-id":["10.3389\/fcomp.2024.1371728"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2024.1371728","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,19]]},"article-number":"1371728"}}