{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T16:40:51Z","timestamp":1792514451225,"version":"4.5.0"},"reference-count":46,"publisher":"Acoustical Society of America (ASA)","issue":"3","funder":[{"DOI":"10.13039\/501100020950","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["111-22210E-A49-041-MY2"],"award-info":[{"award-number":["111-22210E-A49-041-MY2"]}],"id":[{"id":"10.13039\/501100020950","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020950","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["111-2314-B-350 -002 -MY2"],"award-info":[{"award-number":["111-2314-B-350 -002 -MY2"]}],"id":[{"id":"10.13039\/501100020950","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:p>Cochlear implant (CI) is currently the vital technological device for assisting deaf patients in hearing sounds and greatly enhances their sound listening appreciation. Unfortunately, it performs poorly for music listening because of the insufficient number of electrodes and inaccurate identification of music features. Therefore, this study applied source separation technology with a self-adjustment function to enhance the music listening benefits for CI users. In the objective analysis method, this study showed that the results of the source-to-distortion, source-to-interference, and source-to-artifact ratios were 4.88, 5.92, and 15.28\u2009dB, respectively, and significantly better than the Demucs baseline model. For the subjective analysis method, it scored higher than the traditional baseline method VIR6 (vocal to instrument ratio, 6\u2009dB) by approximately 28.1 and 26.4 (out of 100) in the multi-stimulus test with hidden reference and anchor test, respectively. The experimental results showed that the proposed method can benefit CI users in identifying music in a live concert, and the personal self-fitting signal separation method had better results than any other default baselines (vocal to instrument ratio of 6\u2009dB or vocal to instrument ratio of 0\u2009dB) did. This finding suggests that the proposed system is a potential method for enhancing the music listening benefits for CI users.<\/jats:p>","DOI":"10.1121\/10.0025057","type":"journal-article","created":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T13:26:58Z","timestamp":1709299618000},"page":"1694-1703","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":7,"title":["Enhancing music recognition using deep learning-powered source separation technology for cochlear implant users"],"prefix":"10.1121","volume":"155","author":[{"given":"Yuh-Jer","family":"Chang","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 , Taipei, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji-Yan","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 , Taipei, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei-Chung","family":"Chu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 , Taipei, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lieber Po-Hung","family":"Li","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, School of Medicine, National Yang Ming Chiao Tung University 2 , Taipei, Taiwan"},{"name":"Department of Otolaryngology, Cheng Hsin General Hospital 3 , Taipei, Taiwan"},{"name":"Department of Medical Research, China Medical University Hospital, China Medical University 4 , Taichung, Taiwan"},{"name":"Institute of Brain Science, School of Medicine, National Yang Ming Chiao Tung University 5 , Taipei, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying-Hui","family":"Lai","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 , Taipei, Taiwan"},{"name":"Medical Device Innovation Translation Center, National Yang Ming Chiao Tung University 6 , Taipei, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"231","published-online":{"date-parts":[[2024,3,1]]},"reference":[{"key":"2024030113264217000_c1","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1121\/1.400476","article-title":"Calculation of a constant Q spectral transform","volume":"89","year":"1991","journal-title":"J. Acoust. Soc. Am."},{"key":"2024030113264217000_c2","first-page":"1525","article-title":"Root mean square error (RMSE) or mean absolute error (MAE)","volume":"7","year":"2014","journal-title":"Geoscientific model development discussions"},{"key":"2024030113264217000_c3","doi-asserted-by":"publisher","first-page":"2604","DOI":"10.1121\/1.4948445","article-title":"Large-scale training to increase speech intelligibility for hearing-impaired listeners in novel noises","volume":"139","year":"2016","journal-title":"J. Acoust. Soc. Am."},{"key":"2024030113264217000_c4","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/S0892-1997(97)80026-4","article-title":"Test-retest study of the GRBAS scale: Influence of experience and professional background on perceptual rating of voice quality","volume":"11","year":"1997","journal-title":"J. Voice"},{"key":"2024030113264217000_c5","unstructured":"D\u00e9fossez, \nA., \nUsunier, \nN., \nBottou, \nL., and \nBach, \nF. (2019). \u201c\nMusic source separation in the waveform domain,\u201d arXiv:1911.13254."},{"key":"2024030113264217000_c6","doi-asserted-by":"publisher","first-page":"3602","DOI":"10.1121\/1.5042056","article-title":"Deep learning models to remix music for cochlear implant users","volume":"143","year":"2018","journal-title":"J. Acoust. Soc. Am."},{"key":"2024030113264217000_c7","doi-asserted-by":"publisher","first-page":"1206","DOI":"10.3389\/fnins.2019.01206","article-title":"Interactive evaluation of a music preprocessing scheme for cochlear implants based on spectral complexity reduction","volume":"13","year":"2019","journal-title":"Front. Neurosci."},{"key":"2024030113264217000_c8","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1097\/00003446-200506000-00001","article-title":"Recognition of \u2018real-world\u2019 musical excerpts by cochlear implant recipients and normal-hearing adults","volume":"26","year":"2005","journal-title":"Ear Hear."},{"key":"2024030113264217000_c9","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1159\/000095608","article-title":"Music perception with cochlear implants and residual hearing","volume":"11","year":"2006","journal-title":"Audiol. Neurotol."},{"key":"2024030113264217000_c10","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1109\/RBME.2021.3095428","article-title":"Noise reduction in cochlear implant signal processing: A review and recent developments","volume":"16","year":"2021","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"2024030113264217000_c46","year":"2015"},{"key":"2024030113264217000_c34","article-title":"Method for the subjective assessment of intermediate sound quality (MUSHRA)","year":"2001"},{"key":"2024030113264217000_c11","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1097\/01.AUD.0000120365.97792.2F","article-title":"Music perception with temporal cues in acoustic and electric hearing","volume":"25","year":"2004","journal-title":"Ear Hear."},{"key":"2024030113264217000_c12","doi-asserted-by":"publisher","first-page":"1568","DOI":"10.1109\/TBME.2016.2613960","article-title":"A deep denoising autoencoder approach to improving the intelligibility of vocoded speech in cochlear implant simulation","volume":"64","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"2024030113264217000_c13","doi-asserted-by":"publisher","first-page":"e207","DOI":"10.1097\/AUD.0000000000000163","article-title":"The relationship between insertion angles, default frequency allocations, and spiral ganglion place pitch in cochlear implants","volume":"36","year":"2015","journal-title":"Ear Hear."},{"key":"2024030113264217000_c14","doi-asserted-by":"publisher","first-page":"826","DOI":"10.1080\/00016480310000386","article-title":"Music perception in adult cochlear implant recipients","volume":"123","year":"2003","journal-title":"Acta Oto-Laryngol."},{"key":"2024030113264217000_c15","article-title":"Harmonic\/percussive sound separation and spectral complexity reduction of music signals for cochlear implant listeners","year":"2020"},{"key":"2024030113264217000_c16","doi-asserted-by":"publisher","first-page":"e25460","DOI":"10.2196\/25460","article-title":"Improved environment-aware\u2013based noise reduction system for cochlear implant users based on a knowledge transfer approach: Development and usability study","volume":"23","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"2024030113264217000_c17","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.heares.2013.04.009","article-title":"Technological, biological, and acoustical constraints to music perception in cochlear implant users","volume":"308","year":"2014","journal-title":"Hear. Res."},{"key":"2024030113264217000_c18","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1121\/1.2749413","article-title":"Relationship between perception of spectral ripple and speech recognition in cochlear implant and vocoder listeners","volume":"122","year":"2007","journal-title":"J. Acoust. Soc. Am."},{"key":"2024030113264217000_c19","doi-asserted-by":"crossref","unstructured":"Liutkus, \nA. a. S., \nZafar, \nF.-R. a. R., \nKitamura, \nD., \nRivet, \nB., \nIto, \nN., \nOno, \nN., and \nFontecave, \nJ. (2017). \u201c\nThe 2016 signal separation evaluation campaign,\u201d available at https:\/\/sigsep.github.io\/datasets\/dsd100.html (Last viewed February 19, 2024).","DOI":"10.1007\/978-3-319-53547-0_31"},{"key":"2024030113264217000_c20","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1159\/000094648","article-title":"Speech processing in vocoder-centric cochlear implants","volume":"64","year":"2006","journal-title":"Cochlear Brainstem Implants"},{"key":"2024030113264217000_c21","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1055\/s-0032-1329222","article-title":"Music appreciation and training for cochlear implant recipients: A review","volume":"33","year":"2012","journal-title":"Semin. Hear."},{"key":"2024030113264217000_c22","doi-asserted-by":"publisher","first-page":"116","DOI":"10.3109\/14992020903405987","article-title":"Music perception of cochlear implant users: A questionnaire, and its implications for a music training program","volume":"49","year":"2010","journal-title":"Int. J. Audiol."},{"key":"2024030113264217000_c23","volume-title":"Audio Source Separation","year":"2018"},{"key":"2024030113264217000_c24","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1177\/108471380400800203","article-title":"Music perception with cochlear implants: A review","volume":"8","year":"2004","journal-title":"Trends Amplif."},{"key":"2024030113264217000_c25","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1007\/s10162-017-0632-x","article-title":"Vocoder simulations explain complex pitch perception limitations experienced by cochlear implant users","volume":"18","year":"2017","journal-title":"J. Assoc. Res. Otolaryngol."},{"key":"2024030113264217000_c26","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1177\/000348940911800506","article-title":"Self-reported listening habits and enjoyment of music among adult cochlear implant recipients","volume":"118","year":"2009","journal-title":"Ann. Otol. Rhinol. Laryngol."},{"key":"2024030113264217000_c27","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1109\/TASLP.2015.2511623","article-title":"Spectral complexity reduction of music signals for mitigating effects of cochlear hearing loss","volume":"24","year":"2016","journal-title":"IEEE\/ACM Trans. Audio. Speech. Lang. Process."},{"key":"2024030113264217000_c28","unstructured":"National Institute on Deafness and Other Communication Disorders (2021). \u201c\nCochlear implants,\u201d available at https:\/\/www.nidcd.nih.gov\/health\/cochlear-implants (Last viewed February 19, 2024)."},{"key":"2024030113264217000_c29","article-title":"Separation of a monaural audio signal into harmonic\/percussive components by complementary diffusion on spectrogram","year":"2008"},{"key":"2024030113264217000_c30","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.specom.2019.09.001","article-title":"Time-domain speech enhancement using generative adversarial networks","volume":"114","year":"2019","journal-title":"Speech Commun."},{"key":"2024030113264217000_c31","doi-asserted-by":"publisher","first-page":"2326","DOI":"10.3390\/s20082326","article-title":"Incorporating noise robustness in speech command recognition by noise augmentation of training data","volume":"20","year":"2020","journal-title":"Sensors"},{"key":"2024030113264217000_c32","doi-asserted-by":"publisher","first-page":"4338","DOI":"10.1121\/1.4971424","article-title":"Remixing music using source separation algorithms to improve the musical experience of cochlear implant users","volume":"140","year":"2016","journal-title":"J. Acoust. Soc. Am."},{"key":"2024030113264217000_c33","article-title":"MUSDB18\u2014A corpus for music separation","year":"2017"},{"key":"2024030113264217000_c35","article-title":"U-net: Convolutional networks for biomedical image segmentation","year":"2015"},{"key":"2024030113264217000_c36","article-title":"An investigation of deep neural networks for noise robust speech recognition","year":"2013"},{"key":"2024030113264217000_c37","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1038\/416087a","article-title":"Chimaeric sounds reveal dichotomies in auditory perception","volume":"416","year":"2002","journal-title":"Nature"},{"key":"2024030113264217000_c38","doi-asserted-by":"publisher","first-page":"1462","DOI":"10.1109\/TSA.2005.858005","article-title":"Performance measurement in blind audio source separation","volume":"14","year":"2006","journal-title":"IEEE Trans. Audio. Speech Lang. Process."},{"key":"2024030113264217000_c39","unstructured":"Williges, \nB., and \nJ\u00fcrgens, \nT. (2019). \u201cPulsatile \nCochlear Implant Vocoder v 1.0.1,\u201d available at https:\/\/doi.org\/10.5281\/zenodo.3234499 (Last viewed February 19, 2024)."},{"key":"2024030113264217000_c40","doi-asserted-by":"publisher","first-page":"233121651878174","DOI":"10.1177\/2331216518781746","article-title":"Coherent coding of enhanced interaural cues improves sound localization in noise with bilateral cochlear implants","volume":"22","year":"2018","journal-title":"Trends Hear."},{"key":"2024030113264217000_c41","first-page":"109","volume-title":"Cochlear Implants: Principles and Practices","year":"2000"},{"key":"2024030113264217000_c42","first-page":"110","article-title":"Design and evaluation of a continuous interleaved sampling (CIS) processing strategy for multichannel cochlear implants","volume":"30","year":"1993","journal-title":"J. Rehabil. Res. Dev."},{"key":"2024030113264217000_c45","first-page":"7","article-title":"A regression approach to speech enhancement based on deep neural networks","volume":"23","year":"2014","journal-title":"IEEE\/ACM Trans. Audio, Speech, Lang. Process."},{"key":"2024030113264217000_c43","doi-asserted-by":"publisher","first-page":"077201","DOI":"10.1121\/10.0012825","article-title":"Celebrating the one millionth cochlear implant","volume":"2","year":"2022","journal-title":"JASA Express Lett."},{"key":"2024030113264217000_c44","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1109\/RBME.2008.2008250","article-title":"Cochlear implants: System design, integration, and evaluation","volume":"1","year":"2008","journal-title":"IEEE Rev. Biomed. Eng."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/155\/3\/1694\/19704299\/1694_1_10.0025057.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/155\/3\/1694\/19704299\/1694_1_10.0025057.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T13:27:11Z","timestamp":1709299631000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/155\/3\/1694\/3268064\/Enhancing-music-recognition-using-deep-learning"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":46,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1121\/10.0025057","relation":{},"ISSN":["0001-4966"],"issn-type":[{"value":"0001-4966","type":"print"}],"subject":[],"published-other":{"date-parts":[[2024,3]]},"published":{"date-parts":[[2024,3,1]]}}}