{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T21:13:40Z","timestamp":1787951620049,"version":"build-2784847793"},"reference-count":40,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 110-2221-E-027-089"],"award-info":[{"award-number":["MOST 110-2221-E-027-089"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this research, a novel sound source localization model is introduced that integrates a convolutional neural network with a regression model (CNN-R) to estimate the sound source angle and distance based on the acoustic characteristics of the interaural phase difference (IPD). The IPD features of the sound signal are firstly extracted from time-frequency domain by short-time Fourier transform (STFT). Then, the IPD features map is fed to the CNN-R model as an image for sound source localization. The Pyroomacoustics platform and the multichannel impulse response database (MIRD) are used to generate both simulated and real room impulse response (RIR) datasets. The experimental results show that an average accuracy of 98.96% and 98.31% are achieved by the proposed CNN-R for angle and distance estimations in the simulation scenario at SNR = 30 dB and RT60 = 0.16 s, respectively. Moreover, in the real environment, the average accuracies of the angle and distance estimations are 99.85% and 99.38% at SNR = 30 dB and RT60 = 0.16 s, respectively. The performance obtained in both scenarios is superior to that of existing models, indicating the potential of the proposed CNN-R model for real-life applications.<\/jats:p>","DOI":"10.3390\/s21238031","type":"journal-article","created":{"date-parts":[[2021,12,2]],"date-time":"2021-12-02T02:56:14Z","timestamp":1638413774000},"page":"8031","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Sound Source Localization Using a Convolutional Neural Network and Regression Model"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2956-6115","authenticated-orcid":false,"given":"Tan-Hsu","family":"Tan","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, National Taipei University of Technology, Taipei 10608, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-Tang","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taipei University of Technology, Taipei 10608, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5834-1057","authenticated-orcid":false,"given":"Yang-Lang","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taipei University of Technology, Taipei 10608, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8933-7483","authenticated-orcid":false,"given":"Mohammad","family":"Alkhaleefah","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taipei University of Technology, Taipei 10608, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Morar, A., Moldoveanu, A., Mocanu, I., Moldoveanu, F., Radoi, I.E., Asavei, V., Gradinaru, A., and Butean, A. (2020). A comprehensive survey of indoor localization methods based on computer vision. Sensors, 20.","DOI":"10.3390\/s20092641"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"107447","DOI":"10.1016\/j.comnet.2020.107447","article-title":"Acoustic-based sensing and applications: A survey","volume":"181","author":"Bai","year":"2020","journal-title":"Comput. Netw."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhu, R., Wang, Y., Cao, H., Yu, B., Gan, X., Huang, L., Zhang, H., Li, S., Jia, H., and Chen, J. (2020). RTK\/pseudolite\/LAHDE\/IMU-PDR integrated pedestrian navigation system for urban and indoor environments. Sensors, 20.","DOI":"10.3390\/s20061791"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2842","DOI":"10.1109\/JIOT.2020.3020888","article-title":"Comprehensive Analysis on Least-Squares Lateration for Indoor Positioning Systems","volume":"8","author":"Cengiz","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Uzun, A., Ghani, F.A., Ahmadi Najafabadi, A.M., Yenig\u00fcn, H., and Tekin, \u0130. (2021). Indoor Positioning System Based on Global Positioning System Signals with Down-and Up-Converters in 433 MHz ISM Band. Sensors, 21.","DOI":"10.3390\/s21134338"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"107371","DOI":"10.1016\/j.comnet.2020.107371","article-title":"An optimization based localization with area minimization for heterogeneous wireless sensor networks in anisotropic fields","volume":"179","author":"Bhat","year":"2020","journal-title":"Comput. Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2634","DOI":"10.1109\/COMST.2020.3014304","article-title":"Indoor intelligent fingerprint-based localization: Principles, approaches and challenges","volume":"22","author":"Zhu","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jo, H.J., and Kim, S. (2018). Indoor smartphone localization based on LOS and NLOS identification. Sensors, 18.","DOI":"10.3390\/s18113987"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1109\/SURV.2009.090103","article-title":"A survey of indoor positioning systems for wireless personal networks","volume":"11","author":"Gu","year":"2009","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_10","unstructured":"Ye, T. (2015). Algorithms for Indoor Localization Based on IEEE 802.15. 4-2011 UWB and Inertial Sensors. [Ph.D. Thesis, University College Cork]."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2642","DOI":"10.1109\/TNSE.2020.3014384","article-title":"Defending malicious check-in using big data analysis of indoor positioning system: An access point selection approach","volume":"7","author":"Li","year":"2020","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3971","DOI":"10.1109\/JSEN.2020.2964380","article-title":"Light-based indoor positioning systems: A review","volume":"20","author":"Maheepala","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mirowski, P., Ho, T.K., Yi, S., and MacDonald, M. (2013, January 28\u201331). SignalSLAM: Simultaneous localization and mapping with mixed WiFi, Bluetooth, LTE and magnetic signals. Proceedings of the International Conference on Indoor Positioning and Indoor Navigation, IEEE, Montbeliard, France.","DOI":"10.1109\/IPIN.2013.6817853"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, X., Sun, H., and Zhang, H. (2019). A new method of simultaneous localization and mapping for mobile robots using acoustic landmarks. Appl. Sci., 9.","DOI":"10.3390\/app9071352"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, K., Wang, K., Bergasa, L.M., Romera, E., Hu, W., Sun, D., Sun, J., Cheng, R., Chen, T., and L\u00f3pez, E. (2018). Unifying terrain awareness for the visually impaired through real-time semantic segmentation. Sensors, 18.","DOI":"10.3390\/s18051506"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6403","DOI":"10.1109\/TIE.2017.2786219","article-title":"Indoor sound source localization with probabilistic neural network","volume":"65","author":"Sun","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1109\/JSEN.2020.3020357","article-title":"Sound source localization in 2D using a pair of bio\u2013inspired MEMS directional microphones","volume":"21","author":"Rahamanand","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Park, Y., Choi, A., and Kim, K. (2021). Single-Channel Multiple-Receiver Sound Source Localization System with Homomorphic Deconvolution and Linear Regression. Sensors, 21.","DOI":"10.3390\/s21030760"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1109\/TASLP.2017.2782491","article-title":"Binaural speaker localization integrated into an adaptive beamformer for hearing aids","volume":"26","author":"Zohourian","year":"2017","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1109\/TASLP.2018.2876172","article-title":"Asymmetric coding for rate-constrained noise reduction in binaural hearing aids","volume":"27","author":"Amini","year":"2018","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1109\/TASLP.2018.2878618","article-title":"A convex approximation of the relaxed binaural beamforming optimization problem","volume":"27","author":"Koutrouvelis","year":"2018","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1109\/TASLP.2016.2628642","article-title":"Relaxed binaural LCMV beamforming","volume":"25","author":"Koutrouvelis","year":"2016","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1109\/TASLP.2016.2522649","article-title":"Theory and perceptual evaluation of the binaural reproduction and beamforming tradeoff in the generalized spherical array beamformer","volume":"24","author":"Jeffet","year":"2016","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2162","DOI":"10.1109\/TASLP.2015.2471096","article-title":"Interaural coherence preservation in multi-channel Wiener filtering-based noise reduction for binaural hearing aids","volume":"23","author":"Marquardt","year":"2015","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.robot.2017.07.011","article-title":"Localization of sound sources in robotics: A review","volume":"96","author":"Rascon","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Cobos, M., Antonacci, F., Alexandridis, A., Mouchtaris, A., and Lee, B. (2017). A survey of sound source localization methods in wireless acoustic sensor networks. Wirel. Commun. Mob. Comput., 2017.","DOI":"10.1155\/2017\/3956282"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.csl.2015.03.003","article-title":"A survey on sound source localization in robotics: From binaural to array processing methods","volume":"34","author":"Argentieri","year":"2015","journal-title":"Comput. Speech Lang."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/TASLP.2019.2919378","article-title":"Sound localization based on phase difference enhancement using deep neural networks","volume":"27","author":"Pak","year":"2019","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1109\/TASL.2008.2004533","article-title":"Disambiguation of TDOA estimation for multiple sources in reverberant environments","volume":"16","author":"Scheuing","year":"2008","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Farmani, M. (2017). Informed Sound Source Localization for Hearing Aid Applications. [Ph.D. Thesis, Aalborg University].","DOI":"10.1109\/SAM.2018.8448967"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Youssef, K., Argentieri, S., and Zarader, J.L. (2013, January 3\u20137). A learning-based approach to robust binaural sound localization. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, IEEE, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696771"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/JSTSP.2019.2901664","article-title":"Multi-speaker DOA estimation using deep convolutional networks trained with noise signals","volume":"13","author":"Chakrabarty","year":"2019","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3108","DOI":"10.1109\/TASLP.2020.3037521","article-title":"Semi-supervised multiple source localization using relative harmonic coefficients under noisy and reverberant environments","volume":"28","author":"Hu","year":"2020","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yiwere, M., and Rhee, E.J. (2020). Sound source distance estimation using deep learning: An image classification approach. Sensors, 20.","DOI":"10.3390\/s20010172"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"72073","DOI":"10.1109\/ACCESS.2018.2883341","article-title":"A new regional localization method for indoor sound source based on convolutional neural networks","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"40725","DOI":"10.1109\/ACCESS.2019.2905617","article-title":"Multitask learning of time-frequency CNN for sound source localization","volume":"7","author":"Pang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Scheibler, R., Bezzam, E., and Dokmani\u0107, I. (2018, January 15\u201320). Pyroomacoustics: A python package for audio room simulation and array processing algorithms. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8461310"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hadad, E., Heese, F., Vary, P., and Gannot, S. (2014, January 8\u201311). Multichannel audio database in various acoustic environments. Proceedings of the 2014 14th International Workshop on Acoustic Signal Enhancement (IWAENC), IEEE, Juan les Pins, France.","DOI":"10.1109\/IWAENC.2014.6954309"},{"key":"ref_39","unstructured":"Kominek, J., Black, A.W., and Ver, V. (2004, January 14\u201316). CMU ARCTIC databases for speech synthesis. Proceedings of the Fifth ISCA ITRW on Speech Synthesis, Pittsburgh, PA, USA."},{"key":"ref_40","unstructured":"Chollet, F. (2021). Deep Learning with Python, Simon and Schuster."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/8031\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:38:30Z","timestamp":1760168310000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/8031"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,1]]},"references-count":40,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21238031"],"URL":"https:\/\/doi.org\/10.3390\/s21238031","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,1]]}}}