{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T12:51:56Z","timestamp":1785761516965,"version":"3.56.0"},"reference-count":52,"publisher":"Acoustical Society of America (ASA)","issue":"2","funder":[{"DOI":"10.13039\/100020595","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["MOST 111-2221-E-A49-041-MY2"],"award-info":[{"award-number":["MOST 111-2221-E-A49-041-MY2"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100020595","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["113-2628-E-A49-012-MY3"],"award-info":[{"award-number":["113-2628-E-A49-012-MY3"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,8,1]]},"abstract":"<jats:p>Stereo sound enhances the ability to identify the locations of sound sources, thereby enriching the auditory experience. The prevalent method for stereo recording involves using a microphone array, but this approach encounters challenges related to distance, ambient noise, and equipment setup complexity. To address these limitations, this paper proposes a deep-learning-based stereo sound synthesis system using a laser Doppler vibrometer. This study verifies that these monophonic vibration signals contain encoded binaural hearing cues, particularly the interaural level difference and interaural time difference. The proposed system leverages a gated convolutional neural network to synthesize stereo sound from these signals. The system achieves directional sound reconstruction from single-point vibration data with recognition rates of 97.7%\u201398.8%. The results of a stereo music synthesis experiment confirmed the effectiveness of the system, indicating scale-invariant signal-to-distortion ratio improvements of 2.64 and 3.52 for inside and outside tests, respectively. Subjective evaluations showed significant enhancements, with the mean opinion score for pleasantness and stereoscopic sense increasing by 44.5% and 57.0%, respectively.<\/jats:p>","DOI":"10.1121\/10.0044507","type":"journal-article","created":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T12:14:33Z","timestamp":1785759273000},"page":"1011-1023","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":0,"title":["Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis"],"prefix":"10.1121","volume":"160","author":[{"given":"Kuo-Wei","family":"Chao","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 ,","place":["Taiwan"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji-Yan","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 ,","place":["Taiwan"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jia-Wei","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 ,","place":["Taiwan"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi-Chieh","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 ,","place":["Taiwan"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying-Hui","family":"Lai","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National Yang Ming Chiao Tung University 1 ,","place":["Taiwan"]},{"name":"Country Medical Device Innovation and Translation Center, National Yang Ming Chiao Tung University 2 ,","place":["Taiwan"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"231","published-online":{"date-parts":[[2026,8,3]]},"reference":[{"key":"2026080308142536100_c1","volume-title":"From Sound to Synapse: Physiology of the Mammalian Ear","year":"1998"},{"key":"2026080308142536100_c2","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1146\/annurev.ps.42.020191.001031","article-title":"Sound localization by human listeners","volume":"42","year":"1991","journal-title":"Annu. Rev. Psychol."},{"key":"2026080308142536100_c3","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.conb.2015.06.005","article-title":"Sound localization in a changing world","volume":"35","year":"2015","journal-title":"Curr. Opin. Neurobiol."},{"issue":"5","key":"2026080308142536100_c4","doi-asserted-by":"publisher","first-page":"2219","DOI":"10.1121\/1.1471898","article-title":"Listener weighting of cues for lateral angle: The duplex theory of sound localization revisited","volume":"111","year":"2002","journal-title":"J. Acoust. Soc. Am."},{"key":"2026080308142536100_c5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1159\/000380741","article-title":"Importance of binaural hearing","volume":"20","year":"2015","journal-title":"Audiol. Neurotol."},{"key":"2026080308142536100_c6","first-page":"316","article-title":"Semi-automatic mono to stereo up-mixing using sound source formation","year":"2007"},{"key":"2026080308142536100_c7","first-page":"1","article-title":"Ambix\u2014A suggested Ambisonics format"},{"key":"2026080308142536100_c8","unstructured":"Dolby, https:\/\/www.dolby.com\/ (Last viewed July 23, 2026)."},{"issue":"4","key":"2026080308142536100_c9","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1044\/2015_JSLHR-H-14-0355","article-title":"Using ILD or ITD cues for sound source localization and speech understanding in a complex listening environment by listeners with bilateral and with hearing-preservation cochlear implants","volume":"59","year":"2016","journal-title":"J. Speech. Lang. Hear. Res."},{"key":"2026080308142536100_c10","volume-title":"Ambisonics: A Practical 3D Audio Theory for Recording, Studio Production, Sound Reinforcement, and Virtual Reality","year":"2019"},{"key":"2026080308142536100_c11","volume-title":"Microphone Arrays: Signal Processing Techniques and Applications","year":"2001"},{"key":"2026080308142536100_c12","article-title":"A 3D ambisonic based binaural sound reproduction system","year":"2003"},{"key":"2026080308142536100_c13","first-page":"1","article-title":"Long range standoff speaker identification using laser Doppler vibrometer","year":"2016"},{"key":"2026080308142536100_c14","first-page":"829","article-title":"Speech reconstruction from the larynx vibration feature captured by laser-Doppler vibrometer sensor","year":"2021"},{"key":"2026080308142536100_c15","first-page":"953","article-title":"Informed TDoA-based direction of arrival estimation for hearing aid applications","year":"2015"},{"issue":"3","key":"2026080308142536100_c16","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1109\/TASLP.2017.2651373","article-title":"Informed sound source localization using relative transfer functions for hearing aid applications","volume":"25","year":"2017","journal-title":"IEEE\/ACM Trans. Audio. Speech. Lang. Process."},{"issue":"2","key":"2026080308142536100_c17","doi-asserted-by":"publisher","first-page":"1050","DOI":"10.1121\/1.418029","article-title":"Monaural sound localization revisited","volume":"101","year":"1997","journal-title":"J. Acoust. Soc. Am."},{"key":"2026080308142536100_c18","first-page":"1737","article-title":"Learning sound location from a single microphone","year":"2009"},{"issue":"12","key":"2026080308142536100_c19","doi-asserted-by":"publisher","first-page":"2436","DOI":"10.1109\/TASLP.2018.2867081","article-title":"Direction of arrival with one microphone, a few LEGOs, and non-negative matrix factorization","volume":"26","year":"2018","journal-title":"IEEE\/ACM Trans. Audio. Speech. Lang. Process."},{"issue":"3","key":"2026080308142536100_c20","doi-asserted-by":"publisher","first-page":"1902271","DOI":"10.1002\/advs.201902271","article-title":"Sound localization and separation in 3D space using a single microphone with a metamaterial enclosure","volume":"7","year":"2020","journal-title":"Adv. Sci."},{"issue":"9","key":"2026080308142536100_c21","doi-asserted-by":"publisher","first-page":"3168","DOI":"10.3390\/s21093168","article-title":"Mathematical analysis and micro-spacing implementation of acoustic sensor based on bio-inspired intermembrane bridge structure","volume":"21","year":"2021","journal-title":"Sensors"},{"key":"2026080308142536100_c22","doi-asserted-by":"publisher","first-page":"117671","DOI":"10.1016\/j.jsv.2023.117671","article-title":"Direction of arrival estimation of an acoustic wave using a single structural vibration sensor","volume":"553","year":"2023","journal-title":"J. Sound Vib."},{"issue":"5","key":"2026080308142536100_c23","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1109\/JSEN.2014.2298493","article-title":"Reducing the measurement error to optimize the sensitivity of the vibration sensor","volume":"14","year":"2014","journal-title":"IEEE Sens. J."},{"key":"2026080308142536100_c24","first-page":"1","article-title":"Extraction of the relative sensitivity model and improvement of the piezoelectric accelerometer performances","year":"2018"},{"issue":"3","key":"2026080308142536100_c25","doi-asserted-by":"publisher","first-page":"e2568","DOI":"10.1002\/jnm.2568","article-title":"Enhancement of capacitive accelerometer operation by parameters improvement","volume":"32","year":"2019","journal-title":"Int. J. Numer. Model.: Electron. Netw. Devices Fields"},{"issue":"3","key":"2026080308142536100_c26","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1142\/S0219686721500256","article-title":"Appropriate choice of damping rate and frequency margin for improvement of the piezoelectric sensor measurement accuracy","volume":"20","year":"2021","journal-title":"J. Adv. Manuf. Syst."},{"issue":"1","key":"2026080308142536100_c27","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1186\/s13636-022-00265-4","article-title":"Points2Sound: From mono to binaural audio using 3D point cloud scenes","volume":"2022","year":"2022","journal-title":"EURASIP J. Audio Speech Music Process."},{"key":"2026080308142536100_c28","first-page":"26669","article-title":"Cyclic learning for binaural audio generation and localization","year":"2024"},{"key":"2026080308142536100_c29","unstructured":"\u201cVector-Series: Digital Free Beam Hene Laser Vibrometer,\u201d https:\/\/www.optomet.com\/products\/classic-series\/vector-series\/ (Last viewed July 23, 2026)."},{"key":"2026080308142536100_c30","first-page":"1","article-title":"Deep neural network for robust speech recognition with auxiliary features from laser-Doppler vibrometer sensor","year":"2016"},{"key":"2026080308142536100_c31","first-page":"449","article-title":"Speech enhancement for optical laser microphone with deep neural network","year":"2020"},{"issue":"7","key":"2026080308142536100_c32","doi-asserted-by":"publisher","first-page":"073901","DOI":"10.1063\/5.0054920","article-title":"Deep learning-based statistical noise reduction for multidimensional spectral data","volume":"92","year":"2021","journal-title":"Rev. Sci. Instrum."},{"issue":"1","key":"2026080308142536100_c33","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1109\/TASLP.2014.2364452","article-title":"A regression approach to speech enhancement based on deep neural networks","volume":"23","year":"2015","journal-title":"IEEE\/ACM Trans. Audio. Speech. Lang. Process."},{"key":"2026080308142536100_c34","unstructured":"Y. N.\n            Dauphin\n          , A.Fan, M.Auli, and D.Grangier, \u201cLanguage modeling with gated convolutional networks,\u201d Proc. Mach. Learn. Res.70, 933\u2013941 (2017)."},{"issue":"5","key":"2026080308142536100_c35","doi-asserted-by":"publisher","first-page":"1075","DOI":"10.1109\/TASLP.2017.2687104","article-title":"Deep learning based binaural speech separation in reverberant environments","volume":"25","year":"2017","journal-title":"IEEE\/ACM Trans. Audio. Speech. Lang. Process."},{"key":"2026080308142536100_c36","volume-title":"The Laser Doppler Techniques","year":"1980"},{"issue":"5","key":"2026080308142536100_c37","doi-asserted-by":"publisher","first-page":"055202","DOI":"10.1121\/10.0010491","article-title":"Study of optical-based speech acquisition system using vibration signals from speakers' medical masks","volume":"2","year":"2022","journal-title":"JASA Express Lett."},{"key":"2026080308142536100_c38","first-page":"4471","article-title":"Free-form image inpainting with gated convolution","year":"2019"},{"key":"2026080308142536100_c39","first-page":"770","article-title":"Deep residual learning for image recognition","year":"2016"},{"issue":"5","key":"2026080308142536100_c40","doi-asserted-by":"publisher","first-page":"1868","DOI":"10.1121\/1.391938","article-title":"Lateralization of low-frequency, complex waveforms: The use of envelope-based temporal disparities","volume":"77","year":"1985","journal-title":"J. Acoust. Soc. Am."},{"key":"2026080308142536100_c41","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.neucom.2020.07.027","article-title":"Character-level neural network model based on Nadam optimization and its application in clinical concept extraction","volume":"414","year":"2020","journal-title":"Neurocomputing"},{"issue":"5","key":"2026080308142536100_c42","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1121\/1.1917190","article-title":"Standardizing auditory tests","volume":"22","year":"1950","journal-title":"J. Acoust. Soc. Am."},{"issue":"8","key":"2026080308142536100_c43","doi-asserted-by":"publisher","first-page":"1483","DOI":"10.1109\/TASL.2009.2021716","article-title":"A multichannel sinusoidal model applied to spot microphone signals for immersive audio","volume":"17","year":"2009","journal-title":"IEEE Trans. Audio. Speech. Lang. Process."},{"key":"2026080308142536100_c44","first-page":"626","article-title":"SDR\u2013half-baked or well done?","year":"2019"},{"key":"2026080308142536100_c45","unstructured":"J.\n            Serr\u00e0\n          , D.Scaini, S.Pascual, D.Arteaga, J.Pons, J.Breebaart, and G.Cengarle, \u201cMono-to-stereo through parametric stereo generation,\u201d arXiv:2306.14647 (2023)."},{"key":"2026080308142536100_c46","first-page":"404","article-title":"NBU: Neural binaural upmixing of stereo content"},{"key":"2026080308142536100_c47","doi-asserted-by":"crossref","unstructured":"W. C.\n            Huang\n          , D.Markovic, A.Richard, I. D.Gebru, and A.Menon, \u201cEnd-to-end binaural speech synthesis,\u201d arXiv:2207.03697 (2022).","DOI":"10.21437\/Interspeech.2022-10603"},{"key":"2026080308142536100_c48","first-page":"3150","article-title":"DiffStereo: End-to-end mono-to-stereo audio generation with diffusion transformer"},{"key":"2026080308142536100_c49","unstructured":"W.\n            Liu\n          , D.Michelsanti, Z. H.Tan, and J.Jensen, \u201cZeroBAS: Zero-shot mono-to-binaural speech synthesis with controllable spatial cues\u201d arXiv:2403.05556 (2024)."},{"key":"2026080308142536100_c50","unstructured":"Practical demonstrations are available at https:\/\/reurl.cc\/EgyjOg."},{"key":"2026080308142536100_c51","doi-asserted-by":"publisher","first-page":"130804","DOI":"10.1016\/j.neucom.2025.130804","article-title":"BAST-Mamba: Binaural Audio Spectrogram Mamba Transformer for binaural sound localization","volume":"650","year":"2025","journal-title":"Neurocomputing"},{"key":"2026080308142536100_c52","doi-asserted-by":"publisher","first-page":"27048","DOI":"10.1038\/s41598-025-11613-7","article-title":"A multi-stage auditory model for binaural sound localization using the locally competitive algorithm","volume":"15","year":"2025","journal-title":"Sci. Rep."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/160\/2\/1011\/21093057\/1011_1_10.0044507.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/160\/2\/1011\/21093057\/1011_1_10.0044507.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T12:14:36Z","timestamp":1785759276000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/160\/2\/1011\/3400136\/Single-point-optical-vibration-sensing-system-for"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,1]]},"references-count":52,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,8,1]]}},"URL":"https:\/\/doi.org\/10.1121\/10.0044507","relation":{},"ISSN":["1520-8524"],"issn-type":[{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,8]]},"published":{"date-parts":[[2026,8,1]]}}}