{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T09:17:29Z","timestamp":1785403049290,"version":"3.56.0"},"reference-count":55,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T00:00:00Z","timestamp":1776729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"crossref","award":["1449\/23"],"award-info":[{"award-number":["1449\/23"]}],"id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"crossref"}]},{"award":["1449\/23"],"award-info":[{"award-number":["1449\/23"]}],"id":[{"id":"https:\/\/ror.org\/04sazxf24","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Pazy Research Foundation"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Sensing audio using non-acoustic modalities such as millimeter-wave radar and laser-based systems has emerged as an active research area with significant implications for privacy, security, and robust speech processing. These approaches recover speech-related information from vibration measurements captured by non-acoustic sensing modalities. Prior work spans a wide range of techniques, from classical signal-processing pipelines to modern machine-learning and deep-learning models, enabling applications such as speech reconstruction, eavesdropping, automatic speech recognition, and noise-robust enhancement. Some systems rely on radar or laser sensing as a standalone audio surrogate, while others fuse radar-derived features with microphone signals to improve robustness in noisy or non-line-of-sight environments. Experimental results across the literature demonstrate that recovering intelligible speech or discriminative speech features from radar or laser-sensed vibrations is feasible under controlled conditions. However, performance remains sensitive to practical factors including sensing distance, object material and geometries, environmental interference, multipath effects, and task complexity. Not all speech-related tasks are reliably solved, particularly in unconstrained real-world scenarios. Overall, the field is rapidly evolving, with open challenges in robustness, generalization, and deployment, offering several promising directions for future research.<\/jats:p>","DOI":"10.3390\/s26082553","type":"journal-article","created":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T11:42:45Z","timestamp":1776771765000},"page":"2553","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Recovering Speech from Vibrations: Principles and Algorithms in Radar and Laser Sensing"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-6439-019X","authenticated-orcid":false,"given":"Emily","family":"Bederov","sequence":"first","affiliation":[{"name":"Andrew and Erna Viterbi Faculty of Electrical & Computer Engineering, Technion\u2013Israel Institute of Technology, Haifa 3200003, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baruch","family":"Berdugo","sequence":"additional","affiliation":[{"name":"Andrew and Erna Viterbi Faculty of Electrical & Computer Engineering, Technion\u2013Israel Institute of Technology, Haifa 3200003, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2556-3972","authenticated-orcid":false,"given":"Israel","family":"Cohen","sequence":"additional","affiliation":[{"name":"Andrew and Erna Viterbi Faculty of Electrical & Computer Engineering, Technion\u2013Israel Institute of Technology, Haifa 3200003, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,4,21]]},"reference":[{"key":"ref_1","unstructured":"Zhang, Y., Zhou, W., Chen, Y., Jin, X., and Zhang, Y. (2022, January 7\u201311). mmSpy: Eavesdropping on Speech via mmWave Radar. Proceedings of the ACM Conference on Computer and Communications Security (CCS), Los Angeles, CA, USA."},{"key":"ref_2","unstructured":"Zhou, W., Zhang, Y., Chen, Y., and Jin, X. (2023, January 26\u201330). We Can Hear You: Eavesdropping via mmWave Radar. Proceedings of the ACM Conference on Computer and Communications Security (CCS), Copenhagen, Denmark."},{"key":"ref_3","unstructured":"Chen, X., and Liu, Y. (2022, January 17\u201321). AmbiEar: Voice Recognition via Indirect Vibration Sensing. Proceedings of the ACM International Conference on Mobile Computing and Networking (MobiCom), Sydney, Australia."},{"key":"ref_4","first-page":"1","article-title":"Wavoice: An mmWave-Assisted Noise-Resistant Speech Recognition System","volume":"20","author":"Liu","year":"2023","journal-title":"ACM Trans. Sens. Netw. (TOSN)"},{"key":"ref_5","unstructured":"Zhao, M., and Adib, F. (2020, January 21\u201325). MilliEar: Contactless Acoustic Sensing Using Millimeter-Wave Radar. Proceedings of the ACM International Conference on Mobile Computing and Networking (MobiCom), London, UK."},{"key":"ref_6","unstructured":"Zhang, C., Liu, Y., and Li, H. (2016, January 20\u201325). Deep Neural Network for Robust Speech Recognition with Auxiliary Features from Laser-Doppler Vibrometer Sensor. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1007\/s11265-017-1287-x","article-title":"Auxiliary Features from Laser-Doppler Vibrometer Sensor for Deep Neural Network Based Robust Speech Recognition","volume":"90","author":"Sun","year":"2018","journal-title":"J. Signal Process. Syst."},{"key":"ref_8","first-page":"4123","article-title":"Laser Meager Listener: A Scientific Exploration of Laser-Based Speech Eavesdropping","volume":"18","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_9","unstructured":"Zhang, Y., Zhou, W., and Jin, X. (2024, January 14\u201319). Radio2Text: Streaming Speech Recognition Using mmWave Radar. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), London, UK."},{"key":"ref_10","unstructured":"Basak, S., Padarthi, A., and Gowda, M. (July, January 30). mmWave-Whisper: Phone Call Eavesdropping and Transcription Using Millimeter-Wave Radar. Proceedings of the ACM Conference on Security and Privacy in Wireless and Mobile Networks (WiSec), Arlington, TX, USA."},{"key":"ref_11","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montreal, QC, Canada."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_13","unstructured":"Donahue, C., McAuley, J., and Puckette, M. (2019, January 6\u20139). Adversarial Audio Synthesis. Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA."},{"key":"ref_14","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gulati, A., Qin, J., Chiu, C.C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., and Wu, Y. (2020, January 25\u201329). Conformer: Convolution-augmented Transformer for Speech Recognition. Proceedings of the Interspeech, Shanghai, China.","DOI":"10.21437\/Interspeech.2020-3015"},{"key":"ref_16","unstructured":"Radford, A., Kim, J.W., Xu, T., Brockman, G., McLeavey, C., and Sutskever, I. (2022). Robust Speech Recognition via Large-Scale Weak Supervision. arXiv."},{"key":"ref_17","unstructured":"Chen, Z., Zhang, H., and Wang, W. (May, January 29). RadioMic: Learning Acoustic Signals via Radio Frequency Sensing. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), New Orleans, LA, USA."},{"key":"ref_18","unstructured":"Zhang, H., and Wang, W. (2023, January 4\u201310). RadioSES: Radar-Aided Speech Enhancement and Separation. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece."},{"key":"ref_19","unstructured":"Wang, Y., and Zhao, M. (2024, January 14\u201318). EveGuard: Defending Against Acoustic Eavesdropping via Vibration Perturbation. Proceedings of the ACM Conference on Computer and Communications Security (CCS), Salt Lake City, UT, USA."},{"key":"ref_20","unstructured":"Wang, Y., Lin, Y., Zhou, Y., and Chen, R. (July, January 24). Wavesdropper: Through-Wall Word Detection Using Commercial mmWave Devices. Proceedings of the ACM International Conference on Mobile Systems, Applications, and Services (MobiSys), Virtual Event."},{"key":"ref_21","unstructured":"Zhao, M., Liu, Y., Zhang, H., and Chen, X. (2021, January 15\u201319). UWHear: Through-Wall Eavesdropping Using Impulse Radio Ultra-Wideband. Proceedings of the ACM Conference on Computer and Communications Security (CCS), Virtual Event."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Feng, Z., Zhang, C., Xie, L., and Wang, X. (2023, January 17\u201320). mmEavesdropper: Signal Augmentation-Based Directional Eavesdropping with mmWave Radar. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), New York, NY, USA.","DOI":"10.1109\/INFOCOM53939.2023.10229095"},{"key":"ref_23","unstructured":"Wang, Y., Liu, Y., and Chen, X. (2023, January 26\u201330). mmPhone: Acoustic Eavesdropping on Smart Devices via mmWave Radar. Proceedings of the ACM Conference on Computer and Communications Security (CCS), Copenhagen, Denmark."},{"key":"ref_24","unstructured":"Hu, P., Zhang, Y., Chen, H., and Wang, G. (2023, January 21\u201325). mmEcho: Acoustic Eavesdropping via mmWave Radar. Proceedings of the IEEE Symposium on Security and Privacy, San Francisco, CA, USA."},{"key":"ref_25","unstructured":"Zhang, Y., Hu, P., Chen, H., and Wang, G. (2022, January 7\u201311). mmEve: Eavesdropping on Smartphone Conversations via mmWave Radar. Proceedings of the ACM Conference on Computer and Communications Security (CCS), Los Angeles, CA, USA."},{"key":"ref_26","unstructured":"Liu, S., Chen, H., and Wang, G. (2023, January 21\u201325). mmEar: Eavesdropping on Headphones via mmWave Radar. Proceedings of the IEEE Symposium on Security and Privacy, San Francisco, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"119696","DOI":"10.1016\/j.measurement.2025.119696","article-title":"mmSound: High-quality broadband reconstruction for speech recovery using mmWave radio signals","volume":"261","author":"Tang","year":"2026","journal-title":"Measurement"},{"key":"ref_28","unstructured":"Liu, Y., and Chen, X. (2023, January 4\u201310). Radio2Speech: High-Quality Speech Reconstruction from Radio Signals. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece."},{"key":"ref_29","unstructured":"Li, H., and Wang, W. (2022, January 23\u201327). mmMIC: Multi-Modal Speech Recognition Using mmWave Radar and Microphones. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore."},{"key":"ref_30","unstructured":"Zhou, W., and Zhang, Y. (2021, January 15\u201317). WaveEar: Robust Speech Recognition via mmWave Radar. Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys), Coimbra, Portugal."},{"key":"ref_31","unstructured":"Liu, Y., and Chen, X. (2021, January 6\u201311). WavoID: Speaker Identification via mmWave Radar. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada."},{"key":"ref_32","unstructured":"Zhang, Y., and Jin, X. (2022, January 21\u201325). mmProcess: Learning-Free Speech Recovery from mmWave Radar. Proceedings of the IEEE Radar Conference, New York, NY, USA."},{"key":"ref_33","unstructured":"RASE Challenge Organizers (2026, March 04). RASE2026 Challenge: Dataset and Competition Details. Available online: https:\/\/rase-challenge.github.io\/RASE2026-Challenge\/#dataset."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.optlaseng.2016.10.023","article-title":"An International Review of Laser Doppler Vibrometry","volume":"99","author":"Rothberg","year":"2017","journal-title":"Opt. Lasers Eng."},{"key":"ref_35","first-page":"1904","article-title":"Robust Speech Recognition Using an Auxiliary Laser Doppler Vibrometer Sensor","volume":"27","author":"Du","year":"2019","journal-title":"IEEE\/Acm Trans. Audio, Speech, Lang. Process."},{"key":"ref_36","first-page":"64","article-title":"Generating Pseudo Laser Doppler Vibrometer Features for Robust Speech Recognition","volume":"112","author":"Sun","year":"2019","journal-title":"Speech Commun."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cai, C., Iwai, K., and Nishiura, T. (2023). Speech Enhancement Based on Two-Stage Processing with Deep Neural Network for Laser Doppler Vibrometer. Appl. Sci., 13.","DOI":"10.3390\/app13031958"},{"key":"ref_38","first-page":"456","article-title":"Laser Microphone System for Remote Acoustic Detection","volume":"20","author":"Shimizu","year":"1981","journal-title":"Appl. Opt."},{"key":"ref_39","unstructured":"Geng, Y., Nakano, Y., Iwai, K., and Nishiura, T. (2021, January 6\u201311). Audio Signal Extraction and Enhancement Based on CNN from Laser Speckles. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada."},{"key":"ref_40","first-page":"107427","article-title":"Deep-Learning-Based Speech Enhancement for Rough-Focused Optical Laser Microphone","volume":"168","author":"Nakano","year":"2020","journal-title":"Appl. Acoust."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Nakano, Y., Geng, Y., Iwai, K., and Nishiura, T. (2024). Deep-Learning-Based Speech Enhancement with Rough-Focused Optical Laser Microphone by Reconstructing Complex Spectrum. Proceedings of the 2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), IEEE.","DOI":"10.1109\/APSIPAASC63619.2025.10849293"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, G., Xiang, Z., Fu, H., Yang, Y., and Hu, P. (2024, January 20\u201323). EchoLight: Sound Eavesdropping Based on Ambient Light Reflection. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), Boston, MA, USA.","DOI":"10.1109\/INFOCOM52122.2024.10621338"},{"key":"ref_43","unstructured":"Nassi, B., Pirutin, Y., Shamir, A., Elovici, Y., and Zadov, B. (2020, January 16\u201319). LidarPhone: Acoustic Eavesdropping Using Laser-Based Distance Measurements. Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys), Virtual Event."},{"key":"ref_44","first-page":"4123","article-title":"Acoustic Side-Channel Attacks via Commodity LiDAR Sensors","volume":"18","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"045201","DOI":"10.1121\/10.0036356","article-title":"Enhancing speech intelligibility in optical microphone systems through physics-informed data augmentation","volume":"5","author":"Chen","year":"2025","journal-title":"JASA Express Lett."},{"key":"ref_46","unstructured":"Nakano, Y., Zhang, Y., Geng, Y., Nakayama, M., and Nishiura, T. (2025, January 12\u201314). Speech Enhancement Based on Degraded Speech Generation Using Dual Style Encoders for Optical Laser Microphone. Proceedings of the 2025 International Workshop on Smart Info-Media Systems in Asia (SISA), Phuket Campus, Thailand."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhou, B., Tang, J., and Guo, F. (2026). A Nested U-Network with Temporal Convolution for Monaural Speech Enhancement in Laser Hearing. Modelling, 7.","DOI":"10.3390\/modelling7010032"},{"key":"ref_48","unstructured":"Rix, A., Beerends, J., Hollier, M., and Hekstra, A. (2001, January 7\u201311). Perceptual Evaluation of Speech Quality (PESQ): A New Method for Speech Quality Assessment. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Salt Lake, UT, USA."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2125","DOI":"10.1109\/TASL.2011.2114881","article-title":"An Algorithm for Intelligibility Prediction of Time\u2013Frequency Weighted Noisy Speech","volume":"19","author":"Taal","year":"2011","journal-title":"IEEE Trans. Audio, Speech Lang. Process."},{"key":"ref_50","first-page":"373","article-title":"Speech Recognition Evaluation Using Word Error Rate","volume":"18","author":"Morris","year":"2004","journal-title":"Comput. Speech Lang."},{"key":"ref_51","first-page":"389","article-title":"The Novel Role of Arctangent Phase Algorithm and Voice Enhancement Techniques in Laser Hearing","volume":"158","author":"Zhang","year":"2018","journal-title":"Optik"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Avargel, Y., and Cohen, I. (2011). Speech measurements using a laser Doppler vibrometer sensor: Application to speech enhancement. Proceedings of the Joint Workshop on Hands-free Speech Communication and Microphone Arrays (HSCMA), IEEE.","DOI":"10.1109\/HSCMA.2011.5942375"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Luo, H., Lu, S., Wei, Q., Fu, Y., and Tian, J. (2022). Spectrogram-based Speech Enhancement by Spatial Attention Generative Adversarial Networks. Proceedings of the International Conference on Digital Image Processing (ICDIP), SPIE. Available online: https:\/\/api.semanticscholar.org\/CorpusID:252894233.","DOI":"10.1117\/12.2644385"},{"key":"ref_54","unstructured":"Cai, C., Iwai, K., Nishiura, T., and Yamashita, Y. (2020). Speech Enhancement for Optical Laser Microphone With Deep Neural Network. Proceedings of the 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, IEEE."},{"key":"ref_55","unstructured":"Texas Instruments (2026, April 15). mmWave Radar Sensors for Industrial and Automotive Applications. Available online: https:\/\/www.ti.com\/lit\/wp\/spyy005a\/spyy005a.pdf?ts=1776567852787."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/8\/2553\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T04:24:33Z","timestamp":1776918273000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/8\/2553"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,21]]},"references-count":55,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["s26082553"],"URL":"https:\/\/doi.org\/10.3390\/s26082553","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,21]]}}}