{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T12:18:17Z","timestamp":1777983497792,"version":"3.51.4"},"reference-count":45,"publisher":"Acoustical Society of America (ASA)","issue":"5","content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,5,1]]},"abstract":"<jats:p>Acousto-optic sensing (AOS) is a non-contact method for measuring sound using light, suitable for environments where microphones are impractical, such as confined spaces or within airflow. Despite its effectiveness, AOS captures line-integrated sound pressure along the optical path, resulting in signals that cannot be interpreted as those from point-wise microphones. To obtain the sound pressure distribution in three-dimensional (3D) space, volumetric sound-field reconstruction is required. Existing methods require multi-directional line-integrated projection data, typically obtained either by deploying multiple devices or by repeatedly exciting the sound source. The former requires deploying multiple high-cost devices, which is often impractical, whereas the latter is not applicable to sound sources that cannot be reproduced consistently. To overcome these limitations, we propose a task called sound projection synthesis, which synthesizes data in specified directions based on observation data. We achieve this by using a latent diffusion model conditioned on observed projections and view angles to generate new sound-field projections. A model pretrained on natural images was fine-tuned using sound-field data and optimized with a pixel-wise loss. Experiments demonstrate that the model can generate realistic projection data. Combining nine observed views with nine generated views improved 3D reconstruction accuracy compared with using only nine observed views.<\/jats:p>","DOI":"10.1121\/10.0043764","type":"journal-article","created":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T11:27:21Z","timestamp":1777980441000},"page":"3858-3869","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":0,"title":["Sound-field-projection synthesis using latent diffusion model for acousto-optic reconstruction"],"prefix":"10.1121","volume":"159","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-9218-1784","authenticated-orcid":false,"given":"Risako","family":"Tanigawa","sequence":"first","affiliation":[{"name":"Communication Science Laboratories, NTT, Inc 1 ., 3-1 Morinosato-Wakamiya, Atsugi, Kanagawa 243-0198,","place":["Japan"]},{"name":"Department of Intermedia Art and Science, Waseda University 2 , 3-4-1 Ohkubo, Shinjuku-ku, Tokyo 169-8555,","place":["Japan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0423-566X","authenticated-orcid":false,"given":"Kenji","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"Communication Science Laboratories, NTT, Inc 1 ., 3-1 Morinosato-Wakamiya, Atsugi, Kanagawa 243-0198,","place":["Japan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1759-4533","authenticated-orcid":false,"given":"Noboru","family":"Harada","sequence":"additional","affiliation":[{"name":"Communication Science Laboratories, NTT, Inc 1 ., 3-1 Morinosato-Wakamiya, Atsugi, Kanagawa 243-0198,","place":["Japan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9078-1714","authenticated-orcid":false,"given":"Yasuhiro","family":"Oikawa","sequence":"additional","affiliation":[{"name":"Department of Intermedia Art and Science, Waseda University 2 , 3-4-1 Ohkubo, Shinjuku-ku, Tokyo 169-8555,","place":["Japan"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"231","published-online":{"date-parts":[[2026,5,5]]},"reference":[{"issue":"5","key":"2026050507271950900_c1","doi-asserted-by":"publisher","first-page":"3403","DOI":"10.1121\/10.0022537","article-title":"Experimental and quantitative evaluation of frequency modulation caused by Doppler effect around high-speed moving sound source","volume":"154","year":"2023","journal-title":"J. Acoust. Soc. Am."},{"issue":"9","key":"2026050507271950900_c2","doi-asserted-by":"publisher","first-page":"10850","DOI":"10.1109\/TPAMI.2023.3261988","article-title":"Diffusion models in vision: A survey","volume":"45","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"1","key":"2026050507271950900_c3","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/s00193-009-0226-6","article-title":"Schlieren imaging of loud sounds and weak shock waves in air near the limit of visibility","volume":"20","year":"2010","journal-title":"Shock Waves"},{"key":"2026050507271950900_c4","doi-asserted-by":"publisher","first-page":"107523","DOI":"10.1016\/j.apacoust.2020.107523","article-title":"Determination of frequency response of MEMS microphone from sound field measurements using optical phase-shifting interferometry method","volume":"170","year":"2020","journal-title":"Appl. Acoust."},{"issue":"2","key":"2026050507271950900_c5","doi-asserted-by":"publisher","first-page":"1138","DOI":"10.1121\/10.0017246","article-title":"Determination of microphone acoustic center from sound field projection measured by optical interferometry","volume":"153","year":"2023","journal-title":"J. Acoust. Soc. Am."},{"key":"2026050507271950900_c6","first-page":"6840","article-title":"Denoising diffusion probabilistic models","author":"Larochelle","year":"2020"},{"key":"2026050507271950900_c7","first-page":"8","article-title":"Classifier-free diffusion guidance","year":"2021"},{"issue":"3","key":"2026050507271950900_c8","doi-asserted-by":"publisher","first-page":"1688","DOI":"10.1121\/10.0039106","article-title":"Spherical harmonic-domain acousto-optic tomography for three-dimensional sound-field reconstruction","volume":"158","year":"2025","journal-title":"J. Acoust. Soc. Am."},{"issue":"5","key":"2026050507271950900_c9","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1364\/OL.43.000991","article-title":"Simultaneous imaging of flow and sound using high-speed parallel phase-shifting interferometry","volume":"43","year":"2018","journal-title":"Opt. Lett."},{"issue":"5","key":"2026050507271950900_c10","doi-asserted-by":"publisher","first-page":"3171","DOI":"10.1121\/10.0002446","article-title":"Seeing the sound of castanets: Acoustic resonances between shells captured by high-speed optical visualization with 1-mm resolution","volume":"148","year":"2020","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2026050507271950900_c11","doi-asserted-by":"publisher","first-page":"045202","DOI":"10.1088\/1361-6501\/abd3c7","article-title":"Physical-model-based reconstruction of axisymmetric three-dimensional sound field from optical interferometric measurement","volume":"32","year":"2021","journal-title":"Meas. Sci. Technol."},{"issue":"6","key":"2026050507271950900_c12","doi-asserted-by":"publisher","first-page":"064801","DOI":"10.1121\/10.0036816","article-title":"Three-dimensional sound field reconstruction from optical projections using physics-informed neural networks","volume":"5","year":"2025","journal-title":"JASA Express Lett."},{"key":"2026050507271950900_c13","first-page":"1","article-title":"Tomographic reconstruction of sound field from optical projections using physics-informed neural networks","year":"2024"},{"issue":"4","key":"2026050507271950900_c14","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1145\/3592433","article-title":"3D Gaussian splatting for real-time radiance field rendering","volume":"42","year":"2023","journal-title":"ACM Trans. Graph."},{"key":"2026050507271950900_c15","first-page":"9503","article-title":"Eschernet: A generative model for scalable view synthesis","year":"2024"},{"issue":"4","key":"2026050507271950900_c16","doi-asserted-by":"publisher","first-page":"2470","DOI":"10.1121\/1.5098943","article-title":"Acoustic pressure field estimation methods for synthetic schlieren tomography","volume":"145","year":"2019","journal-title":"J. Acoust. Soc. Am"},{"issue":"16","key":"2026050507271950900_c17","doi-asserted-by":"publisher","first-page":"164101","DOI":"10.1063\/1.4918786","article-title":"Towards direct realisation of the SI unit of sound pressure in the audible hearing range based on optical free-field acoustic particle measurements","volume":"106","year":"2015","journal-title":"Appl. Phys. Lett."},{"key":"2026050507271950900_c18","first-page":"9298","article-title":"Zero-1-to-3: Zero-shot one image to 3D object","year":"2023"},{"issue":"10","key":"2026050507271950900_c19","doi-asserted-by":"publisher","first-page":"1640","DOI":"10.1364\/AO.34.001640","article-title":"Tomographic reconstruction of sound fields using TV holography","volume":"34","year":"1995","journal-title":"Appl. Opt."},{"key":"2026050507271950900_c20","unstructured":"MathWorks (2024). \u201cMATLAB [version 24.2.0.2740171 (R2024b)] [computer program],\u201d https:\/\/www.mathworks.com."},{"key":"2026050507271950900_c21","first-page":"405","article-title":"NeRF: Representing scenes as neural radiance fields for view synthesis","volume-title":"Computer Vision\u2014ECCV 2020","author":"Vedaldi","year":"2020"},{"key":"2026050507271950900_c22","doi-asserted-by":"publisher","first-page":"4511312","DOI":"10.1109\/TIM.2025.3577852","article-title":"Acousto-optic reconstruction of exterior sound field based on concentric circle sampling with circular harmonic expansion","volume":"74","year":"2025","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"2026050507271950900_c23","doi-asserted-by":"publisher","first-page":"030001","DOI":"10.1121\/2.0001852","article-title":"Physical-model-based reconstruction of three-dimensional sound field from multi-directional measurement by parallel phase-shift interferometry","volume":"52","year":"2023","journal-title":"Proc. Mtgs. Acoust."},{"key":"2026050507271950900_c24","first-page":"661","article-title":"Sound field measurements based on reconstruction from laser projections","year":"2005"},{"issue":"6","key":"2026050507271950900_c25","doi-asserted-by":"publisher","first-page":"3363","DOI":"10.1121\/1.1628682","article-title":"Schlieren imaging of shock waves from a trumpet","volume":"114","year":"2003","journal-title":"J. Acoust. Soc. Am."},{"key":"2026050507271950900_c26","first-page":"10684","article-title":"High-resolution image synthesis with latent diffusion models","year":"2022"},{"issue":"4","key":"2026050507271950900_c27","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1250\/ast.29.295","article-title":"Visualization of sound field with uniform phase distribution using laser beam microphone coupled with computerized tomography method","volume":"29","year":"2008","journal-title":"Acoust. Sci. Tech."},{"key":"2026050507271950900_c28","first-page":"1","article-title":"Implicit neural representations with periodic activation functions","year":"2020"},{"key":"2026050507271950900_c29","first-page":"1","article-title":"Denoising diffusion implicit models","year":"2021"},{"issue":"1","key":"2026050507271950900_c30","doi-asserted-by":"publisher","first-page":"909437","DOI":"10.1155\/2012\/764681","article-title":"Development of optophone with no diaphragm and application to sound measurement in jet flow","volume":"2012","year":"2012","journal-title":"Adv. Acoust. Vib."},{"issue":"4","key":"2026050507271950900_c31","doi-asserted-by":"publisher","first-page":"A179","DOI":"10.1364\/AO.404140","article-title":"High-speed imaging of the sound field by parallel phase-shifting digital holography","volume":"60","year":"2021","journal-title":"Appl. Opt."},{"issue":"3","key":"2026050507271950900_c32","doi-asserted-by":"publisher","first-page":"2163","DOI":"10.1121\/10.0039344","article-title":"Data-driven volumetric reconstruction for optically measured sound field using physics-constrained 3D Gaussian splatting","volume":"158","year":"2025","journal-title":"J. Acoust. Soc. Am."},{"issue":"5","key":"2026050507271950900_c33","doi-asserted-by":"publisher","first-page":"053201","DOI":"10.1121\/10.0036383","article-title":"How the shape of the musical triangle influences its sound","volume":"5","year":"2025","journal-title":"JASA Express Lett."},{"issue":"9","key":"2026050507271950900_c34","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1007\/s00348-020-03038-x","article-title":"Experimental visualization of aerodynamic sound sources using parallel phase-shifting interferometry","volume":"61","year":"2020","journal-title":"Exp. Fluids"},{"issue":"5","key":"2026050507271950900_c35","doi-asserted-by":"publisher","first-page":"3786","DOI":"10.1121\/1.3695394","article-title":"Sound field reconstruction using acousto-optic tomography","volume":"131","year":"2012","journal-title":"J. Acoust. Soc. Am."},{"key":"2026050507271950900_c36","doi-asserted-by":"publisher","first-page":"044033","DOI":"10.1103\/PhysRevApplied.16.044033","article-title":"Acousto-optical volumetric sensing of acoustic fields","volume":"16","year":"2021","journal-title":"Phys. Rev. Appl."},{"key":"2026050507271950900_c37","first-page":"8852","article-title":"Optical interferometry based acoustic field characterization using physics informed neural networks","year":"2024"},{"issue":"3","key":"2026050507271950900_c38","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1121\/AT.2023.19.3.54","article-title":"A century of acousto-optics\u2014From early discoveries to modern sensing of sound with light","volume":"19","year":"2023","journal-title":"Acoust. Today"},{"key":"2026050507271950900_c39","doi-asserted-by":"publisher","first-page":"3790","DOI":"10.1121\/10.0016627","article-title":"Acousto-optic holography","volume":"152","year":"2022","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2026050507271950900_c40","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"2026050507271950900_c41","first-page":"22","article-title":"Novel view synthesis with diffusion models","year":"2023"},{"key":"2026050507271950900_c42","first-page":"16133","article-title":"Convnext v2: Co-designing and scaling convnets with masked autoencoders","year":"2023"},{"key":"2026050507271950900_c43","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.jsv.2017.01.043","article-title":"Acousto-optic back-projection: Physical-model-based sound field reconstruction from optical projections","volume":"394","year":"2017","journal-title":"J. Sound Vib."},{"issue":"3","key":"2026050507271950900_c44","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1250\/ast.43.177","article-title":"Underwater sound visualization and temperature measurement using high-speed interferometer","volume":"43","year":"2022","journal-title":"Acoust. Sci. Tech."},{"key":"2026050507271950900_c45","unstructured":"Zhang, J., Li, Y., Chen, A., Xu, M., Liu, K., Wang, J., Long, X.-X., Liang, H., Xu, Z., Su, H., Theobalt, C., Rupprecht, C., Vedaldi, A., Pfister, H., Lu, S., and Zhan, F. (2025). \u201cAdvances in feed-forward 3D reconstruction and view synthesis: A survey,\u201d https:\/\/arxiv.org\/abs\/2507.14501 (Last viewed April 28, 2026)."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/159\/5\/3858\/20994320\/3858_1_10.0043764.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/159\/5\/3858\/20994320\/3858_1_10.0043764.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T11:27:25Z","timestamp":1777980445000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/159\/5\/3858\/3388849\/Sound-field-projection-synthesis-using-latent"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,1]]},"references-count":45,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,5,1]]}},"URL":"https:\/\/doi.org\/10.1121\/10.0043764","relation":{},"ISSN":["1520-8524"],"issn-type":[{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,5]]},"published":{"date-parts":[[2026,5,1]]}}}