{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T08:50:45Z","timestamp":1790239845928,"version":"4.1.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T00:00:00Z","timestamp":1511136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>To realize 3D spatial sound rendering with a two-channel headphone, one needs head-related transfer functions (HRTFs) tailored for a specific user. However, measurement of HRTFs requires a tedious and expensive procedure. To address this, we propose a fully perceptual-based HRTF fitting method for individual users using machine learning techniques. The user only needs to answer pairwise comparisons of test signals presented by the system during calibration. This reduces the efforts necessary for the user to obtain individualized HRTFs. Technically, we present a novel adaptive variational AutoEncoder with a convolutional neural network. In the training, this AutoEncoder analyzes publicly available HRTFs dataset and identifies factors that depend on the individuality of users in a nonlinear space. In calibration, the AutoEncoder generates high-quality HRTFs fitted to a specific user by blending the factors. We validate the feasibilities of our method through several quantitative experiments and a user study.<\/jats:p>","DOI":"10.1145\/3130800.3130838","type":"journal-article","created":{"date-parts":[[2017,11,22]],"date-time":"2017-11-22T11:25:08Z","timestamp":1511349908000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Fully perceptual-based 3D spatial sound individualization with an adaptive variational autoencoder"],"prefix":"10.1145","volume":"36","author":[{"given":"Kazuhiko","family":"Yamamoto","sequence":"first","affiliation":[{"name":"The University of Tokyo"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takeo","family":"Igarashi","sequence":"additional","affiliation":[{"name":"The University of Tokyo"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,11,20]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"The CIPIC HRTF Database. In IEEE Workshop on Applications of Signal Processing to Audio and Electroacoustics. 99--102","author":"Algazi V. R."},{"key":"e_1_2_2_2_1","volume-title":"Proc. IEEE Int. Conf. Acoust., Speech, Signal Proces.","author":"Bilinski P."},{"key":"e_1_2_2_3_1","volume-title":"Proc. of ACM SCA. 103--112","author":"Brochu Eric","year":"2010"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1569972"},{"key":"e_1_2_2_5_1","volume-title":"Proc. of ICLR.","author":"Clevert Djork-Arne","year":"2016"},{"key":"e_1_2_2_6_1","unstructured":"Matthieu Courbariaux and Yoshua Bengio. 2016. BinaryNet: Training Deep Neural Networks with Weights and Activations Constrained to +1 or --- 1. In arXiv.  Matthieu Courbariaux and Yoshua Bengio. 2016. BinaryNet: Training Deep Neural Networks with Weights and Activations Constrained to +1 or --- 1. In arXiv."},{"key":"e_1_2_2_7_1","doi-asserted-by":"crossref","unstructured":"R. Duraiswaini D.N. Zotkin and N.A. Gumerov. 2004. Interpolation and range extrapolation of HRTFs {head related transfer functions}. In ICASSP.  R. Duraiswaini D.N. Zotkin and N.A. Gumerov. 2004. Interpolation and range extrapolation of HRTFs {head related transfer functions}. In ICASSP.","DOI":"10.1109\/ICASSP.2004.1326759"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"Felipe Grijalva Luiz Martini Siome Goldenstein and Dinei Florencio. 2014. Anthropometric-Based Customization of Head-Related Transfer Functions using Isomap in The Horizontal Plane. In ICASSP.  Felipe Grijalva Luiz Martini Siome Goldenstein and Dinei Florencio. 2014. Anthropometric-Based Customization of Head-Related Transfer Functions using Isomap in The Horizontal Plane. In ICASSP.","DOI":"10.1109\/ICASSP.2014.6854448"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.3257598"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365603321828970"},{"key":"e_1_2_2_12_1","volume-title":"Proc. of CVPR.","author":"He Kaiming","year":"2015"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925975"},{"key":"e_1_2_2_14_1","unstructured":"Josef Holzl. 2014. A Global Model for HRTF Individualization by Adjustment of Principal Component Weights. In Diploma Thesis.  Josef Holzl. 2014. A Global Model for HRTF Individualization by Adjustment of Principal Component Weights. In Diploma Thesis."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2007.05.007"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Q Huang and Y Fang. 2009. Modeling personalized head- related impulse response using support vector regressions. In J. Shanghai Univ.  Q Huang and Y Fang. 2009. Modeling personalized head- related impulse response using support vector regressions. In J. Shanghai Univ.","DOI":"10.1007\/s11741-009-0602-2"},{"key":"e_1_2_2_17_1","volume-title":"Electron. Letter","volume":"45","author":"Huang Q."},{"key":"e_1_2_2_18_1","doi-asserted-by":"crossref","unstructured":"PK. Iida Y. Ishii and S. Nishioka. 2014. Personalization of head-related transfer functions in the median plane based on the anthropometry of the listener's pinnae. In J. Acoust Soc. Am.  PK. Iida Y. Ishii and S. Nishioka. 2014. Personalization of head-related transfer functions in the median plane based on the anthropometry of the listener's pinnae. In J. Acoust Soc. Am.","DOI":"10.1121\/1.4880856"},{"key":"e_1_2_2_19_1","volume-title":"Proc. of ICML.","author":"Ioffe Sergey","year":"2015"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2282134"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Y. Kahana and P. A. Nelson. 2007. Boundary element simulations of the transfer function of human heads and baffled pinnae using accurate geometric model. In Journal of sound and vibration. 552--579.  Y. Kahana and P. A. Nelson. 2007. Boundary element simulations of the transfer function of human heads and baffled pinnae using accurate geometric model. In Journal of sound and vibration. 552--579.","DOI":"10.1016\/j.jsv.2006.06.079"},{"key":"e_1_2_2_22_1","volume-title":"AES Conference on Audio for Virtual and Augmented Reality.","author":"Kaneko Shoken","year":"2016"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"B. F. Katz. 2001. Boundary element method calculation of individual head-related transfer function. i. rigid model calculation. In J. Acoust Soc. Am.  B. F. Katz. 2001. Boundary element method calculation of individual head-related transfer function. i. rigid model calculation. In J. Acoust Soc. Am.","DOI":"10.1121\/1.1412440"},{"key":"e_1_2_2_24_1","unstructured":"Kingma and Diederik P. 2014. Semi-supervised learning with deep generative models. In Advances in Neural Information Processing Systems.   Kingma and Diederik P. 2014. Semi-supervised learning with deep generative models. In Advances in Neural Information Processing Systems."},{"key":"e_1_2_2_25_1","volume-title":"Adam: A method for stochastic optimization. In CoRR abs\/1412.6980.","author":"Kingma D","year":"2014"},{"key":"e_1_2_2_26_1","volume-title":"Proc. of ICLR.","author":"Kingma Diederik P","year":"2014"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647386"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.428321"},{"key":"e_1_2_2_30_1","unstructured":"Yuancheng Luo Dmitry N. Zotkin Hal Daume and Ramani Duraiswami. 2013b. Kernel regression for Head-Related Transfer Function interpolation and spectral extrema extraction. In ICASSP.  Yuancheng Luo Dmitry N. Zotkin Hal Daume and Ramani Duraiswami. 2013b. Kernel regression for Head-Related Transfer Function interpolation and spectral extrema extraction. In ICASSP."},{"key":"e_1_2_2_31_1","volume-title":"Virtual AutoEncoder Based Recommendation System for Individualizing Head-Related Transfer Functions. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.","author":"Luo Yuancheng","year":"2013"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"G Matheron. 1963. Principles of geostatistics. In Economic Geology. 1246--1266.  G Matheron. 1963. Principles of geostatistics. In Economic Geology. 1246--1266.","DOI":"10.2113\/gsecongeo.58.8.1246"},{"key":"e_1_2_2_33_1","first-page":"6","article-title":"Reexamination of fast head-related transfer function measurement by reciprocal method","volume":"31","author":"Matsunaga Noriyuki","year":"2010","journal-title":"J. Acoust Soc. Ja"},{"key":"e_1_2_2_34_1","volume-title":"AES 55th International Conference.","author":"Meshram Alok","year":"2014"},{"key":"e_1_2_2_35_1","article-title":"Virtual localization improved by scaling non-individualized external-ear transfer functions in frequency. In","author":"Middlebrooks J.C","year":"1999","journal-title":"J. Acoust. Soc. Am. 106."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISUC.2008.41"},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"P. Mokhtari H Takemoto R. Nishimura and H. Kato. 2010. Computer simulation of kemar's head-related transfer functions: verification with measurements and acoustic effects of modifying head shape and pinna concavity. In Principles and Applications of Spatial Hearing. 179--194.  P. Mokhtari H Takemoto R. Nishimura and H. Kato. 2010. Computer simulation of kemar's head-related transfer functions: verification with measurements and acoustic effects of modifying head shape and pinna concavity. In Principles and Applications of Spatial Hearing. 179--194.","DOI":"10.1142\/9789814299312_0016"},{"key":"e_1_2_2_38_1","first-page":"e469","article-title":"Binaural technique: do we need individual recordings?","volume":"44","author":"Moller H.","year":"1996","journal-title":"J. Audio Eng. Soc."},{"key":"e_1_2_2_39_1","volume-title":"Proc. of ICML.","author":"Rezende Danilo Jimenez","year":"2014"},{"key":"e_1_2_2_40_1","unstructured":"Kihyuk Sohn Honglak Lee and Xinchen Yan. 2015. Learning Structured Output Representation using Deep Conditional Generative Models. In Advances in Neural Information Processing Systems.   Kihyuk Sohn Honglak Lee and Xinchen Yan. 2015. Learning Structured Output Representation using Deep Conditional Generative Models. In Advances in Neural Information Processing Systems."},{"key":"e_1_2_2_41_1","volume-title":"Proc. of IJCAI.","author":"Takahama Ryusuke","year":"2016"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_2_2_43_1","volume-title":"Wavenet: A generative model for raw audio. In CoRR abs\/1609.03499.","author":"van den Oord Aaron","year":"2016"},{"key":"e_1_2_2_44_1","volume-title":"Eur. Signal Process. Conf.","author":"Wang Z."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.407089"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASPAA.1993.379986"},{"key":"e_1_2_2_47_1","doi-asserted-by":"crossref","unstructured":"T. Xiao and Q. H. Liu. 2003. Finite difference computation of head-related transfer function for human hearing. In J. Acoust Soc. Am.  T. Xiao and Q. H. Liu. 2003. Finite difference computation of head-related transfer function for human hearing. In J. Acoust Soc. Am.","DOI":"10.1121\/1.1561495"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807448"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2004.827516"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.2207578"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130838","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130838","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:26:18Z","timestamp":1750199178000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130838"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,20]]},"references-count":50,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3130800.3130838"],"URL":"https:\/\/doi.org\/10.1145\/3130800.3130838","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,20]]},"assertion":[{"value":"2017-11-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}