{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T02:51:18Z","timestamp":1777603878955,"version":"3.51.4"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T00:00:00Z","timestamp":1597190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST-107-2221-E-011-114-MY2, MOST-107-2221-E-011-112-MY2"],"award-info":[{"award-number":["MOST-107-2221-E-011-114-MY2, MOST-107-2221-E-011-112-MY2"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJCR17A1"],"award-info":[{"award-number":["JPMJCR17A1"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["18H04106"],"award-info":[{"award-number":["18H04106"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,8,31]]},"abstract":"<jats:p>\n            Generative models based on deep neural networks often have a high-dimensional latent space, ranging sometimes to a few hundred dimensions or even higher, which typically makes them hard for a user to explore directly. We propose\n            <jats:italic toggle=\"yes\">differential subspace search<\/jats:italic>\n            to allow efficient iterative user exploration in such a space, without relying on domain- or data-specific assumptions. We develop a general framework to extract low-dimensional subspaces based on a local differential analysis of the generative model, such that a small change in such a subspace would provide enough change in the resulting data. We do so by applying singular value decomposition to the Jacobian of the generative model and forming a subspace with the desired dimensionality spanned by a given number of singular vectors stochastically selected on the basis of their singular values, to maintain ergodicity. We use our framework to present 1D subspaces to the user via a 1D slider interface. Starting from an initial location, the user finds a new candidate in the presented 1D subspace, which is in turn updated at the new candidate location. This process is repeated until no further improvement can be made. Numerical simulations show that our method can better optimize synthetic black-box objective functions than the alternatives that we tested. Furthermore, we conducted a user study using complex generative models and the results show that our method enables more efficient exploration of high-dimensional latent spaces than the alternatives.\n          <\/jats:p>","DOI":"10.1145\/3386569.3392409","type":"journal-article","created":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T11:44:27Z","timestamp":1597232667000},"update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Human-in-the-loop differential subspace search in high-dimensional latent space"],"prefix":"10.1145","volume":"39","author":[{"given":"Chia-Hsing","family":"Chiu","sequence":"first","affiliation":[{"name":"National Taiwan University of Science and Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuki","family":"Koyama","sequence":"additional","affiliation":[{"name":"National Institute of Advanced Industrial Science and Technology (AIST)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Chi","family":"Lai","sequence":"additional","affiliation":[{"name":"National Taiwan University of Science and Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takeo","family":"Igarashi","sequence":"additional","affiliation":[{"name":"The University of Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yonghao","family":"Yue","sequence":"additional","affiliation":[{"name":"Aoyama Gakuin University (AGU)"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,8,12]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Retrieved","year":"2017","unstructured":"Adobe. 2017. Using the Brainstorming tool in After Effects CS6. Retrieved April 19, 2020 from https:\/\/helpx.adobe.com\/after-effects\/atv\/cs6-tutorials\/brainstorming.html."},{"key":"e_1_2_2_2_1","volume-title":"Proc. of ICLR","author":"Bau David","year":"2019","unstructured":"David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, and Antonio Torralba. 2019. GAN Dissection: Visualizing and Understanding Generative Adversarial Networks. In Proc. of ICLR 2019. https:\/\/openreview.net\/forum?id=Hyg_X2C5FX"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"e_1_2_2_4_1","volume-title":"Advances in Neural Information Processing Systems 20 (NIPS","author":"Brochu Eric","year":"2007","unstructured":"Eric Brochu, Nando de Freitas, and Abhijeet Ghosh. 2007. Active Preference Learning with Discrete Choice Data. In Advances in Neural Information Processing Systems 20 (NIPS 2007). 409--416. https:\/\/dl.acm.org\/doi\/10.5555\/2981562.2981614"},{"key":"e_1_2_2_5_1","volume-title":"Proc. of ICLR","author":"Brock Andrew","year":"2017","unstructured":"Andrew Brock, Theodore Lim, James M Ritchie, and Nick Weston. 2017. Neural Photo Editing with Introspective Adversarial Networks. In Proc. of ICLR 2017. https:\/\/openreview.net\/forum?id=HkNKFiGex"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10208-009-9045-5"},{"key":"e_1_2_2_7_1","unstructured":"Angel X. Chang Thomas Funkhouser Leonidas Guibas Pat Hanrahan Qixing Huang Zimo Li Silvio Savarese Manolis Savva Shuran Song Hao Su Jianxiong Xiao Li Yi and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. https:\/\/arxiv.org\/abs\/1512.03012"},{"key":"e_1_2_2_8_1","volume-title":"Advances in Neural Information Processing Systems 29 (NIPS","author":"Chen Xi","year":"2016","unstructured":"Xi Chen, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel. 2016. InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets. In Advances in Neural Information Processing Systems 29 (NIPS 2016). 2172--2180. https:\/\/dl.acm.org\/doi\/abs\/10.5555\/3157096.3157340"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00609"},{"key":"e_1_2_2_10_1","unstructured":"Chris Donahue Julian McAuley and Miller Puckette. 2018. Adversarial Audio Synthesis. https:\/\/arxiv.org\/abs\/1802.04208"},{"key":"e_1_2_2_11_1","volume-title":"Proc. of ICLR","author":"Engel Jesse","year":"2019","unstructured":"Jesse Engel, Kumar Krishna Agrawal, Shuo Chen, Ishaan Gulrajani, Chris Donahue, and Adam Roberts. 2019. GANSynth: Adversarial Neural Audio Synthesis. In Proc. of ICLR 2019. https:\/\/openreview.net\/forum?id=H1xQVn09FX"},{"key":"e_1_2_2_12_1","volume-title":"Proc. of Machine Learning Research -","volume":"70","author":"Engel Jesse","year":"2017","unstructured":"Jesse Engel, Cinjon Resnick, Adam Roberts, Sander Dieleman, Mohammad Norouzi, Douglas Eck, and Karen Simonyan. 2017. Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders. In Proc. of Machine Learning Research - Volume 70 (ICML 2017). JMLR.org, 1068--1077. https:\/\/dl.acm.org\/doi\/abs\/10.5555\/3305381.3305492"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00584"},{"key":"e_1_2_2_14_1","volume-title":"Advances in Neural Information Processing Systems 30 (NIPS","author":"Gulrajani Ishaan","year":"2017","unstructured":"Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. 2017. Improved Training of Wasserstein GANs. In Advances in Neural Information Processing Systems 30 (NIPS 2017). 5769--5779. https:\/\/dl.acm.org\/doi\/abs\/10.5555\/3295222.3295327"},{"key":"e_1_2_2_15_1","unstructured":"Toby Chong Long Hin I-Chao Shen Issei Sato and Takeo Igarashi. 2019. Interactive Subspace Exploration on Generative Image Modelling. https:\/\/arxiv.org\/abs\/1906.09840"},{"key":"e_1_2_2_16_1","volume-title":"Proc. of ICLR","author":"Jahanian Ali","year":"2020","unstructured":"Ali Jahanian, Lucy Chai, and Phillip Isola. 2020. On the \"steerability\" of generative adversarial networks. In Proc. of ICLR 2020. https:\/\/openreview.net\/forum?id=HylsTT4FvB"},{"key":"e_1_2_2_17_1","volume-title":"Proc. of ICLR","author":"Karras Tero","year":"2018","unstructured":"Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. 2018. Progressive Growing of GANs for Improved Quality, Stability, and Variation. In Proc. of ICLR 2018. https:\/\/openreview.net\/forum?id=Hk99zCeAb"},{"key":"e_1_2_2_18_1","volume-title":"Advances in Neural Information Processing Systems 27 (NIPS","author":"Kingma Diederik P.","year":"2014","unstructured":"Diederik P. Kingma, Danilo J. Rezende, Shakir Mohamed, and Max Welling. 2014. Semi-Supervised Learning with Deep Generative Models. In Advances in Neural Information Processing Systems 27 (NIPS 2014). 3581--3589. https:\/\/dl.acm.org\/doi\/10.5555\/2969033.2969226"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647386"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073598"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03054.x"},{"key":"e_1_2_2_23_1","volume-title":"The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors. Master's thesis","author":"Linnainmaa Seppo","unstructured":"Seppo Linnainmaa. 1970. The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors. Master's thesis. University of Helsinki, Finland."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258887"},{"key":"e_1_2_2_26_1","unstructured":"Lucas Maystre. 2018. Efficient Learning from Comparisons. Ph.D. Dissertation. \u00c9cole Polytechnique F\u00e9d\u00e9rale de Lausanne."},{"key":"e_1_2_2_27_1","unstructured":"Mehdi Mirza and Simon Osindero. 2014. Conditional Generative Adversarial Nets. https:\/\/arxiv.org\/abs\/1411.1784"},{"key":"e_1_2_2_28_1","volume-title":"Proc. of ICLR","author":"Miyato Takeru","year":"2018","unstructured":"Takeru Miyato, Toshiki Kataoka, Masanori Koyama, and Yuichi Yoshida. 2018. Spectral Normalization for Generative Adversarial Networks. In Proc. of ICLR 2018. https:\/\/openreview.net\/forum?id=B1QRgziT-"},{"key":"e_1_2_2_29_1","unstructured":"Riccardo Moriconi Marc P. Deisenroth and K. S. Sesh Kumar. 2019. High-dimensional Bayesian optimization using low-dimensional feature spaces. https:\/\/arxiv.org\/abs\/1902.10675"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91578-4"},{"key":"e_1_2_2_31_1","volume-title":"Williams","author":"Rasmussen Carl Edward","year":"2006","unstructured":"Carl Edward Rasmussen and Christopher K. I. Williams. 2006. Gaussian Processes for Machine Learning. The MIT Press."},{"key":"e_1_2_2_32_1","volume-title":"Advances in Neural Information Processing Systems 24 (NIPS","author":"Rifai Salah","year":"2011","unstructured":"Salah Rifai, Yann N. Dauphin, Pascal Vincent, Yoshua Bengio, and Xavier Muller. 2011. The Manifold Tangent Classifier. In Advances in Neural Information Processing Systems 24 (NIPS 2011). 2294--2302. https:\/\/dl.acm.org\/doi\/10.5555\/2986459.2986715"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2014.09.003"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00926"},{"key":"e_1_2_2_36_1","volume-title":"Adams","author":"Snoek Jasper","year":"2012","unstructured":"Jasper Snoek, Hugo Larochelle, and Ryan P. Adams. 2012. Practical Bayesian Optimization of Machine Learning Algorithms. In Advances in Neural Information Processing Systems 25 (NIPS 2012). 2951--2959. https:\/\/dl.acm.org\/doi\/abs\/10.5555\/2999325.2999464"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.949485"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618513"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","unstructured":"Nobuyuki Umetani. 2017. Exploring Generative 3D Shapes Using Autoencoder Networks. In SIGGRAPH Asia 2017 Technical Briefs. 24:1--24:4. 10.1145\/3145749.3145758","DOI":"10.1145\/3145749.3145758"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.4806"},{"key":"e_1_2_2_41_1","unstructured":"Ceyuan Yang Yujun Shen and Bolei Zhou. 2019. Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis. https:\/\/arxiv.org\/abs\/1911.09267"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_36"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386569.3392409","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3386569.3392409","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3386569.3392409","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T05:38:14Z","timestamp":1750829894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386569.3392409"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,12]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,8,31]]}},"alternative-id":["10.1145\/3386569.3392409"],"URL":"https:\/\/doi.org\/10.1145\/3386569.3392409","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,12]]},"assertion":[{"value":"2020-08-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}