{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T08:29:37Z","timestamp":1691742577628},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"University of Augsburg"},{"name":"Universit\u00e4t Augsburg"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SN COMPUT. SCI."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this work, we propose a method that enforces explicit control over various attributes during the image generation process in a generative adversarial net. We propose a semi-supervised learning procedure that allows us to use a quantized approximation of object orientation for learning continuous object rotations. As a result, among many other attributes, our proposed method allows us to control object orientation in scenes that are rendered according to our specifications.<\/jats:p>","DOI":"10.1007\/s42979-022-01462-w","type":"journal-article","created":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T21:13:44Z","timestamp":1668114824000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Controlling 3D Objects in 2D Image Synthesis"],"prefix":"10.1007","volume":"4","author":[{"given":"Stephan","family":"Brehm","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Barthel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rainer","family":"Lienhart","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,11,10]]},"reference":[{"key":"1462_CR1","doi-asserted-by":"publisher","unstructured":"Karras T, Laine S, Aittala M, Hellsten J, Lehtinen J, Aila T. Analyzing and improving the image quality of stylegan. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition, CVPR 2020, Seattle, WA, USA, June 13\u201319, 2020. Computer Vision Foundation\/IEEE. 2020. pp 8107\u201316. https:\/\/doi.org\/10.1109\/CVPR42600.2020.00813.","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"1462_CR2","unstructured":"H\u00e4rk\u00f6nen E, Hertzmann A, Lehtinen J, Paris S. Ganspace: discovering interpretable GAN controls. In: Larochelle H, Ranzato M, Hadsell R, Balcan M, Lin H, editors. Advances in neural information processing systems 33: annual conference on neural information processing systems 2020, NeurIPS 2020, December 6\u201312, 2020, Virtual. 2020."},{"key":"1462_CR3","unstructured":"Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville AC, Bengio Y. Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ, editors. Advances in neural information processing systems 27: annual conference on neural information processing systems 2014, December 8\u201313 2014, Montreal, Quebec, Canada. 2014. pp 2672\u201380."},{"key":"1462_CR4","doi-asserted-by":"publisher","first-page":"187455","DOI":"10.1109\/ACCESS.2020.3031059","volume":"8","author":"H Xu","year":"2020","unstructured":"Xu H, Li C, Rahaman MM, Yao Y, Li Z, Zhang J, Kulwa F, Zhao X, Qi S, Teng Y. An enhanced framework of generative adversarial networks (ef-gans) for environmental microorganism image augmentation with limited rotation-invariant training data. IEEE Access. 2020;8:187455\u201369. https:\/\/doi.org\/10.1109\/ACCESS.2020.3031059.","journal-title":"IEEE Access"},{"key":"1462_CR5","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.isprsjprs.2021.07.007","volume":"179","author":"X Li","year":"2021","unstructured":"Li X, Zhengshun D, Huang Y, Tan Z. A deep translation (gan) based change detection network for optical and sar remote sensing images. ISPRS J Photogramm Remote Sens. 2021;179:14\u201334. https:\/\/doi.org\/10.1016\/j.isprsjprs.2021.07.007.","journal-title":"ISPRS J Photogramm Remote Sens"},{"key":"1462_CR6","doi-asserted-by":"crossref","unstructured":"Chan ER, Monteiro M, Kellnhofer P, Wu J, Wetzstein G. Pi-gan: periodic implicit generative adversarial networks for 3d-aware image synthesis. In: IEEE conference on computer vision and pattern recognition, CVPR 2021, virtual, June 19\u201325, 2021. Computer Vision Foundation\/IEEE. 2021. pp 5799\u2013809.","DOI":"10.1109\/CVPR46437.2021.00574"},{"key":"1462_CR7","unstructured":"Zhang Y, Chen W, Ling H, Gao J, Zhang Y, Torralba A, Fidler S. Image gans meet differentiable rendering for inverse graphics and interpretable 3d neural rendering. In: 9th international conference on learning representations, ICLR 2021, virtual event, Austria, May 3\u20137, 2021. OpenReview.net. 2021."},{"key":"1462_CR8","doi-asserted-by":"publisher","unstructured":"Tewari A, Elgharib M, Bharaj G, Bernard F, Seidel H, P\u00e9rez P, Zollh\u00f6fer M, Theobalt C. Stylerig: rigging stylegan for 3d control over portrait images. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition, CVPR 2020, Seattle, WA, USA, June 13\u201319, 2020. Computer Vision Foundation\/IEEE. 2020. pp 6141\u201350. https:\/\/doi.org\/10.1109\/CVPR42600.2020.00618.","DOI":"10.1109\/CVPR42600.2020.00618"},{"key":"1462_CR9","doi-asserted-by":"publisher","unstructured":"Shoshan A, Bhonker N, Kviatkovsky I, Medioni GG. Gan-control: explicitly controllable gans. In: 2021 IEEE\/CVF international conference on computer vision, ICCV 2021, Montreal, QC, Canada, October 10\u201317, 2021. IEEE. 2021. pp. 14063\u201373. https:\/\/doi.org\/10.1109\/ICCV48922.2021.01382.","DOI":"10.1109\/ICCV48922.2021.01382"},{"key":"1462_CR10","doi-asserted-by":"publisher","unstructured":"Brehm S, Harzig P, Einfalt M, Lienhart R. Learning segmentation from object color. In: 3rd IEEE conference on multimedia information processing and retrieval, MIPR 2020, Shenzhen, China, August 6\u20138, 2020. IEEE. 2020. pp. 139\u201344. https:\/\/doi.org\/10.1109\/MIPR49039.2020.00036.","DOI":"10.1109\/MIPR49039.2020.00036"},{"key":"1462_CR11","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition, CVPR 2016, Las Vegas, NV, USA, June 27\u201330, 2016. IEEE Computer Society. 2016. pp. 770\u201378. https:\/\/doi.org\/10.1109\/CVPR.2016.90.","DOI":"10.1109\/CVPR.2016.90"},{"key":"1462_CR12","doi-asserted-by":"publisher","unstructured":"Deng J, Dong W, Socher R, Li L, Li K, Fei-Fei L. Imagenet: a large-scale hierarchical image database. In: 2009 IEEE computer society conference on computer vision and pattern recognition (CVPR 2009), 20\u201325 June 2009, Miami, Florida, USA. IEEE Computer Society. 2009. pp. 248\u201355. https:\/\/doi.org\/10.1109\/CVPR.2009.5206848.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"1462_CR13","unstructured":"Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R, Vishwanathan SVN, Garnett R, editors. Advances in neural information processing systems 30: annual conference on neural information processing systems 2017, December 4\u20139, 2017, Long Beach, CA, USA. 2017. pp. 6626\u201337."},{"issue":"6","key":"1462_CR14","first-page":"689","volume":"244","author":"M Fr\u00e9chet","year":"1957","unstructured":"Fr\u00e9chet M. Sur la distance de deux lois de probabilit\u00e9. Comptes Rendus Hebdomadaires des Seances de L Academie des Sciences. 1957;244(6):689\u201392.","journal-title":"Comptes Rendus Hebdomadaires des Seances de L Academie des Sciences"},{"key":"1462_CR15","doi-asserted-by":"publisher","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: 2016 IEEE conference on computer vision and pattern recognition, CVPR 2016, Las Vegas, NV, USA, June 27\u201330, 2016. IEEE Computer Society. 2016. pp. 2818\u201326. https:\/\/doi.org\/10.1109\/CVPR.2016.308.","DOI":"10.1109\/CVPR.2016.308"},{"key":"1462_CR16","doi-asserted-by":"publisher","unstructured":"Chong MJ, Forsyth DA. Effectively unbiased FID and inception score and where to find them. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition, CVPR 2020, Seattle, WA, USA, June 13\u201319, 2020. Computer Vision Foundation\/IEEE. 2020. pp. 6069\u201378. https:\/\/doi.org\/10.1109\/CVPR42600.2020.00611.","DOI":"10.1109\/CVPR42600.2020.00611"},{"key":"1462_CR17","doi-asserted-by":"publisher","unstructured":"Zhang R, Isola P, Efros AA, Shechtman E, Wang O. The unreasonable effectiveness of deep features as a perceptual metric. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18\u201322, 2018. Computer Vision Foundation\/IEEE Computer Society. 2018. pp. 586\u201395. https:\/\/doi.org\/10.1109\/CVPR.2018.00068.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"1462_CR18","doi-asserted-by":"publisher","unstructured":"Mousavian A, Anguelov D, Flynn J, Kosecka J. 3d bounding box estimation using deep learning and geometry. In: 2017 IEEE conference on computer vision and pattern recognition, CVPR 2017, Honolulu, HI, USA, July 21\u201326, 2017. IEEE Computer Society. 2017. pp. 5632\u201340. https:\/\/doi.org\/10.1109\/CVPR.2017.597.","DOI":"10.1109\/CVPR.2017.597"},{"key":"1462_CR19","doi-asserted-by":"publisher","unstructured":"Geiger A, Lenz P, Urtasun R. Are we ready for autonomous driving? The KITTI vision benchmark suite. In: 2012 IEEE conference on computer vision and pattern recognition, Providence, RI, USA, June 16\u201321, 2012. IEEE Computer Society (2012). pp. 3354\u201361. https:\/\/doi.org\/10.1109\/CVPR.2012.6248074.","DOI":"10.1109\/CVPR.2012.6248074"}],"container-title":["SN Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-022-01462-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42979-022-01462-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-022-01462-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,7]],"date-time":"2023-01-07T22:24:14Z","timestamp":1673130254000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42979-022-01462-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,10]]},"references-count":19,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["1462"],"URL":"https:\/\/doi.org\/10.1007\/s42979-022-01462-w","relation":{},"ISSN":["2661-8907"],"issn-type":[{"value":"2661-8907","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,10]]},"assertion":[{"value":"10 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"48"}}