{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T15:57:52Z","timestamp":1685980672614},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,7,26]],"date-time":"2019-07-26T00:00:00Z","timestamp":1564099200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["StG-2015-637014"]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2019,7,26]]},"abstract":"We propose a novel method to up-sample volumetric functions with generative neural networks using several orthogonal passes. Our method decomposes generative problems on Cartesian field functions into multiple smaller sub-problems that can be learned more efficiently. Specifically, we utilize two separate generative adversarial networks: the first one up-scales slices which are parallel to the XY-plane, whereas the second one refines the whole volume along the Z---axis working on slices in the YZ-plane. In this way, we obtain full coverage for the 3D target function and can leverage spatio-temporal supervision with a set of discriminators. Additionally, we demonstrate that our method can be combined with curriculum learning and progressive growing approaches. We arrive at a first method that can up-sample volumes by a factor of eight along each dimension, i.e., increasing the number of degrees of freedom by 512. Large volumetric up-scaling factors such as this one have previously not been attainable as the required number of weights in the neural networks renders adversarial training runs prohibitively difficult. We demonstrate the generality of our trained networks with a series of comparisons to previous work, a variety of complex 3D results, and an analysis of the resulting performance.<\/jats:p>","DOI":"10.1145\/3340251","type":"journal-article","created":{"date-parts":[[2019,7,29]],"date-time":"2019-07-29T20:55:51Z","timestamp":1564433751000},"page":"1-21","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["A Multi-Pass GAN for Fluid Flow Super-Resolution"],"prefix":"10.1145","volume":"2","author":[{"given":"Maximilian","family":"Werhahn","sequence":"first","affiliation":[{"name":"Technical University of Munich"}]},{"given":"You","family":"Xie","sequence":"additional","affiliation":[{"name":"Technical University of Munich"}]},{"given":"Mengyu","family":"Chu","sequence":"additional","affiliation":[{"name":"Technical University of Munich"}]},{"given":"Nils","family":"Thuerey","sequence":"additional","affiliation":[{"name":"Technical University of Munich"}]}],"member":"320","published-online":{"date-parts":[[2019,7,26]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Mart\u00edn Arjovsky and L\u00e9on Bottou. 2017. Towards Principled Methods for Training Generative Adversarial Networks. CoRR abs\/1701.04862 (2017). arXiv:1701.04862 http:\/\/arxiv.org\/abs\/1701.04862 Mart\u00edn Arjovsky and L\u00e9on Bottou. 2017. Towards Principled Methods for Training Generative Adversarial Networks. CoRR abs\/1701.04862 (2017). arXiv:1701.04862 http:\/\/arxiv.org\/abs\/1701.04862"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073708"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276502"},{"key":"e_1_2_2_4_1","unstructured":"Prateep Bhattacharjee and Sukhendu Das. 2017. Temporal coherency based criteria for predicting video frames using deep multi-stage generative adversarial networks. In Advances in Neural Information Processing Systems. 4268--4277. Prateep Bhattacharjee and Sukhendu Das. 2017. Temporal coherency based criteria for predicting video frames using deep multi-stage generative adversarial networks. In Advances in Neural Information Processing Systems. 4268--4277."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073601"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.126"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073643"},{"key":"e_1_2_2_8_1","unstructured":"Mengyu Chu You Xie Laura Leal-Taix\u00e9 and Nils Thuerey. 2018. Temporally Coherent GANs for Video Super-Resolution (TecoGAN). arXiv preprint arXiv:1811.09393 (2018). Mengyu Chu You Xie Laura Leal-Taix\u00e9 and Nils Thuerey. 2018. Temporally Coherent GANs for Video Super-Resolution (TecoGAN). arXiv preprint arXiv:1811.09393 (2018)."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"e_1_2_2_10_1","unstructured":"Amir Barati Farimani Joseph Gomes and Vijay S Pande. 2017. Deep learning the physics of transport phenomena. arXiv preprint arXiv:1709.02432 (2017). Amir Barati Farimani Joseph Gomes and Vijay S Pande. 2017. Deep learning the physics of transport phenomena. arXiv preprint arXiv:1709.02432 (2017)."},{"key":"e_1_2_2_11_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680. Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818129"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130880"},{"key":"e_1_2_2_16_1","unstructured":"Tero Karras Timo Aila Samuli Laine and Jaakko Lehtinen. 2017. Progressive growing of gans for improved quality stability and variation. arXiv preprint arXiv:1710.10196 (2017). Tero Karras Timo Aila Samuli Laine and Jaakko Lehtinen. 2017. Progressive growing of gans for improved quality stability and variation. arXiv preprint arXiv:1710.10196 (2017)."},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"John A Kennedy Ora Israel Alex Frenkel Rachel Bar-Shalom and Haim Azhari. 2006. Super-resolution in PET imaging. IEEE transactions on medical imaging 25 2 (2006) 137--147. John A Kennedy Ora Israel Alex Frenkel Rachel Bar-Shalom and Haim Azhari. 2006. Super-resolution in PET imaging. IEEE transactions on medical imaging 25 2 (2006) 137--147.","DOI":"10.1109\/TMI.2005.861705"},{"key":"e_1_2_2_18_1","volume-title":"Deep Fluids: A Generative Network for Parameterized Fluid Simulations. arXiv preprint arXiv:1806.02071","author":"Kim Byungsoo","year":"2018"},{"key":"e_1_2_2_19_1","volume-title":"Flowfixer: Using bfecc for fluid simulation. Technical Report","author":"Kim ByungMoon","year":"2005"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.182"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360649"},{"key":"e_1_2_2_22_1","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR abs\/1412.6980 (2014). arXiv:1412.6980 http:\/\/arxiv.org\/abs\/1412.6980 Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR abs\/1412.6980 (2014). arXiv:1412.6980 http:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_2_2_23_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","volume":"2","author":"Lai Wei-Sheng","year":"2017"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Christian Ledig Lucas Theis Ferenc Husz\u00e1r Jose Caballero Andrew Cunningham Alejandro Acosta Andrew Aitken Alykhan Tejani Johannes Totz Zehan Wang etal 2017. Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint (2017). Christian Ledig Lucas Theis Ferenc Husz\u00e1r Jose Caballero Andrew Cunningham Alejandro Acosta Andrew Aitken Alykhan Tejani Johannes Totz Zehan Wang et al. 2017. Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint (2017).","DOI":"10.1109\/CVPR.2017.19"},{"key":"e_1_2_2_25_1","first-page":"3","article-title":"Enhanced deep residual networks for single image super-resolution","volume":"1","author":"Lim Bee","year":"2017","journal-title":"CVPR"},{"key":"e_1_2_2_26_1","volume-title":"Pde-net: Learning pdes from data. arXiv preprint arXiv:1710.09668","author":"Long Zichao","year":"2017"},{"key":"e_1_2_2_27_1","unstructured":"Xudong Mao Qing Li Haoran Xie Raymond Y. K. Lau and Zhen Wang. 2016. Multi-class Generative Adversarial Networks with the L2 Loss Function. CoRR abs\/1611.04076 (2016). arXiv:1611.04076 http:\/\/arxiv.org\/abs\/1611.04076 Xudong Mao Qing Li Haoran Xie Raymond Y. K. Lau and Zhen Wang. 2016. Multi-class Generative Adversarial Networks with the L2 Loss Function. CoRR abs\/1611.04076 (2016). arXiv:1611.04076 http:\/\/arxiv.org\/abs\/1611.04076"},{"key":"e_1_2_2_28_1","unstructured":"Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014). Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014)."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409119"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073602"},{"key":"e_1_2_2_31_1","unstructured":"Lukas Prantl Boris Bonev and Nils Thuerey. 2017. Pre-computed liquid spaces with generative neural networks and optical flow. arXiv preprint arXiv:1704.07854 (2017). Lukas Prantl Boris Bonev and Nils Thuerey. 2017. Pre-computed liquid spaces with generative neural networks and optical flow. arXiv preprint arXiv:1704.07854 (2017)."},{"key":"e_1_2_2_32_1","volume-title":"Proc. ICLR","author":"Radford Alec","year":"2016"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45886-1_3"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.308"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.481"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10915-007-9166-4"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311548"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.298"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980229"},{"key":"e_1_2_2_40_1","unstructured":"Nils Thuerey and Tobias Pfaff. 2018. MantaFlow. (2018). http:\/\/mantaflow.com. Nils Thuerey and Tobias Pfaff. 2018. MantaFlow. (2018). http:\/\/mantaflow.com."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.241"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3306035"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.514"},{"key":"e_1_2_2_44_1","volume-title":"Computer Graphics Forum","author":"Um Kiwon"},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Yifan Wang Federico Perazzi Brian McWilliams Alexander Sorkine-Hornung Olga Sorkine-Hornung and Christopher Schroers. 2018. A Fully Progressive Approach to Single-Image Super-Resolution. CoRR abs\/1804.02900 (2018). arXiv:1804.02900 http:\/\/arxiv.org\/abs\/1804.02900 Yifan Wang Federico Perazzi Brian McWilliams Alexander Sorkine-Hornung Olga Sorkine-Hornung and Christopher Schroers. 2018. A Fully Progressive Approach to Single-Image Super-Resolution. CoRR abs\/1804.02900 (2018). arXiv:1804.02900 http:\/\/arxiv.org\/abs\/1804.02900","DOI":"10.1109\/CVPRW.2018.00131"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201304"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298649"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2009.09.002"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3340251","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T06:34:03Z","timestamp":1672554843000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340251"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,26]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,7,26]]}},"alternative-id":["10.1145\/3340251"],"URL":"http:\/\/dx.doi.org\/10.1145\/3340251","relation":{},"ISSN":["2577-6193"],"issn-type":[{"value":"2577-6193","type":"electronic"}],"subject":["Computer Graphics and Computer-Aided Design","Computer Science Applications"],"published":{"date-parts":[[2019,7,26]]},"assertion":[{"value":"2019-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}