{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T22:27:48Z","timestamp":1780093668737,"version":"3.54.0"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>Near-eye displays using holographic projection are emerging as an exciting display approach for virtual and augmented reality at high-resolution without complex optical setups --- shifting optical complexity to computation. While precise phase modulation hardware is becoming available, phase retrieval algorithms are still in their infancy, and holographic display approaches resort to heuristic encoding methods or iterative methods relying on various relaxations.<\/jats:p>\n          <jats:p>In this work, we depart from such existing approximations and solve the phase retrieval problem for a hologram of a scene at a single depth at a given time by revisiting complex Wirtinger derivatives, also extending our framework to render 3D volumetric scenes. Using Wirtinger derivatives allows us to pose the phase retrieval problem as a quadratic problem which can be minimized with first-order optimization methods. The proposed Wirtinger Holography is flexible and facilitates the use of different loss functions, including learned perceptual losses parametrized by deep neural networks, as well as stochastic optimization methods. We validate this framework by demonstrating holographic reconstructions with an order of magnitude lower error, both in simulation and on an experimental hardware prototype.<\/jats:p>","DOI":"10.1145\/3355089.3356539","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":221,"title":["Wirtinger holography for near-eye displays"],"prefix":"10.1145","volume":"38","author":[{"given":"Praneeth","family":"Chakravarthula","sequence":"first","affiliation":[{"name":"University of North Carolina at Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yifan","family":"Peng","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joel","family":"Kollin","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Henry","family":"Fuchs","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"Heide","sequence":"additional","affiliation":[{"name":"Princeton University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Tensorflow: A system for large-scale machine learning. In 12th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 16). 265--283.","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. Tensorflow: A system for large-scale machine learning. In 12th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 16). 265--283."},{"key":"e_1_2_2_2_1","volume-title":"Computer generated holograms from three dimensional meshes using an analytic light transport model. Applied optics 47, 10","author":"Ahrenberg Lukas","year":"2008","unstructured":"Lukas Ahrenberg, Philip Benzie, Marcus Magnor, and John Watson. 2008. Computer generated holograms from three dimensional meshes using an analytic light transport model. Applied optics 47, 10 (2008), 1567--1574."},{"key":"e_1_2_2_3_1","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Aarti Singh and Jerry Zhu (Eds.)","volume":"54","author":"Bahmani S.","unstructured":"S. Bahmani and J. Romberg. 2017. Phase Retrieval Meets Statistical Learning Theory: A Flexible Convex Relaxation. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Aarti Singh and Jerry Zhu (Eds.), Vol. 54. PMLR, Fort Lauderdale, FL, USA, 252--260."},{"key":"e_1_2_2_4_1","first-page":"247","article-title":"Fourier phase problems are uniquely solvable in mute than one dimension. I: Underlying theory","volume":"61","author":"Bates R","year":"1982","unstructured":"R Bates. 1982. Fourier phase problems are uniquely solvable in mute than one dimension. I: Underlying theory. Optik (Stuttgart) 61 (1982), 247--262.","journal-title":"Optik (Stuttgart)"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.20.001025"},{"key":"e_1_2_2_6_1","volume-title":"Method to calculate the far field of three-dimensional objects for computer-generated holography. Applied optics 49, 24","author":"Bayraktar Muharrem","year":"2010","unstructured":"Muharrem Bayraktar and Meri\u00e7 \u00d6zcan. 2010. Method to calculate the far field of three-dimensional objects for computer-generated holography. Applied optics 49, 24 (2010), 4647--4654."},{"key":"e_1_2_2_7_1","volume-title":"Holographic imaging","author":"Benton Stephen A","unstructured":"Stephen A Benton and V Michael Bove Jr. 2008. Holographic imaging. John Wiley & Sons."},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Marco Bevilacqua Aline Roumy Christine Guillemot and Marie Line Alberi-Morel. 2012. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. (2012).","DOI":"10.5244\/C.26.135"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2015.2399924"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpa.21432"},{"key":"e_1_2_2_11_1","volume-title":"Focusar: Auto-focus augmented reality eyeglasses for both real world and virtual imagery","author":"Chakravarthula Praneeth","year":"2018","unstructured":"Praneeth Chakravarthula, David Dunn, Kaan Ak\u015fit, and Henry Fuchs. 2018. Focusar: Auto-focus augmented reality eyeglasses for both real world and virtual imagery. IEEE transactions on visualization and computer graphics 24, 11 (2018), 2906--2916."},{"key":"e_1_2_2_12_1","volume-title":"Improved layer-based method for rapid hologram generation and real-time interactive holographic display applications. Optics express 23, 14","author":"Chen J-S","year":"2015","unstructured":"J-S Chen and DP Chu. 2015. Improved layer-based method for rapid hologram generation and real-time interactive holographic display applications. Optics express 23, 14 (2015), 18143--18155."},{"key":"e_1_2_2_13_1","volume-title":"Computer generated hologram from point cloud using graphics processor. Applied optics 48, 36","author":"Chen Rick H-Y","year":"2009","unstructured":"Rick H-Y Chen and Timothy D Wilkinson. 2009. Computer generated hologram from point cloud using graphics processor. Applied optics 48, 36 (2009), 6841--6850."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130815"},{"key":"e_1_2_2_15_1","volume-title":"Phase retrieval algorithms: a comparison. Applied optics 21, 15","author":"Fienup James R","year":"1982","unstructured":"James R Fienup. 1982. Phase retrieval algorithms: a comparison. Applied optics 21, 15 (1982), 2758--2769."},{"key":"e_1_2_2_16_1","volume-title":"Phase-retrieval algorithms for a complicated optical system. Applied optics 32, 10","author":"Fienup James R","year":"1993","unstructured":"James R Fienup. 1993. Phase-retrieval algorithms for a complicated optical system. Applied optics 32, 10 (1993), 1737--1746."},{"key":"e_1_2_2_17_1","first-page":"237","article-title":"A practical algorithm for the determination of the phase from image and diffraction plane pictures","volume":"35","author":"Gerchberg Ralph W","year":"1972","unstructured":"Ralph W Gerchberg. 1972. A practical algorithm for the determination of the phase from image and diffraction plane pictures. Optik 35 (1972), 237--246.","journal-title":"Optik"},{"key":"e_1_2_2_18_1","volume-title":"PhaseMax: Convex phase retrieval via basis pursuit","author":"Goldstein Tom","year":"2018","unstructured":"Tom Goldstein and Christoph Studer. 2018. PhaseMax: Convex phase retrieval via basis pursuit. IEEE Transactions on Information Theory (2018)."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.66.000961"},{"key":"e_1_2_2_20_1","volume-title":"Introduction to Fourier optics","author":"Goodman Joseph W","unstructured":"Joseph W Goodman. 2005. Introduction to Fourier optics. Roberts and Company Publishers."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601120"},{"key":"e_1_2_2_22_1","volume-title":"Computer-generated double-phase holograms. Applied optics 17, 24","author":"Hsueh CK","year":"1978","unstructured":"CK Hsueh and AA Sawchuk. 1978. Computer-generated double-phase holograms. Applied optics 17, 24 (1978), 3874--3883."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766922"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299156"},{"key":"e_1_2_2_25_1","volume-title":"Fast and effective occlusion culling for 3D holographic displays by inverse orthographic projection with low angular sampling. Applied optics 53, 27","author":"Jia Jia","year":"2014","unstructured":"Jia Jia, Juan Liu, Guofan Jin, and Yongtian Wang. 2014. Fast and effective occlusion culling for 3D holographic displays by inverse orthographic projection with low angular sampling. Applied optics 53, 27 (2014), 6287--6293."},{"key":"e_1_2_2_26_1","volume-title":"Mathematical modeling of triangle-mesh-modeled three-dimensional surface objects for digital holography. Applied optics 47, 19","author":"Kim Hwi","year":"2008","unstructured":"Hwi Kim, Joonku Hahn, and Byoungho Lee. 2008. Mathematical modeling of triangle-mesh-modeled three-dimensional surface objects for digital holography. Applied optics 47, 19 (2008), D117--D127."},{"key":"e_1_2_2_27_1","volume-title":"Phase retrieval using conjugate gradient minimization. journal of Modern Optics 38, 9","author":"Lane RG","year":"1991","unstructured":"RG Lane. 1991. Phase retrieval using conjugate gradient minimization. journal of Modern Optics 38, 9 (1991), 1797--1813."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508366"},{"key":"e_1_2_2_29_1","volume-title":"Computer-generated holograms of 3-D objects composed of tilted planar segments. Applied optics 27, 14","author":"Leseberg Detlef","year":"1988","unstructured":"Detlef Leseberg and Christian Fr\u00e8re. 1988. Computer-generated holograms of 3-D objects composed of tilted planar segments. Applied optics 27, 14 (1988), 3020--3024."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1147\/rd.132.0150"},{"key":"e_1_2_2_31_1","volume-title":"On the limited memory BFGS method for large scale optimization. Mathematical programming 45, 1-3","author":"Liu Dong C","year":"1989","unstructured":"Dong C Liu and Jorge Nocedal. 1989. On the limited memory BFGS method for large scale optimization. Mathematical programming 45, 1-3 (1989), 503--528."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218490"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.133376"},{"key":"e_1_2_2_34_1","volume-title":"Relaxed averaged alternating reflections for diffraction imaging. Inverse problems 21, 1","author":"Luke D Russell","year":"2004","unstructured":"D Russell Luke. 2004. Relaxed averaged alternating reflections for diffraction imaging. Inverse problems 21, 1 (2004), 37."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073624"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acha.2015.06.005"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937655"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1364\/OPEX.14.000603"},{"key":"e_1_2_2_39_1","volume-title":"Computer-generated holograms for three-dimensional surface objects with shade and texture. Applied optics 44, 22","author":"Matsushima Kyoji","year":"2005","unstructured":"Kyoji Matsushima. 2005. Computer-generated holograms for three-dimensional surface objects with shade and texture. Applied optics 44, 22 (2005), 4607--4614."},{"key":"e_1_2_2_40_1","volume-title":"Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method. Applied optics 48, 34","author":"Matsushima Kyoji","year":"2009","unstructured":"Kyoji Matsushima and Sumio Nakahara. 2009. Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method. Applied optics 48, 34 (2009), H54--H63."},{"key":"e_1_2_2_41_1","volume-title":"Silhouette method for hidden surface removal in computer holography and its acceleration using the switch-back technique. Optics express 22, 20","author":"Matsushima Kyoji","year":"2014","unstructured":"Kyoji Matsushima, Masaki Nakamura, and Sumio Nakahara. 2014. Silhouette method for hidden surface removal in computer holography and its acceleration using the switch-back technique. Optics express 22, 20 (2014), 24450--24465."},{"key":"e_1_2_2_42_1","volume-title":"Mix-and-match holography. ACM Transactions on Graphics","author":"Peng Yifan","year":"2017","unstructured":"Yifan Peng, Xiong Dun, Qilin Sun, and Wolfgang Heidrich. 2017. Mix-and-match holography. ACM Transactions on Graphics (2017)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.476879"},{"key":"e_1_2_2_44_1","volume-title":"Theory of complex functions","author":"Remmert Reinhold","unstructured":"Reinhold Remmert. 2012. Theory of complex functions. Vol. 122. Springer Science & Business Media."},{"key":"e_1_2_2_45_1","volume-title":"minFunc: unconstrained differentiable multivariate optimization in Matlab. Software","author":"Schmidt Mark","year":"2005","unstructured":"Mark Schmidt. 2005. minFunc: unconstrained differentiable multivariate optimization in Matlab. Software available at http:\/\/www.cs.ubc.ca\/~schmidtm\/Software\/minFunc.htm (2005)."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130832"},{"key":"e_1_2_2_47_1","volume-title":"Practical Holography XXIV: Materials and Applications","author":"Smithwick Quinn YJ","year":"1903","unstructured":"Quinn YJ Smithwick, James Barabas, Daniel E Smalley, and V Michael Bove. 2010. Interactive holographic stereograms with accommodation cues. In Practical Holography XXIV: Materials and Applications, Vol. 7619. International Society for Optics and Photonics, 761903."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.10.000299"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACSSC.2003.1292216"},{"key":"e_1_2_2_51_1","volume-title":"Holographic image synthesis utilizing theoretical methods. Applied physics letters 9, 11","author":"Waters James P","year":"1966","unstructured":"James P Waters. 1966. Holographic image synthesis utilizing theoretical methods. Applied physics letters 9, 11 (1966), 405--407."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/11\/115010"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.155027"},{"key":"e_1_2_2_54_1","volume-title":"Practical Holography XXX: Materials and Applications","volume":"9771","author":"Yoshikawa Hiroshi","year":"2016","unstructured":"Hiroshi Yoshikawa, Takeshi Yamaguchi, and Hiroki Uetake. 2016. Image quality evaluation and control of computer-generated holograms. In Practical Holography XXX: Materials and Applications, Vol. 9771. International Society for Optics and Photonics, 97710N."},{"key":"e_1_2_2_55_1","volume-title":"International conference on curves and surfaces. Springer, 711--730","author":"Zeyde Roman","year":"2010","unstructured":"Roman Zeyde, Michael Elad, and Matan Protter. 2010. On single image scale-up using sparse-representations. In International conference on curves and surfaces. Springer, 711--730."},{"key":"e_1_2_2_56_1","volume-title":"Fully computed holographic stereogram based algorithm for computer-generated holograms with accurate depth cues. Optics express 23, 4","author":"Zhang Hao","year":"2015","unstructured":"Hao Zhang, Yan Zhao, Liangcai Cao, and Guofan Jin. 2015. Fully computed holographic stereogram based algorithm for computer-generated holograms with accurate depth cues. Optics express 23, 4 (2015), 3901--3913."},{"key":"e_1_2_2_57_1","volume-title":"Layered holographic stereogram based on inverse Fresnel diffraction. Applied optics 55, 3","author":"Zhang Hao","year":"2016","unstructured":"Hao Zhang, Yan Zhao, Liangcai Cao, and Guofan Jin. 2016. Layered holographic stereogram based on inverse Fresnel diffraction. Applied optics 55, 3 (2016), A154--A159."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1364\/OPTICA.4.001306"},{"key":"e_1_2_2_59_1","volume-title":"The unreasonable effectiveness of deep features as a perceptual metric. arXiv preprint","author":"Zhang Richard","year":"2018","unstructured":"Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. 2018. The unreasonable effectiveness of deep features as a perceptual metric. arXiv preprint (2018)."},{"key":"e_1_2_2_60_1","volume-title":"Accurate calculation of computer-generated holograms using angular-spectrum layer-oriented method. Optics express 23, 20","author":"Zhao Yan","year":"2015","unstructured":"Yan Zhao, Liangcai Cao, Hao Zhang, Dezhao Kong, and Guofan Jin. 2015. Accurate calculation of computer-generated holograms using angular-spectrum layer-oriented method. Optics express 23, 20 (2015), 25440--25449."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356539","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356539","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356539"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":59,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356539"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356539","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}