{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T07:16:03Z","timestamp":1781853363196,"version":"3.54.5"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"PECASE by the ARO"},{"name":"NSF","award":["1839974"],"award-info":[{"award-number":["1839974"]}]},{"DOI":"10.13039\/100000010","name":"Ford","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100000010","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>Holographic near-eye displays promise unprecedented capabilities for virtual and augmented reality (VR\/AR) systems. The image quality achieved by current holographic displays, however, is limited by the wave propagation models used to simulate the physical optics. We propose a neural network-parameterized plane-to-multiplane wave propagation model that closes the gap between physics and simulation. Our model is automatically trained using camera feedback and it outperforms related techniques in 2D plane-to-plane settings by a large margin. Moreover, it is the first network-parameterized model to naturally extend to 3D settings, enabling high-quality 3D computer-generated holography using a novel phase regularization strategy of the complex-valued wave field. The efficacy of our approach is demonstrated through extensive experimental evaluation with both VR and optical see-through AR display prototypes.<\/jats:p>","DOI":"10.1145\/3478513.3480542","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T18:29:20Z","timestamp":1639160960000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":180,"title":["Neural 3D holography"],"prefix":"10.1145","volume":"40","author":[{"given":"Suyeon","family":"Choi","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manu","family":"Gopakumar","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yifan","family":"Peng","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonghyun","family":"Kim","sequence":"additional","affiliation":[{"name":"NVIDIA and Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gordon","family":"Wetzstein","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,12,10]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study. In CVPR.","author":"Agustsson Eirikur","year":"2017","unstructured":"Eirikur Agustsson and Radu Timofte . 2017 . NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study. In CVPR. Eirikur Agustsson and Radu Timofte. 2017. NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study. In CVPR."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1561\/2200000015"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2451236.2451239"},{"key":"e_1_2_2_4_1","volume-title":"Proc. SPIE","volume":"0367","author":"Benton Stephen A.","year":"1983","unstructured":"Stephen A. Benton . 1983 . Survey Of Holographic Stereograms . In Proc. SPIE , Vol. 0367 . Stephen A. Benton. 1983. Survey Of Holographic Stereograms. In Proc. SPIE, Vol. 0367."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1370944"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/713826091"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356539"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417846"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1364\/OPTICA.406004"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.425077"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.23.018143"},{"key":"e_1_2_2_12_1","volume-title":"Computer generated hologram with geometric occlusion using GPU-accelerated depth buffer rasterization for three-dimensional display. Applied optics 48, 21","author":"Chen Rick H-Y","year":"2009","unstructured":"Rick H-Y Chen and Timothy D Wilkinson . 2009. Computer generated hologram with geometric occlusion using GPU-accelerated depth buffer rasterization for three-dimensional display. Applied optics 48, 21 ( 2009 ), 4246--4255. Rick H-Y Chen and Timothy D Wilkinson. 2009. Computer generated hologram with geometric occlusion using GPU-accelerated depth buffer rasterization for three-dimensional display. Applied optics 48, 21 (2009), 4246--4255."},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Wenzheng Chen Parsa Mirdehghan Sanja Fidler and Kiriakos N Kutulakos. 2020. Auto-Tuning Structured Light by Optical Stochastic Gradient Descent. In CVPR. 5970--5980.  Wenzheng Chen Parsa Mirdehghan Sanja Fidler and Kiriakos N Kutulakos. 2020. Auto-Tuning Structured Light by Optical Stochastic Gradient Descent. In CVPR. 5970--5980.","DOI":"10.1109\/CVPR42600.2020.00601"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1364\/OPTICA.410622"},{"key":"e_1_2_2_15_1","volume-title":"Dynamic holographic optical tweezers. Optics communications 207, 1-6","author":"Curtis Jennifer E","year":"2002","unstructured":"Jennifer E Curtis , Brian A Koss , and David G Grier . 2002. Dynamic holographic optical tweezers. Optics communications 207, 1-6 ( 2002 ), 169--175. Jennifer E Curtis, Brian A Koss, and David G Grier. 2002. Dynamic holographic optical tweezers. Optics communications 207, 1-6 (2002), 169--175."},{"key":"e_1_2_2_16_1","volume-title":"Fresnel ping-pong algorithm for two-plane computer-generated hologram display. OSA Applied optics 33, 5","author":"Dorsch Rainer G","year":"1994","unstructured":"Rainer G Dorsch , Adolf W Lohmann , and Stefan Sinzinger . 1994. Fresnel ping-pong algorithm for two-plane computer-generated hologram display. OSA Applied optics 33, 5 ( 1994 ), 869--875. Rainer G Dorsch, Adolf W Lohmann, and Stefan Sinzinger. 1994. Fresnel ping-pong algorithm for two-plane computer-generated hologram display. OSA Applied optics 33, 5 (1994), 869--875."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.399624"},{"key":"e_1_2_2_18_1","volume-title":"Phase retrieval algorithms: a comparison. Applied optics 21, 15","author":"Fienup James R","year":"1982","unstructured":"James R Fienup . 1982. Phase retrieval algorithms: a comparison. Applied optics 21, 15 ( 1982 ), 2758--2769. James R Fienup. 1982. Phase retrieval algorithms: a comparison. Applied optics 21, 15 (1982), 2758--2769."},{"key":"e_1_2_2_19_1","volume-title":"Monocular 3D see-through head-mounted display via complex amplitude modulation. OSA Opt","author":"Gao Qiankun","year":"2016","unstructured":"Qiankun Gao , Juan Liu , Jian Han , and Xin Li. 2016. Monocular 3D see-through head-mounted display via complex amplitude modulation. OSA Opt . Express 24, 15 ( 2016 ). Qiankun Gao, Juan Liu, Jian Han, and Xin Li. 2016. Monocular 3D see-through head-mounted display via complex amplitude modulation. OSA Opt. Express 24, 15 (2016)."},{"key":"e_1_2_2_20_1","first-page":"237","article-title":"A practical algorithm for the determination of phase from image and diffraction plane pictures","volume":"35","author":"Gerchberg Ralph W","year":"1972","unstructured":"Ralph W Gerchberg . 1972 . A practical algorithm for the determination of phase from image and diffraction plane pictures . Optik 35 (1972), 237 -- 246 . Ralph W Gerchberg. 1972. A practical algorithm for the determination of phase from image and diffraction plane pictures. Optik 35 (1972), 237--246.","journal-title":"Optik"},{"key":"e_1_2_2_21_1","volume-title":"Introduction to Fourier optics","author":"Goodman Joseph W","unstructured":"Joseph W Goodman . 2005. Introduction to Fourier optics . Roberts and Company . Joseph W Goodman. 2005. Introduction to Fourier optics. Roberts and Company."},{"key":"e_1_2_2_22_1","volume-title":"Three-dimensional spatiotemporal focusing of holographic patterns. Nature communications 7, 1","author":"Hernandez Oscar","year":"2016","unstructured":"Oscar Hernandez , Eirini Papagiakoumou , Dimitrii Tanese , Kevin Fidelin , Claire Wyart , and Valentina Emiliani . 2016. Three-dimensional spatiotemporal focusing of holographic patterns. Nature communications 7, 1 ( 2016 ), 1--11. Oscar Hernandez, Eirini Papagiakoumou, Dimitrii Tanese, Kevin Fidelin, Claire Wyart, and Valentina Emiliani. 2016. Three-dimensional spatiotemporal focusing of holographic patterns. Nature communications 7, 1 (2016), 1--11."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.57.003859"},{"key":"e_1_2_2_24_1","volume-title":"Sawchuk","author":"Hsueh Chung-Kai","year":"1978","unstructured":"Chung-Kai Hsueh and Alexander A . Sawchuk . 1978 . Computer-generated double-phase holograms. Applied optics 17, 24 (1978), 3874--3883. Chung-Kai Hsueh and Alexander A. Sawchuk. 1978. Computer-generated double-phase holograms. Applied optics 17, 24 (1978), 3874--3883."},{"key":"e_1_2_2_25_1","volume-title":"A 3D integral imaging optical see-through head-mounted display. Optics express 22, 11","author":"Hua Hong","year":"2014","unstructured":"Hong Hua and Bahram Javidi . 2014. A 3D integral imaging optical see-through head-mounted display. Optics express 22, 11 ( 2014 ), 13484--13491. Hong Hua and Bahram Javidi. 2014. A 3D integral imaging optical see-through head-mounted display. Optics express 22, 11 (2014), 13484--13491."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766922"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275069"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130889"},{"key":"e_1_2_2_29_1","volume-title":"Accurate phase-added stereogram to improve the coherent stereogram. OSA Appl. Opt. 47, 19","author":"Kang Hoonjong","year":"2008","unstructured":"Hoonjong Kang , Takeshi Yamaguchi , and Hiroshi Yoshikawa . 2008. Accurate phase-added stereogram to improve the coherent stereogram. OSA Appl. Opt. 47, 19 ( 2008 ). Hoonjong Kang, Takeshi Yamaguchi, and Hiroshi Yoshikawa. 2008. Accurate phase-added stereogram to improve the coherent stereogram. OSA Appl. Opt. 47, 19 (2008)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392414"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508366"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.402317"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.9.000639"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1364\/OL.41.002486"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218490"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073624"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392416"},{"key":"e_1_2_2_38_1","volume-title":"The depth-of-field of the human eye from objective and subjective measurements. Vision research 39, 12","author":"Marcos Susana","year":"1999","unstructured":"Susana Marcos , Esther Moreno , and Rafael Navarro . 1999. The depth-of-field of the human eye from objective and subjective measurements. Vision research 39, 12 ( 1999 ), 2039--2049. Susana Marcos, Esther Moreno, and Rafael Navarro. 1999. The depth-of-field of the human eye from objective and subjective measurements. Vision research 39, 12 (1999), 2039--2049."},{"key":"e_1_2_2_39_1","volume-title":"Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method. Applied optics 48, 34","author":"Matsushima Kyoji","year":"2009","unstructured":"Kyoji Matsushima and Sumio Nakahara . 2009. Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method. Applied optics 48, 34 ( 2009 ), H54--H63. Kyoji Matsushima and Sumio Nakahara. 2009. Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method. Applied optics 48, 34 (2009), H54--H63."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.22.006526"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356517"},{"key":"e_1_2_2_42_1","volume-title":"Jesper Gl\u00fcckstad, Ehud Y Isacoff, and Valentina Emiliani.","author":"Papagiakoumou Eirini","year":"2010","unstructured":"Eirini Papagiakoumou , Francesca Anselmi , Aur\u00e9lien B\u00e8gue , Vincent De Sars , Jesper Gl\u00fcckstad, Ehud Y Isacoff, and Valentina Emiliani. 2010 . Scanless two-photon excitation of channelrhodopsin-2. Nature methods 7, 10 (2010), 848--854. Eirini Papagiakoumou, Francesca Anselmi, Aur\u00e9lien B\u00e8gue, Vincent De Sars, Jesper Gl\u00fcckstad, Ehud Y Isacoff, and Valentina Emiliani. 2010. Scanless two-photon excitation of channelrhodopsin-2. Nature methods 7, 10 (2010), 848--854."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/15980316.2016.1255672"},{"key":"e_1_2_2_44_1","volume-title":"Speckle-free Holography with Partially Coherent Light Sources and Camera-in-the-loop Calibration. Science Advances","author":"Peng Yifan","year":"2021","unstructured":"Yifan Peng , Suyeon Choi , Jonghyun Kim , and Gordon Wetzstein . 2021. Speckle-free Holography with Partially Coherent Light Sources and Camera-in-the-loop Calibration. Science Advances ( 2021 ). Yifan Peng, Suyeon Choi, Jonghyun Kim, and Gordon Wetzstein. 2021. Speckle-free Holography with Partially Coherent Light Sources and Camera-in-the-loop Calibration. Science Advances (2021)."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417802"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130839"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130832"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-03152-0"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aao5496"},{"key":"e_1_2_2_51_1","volume-title":"Instance normalization: The missing ingredient for fast stylization. arXiv preprint arXiv:1607.08022","author":"Ulyanov Dmitry","year":"2016","unstructured":"Dmitry Ulyanov , Andrea Vedaldi , and Victor Lempitsky . 2016. Instance normalization: The missing ingredient for fast stylization. arXiv preprint arXiv:1607.08022 ( 2016 ). Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2016. Instance normalization: The missing ingredient for fast stylization. arXiv preprint arXiv:1607.08022 (2016)."},{"key":"e_1_2_2_52_1","volume-title":"Occlusion culling for computer generated hologram based on ray-wavefront conversion. Optics express 21, 19","author":"Wakunami Koki","year":"2013","unstructured":"Koki Wakunami , Hiroaki Yamashita , and Masahiro Yamaguchi . 2013. Occlusion culling for computer generated hologram based on ray-wavefront conversion. Optics express 21, 19 ( 2013 ), 21811--21822. Koki Wakunami, Hiroaki Yamashita, and Masahiro Yamaguchi. 2013. Occlusion culling for computer generated hologram based on ray-wavefront conversion. Optics express 21, 19 (2013), 21811--21822."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.23.032573"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/JDT.2010.2045734"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.23.032025"},{"key":"e_1_2_2_56_1","volume-title":"Computer-generated hologram with occlusion effect using layer-based processing. Applied optics 56, 13","author":"Zhang Hao","year":"2017","unstructured":"Hao Zhang , Liangcai Cao , and Guofan Jin . 2017. Computer-generated hologram with occlusion effect using layer-based processing. Applied optics 56, 13 ( 2017 ). Hao Zhang, Liangcai Cao, and Guofan Jin. 2017. Computer-generated hologram with occlusion effect using layer-based processing. Applied optics 56, 13 (2017)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.3599871"},{"key":"e_1_2_2_58_1","volume-title":"Proc. ICCP. 1--10","author":"Zhang Zhengyun","unstructured":"Zhengyun Zhang and M. Levoy . 2009. Wigner distributions and how they relate to the light field . In Proc. ICCP. 1--10 . Zhengyun Zhang and M. Levoy. 2009. Wigner distributions and how they relate to the light field. In Proc. ICCP. 1--10."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2007.01066.x"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480542","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480542","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480542","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:40Z","timestamp":1750191100000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480542"}},"subtitle":["learning accurate wave propagation models for 3D holographic virtual and augmented reality displays"],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":59,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3478513.3480542"],"URL":"https:\/\/doi.org\/10.1145\/3478513.3480542","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2021-12-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}