{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T16:27:57Z","timestamp":1779294477657,"version":"3.51.4"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T00:00:00Z","timestamp":1511136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>As head-mounted displays (HMDs) commonly present a single, fixed-focus display plane, a conflict can be created between the vergence and accommodation responses of the viewer. Multifocal HMDs have long been investigated as a potential solution in which multiple image planes span the viewer's accommodation range. Such displays require a scene decomposition algorithm to distribute the depiction of objects across image planes, and previous work has shown that simple decompositions can be achieved in real-time. However, recent optimal decompositions further improve image quality, particularly with complex content. Such decompositions are more computationally involved and likely require better alignment of the image planes with the viewer's eyes, which are potential barriers to practical applications.<\/jats:p>\n          <jats:p>Our goal is to enable interactive optimal decomposition algorithms capable of driving a vergence- and accommodation-tracked multifocal testbed. Ultimately, such a testbed is necessary to establish the requirements for the practical use of multifocal displays, in terms of computational demand and hardware accuracy. To this end, we present an efficient algorithm for optimal decompositions, incorporating insights from vision science. Our method is amenable to GPU implementations and achieves a three-orders-of-magnitude speedup over previous work. We further show that eye tracking can be used for adequate plane alignment with efficient image-based deformations, adjusting for both eye rotation and head movement relative to the display. We also build the first binocular multifocal testbed with integrated eye tracking and accommodation measurement, paving the way to establish practical eye tracking and rendering requirements for this promising class of display. Finally, we report preliminary results from a pilot user study utilizing our testbed, investigating the accommodation response of users to dynamic stimuli presented under optimal decomposition.<\/jats:p>","DOI":"10.1145\/3130800.3130846","type":"journal-article","created":{"date-parts":[[2017,11,22]],"date-time":"2017-11-22T16:25:08Z","timestamp":1511367908000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["Fast gaze-contingent optimal decompositions for multifocal displays"],"prefix":"10.1145","volume":"36","author":[{"given":"Olivier","family":"Mercier","sequence":"first","affiliation":[{"name":"Universit\u00e9 de Montr\u00e9al and Oculus Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yusufu","family":"Sulai","sequence":"additional","affiliation":[{"name":"Oculus Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin","family":"Mackenzie","sequence":"additional","affiliation":[{"name":"Oculus Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marina","family":"Zannoli","sequence":"additional","affiliation":[{"name":"Oculus Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Hillis","sequence":"additional","affiliation":[{"name":"Oculus Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Derek","family":"Nowrouzezahrai","sequence":"additional","affiliation":[{"name":"McGill University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Douglas","family":"Lanman","sequence":"additional","affiliation":[{"name":"Oculus Research"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,11,20]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Kurt Akeley. 2004. Achieving near-correct focus cues using multiple image planes. Ph.D. Dissertation. Stanford University.   Kurt Akeley. 2004. Achieving near-correct focus cues using multiple image planes. Ph.D. Dissertation. Stanford University."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015804"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.48.000193"},{"key":"e_1_2_2_4_1","unstructured":"Barry Blundell and Adam Schwartz. 1999. Volumetric Three-Dimensional Display Systems. Wiley-IEEE Press.   Barry Blundell and Adam Schwartz. 1999. Volumetric Three-Dimensional Display Systems. Wiley-IEEE Press."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/col.5080140107"},{"key":"e_1_2_2_6_1","volume-title":"9th International Edition. Brooks\/Cole, Cencag Learning","author":"Burden Richard L.","year":"2011"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1108491108"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2657058"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2011.05.011"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.30"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Robert T. Held Emily A. Cooper and Martin S. Banks. 2012. Blur and Disparity Are Complementary Cues to Depth. Current Biology 22 (2012). Issue 5.  Robert T. Held Emily A. Cooper and Martin S. Banks. 2012. Blur and Disparity Are Complementary Cues to Depth. Current Biology 22 (2012). Issue 5.","DOI":"10.1016\/j.cub.2012.01.033"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1731047.1731057"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1167\/8.3.33"},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Xinda Hu and Hong Hua. 2014. High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics. Optics Express 22 11 (2014).  Xinda Hu and Hong Hua. 2014. High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics. Optics Express 22 11 (2014).","DOI":"10.1364\/OE.22.013896"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Hong Hua and Bahram Javidi. 2014. A 3D integral imaging optical see-through head-mounted display. Optics Express 22 11 (2014).  Hong Hua and Bahram Javidi. 2014. A 3D integral imaging optical see-through head-mounted display. Optics Express 22 11 (2014).","DOI":"10.1364\/OE.22.013484"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766922"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Paul V. Johnson Jared A.Q. Parnell Joohwan Kim Christopher D. Saunter Gordon D. Love and Martin S. Banks. 2016. Dynamic lens and monovision 3D displays to improve viewer comfort. Optics Express 24 11 (2016).  Paul V. Johnson Jared A.Q. Parnell Joohwan Kim Christopher D. Saunter Gordon D. Love and Martin S. Banks. 2016. Dynamic lens and monovision 3D displays to improve viewer comfort. Optics Express 24 11 (2016).","DOI":"10.1364\/OE.24.011808"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925866"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858140"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073594"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00356857"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073622"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2473855"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508366"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.11.001949"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Sheng Liu and Hong Hua. 2010. A systematic method for designing depth-fused multi-focal plane three-dimensional displays. Optics express 18 11 (2010) 11562--11573.  Sheng Liu and Hong Hua. 2010. A systematic method for designing depth-fused multi-focal plane three-dimensional displays. Optics express 18 11 (2010) 11562--11573.","DOI":"10.1364\/OE.18.011562"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.95"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Patrick Llull Noah Bedard Wanmin Wu Ivana To\u0161i\u0107 Kathrin Berkner and Nikhil Balram. 2015. Design and optimization of a near-eye multifocal display system for augmented reality In Imaging and Applied Optics. Imaging and Applied Optics.  Patrick Llull Noah Bedard Wanmin Wu Ivana To\u0161i\u0107 Kathrin Berkner and Nikhil Balram. 2015. Design and optimization of a near-eye multifocal display system for augmented reality In Imaging and Applied Optics. Imaging and Applied Optics.","DOI":"10.1364\/AOMS.2015.JTh3A.5"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Gordon D. Love David M. Hoffman Philip J.W. Hands James Gao Andrew K. Kirby and Martin S. Banks. 2009. High-speed switchable lens enables the development of a volumetric stereoscopic display. Optics Express 17 18 (2009).  Gordon D. Love David M. Hoffman Philip J.W. Hands James Gao Andrew K. Kirby and Martin S. Banks. 2009. High-speed switchable lens enables the development of a volumetric stereoscopic display. Optics Express 17 18 (2009).","DOI":"10.1364\/OE.17.015716"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.JEI.21.1.011002"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1167\/10.8.22"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964935"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073590"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1167\/14.12.25"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766909"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(80)90158-3"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1617251114"},{"key":"e_1_2_2_38_1","unstructured":"Victor Podlozhnyuk. 2007. Image convolution with CUDA. NVIDIA Corporation white paper June 2097 3 (2007).  Victor Podlozhnyuk. 2007. Image convolution with CUDA. NVIDIA Corporation white paper June 2097 3 (2007)."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/965161.806818"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Sowmya Ravikumar Kurt Akeley and Martin S. Banks. 2011. Creating effective focus cues in multi-plane 3D displays. Optics Express 19 21 (2011).  Sowmya Ravikumar Kurt Akeley and Martin S. Banks. 2011. Creating effective focus cues in multi-plane 3D displays. Optics Express 19 21 (2011).","DOI":"10.1364\/OE.19.020940"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.39.003209"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1167\/11.8.11"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.3788\/COL201412.060010"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806265"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2010.2098351"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Dhanraj Vishwanath and Erik Blaser. 2010. Retinal blur and the perception of egocentric distance. Journal of Vision 10 (2010).  Dhanraj Vishwanath and Erik Blaser. 2010. Retinal blur and the perception of egocentric distance. Journal of Vision 10 (2010).","DOI":"10.1167\/10.10.26"},{"key":"e_1_2_2_47_1","volume-title":"Virtual Reality Annual International Symposium. 172--178","author":"Benjamin"},{"key":"e_1_2_2_48_1","volume-title":"SPIE Stereoscopic Displays And Applications","volume":"8288","author":"Watt Simon J.","year":"2005"},{"key":"e_1_2_2_49_1","volume-title":"IEEE Multimedia and Expo. Marina Zannoli, Gordon D. Love, Rahul Narain, and Martin S. Banks. 2016","author":"Wu W.","year":"2016"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130846","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130846","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:18Z","timestamp":1750212678000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130846"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,20]]},"references-count":49,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3130800.3130846"],"URL":"https:\/\/doi.org\/10.1145\/3130800.3130846","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,20]]},"assertion":[{"value":"2017-11-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}