{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T10:38:09Z","timestamp":1761129489384,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,9,26]],"date-time":"2017-09-26T00:00:00Z","timestamp":1506384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["Grant-in-Aid for Scientific Research (B) #15H02737","Challenging Exploratory Research #15K12084"],"award-info":[{"award-number":["Grant-in-Aid for Scientific Research (B) #15H02737","Challenging Exploratory Research #15K12084"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Augmented Reality (AR) superimposes computer graphics (CG) onto a user\u2019s view of the real world. A key quality problem in this field is to achieve coherence between reality and CG when the user\u2019s eyes refocus or change pupil size. We designed and evaluated a display that improves coherence by measuring the user\u2019s eye state and continuously adapting CG accordingly. Our tabletop prototype emulates an Optical See-Through Head-Mounted Display, a common AR display device. In our evaluation, participants observed three pillars at different depths. We then challenged them to identify a virtual pillar among the three while freely refocusing their eyes. Results show that our design significantly improved realism. Compared to Light Field Displays, our design aims to simplify display-optics while providing similar quality. We could only partially achieve this goal. We discuss the lessons we learned and how we plan to overcome the remaining challenges. The experimental protocol from our evaluation is useful for display developers as it can be used to measure the coherence of a display.<\/jats:p>","DOI":"10.3390\/mti1040022","type":"journal-article","created":{"date-parts":[[2017,9,26]],"date-time":"2017-09-26T16:14:45Z","timestamp":1506442485000},"page":"22","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["EyeAR: Refocusable Augmented Reality Content through Eye Measurements"],"prefix":"10.3390","volume":"1","author":[{"given":"Damien","family":"Rompapas","sequence":"first","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aitor","family":"Rovira","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Plopski","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Sandor","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takafumi","family":"Taketomi","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Goshiro","family":"Yamamoto","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3921-2871","authenticated-orcid":false,"given":"Hirokazu","family":"Kato","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sei","family":"Ikeda","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,9,26]]},"reference":[{"key":"ref_1","unstructured":"Sutherland, I.E. (1965, January 24\u201329). The Ultimate Display. Proceedings of the IFIP Congress, New York, NY, USA."},{"key":"ref_2","unstructured":"Wikipedia (2017, May 14). Holodeck\u2014Wikipedia, The Free Encyclopedia. Available online: http:\/\/en.wikipedia.org\/wiki\/Holodeck."},{"key":"ref_3","unstructured":"Sandor, C., Fuchs, M., Cassinelli, A., Li, H., Newcombe, R.A., Yamamoto, G., and Feiner, S.K. (2015). Breaking the Barriers to True Augmented Reality. arXiv."},{"key":"ref_4","unstructured":"Wikipedia (2017, May 14). Google Glass\u2014Wikipedia, The Free Encyclopedia. Available online: https:\/\/en.wikipedia.org\/wiki\/Google_Glass."},{"key":"ref_5","unstructured":"Wikipedia (2017, May 14). Windows Mixed Reality\u2014Wikipedia, The Free Encyclopedia. Available online: https:\/\/en.wikipedia.org\/wiki\/Windows_Mixed_Reality."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TVCG.2015.2473855","article-title":"Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays","volume":"22","author":"Kramida","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_7","unstructured":"Stredney, D., and Weghorst, S.J. (1998). The Virtual Retinal Display: A New Technology for Virtual Reality and Augmented Vision in Medicine, IOS Press and Ohmsha."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1162\/105474602317473213","article-title":"Single-Point Active Alignment Method (SPAAM) for Optical See-through HMD Calibration for Augmented Reality","volume":"11","author":"Tuceryan","year":"2002","journal-title":"Presence"},{"key":"ref_9","unstructured":"Teittinen, M. (2017, May 14). Depth Cues in the Human Visual System. Available online: http:\/\/www.hitl.washington.edu\/projects\/knowledge_base\/virtual-worlds\/EVE\/III.A.1.c.DepthCues.html."},{"key":"ref_10","unstructured":"Ware, C. (2012). Information Visualization: Perception for Design, Elsevier. [3rd ed.]."},{"key":"ref_11","unstructured":"K\u00e1n, P., and Kaufmann, H. (2012, January 13\u201318). Physically-Based Depth of Field in Augmented Reality. Proceedings of the Eurographics (Short Papers), Cagliari, Italy."},{"key":"ref_12","unstructured":"Shan, Q., Adams, R., Curless, B., Furukawa, Y., and Seitz, S.M. (July, January 29). The Visual Turing Test for Scene Reconstruction. Proceedings of the IEEE International Conference on 3D Vision-3DV, Seattle, WA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Borg, M., Johansen, S.S., Thomsen, D.L., and Kraus, M. (2012). Practical Implementation of a Graphics Turing Test. International Symposium on Advances in Visual Computing, Springer.","DOI":"10.1007\/978-3-642-33191-6_30"},{"key":"ref_14","unstructured":"Rompapas, D.C., Oshima, K., Moser, K.R., Swan, E.J., Ikeda, S., Yamamoto, G., Taketomi, T., Sandor, C., and Kato, H. (October, January 29). EyeAR: Physically-Based Depth of Field through Eye Measurements. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality Reality, Fukuoka, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rompapas, D.C., Rovira, A., Ikeda, S., Plopski, A., Taketomi, T., Sandor, C., and Kato, H. (2016, January 19\u201323). EyeAR: Refocusable Augmented Reality Content through Eye Measurements. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct) Reality, Merida, Mexico.","DOI":"10.1109\/ISMAR-Adjunct.2016.0108"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rovira, A., Rompapas, D.C., Sandor, C., Taketomi, T., Kato, H., and Ikeda, S. (2016, January 19\u201323). EyeAR: Empiric Evaluation of a Refocusable Augmented Reality System. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Merida, Mexico.","DOI":"10.1109\/ISMAR-Adjunct.2016.0027"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1109\/JPROC.2017.2648796","article-title":"Enabling Focus Cues in Head-Mounted Displays","volume":"105","author":"Hua","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"804","DOI":"10.1145\/1015706.1015804","article-title":"A Stereo Display Prototype with Multiple Focal Distances","volume":"23","author":"Akeley","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"60:1","DOI":"10.1145\/2766922","article-title":"The Light Field Stereoscope: Immersive Computer Graphics via Factored Near-eye Light Field Displays with Focus Cues","volume":"34","author":"Huang","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Narain, R., Albert, R.A., Bulbul, A., Ward, G.J., Banks, M.S., and O\u2019Brien, J.F. (2015). Optimal Presentation of Imagery with Focus Cues on Multi-plane Displays. ACM Trans. Graph., 34.","DOI":"10.1145\/2766909"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1167\/10.8.22","article-title":"Accommodation to Multiple-Focal-Plane Displays: Implications for Improving Stereoscopic Displays and for Accommodation Control","volume":"10","author":"MacKenzie","year":"2010","journal-title":"J. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1322","DOI":"10.1109\/TVCG.2017.2657058","article-title":"Wide Field of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors","volume":"23","author":"Dunn","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_23","unstructured":"Liu, S., Cheng, D., and Hua, H. (2008, January 15\u201318). An Optical See-Through Head Mounted Display with Addressable Focal Planes. Proceedings of the IEEE\/ACM International Symposium on Mixed and Augmented Reality, Cambridge, UK."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/S0141-9382(03)00016-7","article-title":"A Retinal Scanning Display System that Produces Multiple Focal Planes with a Deformable Membrane Mirror","volume":"24","author":"McQuaide","year":"2003","journal-title":"Displays"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2183","DOI":"10.1073\/pnas.1617251114","article-title":"Optimizing Virtual Reality for all Users through Gaze-Contingent and Adaptive Focus Displays","volume":"114","author":"Padmanaban","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hillaire, S., L\u00e9cuyer, A., Cozot, R., and Casiez, G. (2008, January 8\u201312). Using an Eye-Tracking System to Improve Camera Motions and Depth-of-Field Blur Effects in Virtual Environments. Proceedings of the IEEE Virtual Reality, Reno, NE, USA.","DOI":"10.1109\/VR.2008.4480749"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/MCG.2008.113","article-title":"Depth-of-Field Blur Effects for First-Person Navigation in Virtual Environments","volume":"28","author":"Hillaire","year":"2008","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_28","unstructured":"Mauderer, M., Conte, S., Nacenta, M.A., and Vishwanath, D. (May, January 26). Depth Perception with Gaze-contingent Depth of Field. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Vinnikov, M., and Allison, R.S. (2014, January 26\u201328). Gaze-contingent Depth of Field in Realistic Scenes: The User Experience. Proceedings of the ACM Symposium on Eye Tracking Research and Applications, Safety Harbor, FL, USA.","DOI":"10.1145\/2578153.2578170"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hua, H., and Liu, S. (2010). Depth-Fused Multi-Focal Plane Displays Enable Accurate Depth Perception. Proc. SPIE Opt. Des. Test. IV.","DOI":"10.1117\/12.871245"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lin, X., and Takefumi, O. (2013, January 1\u20134). Blur with Depth: A Depth Cue Method Based on Blur Effect in Augmented Reality. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality, Adelaide, Australia.","DOI":"10.1109\/ISMAR.2013.6671831"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1093\/mind\/LIX.236.433","article-title":"Computing Machinery and Intelligence","volume":"59","author":"Turing","year":"1950","journal-title":"Mind"},{"key":"ref_33","unstructured":"McGuigan, M. (2006). Graphics Turing Test. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1145\/7529.7920","article-title":"An Experimental Evaluation of Computer Graphics Imagery","volume":"5","author":"Meyer","year":"1986","journal-title":"ACM Trans. Graph."},{"key":"ref_35","unstructured":"Nvidia (2017, May 14). How We Created Demos that Blur the Line Between Real and Rendered. Available online: http:\/\/blogs.nvidia.com\/blog\/2015\/08\/11\/photorealistic\/."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1167\/6.10.5","article-title":"Crystalline Lens Radii of Curvature from Purkinje and Scheimpflug Imaging","volume":"6","author":"Rosales","year":"2006","journal-title":"J. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1016\/j.optlaseng.2011.12.001","article-title":"3D Gaze Tracking Method Using Purkinje Images on Eye Optical Model and Pupil","volume":"50","author":"Lee","year":"2012","journal-title":"Opt. Lasers Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Toyama, T., Orlosky, J., Sonntag, D., and Kiyokawa, K. (2014, January 27\u201329). A Natural Interface for Multi-focal Plane Head Mounted Displays using 3D Gaze. Proceedings of the International Working Conference on Advanced Visual Interfaces, Como, Italy.","DOI":"10.1145\/2598153.2598154"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Oshima, K., Moser, K.R., Rompapas, D.C., Swan, E.J., Ikeda, S., Yamamoto, G., Taketomi, T., Sandor, C., and Kato, H. (2016, January 19\u201323). Improved Clarity of Defocussed Content on Optical See-Through Head-Mounted Displays. Proceedings of the IEEE Symposium on 3D User Interfaces, Greenville, SC, USA.","DOI":"10.1109\/3DUI.2016.7460049"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1145\/964965.808590","article-title":"Distributed Ray Tracing","volume":"18","author":"Cook","year":"1984","journal-title":"Proc. ACM Siggraph Comput. Graph."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1016\/0042-6989(80)90063-2","article-title":"Depth of Focus, Eye Size and Visual Acuity","volume":"20","author":"Green","year":"1980","journal-title":"Vis. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1002\/jsid.156","article-title":"Simultaneous Measurement of Lens Accommodation and Convergence in Natural and Artificial 3D Vision","volume":"21","author":"Shiomi","year":"2013","journal-title":"J. Soc. Inf. Disp."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1145\/1778765.1778803","article-title":"Optix: A General Purpose Ray Tracing Engine","volume":"29","author":"Parker","year":"2010","journal-title":"ACM Trans. Graph."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1364\/AO.4.000767","article-title":"Directional Reflectance and Emissivity of an Opaque Surface","volume":"4","author":"Nicodemus","year":"1965","journal-title":"Appl. Opt."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal Data Analysis Using Generalized Linear Models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Agresti, A. (2011). Categorical Data Analysis, Springer.","DOI":"10.1007\/978-3-642-04898-2_161"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1097\/AAP.0b013e31823ebc74","article-title":"Beyond Repeated Measures ANOVA: Advanced Statistical Methods for the Analysis of Longitudinal Data in Anesthesia Research","volume":"37","author":"Ma","year":"2012","journal-title":"Reg. Anesth. Pain Med."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1111\/j.0006-341X.2001.00120.x","article-title":"Akaike\u2019s Information Criterion in Generalized Estimating Equations","volume":"57","author":"Pan","year":"2001","journal-title":"Biometrics"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1002\/sim.3489","article-title":"Working-Correlation-Structure Identification in Generalized Estimating Equations","volume":"28","author":"Hin","year":"2009","journal-title":"Stat. Med."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1002\/sim.2023","article-title":"A Comparison of Goodness of Fit Tests for the Logistic GEE Model","volume":"24","author":"Evans","year":"2005","journal-title":"Stat. Med."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1080\/00140139.2010.489968","article-title":"Effects of Age on Dynamic Accommodation","volume":"53","author":"Lockhart","year":"2010","journal-title":"Ergonomics"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1805964.1805966","article-title":"Coded aperture projection","volume":"29","author":"Grosse","year":"2010","journal-title":"ACM Trans. Graph."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/TVCG.2015.2391861","article-title":"Extended Depth-of-Field Projector by Fast Focal Sweep Projection","volume":"21","author":"Iwai","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/1\/4\/22\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:45:58Z","timestamp":1760208358000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/1\/4\/22"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,26]]},"references-count":53,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["mti1040022"],"URL":"https:\/\/doi.org\/10.3390\/mti1040022","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2017,9,26]]}}}