{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:42:06Z","timestamp":1776105726064,"version":"3.50.1"},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2020,3,30]],"date-time":"2020-03-30T00:00:00Z","timestamp":1585526400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Eye tracking technology is widely applied to detect user\u2019s attention in a 2D field, such as web page design, package design, and shooting games. However, because our surroundings primarily consist of 3D objects, applications will be expanded if there is an effective method to obtain and display user\u2019s 3D gaze fixation. In this research, a methodology is proposed to demonstrate the user\u2019s 3D gaze fixation on a digital model of a scene using only a pair of eye tracking glasses. The eye tracking glasses record user\u2019s gaze data and scene video. Thus, using image-based 3D reconstruction, a 3D model of the scene can be reconstructed from the frame images; simultaneously, the transformation matrix of each frame image can be evaluated to find 3D gaze fixation on the 3D model. In addition, a method that demonstrates multiple users\u2019 3D gaze fixation on the same digital model is presented to analyze gaze distinction between different subjects. With this preliminary development, this approach shows potential to be applied to a larger environment and conduct a more reliable investigation.<\/jats:p>","DOI":"10.1093\/jcde\/qwaa019","type":"journal-article","created":{"date-parts":[[2020,1,31]],"date-time":"2020-01-31T12:09:13Z","timestamp":1580472553000},"page":"228-237","source":"Crossref","is-referenced-by-count":11,"title":["Visualization of user\u2019s attention on objects in 3D environment using only eye tracking glasses"],"prefix":"10.1093","volume":"7","author":[{"given":"Ting-Hao","family":"Li","sequence":"first","affiliation":[{"name":"Department of Precision Engineering, The University of Tokyo, Tokyo 113-8656, Japan"}]},{"given":"Hiromasa","family":"Suzuki","sequence":"first","affiliation":[{"name":"Department of Precision Engineering, The University of Tokyo, Tokyo 113-8656, Japan"}]},{"given":"Yutaka","family":"Ohtake","sequence":"first","affiliation":[{"name":"Department of Precision Engineering, The University of Tokyo, Tokyo 113-8656, Japan"}]}],"member":"286","published-online":{"date-parts":[[2020,3,30]]},"reference":[{"key":"2020042510554772400_bib1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1531326.1531330","article-title":"PatchMatch: A randomized correspondence algorithm for structural image editing","volume":"28","author":"Barnes","year":"2009","journal-title":"ACM Transactions on Graphics"},{"key":"2020042510554772400_bib2","doi-asserted-by":"crossref","DOI":"10.1145\/2628257.2628274","article-title":"Gaze3D: Framework for gaze analysis on 3D reconstructed scenes","author":"Booth","year":"2014","journal-title":"Proceedings of the ACM Symposium on Applied Perception (SAP 2014)"},{"key":"2020042510554772400_bib3","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1167\/6.6.481","article-title":"Predictive eye movements in squash","volume":"6","author":"Chajka","year":"2006","journal-title":"Journal of Vision"},{"key":"2020042510554772400_bib4","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4471-3750-4","volume-title":"Eye tracking methodology: Theory and practice","author":"Duchowski","year":"2003"},{"key":"2020042510554772400_bib5","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1109\/83.661183","article-title":"Variational principles, surface evolution, PDE\u2019s, level set methods and the stereo problem","volume":"7","author":"Faugeras","year":"1998","journal-title":"IEEE Transactions on Image Processing"},{"key":"2020042510554772400_bib6","article-title":"FFmpeg","author":"FFmpeg Developers","year":"2018"},{"key":"2020042510554772400_bib7","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511811685","volume-title":"Multiple view geometry in computer vision","author":"Hartley","year":"2004"},{"key":"2020042510554772400_bib8","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1155\/2014\/798595","article-title":"Exploiting visibility information in surface reconstruction to preserve weakly supported surfaces","volume":"2014","author":"Jancosek","year":"2014","journal-title":"International Scholarly Research Notices"},{"key":"2020042510554772400_bib9","first-page":"66","article-title":"Wearable gaze trackers: Mapping visual attention in 3D","volume-title":"Proceedings of the 20th Scandinavian Conference on Image Analysis (SCIA 2017)","author":"Jensen","year":"2017"},{"key":"2020042510554772400_bib10","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1148\/radiol.2422051997","article-title":"Holistic component of image perception in mammogram interpretation: Gaze-tracking study","volume":"242","author":"Kundel","year":"2007","journal-title":"Radiology"},{"key":"2020042510554772400_bib11","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An accurate O(n) solution to the PnP problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"International Journal of Computer Vision"},{"key":"2020042510554772400_bib12","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"International Journal of Computer Vision"},{"key":"2020042510554772400_bib13","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1123\/jsep.29.4.457","article-title":"Perceptual-cognitive expertise in sport: A meta-analysis","volume":"29","author":"Mann","year":"2007","journal-title":"Journal of Sport and Exercise Psychology"},{"key":"2020042510554772400_bib14","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s10339-012-0499-z","article-title":"Gaze and eye-tracking solutions for psychological research","volume":"13","author":"Mele","year":"2012","journal-title":"Cognitive Processing"},{"key":"2020042510554772400_bib15","article-title":"OpenMVS","author":"OpenMVS Developers","year":"2018"},{"key":"2020042510554772400_bib16","first-page":"62","article-title":"FACTS: A computer vision system for 3D recovery and semantic mapping of human factors","volume-title":"Proceedings of the 9th International Conference on Computer Vision Systems (ICVS 2013)","author":"Paletta","year":"2013"},{"key":"2020042510554772400_bib17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1117\/12.880957","article-title":"Analyzing complex gaze behavior in the natural world","volume-title":"SPIE-IS&T Human Vision and Electronic Imaging XVI (Vol.","author":"Pelz","year":"2011"},{"key":"2020042510554772400_bib18","doi-asserted-by":"crossref","DOI":"10.1145\/2578153.2578183","article-title":"EyeSee3D: A low-cost approach for analyzing mobile 3D eye tracking data using computer vision and augmented reality technology","volume-title":"Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA)","author":"Pfeiffer","year":"2014"},{"key":"2020042510554772400_bib19","first-page":"(pp. 201","article-title":"3D gaze point localization and visualization using LiDAR-based 3D reconstructions","volume-title":"Proceedings of the 9th Biennial ACM Symposium on Eye Tracking Research and Application","author":"Pieszala","year":"2016"},{"key":"2020042510554772400_bib20","first-page":"36","article-title":"Exploring natural eye-gaze-based interaction for immersive virtual reality","volume-title":"Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI)","author":"Piumsomboon","year":"2017"},{"key":"2020042510554772400_bib21","article-title":"COLMAP","author":"Sch\u00f6nberger","year":"2018"},{"key":"2020042510554772400_bib22","volume-title":"Robust methods for accurate and efficient 3D modeling from unstructured imagery","author":"Sch\u00f6nberger","year":"2018"},{"key":"2020042510554772400_bib23","first-page":"4104","article-title":"Structure-from-motion revisited","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Sch\u00f6nberger","year":"2016"},{"key":"2020042510554772400_bib24","first-page":"321","article-title":"A vote-and-verify strategy for fast spatial verification in image retrieval","volume-title":"Proceedings of the 13th Asian Conference on Computer Vision (ACCV 2016)","author":"Sch\u00f6nberger","year":"2016"},{"key":"2020042510554772400_bib25","first-page":"5126","article-title":"From single image query to detailed 3D reconstruction","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Sch\u00f6nberger","year":"2015"},{"key":"2020042510554772400_bib26","first-page":"501","article-title":"Pixelwise view selection for unstructured multi-view stereo","volume-title":"Proceedings of the 14th European Conference on Computer Vision (ECCV 2016)","author":"Sch\u00f6nberger","year":"2016"},{"key":"2020042510554772400_bib27","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1109\/TVCG.2016.2598796","article-title":"GazeDx: Interactive visual analytics framework for comparative gaze analysis with volumetric medical images","volume":"23","author":"Song","year":"2017","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"2020042510554772400_bib28","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1109\/TVCG.2013.271","article-title":"GazeVis: Interactive 3D gaze visualization for contiguous cross-sectional medical images","volume":"20","author":"Song","year":"2014","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"2020042510554772400_bib29","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/j.jcde.2017.12.007","article-title":"A system for three-dimensional gaze fixation analysis using eye tracking glasses","volume":"5","author":"Takahashi","year":"2018","journal-title":"Journal of Computational Design and Engineering"},{"key":"2020042510554772400_bib30","article-title":"Tobii Pro Glasses 2","author":"Tobii Pro","year":"2018"},{"key":"2020042510554772400_bib31","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1016\/j.comcom.2011.11.002","article-title":"Wearable eye tracking for mental health monitoring","volume":"35","author":"Vidal","year":"2012","journal-title":"Computer Communications"},{"key":"2020042510554772400_bib32","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1109\/TPAMI.2011.172","article-title":"High accuracy and visibility-consistent dense multiview stereo","volume":"34","author":"Vu","year":"2012","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2020042510554772400_bib33","first-page":"836","article-title":"Let there be color! Large-scale texturing of 3D reconstructions","volume-title":"Proceedings of the 13th European Conference on Computer Vision (ECCV 2014)","author":"Waechter","year":"2014"},{"key":"2020042510554772400_bib34","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/507072.507078","article-title":"Fixation maps: Quantifying eye-movement traces","volume-title":"Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA \u201902)","author":"Wooding","year":"2002"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jcde\/article-pdf\/7\/2\/228\/33127531\/qwaa019.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jcde\/article-pdf\/7\/2\/228\/33127531\/qwaa019.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,25]],"date-time":"2021-02-25T03:51:11Z","timestamp":1614225071000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/7\/2\/228\/5813739"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,30]]},"references-count":34,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,3,30]]},"published-print":{"date-parts":[[2020,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwaa019","relation":{},"ISSN":["2288-5048"],"issn-type":[{"value":"2288-5048","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,4]]},"published":{"date-parts":[[2020,3,30]]}}}