{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T15:16:52Z","timestamp":1767626212734,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,6]],"date-time":"2018-08-06T00:00:00Z","timestamp":1533513600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Today, museum visits are perceived as an opportunity for individuals to explore and make up their own minds. The increasing technical capabilities of Augmented Reality (AR) technology have raised audience expectations, advancing the use of mobile AR in cultural heritage (CH) settings. Hence, there is the need to define a criteria, based on users\u2019 preference, able to drive developers and insiders toward a more conscious development of AR-based applications. Starting from previous research (performed to define a protocol for understanding the visual behaviour of subjects looking at paintings), this paper introduces a truly predictive model of the museum visitor\u2019s visual behaviour, measured by an eye tracker. A Hidden Markov Model (HMM) approach is presented, able to predict users\u2019 attention in front of a painting. Furthermore, this research compares users\u2019 behaviour between adults and children, expanding the results to different kind of users, thus providing a reliable approach to eye trajectories. Tests have been conducted defining areas of interest (AOI) and observing the most visited ones, attempting the prediction of subsequent transitions between AOIs. The results demonstrate the effectiveness and suitability of our approach, with performance evaluation values that exceed 90%.<\/jats:p>","DOI":"10.3390\/jimaging4080101","type":"journal-article","created":{"date-parts":[[2018,8,7]],"date-time":"2018-08-07T03:44:18Z","timestamp":1533613458000},"page":"101","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["User-Centered Predictive Model for Improving Cultural Heritage Augmented Reality Applications: An HMM-Based Approach for Eye-Tracking Data"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9160-834X","authenticated-orcid":false,"given":"Roberto","family":"Pierdicca","sequence":"first","affiliation":[{"name":"Dipartimento di Ingegneria Civile, Edile e dell\u2019Architettura, Universit\u00e1 Politecnica delle Marche, 60131 Ancona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5523-7174","authenticated-orcid":false,"given":"Marina","family":"Paolanti","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e1 Politecnica delle Marche, 60131 Ancona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0778-2386","authenticated-orcid":false,"given":"Simona","family":"Naspetti","sequence":"additional","affiliation":[{"name":"Department of Materials, Environmental Sciences and Urban Planning, Universit\u00e1 Politecnica delle Marche, 60131 Ancona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5565-6902","authenticated-orcid":false,"given":"Serena","family":"Mandolesi","sequence":"additional","affiliation":[{"name":"Department of Materials, Environmental Sciences and Urban Planning, Universit\u00e1 Politecnica delle Marche, 60131 Ancona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7108-397X","authenticated-orcid":false,"given":"Raffaele","family":"Zanoli","sequence":"additional","affiliation":[{"name":"Department of Agricultural, Food and Environmental Sciences, Universit\u00e1 Politecnica delle Marche, 60131 Ancona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emanuele","family":"Frontoni","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e1 Politecnica delle Marche, 60131 Ancona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Cameron, F., and Kenderdine, S. (2007). Theorizing Digital Cultural Heritage: A Critical Discourse, MIT Press.","DOI":"10.7551\/mitpress\/9780262033534.001.0001"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1109\/JIOT.2015.2506258","article-title":"An indoor location-Aware system for an IoT-based smart museum","volume":"3","author":"Alletto","year":"2016","journal-title":"IEEE Int. Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.chb.2015.12.035","article-title":"Use of digital guides in museum galleries: Determinants of information selection","volume":"57","author":"Merkt","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Pescarin, S., Pagano, A., Wallerg\u00e5rd, M., Hupperetz, W., and Ray, C. (2012, January 2\u20135). Archeovirtual 2011: An evaluation approach to virtual museums. Proceedings of the 2012 18th International Conference on Virtual Systems and Multimedia (VSMM), Milan, Italy.","DOI":"10.1109\/VSMM.2012.6365903"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1155\/2014\/597476","article-title":"Augmented reality experience: From high-resolution acquisition to real time augmented contents","volume":"2014","author":"Clini","year":"2014","journal-title":"Adv. Multimed."},{"key":"ref_6","unstructured":"Pierdicca, R., Frontoni, E., Zingaretti, P., Malinverni, E.S., Colosi, F., and Orazi, R. (September, January 31). Making visible the invisible. augmented reality visualization for 3D reconstructions of archaeological sites. Proceedings of the International Conference on Augmented and Virtual Reality, Lecce, Italy."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Naspetti, S., Pierdicca, R., Mandolesi, S., Paolanti, M., Frontoni, E., and Zanoli, R. (2016, January 15\u201318). Automatic analysis of eye-tracking data for augmented reality applications: A prospective outlook. Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Otranto, Italy.","DOI":"10.1007\/978-3-319-40651-0_17"},{"key":"ref_8","unstructured":"Sturari, M., Clini, P., and Quattrini, R. (September, January 31). Advanced Interaction with Paintings by Augmented Reality and High Resolution Visualization: A Real Case Exhibition. Proceedings of the Second International Conference Augmented and Virtual Reality (AVR 2015), Lecce, Italy."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"211","DOI":"10.4018\/978-1-59140-562-7.ch034","article-title":"Eye tracking in HCI and usability research","volume":"1","author":"Poole","year":"2006","journal-title":"Encycl. Hum. Comput. Interact."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1287\/mnsc.1120.1625","article-title":"Information acquisition during online decision making: A model-based exploration using eye-tracking data","volume":"59","author":"Shi","year":"2013","journal-title":"Manag. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Qu, Q.X., Zhang, L., Chao, W.Y., and Duffy, V. (2017). User Experience Design Based on Eye-Tracking Technology: A Case Study on Smartphone APPs. Advances in Applied Digital Human Modeling and Simulation, Springer.","DOI":"10.1007\/978-3-319-41627-4_27"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wedel, M., and Pieters, R. (2008). A review of eye-tracking research in marketing. Review of Marketing Research, Emerald Group Publishing Limited.","DOI":"10.1108\/S1548-6435(2008)0000004009"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1007\/s10648-011-9174-7","article-title":"Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains","volume":"23","author":"Gegenfurtner","year":"2011","journal-title":"Educ. Psychol. Rev."},{"key":"ref_14","unstructured":"Holmqvist, K., Nystr\u00f6m, M., Andersson, R., Dewhurst, R., Jarodzka, H., and Van de Weijer, J. (2011). Eye Tracking: A Comprehensive Guide to Methods and Measures, OUP Oxford."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1109\/34.877520","article-title":"Algorithms for defining visual regions-of-interest: Comparison with eye fixations","volume":"22","author":"Privitera","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Duchowski, A.T., Driver, J., Jolaoso, S., Tan, W., Ramey, B.N., and Robbins, A. (2010, January 22\u201324). Scanpath comparison revisited. Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, Austin, TX, USA.","DOI":"10.1145\/1743666.1743719"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2889","DOI":"10.1109\/TVCG.2012.276","article-title":"Visual analytics methodology for eye movement studies","volume":"18","author":"Andrienko","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"362","DOI":"10.3758\/s13428-017-0876-8","article-title":"Scanpath modeling and classification with hidden Markov models","volume":"50","author":"Coutrot","year":"2018","journal-title":"Behav. Res. Methods"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1167\/14.11.8","article-title":"Understanding eye movements in face recognition using hidden Markov models","volume":"14","author":"Chuk","year":"2014","journal-title":"J. Vis."},{"key":"ref_20","unstructured":"Toker, D., Conati, C., Steichen, B., and Carenini, G. (May, January 27). Individual user characteristics and information visualization: Connecting the dots through eye tracking. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1503","DOI":"10.1016\/j.visres.2010.05.002","article-title":"Statistical regularities in art: Relations with visual coding and perception","volume":"50","author":"Graham","year":"2010","journal-title":"Vis. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"98","DOI":"10.3389\/fnhum.2011.00098","article-title":"How do we see art: An eye-tracker study","volume":"5","author":"Quiroga","year":"2011","journal-title":"Front. Hum. Neurosci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Massaro, D., Savazzi, F., Di Dio, C., Freedberg, D., Gallese, V., Gilli, G., and Marchetti, A. (2012). When art moves the eyes: A behavioral and eye-tracking study. PloS ONE, 7.","DOI":"10.1371\/journal.pone.0037285"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Walker, F., Bucker, B., Anderson, N.C., Schreij, D., and Theeuwes, J. (2017). Looking at paintings in the Vincent Van Gogh Museum: Eye movement patterns of children and adults. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0178912"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ylitalo, A.K., S\u00e4rkk\u00e4, A., and Guttorp, P. (ArXiv, 2016). What we look at in paintings: A comparison between experienced and inexperienced art viewers, ArXiv.","DOI":"10.1214\/16-AOAS921"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yasser, A., Clawson, K., Bowerman, C., and L\u00e9v\u00eaque, M. (2017, January 3\u20136). Saving Cultural Heritage with Digital Make-Believe: Machine Learning and Digital Techniques to the Rescue. Proceedings of the 31st British Computer Society Human Computer Interaction Conference, Sunderland, UK.","DOI":"10.14236\/ewic\/HCI2017.97"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1007\/s11042-010-0561-8","article-title":"Automatic segmentation of digitalized historical manuscripts","volume":"55","author":"Grana","year":"2011","journal-title":"Multimed. Tools Appl."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bar, Y., Levy, N., and Wolf, L. (2014, January 6\u201312). Classification of Artistic Styles Using Binarized Features Derived from a Deep Neural Network. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-16178-5_5"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Findlay, J.M., and Gilchrist, I.D. (2003). Active Vision: The Psychology of Looking and Seeing, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780198524793.001.0001"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MASSP.1986.1165342","article-title":"An introduction to hidden Markov models","volume":"3","author":"Rabiner","year":"1986","journal-title":"IEEE Assp Mag."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/s10846-013-9983-7","article-title":"A dynamic gesture and posture recognition system","volume":"76","author":"Sgouropoulos","year":"2014","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1023\/B:JINT.0000015401.49928.a4","article-title":"Symbolic place recognition in voronoi-based maps by using hidden markov models","volume":"39","author":"Boada","year":"2004","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_33","unstructured":"Tissenbaum, M., Berland, M., and Kumar, V. (July, January 29). Modeling Visitor Behavior in a Game-Based Engineering Museum Exhibit with Hidden Markov Models. Proceedings of the 9th International Conference on Educational Data Mining (EDM), Raleigh, NC, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1109\/TIP.2003.821349","article-title":"Studying digital imagery of ancient paintings by mixtures of stochastic models","volume":"13","author":"Li","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1068\/i0382","article-title":"Yarbus, eye movements, and vision","volume":"1","author":"Tatler","year":"2010","journal-title":"i-Perception"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.visres.2014.08.014","article-title":"An inverse Yarbus process: Predicting observers\u2019 task from eye movement patterns","volume":"103","author":"Clark","year":"2014","journal-title":"Vis. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/5.18626","article-title":"A tutorial on hidden Markov models and selected applications in speech recognition","volume":"77","author":"Rabiner","year":"1989","journal-title":"Proc. IEEE"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1109\/PROC.1973.9030","article-title":"The viterbi algorithm","volume":"61","author":"Forney","year":"1973","journal-title":"Proc. IEEE"},{"key":"ref_39","first-page":"1","article-title":"An equality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes","volume":"3","author":"Baum","year":"1972","journal-title":"Inequalities"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Sokolova, M., Japkowicz, N., and Szpakowicz, S. (2006, January 4\u20138). Beyond accuracy, F-score and ROC: A family of discriminant measures for performance evaluation. Proceedings of the Australian Conference on Artificial Intelligence, Hobart, Australia.","DOI":"10.1007\/11941439_114"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1023\/A:1017181826899","article-title":"Glossary of terms","volume":"30","author":"Kohavi","year":"1998","journal-title":"Mach. Learn."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/4\/8\/101\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:16:56Z","timestamp":1760195816000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/4\/8\/101"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,6]]},"references-count":41,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["jimaging4080101"],"URL":"https:\/\/doi.org\/10.3390\/jimaging4080101","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2018,8,6]]}}}