{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T10:15:23Z","timestamp":1770286523075,"version":"3.49.0"},"reference-count":64,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T00:00:00Z","timestamp":1675296000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100013360","name":"Invest Northern Ireland","doi-asserted-by":"publisher","award":["71050R"],"award-info":[{"award-number":["71050R"]}],"id":[{"id":"10.13039\/100013360","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Human-Computer Interaction (HCI) research has extensively employed eye-tracking technologies in a variety of fields. Meanwhile, the ongoing development of Internet Protocol TV (IPTV) has significantly enriched the TV customer experience, which is of great interest to researchers across academia and industry. A previous study was carried out at the BT Ireland Innovation Centre (BTIIC), where an eye tracker was employed to record user interactions with a Video-on-Demand (VoD) application, the BT Player. This paper is a complementary and subsequent study of the analysis of eye-tracking data in our previously published introductory paper. Here, we propose a method for integrating layout information from the BT Player with mining the process of customer eye movement on the screen, thereby generating HCI and Industry-relevant insights regarding user experience. We incorporate a popular Machine Learning model, a discrete-time Markov Chain (DTMC), into our methodology, as the eye tracker records each gaze movement at a particular frequency, which is a good example of discrete-time sequences. The Markov Model is found suitable for our study, and it helps to reveal characteristics of the gaze movement as well as the user interface (UI) design on the VoD application by interpreting transition matrices, first passage time, proposed \u2018most likely trajectory\u2019 and other Markov properties of the model. Additionally, the study has revealed numerous promising areas for future research. And the code involved in this study is open access on GitHub.<\/jats:p>","DOI":"10.3390\/a16020082","type":"journal-article","created":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T03:36:57Z","timestamp":1675395417000},"page":"82","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Process Mining IPTV Customer Eye Gaze Movement Using Discrete-Time Markov Chains"],"prefix":"10.3390","volume":"16","author":[{"given":"Zhi","family":"Chen","sequence":"first","affiliation":[{"name":"School of Computing, Ulster University, Jordanstown BT37 0QB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4821-6404","authenticated-orcid":false,"given":"Shuai","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Jordanstown BT37 0QB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6871-3504","authenticated-orcid":false,"given":"Sally","family":"McClean","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Jordanstown BT37 0QB, UK"}]},{"given":"Fionnuala","family":"Hart","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Jordanstown BT37 0QB, UK"}]},{"given":"Michael","family":"Milliken","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Jordanstown BT37 0QB, UK"}]},{"given":"Brahim","family":"Allan","sequence":"additional","affiliation":[{"name":"BT Applied Research, British Telecom, Ipswich IP5 3RE, UK"}]},{"given":"Ian","family":"Kegel","sequence":"additional","affiliation":[{"name":"BT Applied Research, British Telecom, Ipswich IP5 3RE, UK"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s11235-016-0157-3","article-title":"Survey of Catch-up TV and Other Time-Shift Services: A Comprehensive Analysis and Taxonomy of Linear and Nonlinear Television","volume":"64","author":"Abreu","year":"2017","journal-title":"Telecommun. Syst."},{"key":"ref_2","first-page":"136","article-title":"Application of IP network and IPTV","volume":"6","author":"Mai","year":"2016","journal-title":"Electron. World"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1561\/1100000008","article-title":"The Evolution of TV Systems, Content, and Users toward Interactivity","volume":"2","author":"Cesar","year":"2007","journal-title":"Found. Trends\u00ae Hum.\u2013Comput. Interact."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.csi.2018.02.006","article-title":"Incorporating Data Analytics into Design Science to Predict User Intentions to Adopt Smart TV with Consideration of Product Features","volume":"59","author":"Wang","year":"2018","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1515\/auseb-2015-0004","article-title":"Predicting Customer Churn and Retention Rates in Nigeria\u2019s Mobile Telecommunication Industry Using Markov Chain Modelling","volume":"3","author":"Adebiyi","year":"2015","journal-title":"Acta Univ. Sapientiae Econ. Bus."},{"key":"ref_6","unstructured":"Kim, Y., Park, J.K., Choi, H.J., Lee, S., Park, H., Kim, J., Lee, Z., and Ko, K. (April, January 31). Reducing IPTV Channel Zapping Time Based on Viewer\u2019s Surfing Behavior and Preference. Proceedings of the 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, Las Vegas, NV, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Tsai, W.-C., Ko, C.-L., and Liu, C.-S. (2017, January 19\u201322). A Lightweight Personalized Image Preloading Method for IPTV System. Proceedings of the 2017 19th International Conference on Advanced Communication Technology (ICACT), Pyeongchang, Republic of Korea.","DOI":"10.23919\/ICACT.2017.7890095"},{"key":"ref_8","unstructured":"9Schnabel, T., Bennett, P.N., and Joachims, T. (2018). Improving Recommender Systems Beyond the Algorithm. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1007\/978-3-319-20895-4_29","article-title":"UX and Usability on Smart TV: A Case Study on a T-Commerce Application","volume":"Volume 9191","author":"Tan","year":"2015","journal-title":"HCI in Business"},{"key":"ref_10","unstructured":"Chennamma, H.R., and Yuan, X. (2013). A Survey on Eye-Gaze Tracking Techniques. arXiv."},{"key":"ref_11","unstructured":"Zhang, S., McClean, S., Garifullina, A., Kegel, I., Lightbody, G., Milliken, M., Ennis, A., and Scotney, B. (2018). British HCI Conference 2018, British Computer Society."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.csi.2018.02.004","article-title":"Evaluating Multimedia Learning Materials in Primary Education Using Eye Tracking","volume":"59","author":"Molina","year":"2018","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Faulkner, X., Finlay, J., and D\u00e9tienne, F. (2002). People and Computers XVI\u2014Memorable Yet Invisible, Springer.","DOI":"10.1007\/978-1-4471-0105-5"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Menges, R., Tamimi, H., Kumar, C., Walber, T., Schaefer, C., and Staab, S. (2018, January 14\u201317). Enhanced Representation of Web Pages for Usability Analysis with Eye Tracking. Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications, Warsaw, Poland.","DOI":"10.1145\/3204493.3214308"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1080\/10447318.2018.1543089","article-title":"Differences between EFL Beginners and Intermediate Level Readers When Reading Onscreen Narrative Text with Pictures: A Study of Eye Movements as a Guide to Personalization","volume":"35","author":"Lin","year":"2019","journal-title":"Int. J. Hum.\u2013Comput. Interact."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, Z., Zhang, S., Mcclean, S., Lightbody, G., Milliken, M., Kegel, I., and Garifullina, A. (2019, January 19\u201323). Using Eye Tracking to Gain Insight into TV Customer Experience by Markov Modelling. Proceedings of the 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI), Leicester, UK.","DOI":"10.1109\/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00184"},{"key":"ref_17","unstructured":"Spedicato, G. (2022, April 26). \u201cDiscrete Time Markov Chains with R.\u201d The R Journal. R Package Version 0.6.9.7. Available online: https:\/\/journal.r-project.org\/archive\/2017\/RJ-2017-036\/index.html."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1037\/0033-295X.87.4.329","article-title":"A Theory of Reading: From Eye Fixations to Comprehension","volume":"87","author":"Just","year":"1980","journal-title":"Psychol. Rev."},{"key":"ref_19","unstructured":"Shaw, R., Crisman, E., Loomis, A., and Laszewski, Z. (1990, January 3\u20136). The Eye Wink Control Interface: Using the Computer to Provide the Severely Disabled with Increased Flexibility and Comfort. Proceedings of the Third Annual IEEE Symposium on Computer-Based Medical Systems, Chapel Hill, NC, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Costescu, C., Rosan, A., Brigitta, N., Hathazi, A., Kovari, A., Katona, J., Demeter, R., Heldal, I., Helgesen, C., and Thill, S. (2019, January 23\u201325). Assessing Visual Attention in Children Using GP3 Eye Tracker. Proceedings of the 2019 10th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Naples, Italy.","DOI":"10.1109\/CogInfoCom47531.2019.9089995"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"57","DOI":"10.12700\/APH.17.2.2020.2.4","article-title":"Evaluation of Eye-Movement Metrics Ina Software DebbugingTask Using GP3 Eye Tracker","volume":"17","author":"Kovari","year":"2020","journal-title":"Acta Polytech. Hung."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sulikowski, P., and Zdziebko, T. (2020). Deep Learning-Enhanced Framework for Performance Evaluation of a Recommending Interface with Varied Recommendation Position and Intensity Based on Eye-Tracking Equipment Data Processing. Electronics, 9.","DOI":"10.3390\/electronics9020266"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"517","DOI":"10.21273\/HORTTECH.23.4.517","article-title":"Practical Field Use of Eye-Tracking Devices for Consumer Research in the Retail Environment","volume":"23","author":"Behe","year":"2013","journal-title":"HortTechnology"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rihn, A., Khachatryan, H., and Wei, X. (2018). Assessing Purchase Patterns of Price Conscious Consumers. Horticulturae, 4.","DOI":"10.3390\/horticulturae4030013"},{"key":"ref_25","first-page":"107","article-title":"Using Innovative Biometric Measurements in Consumer Decision Making Research","volume":"1","author":"Khachatryan","year":"2015","journal-title":"Sci. Bus. (S2B) Res. Innov."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1016\/j.foodpol.2012.03.004","article-title":"Eye Tracking and Nutrition Label Use: A Review of the Literature and Recommendations for Label Enhancement","volume":"37","author":"Graham","year":"2012","journal-title":"Food Policy"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"119","DOI":"10.2753\/JEC1086-4415170105","article-title":"Attention to Banner Ads and Their Effectiveness: An Eye-Tracking Approach","volume":"17","author":"Joowon","year":"2012","journal-title":"Int. J. Electron. Commer."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1080\/00913367.1997.10673518","article-title":"Consumer Eye Movement Patterns on Yellow Pages Advertising","volume":"26","author":"Lohse","year":"1997","journal-title":"J. Advert."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1257\/aer.101.2.900","article-title":"Search Dynamics in Consumer Choice under Time Pressure: An Eye-Tracking Study","volume":"101","author":"Reutskaja","year":"2011","journal-title":"Am. Econ. Rev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1007\/BF00227286","article-title":"Fitts\u2019 Law in Two-Dimensional Task Space","volume":"100","author":"Mottet","year":"1994","journal-title":"Exp. Brain Res."},{"key":"ref_31","unstructured":"(2022, April 25). Fitts\u2019s Law: The Importance of Size and Distance in UI Design, Interaction Design Foundation. Available online: https:\/\/www.interaction-design.org\/literature\/article\/tts-s-law-the-importance-of-size-and-distance-in-ui-design."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/0953-5438(92)90019-C","article-title":"How Should Fitts\u2019 Law Be Applied to Human-Computer Interaction?","volume":"4","author":"Gillan","year":"1992","journal-title":"Interact. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1167\/2.4.5","article-title":"Ecological Statistics of Gestalt Laws for the Perceptual Organization of Contours","volume":"2","author":"Elder","year":"2002","journal-title":"J. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1172","DOI":"10.1037\/a0029333","article-title":"A Century of Gestalt Psychology in Visual Perception: I. Perceptual Grouping and Figure\u2013Ground Organization","volume":"138","author":"Wagemans","year":"2012","journal-title":"Psychol. Bull."},{"key":"ref_35","unstructured":"(2022, April 29). Gestalt Principles, Interaction Design Foundation. Available online: https:\/\/www.interactiondesign.org\/literature\/topics\/gestalt-principles."},{"key":"ref_36","unstructured":"Pernice, K. (2022, May 01). F-Shaped Pattern of Reading on the Web: Misunderstood, But Still Relevant (Even on Mobile), Nielsen Norman Group. Available online: https:\/\/www.nngroup.com\/articles\/f-shaped-pattern-reading-web-content\/."},{"key":"ref_37","unstructured":"Fessenden, T. (2022, May 01). Horizontal Attention Leans Left, Nielsen Norman Group. Available online: https:\/\/www.nngroup.com\/articles\/horizontal-attention-leans-left\/."},{"key":"ref_38","unstructured":"Pemberton, L., and Griffiths, R. (2003, January 22\u201327). Usability evaluation techniques for interactive television. Proceedings of the HCI International 2003, Crete, Greece."},{"key":"ref_39","unstructured":"Carroll, J.M. (1987). Interfacing Thought: Cognitive Aspects of Human-Computer Interaction, The MIT Press."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Card, S.K. (2018). The Psychology of Human-Computer Interaction, CRC Press. [1st ed.].","DOI":"10.1201\/9780203736166"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sulikowski, P., and Zdziebko, T. (2020). Horizontal vs. Vertical Recommendation Zones Evaluation Using Behavior Tracking. Appl. Sci., 11.","DOI":"10.3390\/app11010056"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sziladi, G., Ujbanyi, T., Katona, J., and Kovari, A. (2017, January 11\u201314). The Analysis of Hand Gesture Based Cursor Position Control during Solve an IT Related Task. Proceedings of the 2017 8th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Debrecen, Hungary.","DOI":"10.1109\/CogInfoCom.2017.8268281"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"43","DOI":"10.3991\/ijoe.v11i6.5119","article-title":"EEG-Based Computer Control Interface for Brain-Machine Interaction","volume":"11","author":"Katona","year":"2015","journal-title":"Int. J. Onl. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Gagniuc, P.A. (2017). Markov Chains: From Theory to Implementation and Experimentation, John Wiley & Sons, Inc.","DOI":"10.1002\/9781119387596"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"25200","DOI":"10.1109\/ACCESS.2018.2829545","article-title":"KVLMM: A Trajectory Prediction Method Based on a Variable-Order Markov Model with Kernel Smoothing","volume":"6","author":"Wang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.ifacol.2016.10.473","article-title":"Gaze Trajectory Prediction in the Context of Social Robotics","volume":"49","author":"Setchi","year":"2016","journal-title":"IFAC-PapersOnLine"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1093\/imaman\/12.1.89","article-title":"Time Will Tell: Behavioural Scoring and the Dynamics of Consumer Credit Assessment","volume":"12","author":"Thomas","year":"2001","journal-title":"IMA J. Manag. Math."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v074.i04","article-title":"R Package Clickstream: Analyzing Clickstream Data with Markov Chains","volume":"74","author":"Scholz","year":"2016","journal-title":"J. Stat. Soft."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1287\/mksc.1040.0073","article-title":"Modeling Online Browsing and Path Analysis Using Clickstream Data","volume":"23","author":"Montgomery","year":"2004","journal-title":"Mark. Sci."},{"key":"ref_50","unstructured":"Ish-Shalom, S., and Hansen, S. (2016). Visualizing Clickstream Data as Discrete-Time Markov Chains, Stanford University."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"04025","DOI":"10.1051\/matecconf\/201712504025","article-title":"Website Clickstream Data Visualization Using Improved Markov Chain Modelling in Apache Flume","volume":"125","author":"Frhan","year":"2017","journal-title":"MATEC Web Conf."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Cegan, L. (2015, January 24\u201327). Intelligent Preloading of Websites Resources Based on Clustering Web User Sessions. Proceedings of the 2015 5th International Conference on IT Convergence and Security (ICITCS), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICITCS.2015.7292988"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1093\/imaman\/dpn030","article-title":"Non-Homogeneous Markov Models for Sequential Pattern Mining of Healthcare Data","volume":"20","author":"Garg","year":"2009","journal-title":"IMA J. Manag. Math."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/5.18626","article-title":"A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition","volume":"77","author":"Rabiner","year":"1989","journal-title":"Proc. IEEE"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/S0304-3800(00)00269-6","article-title":"The Mathematics of Markov Models: What Markov Chains Can Really Predict in Forest Successions","volume":"126","author":"Logofet","year":"2000","journal-title":"Ecol. Model."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1016\/j.energy.2004.05.026","article-title":"First and Second Order Markov Chain Models for Synthetic Generation of Wind Speed Time Series","volume":"30","author":"Shamshad","year":"2005","journal-title":"Energy"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Gebali, F. (2008). Analysis of Computer and Communication Networks, Springer.","DOI":"10.1007\/978-0-387-74437-7"},{"key":"ref_58","unstructured":"Feres, R. (2022, April 25). Notes for Math 450 Matlab Listings for Markov Chains. Available online: http:\/\/www.math.wustl.edu\/feres\/Math450Lect04.pdf."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Kemeny, J.G., and Snell, J.L. (1976). Finite Markov Chains, Springer. Undergraduate Texts in Mathematics.","DOI":"10.1007\/978-1-4684-9455-6_4"},{"key":"ref_60","unstructured":"(2022, April 24). Stationary and Limiting Distributions, Introduction to Probability, Statistics and Random Processes. Available online: https:\/\/www.probabilitycourse.com\/chapter11\/11_2_6_stationary_and_limiting_distributions.php."},{"key":"ref_61","first-page":"151","article-title":"Accurate Calculations of Stationary Distributions and Mean First Passage Times in Markov Renewal Processes and Markov Chains","volume":"4","author":"Hunter","year":"2016","journal-title":"Spec. Matrices"},{"key":"ref_62","unstructured":"Maltby, H. (2022, April 13). Absorbing Markov Chains. Available online: https:\/\/brilliant.org\/wiki\/absorbing-markov-chains\/."},{"key":"ref_63","unstructured":"MathWorks (2022, April 26). Create Discrete-Time Markov Chain. Available online: https:\/\/uk.mathworks.com\/help\/econ\/dtmc.html."},{"key":"ref_64","unstructured":"MathWorks (2022, April 26). Determine Markov Chain Asymptotics. Available online: https:\/\/uk.mathworks.com\/help\/econ\/dtmc.asymptotics.html."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/2\/82\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:22:19Z","timestamp":1760120539000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/2\/82"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,2]]},"references-count":64,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["a16020082"],"URL":"https:\/\/doi.org\/10.3390\/a16020082","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,2]]}}}