{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T16:47:54Z","timestamp":1779295674595,"version":"3.51.4"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2014,4,1]],"date-time":"2014-04-01T00:00:00Z","timestamp":1396310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100007458","name":"Qatar Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007458","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2014,4]]},"abstract":"<jats:p>Haptic-based Virtual Reality (VR) applications have many merits. What is still obscure, from the designer's perspective of these applications, is the experience the users will undergo when they use the VR system. Quality of Experience (QoE) is an evaluation metric from the user's perspective that unfortunately has received limited attention from the research community. Assessing the QoE of VR applications reflects the amount of overall satisfaction and benefits gained from the application in addition to laying the foundation for ideal user-centric design in the future. In this article, we propose a taxonomy for the evaluation of QoE for multimedia applications and in particular VR applications. We model this taxonomy using a Fuzzy logic Inference System (FIS) to quantitatively measure the QoE of haptic virtual environments. We build and test our FIS by conducting a users' study analysis to evaluate the QoE of a haptic game application. Our results demonstrate that the proposed FIS model reflects the user's estimation of the application's quality significantly with low error and hence is suited for QoE evaluation.<\/jats:p>","DOI":"10.1145\/2540991","type":"journal-article","created":{"date-parts":[[2014,4,15]],"date-time":"2014-04-15T17:50:29Z","timestamp":1397584229000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["A Quality of Experience Model for Haptic Virtual Environments"],"prefix":"10.1145","volume":"10","author":[{"given":"Abdelwahab","family":"Hamam","sequence":"first","affiliation":[{"name":"University of Ottawa, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abdulmotaleb El","family":"Saddik","sequence":"additional","affiliation":[{"name":"University of Ottawa, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jihad","family":"Alja'am","sequence":"additional","affiliation":[{"name":"University of Qatar, Qatar"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,4,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/HAPTICS.2008.4479972"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA'08)","author":"Alamri A.","unstructured":"A. Alamri , M. Eid , and A. El Saddik . 2008. A quality of performance model for evaluating post-stroke patients . In Proceedings of the IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA'08) . 14--18. A. Alamri, M. Eid, and A. El Saddik. 2008. A quality of performance model for evaluating post-stroke patients. In Proceedings of the IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA'08). 14--18."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/365058.365082"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1162\/105474605775196535"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2071905"},{"key":"e_1_2_1_6_1","volume-title":"Business Statistics: For Contemporary Decision Making","author":"Black K.","year":"2004","unstructured":"K. Black . 2004 . Business Statistics: For Contemporary Decision Making . Leyh Publishing . K. Black. 2004. Business Statistics: For Contemporary Decision Making. Leyh Publishing."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.10217"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/HAPTIC.2012.6183844"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"L. De Marez and K. De Moor. 2007. The challenge of user- and QoE-centric research and product development in today's ICT-environment. Observatorio (OBS&ast;) 1 1--22.  L. De Marez and K. De Moor. 2007. The challenge of user- and QoE-centric research and product development in today's ICT-environment. Observatorio (OBS&ast;) 1 1--22.","DOI":"10.15847\/obsOBS132007141"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0923-5965(97)00021-0"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1631272.1631275"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIM.2007.339540"},{"key":"e_1_2_1_13_1","first-page":"121","article-title":"Quality of experience in virtual environments","volume":"5","author":"Gaggioli A.","year":"2003","unstructured":"A. Gaggioli , M. Bassi , and A. Fave . 2003 . Quality of experience in virtual environments . Emerging Commun. 5 , 121 -- 136 . A. Gaggioli, M. Bassi, and A. Fave. 2003. Quality of experience in virtual environments. Emerging Commun. 5, 121--136.","journal-title":"Emerging Commun."},{"key":"e_1_2_1_14_1","unstructured":"A. Guerraz C. Loscos and R. Widenfeld. 2003. How to use physical parameters coming from the haptic device itself to enhance the evaluation of haptic benefits in user interface&quest; In Proceedings of the Eurohaptics Conference. 137--145.  A. Guerraz C. Loscos and R. Widenfeld. 2003. How to use physical parameters coming from the haptic device itself to enhance the evaluation of haptic benefits in user interface&quest; In Proceedings of the Eurohaptics Conference. 137--145."},{"key":"e_1_2_1_15_1","first-page":"155","article-title":"The effect of degree of immersion upon learning performance in virtual reality simulations for medical education","volume":"125","author":"Gutierrez F.","year":"2007","unstructured":"F. Gutierrez , J. Pierce , V. M. Vergara , R. Coulter , L. Saland , T. P. Caudell , T. E. Goldsmith , and D. C. Alverson . 2007 . The effect of degree of immersion upon learning performance in virtual reality simulations for medical education . Stud. Health Tech. Informatics 125 , 155 -- 160 . F. Gutierrez, J. Pierce, V. M. Vergara, R. Coulter, L. Saland, T. P. Caudell, T. E. Goldsmith, and D. C. Alverson. 2007. The effect of degree of immersion upon learning performance in virtual reality simulations for medical education. Stud. Health Tech. Informatics 125, 155--160.","journal-title":"Stud. Health Tech. Informatics"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1162\/pres.16.6.603"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08)","author":"Hamam A.","unstructured":"A. Hamam , M. Eid , A. E. Saddik , and N. D. Georganas . 2008a. A quality of experience model for haptic user interfaces . In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08) . 1--6. A. Hamam, M. Eid, A. E. Saddik, and N. D. Georganas. 2008a. A quality of experience model for haptic user interfaces. In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08). 1--6."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69057-3_14"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-012-0990-7"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2013.2272859"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.","author":"Huang P.","unstructured":"P. Huang , Y. Ishibashi , N. Fukushima , and S. Sugawara . 2012. QoE assessment of olfactory media in remote ikebana with haptic media . In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6. P. Huang, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2012. QoE assessment of olfactory media in remote ikebana with haptic media. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2.","author":"Ida Y.","unstructured":"Y. Ida , Y. Ishibashi , N. Fukushima , and S. Sugawara . 2010. QoE assessment of interactivity and fairness in First Person Shooting with group synchronization control . In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2. Y. Ida, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment of interactivity and fairness in First Person Shooting with group synchronization control. In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the International Conference on Advances in Computer Entertainment Technology.","author":"Ijsselsteijn W.","unstructured":"W. Ijsselsteijn , Y. De Kort , K. Poels , A. Jurgelionis , and F. Bellotti . 2007. Characterising and measuring user experiences in digital games . In Proceedings of the International Conference on Advances in Computer Entertainment Technology. W. Ijsselsteijn, Y. De Kort, K. Poels, A. Jurgelionis, and F. Bellotti. 2007. Characterising and measuring user experiences in digital games. In Proceedings of the International Conference on Advances in Computer Entertainment Technology."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899687.1899694"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2004.10000"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2008.2"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2009.32"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2.","author":"Kusunose Y.","unstructured":"Y. Kusunose , Y. Ishibashi , N. Fukushima , and S. Sugawara . 2010. QoE assessment in networked air hockey game with haptic media . In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2. Y. Kusunose, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in networked air hockey game with haptic media. In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the IEEE Conference on Virtual Reality.","author":"Park K. S.","unstructured":"K. S. Park and R. V. Kenyon . 1999. Effects of network characteristics on human performance in a collaborative virtual environment . In Proceedings of the IEEE Conference on Virtual Reality. K. S. Park and R. V. Kenyon. 1999. Effects of network characteristics on human performance in a collaborative virtual environment. In Proceedings of the IEEE Conference on Virtual Reality."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1973.0303"},{"key":"e_1_2_1_31_1","volume-title":"Fuzzy logic toolbox for use with MATLAB","author":"Documentation MATLAB","year":"2001","unstructured":"MATLAB Documentation , Fuzzy logic toolbox for use with MATLAB . Math Works Inc ., 2001 . MATLAB Documentation, Fuzzy logic toolbox for use with MATLAB. Math Works Inc., 2001."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/019394599301500506"},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","unstructured":"C. C. Preston and A. M. Colman. 2000. Optimal number of response categories in rating scales: reliability validity discriminating power and respondent preferences. Acta Psychologica 104.  C. C. Preston and A. M. Colman. 2000. Optimal number of response categories in rating scales: reliability validity discriminating power and respondent preferences. Acta Psychologica 104.","DOI":"10.1016\/S0001-6918(99)00050-5"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1496984.1496998"},{"key":"e_1_2_1_35_1","first-page":"5","article-title":"Affective ludology, flow and immersion in a first-person shooter: Measurement of player experience","volume":"3","author":"Nacke L. E.","year":"2010","unstructured":"L. E. Nacke and C. A. Lindley . 2010 . Affective ludology, flow and immersion in a first-person shooter: Measurement of player experience . Loading 3 , 5 . L. E. Nacke and C. A. Lindley. 2010. Affective ludology, flow and immersion in a first-person shooter: Measurement of player experience. Loading 3, 5.","journal-title":"Loading"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the International Workshop on Motion Sickness: Medical and Human Factors. 26--28","author":"Ramsey A.","year":"1997","unstructured":"A. Ramsey . 1997 . Investigation of physiological measures relative to self-report of virtual reality induced sickness and effects (VRISE) . In Proceedings of the International Workshop on Motion Sickness: Medical and Human Factors. 26--28 . A. Ramsey. 1997. Investigation of physiological measures relative to self-report of virtual reality induced sickness and effects (VRISE). In Proceedings of the International Workshop on Motion Sickness: Medical and Human Factors. 26--28."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the International Test Users Conference. Austrahan Conference for Educational Research.","author":"Roid G. H.","year":"2004","unstructured":"G. H. Roid . 2004 . Quality of performance and change-sensitive assessment of cognitive ability . In Proceedings of the International Test Users Conference. Austrahan Conference for Educational Research. G. H. Roid. 2004. Quality of performance and change-sensitive assessment of cognitive ability. In Proceedings of the International Test Users Conference. Austrahan Conference for Educational Research."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047936.1047938"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/10.16476"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0097-8493(97)00030-7"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/070674370304801108"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/257874.257881"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1077246.1077253"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.","author":"Tatematsu A.","unstructured":"A. Tatematsu , Y. Ishibashi , N. Fukushima , and S. Sugawara . 2010. QoE assessment in haptic media, sound and video transmission: Influences of network latency . In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6. A. Tatematsu, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in haptic media, sound and video transmission: Influences of network latency. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/21.199466"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE International Symposium on Virtual Environments, Human- Computer Interfaces and Measurement Systems (VECIMS'03)","author":"Whalen T. E.","unstructured":"T. E. Whalen , S. Noel , and J. Stewart . 2003. Measuring the human side of virtual reality . In Proceedings of the IEEE International Symposium on Virtual Environments, Human- Computer Interfaces and Measurement Systems (VECIMS'03) . 8--12. T. E. Whalen, S. Noel, and J. Stewart. 2003. Measuring the human side of virtual reality. In Proceedings of the IEEE International Symposium on Virtual Environments, Human- Computer Interfaces and Measurement Systems (VECIMS'03). 8--12."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1631272.1631338"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISM.2010.39"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2540991","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2540991","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:09:54Z","timestamp":1750234194000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2540991"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,4]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,4]]}},"alternative-id":["10.1145\/2540991"],"URL":"https:\/\/doi.org\/10.1145\/2540991","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,4]]},"assertion":[{"value":"2012-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-04-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}