{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:14:36Z","timestamp":1760242476460,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,7,28]],"date-time":"2017-07-28T00:00:00Z","timestamp":1501200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>As Augmented Reality (AR) applications become commonplace, the determination of a device operator\u2019s subjective Quality of Experience (QoE) in addition to objective Quality of Service (QoS) metrics gains importance. Human subject experimentation is common for QoE relationship determinations due to the subjective nature of the QoE. In AR scenarios, the overlay of displayed content with the real world adds to the complexity. We employ Electroencephalography (EEG) measurements as the solution to the inherent subjectivity and situationality of AR content display overlaid with the real world. Specifically, we evaluate prediction performance for traditional image display (AR) and spherical\/immersive image display (SAR) for the QoE and underlying QoS levels. Our approach utilizing a four-position EEG wearable achieves high levels of accuracy. Our detailed evaluation of the available data indicates that less sensors would perform almost as well and could be integrated into future wearable devices. Additionally, we make our Visual Interface Evaluation for Wearables (VIEW) datasets from human subject experimentation publicly available and describe their utilization.<\/jats:p>","DOI":"10.3390\/fi9030040","type":"journal-article","created":{"date-parts":[[2017,7,28]],"date-time":"2017-07-28T10:14:34Z","timestamp":1501236874000},"page":"40","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Visual Interface Evaluation for Wearables Datasets: Predicting the Subjective Augmented Vision Image QoE and QoS"],"prefix":"10.3390","volume":"9","author":[{"given":"Brian","family":"Bauman","sequence":"first","affiliation":[{"name":"Department of Computer Science, Central Michigan University, Mount Pleasant, MI 48859, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2770-0675","authenticated-orcid":false,"given":"Patrick","family":"Seeling","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Central Michigan University, Mount Pleasant, MI 48859, USA"}]}],"member":"1968","published-online":{"date-parts":[[2017,7,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Keighrey, C., Flynn, R., Murray, S., and Murray, N. (June, January 31). A QoE evaluation of immersive augmented and virtual reality speech language assessment applications. Proceedings of the 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany.","DOI":"10.1109\/QoMEX.2017.7965656"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1109\/JPROC.2013.2294642","article-title":"Behind the Glass: Driver Challenges and Opportunities for AR Automotive Applications","volume":"102","author":"Gabbard","year":"2014","journal-title":"Proc. IEEE"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1162\/105474600566808","article-title":"Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization","volume":"9","author":"Rolland","year":"2000","journal-title":"Presence"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1109\/JDT.2008.2006510","article-title":"Advanced Display and Visualization Concepts for Image Guided Surgery","volume":"4","author":"Traub","year":"2008","journal-title":"J. Disp. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s11528-012-0559-3","article-title":"Augmented Reality in Education and Training","volume":"56","author":"Lee","year":"2012","journal-title":"TechTrends"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/MNET.2016.1500279NM","article-title":"Enabling Low-Latency Applications in Fog-Radio Access Networks","volume":"31","author":"Shih","year":"2017","journal-title":"IEEE Netw."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Seeling, P. (2015, January 9\u201312). Network Traffic Characteristics of Proxied Wearable Devices: A Day with Google Glass. Proceedings of the IEEE Consumer Communications and Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2015.7158087"},{"key":"ref_8","unstructured":"Brunnstr\u00f6m, K., Beker, S.A., De Moor, K., Dooms, A., Egger, S., Garcia, M.N., Hossfeld, T., Jumisko-Pyykk\u00f6, S., Keimel, C., and Larabi, C. (2013, January 12). Qualinet White Paper on Definitions of Quality of Experience. Proceedings of 5th Qualinet Meeting, Novi Sad, Serbia."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Engelke, U., Nguyen, H., and Ketchell, S. (June, January 31). Quality of augmented reality experience: A correlation analysis. Proceedings of the 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany.","DOI":"10.1109\/QoMEX.2017.7965638"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hektner, J.M., Schmidt, J.A., and Csikszentmihalyi, M. (2007). Experience Sampling Method: Measuring the Quality of Everyday Life, Sage.","DOI":"10.4135\/9781412984201"},{"key":"ref_11","unstructured":"ITU-R, R. (2003). 1534-1, Method for the Subjective Assessment of Intermediate Quality Levels of Coding Systems (MUSHRA), International Telecommunication Union."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2010.1","article-title":"Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications","volume":"1","author":"Calvo","year":"2010","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gaubatz, M.D., and Hemami, S.S. (2008, January 12\u201315). On the nearly scale-independent rank behavior of image quality metrics. Proceedings of the IEEE International Conference on Image Processing ICIP, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4711851"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MNET.2010.5430142","article-title":"A generic quantitative relationship between quality of experience and quality of service","volume":"24","author":"Fiedler","year":"2010","journal-title":"IEEE Netw."},{"key":"ref_15","first-page":"587","article-title":"Logarithmic laws in service quality perception: where microeconomics meets psychophysics and quality of experience","volume":"52","author":"Reichl","year":"2013","journal-title":"Telecommun. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Seeling, P. (2015, January 8\u201312). Augmented Vision and Quality of Experience Assessment: Towards a Unified Evaluation Framework. Proceedings of the IEEE ICC Workshop on Quality of Experience-based Management for Future Internet Applications and Services (QoE-FI), London, UK.","DOI":"10.1109\/ICCW.2015.7247431"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2123","DOI":"10.1109\/5.726784","article-title":"Humanistic computing: \u201cWearComp\u201d as a new framework and application for intelligent signal processing","volume":"86","author":"Mann","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_18","unstructured":"Kanbara, M., Okuma, T., and Takemura, H. (2000, January 22\u201322). A Stereoscopic Video See-through Augmented Reality System Based on Real-time Vision-based Registration. Proceedings of the IEEE Virtual Reality 2000 (Cat. No. 00CB37048), New Brunswick, NJ, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.20870\/IJVR.2010.9.2.2767","article-title":"A Survey of Augmented Reality Technologies, Applications and Limitations","volume":"9","author":"Poelman","year":"2010","journal-title":"Int. J. Virtual Real."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kruijff, E., Swan, J.E., and Feiner, S. (2010, January 13\u201316). Perceptual Issues in Augmented Reality Revisited. Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Seoul, Korea.","DOI":"10.1109\/ISMAR.2010.5643530"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kalkofen, D., Mendez, E., and Schmalstieg, D. (2007, January 13\u201316). Interactive Focus and Context Visualization for Augmented Reality. Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538846"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bonanni, L., Lee, C.H., and Selker, T. (2005, January 2\u20137). Attention-Based Design of Augmented Reality Interfaces. Proceedings of the ACM Human Factors in Computing Systems Conference CHI, Portland, OR, USA.","DOI":"10.1145\/1056808.1056883"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sanches, S.R.R., Tokunaga, D.M., Silva, V.F., and Tori, R. (2012, January 28\u201331). Subjective Video Quality Assessment in Segmentation for Augmented Reality Applications. Proceedings of the 2012 14th Symposium on Virtual and Augmented Reality, Rio de Janeiro, Brazil.","DOI":"10.1109\/SVR.2012.2"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Klein, E., Swan, J.E., Schmidt, G.S., Livingston, M.A., and Staadt, O.G. (2009, January 14\u201318). Measurement Protocols for Medium-Field Distance Perception in Large-Screen Immersive Displays. Proceedings of the IEEE Virtual Reality Conference (VR), Lafayette, LA, USA.","DOI":"10.1109\/VR.2009.4811007"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Livingston, M.A., Barrow, J.H., and Sibley, C.M. (2009, January 14\u201318). Quantification of Contrast Sensitivity and Color Perception using Head-worn Augmented Reality Displays. Proceedings of the IEEE Virtual Reality Conference (VR), Lafayette, LA, USA.","DOI":"10.1109\/VR.2009.4811009"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1889\/1.1831704","article-title":"The impact of non-immersive head-mounted displays (HMDs) on the visual field","volume":"11","author":"Woods","year":"2003","journal-title":"J. Soc. Inf. Disp."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Seeling, P. (2016, January 9\u201312). Visual User Experience Difference: Image Compression Impacts on the Quality of Experience in Augmented Binocular Vision. Proceedings of the IEEE Consumer Communications and Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2016.7444911"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pan, C., Xu, Y., Yan, Y., Gu, K., and Yang, X. (2016, January 27\u201330). Exploiting neural models for no-reference image quality assessment. Proceedings of the 2016 Visual Communications and Image Processing (VCIP), Chengdu, China.","DOI":"10.1109\/VCIP.2016.7805524"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2619","DOI":"10.1109\/TIP.2012.2187672","article-title":"Toward a Direct Measure of Video Quality Perception Using EEG","volume":"21","author":"Scholler","year":"2012","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bosse, S., M\u00fcller, K.R., Wiegand, T., and Samek, W. (2016, January 9\u201312). Brain-Computer Interfacing for multimedia quality assessment. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844669"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Davis, P., Creusere, C.D., and Kroger, J. (2016, January 25\u201328). The effect of perceptual video quality on EEG power distribution. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532793"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lindemann, L., and Magnor, M.A. (2011, January 11\u201314). Assessing the quality of compressed images using EEG. Proceedings of the 18th IEEE International Conference on Image Processing, Brussels, Belgium.","DOI":"10.1109\/ICIP.2011.6116324"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"026012","DOI":"10.1088\/1741-2560\/12\/2\/026012","article-title":"EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs)","volume":"12","author":"Acqualagna","year":"2015","journal-title":"J. Neural Eng."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Arnau-Gonzalez, P., Althobaiti, T., Katsigiannis, S., and Ramzan, N. (June, January 31). Perceptual video quality evaluation by means of physiological signals. Proceedings of the 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany.","DOI":"10.1109\/QoMEX.2017.7965651"},{"key":"ref_35","unstructured":"Bauman, B., and Seeling, P. (2017). Towards Predictions of the Image Quality of Experience for Augmented Reality Scenarios, Cornell University Library."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bauman, B., and Seeling, P. (2017, January 8\u201311). Towards Still Image Experience Predictions in Augmented Vision Settings. Proceedings of the IEEE Consumer Communications and Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2017.7983282"},{"key":"ref_37","unstructured":"ITU-T (2017, May 15). Recommendation ITU-T P.910: Subjective Video Quality Assessment Methods for Multimedia Applications. Available online: https:\/\/www.itu.int\/rec\/T-REC-P.910-199608-S\/en."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.image.2014.10.009","article-title":"Image database TID2013: Peculiarities, results and perspectives","volume":"30","author":"Ponomarenko","year":"2015","journal-title":"Signal Proc. Image Commun."},{"key":"ref_39","unstructured":"Seeling, P. (2017, June 30). Visual Interface Evaluation for Wearables (VIEW). Available online: http:\/\/people.cst.cmich.edu\/seeli1p\/VIEW\/."},{"key":"ref_40","unstructured":"Seeling, P. (2017, June 30). Visual Interface Evaluation for Wearables (VIEW). Available online: http:\/\/patrick.seeling.org\/VIEW\/."},{"key":"ref_41","unstructured":"Hipp, D.R. (2017, June 30). SQLite. Available online: http:\/\/www.sqlite.org."},{"key":"ref_42","unstructured":"Jain, R. (1991). The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling, Wiley."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/9\/3\/40\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:44:17Z","timestamp":1760208257000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/9\/3\/40"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,28]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,9]]}},"alternative-id":["fi9030040"],"URL":"https:\/\/doi.org\/10.3390\/fi9030040","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2017,7,28]]}}}