{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:23:32Z","timestamp":1760243012797,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2015,5,7]],"date-time":"2015-05-07T00:00:00Z","timestamp":1430956800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the rapid increase of 3-dimensional (3D) content, considerable research related to the 3D human factor has been undertaken for quantitatively evaluating visual discomfort, including eye fatigue and dizziness, caused by viewing 3D content. Various modalities such as electroencephalograms (EEGs), biomedical signals, and eye responses have been investigated. However, the majority of the previous research has analyzed each modality separately to measure user eye fatigue. This cannot guarantee the credibility of the resulting eye fatigue evaluations. Therefore, we propose a new method for quantitatively evaluating eye fatigue related to 3D content by combining multimodal measurements. This research is novel for the following four reasons: first, for the evaluation of eye fatigue with high credibility on 3D displays, a fuzzy-based fusion method (FBFM) is proposed based on the multimodalities of EEG signals, eye blinking rate (BR), facial temperature (FT), and subjective evaluation (SE); second, to measure a more accurate variation of eye fatigue (before and after watching a 3D display), we obtain the quality scores of EEG signals, eye BR, FT and SE; third, for combining the values of the four modalities we obtain the optimal weights of the EEG signals BR, FT and SE using a fuzzy system based on quality scores; fourth, the quantitative level of the variation of eye fatigue is finally obtained using the weighted sum of the values measured by the four modalities. Experimental results confirm that the effectiveness of the proposed FBFM is greater than other conventional multimodal measurements. Moreover, the credibility of the variations of the eye fatigue using the FBFM before and after watching the 3D display is proven using a t-test and descriptive statistical analysis using effect size.<\/jats:p>","DOI":"10.3390\/s150510825","type":"journal-article","created":{"date-parts":[[2015,5,7]],"date-time":"2015-05-07T10:54:29Z","timestamp":1430996069000},"page":"10825-10851","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Fuzzy-Based Fusion Method of Multimodal Sensor-Based Measurements for the Quantitative Evaluation of Eye Fatigue on 3D Displays"],"prefix":"10.3390","volume":"15","author":[{"given":"Jae","family":"Bang","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jong-Suk","family":"Choi","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hwan","family":"Heo","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kang","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,5,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"030201:1","DOI":"10.2352\/J.ImagingSci.Technol.2009.53.3.030201","article-title":"Visual discomfort and visual fatigue of stereoscopic displays: A review","volume":"53","author":"Lambooij","year":"2009","journal-title":"J. Imaging Sci. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1677","DOI":"10.1109\/TCE.2010.5606312","article-title":"The comparative measurements of eyestrain caused by 2D and 3D displays","volume":"56","author":"Lee","year":"2010","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"8577","DOI":"10.3390\/s140508577","article-title":"Quantitative measurement of eyestrain on 3D stereoscopic display considering the eye foveation model and edge information","volume":"14","author":"Heo","year":"2014","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kim, Y.-J., and Lee, E.C. (2011, January 9\u201314). EEG Based Comparative Measurement of Visual Fatigue Caused by 2D and 3D Displays. Proceedings of the International Conference, HCI International, Orlando, FL, USA.","DOI":"10.1007\/978-3-642-22095-1_59"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.displa.2014.10.001","article-title":"Assessment visual fatigue of watching 3DTV using EEG power spectral parameters","volume":"35","author":"Chen","year":"2014","journal-title":"Displays"},{"key":"ref_6","unstructured":"Park, S.J., Oh, S.B., Subramaniyam, M., and Lim, H.K. (2012, January 9\u201314). Human Impact Assessment of Watching 3D Television by Electrocardiogram and Subjective Evaluation. Proceedings of the XX IMEKO World Congress\u2014Metrology for Green Growth, Busan, Korea."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, H.-C.O., Seo, J., Kham, K., and Lee, S. (2008, January 28\u201330). Measurement of 3D Visual Fatigue Using Event-Related Potential (ERP): 3D Oddball Paradigm. Proceedings of the 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, Istanbul, Turkey.","DOI":"10.1109\/3DTV.2008.4547846"},{"key":"ref_8","unstructured":"Yu, J.-H., Lee, B.-H., and Kim, D.-H. (2012, January 2\u20137). EOG Based Eye Movement Measure of Visual Fatigue Caused by 2D and 3D Displays. Proceedings of the IEEE-EMBS International Conference on Biomedical and Health Informatics, Hong Kong and Shenzhen, China."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Inoue, T., Kato, Y.O., and Ozawa, J. (2012, January 2\u20135). Evaluating Visual Fatigue by Sensing Eye Movement during Viewing of 3D Images. Proceedings of the 1st IEEE Global Conference on Consumer Electronics, Tokyo, Japan.","DOI":"10.1109\/GCCE.2012.6379666"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"16467","DOI":"10.3390\/s140916467","article-title":"Assessment of eye fatigue caused by 3D displays based on multimodal measurements","volume":"14","author":"Bang","year":"2014","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"13054","DOI":"10.3390\/s131013054","article-title":"Autonomic nervous system responses can reveal visual fatigue induced by 3D displays","volume":"13","author":"Kim","year":"2013","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"083110:1","DOI":"10.1117\/1.OE.52.8.083110","article-title":"Visual fatigue measurement model in stereoscopy based on bayesian network","volume":"52","author":"Yuan","year":"2013","journal-title":"Opt. Eng."},{"key":"ref_13","unstructured":"SSG-3700CR Rechargeable 3D Glasses. Available online:http:\/\/www.samsung.com\/ie\/consumer\/tv-audio-video\/tv-av-accessories\/tv-accessories\/SSG-3700CR\/XC?subsubtype=3d-glasses."},{"key":"ref_14","unstructured":"Samsung Smart TV. Available online:http:\/\/www.samsung.com\/us\/system\/consumer\/product\/un\/60\/es\/un60es8000fxza\/7654_SlimLED_60_8000_V14.pdf."},{"key":"ref_15","unstructured":"Gazelle. Available online:http:\/\/www.ptgrey.com\/products\/gazelle\/gazelle_camera_link.asp."},{"key":"ref_16","unstructured":"ICI 7320 Pro Specifications. Available online:http:\/\/www.infraredcamerasinc.com\/Thermal-Cameras\/Fix-Mounted-Thermal-Cameras\/ICI7320_Pro_fix-mounted_thermal_camera.html."},{"key":"ref_17","first-page":"98","article-title":"3DTV broadcasting safety guideline","volume":"133","author":"Li","year":"2010","journal-title":"TTA J."},{"key":"ref_18","unstructured":"Emotiv EPOC. Available online:http:\/\/www.emotiv.com\/epoc.php."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"6272","DOI":"10.3390\/s130506272","article-title":"Noise reduction in brainwaves by using both EEG signals and frontal viewing camera images","volume":"13","author":"Bang","year":"2013","journal-title":"Sensors"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3454","DOI":"10.3390\/s130303454","article-title":"Enhanced perception of user intention by combining EEG and gaze-tracking for brain-computer interfaces (BCIs)","volume":"13","author":"Choi","year":"2013","journal-title":"Sensors"},{"key":"ref_21","unstructured":"Emotiv SDK. Available online:http:\/\/innovatec.co.jp\/content\/etc\/ResearchEditionSDK.pdf."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1177\/001872089403600209","article-title":"Blink rate: A possible measure of fatigue","volume":"36","author":"Stern","year":"1994","journal-title":"Hum. Factors"},{"key":"ref_23","first-page":"786303:1","article-title":"Visual fatigue monitoring system based on eye-movement and eye-blink detection","volume":"7863","author":"Kim","year":"2011","journal-title":"Proc. SPIE"},{"key":"ref_24","unstructured":"SFH 4550. Available online:http:\/\/www.jlab.org\/accel\/inj_group\/laser2001\/pockels_files\/pockels_switch_notebook_files\/SFH4550.pdf."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"047201:1","DOI":"10.1117\/1.OE.52.4.047201","article-title":"Enhanced iris recognition method based on multi-unit iris images","volume":"52","author":"Shin","year":"2013","journal-title":"Opt. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ghiass, R.S., Arandjelovi\u0107, O., Bendada, H., and Maldague, X. (2013, January 4\u20139). Infrared Face Recognition: A Literature Review. Proceedings of the International Joint Conference on Neural Networks, Dallas, TX, USA.","DOI":"10.1109\/IJCNN.2013.6707096"},{"key":"ref_27","unstructured":"Webcam C600. Available online:http:\/\/www.logitech.com\/en-us\/support\/5869."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bayu, B.S., and Miura, J. (2013, January 7\u20139). Fuzzy-based Illumination Normalization for Face Recognition. Proceedings of the IEEE Workshop on Advanced Robotics and Its Social Impacts, Tokyo, Japan.","DOI":"10.1109\/ARSO.2013.6705518"},{"key":"ref_30","first-page":"164","article-title":"Why trapezoidal and triangular membership functions work so well: Towards a theoretical explanation","volume":"8","author":"Barua","year":"2014","journal-title":"J. Uncertain Syst."},{"key":"ref_31","unstructured":"Zhao, J., and Bose, B.K. (2002, January 5\u20138). Evaluation of Membership Functions for Fuzzy Logic Controlled Induction Motor Drive. Proceedings of the IEEE Annual Conference of the Industrial Electronics Society, Sevilla, Spain."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S0165-0114(97)00337-0","article-title":"Defuzzification: Criteria and classification","volume":"108","author":"Leekwijck","year":"1999","journal-title":"Fuzzy Sets Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1016\/j.fss.2005.11.005","article-title":"Fast and accurate center of gravity defuzzification of fuzzy system outputs defined on trapezoidal fuzzy partitions","volume":"157","author":"Broekhoven","year":"2006","journal-title":"Fuzzy Sets Syst."},{"key":"ref_34","unstructured":"Dongleware. Available online:http:\/\/www.dongleware.de."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1080\/00140139008925312","article-title":"On the preferred viewing distances to screen and document at VDU workplaces","volume":"33","author":"Wolfgang","year":"1990","journal-title":"Ergonomics"},{"key":"ref_36","unstructured":"Correlation and Dependence. Available online:http:\/\/en.wikipedia.org\/wiki\/Correlation_and_dependence."},{"key":"ref_37","unstructured":"Student\u2019s T-Test. Available online:http:\/\/en.wikipedia.org\/wiki\/Student\u2019s_t-test."},{"key":"ref_38","unstructured":"Effect Size. Available online:http:\/\/en.wikipedia.org\/wiki\/Effect_size#Cohen.27s_d."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","article-title":"A power primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychol. Bull."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Kim, J.W., Jo, J.G., Seo, J.Y., Cho, H.C., Kim, K.S., Cho, T.H., and Yoo, S.G. (2006, January 20\u201323). Intelligent Hue Control System for Display Panel. Proceedings of the IEEE International Conference on Information Acquisition, Weihai, China.","DOI":"10.1109\/ICIA.2006.305917"},{"key":"ref_41","unstructured":"Pixabay. Available online:http:\/\/pixabay.com\/ko\/%EA%B3%B5%EC%9B%90-%EB%82%98%EB%AC%B4-%EB%85%B9%EC%83%89-90476\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/5\/10825\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:45:57Z","timestamp":1760215557000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/5\/10825"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,5,7]]},"references-count":41,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2015,5]]}},"alternative-id":["s150510825"],"URL":"https:\/\/doi.org\/10.3390\/s150510825","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2015,5,7]]}}}