{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T12:25:52Z","timestamp":1783427152422,"version":"3.54.6"},"reference-count":96,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2018,5,18]],"date-time":"2018-05-18T00:00:00Z","timestamp":1526601600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"an Institute for Information &amp; Communications Technology Promotion (IITP) grant funded by the Korean government (MSIT)","award":["2017-0-00655"],"award-info":[{"award-number":["2017-0-00655"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The user experience (UX) is an emerging field in user research and design, and the development of UX evaluation methods presents a challenge for both researchers and practitioners. Different UX evaluation methods have been developed to extract accurate UX data. Among UX evaluation methods, the mixed-method approach of triangulation has gained importance. It provides more accurate and precise information about the user while interacting with the product. However, this approach requires skilled UX researchers and developers to integrate multiple devices, synchronize them, analyze the data, and ultimately produce an informed decision. In this paper, a method and system for measuring the overall UX over time using a triangulation method are proposed. The proposed platform incorporates observational and physiological measurements in addition to traditional ones. The platform reduces the subjective bias and validates the user\u2019s perceptions, which are measured by different sensors through objectification of the subjective nature of the user in the UX assessment. The platform additionally offers plug-and-play support for different devices and powerful analytics for obtaining insight on the UX in terms of multiple participants.<\/jats:p>","DOI":"10.3390\/s18051622","type":"journal-article","created":{"date-parts":[[2018,5,21]],"date-time":"2018-05-21T04:07:30Z","timestamp":1526875650000},"page":"1622","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["A Multimodal Deep Log-Based User Experience (UX) Platform for UX Evaluation"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3862-8787","authenticated-orcid":false,"given":"Jamil","family":"Hussain","sequence":"first","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wajahat Ali","family":"Khan","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taeho","family":"Hur","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hafiz Syed Muhammad","family":"Bilal","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3675-2258","authenticated-orcid":false,"given":"Jaehun","family":"Bang","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anees Ul","family":"Hassan","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7851-2327","authenticated-orcid":false,"given":"Muhammad","family":"Afzal","sequence":"additional","affiliation":[{"name":"Department of Software, College of Electronics and Information Engineering, Sejong University, Seoul 05006, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sungyoung","family":"Lee","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Lab, Department of Computer Science and Engineering, Kyung Hee University, Giheung-gu, Yongin-si, Gyeonggi-do, Seoul 446-701, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,5,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1080\/01449290500330331","article-title":"User experience\u2014A research agenda","volume":"25","author":"Hassenzahl","year":"2006","journal-title":"Behav. Inf. Technol."},{"key":"ref_2","unstructured":"Liang, Y., Liu, Y., and Loh, H.T. (2013). Exploring Online Reviews for User Experience Modeling. DS 75\u20137: Proceedings of the 19th International Conference on Engineering Design (ICED13), Design for Harmonies, Vol. 7: Human Behaviour in Design, Seoul, Korea, 19\u201322.08. 2013, Sungkyunkwan University."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kula, I., Atkinson, R.K., Branaghan, R.J., and Roscoe, R.D. (2017). Assessing User Experience via Biometric Sensor Affect Detection. End-User Considerations in Educational Technology Design, IGI Global.","DOI":"10.4018\/978-1-5225-2639-1.ch006"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Law, E.L.-C., and van Schaik, P. (2010). Modelling User Experience\u2013An Agenda for Research and Practice, Oxford University Press.","DOI":"10.1016\/j.intcom.2010.04.006"},{"key":"ref_5","first-page":"6","article-title":"User experience white paper. Bringing clarity to the concept of user experience. Result from Dagstuhl Seminar on Demarcating User Experience, September 15\u201318 (2010)","volume":"22","author":"Roto","year":"2011","journal-title":"Disponible en ligne le"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Laugwitz, B., Held, T., and Schrepp, M. (2008). Construction and Evaluation of a User Experience Questionnaire. Symposium of the Austrian HCI and Usability Engineering Group, Springer.","DOI":"10.1007\/978-3-540-89350-9_6"},{"key":"ref_7","unstructured":"All About, U.X. (2007, March 29). Available online: http:\/\/www.allaboutux.org\/all-methods."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1146\/annurev.psych.54.101601.145030","article-title":"Diary methods: Capturing life as it is lived","volume":"54","author":"Bolger","year":"2003","journal-title":"Annu. Rev. Psychol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Karapanos, E., Zimmerman, J., Forlizzi, J., and Martens, J.-B. (2009, January 4\u20139). User Experience over Time: An Initial Framework. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518814"},{"key":"ref_10","unstructured":"Fallman, D., and Waterworth, J. (2005, January 2\u20137). Dealing with User Experience and Affective Evaluation in HCI Design: A Repertory Grid Approach. Proceedings of the Conference on Human Factors in Computing Systems, Portland, OR, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Scollon, C.N., Prieto, C.-K., and Diener, E. (2009). Experience Sampling: Promises and Pitfalls, Strength and Weaknesses. Assessing Well-Being, Springer.","DOI":"10.1007\/978-90-481-2354-4_8"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vermeeren, A.P., Law, E.L.-C., Roto, V., Obrist, M., Hoonhout, J., and V\u00e4\u00e4n\u00e4nen-Vainio-Mattila, K. (2010, January 16\u201320). User Experience Evaluation Methods: Current State and Development Needs. Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, Reykjavik, Iceland.","DOI":"10.1145\/1868914.1868973"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Schubert, E. (2001). Continuous Measurement of Self-Report Emotional Response to Music, Oxford University Press.","DOI":"10.1093\/oso\/9780192631886.003.0017"},{"key":"ref_14","first-page":"195","article-title":"A Proposal of collecting Emotions and Experiences","volume":"2","author":"Arhippainen","year":"2004","journal-title":"Interact. Exp. HCI"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1037\/0022-3514.57.3.493","article-title":"Affect grid: A single-item scale of pleasure and arousal","volume":"57","author":"Russel","year":"1989","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1037\/1076-898X.11.4.237","article-title":"Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting","volume":"11","author":"Paas","year":"2005","journal-title":"J. Exp. Psychol. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/TPC.2013.2274110","article-title":"Observing the User Experience: A Practitioner\u2019s Guide to User Research","volume":"56","author":"Goodman","year":"2013","journal-title":"IEEE Trans. Prof. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kuniavsky, M. (2003). Observing the User Experience: A Practitioner\u2019s Guide to User Research, Morgan Kaufmann.","DOI":"10.1016\/B978-155860923-5\/50031-0"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"23","DOI":"10.3233\/SW-140163","article-title":"Eye tracking the user experience\u2013An evaluation of ontology visualization techniques","volume":"8","author":"Fu","year":"2017","journal-title":"Semant. Web J."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Qu, Q.-X., Zhang, L., Chao, W.-Y., and Duffy, V. (2017). User Experience Design Based on Eye-Tracking Technology: A Case Study on Smartphone APPs. Advances in Applied Digital Human Modeling and Simulation, Springer.","DOI":"10.1007\/978-3-319-41627-4_27"},{"key":"ref_21","unstructured":"Bojko, A. (2013). Eye Tracking the User Experience: A Practical Guide to Research, Rosenfeld Media."},{"key":"ref_22","unstructured":"Zheng, W.-L., Zhu, J.-Y., and Lu, B.-L. (2017). Identifying stable patterns over time for emotion recognition from EEG. IEEE Trans. Affect. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"07006","DOI":"10.1051\/itmconf\/20171107006","article-title":"Channel Division Based Multiple Classifiers Fusion for Emotion Recognition Using EEG signals","volume":"Volume 11","author":"Li","year":"2017","journal-title":"ITM Web of Conferences"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., and Shi, Y. (2017). Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Trans. Affect. Comput.","DOI":"10.1109\/TAFFC.2017.2660485"},{"key":"ref_25","unstructured":"Mundell, C., Vielma, J.P., and Zaman, T. (arXiv, 2016). Predicting Performance Under Stressful Conditions Using Galvanic Skin Response, arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1145\/2960413","article-title":"Detecting Users\u2019 Cognitive Load by Galvanic Skin Response with Affective Interference","volume":"7","author":"Nourbakhsh","year":"2017","journal-title":"ACM Trans. Interact. Intell. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/MCE.2016.2590178","article-title":"A survey of affective computing for stress detection: Evaluating technologies in stress detection for better health","volume":"5","author":"Greene","year":"2016","journal-title":"IEEE Consum. Electron. Mag."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Basu, S., Bag, A., Aftabuddin, M., Mahadevappa, M., Mukherjee, J., and Guha, R. (2016, January 16\u201318). Effects of Emotion on Physiological Signals. Proceedings of the 2016 IEEE Annual India Conference (INDICON), Bangalore, India.","DOI":"10.1109\/INDICON.2016.7839091"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1080\/00049539908255353","article-title":"Measuring emotion continuously: Validity and reliability of the two-dimensional emotion-space","volume":"51","author":"Schubert","year":"1999","journal-title":"Aust. J. Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Izard, C.E. (1993). The Differential Emotions Scale: DES IV-A; [A Method of Measuring the Meaning of Subjective Experience of Discrete Emotions], University of Delaware.","DOI":"10.1037\/t06000-000"},{"key":"ref_31","unstructured":"Sacharin, V., Schlegel, K., and Scherer, K.R. (2017, March 29). Geneva Emotion Wheel Rating Study. Available online: https:\/\/archive-ouverte.unige.ch\/unige:97849."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Desmet, P. (2003). Measuring emotion: Development and Application of an Instrument to Measure Emotional Responses to Products. Funology, Springer.","DOI":"10.1007\/1-4020-2967-5_12"},{"key":"ref_33","unstructured":"Laurans, G., Desmet, P.M.A., Karlsson, M.A., and van Erp, J. (2006). Using Self-Confrontation to Study User Experience: A New Approach to the Dynamic Measurement of Emotions while Interacting with Products. Design & Emotion, Chalmers University of Technology."},{"key":"ref_34","first-page":"32","article-title":"Designing products with added emotional value: Development and appllcation of an approach for research through design","volume":"4","author":"Desmet","year":"2001","journal-title":"Des. J."},{"key":"ref_35","unstructured":"Hassenzahl, M., Burmester, M., and Koller, F. (2003). AttrakDiff: A Questionnaire to Measure Perceived Hedonic and Pragmatic Quality. Mensch & Computer, Springer."},{"key":"ref_36","unstructured":"Norman, K.L., Shneiderman, B., Harper, B., and Slaughter, L. (1998). Questionnaire for User Interaction Satisfaction, University of Maryland."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1111\/j.1467-8535.1993.tb00076.x","article-title":"SUMI: The software usability measurement inventory","volume":"24","author":"Kirakowski","year":"1993","journal-title":"Br. J. Educ. Technol."},{"key":"ref_38","first-page":"4","article-title":"SUS-A quick and dirty usability scale","volume":"189","author":"Brooke","year":"1996","journal-title":"Usability Eval. Ind."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.ijhcs.2003.09.002","article-title":"Assessing dimensions of perceived visual aesthetics of web sites","volume":"60","author":"Lavie","year":"2004","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1177\/001872089303500412","article-title":"The efficiency of instructional conditions: An approach to combine mental effort and performance measures","volume":"35","author":"Paas","year":"1993","journal-title":"Hum. Factors"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Siddiqi, M.H., Alam, M.G.R., Hong, C.S., Khan, A.M., and Choo, H. (2016). A Novel Maximum Entropy Markov Model for Human Facial Expression Recognition. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0162702"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1016\/j.patcog.2010.09.020","article-title":"Survey on speech emotion recognition: Features, classification schemes, and databases","volume":"44","author":"Kamel","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1016\/j.tourman.2010.03.015","article-title":"Google Analytics for measuring website performance","volume":"32","author":"Plaza","year":"2011","journal-title":"Tour. Manag."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Scherr, S.A., Elberzhager, F., and Holl, K. (September, January 30). An Automated Feedback-Based Approach to Support Mobile App Development. Proceedings of the 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Vienna, Austria.","DOI":"10.1109\/SEAA.2017.45"},{"key":"ref_45","unstructured":"Den Uyl, M.J., and Van Kuilenburg, H. (September, January 30). The FaceReader: Online Facial Expression Recognition. Proceedings of Measuring Behavior 2005, 5th Internaltional Conference on Methods and Techniques in Behavioral Research, Wageningen, The Netherlands."},{"key":"ref_46","unstructured":"Zaman, B., and Shrimpton-Smith, T. The FaceReader: Measuring Instant Fun of Use. Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles, Oslo, Norway."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Whitehill, J., Bartlett, M., and Movellan, J. (2008, January 23\u201328). Automatic Facial Expression Recognition for Intelligent Tutoring Systems. Proceedings of the 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA.","DOI":"10.1109\/CVPRW.2008.4563182"},{"key":"ref_48","unstructured":"Noroozi, F., Marjanovic, M., Njegus, A., Escalera, S., and Anbarjafari, G. (2017). Audio-visual emotion recognition in video clips. IEEE Trans. Affect. Comput."},{"key":"ref_49","unstructured":"Clifton, B. (2012). Advanced Web Metrics with Google Analytics, John Wiley & Sons."},{"key":"ref_50","unstructured":"Miller, S.A. (2012). Piwik Web Analytics Essentials, Packt Publishing Ltd."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Liu, X., Zhu, S., Wang, W., and Liu, J. (2016). Alde: Privacy Risk Analysis of Analytics Libraries in the Android Ecosystem. International Conference on Security and Privacy in Communication Systems, Springer.","DOI":"10.1007\/978-3-319-59608-2_36"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Alepuz, I., Cabrejas, J., Monserrat, J.F., Perez, A.G., Pajares, G., and Gimenez, R. (2017, January 21\u201323). Use of Mobile Network Analytics for Application Performance Design. Proceedings of the 2007 Network Traffic Measurement and Analysis Conference (TMA), Dublin, Ireland.","DOI":"10.23919\/TMA.2017.8002919"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1177\/1073191116635807","article-title":"A primer on observational measurement","volume":"23","author":"Girard","year":"2016","journal-title":"Assessment"},{"key":"ref_54","unstructured":"Zheng, W.-L., Dong, B.-N., and Lu, B.-L. (2014, January 26\u201330). Multimodal Emotion Recognition Using EEG and Eye Tracking Data. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Chicago, IL, USA."},{"key":"ref_55","unstructured":"Bergstrom, J.R., and Schall, A. (2014). Eye Tracking in User Experience Design, Elsevier."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.chb.2017.02.035","article-title":"Diagnosing user perception and acceptance using eye tracking in web-based end-user development","volume":"72","author":"Tzafilkou","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.ress.2016.12.015","article-title":"A multi-sensor fusion framework for improving situational awareness in demanding maritime training","volume":"161","author":"Sanfilippo","year":"2017","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Sivaji, A., and Ahmad, W.F.W. (2014). Benefits of Complementing Eye-Tracking Analysis with Think-Aloud Protocol in a Multilingual Country with High Power Distance. Current Trends in Eye Tracking Research, Springer.","DOI":"10.1007\/978-3-319-02868-2_21"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/j.1469-8986.1993.tb03354.x","article-title":"The psychophysiology of disgust: Differentiating negative emotional contexts with facial EMG","volume":"30","author":"Vrana","year":"1993","journal-title":"Psychophysiology"},{"key":"ref_60","unstructured":"Bacic, D. (2018, May 15). Understanding Business Dashboard Design User Impact: Triangulation Approach Using Eye-Tracking, Facial Expression, Galvanic Skin Response and EEG Sensors. Available online: http:\/\/aisel.aisnet.org\/amcis2017\/HumanCI\/Presentations\/21\/."},{"key":"ref_61","unstructured":"Klein, L. (2013). UX for Lean Startups: Faster, Smarter User Experience Research and Design, O\u2019Reilly Media, Inc."},{"key":"ref_62","unstructured":"Meneweger, T., Wurhofer, D., Obrist, M., Beck, E., and Tscheligi, M. (May, January 26). Characteristics of Narrative Textual Data Linked to User Experiences. Proceedings of the CHI\u201914 Extended Abstracts on Human Factors in Computing Systems, Toronto, ON, Canada."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1186\/s12938-016-0179-9","article-title":"The Mining Minds digital health and wellness framework","volume":"15","author":"Banos","year":"2016","journal-title":"Biomed. Eng. Online"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Amin, M.B., Banos, O., Khan, W.A., Muhammad Bilal, H.S., Gong, J., Bui, D.-M., Cho, S.H., Hussain, S., Ali, T., and Akhtar, U. (2016). On curating multimodal sensory data for health and wellness platforms. Sensors, 16.","DOI":"10.3390\/s16070980"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1016\/j.cie.2016.05.023","article-title":"UNISON framework of data-driven innovation for extracting user experience of product design of wearable devices","volume":"99","author":"Lin","year":"2016","journal-title":"Comput. Ind. Eng."},{"key":"ref_66","unstructured":"(2017, March 29). Node.js. Available online: https:\/\/nodejs.org\/en\/."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Hussain, J., Khan, W.A., Afzal, M., Hussain, M., Kang, B.H., and Lee, S. (2014). Adaptive User Interface and User Experience Based Authoring Tool for Recommendation Systems. International Conference on Ubiquitous Computing and Ambient Intelligence, Springer.","DOI":"10.1007\/978-3-319-13102-3_24"},{"key":"ref_68","unstructured":"Hussain, J., and Lee, S. (2018, May 15). Identifying User Experience (UX) Dimensions from UX Literature Reviews. Available online: http:\/\/www.riss.kr\/search\/detail\/DetailView.do?p_mat_type=1a0202e37d52c72d&control_no=f631e21b1c0c2bd1b36097776a77e665."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12193-018-0258-2","article-title":"Model-based adaptive user interface based on context and user experience evaluation","volume":"12","author":"Hussain","year":"2018","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_70","unstructured":"Albert, W., and Tullis, T. (2013). Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics, Newnes."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Banos, O., Villalonga, C., Bang, J., Hur, T., Kang, D., Park, S., Le-Ba, V., Amin, M.B., Razzaq, M.A., and Khan, W.A. (2016). Human Behavior Analysis by Means of Multimodal Context Mining. Sensors, 16.","DOI":"10.3390\/s16081264"},{"key":"ref_72","unstructured":"Ververidis, D., and Kotropoulos, C. (2018, May 15). A State of the Art Review on Emotional Speech Databases. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.420.6988&rep=rep1&type=pdf."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"McKeown, G., Valstar, M.F., Cowie, R., and Pantic, M. (2010, January 19\u201323). The SEMAINE Corpus of Emotionally Coloured Character Interactions. Proceedings of the 2010 IEEE International Conference on Multimedia and Expo (ICME), Suntec City, Singapore.","DOI":"10.1109\/ICME.2010.5583006"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Yang, X., Tan, B., Ding, J., Zhang, J., and Gong, J. (2010, January 25\u201327). Comparative Study on Voice Activity Detection Algorithm. Proceedings of the 2010 International Conference on Electrical and Control Engineering (ICECE), Wuhan, China.","DOI":"10.1109\/iCECE.2010.153"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"5858","DOI":"10.1016\/j.eswa.2014.03.026","article-title":"A new approach of audio emotion recognition","volume":"41","author":"Ooi","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TPAMI.2008.52","article-title":"A survey of affect recognition methods: Audio, visual, and spontaneous expressions","volume":"31","author":"Zeng","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_77","first-page":"43","article-title":"A review and meta-analysis of multimodal affect detection systems","volume":"47","author":"Kory","year":"2015","journal-title":"ACM Comput. Surv. CSUR"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Patwardhan, A.S. (2010, January 19\u201323). Multimodal Mixed Emotion Detection. Proceedings of the 2017 2nd International Conference on Communication and Electronics Systems (ICCES), Suntec City, Singapore.","DOI":"10.1109\/CESYS.2017.8321250"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.neucom.2015.01.095","article-title":"Fusing audio, visual and textual clues for sentiment analysis from multimodal content","volume":"174","author":"Poria","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MIS.2013.34","article-title":"Youtube movie reviews: Sentiment analysis in an audio-visual context","volume":"28","author":"Weninger","year":"2013","journal-title":"IEEE Intell. Syst."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/s11042-009-0344-2","article-title":"Multimodal information fusion application to human emotion recognition from face and speech","volume":"49","author":"Mansoorizadeh","year":"2010","journal-title":"Multimed. Tools Appl."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Sarkar, C., Bhatia, S., Agarwal, A., and Li, J. (2014, January 7). Feature Analysis for Computational Personality Recognition Using Youtube Personality Data Set. Proceedings of the 2014 ACM Multi Media on Workshop on Computational Personality Recognition, Orlando, FL, USA.","DOI":"10.1145\/2659522.2659528"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.neunet.2014.10.005","article-title":"Towards an intelligent framework for multimodal affective data analysis","volume":"63","author":"Poria","year":"2015","journal-title":"Neural Netw."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1007\/s11042-013-1450-8","article-title":"Hybrid video emotional tagging using users\u2019 EEG and video content","volume":"72","author":"Wang","year":"2014","journal-title":"Multimed. Tools Appl."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"53","DOI":"10.5772\/54002","article-title":"Towards efficient multi-modal emotion recognition","volume":"10","year":"2013","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"602","DOI":"10.2307\/2392366","article-title":"Mixing qualitative and quantitative methods: Triangulation in action","volume":"24","author":"Jick","year":"1979","journal-title":"Adm. Sci. Q."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.compbiomed.2015.11.013","article-title":"Multimodal hybrid reasoning methodology for personalized wellbeing services","volume":"69","author":"Ali","year":"2016","journal-title":"Comput. Biol. Med."},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Sauro, J., and Dumas, J.S. (2009, January 4\u20139). Comparison of Three One-Question, Post-Task Usability Questionnaires. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518946"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.eswa.2017.01.009","article-title":"Ordinal-based and frequency-based integration of feature selection methods for sentiment analysis","volume":"75","author":"Yousefpour","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1016\/j.ins.2010.11.023","article-title":"Ensemble of feature sets and classification algorithms for sentiment classification","volume":"181","author":"Xia","year":"2011","journal-title":"Inf. Sci."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Taylor, A., Marcus, M., and Santorini, B. (2003). The Penn Treebank: An Overview. Treebanks, Springer.","DOI":"10.1007\/978-94-010-0201-1_1"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The Extended Cohn-Kanade Dataset (ck+): A Complete Dataset for Action Unit and Emotion-Specified Expression. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_93","unstructured":"Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J., and Budynek, J. (1998, January 14\u201316). The Japanese Female Facial Expression (JAFFE) Database. Proceedings of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1037\/a0017844","article-title":"Can Duchenne smiles be feigned? New evidence on felt and false smiles","volume":"9","author":"Krumhuber","year":"2009","journal-title":"Emotion"},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1109\/TPAMI.2005.92","article-title":"Acquiring linear subspaces for face recognition under variable lighting","volume":"27","author":"Lee","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_96","unstructured":"Thomaz, C.E. (2012, October 02). FEI Face Database. Available online: http:\/\/fei.edu.br\/~cetfacedatabase.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1622\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:04:59Z","timestamp":1760195099000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1622"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,18]]},"references-count":96,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,5]]}},"alternative-id":["s18051622"],"URL":"https:\/\/doi.org\/10.3390\/s18051622","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,18]]}}}