{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T20:29:23Z","timestamp":1775939363279,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2018,6,11]],"date-time":"2018-06-11T00:00:00Z","timestamp":1528675200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Machine learning approaches for human emotion recognition have recently demonstrated high performance. However, only\/mostly for subject-dependent approaches, in a variety of applications like advanced driver assisted systems, smart homes and medical environments. Therefore, now the focus is shifted more towards subject-independent approaches, which are more universal and where the emotion recognition system is trained using a specific group of subjects and then tested on totally new persons and thereby possibly while using other sensors of same physiological signals in order to recognize their emotions. In this paper, we explore a novel robust subject-independent human emotion recognition system, which consists of two major models. The first one is an automatic feature calibration model and the second one is a classification model based on Cellular Neural Networks (CNN). The proposed system produces state-of-the-art results with an accuracy rate between 80% and 89% when using the same elicitation materials and physiological sensors brands for both training and testing and an accuracy rate of 71.05% when the elicitation materials and physiological sensors brands used in training are different from those used in training. Here, the following physiological signals are involved: ECG (Electrocardiogram), EDA (Electrodermal activity) and ST (Skin-Temperature).<\/jats:p>","DOI":"10.3390\/s18061905","type":"journal-article","created":{"date-parts":[[2018,6,11]],"date-time":"2018-06-11T11:01:01Z","timestamp":1528714861000},"page":"1905","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["A Globally Generalized Emotion Recognition System Involving Different Physiological Signals"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7941-5900","authenticated-orcid":false,"given":"Mouhannad","family":"Ali","sequence":"first","affiliation":[{"name":"Department of Smart Systems Technologies, Alpen-Adira University, Klagenfurt 9020, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1239-9261","authenticated-orcid":false,"given":"Fadi","family":"Al Machot","sequence":"additional","affiliation":[{"name":"Research Center Borstel\u2014Leibniz Center for Medicine and Biosciences, Borstel 23845, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmad","family":"Haj Mosa","sequence":"additional","affiliation":[{"name":"Department of Smart Systems Technologies, Alpen-Adira University, Klagenfurt 9020, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Midhat","family":"Jdeed","sequence":"additional","affiliation":[{"name":"Department of Smart Systems Technologies, Alpen-Adira University, Klagenfurt 9020, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elyan","family":"Al Machot","sequence":"additional","affiliation":[{"name":"Carl Gustav Carus Faculty of Medicine, Dresden University of Technology, Dresden 01069, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kyandoghere","family":"Kyamakya","sequence":"additional","affiliation":[{"name":"Department of Smart Systems Technologies, Alpen-Adira University, Klagenfurt 9020, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,11]]},"reference":[{"key":"ref_1","unstructured":"Burns, P., and Lansdown, T. (August, January 5). E-distraction: The challenges for safe and usable internet services in vehicles. Proceedings of the Internet Forum on the Safety Impact of Driver Distraction When Using In-Vehicle Technologies, Washington, DC, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1109\/TIM.2016.2640458","article-title":"A Driver State Detection System-Combining a Capacitive Hand Detection Sensor With Physiological Sensors","volume":"66","author":"Mosa","year":"2017","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ali, M., Mosa, A.H., Al Machot, F., and Kyamakya, K. (2016, January 5\u20138). EEG-based emotion recognition approach for e-healthcare applications. Proceedings of the 2016 Eighth International Conference on IEEE Ubiquitous and Future Networks (ICUFN), Vienna, Austria.","DOI":"10.1109\/ICUFN.2016.7536936"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5334\/pb-46-1-2-99","article-title":"Psychopathy and physiological detection of concealed information: A review","volume":"46","author":"Verschuere","year":"2006","journal-title":"Psychol. Belg."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1080\/01449290500331156","article-title":"Using psychophysiological techniques to measure user experience with entertainment technologies","volume":"25","author":"Mandryk","year":"2006","journal-title":"Behav. Inf. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/79.911197","article-title":"Emotion recognition in human-computer interaction","volume":"18","author":"Cowie","year":"2001","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Al Machot, F., Mosa, A.H., Fasih, A., Schwarzlm\u00fcller, C., Ali, M., and Kyamakya, K. (2012). A novel real-time emotion detection system for advanced driver assistance systems. Autonomous Systems: Developments and Trends, Springer.","DOI":"10.1007\/978-3-642-24806-1_21"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1109\/TSMCA.2008.918624","article-title":"Toward emotion recognition in car-racing drivers: A biosignal processing approach","volume":"38","author":"Katsis","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kim, J. (2007). Bimodal Emotion Recognition Using Speech and Physiological Changes, INTECH Open Access Publisher. Robust Speech Recognition and Understanding.","DOI":"10.5772\/4754"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Essa, I.A., and Pentland, A. (1994, January 21\u201323). A vision system for observing and extracting facial action parameters. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA. CVPR\u201994.","DOI":"10.1109\/CVPR.1994.323813"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2067","DOI":"10.1109\/TPAMI.2008.26","article-title":"Emotion recognition based on physiological changes in music listening","volume":"30","author":"Kim","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","unstructured":"Wen, W.-H., Qiu, Y.-H., and Liu, G.-Y. (April, January 31). Electrocardiography recording, feature extraction and classification for emotion recognition. Proceedings of the 2009 WRI World Congress on Computer Science and Information Engineering, Los Angeles, CA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ali, M., Al Machot, F., Mosa, A.H., and Kyamakya, K. (2016). CNN Based Subject-Independent Driver Emotion Recognition System Involving Physiological Signals for ADAS. Advanced Microsystems for Automotive Applications 2016, Springer.","DOI":"10.1007\/978-3-319-44766-7_11"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"929414","DOI":"10.1155\/S1110865704406192","article-title":"Using noninvasive wearable computers to recognize human emotions from physiological signals","volume":"2004","author":"Lisetti","year":"2004","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1146\/annurev.so.15.080189.001533","article-title":"The sociology of emotions","volume":"15","author":"Thoits","year":"1989","journal-title":"Annu. Rev. Sociol."},{"key":"ref_16","first-page":"4","article-title":"Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion","volume":"5","author":"Krause","year":"1987","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1037\/0003-066X.50.5.372","article-title":"The emotion probe: Studies of motivation and attention","volume":"50","author":"Lang","year":"1995","journal-title":"Am. Psychol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Haag, A., Goronzy, S., Schaich, P., and Williams, J. (2004). Emotion Recognition Using Bio-Sensors: First Steps towards an Automatic System. Tutorial and Research Workshop on Affective Dialogue Systems, Springer.","DOI":"10.1007\/978-3-540-24842-2_4"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Maaoui, C., and Pruski, A. (2010). Emotion Recognition through Physiological Signals for Human-Machine Communication, INTECH Open Access Publisher.","DOI":"10.5772\/10312"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4857","DOI":"10.1109\/TIE.2010.2103538","article-title":"A stress-detection system based on physiological signals and fuzzy logic","volume":"58","author":"Casanova","year":"2011","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1109\/TRO.2007.904899","article-title":"Affective state estimation for human\u2013robot interaction","volume":"23","author":"Kulic","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/TAFFC.2014.2327617","article-title":"Emotion recognition based on multi-variant correlation of physiological signals","volume":"5","author":"Wen","year":"2014","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TBME.2010.2048568","article-title":"EEG-based emotion recognition in music listening","volume":"57","author":"Lin","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Coan, J.A., and Allen, J.J. (2007). Handbook of Emotion Elicitation and Assessment, Oxford University Press.","DOI":"10.1093\/oso\/9780195169157.001.0001"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","article-title":"Deap: A database for emotion analysis; using physiological signals","volume":"3","author":"Koelstra","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A multimodal database for affect recognition and implicit tagging","volume":"3","author":"Soleymani","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MIC.2003.1167344","article-title":"Amazon. com recommendations: Item-to-item collaborative filtering","volume":"7","author":"Linden","year":"2003","journal-title":"IEEE Internet Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/BF00332914","article-title":"Accelerating the convergence of the back-propagation method","volume":"59","author":"Vogl","year":"1988","journal-title":"Biol. Cybern."},{"key":"ref_29","unstructured":"Jaeger, H. (2001). The \u201cEcho State\u201d Approach to Analysing and Training Recurrent Neural Networks-With an Erratum Note, German National Research Center for Information Technology. GMD Technical Report."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Boucsein, W. (2012). Electrodermal Activity, Springer Science & Business Media.","DOI":"10.1007\/978-1-4614-1126-0"},{"key":"ref_31","unstructured":"Wristband, E.E. (2017, January 06). EDA Sensor. Available online: https:\/\/www.empatica.com\/e4-wristband."},{"key":"ref_32","unstructured":"Silverthorn, D.U., Ober, W.C., Garrison, C.W., Silverthorn, A.C., and Johnson, B.R. (2009). Human Physiology: An Integrated Approach, Pearson\/Benjamin Cummings."},{"key":"ref_33","unstructured":"BioRadio (2017, January 06). ECG Sensor. Available online: https:\/\/glneurotech.com\/bioradio\/."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/0005-7916(94)90063-9","article-title":"Measuring emotion: The self-assessment manikin and the semantic differential","volume":"25","author":"Bradley","year":"1994","journal-title":"J. Behav. Ther. Exp. Psychiatry"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1080\/02699930903274322","article-title":"Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchers","volume":"24","author":"Schaefer","year":"2010","journal-title":"Cognit. Emot."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Coan, J.A., and Allen, J.J.B. (2007). Emotion elicitation using films. Handbook of Emotion Elicitation and Assessment, Oxford University Press.","DOI":"10.1093\/oso\/9780195169157.001.0001"},{"key":"ref_37","first-page":"647","article-title":"Decomposition of skin conductance data by means of nonnegative deconvolution","volume":"47","author":"Benedek","year":"2010","journal-title":"Psychophysiology"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.cmpb.2013.07.024","article-title":"Kubios HRV\u2013heart rate variability analysis software","volume":"113","author":"Tarvainen","year":"2014","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_39","first-page":"100","article-title":"Algorithm AS 136: A k-means clustering algorithm","volume":"28","author":"Hartigan","year":"1979","journal-title":"J. R. Stat. Soc. Ser. C"},{"key":"ref_40","unstructured":"Arthur, D., and Vassilvitskii, S. (2007, January 7\u20139). k-means++: The advantages of careful seeding. Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, New Orleans, Louisiana."},{"key":"ref_41","first-page":"281","article-title":"Learning the k in k-means","volume":"3","author":"Hamerly","year":"2003","journal-title":"NIPS"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1002\/asi.10242","article-title":"Requirements for a cocitation similarity measure, with special reference to Pearson\u2019s correlation coefficient","volume":"54","author":"Ahlgren","year":"2003","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1109\/31.7601","article-title":"Cellular neural networks: Applications","volume":"35","author":"Chua","year":"1988","journal-title":"IEEE Trans. Circuits Syst."},{"key":"ref_44","unstructured":"(2015). MATLAB, The MathWorks Inc.. version (R2015b)."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kennedy, J. (2011). Particle swarm optimization. Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8_630"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Luko\u0161evi\u010dius, M. (2012). A practical guide to applying echo state networks. Neural Networks: Tricks of the Trade, Springer.","DOI":"10.1007\/978-3-642-35289-8_36"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1137\/0709012","article-title":"The numerical solution of Volterra functional differential equations by Euler\u2019s method","volume":"9","author":"Cryer","year":"1972","journal-title":"SIAM J. Numeri. Anal."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.1109\/TIM.2008.922074","article-title":"Dynamic compensation of nonlinear sensors by a learning-from-examples approach","volume":"57","author":"Marconato","year":"2008","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_49","first-page":"1277","article-title":"Bayesian quadratic discriminant analysis","volume":"8","author":"Srivastava","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1109\/T-C.1975.224297","article-title":"A branch and bound algorithm for computing k-nearest neighbors","volume":"100","author":"Fukunaga","year":"1975","journal-title":"IEEE Trans. Comput."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1109\/TNNLS.2012.2198074","article-title":"Toward automatic time-series forecasting using neural networks","volume":"23","author":"Yan","year":"2012","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"K\u00f6hler, R., and Metrology, F.C. (2009). The international vocabulary of metrology: Basic and general concepts and associated terms. Why? How?. Transverse Discip. Metrol., 233\u2013238.","DOI":"10.1002\/9780470611371.ch21"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/s10994-009-5119-5","article-title":"Measuring classifier performance: A coherent alternative to the area under the ROC curve","volume":"77","author":"Hand","year":"2009","journal-title":"Mach. Learn."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Al Machot, F., Ali, M., Mosa, A.H., Schwarzlm\u00fcller, C., Gutmann, M., and Kyamakya, K. (2016). Real-time raindrop detection based on cellular neural networks for ADAS. J. Real-Time Image Process.","DOI":"10.1007\/s11554-016-0569-z"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/TCSII.2006.886244","article-title":"Cellular neural networks with virtual template expansion for retinal vessel segmentation","volume":"54","author":"Perfetti","year":"2007","journal-title":"IEEE Trans. Circuits Syst. II Express Br."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/S0925-2312(99)00177-0","article-title":"Object recognition in image sequences with cellular neural networks","volume":"31","author":"Milanova","year":"2000","journal-title":"Neurocomputing"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1109\/JSSC.2010.2074350","article-title":"A 3.9 mW 25-electrode reconfigured sensor for wearable cardiac monitoring system","volume":"46","author":"Yan","year":"2011","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Yapici, M.K., and Alkhidir, T.E. (2017). Intelligent medical garments with graphene-functionalized smart-cloth ECG sensors. Sensors, 17.","DOI":"10.3390\/s17040875"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/6\/1905\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:08:14Z","timestamp":1760195294000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/6\/1905"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,11]]},"references-count":58,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["s18061905"],"URL":"https:\/\/doi.org\/10.3390\/s18061905","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,11]]}}}