{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T02:14:57Z","timestamp":1779934497783,"version":"3.53.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,2,16]],"date-time":"2022-02-16T00:00:00Z","timestamp":1644969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Institute of Engineering Sciences and Technology"},{"name":"GIK Institute graduate research fund"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2022,5,31]]},"abstract":"<jats:p>The modern computing applications are presently adapting to the convenient availability of huge and diverse data for making their pattern recognition methods smarter. Identification of dominant emotion solely based on the text data generated by humans is essential for the modern human\u2013computer interaction. This work presents a multimodal text-keystrokes dataset and associated learning methods for the identification of human emotions hidden in small text. For this, a text-keystrokes data of 69 participants is collected in multiple scenarios. Stimuli are induced through videos in a controlled environment. After the stimuli induction, participants write their reviews about the given scenario in an unguided manner. Afterward, keystroke and in-text features are extracted from the dataset. These are used with an assortment of learning methods to identify emotion hidden in the short text. An accuracy of 86.95% is achieved by fusing text and keystroke features. Whereas, 100% accuracy is obtained for pleasure-displeasure classes of emotions using the fusion of keystroke\/text features, tree-based feature selection method, and support vector machine classifier. The present work is also compared with four state-of-the-art techniques for the same task, where the results suggest that the present proposal performs better in terms of accuracy.<\/jats:p>","DOI":"10.1145\/3480968","type":"journal-article","created":{"date-parts":[[2022,2,16]],"date-time":"2022-02-16T17:56:32Z","timestamp":1645034192000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Non-Acted Text and Keystrokes Database and Learning Methods to Recognize Emotions"],"prefix":"10.1145","volume":"18","author":[{"given":"Madiha","family":"Tahir","sequence":"first","affiliation":[{"name":"Machine Intelligence Research Group (MInG), Faculty of Computer Science and Engineering, Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi, KP, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zahid","family":"Halim","sequence":"additional","affiliation":[{"name":"Machine Intelligence Research Group (MInG), Faculty of Computer Science and Engineering, Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi, KP, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atta Ur","family":"Rahman","sequence":"additional","affiliation":[{"name":"Machine Intelligence Research Group (MInG), Faculty of Computer Science and Engineering, Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi, KP, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad","family":"Waqas","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Trusted Computing, Faculty of Information Technology, Beijing University of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shanshan","family":"Tu","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Electronics and Computer Science, University of Southampton, Southampton, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhu","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Houston, Houston, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,2,16]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.06.016"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.10.001"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0023683"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.10.009"},{"key":"e_1_3_1_6_2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1002\/0470013494.ch3","article-title":"Basic emotions","author":"Ekman P.","year":"1999","unstructured":"P. Ekman. 1999. Basic emotions. Handbook of Cognition and Emotion. John Wiley & Sons, USA, 45\u201360.","journal-title":"Handbook of Cognition and Emotion"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.3233\/SW-170270"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1511\/2001.4.344"},{"key":"e_1_3_1_9_2","volume-title":"Shame and Pride: Affect, Sex, and the Birth of the Self","author":"Nathanson Donald L.","year":"1992","unstructured":"Donald L. Nathanson. 1992. Shame and Pride: Affect, Sex, and the Birth of the Self. W.W. Norton, New York."},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.03.007"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.12.006"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(03)00099-2"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/NSysS.2017.7885808"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2854966"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.15"},{"key":"e_1_3_1_16_2","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Gu Y.","year":"2018","unstructured":"Y. Gu, S. Chen, and I. Marsic. 2018. Deep multimodal learning for emotion recognition in spoken language. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing."},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2553038"},{"key":"e_1_3_1_18_2","unstructured":"Emotions at Work: Theory Research and Applications for Management"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.38.11.1145"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1093\/scan\/nsw153"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-008-9076-6"},{"key":"e_1_3_1_22_2","unstructured":"S. Tripathi and H. Beigi. 2018. Multi-modal emotion recognition on IEMOCAP dataset using deep learning. Retrieved from https:\/\/arxiv.org\/abs\/1804.05788."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-1104"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2018.09.002"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.10.096"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.2012.00454.x"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics8020164"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1348\/014466507X173736"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/INNOVATIONS.2015.7381514"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.04.131"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICARCV.2018.8581248"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.4236\/jss.2016.49002"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106443"},{"key":"e_1_3_1_34_2","first-page":"2901--2909","article-title":"Time-frequency representation and convolutional neural network-based emotion recognition","author":"Khare S. K.","year":"2020","unstructured":"S. K. Khare, and V. Bajaj. 2020. Time-frequency representation and convolutional neural network-based emotion recognition. IEEE Transactions on Neural Networks and Learning Systems, 32, 7 (2020), 2901--2909.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2013.2247824"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2019.2954667"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDEW.2006.145"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2005-446"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979046"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2014.907343"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2017.8273592"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/HSI.2015.7170682"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.15439\/2016F263"},{"key":"e_1_3_1_44_2","first-page":"1","article-title":"Design for emotion detection of punjabi text using hybrid approach","volume":"2","author":"Grover S.","year":"2016","unstructured":"S. Grover and A. Verma. 2016. Design for emotion detection of punjabi text using hybrid approach. In Proceedings of the International Conference on Inventive Computation Technologies, Vol. 2, 1\u20136.","journal-title":"Proceedings of the International Conference on Inventive Computation Technologies"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2010.2052026"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-008-9076-6"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1080\/02699930801993999"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2017.2788081"},{"issue":"7","key":"e_1_3_1_49_2","first-page":"3281","article-title":"Multisource transfer learning for cross-subject EEG emotion recognition","volume":"50","author":"Li J.","year":"2019","unstructured":"J. Li, S. Qiu, Y. Y. Shen, C. L. Liu, and H. He. 2019. Multisource transfer learning for cross-subject EEG emotion recognition.\" IEEE Transactions on Cybernetics 50, 7 (2019), 3281\u20133293.","journal-title":"IEEE Transactions on Cybernetics"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2018.2797176"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2020.3036935"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.3390\/app10113754"},{"key":"e_1_3_1_53_2","first-page":"7294","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Nguyen C.","year":"2020","unstructured":"C. Nguyen, T. Hassner, M. Seeger, and C. Archambeau. 2020. Leep: A new measure to evaluate transferability of learned representations. In Proceedings of the International Conference on Machine Learning. 7294\u20137305, PMLR."},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.3390\/cancers13071590"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2019.2892791"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413506"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3480968","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3480968","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:23Z","timestamp":1750191503000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3480968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,16]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,5,31]]}},"alternative-id":["10.1145\/3480968"],"URL":"https:\/\/doi.org\/10.1145\/3480968","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,16]]},"assertion":[{"value":"2021-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}