{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:34:12Z","timestamp":1780054452323,"version":"3.54.0"},"reference-count":51,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,9,30]],"date-time":"2023-09-30T00:00:00Z","timestamp":1696032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council (NSERC) of Canada","doi-asserted-by":"publisher","award":["10007544"],"award-info":[{"award-number":["10007544"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council (NSERC) of Canada","doi-asserted-by":"publisher","award":["10022972"],"award-info":[{"award-number":["10022972"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council (NSERC) of Canada","doi-asserted-by":"publisher","award":["10027075"],"award-info":[{"award-number":["10027075"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The advent of Social Behavioral Biometrics (SBB) in the realm of person identification has underscored the importance of understanding unique patterns of social interactions and communication. This paper introduces a novel multimodal SBB system that integrates human micro-expressions from text, an emerging biometric trait, with other established SBB traits in order to enhance online user identification performance. Including human micro-expression, the proposed method extracts five other original SBB traits for a comprehensive representation of the social behavioral characteristics of an individual. Upon finding the independent person identification score by every SBB trait, a rank-level fusion that leverages the weighted Borda count is employed to fuse the scores from all the traits, obtaining the final identification score. The proposed method is evaluated on a benchmark dataset of 250 Twitter users, and the results indicate that the incorporation of human micro-expression with existing SBB traits can substantially boost the overall online user identification performance, with an accuracy of 73.87% and a recall score of 74%. Furthermore, the proposed method outperforms the state-of-the-art SBB systems.<\/jats:p>","DOI":"10.3390\/s23198197","type":"journal-article","created":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T04:39:30Z","timestamp":1696221570000},"page":"8197","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Human Micro-Expressions in Multimodal Social Behavioral Biometrics"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7357-5831","authenticated-orcid":false,"given":"Zaman","family":"Wahid","sequence":"first","affiliation":[{"name":"Biometric Technologies Laboratory, Department of Computer Science, University of Calgary, 2500 University Dr. NW, Calgary, AB T2N 1N4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1850-4816","authenticated-orcid":false,"given":"A. S. M. Hossain","family":"Bari","sequence":"additional","affiliation":[{"name":"Biometric Technologies Laboratory, Department of Computer Science, University of Calgary, 2500 University Dr. NW, Calgary, AB T2N 1N4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5338-1834","authenticated-orcid":false,"given":"Marina","family":"Gavrilova","sequence":"additional","affiliation":[{"name":"Biometric Technologies Laboratory, Department of Computer Science, University of Calgary, 2500 University Dr. NW, Calgary, AB T2N 1N4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2642","DOI":"10.1016\/j.matpr.2021.07.005","article-title":"A comprehensive survey on the biometric systems based on physiological and behavioural characteristics","volume":"80","author":"Abdulrahman","year":"2021","journal-title":"Mater. Today Proc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1016\/j.patcog.2014.01.016","article-title":"A review of biometric technology along with trends and prospects","volume":"47","author":"Unar","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Jain, A.K., Flynn, P., and Ross, A.A. (2007). Handbook of Biometrics, Springer Science & Business Media.","DOI":"10.1007\/978-0-387-71041-9"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"9128","DOI":"10.1109\/JIOT.2020.3004077","article-title":"Behavioral biometrics for continuous authentication in the internet-of-things era: An artificial intelligence perspective","volume":"7","author":"Liang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Revett, K. (2008). Behavioral Biometrics: A Remote Access Approach, John Wiley & Sons.","DOI":"10.1002\/9780470997949"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sultana, M., Paul, P.P., and Gavrilova, M. (2014, January 6\u20138). A concept of social behavioral biometrics: Motivation, current developments, and future trends. Proceedings of the International Conference on Cyberworlds, Santander, Spain.","DOI":"10.1109\/CW.2014.44"},{"key":"ref_7","unstructured":"Gavrilova, M.L., Anzum, F., Hossain Bari, A., Bhatia, Y., Iffath, F., Ohi, Q., Shopon, M., and Wahid, Z. (2022). Breakthroughs in Digital Biometrics and Forensics, Springer."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1007\/s11042-022-13245-9","article-title":"Continuous user authentication on smartphone via behavioral biometrics: A survey","volume":"82","author":"Rayani","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1109\/THMS.2017.2681673","article-title":"User recognition from social behavior in computer-mediated social context","volume":"47","author":"Sultana","year":"2017","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tumpa, S.N., and Gavrilova, M. (2020, January 11\u201314). Linguistic profiles in biometric security system for online user authentication. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Toronto, ON, Canada.","DOI":"10.1109\/SMC42975.2020.9282937"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"57481","DOI":"10.1109\/ACCESS.2023.3283932","article-title":"Human Micro-Expression: A Novel Social Behavioral Biometric for Person Identification","volume":"11","author":"Wahid","year":"2023","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.adhoc.2018.09.015","article-title":"BehaveSense: Continuous authentication for security-sensitive mobile apps using behavioral biometrics","volume":"84","author":"Yang","year":"2019","journal-title":"Ad Hoc Netw."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sahdev, S.L., Singh, S., Kaur, N., and Siddiqui, L. (2021, January 17\u201319). Behavioral Biometrics for Adaptive Authentication in Digital Banking-Guard Against Flawless Privacy. Proceedings of the International Conference on Innovative Practices in Technology and Management, Noida, India.","DOI":"10.1109\/ICIPTM52218.2021.9388364"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1016\/j.comnet.2012.10.005","article-title":"Blog or block: Detecting blog bots through behavioral biometrics","volume":"57","author":"Chu","year":"2013","journal-title":"Comput. Netw."},{"key":"ref_15","unstructured":"Awad, A. (2017). Information Security Practices, Springer."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Granatyr, J., Gomes, H.M., Dias, J.M., Paiva, A.M., Nunes, M.A.S.N., Scalabrin, E.E., and Spak, F. (2019, January 6\u20139). Inferring trust using personality aspects extracted from texts. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Bari, Italy.","DOI":"10.1109\/SMC.2019.8914641"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/s41060-021-00294-w","article-title":"Personalized multi-faceted trust modeling to determine trust links in social media and its potential for misinformation management","volume":"13","author":"Parmentier","year":"2022","journal-title":"Int. J. Data Sci. Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.procs.2021.05.075","article-title":"Sexual-predator detection system based on Social Behavior Biometric (SBB) features","volume":"189","author":"Wani","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wahid, Z., and Al Imran, A. (2023, January 14\u201317). Multi-feature Transformer for Multiclass Cyberbullying Detection in Bangla. Proceedings of the IFIP International Conference on Artificial Intelligence Applications and Innovations, Le\u00f3n, Spain.","DOI":"10.1007\/978-3-031-34111-3_37"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102532","DOI":"10.1016\/j.ipm.2021.102532","article-title":"A sentiment-aware deep learning approach for personality detection from text","volume":"58","author":"Ren","year":"2021","journal-title":"Inf. Process. Manag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.cobeha.2017.07.005","article-title":"Detecting depression and mental illness on social media: An integrative review","volume":"18","author":"Guntuku","year":"2017","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"44883","DOI":"10.1109\/ACCESS.2019.2909180","article-title":"Detection of depression-related posts in Reddit social media forum","volume":"7","author":"Tadesse","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13278-021-00776-6","article-title":"A review on sentiment analysis and emotion detection from text","volume":"11","author":"Nandwani","year":"2021","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_24","unstructured":"Seyeditabari, A., Tabari, N., and Zadrozny, W. (2018). Emotion detection in text: A review. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dunbar, R. (2010). How Many Friends Does One Person Need? Dunbar\u2019s Number and Other Evolutionary Quirks, Faber.","DOI":"10.2307\/j.ctvk12rgx"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gon\u00e7alves, B., Perra, N., and Vespignani, A. (2011). Modeling users\u2019 activity on Twitter networks: Validation of Dunbar\u2019s number. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0022656"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.socnet.2016.06.003","article-title":"Calling Dunbar\u2019s numbers","volume":"47","author":"Kaski","year":"2016","journal-title":"Soc. Netw."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sultana, M., and Gavrilova, M. (2018, January 7\u201310). Temporal Pattern in Tweeting Behavior for Persons\u2019 Identity Verification. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00424"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8487","DOI":"10.1109\/ACCESS.2022.3144145","article-title":"Template aging in multi-modal social behavioral biometrics","volume":"10","author":"Tumpa","year":"2022","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"12199","DOI":"10.1109\/ACCESS.2017.2719706","article-title":"Social behaviometrics for personalized devices in the internet of things era","volume":"5","author":"Anjomshoa","year":"2017","journal-title":"IEEE Access"},{"key":"ref_31","unstructured":"Saleema, A., and Thampi, S.M. (2019, January 18\u201321). User recognition using cognitive psychology based behavior modeling in online social networks. Proceedings of the Advances in Signal Processing and Intelligent Recognition Systems: 5th International Symposium, SIRS 2019, Trivandrum, India."},{"key":"ref_32","unstructured":"Parrott, W.G. (2001). Emotions in Social Psychology: Essential Readings, Psychology Press."},{"key":"ref_33","first-page":"359","article-title":"Using Dynamic Time Warping to find patterns in time series","volume":"Volume 10","author":"Berndt","year":"1994","journal-title":"Proceedings of the Knowledge Discovery in Databases Workshop"},{"key":"ref_34","unstructured":"Li, S.Z. (2009). Encyclopedia of Biometrics: I-Z, Springer Science & Business Media."},{"key":"ref_35","unstructured":"Murthy, D. (2018). Twitter, Polity Press."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.comcom.2015.09.021","article-title":"A framework for real-time Twitter data analysis","volume":"73","author":"Gaglio","year":"2016","journal-title":"Comput. Commun."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/j.future.2016.10.019","article-title":"Social networking data analysis tools & challenges","volume":"86","author":"Sapountzi","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.ipm.2013.08.006","article-title":"The impact of preprocessing on text classification","volume":"50","author":"Uysal","year":"2014","journal-title":"Inf. Process. Manag."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Benevenuto, F., Rodrigues, T., Cha, M., and Almeida, V. (2009, January 28\u201330). Characterizing user behavior in online social networks. Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement, Marrakech, Morocco.","DOI":"10.1145\/1644893.1644900"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Loper, E., and Bird, S. (2002). Nltk: The natural language toolkit. arXiv.","DOI":"10.3115\/1118108.1118117"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C. (2011). An Introduction to Social Network Data Analytics, Springer.","DOI":"10.1007\/978-1-4419-8462-3"},{"key":"ref_42","unstructured":"Ramos, J. (2003, January 23\u201324). Using TF-IDF to determine word relevance in document queries. Proceedings of the 1st International Conference on Machine Learning, Los Angeles, CA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_44","unstructured":"Tumpa, S.N. (2022). Online User Recognition Using Social Behavioral Biometric System. [Master\u2019s Thesis, Schulich School of Engineering, University of Calgary]."},{"key":"ref_45","unstructured":"Lan, M., Tan, C.L., Low, H.B., and Sung, S.Y. (August, January 31). A comprehensive comparative study on term weighting schemes for text categorization with support vector machines. Proceedings of the 14th International Conference on World Wide Web, Montreal, QUE, Canada."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2270","DOI":"10.1016\/j.patcog.2005.01.012","article-title":"Score normalization in multimodal biometric systems","volume":"38","author":"Jain","year":"2005","journal-title":"Pattern Recognit."},{"key":"ref_47","unstructured":"Parsons, V.L. (2014). Wiley StatsRef: Statistics Reference Online, Wiley."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1007\/978-0-387-39940-9_565","article-title":"Cross-validation","volume":"5","author":"Refaeilzadeh","year":"2009","journal-title":"Encycl. Database Syst."},{"key":"ref_49","unstructured":"Liashchynskyi, P., and Liashchynskyi, P. (2019). Grid search, random search, genetic algorithm: A big comparison for NAS. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"157663","DOI":"10.1109\/ACCESS.2020.3018958","article-title":"Score and rank level fusion algorithms for social behavioral biometrics","volume":"8","author":"Tumpa","year":"2020","journal-title":"IEEE Access"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"113114","DOI":"10.1016\/j.eswa.2019.113114","article-title":"A comprehensive survey on the biometric recognition systems based on physiological and behavioral modalities","volume":"143","author":"Dargan","year":"2020","journal-title":"Expert Syst. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8197\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:02:59Z","timestamp":1760130179000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8197"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,30]]},"references-count":51,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23198197"],"URL":"https:\/\/doi.org\/10.3390\/s23198197","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,30]]}}}