{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T19:39:13Z","timestamp":1783021153637,"version":"3.54.6"},"reference-count":34,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,10,28]],"date-time":"2019-10-28T00:00:00Z","timestamp":1572220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Many biometric systems based on physiological traits such as ones facial characteristics, iris, and fingerprint have been developed for authentication purposes. Such security systems, however, commonly suffer from impersonation attacks such as obfuscation, abrasion, latent samples, and covert attack. More conventional behavioral methods, such as passwords and signatures, suffer from similar issues and can easily be spoofed. With growing levels of private data readily available across the internet, a more robust authentication system is needed for use in emerging technologies and mobile applications. In this paper, we present a novel multimodal biometric user authentication framework by combining the behavioral dynamic signature with the the physiological electroencephalograph (EEG) to restrict unauthorized access. EEG signals of 33 genuine users were collected while signing on their mobile phones. The recorded sequences were modeled using a bidirectional long short-term memory neural network (BLSTM-NN) based sequential classifier to accomplish person identification and verification. An accuracy of 98.78% was obtained for identification using decision fusion of dynamic signatures and EEG signals. The robustness of the framework was also tested against 1650 impersonation attempts made by 25 forged users by imitating the dynamic signatures of genuine users. Verification performance was measured using detection error tradeoff (DET) curves and half total error rate (HTER) security matrices using true positive rate (TPR) and false acceptance rate (FAR), resulting in 3.75% FAR and 1.87% HTER with 100% TPR for forgery attempts.<\/jats:p>","DOI":"10.3390\/s19214641","type":"journal-article","created":{"date-parts":[[2019,10,28]],"date-time":"2019-10-28T04:44:31Z","timestamp":1572237871000},"page":"4641","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Fusion of Neuro-Signals and Dynamic Signatures for Person Authentication"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5717-4242","authenticated-orcid":false,"given":"Pradeep","family":"Kumar","sequence":"first","affiliation":[{"name":"Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB E3B 5A3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8532-0895","authenticated-orcid":false,"given":"Rajkumar","family":"Saini","sequence":"additional","affiliation":[{"name":"Department of Computer Science &amp; Engineering, Indian Institute of Technology, Roorkee 247667, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8469-9899","authenticated-orcid":false,"given":"Barjinder","family":"Kaur","sequence":"additional","affiliation":[{"name":"Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB E3B 5A3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Partha Pratim","family":"Roy","sequence":"additional","affiliation":[{"name":"Department of Computer Science &amp; Engineering, Indian Institute of Technology, Roorkee 247667, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4421-1016","authenticated-orcid":false,"given":"Erik","family":"Scheme","sequence":"additional","affiliation":[{"name":"Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB E3B 5A3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,28]]},"reference":[{"key":"ref_1","unstructured":"Zhang, D.D. (2012). Biometric Solutions: For Authentication in an E-world, Springer Science & Business Media."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Aloul, F., Zahidi, S., and El-Hajj, W. (2009, January 10\u201313). Two factor authentication using mobile phones. Proceedings of the 2009 IEEE\/ACS International Conference on Computer Systems and Applications, Rabat, Morocco.","DOI":"10.1109\/AICCSA.2009.5069395"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sharif, M., Raza, M., Shah, J.H., Yasmin, M., and Fernandes, S.L. (2019). An Overview of Biometrics Methods. Handbook of Multimedia Information Security: Techniques and Applications, Springer.","DOI":"10.1007\/978-3-030-15887-3_2"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3259","DOI":"10.1109\/TIFS.2019.2916403","article-title":"Convolutional Neural Networks Using Dynamic Functional Connectivity for EEG-based Person Identification in Diverse Human States","volume":"14","author":"Wang","year":"2019","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Miyamoto, C., Baba, S., and Nakanishi, I. (2009, January 8\u201311). Biometric person authentication using new spectral features of electroencephalogram (EEG). Proceedings of the 2008 International Symposium on Intelligent Signal Processing and Communications Systems, Bangkok, Thailand.","DOI":"10.1109\/ISPACS.2009.4806762"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1142\/S0129065708001373","article-title":"Two-stage biometric authentication method using thought activity brain waves","volume":"18","author":"Palaniappan","year":"2008","journal-title":"Int. J. Neural Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2406","DOI":"10.1109\/TBME.2014.2317881","article-title":"Human brain distinctiveness based on EEG spectral coherence connectivity","volume":"61","author":"Campisi","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tanwar, S., Obaidat, M.S., Tyagi, S., and Kumar, N. (2019). Online Signature-Based Biometric Recognition. Biometric-Based Physical and Cybersecurity Systems, Springer.","DOI":"10.1007\/978-3-319-98734-7"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1049\/iet-bmt.2015.0017","article-title":"Authentic mobile-biometric signature verification system","volume":"5","author":"Zareen","year":"2016","journal-title":"IET Biometrics"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Galbally, J., Gomez-Barrero, M., and Ross, A. (2017, January 1\u20134). Accuracy evaluation of handwritten signature verification: Rethinking the random-skilled forgeries dichotomy. Proceedings of the 2017 IEEE International Joint Conference on Biometrics (IJCB), Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272711"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"20463","DOI":"10.1109\/ACCESS.2017.2755771","article-title":"Improving presentation attack detection in dynamic handwritten signature biometrics","volume":"5","year":"2017","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tolosana, R., Vera-Rodriguez, R., Fierrez, J., and Ortega-Garcia, J. (2019). Presentation Attacks in Signature Biometrics: Types and Introduction to Attack Detection. Handbook of Biometric Anti-Spoofing, Springer.","DOI":"10.1007\/978-3-319-92627-8_19"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gomez-Barrero, M., Galbally, J., Fierrez, J., Ortega-Garcia, J., and Plamondon, R. (2015, January 19\u201322). Enhanced on-line signature verification based on skilled forgery detection using sigma-lognormal features. Proceedings of the 2015 International Conference on Biometrics (ICB), Phuket, Thailand.","DOI":"10.1109\/ICB.2015.7139065"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Madasu, V.K., Yusof, M.H.M., Hanmandlu, M., and Kubik, K. (2003). Off-line signature verification and forgery detection system based on fuzzy modeling. Australasian Joint Conference on Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-540-24581-0_86"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.eswa.2018.08.036","article-title":"Robust multimodal biometric system based on optimal score level fusion model","volume":"116","author":"Walia","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Leghari, M., Memon, S., and Chandio, A.A. (2018, January 3\u20134). Feature-level fusion of fingerprint and online signature for multimodal biometrics. Proceedings of the 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), Sukkur, Pakistan.","DOI":"10.1109\/ICOMET.2018.8346358"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11277-017-5034-1","article-title":"Multimodal biometric authentication algorithm using iris, palm print, face and signature with encoded dwt","volume":"99","author":"Sujatha","year":"2018","journal-title":"Wirel. Pers. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"956","DOI":"10.1109\/TFUZZ.2018.2870590","article-title":"Multimodal Gait Recognition with Inertial Sensor Data and Video Using Evolutionary Algorithm","volume":"27","author":"Kumar","year":"2018","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2248","DOI":"10.1016\/j.neuroimage.2009.10.057","article-title":"Saccadic spike potentials in gamma-band EEG: Characterization, detection and suppression","volume":"49","author":"Keren","year":"2010","journal-title":"Neuroimage"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.jnca.2017.02.011","article-title":"A bio-signal based framework to secure mobile devices","volume":"89","author":"Kumar","year":"2017","journal-title":"J. Network Comput. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yazdani, A., Roodaki, A., Rezatofighi, S., Misaghian, K., and Setarehdan, S.K. (2008, January 26\u201329). Fisher linear discriminant based person identification using visual evoked potentials. Proceedings of the 9th International Conference on Signal Processing, Beijing, China.","DOI":"10.1109\/ICOSP.2008.4697459"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1109\/JSEN.2016.2643165","article-title":"Study of Text Segmentation and Recognition using Leap Motion Sensor","volume":"17","author":"Kumar","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2467","DOI":"10.1007\/s13042-018-0883-9","article-title":"A dempster\u2013shafer theory based classifier combination for online signature recognition and verification systems","volume":"10","author":"Ghosh","year":"2019","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1142\/S0218001409007417","article-title":"Feature selection for HMM and BLSTM based handwriting recognition of whiteboard notes","volume":"23","author":"Liwicki","year":"2009","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.neucom.2016.08.132","article-title":"A multimodal framework for sensor based sign language recognition","volume":"259","author":"Kumar","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/j.neunet.2005.06.042","article-title":"Framewise phoneme classification with bidirectional LSTM and other neural network architectures","volume":"18","author":"Graves","year":"2005","journal-title":"Neural Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1109\/34.667881","article-title":"On combining classifiers","volume":"20","author":"Kittler","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2270","DOI":"10.1016\/j.patcog.2005.01.012","article-title":"Score normalization in multimodal biometric systems","volume":"38","author":"Jain","year":"2005","journal-title":"Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ponti, M.P. (2011, January 28\u201330). Combining classifiers: From the creation of ensembles to the decision fusion. Proceedings of the 2011 24th SIBGRAPI Conference on Graphics, Patterns, and Images Tutorials, Alagoas, Brazil.","DOI":"10.1109\/SIBGRAPI-T.2011.9"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.1109\/TBME.2004.827072","article-title":"BCI2000: A general-purpose brain-computer interface (BCI) system","volume":"51","author":"Schalk","year":"2004","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1049\/ip-vis:20031078","article-title":"MCYT baseline corpus: A bimodal biometric database","volume":"150","author":"Simon","year":"2003","journal-title":"IEEE Proc. Vis. Image Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1109\/LSP.2014.2367091","article-title":"An EEG-based biometric system using eigenvector centrality in resting state brain networks","volume":"22","author":"Fraschini","year":"2015","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s10032-019-00316-1","article-title":"Online signature verification based on string edit distance","volume":"22","author":"Riesen","year":"2019","journal-title":"Int. J. Doc. Anal. Recogn."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.eswa.2016.06.006","article-title":"EEG-based person identification through binary flower pollination algorithm","volume":"62","author":"Rodrigues","year":"2016","journal-title":"Expert Syst. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4641\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:29:47Z","timestamp":1760189387000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4641"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,28]]},"references-count":34,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19214641"],"URL":"https:\/\/doi.org\/10.3390\/s19214641","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,28]]}}}