{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:06:00Z","timestamp":1777705560588,"version":"3.51.4"},"reference-count":21,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2022,1,25]]},"abstract":"<jats:p>Person identification using biometric features is an effective method for recognizing and authenticating the identity of a person. Multimodal biometric systems combine different biometric modalities in order to make better predictions as well as for achieving increased robustness. This paper proposes a touchless multimodal person identification model using deep learning techniques by combining the gait and speech modalities. Separate pipelines for both the modalities were developed using Convolutional Neural Networks. The paper also explores various fusion strategies for combining the two pipelines and shows how various metrics get affected with different fusion strategies. Results show that weighted average and product fusion rules work best for the data used in the experiments.<\/jats:p>","DOI":"10.3233\/jifs-189765","type":"journal-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T12:37:07Z","timestamp":1614947827000},"page":"981-990","source":"Crossref","is-referenced-by-count":6,"title":["CNN-based Multimodal Touchless Biometric Recognition System using Gait and Speech"],"prefix":"10.1177","volume":"42","author":[{"given":"Sumit","family":"Sarin","sequence":"first","affiliation":[{"name":"Netaji Subhas Institute of Technology, Sector-3, Dwarka, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antriksh","family":"Mittal","sequence":"additional","affiliation":[{"name":"Netaji Subhas Institute of Technology, Sector-3, Dwarka, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anirudh","family":"Chugh","sequence":"additional","affiliation":[{"name":"Netaji Subhas Institute of Technology, Sector-3, Dwarka, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Smriti","family":"Srivastava","sequence":"additional","affiliation":[{"name":"Netaji Subhas Institute of Technology, Sector-3, Dwarka, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-189765_ref1","doi-asserted-by":"crossref","unstructured":"Venkatraman S. and Delpachitra I. , Biometrics in banking security: A case study,415\u2013430. 10, Inf Manag Comput Security 16 (2008).","DOI":"10.1108\/09685220810908813"},{"key":"10.3233\/JIFS-189765_ref2","doi-asserted-by":"crossref","first-page":"7532","DOI":"10.1109\/ACCESS.2016.2614720","article-title":"Unimodal and multimodal biometric sensing systems: A review","volume":"4","author":"Oloyede","year":"2016","journal-title":"IEEE Access"},{"issue":"7553","key":"10.3233\/JIFS-189765_ref3","first-page":"436","article-title":"Deep learning","volume":"521","author":"Lecun","year":"2015","journal-title":"Nature Cell Biology"},{"key":"10.3233\/JIFS-189765_ref6","doi-asserted-by":"crossref","unstructured":"Singh S. , Gyaourova A. , Bebis G. and Pavlidis I. , Infrared and visible image fusion for face recognition, Proceedings of SPIE - The International Society for Optical Engineering 5404 04 (2004).","DOI":"10.1117\/12.543549"},{"issue":"2","key":"10.3233\/JIFS-189765_ref7","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1007\/s13369-017-2644-6","article-title":"Accurate human recognition by score-level and feature-level fusion using palm\u2013phalanges print","volume":"43","author":"Gopal","year":"2018","journal-title":"Arabian Journal for Science and Engineering"},{"key":"10.3233\/JIFS-189765_ref9","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/ICPR.2006.556","article-title":"Feature fusion of face and gait for human recognition at a distance in video, in","volume":"4","author":"Zhou","year":"2006","journal-title":"18th International Conference on Pattern Recognition (ICPR\u201906)"},{"issue":"13","key":"10.3233\/JIFS-189765_ref11","doi-asserted-by":"crossref","first-page":"2115","DOI":"10.1016\/S0167-8655(03)00079-5","article-title":"Information fusion in biometrics","volume":"24","author":"Ross","year":"2003","journal-title":"Pattern Recogn Lett"},{"issue":"2","key":"10.3233\/JIFS-189765_ref12","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/2.820041","article-title":"Biold: a multimodal biometric identification system","volume":"33","author":"Frischholz","year":"2000","journal-title":"Computer"},{"key":"10.3233\/JIFS-189765_ref13","doi-asserted-by":"crossref","unstructured":"Chaudhary G. , Srivastava S. , Bhardwaj S. and Bhargava S. , Fusion of palm-phalanges print with palmprint and dorsal hand vein, Applied Soft Computing 47 05 (2016).","DOI":"10.1016\/j.asoc.2016.05.039"},{"key":"10.3233\/JIFS-189765_ref14","doi-asserted-by":"crossref","unstructured":"Chaudhary G. , Srivastava S. and Bhardwaj S. , A robust biometrics multilevel fusion scheme, International Journal of Image Mining 2 (2016), 100. 01.","DOI":"10.1504\/IJIM.2016.10004699"},{"issue":"2","key":"10.3233\/JIFS-189765_ref16","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/MIS.2018.2881494","article-title":"Robust authentication using dorsal hand vein images","volume":"34","author":"Arora","year":"2019","journal-title":"IEEE Intelligent Systems"},{"key":"10.3233\/JIFS-189765_ref17","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1016\/S0167-8655(01)00073-3","article-title":"On combining classifiers using sum and product rules","volume":"22","author":"Alexandre","year":"2001","journal-title":"Pattern Recognition Letters"},{"issue":"2","key":"10.3233\/JIFS-189765_ref19","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/s10444-013-9310-7","article-title":"Weighted fusion frame construction via spectral tetris","volume":"40","author":"Casazza","year":"2014","journal-title":"Advances in Computational Mathematics"},{"issue":"2","key":"10.3233\/JIFS-189765_ref21","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1109\/TPAMI.2006.38","article-title":"Individual recognition using gait energy image","volume":"28","author":"Han","year":"2006","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"4","key":"10.3233\/JIFS-189765_ref23","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1016\/j.patcog.2010.10.011","article-title":"Gait flow image: A silhouette-based gait representation for human identification","volume":"44","author":"Lam","year":"2011","journal-title":"Pattern Recognition"},{"issue":"6","key":"10.3233\/JIFS-189765_ref24","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1016\/j.jvcir.2014.05.006","article-title":"Gait probability image: An information-theoretic model of gait representation","volume":"25","author":"Lee","year":"2014","journal-title":"Journal of Visual Communication and Image Representation"},{"key":"10.3233\/JIFS-189765_ref26","doi-asserted-by":"crossref","first-page":"45","DOI":"10.4018\/IJRSDA.2016040104","article-title":"Analysis of gait flow image and gait gaussian image using extension neural network for gait recognition","volume":"3","author":"Narula","year":"2016","journal-title":"International Journal of Rough Sets and Data Analysis"},{"issue":"6","key":"10.3233\/JIFS-189765_ref32","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MSP.2015.2462851","article-title":"Speaker recognition by machines and humans: A tutorial review","volume":"32","author":"Hansen","year":"2015","journal-title":"IEEE Signal Processing Magazine"},{"issue":"1","key":"10.3233\/JIFS-189765_ref33","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/89.365379","article-title":"Robust text-independent speaker identification using gaussian mixture speaker models","volume":"3","author":"Reynolds","year":"1995","journal-title":"IEEE Transactions on Speech and Audio Processing"},{"issue":"3","key":"10.3233\/JIFS-189765_ref41","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1121\/1.1915893","article-title":"A scale for the measurement of the psychological magnitude pitch","volume":"8","author":"Stevens","year":"1937","journal-title":"The Journal of the Acoustical Society of America"},{"issue":"56","key":"10.3233\/JIFS-189765_ref45","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"Journal of Machine Learning Research"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-189765","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:44:14Z","timestamp":1777455854000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-189765"}},"subtitle":[],"editor":[{"given":"Hasmat","family":"Malik","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Gopal","family":"Chaudhary","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Smriti","family":"Srivastava","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,1,25]]},"references-count":21,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/jifs-189765","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,25]]}}}