{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T16:10:56Z","timestamp":1777565456942,"version":"3.51.4"},"reference-count":14,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,7,16]],"date-time":"2020-07-16T00:00:00Z","timestamp":1594857600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,16]],"date-time":"2020-07-16T00:00:00Z","timestamp":1594857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Recognition is an essential function of human beings. Humans easily recognize a person using various inputs such as voice, face, or gesture. In this study, we mainly focus on DL model with multi-modality which has many benefits including noise reduction. We used ResNet-50 for extracting features from dataset with 2D data.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>This study proposes a novel multimodal and multitask model, which can both identify human ID and classify the gender in single step. At the feature level, the extracted features are concatenated as the input for the identification module. Additionally, in our model design, we can change the number of modalities used in a single model. To demonstrate our model, we generate 58 virtual subjects with public ECG, face and fingerprint dataset. Through the test with noisy input, using multimodal is more robust and better than using single modality.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>This paper presents an end-to-end approach for multimodal and multitask learning. The proposed model shows robustness on the spoof attack, which can be significant for bio-authentication device. Through results in this study, we suggest a new perspective for human identification task, which performs better than in previous approaches.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12859-020-03613-3","type":"journal-article","created":{"date-parts":[[2020,7,16]],"date-time":"2020-07-16T17:02:36Z","timestamp":1594918956000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Deep user identification model with multiple biometric data"],"prefix":"10.1186","volume":"21","author":[{"given":"Hyoung-Kyu","family":"Song","sequence":"first","affiliation":[]},{"given":"Ebrahim","family":"AlAlkeem","sequence":"additional","affiliation":[]},{"given":"Jaewoong","family":"Yun","sequence":"additional","affiliation":[]},{"given":"Tae-Ho","family":"Kim","sequence":"additional","affiliation":[]},{"given":"Hyerin","family":"Yoo","sequence":"additional","affiliation":[]},{"given":"Dasom","family":"Heo","sequence":"additional","affiliation":[]},{"given":"Myungsu","family":"Chae","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1398-952X","authenticated-orcid":false,"given":"Chan","family":"Yeob Yeun","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,7,16]]},"reference":[{"key":"3613_CR1","doi-asserted-by":"publisher","unstructured":"Israel S. A., Scruggs W. T., Worek W. J., Irvine J. M.Fusing face and ecg for personal identification. In: Proceedings of 32nd Applied Imagery Pattern Recognition Workshop: 15-17 Octobor 2003; Washington DC. IEEE: 2003. p. 226\u201331. https:\/\/doi.org\/10.1109\/aipr.2003.1284276.","DOI":"10.1109\/aipr.2003.1284276"},{"key":"3613_CR2","first-page":"261","volume":"2","author":"S. Zokaee","year":"2012","unstructured":"Zokaee S., Faez K.Human identification based on electrocardiogram and palmprint. Int J Electr Comput Eng. 2012; 2:261\u20136.","journal-title":"Int J Electr Comput Eng"},{"key":"3613_CR3","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-4666-3646-0","volume-title":"Multimodal Biometrics and Intelligent Image Processing for Security Systems","author":"M. L. Gavrilova","year":"2013","unstructured":"Gavrilova M. L., Monwar M.Multimodal Biometrics and Intelligent Image Processing for Security Systems. Hershey: IGI Global; 2013."},{"key":"3613_CR4","doi-asserted-by":"publisher","DOI":"10.1109\/IT4OD.2016.7479294","volume-title":"Proceedings of International Conference on Information Technology for Organizations Development: 30 March-1 April 2016","author":"O. Chergui","year":"2016","unstructured":"Chergui O., Bendjenna H., Meraoumia A., Chitroub S.Ccombining palmprint & finger-knuckle-print for user identification. In: Proceedings of International Conference on Information Technology for Organizations Development: 30 March-1 April 2016. Fez: IEEE: 2016. p. 1\u20135. https:\/\/doi.org\/10.1109\/IT4OD.2016.7479294."},{"key":"3613_CR5","doi-asserted-by":"publisher","first-page":"063020","DOI":"10.1117\/1.JEI.24.6.063020","volume":"24","author":"G. Huo","year":"2015","unstructured":"Huo G., Liu Y., Zhu X., Dong H., He F.Face\u2013iris multimodal biometric scheme based on feature level fusion. J Electron Imaging. 2015; 24:063020.","journal-title":"J Electron Imaging"},{"key":"3613_CR6","volume-title":"Handbook of Multibiometrics","author":"A. A. Ross","year":"2013","unstructured":"Ross A. A., Nandakumar K., Jain A. K.Handbook of Multibiometrics. New York: Springer; 2013."},{"key":"3613_CR7","doi-asserted-by":"publisher","unstructured":"Lin Y., Lv F., Zhu S., Yang M., Cour T., Yu K., Cao L., Huang T.Large-scale image classification: Fast feature extraction and svm training. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition: 20-25 June 2011; Providence. IEEE: 2011. p. 1689\u201396. https:\/\/doi.org\/10.1109\/cvpr.2011.5995477.","DOI":"10.1109\/cvpr.2011.5995477"},{"key":"3613_CR8","doi-asserted-by":"publisher","unstructured":"He K., Zhang X., Ren S., Sun J.Deep residual learning for image recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition: 27-30 June 2016; Las Vegas. IEEE: 2016. p. 770\u20138. https:\/\/doi.org\/10.1109\/cvpr.2016.90.","DOI":"10.1109\/cvpr.2016.90"},{"key":"3613_CR9","doi-asserted-by":"publisher","unstructured":"Salloum R., Kuo C. J.Ecg-based biometrics using recurrent neural networks. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing: 5-9 March 2017; New Orleans. IEEE: 2017. p. 2062\u20136. https:\/\/doi.org\/10.1109\/icassp.2017.7952519.","DOI":"10.1109\/icassp.2017.7952519"},{"key":"3613_CR10","first-page":"215","volume":"101","author":"A. Goldberger","year":"2000","unstructured":"Goldberger A., Amaral L., Glass L., Hausdorff J., Ivanov P., Mark R., Mietus J., Moody G., Peng C. K., Stanley H.Physiobank, physiotoolkit, and physionet : Components of a new research resource for complex physiologic signals. Circulation. 2000; 101:215\u201320.","journal-title":"Circulation"},{"key":"3613_CR11","unstructured":"ECG-ID Database. https:\/\/dx.doi.org\/10.13026\/C2J01F. Accessed 08 May 2020."},{"key":"3613_CR12","unstructured":"PTB Diagnostic ECG Database. https:\/\/dx.doi.org\/10.13026\/C28C71. Accessed 08 May 2020."},{"key":"3613_CR13","volume-title":"Proceedings of 8th British Machine Vision Conference: 1997; Colchester","author":"D. Hond","year":"1997","unstructured":"Hond D., Spacek L.Distinctive descriptions for face processing. In: Proceedings of 8th British Machine Vision Conference: 1997; Colchester. Colchester: BMVA: 1997. p. 320\u20139. http:\/\/www.bmva.org\/bmvc\/1997\/papers\/021\/topsty.htm."},{"key":"3613_CR14","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/S0969-4765(07)70140-6","volume":"15","author":"R. Cappelli","year":"2007","unstructured":"Cappelli R., Ferrara M., Franco A., Maltoni D.Fingerprint verification competition 2006. Biom Technol Today. 2007; 15:7\u20139.","journal-title":"Biom Technol Today"}],"updated-by":[{"DOI":"10.1186\/s12859-020-03746-5","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2020,10,26]],"date-time":"2020-10-26T00:00:00Z","timestamp":1603670400000}}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03613-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-020-03613-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03613-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,15]],"date-time":"2021-07-15T23:10:04Z","timestamp":1626390604000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-020-03613-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,16]]},"references-count":14,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["3613"],"URL":"https:\/\/doi.org\/10.1186\/s12859-020-03613-3","relation":{"correction":[{"id-type":"doi","id":"10.1186\/s12859-020-03746-5","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,16]]},"assertion":[{"value":"11 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 October 2020","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"An amendment to this paper has been published and can be accessed via the original article.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"315"}}