{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:27:04Z","timestamp":1740122824818,"version":"3.37.3"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"39-40","license":[{"start":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T00:00:00Z","timestamp":1597104000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T00:00:00Z","timestamp":1597104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"EU Horizon 2020 projec","award":["700381"],"award-info":[{"award-number":["700381"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2020,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In many real-world classification problems there exist multiple subclasses (or clusters) within a class; in other words, the underlying data distribution is within-class multimodal. One example is face recognition where a face (i.e. a class) may be presented in frontal view or side view, corresponding to different modalities. This issue has been largely ignored in the literature or at least under studied. How to address the within-class multimodality issue is still an unsolved problem. In this paper, we present an extensive study of within-class multimodality classification. This study is guided by a number of research questions, and conducted through experimentation on artificial data and real data. In addition, we establish a case for within-class multimodal classification that is characterised by the concurrent maximisation of between-class separation, between-subclass separation and within-class compactness. Extensive experimental results show that within-class multimodal classification consistently leads to significant performance gains when within-class multimodality is present in data. Furthermore, it has been found that within-class multimodal classification offers a competitive solution to face recognition under different lighting and face pose conditions. It is our opinion that the case for within-class multimodal classification is established, therefore there is a milestone to be achieved in some machine learning algorithms (e.g. Gaussian mixture model) when within-class multimodal classification, or part of it, is pursued.<\/jats:p>","DOI":"10.1007\/s11042-020-09238-1","type":"journal-article","created":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T17:05:17Z","timestamp":1597165517000},"page":"29327-29352","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Within-class multimodal classification"],"prefix":"10.1007","volume":"79","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8722-663X","authenticated-orcid":false,"given":"Huan","family":"Wan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bryan","family":"Scotney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wing W. Y.","family":"Ng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,8,11]]},"reference":[{"issue":"7","key":"9238_CR1","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1109\/34.598228","volume":"19","author":"PN Belhumeur","year":"1997","unstructured":"Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on pattern analysis and machine intelligence 19(7):711\u2013720","journal-title":"IEEE Transactions on pattern analysis and machine intelligence"},{"issue":"1","key":"9238_CR2","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Machine learning 45(1):5\u201332","journal-title":"Machine learning"},{"key":"9238_CR3","unstructured":"Dheeru D, Karra Taniskidou E (2017) UCI machine learning repository http:\/\/archive.ics.uci.edu\/ml"},{"key":"9238_CR4","doi-asserted-by":"publisher","unstructured":"Em Y, Gag F, Lou Y, Wang S, Huang T, Duan LY (2017) Incorporating intra-class variance to fine-grained visual recognition. In: 2017 IEEE International Conference on Multimedia and Expo (ICME), pp 1452\u20131457 https:\/\/doi.org\/10.1109\/ICME.2017.8019371","DOI":"10.1109\/ICME.2017.8019371"},{"issue":"2","key":"9238_CR5","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","volume":"7","author":"RA Fisher","year":"1936","unstructured":"Fisher RA (1936) The use of multiple measurements in taxonomic problems. Annals of eugenics 7(2):179\u2013188","journal-title":"Annals of eugenics"},{"issue":"5","key":"9238_CR6","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1109\/LSP.2011.2127474","volume":"18","author":"N Gkalelis","year":"2011","unstructured":"Gkalelis N, Mezaris V, Kompatsiaris I (2011) Mixture subclass discriminant analysis. IEEE Signal Processing Letters 18(5):319\u2013322","journal-title":"IEEE Signal Processing Letters"},{"key":"9238_CR7","unstructured":"Hayashi F (2000) Econometrics. Princeton University Press"},{"issue":"3","key":"9238_CR8","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1109\/TSG.2016.2598872","volume":"9","author":"K He","year":"2016","unstructured":"He K, Stankovic L, Liao J, Stankovic V (2016) Non-intrusive load disaggregation using graph signal processing. IEEE Transactions on Smart Grid 9(3):1739\u20131747","journal-title":"IEEE Transactions on Smart Grid"},{"key":"9238_CR9","unstructured":"Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: A database forstudying face recognition in unconstrained environments"},{"issue":"1","key":"9238_CR10","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3934\/mfc.2019006","volume":"2","author":"W Jia","year":"2019","unstructured":"Jia W, Deng Y, Xin C, Liu X, Pedrycz W (2019) A classification algorithm with linear discriminant analysis and axiomatic fuzzy sets. Mathematical Foundations of Computing 2(1):73\u201381","journal-title":"Mathematical Foundations of Computing"},{"key":"9238_CR11","doi-asserted-by":"crossref","unstructured":"Kaselimi M, Doulamis N, Doulamis A, Voulodimos A, Protopapadakis E (2019) Bayesian-optimized bidirectional lstm regression model for non-intrusive load monitoring. In: ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) IEEE, pp 2747\u20132751","DOI":"10.1109\/ICASSP.2019.8683110"},{"key":"9238_CR12","doi-asserted-by":"crossref","unstructured":"Kaselimi M, Doulamis N, Voulodimos A (2020) Context aware energy disaggregation using adaptive bidirectional lstm models. IEEE Transactions on Smart Grid","DOI":"10.1109\/TSG.2020.2974347"},{"key":"9238_CR13","doi-asserted-by":"crossref","unstructured":"Li CN, Shao YH (2019) Robust and sparse linear discriminant analysis via an alternating direction method of multipliers. IEEE transactions on neural networks and learning systems","DOI":"10.1109\/TNNLS.2019.2910991"},{"key":"9238_CR14","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/j.ins.2019.09.032","volume":"510","author":"H Li","year":"2020","unstructured":"Li H, Zhang L, Huang B, Zhou X (2020) Cost-sensitive dual-bidirectional linear discriminant analysis. Information Sciences 510:283\u2013303","journal-title":"Information Sciences"},{"key":"9238_CR15","unstructured":"Louppe G (2014) Understanding random forests: From theory to practice. arXiv preprint arXiv:14077502"},{"key":"9238_CR16","first-page":"2579","volume":"9","author":"M Lvd","year":"2008","unstructured":"Lvd M, Hinton G (2008) Visualizing data using t-SNE. Journal of machine learning research 9:2579\u20132605","journal-title":"Journal of machine learning research"},{"issue":"2","key":"9238_CR17","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1109\/34.908974","volume":"23","author":"AM Mart\u00ednez","year":"2001","unstructured":"Mart\u00ednez AM, Kak AC (2001) Pca versus lda. IEEE transactions on pattern analysis and machine intelligence 23(2):228\u2013233","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"issue":"12","key":"9238_CR18","doi-asserted-by":"publisher","first-page":"1934","DOI":"10.1109\/TPAMI.2005.250","volume":"27","author":"AM Martinez","year":"2005","unstructured":"Martinez AM, Zhu M (2005) Where are linear feature extraction methods applicable?. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(12):1934\u20131944","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"9238_CR19","doi-asserted-by":"crossref","unstructured":"Murray D, Stankovic L, Stankovic V, Lulic S, Sladojevic S (2019) Transferability of neural network approaches for low-rate energy disaggregation. In: ICASSP 2019\u20132019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, pp 8330\u20138334","DOI":"10.1109\/ICASSP.2019.8682486"},{"issue":"1","key":"9238_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3369870","volume":"14","author":"F Nie","year":"2020","unstructured":"Nie F, Wang Z, Wang R, Wang Z, Li X (2020) Adaptive local linear discriminant analysis. ACM Transactions on Knowledge Discovery from Data (TKDD) 14(1):1\u201319","journal-title":"ACM Transactions on Knowledge Discovery from Data (TKDD)"},{"issue":"10","key":"9238_CR21","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.1109\/34.879790","volume":"22","author":"PJ Phillips","year":"2000","unstructured":"Phillips PJ, Moon H, Rizvi SA, Rauss PJ (2000) The feret evaluation methodology for face-recognition algorithms. IEEE Transactions on pattern analysis and machine intelligence 22(10):1090\u20131104","journal-title":"IEEE Transactions on pattern analysis and machine intelligence"},{"issue":"2","key":"9238_CR22","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1111\/j.2517-6161.1948.tb00008.x","volume":"10","author":"CR Rao","year":"1948","unstructured":"Rao CR (1948) The utilization of multiple measurements in problems of biological classification. Journal of the Royal Statistical Society Series B (Methodological) 10(2):159\u2013203","journal-title":"Journal of the Royal Statistical Society Series B (Methodological)"},{"key":"9238_CR23","unstructured":"Seber GA, Lee AJ (2012) Linear regression analysis vol 329. John Wiley & Sons"},{"issue":"3","key":"9238_CR24","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/s13042-013-0226-9","volume":"6","author":"A Sharma","year":"2015","unstructured":"Sharma A, Paliwal KK (2015) Linear discriminant analysis for the small sample size problem: an overview. International Journal of Machine Learning and Cybernetics 6(3):443\u2013454","journal-title":"International Journal of Machine Learning and Cybernetics"},{"key":"9238_CR25","unstructured":"Vishwakarma VP, Dalal S (2020) A novel non-linear modifier for adaptive illumination normalization for robust face recognition Multimedia. Tools and Applications pp 1\u201327"},{"issue":"2","key":"9238_CR26","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1109\/TPAMI.2017.2672557","volume":"40","author":"H Wan","year":"2018","unstructured":"Wan H, Wang H, Guo G, Wei X (2018) Separability-oriented subclass discriminant analysis. IEEE transactions on pattern analysis and machine intelligence 40(2):409\u2013422","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"9238_CR27","doi-asserted-by":"crossref","unstructured":"Wang F, Wang Q, Nie F, Li Z, Yu w, Wang R (2019) Unsupervised linear discriminant analysis for jointly clustering and subspace learning. IEEE Transactions on Knowledge and Data Engineering","DOI":"10.1109\/TKDE.2019.2939524"},{"key":"9238_CR28","doi-asserted-by":"crossref","unstructured":"Wen Y, Zhang K, Li Z, Qiao Y (2016) A discriminative feature learning approach for deep face recognition. In: European conference on computer vision, Springer, pp 499\u2013515","DOI":"10.1007\/978-3-319-46478-7_31"},{"issue":"6-7","key":"9238_CR29","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1007\/s11263-018-01142-4","volume":"127","author":"Y Wen","year":"2019","unstructured":"Wen Y, Zhang K, Li Z, Qiao Y (2019) A comprehensive study on center loss for deep face recognition. Int J Comput Vis 127(6-7):668\u2013683","journal-title":"Int J Comput Vis"},{"key":"9238_CR30","unstructured":"Ye J, Ji S (2010) Discriminant analysis for dimensionality reduction: An overview of recent developments biometrics: Theory Methods, and Applications Wiley-IEEE Press New York"},{"key":"9238_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TPAMI.2018.2803179","volume":"99","author":"W Zhang","year":"2018","unstructured":"Zhang W, Zhao X, Morvan JM, Chen L (2018) Improving shadow suppression for illumination robust face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 99:1\u20131. https:\/\/doi.org\/10.1109\/TPAMI.2018.2803179","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"8","key":"9238_CR32","doi-asserted-by":"publisher","first-page":"1274","DOI":"10.1109\/TPAMI.2006.172","volume":"28","author":"M Zhu","year":"2006","unstructured":"Zhu M, Martinez AM (2006) Subclass discriminant analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(8):1274\u20131286","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09238-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-09238-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09238-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,6]],"date-time":"2022-11-06T15:09:37Z","timestamp":1667747377000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-09238-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,11]]},"references-count":32,"journal-issue":{"issue":"39-40","published-print":{"date-parts":[[2020,10]]}},"alternative-id":["9238"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-09238-1","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"type":"print","value":"1380-7501"},{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2020,8,11]]},"assertion":[{"value":"10 June 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 June 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 August 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}