{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:53:24Z","timestamp":1760151204535,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T00:00:00Z","timestamp":1645574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009776","name":"McMaster University","doi-asserted-by":"publisher","award":["25000"],"award-info":[{"award-number":["25000"]}],"id":[{"id":"10.13039\/100009776","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Canonical Correlation Analysis (CCA) is a classic multivariate statistical technique, which can be used to find a projection pair that maximally captures the correlation between two sets of random variables. The present paper introduces a CCA-based approach for image retrieval. It capitalizes on feature maps induced by two images under comparison through a pre-trained Convolutional Neural Network (CNN) and leverages basis vectors identified through CCA, together with an element-wise selection method based on a Chernoff-information-related criterion, to produce compact transformed image features; a binary hypothesis test regarding the joint distribution of transformed feature pair is then employed to measure the similarity between two images. The proposed approach is benchmarked against two alternative statistical methods, Linear Discriminant Analysis (LDA) and Principal Component Analysis with whitening (PCAw). Our CCA-based approach is shown to achieve highly competitive retrieval performances on standard datasets, which include, among others, Oxford5k and Paris6k.<\/jats:p>","DOI":"10.3390\/info13030106","type":"journal-article","created":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T22:54:02Z","timestamp":1645656842000},"page":"106","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Image Retrieval via Canonical Correlation Analysis and Binary Hypothesis Testing"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9949-4252","authenticated-orcid":false,"given":"Kangdi","family":"Shi","sequence":"first","affiliation":[{"name":"The Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4S1, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6377-4730","authenticated-orcid":false,"given":"Xiaohong","family":"Liu","sequence":"additional","affiliation":[{"name":"The Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4S1, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7586-2631","authenticated-orcid":false,"given":"Muhammad","family":"Alrabeiah","sequence":"additional","affiliation":[{"name":"The Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4S1, Canada"}]},{"given":"Xintong","family":"Guo","sequence":"additional","affiliation":[{"name":"The Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4S1, Canada"}]},{"given":"Jie","family":"Lin","sequence":"additional","affiliation":[{"name":"The Institute for Infocomm Research, A-STAR, Singapore 138632, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7155-3663","authenticated-orcid":false,"given":"Huan","family":"Liu","sequence":"additional","affiliation":[{"name":"The Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4S1, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8084-9332","authenticated-orcid":false,"given":"Jun","family":"Chen","sequence":"additional","affiliation":[{"name":"The Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON L8S 4S1, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,23]]},"reference":[{"key":"ref_1","unstructured":"Wengang, Z., Houqiang, L., and Qi, T. (2017). Recent advance in content-based image retrieval: A literature survey. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1109\/TIP.2010.2042645","article-title":"Enhanced local texture feature sets for face recognition under difficult lighting conditions","volume":"19","author":"Tan","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ojansivu, V., and Heikkil\u00e4, J. (2008). Blur insensitive texture classification using local phase quantization. International Conference on Image and Signal Processing, Springer.","DOI":"10.1007\/978-3-540-69905-7_27"},{"key":"ref_6","first-page":"886","article-title":"Histograms of oriented gradients for human detection","volume":"1","author":"Dalal","year":"2005","journal-title":"IEEE Conf. Comput. Vis. Pattern Recognit."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Batool, A., Nisar, M.W., Shah, J.H., Khan, M.A., and El-Latif, A.A.A. (Big Data, 2022). iELMNet: Integrating novel improved extreme learning machine and convolutional neural network model for traffic sign detection, Big Data, ahead of print.","DOI":"10.1089\/big.2021.0279"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Nawaz, M., Nazir, T., Javed, A., Tariq, U., Yong, H.-S., Khan, M.A., and Cha, J. (2022). An efficient deep learning approach to automatic glaucoma detection using optic disc and optic cup localization. Sensors, 22.","DOI":"10.3390\/s22020434"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Razavian, A.S., Azizpour, H., Sullivan, J., and Carlsson, S. (2014, January 23\u201328). CNN features off-the-shelf: An astounding baseline for recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.131"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Khan, M.A., Muhammad, K., Sharif, M., Akram, T., and Kadry, S. (2021). Intelligent fusion-assisted skin lesion localization and classification for smart healthcare. Neural Comput. Appl., 1\u201316.","DOI":"10.1007\/s00521-021-06490-w"},{"key":"ref_11","unstructured":"Tolias, G., Sicre, R., and J\u00e9gou, H. (2015). Particular object retrieval with integral max-pooling of CNN activations. arXiv."},{"key":"ref_12","unstructured":"Babenko, A., and Lempitsky, V. (2015, January 7\u201313). Aggregating local deep features for image retrieval. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1968","DOI":"10.1109\/TMM.2017.2713410","article-title":"Hnip: Compact deep invariant representations for video matching, localization, and retrieval","volume":"19","author":"Lin","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kalantidis, Y., Mellina, C., and Osindero, S. (2016). Cross-dimensional weighting for aggregated deep convolutional features. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46604-0_48"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Azhar, I., Sharif, M., Raza, M., Khan, M.A., and Yong, H.-S. (2021). A decision support system for face sketch synthesis using deep learning and artificial intelligence. Sensors, 21.","DOI":"10.3390\/s21248178"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Khan, S., Khan, M.A., Alhaisoni, M., Tariq, U., Yong, H.-S., Armghan, A., and Alenezi, F. (2021). Human action recognition: A paradigm of best deep learning features selection and serial based extended fusion. Sensors, 21.","DOI":"10.3390\/s21237941"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Noh, H., Araujo, A., Sim, J., Weyand, T., and Han, B. (2017, January 22\u201329). Largescale image retrieval with attentive deep local features. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.374"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., and Sivic, J. (2016, January 26\u201330). NetVLAD: CNN architecture for weakly supervised place recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.572"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Radenovi\u0107, F., Tolias, G., and Chum, O. (2016). CNN image retrieval learns from bow: Unsupervised fine-tuning with hard examples. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s11263-017-1016-8","article-title":"End-to-end learning of deep visual representations for image retrieval","volume":"124","author":"Gordo","year":"2017","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hyv\u00e4rinen, A., Hurri, J., and Hoyer, P.O. (2009). Principal components and whitening. Natural Image Statistics, Springer.","DOI":"10.1007\/978-1-84882-491-1"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Izenman, A.J. (2013). Linear discriminant analysis. Modern Multivariate Statistical Techniques, Springer.","DOI":"10.1007\/978-0-387-78189-1_8"},{"key":"ref_23","unstructured":"Johnson, R.A., and Wichern, D.W. (2018). Canonical correlation analysis. Applied Multivariate Statistical Analysis, Pearson. [6th ed.]."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1007\/s11263-013-0658-4","article-title":"A multi-view embedding space for modeling internet images, tags, and their semantics","volume":"106","author":"Gong","year":"2014","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yan, F., and Mikolajczyk, K. (2015, January 7\u201312). Deep correlation for matching images and text. Proceedings of the Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298966"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s13735-018-0151-5","article-title":"End-to-end cross-modality retrieval with cca projections and pairwise ranking loss","volume":"7","author":"Dorfer","year":"2018","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yu, Y., Tang, S., Aizawa, K., and Aizawa, A. (2018). Category-based deep cca for fine-grained venue discovery from multimodal data. arXiv.","DOI":"10.1109\/TNNLS.2018.2856253"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lin, Z., and Peltonen, J. (2017). An information retrieval approach for finding dependent subspaces of multiple views. International Conference on Machine Learning and Data Mining in Pattern Recognition, Springer.","DOI":"10.1007\/978-3-319-62416-7_1"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1109\/TSP.2016.2628348","article-title":"Local canonical correlation analysis for nonlinear common variables discovery","volume":"65","author":"Yair","year":"2017","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_30","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_31","unstructured":"Abdi, H. (2007). The eigen-decomposition: Eigenvalues and eigenvectors. Encyclopedia of Measurement and Statistics, SAGE Publications, Inc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/LSP.2013.2243726","article-title":"An information-geometric characterization of chernoff information","volume":"20","author":"Nielsen","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_33","unstructured":"Nielsen, F. (2011). Chernoff information of exponential families. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Prince, S.J. (2012). Common probability distribution. Computer Vision: Models, Learning and Inference, Cambridge University Press.","DOI":"10.1017\/CBO9780511996504"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Radenovi\u0107, F., Tolias, G., and Chum, O. (2018). Fine-tuning CNN image retrieval with no human annotation. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers.","DOI":"10.1109\/TPAMI.2018.2846566"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., Radenovic, F., Chum, O., and Frahm, J.-M. (2015, January 7\u201312). From single image query to detailed 3d reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299148"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1109\/TVCG.2004.17","article-title":"Robust linear dimensionality reduction","volume":"10","author":"Koren","year":"2004","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, T., Zhu, S., and Ogihara, M. (2003). Using discriminant analysis for multi-class classification. Third IEEE International Conference on Data Mining, IEEE Computer Society.","DOI":"10.1109\/ICDM.2003.1250984"},{"key":"ref_39","unstructured":"Mirkes, E.M., Gorban, A.N., and Zinoviev, A. (2021, September 10). A Supervised PCA. Available online: https:\/\/github.com\/Mirkes\/SupervisedPCA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","article-title":"The use of multiple measurements in taxonomic problems","volume":"7","author":"Fisher","year":"1936","journal-title":"Ann. Eugen."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1109\/34.531802","article-title":"Using discriminant eigenfeatures for image retrieval","volume":"8","author":"Swets","year":"1996","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2007, January 17\u201322). Object retrieval with large vocabularies and fast spatial matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383172"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2008, January 23\u201328). Lost in quantization: Improving particular object retrieval in large scale image databases. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587635"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Radenovic, F., Iscen, A., Tolias, G., Avrithis, Y., and Chum, O. (2018, January 18\u201323). Revisiting oxford and paris: Large-scale image retrieval benchmarking. Proceedings of the IEEE Computer Vision and Pattern Recognition Conference, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00598"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/3\/106\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:25:33Z","timestamp":1760135133000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/3\/106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,23]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["info13030106"],"URL":"https:\/\/doi.org\/10.3390\/info13030106","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2022,2,23]]}}}