{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T10:26:32Z","timestamp":1760955992511,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,10,25]],"date-time":"2019-10-25T00:00:00Z","timestamp":1571961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Image retrieval based on a convolutional neural network (CNN) has attracted great attention among researchers because of the high performance. The pooling method has become a research hotpot in the task of image retrieval in recent years. In this paper, we propose the feature distribution entropy (FDE) to measure the difference of regional distribution information in the feature maps from CNNs. We propose a novel pooling method, which fuses our proposed FDE with region maximum activations of convolutions (R-MAC) features to improve the performance of image retrieval, as it takes the advantage of regional distribution information in the feature maps. Compared with the descriptors computed by R-MAC pooling, our proposed method considers not only the most significant feature values of each region in feature map, but also the distribution difference in different regions. We utilize the histogram of feature values to calculate regional distribution entropy and concatenate the regional distribution entropy into FDE, which is further normalized and fused with R-MAC feature vectors by weighted summation to generate the final feature descriptors. We have conducted experiments on public datasets and the results demonstrate that our proposed method could produce better retrieval performances than existing state-of-the-art algorithms. Further, higher performance could be achieved by performing these post-processing on the improved feature descriptors.<\/jats:p>","DOI":"10.3390\/e21111037","type":"journal-article","created":{"date-parts":[[2019,10,25]],"date-time":"2019-10-25T11:05:18Z","timestamp":1572001518000},"page":"1037","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Fusing Feature Distribution Entropy with R-MAC Features in Image Retrieval"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0196-7913","authenticated-orcid":false,"given":"Pingping","family":"Liu","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"},{"name":"Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China"},{"name":"School of Mechanical Science and Engineering, Jilin University, Changchun 130025, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guixia","family":"Gou","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huili","family":"Guo","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongwei","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiuzhan","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Communication Engineering, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,25]]},"reference":[{"key":"ref_1","first-page":"22","article-title":"A Survey On: Content Based Image Retrieval Systems","volume":"4","author":"Singhai","year":"2010","journal-title":"Int. J. Comput. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1109\/34.895972","article-title":"Content-based image retrieval at the end of the early","volume":"22","author":"Smeulders","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1109\/TPAMI.2017.2709749","article-title":"SIFT Meets CNN: A Decade Survey of Instance Retrieval","volume":"40","author":"Zheng","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Duanmu, X. (2010, January 12\u201314). Image Retrieval Using Color Moment Invariant. Proceedings of the International Conference on Information Technology: New Generations, Las Vegas, NV, USA.","DOI":"10.1109\/ITNG.2010.231"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sivic, J., and Zisserman, A. (2003, January 13\u201316). Video Google: a text retrieval approach to object matching in videos. Proceedings of the Ninth IEEE International Conference on Computer Vision 2003, Nice, France.","DOI":"10.1109\/ICCV.2003.1238663"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Jegou, H., Douze, M., Schmid, C., and Perez, P. (2010, January 13\u201318). Aggregating local descriptors into a compact image representation. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540039"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1704","DOI":"10.1109\/TPAMI.2011.235","article-title":"Aggregating Local Image Descriptors into Compact Codes","volume":"34","author":"Jegou","year":"2012","journal-title":"Proc. IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","first-page":"1097","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"141","author":"Krizhevsky","year":"2012","journal-title":"Neural Inf. Process. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ng, J.Y.-H., Yang, F., and Davis, L.S. (2015, January 7\u201312). Exploiting local features from deep networks for image retrieval. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301272"},{"key":"ref_12","first-page":"251","article-title":"Visual Instance Retrieval with Deep Convolutional Networks","volume":"4","author":"Razavian","year":"2016","journal-title":"ITE Trans. Media Technol. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y.Q., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.neucom.2017.03.072","article-title":"Content-based image retrieval with compact deep convolutional features","volume":"249","author":"Amira","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yandex, A.B., and Lempitsky, V. (2015, January 7\u201313). Aggregating Local Deep Features for Image Retrieval. Proceedings of the IEEE International Conference on Computer Vision ICCV, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.150"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., and Sivic, J. (2016, January 27\u201330). NetVLAD: CNN architecture for weakly supervised place recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.572"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Razavian, A.S., Azizpour, H., Sullivan, J., and Carlsson, S. (2014, January 23\u201328). CNN Features off-the-shelf: An Astounding Baseline for Recognition. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.131"},{"key":"ref_18","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the Neural Information Processing Systems Conference, Montreal, QC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015). Fast R-CNN. arXiv.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_20","first-page":"392","article-title":"Multi-scale Orderless Pooling of Deep Convolutional Activation Features","volume":"8695","author":"Gong","year":"2014","journal-title":"Comput. Vis. ECCV"},{"key":"ref_21","unstructured":"Mousavian, A., and Kosecka, J. (2015). Deep Convolutional Features for Image Based Retrieval and Scene Categorization. arXiv."},{"key":"ref_22","unstructured":"Babenko, A., and Lempitsky, V. (2015). Aggregating Deep Convolutional Features for Image Retrieval. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kalantidis, Y., Mellina, C., and Osindero, S. (2016, January 8\u201316). Cross-Dimensional Weighting for Aggregated Deep Convolutional Features. Proceedings of the European Conference on Computer Vision 2016, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46604-0_48"},{"key":"ref_24","unstructured":"Tolias, G., Sicre, R., and J\u00e9gou, H. (2015). Particular object retrieval with integral max-pooling of CNN activations. arXiv."},{"key":"ref_25","first-page":"1655","article-title":"Fine-tuning CNN Image Retrieval with No Human Annotation","volume":"41","author":"Tolias","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mohedano, E., Salvador, A., Mcguinness, K., Marques, F., O\u2019Connor, N.E., and Giro-I-Nieto, X. (2016, January 6\u20139). Bags of Local Convolutional Features for Scalable Instance Search. Proceedings of the ACM on International Conference on Multimedia Retrieval, New York, NY, USA.","DOI":"10.1145\/2911996.2912061"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2007, January 17\u201322). Object retrieval with large vocabularies and fast spatial matching. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383172"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chum, O., Philbin, J., Sivic, J., Isard, M., and Zisserman, A. (2007, January 14\u201321). Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval. Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408891"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chum, O., Mikulik, A., Perdoch, M., and Matas, J. (2011, January 20\u201325). Total recall II: Query expansion revisited. Proceedings of the Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995601"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation, Springer.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_31","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2011, January 20\u201325). Fully convolutional networks for semantic segmentation. Proceedings of the Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_32","unstructured":"Hao, J., Wei, W., Jing, D., and Tan, T. (2017, January 10\u201314). MFC: A multi-scale fully convolutional approach for visual instance retrieval. Proceedings of the IEEE International Conference on Multimedia & Expo Workshops, Hong Kong, China."},{"key":"ref_33","first-page":"1","article-title":"A Novel Image Retrieval Based on a Combination of Local and Global Histograms of Visual Words","volume":"2016","author":"Objects","year":"2016","journal-title":"Math. Probl. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Krapac, J., Verbeek, J., and Jurie, F. (2011, January 6\u201313). Modeling spatial layout with fisher vectors for image categorization. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126406"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Koniusz, P., and Mikolajczyk, K. (2011, January 11\u201314). Spatial Coordinate Coding to reduce histogram representations, Dominant Angle and Colour Pyramid Match. Proceedings of the IEEE International Conference on Image Processing, Brussels, Belgium.","DOI":"10.1109\/ICIP.2011.6116639"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2216","DOI":"10.1016\/j.patrec.2012.07.019","article-title":"Modeling the spatial layout of images beyond spatial pyramids","volume":"33","author":"Perronnin","year":"2012","journal-title":"Pattern Recogn. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s13640-018-0247-0","article-title":"Adding spatial distribution clue to aggregated vector in image retrieval","volume":"2018","author":"Liu","year":"2018","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Jegou, H., and Chum, O. (2012, January 7\u201313). Negative evidences and co-occurences in image retrieval: The benefit of PCA and whitening. Proceedings of the European Conference on Computer Vision, Firenze, Italy.","DOI":"10.1007\/978-3-642-33709-3_55"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gordo, A., and Larlus, D. (2017, January 21\u201326). Beyond instance-level image retrieval: Leveraging captions to learn a global visual representation for semantic retrieval. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.560"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Mikolajczyk, K., and Matas, J. (2007, January 14\u201321). Improving Descriptors for Fast Tree Matching by Optimal Linear Projection. Proceedings of the International Conference on Computer Vision, Rio De Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408871"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2008, January 23\u201328). Lost in Quantization: Improving Particular Object Retrieval in Large Scale Image Databases. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587635"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., and Lenc, K. (2014). MatConvNet\u2014Convolutional Neural Networks for MATLAB. arXiv.","DOI":"10.1145\/2733373.2807412"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.F. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jegou, H., Douze, M., and Schmid, C. (2008, January 12\u201318). Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search. Proceedings of the European Conference on Computer Vision, Marseille, France.","DOI":"10.1007\/978-3-540-88682-2_24"},{"key":"ref_47","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_48","unstructured":"Jun, C. (2017). Brain Tumor Dataset. Figshare."},{"key":"ref_49","unstructured":"Zhang, Z., Yin, F.S., Liu, J., Wong, W.K.D., Tan, N.M., Lee, B.H., Cheng, J., and Wong, T.Y. (September, January 31). ORIGA-light: An online retinal fundus image database for glaucoma analysis and research. Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society, Buenos Aires, Argentina."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/11\/1037\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:29:20Z","timestamp":1760189360000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/11\/1037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,25]]},"references-count":49,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["e21111037"],"URL":"https:\/\/doi.org\/10.3390\/e21111037","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,10,25]]}}}