{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T06:00:21Z","timestamp":1783404021511,"version":"3.54.6"},"reference-count":50,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,4,2]],"date-time":"2021-04-02T00:00:00Z","timestamp":1617321600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61801444"],"award-info":[{"award-number":["61801444"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61701452"],"award-info":[{"award-number":["61701452"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"State Key Laboratory of Integrated Services Networks (Xidian University)","award":["ISN20-07"],"award-info":[{"award-number":["ISN20-07"]}]},{"name":"Hong Kong Scholars Program","award":["XJ2018012"],"award-info":[{"award-number":["XJ2018012"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recently, deep learning has developed rapidly, while it has also been quite successfully applied in the field of hyperspectral classification. Generally, training the parameters of a deep neural network to the best is the core step of a deep learning-based method, which usually requires a large number of labeled samples. However, in remote sensing analysis tasks, we only have limited labeled data because of the high cost of their collection. Therefore, in this paper, we propose a deep metric learning with online hard mining (DMLOHM) method for hyperspectral classification, which can maximize the inter-class distance and minimize the intra-class distance, utilizing a convolutional neural network (CNN) as an embedded network. First of all, we utilized the triplet network to learn better representations of raw data so that raw data were capable of having their dimensionality reduced. Afterward, an online hard mining method was used to mine the most valuable information from the limited hyperspectral data. To verify the performance of the proposed DMLOHM, we utilized three well-known hyperspectral datasets: Salinas Scene, Pavia University, and HyRANK for verification. Compared with CNN and DMLTN, the experimental results showed that the proposed method improved the classification accuracy from 0.13% to 4.03% with 85 labeled samples per class.<\/jats:p>","DOI":"10.3390\/rs13071368","type":"journal-article","created":{"date-parts":[[2021,4,2]],"date-time":"2021-04-02T10:34:09Z","timestamp":1617359649000},"page":"1368","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Deep Metric Learning with Online Hard Mining for Hyperspectral Classification"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0592-7887","authenticated-orcid":false,"given":"Yanni","family":"Dong","sequence":"first","affiliation":[{"name":"Hubei Subsurface Multi-Scale Imaging Key Laboratory, Institute of Geophysics and Geomatics, China University of Geosciences, Wuhan 430074, China"},{"name":"Key Laboratory of Intelligent Computing &amp; Signal Processing, Ministry of Education, Anhui University, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cong","family":"Yang","sequence":"additional","affiliation":[{"name":"Hubei Subsurface Multi-Scale Imaging Key Laboratory, Institute of Geophysics and Geomatics, China University of Geosciences, Wuhan 430074, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2913-3515","authenticated-orcid":false,"given":"Yuxiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Hubei Subsurface Multi-Scale Imaging Key Laboratory, Institute of Geophysics and Geomatics, China University of Geosciences, Wuhan 430074, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"044516","DOI":"10.1117\/1.JRS.13.044516","article-title":"Hyperspectral imaging and neural networks to classify herbicide-resistant weeds","volume":"13","author":"Scherrer","year":"2019","journal-title":"J. Appl. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"120987","DOI":"10.1016\/j.jhazmat.2019.120987","article-title":"Estimation of the spatial distribution of heavy metal in agricultural soils using airborne hyperspectral imaging and random forest","volume":"382","author":"Tan","year":"2020","journal-title":"J. Hazard. Mater."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tu\u015fa, L., Khodadadzadeh, M., Contreras, C., Rafiezadeh Shahi, K., Fuchs, M., Gloaguen, R., and Gutzmer, J. (2020). Drill-Core Mineral Abundance Estimation Using Hyperspectral and High-Resolution Mineralogical Data. Remote Sens., 12.","DOI":"10.3390\/rs12071218"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"046516","DOI":"10.1117\/1.JRS.13.046516","article-title":"Local similarity constraint-based sparse algorithm for hyperspectral target detection","volume":"13","author":"Li","year":"2019","journal-title":"J. Appl. Remote. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Richards, J.A. (2013). Clustering and unsupervised classification. Remote Sensing Digital Image Analysis, Springer.","DOI":"10.1007\/978-3-642-30062-2"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1016\/S0893-6080(00)00026-5","article-title":"Independent component analysis: Algorithms and applications","volume":"13","author":"Oja","year":"2000","journal-title":"Neural Netw."},{"key":"ref_9","unstructured":"Bennett, K.P., and Demiriz, A. (1999). Semi-supervised support vector machines. Advances in Neural Information Processing Systems, Mitt Press."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.patcog.2016.09.006","article-title":"Sequential dimensionality reduction for extracting localized features","volume":"63","author":"Casalino","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_12","unstructured":"Mika, S., Ratsch, G., Weston, J., Scholkopf, B., and Mullers, K.-R. (1999, January 25\u201325). Fisher discriminant analysis with kernels. Proceedings of the Neural Networks for Signal Processing IX: Proceedings of the IEEE Signal Processing Society Workshop (Cat. No. 98th8468), Madison, WI, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2385","DOI":"10.1162\/089976600300014980","article-title":"Generalized Discriminant Analysis Using a Kernel Approach","volume":"12","author":"Baudat","year":"2000","journal-title":"Neural Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1162\/089976698300017467","article-title":"Nonlinear Component Analysis as a Kernel Eigenvalue Problem","volume":"10","author":"Smola","year":"1998","journal-title":"Neural Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4816","DOI":"10.1109\/TGRS.2012.2230268","article-title":"Generalized composite kernel framework for hyperspectral image classification","volume":"51","author":"Li","year":"2013","journal-title":"IEEE Transact. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the mean accuracy of statistical pattern recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_17","unstructured":"Han, J., Yao, X., Cheng, G., Feng, X., and Xu, D. (2020). P-CNN: Part-Based Convolutional Neural Networks for Fine-Grained Visual Categorization. IEEE Trans. Pattern Anal. Mach. Intell., 1."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.patrec.2017.06.012","article-title":"Back projection: An effective postprocessing method for GAN-based face sketch synthesis","volume":"107","author":"Wang","year":"2018","journal-title":"Pattern Recognit. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3235","DOI":"10.1109\/TII.2018.2809730","article-title":"Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling With Variable-Wise Weighted SAE","volume":"14","author":"Yuan","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A Fast Learning Algorithm for Deep Belief Nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep Recurrent Neural Networks for Hyperspectral Image Classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2015\/258619","article-title":"Deep Convolutional Neural Networks for Hyperspectral Image Classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through convolutional neural networks. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network. Remote. Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2016.2616355","article-title":"Hyperspectral Image Classification Using Deep Pixel-Pair Features","volume":"55","author":"Li","year":"2016","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2017.11.003","article-title":"MugNet: Deep learning for hyperspectral image classification using limited samples","volume":"145","author":"Pan","year":"2018","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1109\/TIP.2017.2772836","article-title":"Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification","volume":"27","author":"Wu","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cheng, G., Xie, X., Han, J., Guo, L., and Xia, G.-S. (2020). Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities. arXiv, Available online: https:\/\/ieeexplore.ieee.org\/document\/9127795.","DOI":"10.1109\/JSTARS.2020.3005403"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7894","DOI":"10.1109\/TGRS.2019.2917161","article-title":"A Feature Aggregation Convolutional Neural Network for Remote Sensing Scene Classification","volume":"57","author":"Lu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1109\/TGRS.2017.2783902","article-title":"When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs","volume":"56","author":"Cheng","year":"2018","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.patcog.2017.03.030","article-title":"Locality constraint distance metric learning for traffic congestion detection","volume":"75","author":"Wang","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_32","first-page":"207","article-title":"Distance metric learning for large margin nearest neighbor classification","volume":"10","author":"Weinberger","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sundermeyer, M., Schl\u00fcter, R., and Ney, H. (2012, January 9\u201313). LSTM neural networks for language modeling. Proceedings of the Thirteenth Annual Conference of the International Speech Communication Association, Portland, OR, USA.","DOI":"10.21437\/Interspeech.2012-65"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TNN.2008.2005605","article-title":"The Graph Neural Network Model","volume":"20","author":"Scarselli","year":"2009","journal-title":"IEEE Trans. Neural Networks"},{"key":"ref_35","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, Mitt Press."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hoffer, E., and Ailon, N. (2015). Deep metric learning using triplet network. International Workshop on Similarity-Based Pattern Recognition, Springer.","DOI":"10.1007\/978-3-319-24261-3_7"},{"key":"ref_37","unstructured":"Hadsell, R., Chopra, S., and LeCun, Y. (2006, January 17\u201322). Dimensionality reduction by learning an invariant mapping. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1422","DOI":"10.1109\/TGRS.2019.2946318","article-title":"Deep Metric Learning-Based Feature Embedding for Hyperspectral Image Classification","volume":"58","author":"Deng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kaya, M., and Bilge, H. (2019). \u015eakir Deep Metric Learning: A Survey. Symmetry, 11.","DOI":"10.3390\/sym11091066"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2766959","article-title":"Learning visual similarity for product design with convolutional neural networks","volume":"34","author":"Bell","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.patcog.2017.11.008","article-title":"Random sampling for fast face sketch synthesis","volume":"76","author":"Wang","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Simo-Serra, E., Trulls, E., Ferraz, L., Kokkinos, I., Fua, P., and Moreno-Noguer, F. (2015, January 7\u201313). Discriminative learning of deep convolutional feature point descriptors. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.22"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_44","unstructured":"Manmatha, R., Wu, C., Smola, A.J., and Krahenbuhl, P. (2017, January 22\u201329). Sampling Matters in Deep Embedding Learning. Proceedings of the International Conference on Computer Vision, Venice, Italy."},{"key":"ref_45","unstructured":"Hermans, A., Beyer, L., and Leibe, B. (2017). In Defense of the Triplet Loss for Person Re-Identification. arXiv, Available online: https:\/\/arxiv.org\/abs\/1703.07737."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2509","DOI":"10.1109\/TGRS.2016.2645703","article-title":"Dimensionality reduction and classification of hyperspectral images using ensemble discriminative local metric learning","volume":"55","author":"Dong","year":"2017","journal-title":"IEEE Transact. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1109\/TGRS.2014.2345739","article-title":"Multiple Feature Learning for Hyperspectral Image Classification","volume":"53","author":"Li","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.neucom.2019.05.019","article-title":"Hyperspectral imagery classification with deep metric learning","volume":"356","author":"Cao","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_49","unstructured":"Lennon, R. (2002). Remote Sensing Digital Image Analysis: An Introduction, Esa\/Esrin."},{"key":"ref_50","unstructured":"Dong, Y., Liang, T., Zhang, Y., and Du, B. (2020). Spectral-Spatial Weighted Kernel Manifold Embedded Distribution Alignment for Remote Sensing Image Classification. IEEE Trans. Cybern., 1\u201313."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/7\/1368\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:33:39Z","timestamp":1760362419000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/7\/1368"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,2]]},"references-count":50,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["rs13071368"],"URL":"https:\/\/doi.org\/10.3390\/rs13071368","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,2]]}}}