{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:17:26Z","timestamp":1760231846124,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,10,9]],"date-time":"2022-10-09T00:00:00Z","timestamp":1665273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42271481","41861048"],"award-info":[{"award-number":["42271481","41861048"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"High Performance Computing Platform of Central South University and HPC Central of Department of GIS","award":["42271481","41861048"],"award-info":[{"award-number":["42271481","41861048"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>With the rapid development of remote sensing technology and the growing demand for applications, the classical deep learning-based object detection model is bottlenecked in processing incremental data, especially in the increasing classes of detected objects. It requires models to sequentially learn new classes of objects based on the current model, while preserving old categories-related knowledge. Existing class-incremental detection methods achieve this goal mainly by constraining the optimization trajectory in the feature of output space. However, these works neglect the case where the previously learned background is a new category to learn, resulting in performance degradation in the new category because of the conflict between remaining the background-related knowledge or updating the background-related knowledge. This paper proposes a novel class-incremental detection method incorporated with the teacher-student architecture and the selective distillation (SDCID) strategy. Specifically, it is the asymmetry architecture, i.e., the teacher network temporarily stores historical knowledge of previously learned objects, and the student network integrates historical knowledge from the teacher network with the newly learned object-related knowledge, respectively. This asymmetry architecture reveals the significance of the distinct representation of history knowledge and new knowledge in incremental detection. Furthermore, SDCID selectively masks the shared subobject of new images to learn and previously learned background, while learning new categories of images and then transfers the classification results of the student model to the background class following the judgment model of the teacher model. This manner avoids interferences between the background category-related knowledge from a teacher model and the learning of other new classes of objects. In addition, we proposed a new incremental learning evaluation metric, C-SP, to comprehensively evaluate the incremental learning stability and plasticity performance. We verified the proposed method on two object detection datasets of remote sensing images, i.e., DIOR and DOTA. The experience results in accuracy and C-SP suggest that the proposed method surpasses existing class-incremental detection methods. We further analyzed the influence of the mask component in our method and the hyper-parameters sensitive to our method.<\/jats:p>","DOI":"10.3390\/sym14102100","type":"journal-article","created":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T03:32:56Z","timestamp":1665459176000},"page":"2100","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Class-Incremental Detection Method of Remote Sensing Images Based on Selective Distillation"],"prefix":"10.3390","volume":"14","author":[{"given":"Hang","family":"Ruan","sequence":"first","affiliation":[{"name":"Beijing Institute of Tracking and Communication Technology, Beijing 100094, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1820-4015","authenticated-orcid":false,"given":"Jian","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Geosciences and Info-Physics, Central South University, Changsha 410083, China"}]},{"given":"Ye","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Geosciences and Info-Physics, Central South University, Changsha 410083, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0144-2524","authenticated-orcid":false,"given":"Silu","family":"He","sequence":"additional","affiliation":[{"name":"School of Geosciences and Info-Physics, Central South University, Changsha 410083, China"}]},{"given":"Zhenshi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Undergraduate School, National University of Defense Technology, Changsha 410080, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1173-6593","authenticated-orcid":false,"given":"Haifeng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Geosciences and Info-Physics, Central South University, Changsha 410083, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.isprsjprs.2016.03.014","article-title":"A survey on object detection in optical remote sensing images","volume":"117","author":"Cheng","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","first-page":"7","article-title":"Remote Sensing Military Target Detection Algorithm Based on Lightweight YOLOv3","volume":"57","author":"Qin","year":"2021","journal-title":"Comput. Eng. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/S0079-7421(08)60536-8","article-title":"Catastrophic interference in connectionist networks: The sequential learning problem","volume":"Volume 24","author":"McCloskey","year":"1989","journal-title":"Psychology of Learning and Motivation"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1037\/0033-295X.97.2.285","article-title":"Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions","volume":"97","author":"Ratcliff","year":"1990","journal-title":"Psychol. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/S1364-6613(99)01294-2","article-title":"Catastrophic forgetting in connectionist networks","volume":"3","author":"French","year":"1999","journal-title":"Trends Cogn. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shmelkov, K., Schmid, C., and Alahari, K. (2017, January 22\u201329). Incremental learning of object detectors without catastrophic forgetting. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.368"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, D., Tasci, S., Ghosh, S., Zhu, J., Zhang, J., and Heck, L. (2019, January 7\u20139). RILOD: Near real-time incremental learning for object detection at the edge. Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing, Arlington, VI, USA.","DOI":"10.1145\/3318216.3363317"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xia, G.S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., and Zhang, L. (2018, January 18\u201323). DOTA: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00418"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.patrec.2020.09.030","article-title":"Faster ilod: Incremental learning for object detectors based on faster rcnn","volume":"140","author":"Peng","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_10","unstructured":"Shuai, T., Sun, K., Shi, B., and Chen, J. (2016, January 4\u20136). A ship target automatic recognition method for sub-meter remote sensing images. Proceedings of the 2016 4th International Workshop on Earth Observation and Remote Sensing Applications (EORSA), Guangzhou, China."},{"key":"ref_11","first-page":"4511","article-title":"Ship detection in high-resolution optical imagery based on anomaly detector and local shape feature","volume":"52","author":"Shi","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1109\/JSTARS.2016.2602439","article-title":"Building detection using enhanced HOG\u2013LBP features and region refinement processes","volume":"10","author":"Konstantinidis","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2327","DOI":"10.1109\/JSTARS.2013.2242846","article-title":"Airborne vehicle detection in dense urban areas using HoG features and disparity maps","volume":"6","author":"Tuermer","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zheng, J., Xi, Y., Feng, M., Li, X., and Li, N. (2016, January 15\u201317). Object detection based on BING in optical remote sensing images. Proceedings of the 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Datong, China.","DOI":"10.1109\/CISP-BMEI.2016.7852763"},{"key":"ref_15","unstructured":"Song, Z., Sui, H., and Wang, Y. (2014, January 8\u20139). Automatic ship detection for optical satellite images based on visual attention model and LBP. Proceedings of the 2014 IEEE Workshop on Electronics, Computer and Applications, Ottawa, ON, Canada."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_21","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst., 28."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yang, X., Yan, J., Liao, W., Yang, X., Tang, J., and He, T. (2022). Scrdet++: Detecting small, cluttered and rotated objects via instance-level feature denoising and rotation loss smoothing. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2022.3166956"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, J., Ding, J., Guo, H., Cheng, W., Pan, T., and Yang, W. (2019). Mask OBB: A semantic attention-based mask oriented bounding box representation for multi-category object detection in aerial images. Remote Sens., 11.","DOI":"10.3390\/rs11242930"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yang, F., Li, W., Hu, H., Li, W., and Wang, P. (2020). Multi-scale feature integrated attention-based rotation network for object detection in VHR aerial images. Sensors, 20.","DOI":"10.3390\/s20061686"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, C., Xu, C., Cui, Z., Wang, D., Zhang, T., and Yang, J. (2019, January 22\u201325). Feature-attentioned object detection in remote sensing imagery. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803521"},{"key":"ref_28","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv, 2."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","article-title":"Learning without forgetting","volume":"40","author":"Li","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dhar, P., Singh, R.V., Peng, K.C., Wu, Z., and Chellappa, R. (2019, January 15\u201320). Learning without memorizing. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00528"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Douillard, A., Cord, M., Ollion, C., Robert, T., and Valle, E. (2020, January 23\u201328). Podnet: Pooled outputs distillation for small-tasks incremental learning. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58565-5_6"},{"key":"ref_32","first-page":"1","article-title":"Incremental detection of remote sensing objects with feature pyramid and knowledge distillation","volume":"60","author":"Chen","year":"2020","journal-title":"IEEE Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The pascal visual object classes (voc) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1109\/LGRS.2015.2513443","article-title":"Bag-of-visual-words scene classifier with local and global features for high spatial resolution remote sensing imagery","volume":"13","author":"Zhu","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/10\/2100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:48:30Z","timestamp":1760143710000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/10\/2100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,9]]},"references-count":34,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["sym14102100"],"URL":"https:\/\/doi.org\/10.3390\/sym14102100","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2022,10,9]]}}}