{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:56:04Z","timestamp":1760230564385,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,7,30]],"date-time":"2022-07-30T00:00:00Z","timestamp":1659139200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62076251"],"award-info":[{"award-number":["62076251"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Current distillation methods only distill between corresponding layers, and do not consider the knowledge contained in preceding layers. To solve this problem, we analyzed the guiding effect of the inferior features of a teacher model on the coordinate feature of a student model, and proposed inferior and coordinate distillation for object detectors. The proposed method utilizes the rich information contained in different layers of the teacher model; such that the student model can review the old information and learn the new information, in addition to the dark knowledge in the teacher model. Moreover, the refine module is used to align the features of different layers, distinguish the spatial and channel to extract attention, strengthen the correlation between the features of different stages, and prevent the disorder caused by merging. Exclusive experiments were conducted on different object detectors. The results for the mean average precision (mAP) obtained using Faster R-CNN, RetinaNet, and fully convolutional one-stage object detector (FCOS) with ResNet-50 as its backbone were 40.5%, 39.8%, and 42.8% with regard to the COCO dataset, respectively; which are 2.1%, 2.4%, and 4.3% higher than the benchmark, respectively.<\/jats:p>","DOI":"10.3390\/s22155719","type":"journal-article","created":{"date-parts":[[2022,8,1]],"date-time":"2022-08-01T23:49:27Z","timestamp":1659397767000},"page":"5719","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Inferior and Coordinate Distillation for Object Detectors"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1273-4397","authenticated-orcid":false,"given":"Yao","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Command and Control Engineering, Army Engineering University of PLA, Nanjing 210007, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1682-0284","authenticated-orcid":false,"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Command and Control Engineering, Army Engineering University of PLA, Nanjing 210007, China"}]},{"given":"Zhisong","family":"Pan","sequence":"additional","affiliation":[{"name":"School of Command and Control Engineering, Army Engineering University of PLA, Nanjing 210007, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,30]]},"reference":[{"key":"ref_1","unstructured":"Howard, A., Sandler, M., Chu, G., Chen, L.-C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for MobileNetV3. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Rossit, D.A., Tohm\u00e9, F., and Mej\u00eda Delgadillo, G. (2020, January 9\u201311). Study of the Location of a Second Fleet for the Brazilian Navy: Structuring and Mathematical Modeling Using SAPEVO-M and VIKOR Methods. Proceedings of the International Conference of Production Research\u2013Americas, Bah\u00eda Blanca, Argentina.","DOI":"10.1007\/978-3-030-76310-7"},{"key":"ref_3","unstructured":"Hinton, G.E., Vinyals, O., and Dean, J. (2015). Distilling the Knowledge in a Neural Network. arXiv."},{"key":"ref_4","unstructured":"Romero, A., Ballas, N., Kahou, S.E., Chassang, A., Gatta, C., and Bengio, Y. (2015, January 7\u20139). FitNets: Hints for Thin Deep Nets. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ji, M., Heo, B., and Park, S. (2021, January 2\u20139). Show, Attend and Distill: Knowledge Distillation via Attention-Based Feature Matching. Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual.","DOI":"10.1609\/aaai.v35i9.16969"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chen, P., Liu, S., Zhao, H., and Jia, J. (2021, January 19\u201325). Distilling Knowledge via Knowledge Review. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, Virtual.","DOI":"10.1109\/CVPR46437.2021.00497"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhao, B., Cui, Q., Song, R., Qiu, Y., and Liang, J. (2022, January 21\u201324). Decoupled Knowledge Distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Louisiana.","DOI":"10.1109\/CVPR52688.2022.01165"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3359","DOI":"10.1109\/TIP.2022.3170728","article-title":"Spot-Adaptive Knowledge Distillation","volume":"31","author":"Song","year":"2022","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","unstructured":"Chen, G., Choi, W., Yu, X., Han, T.X., and Chandraker, M. (2017, January 4\u20139). Learning Efficient Object Detection Models with Knowledge Distillation. Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, T., Yuan, L., Zhang, X., and Feng, J. (2019, January 16\u201320). Distilling Object Detectors With Fine-Grained Feature Imitation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00507"},{"key":"ref_11","unstructured":"Sun, R., Tang, F., Zhang, X., Xiong, H., and Tian, Q. (2020). Distilling Object Detectors with Task Adaptive Regularization. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Guo, J., Han, K., Wang, Y., Wu, H., Chen, X., Xu, C., and Xu, C. (2021, January 19\u201325). Distilling Object Detectors via Decoupled Features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, Virtual.","DOI":"10.1109\/CVPR46437.2021.00219"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal Loss for Dense Object Detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Tian, Z., Shen, C., Chen, H., and He, T. (November, January 27). FCOS: Fully Convolutional One-Stage Object Detection. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00972"},{"key":"ref_15","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, Z., Li, Z., Jiang, X., Gong, Y., Yuan, Z., Zhao, D., and Yuan, C. (2022, January 21\u201324). Focal and Global Knowledge Distillation for Detectors. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Louisiana.","DOI":"10.1109\/CVPR52688.2022.00460"},{"key":"ref_18","unstructured":"Li, G., Li, X., Wang, Y., Zhang, S., Wu, Y., and Liang, D. (March, January 22). Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation. Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022, Virtual."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shu, C., Liu, Y., Gao, J., Yan, Z., and Shen, C. (2021, January 10\u201317). Channel-Wise Knowledge Distillation for Dense Prediction. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision, ICCV 2021, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00526"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the Computer Vision\u2014ECCV 2018\u201415th European Conference, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S.J., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common Objects in Context. Proceedings of the Computer Vision\u2014ECCV 2014\u201413th European Conference, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_22","unstructured":"Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., and Xu, J. (2019). MMDetection: Open MMLab Detection Toolbox and Benchmark. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Dai, X., Jiang, Z., Wu, Z., Bao, Y., Wang, Z., Liu, S., and Zhou, E. (2021, January 19\u201325). General Instance Distillation for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, Virtual.","DOI":"10.1109\/CVPR46437.2021.00775"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5719\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:59:56Z","timestamp":1760140796000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,30]]},"references-count":23,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22155719"],"URL":"https:\/\/doi.org\/10.3390\/s22155719","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,7,30]]}}}