{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T17:38:16Z","timestamp":1772473096977,"version":"3.50.1"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"8-9","license":[{"start":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T00:00:00Z","timestamp":1579564800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T00:00:00Z","timestamp":1579564800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2020,9]]},"DOI":"10.1007\/s11263-019-01286-x","type":"journal-article","created":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T14:03:41Z","timestamp":1579615421000},"page":"2089-2106","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Learning an Evolutionary Embedding via Massive Knowledge Distillation"],"prefix":"10.1007","volume":"128","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5317-1338","authenticated-orcid":false,"given":"Xiang","family":"Wu","sequence":"first","affiliation":[]},{"given":"Ran","family":"He","sequence":"additional","affiliation":[]},{"given":"Yibo","family":"Hu","sequence":"additional","affiliation":[]},{"given":"Zhenan","family":"Sun","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,1,21]]},"reference":[{"key":"1286_CR1","unstructured":"Ba, J., & Caruana, R. (2014). Do deep nets really need to be deep? In NeurIPS."},{"key":"1286_CR2","doi-asserted-by":"crossref","unstructured":"Bromley, J., Guyon, I., LeCun, Y., S\u00e4ckinger, E., & Shah, R. (1994). Signature verification using a\u201c siamese\u201d time delay neural network. In NeurIPS.","DOI":"10.1142\/9789812797926_0003"},{"key":"1286_CR3","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wang, N., & Zhang, Z. (2018). Darkrank: Accelerating deep metric learning via cross sample similarities transfer. In AAAI.","DOI":"10.1609\/aaai.v32i1.11783"},{"key":"1286_CR4","unstructured":"Chen, J., Yi, D., Yang, J., Zhao, G., Li, S.Z., & Pietikainen, M. (2009) Learning mappings for face synthesis from near infrared to visual light images. In CVPR."},{"key":"1286_CR5","unstructured":"Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016). Binarized neural networks: Training deep neural networks with weights and activations constrained to +\u00a01 or -\u00a01. In NeurIPS."},{"key":"1286_CR6","unstructured":"Czarnecki, W. M., Osindero, S., Jaderberg, M., Swirszcz, G., & Pascanu, R. (2017). Sobolev training for neural networks. In NeurIPS."},{"key":"1286_CR7","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L. J., Li, K., & Fei-Fei, L. (2009). Imagenet: A large-scale hierarchical image database. In CVPR.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"1286_CR8","doi-asserted-by":"publisher","first-page":"2993","DOI":"10.1016\/j.patcog.2015.04.005","volume":"48","author":"S Ding","year":"2015","unstructured":"Ding, S., Lin, L., Wang, G., & Chao, H. Y. (2015). Deep feature learning with relative distance comparison for person re-identification. Pattern Recognition, 48, 2993.","journal-title":"Pattern Recognition"},{"key":"1286_CR9","doi-asserted-by":"crossref","unstructured":"Guo, Y., Zhang, L., Hu, Y., He, X., & Gao, J. (2016). Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. In ECCV.","DOI":"10.1007\/978-3-319-46487-9_6"},{"key":"1286_CR10","doi-asserted-by":"crossref","unstructured":"Guo, H., Zhao, C., Liu, Z., Wang, J., & Lu, H. (2018). Learning coarse-to-fine structured feature embedding for vehicle re-identification. In AAAI.","DOI":"10.1609\/aaai.v32i1.12237"},{"key":"1286_CR11","unstructured":"Han, S., Mao, H., & Dally, W. J. (2016). Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. In ICLR."},{"key":"1286_CR12","unstructured":"Han, S., Pool, J., Tran, J., & Dally, W. J. (2015). Learning both weights and connections for efficient neural network. In NeurIPS."},{"key":"1286_CR13","doi-asserted-by":"crossref","unstructured":"He, R., Wu, X., Sun, Z., & Tan, T. (2017). Learning invariant deep representation for nir-vis face recognition. In AAAI.","DOI":"10.1609\/aaai.v31i1.10786"},{"key":"1286_CR14","unstructured":"He, R., Wu, X., Sun, Z., & Tan, T. (2018). Wasserstein CNN: Learning invariant features for NIR-VIS face recognition. In TPAMI."},{"key":"1286_CR15","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In CVPR.","DOI":"10.1109\/CVPR.2016.90"},{"key":"1286_CR16","unstructured":"Hinton, G. E., Vinyals, O., & Dean, J. (2015). Distilling the knowledge in a neural network. In NeurIPS workshop."},{"key":"1286_CR17","unstructured":"Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., et al. (2017). Mobilenets: Efficientconvolutional neural networks for mobile vision applications. CoRR arXiv:1704.04861."},{"key":"1286_CR18","unstructured":"Huang, Z., & Wang, N. (2017). Like what you like: Knowledge distill via neuron selectivity transfer. CoRR arXiv:1707.01219."},{"key":"1286_CR19","unstructured":"Huang, C., Loy, C. C., & Tang, X. (2016). Local similarity-aware deep feature embedding. In NeurIPS."},{"key":"1286_CR20","unstructured":"Huang, G. B., Ramesh, M., Berg, T., & Learned-Miller, E. (2007). Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst."},{"key":"1286_CR21","unstructured":"Huang, D., Sun, J., & Wang, Y. (2012). The BUAA-VisNir face database instructions. Technical Report IRIP-TR-12-FR-001, Beihang University, Beijing, China"},{"key":"1286_CR22","unstructured":"Iandola, F. N., Moskewicz, M. W., Ashraf, K., Han, S., Dally, W. J., & Keutzer, K. (2016). Squeezenet: Alexnet-level accuracy with 50x fewer parameters and$$<$$1\u00a0mb model size. CoRR arXiv:1602.07360."},{"key":"1286_CR23","doi-asserted-by":"crossref","unstructured":"Kemelmacher-Shlizerman, I., Seitz, S. M., Miller, D., & Brossard, E. (2016). The megaface benchmark: 1 million faces for recognition at scale. In CVPR.","DOI":"10.1109\/CVPR.2016.527"},{"key":"1286_CR24","unstructured":"Kim, J., Park, S., & Kwak, N. (2018). Paraphrasing complex network: Network compression via factor transfer. In NeurIPS."},{"key":"1286_CR25","unstructured":"Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. In ICLR."},{"key":"1286_CR26","unstructured":"LeCun, Y., Cortes, C., & Burges, C. (2010). Mnist handwritten digit database. AT&T Labs [Online]. Available http:\/\/yann.lecun.com\/exdb\/mnist ."},{"key":"1286_CR27","unstructured":"Li, H., Kadav, A., Durdanovic, I., Samet, H., & Graf, H. P. (2017). Pruning filters for efficient convnets. In: ICLR."},{"key":"1286_CR28","unstructured":"Li, S. Z., Yi, D., Lei, Z., & Liao, S. (2013). The casia nir-vis 2.0 face database. In CVPR workshops."},{"key":"1286_CR29","doi-asserted-by":"crossref","unstructured":"Liao, S., Lei, Z., Yi, D., Li, & S. Z. (2014). A benchmark study of large-scale unconstrained face recognition. In IJCB.","DOI":"10.1109\/BTAS.2014.6996301"},{"key":"1286_CR30","doi-asserted-by":"crossref","unstructured":"Liu, Y., Cao, J., Li, B., Yuan, Y., Hu, W., Li, Y., & Duan, Y. (2019). Knowledge distillation via instance relationship graph. In CVPR.","DOI":"10.1109\/CVPR.2019.00726"},{"key":"1286_CR31","doi-asserted-by":"crossref","unstructured":"Liu, X., Liu, W., Ma, H., & Fu, H. (2016). Large-scale vehicle re-identification in urban surveillance videos. In ICME.","DOI":"10.1109\/ICME.2016.7553002"},{"key":"1286_CR32","unstructured":"Liu, X., Song, L., Wu, X., & Tan, T. (2016). Transferring deep representation for nir-vis heterogeneous face recognition. In ICB."},{"key":"1286_CR33","doi-asserted-by":"crossref","unstructured":"Liu, H., Tian, Y., Wang, Y., Pang, L., & Huang, T. (2016). Deep relative distance learning: Tell the difference between similar vehicles. In CVPR.","DOI":"10.1109\/CVPR.2016.238"},{"key":"1286_CR34","unstructured":"Liu, W., Wen, Y., Yu, Z., & Yang, M. (2016). Large-margin softmax loss for convolutional neural networks. In ICML."},{"key":"1286_CR35","doi-asserted-by":"crossref","unstructured":"Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017). Sphereface: Deep hypersphere embedding for face recognition. In CVPR.","DOI":"10.1109\/CVPR.2017.713"},{"key":"1286_CR36","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1109\/TMM.2017.2751966","volume":"20","author":"X Liu","year":"2018","unstructured":"Liu, X., Liu, W., Mei, T., & Ma, H. (2018). Provid: Progressive and multimodal vehicle reidentification for large-scale urban surveillance. IEEE Transactions on Multimedia, 20, 645\u2013658.","journal-title":"IEEE Transactions on Multimedia"},{"key":"1286_CR37","doi-asserted-by":"crossref","unstructured":"Luo, H., Gu, Y., Liao, X., Lai, S., & Jiang, W. (2019). Bag of tricks and a strong baseline for deep person re-identification. In CVPR Workshops.","DOI":"10.1109\/CVPRW.2019.00190"},{"key":"1286_CR38","doi-asserted-by":"crossref","unstructured":"Luo, J. H., Wu, J., & Lin, W. (2017). Thinet: A filter level pruning method for deep neural network compression. In ICCV.","DOI":"10.1109\/ICCV.2017.541"},{"key":"1286_CR39","doi-asserted-by":"crossref","unstructured":"Luo, P., Zhu, Z., Liu, Z., Wang, X., & Tang, X. (2016). Face model compression by distilling knowledge from neurons. In AAAI.","DOI":"10.1609\/aaai.v30i1.10449"},{"key":"1286_CR40","unstructured":"Molchanov, P., Tyree, S., Karras, T., Aila, T., & Kautz, J. (2017). Pruning convolutional neural networks for resource efficient inference. In ICLR."},{"key":"1286_CR41","doi-asserted-by":"crossref","unstructured":"Ng, H., & Winkler, S. (2014). A data-driven approach to cleaning large face datasets. In ICIP.","DOI":"10.1109\/ICIP.2014.7025068"},{"key":"1286_CR42","doi-asserted-by":"crossref","unstructured":"Park, W., Kim, D., Lu, Y., & Cho, M. (2019). Relational knowledge distillation. In CVPR.","DOI":"10.1109\/CVPR.2019.00409"},{"key":"1286_CR43","doi-asserted-by":"crossref","unstructured":"Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015). Deep face recognition. In BMVC.","DOI":"10.5244\/C.29.41"},{"key":"1286_CR44","doi-asserted-by":"crossref","unstructured":"Passalis, N., & Tefas, A. (2018). Learning deep representations with probabilistic knowledge transfer. In ECCV.","DOI":"10.1007\/978-3-030-01252-6_17"},{"key":"1286_CR45","unstructured":"Ranjan, R., Castillo, C. D., & Chellappa, R. (2017). L2-constrained softmax loss for discriminative face verification. CoRR arXiv:1703.09507."},{"key":"1286_CR46","doi-asserted-by":"crossref","unstructured":"Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016). Xnor-net: Imagenet classification using binary convolutional neural networks. In ECCV.","DOI":"10.1007\/978-3-319-46493-0_32"},{"key":"1286_CR47","doi-asserted-by":"crossref","unstructured":"Ristani, E., Solera, F., Zou, R., Cucchiara, R., & Tomasi, C. (2016). Performance measures and a data set for multi-target, multi-camera tracking. In ECCV workshop.","DOI":"10.1007\/978-3-319-48881-3_2"},{"key":"1286_CR48","unstructured":"Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2015). Fitnets: Hints for thin deep nets. In ICLR."},{"key":"1286_CR49","unstructured":"Sandler, M., Howard, A. G., Zhu, M., Zhmoginov, A., & Chen, L. (2018). Inverted residuals and linear bottlenecks: Mobile networks for classification, detection and segmentation. CoRR arXiv:1801.04381."},{"key":"1286_CR50","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In CVPR.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"1286_CR51","unstructured":"Sohn, K. (2016). Improved deep metric learning with multi-class n-pair loss objective. In NeurIPS."},{"key":"1286_CR52","doi-asserted-by":"crossref","unstructured":"Song, C., Huang, Y., Ouyang, W., & Wang, L. (2018). Mask-guided contrastive attention model for person re-identification. In CVPR.","DOI":"10.1109\/CVPR.2018.00129"},{"key":"1286_CR53","doi-asserted-by":"crossref","unstructured":"Song, H. O., Jegelka, S., Rathod, V., & Murphy, K. (2017). Deep metric learning via facility location. In CVPR.","DOI":"10.1109\/CVPR.2017.237"},{"key":"1286_CR54","doi-asserted-by":"crossref","unstructured":"Song, H.O., Xiang, Y., Jegelka, S., & Savarese, S. (2016). Deep metric learning via lifted structured feature embedding. In CVPR.","DOI":"10.1109\/CVPR.2016.434"},{"key":"1286_CR55","unstructured":"Sun, Y., Chen, Y., Wang, X., & Tang, X. (2014). Deep learning face representation by joint identification-verification. In NeurIPS."},{"key":"1286_CR56","doi-asserted-by":"crossref","unstructured":"Sun, Y., Wang, X., & Tang, X. (2015). Deeply learned face representations are sparse, selective, and robust. In CVPR.","DOI":"10.1109\/CVPR.2015.7298907"},{"key":"1286_CR57","doi-asserted-by":"crossref","unstructured":"Sun, Y., Zheng, L., Deng, W., & Wang, S. (2017). Svdnet for pedestrian retrieval. In ICCV.","DOI":"10.1109\/ICCV.2017.410"},{"key":"1286_CR58","doi-asserted-by":"crossref","unstructured":"Wang, F., Xiang, X., Cheng, J., & Yuille, A. L. (2017). Normface: $$\\text{L}_{2}$$ hypersphere embedding for face verification. In ACM MM.","DOI":"10.1145\/3123266.3123359"},{"key":"1286_CR59","unstructured":"Wang, C., Zhang, Q., Huang, C., Liu, W., & Wang, X. (2018). Mancs: A multi-task attentional network with curriculum sampling for person re-identification. In: ECCV."},{"key":"1286_CR60","doi-asserted-by":"crossref","unstructured":"Wang, J., Zhou, F., Wen, S., Liu, X., & Lin, Y. (2017). Deep metric learning with angular loss. In ICCV.","DOI":"10.1109\/ICCV.2017.283"},{"key":"1286_CR61","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016). A discriminative feature learning approach for deep face recognition. In ECCV.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"1286_CR62","doi-asserted-by":"crossref","unstructured":"Wu, X., Song, L., He, R., & Tan, T. (2018). Coupled deep learning for heterogeneous face recognition. In AAAI.","DOI":"10.1609\/aaai.v32i1.11500"},{"key":"1286_CR63","doi-asserted-by":"publisher","first-page":"2884","DOI":"10.1109\/TIFS.2018.2833032","volume":"13","author":"X Wu","year":"2018","unstructured":"Wu, X., He, R., Sun, Z., & Tan, T. (2018). A light CNN for deep face representation with noisy labels. IEEE Transactions on Information Forensics and Security, 13, 2884\u20132896.","journal-title":"IEEE Transactions on Information Forensics and Security"},{"key":"1286_CR64","unstructured":"Yi, D., Lei, Z., Liao, S., & Li, S. Z. (2014). Learning face representation from scratch. CoRR arXiv:1411.7923."},{"key":"1286_CR65","doi-asserted-by":"crossref","unstructured":"Yim, J., Joo, D., Bae, J., & Kim, J. (2017). A gift from knowledge distillation: Fast optimization, network minimization and transfer learning. In CVPR.","DOI":"10.1109\/CVPR.2017.754"},{"key":"1286_CR66","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Yang, K., & Zhang, C. (2017). Hard-aware deeply cascaded embedding. In ICCV.","DOI":"10.1109\/ICCV.2017.94"},{"key":"1286_CR67","unstructured":"Zagoruyko, S., & Komodakis, N. (2017). Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. In ICLR."},{"key":"1286_CR68","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Lan, C., Zeng, W., & Chen, Z. (2019). Densely semantically aligned person re-identification. In CVPR.","DOI":"10.1109\/CVPR.2019.00076"},{"key":"1286_CR69","unstructured":"Zhang, Y., Xiang, T., Hospedales, T. M., & Lu, H. (2018). Deep mutual learning. In: CVPR."},{"key":"1286_CR70","unstructured":"Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017). Shufflenet: An extremely efficient convolutional neural network for mobile devices. CoRR arXiv:1707.01083."},{"key":"1286_CR71","doi-asserted-by":"publisher","first-page":"4766","DOI":"10.1109\/TIP.2015.2467315","volume":"24","author":"R Zhang","year":"2015","unstructured":"Zhang, R., Lin, L., Zhang, R., Zuo, W., & Zhang, L. (2015). Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Transactions on Image Processing, 24, 4766\u20134779.","journal-title":"IEEE Transactions on Image Processing"},{"key":"1286_CR72","doi-asserted-by":"crossref","unstructured":"Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015). Scalable person re-identification: A benchmark. In ICCV.","DOI":"10.1109\/ICCV.2015.133"},{"key":"1286_CR73","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Yang, X., Yu, Z., Zheng, L., Yang, Y., & Kautz, J. (2019). Joint discriminative and generative learning for person re-identification. In CVPR.","DOI":"10.1109\/CVPR.2019.00224"},{"key":"1286_CR74","unstructured":"Zheng, Z., Zheng, L., & Yang, Y. (2017). Pedestrian alignment network for large-scale person re-identification. CoRR arXiv:1707.00408."},{"key":"1286_CR75","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Zheng, L., & Yang, Y. (2017). Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In ICCV.","DOI":"10.1109\/ICCV.2017.405"},{"key":"1286_CR76","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Zheng, L., Zheng, Z., Li, S., & Yang, Y. (2018). Camera style adaptation for person re-identification. In CVPR.","DOI":"10.1109\/CVPR.2018.00541"},{"key":"1286_CR77","unstructured":"Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2017). Learning transferable architectures for scalable image recognition. CoRR arXiv:1707.07012."}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-019-01286-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11263-019-01286-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-019-01286-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,12]],"date-time":"2022-10-12T05:05:03Z","timestamp":1665551103000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11263-019-01286-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,21]]},"references-count":77,"journal-issue":{"issue":"8-9","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["1286"],"URL":"https:\/\/doi.org\/10.1007\/s11263-019-01286-x","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,21]]},"assertion":[{"value":"7 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}