{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T20:03:05Z","timestamp":1792958585367,"version":"4.5.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,8,4]],"date-time":"2017-08-04T00:00:00Z","timestamp":1501804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61375026,2015BAF15B00"],"award-info":[{"award-number":["61375026,2015BAF15B00"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["FT-130101457,DP-140102164,LP-150100671"],"award-info":[{"award-number":["FT-130101457,DP-140102164,LP-150100671"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,8,4]]},"DOI":"10.1145\/3097983.3098135","type":"proceedings-article","created":{"date-parts":[[2017,8,4]],"date-time":"2017-08-04T14:35:54Z","timestamp":1501857354000},"page":"1285-1294","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":311,"title":["Learning from Multiple Teacher Networks"],"prefix":"10.1145","author":[{"given":"Shan","family":"You","sequence":"first","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Sydney, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Xu","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dacheng","family":"Tao","sequence":"additional","affiliation":[{"name":"University of Sydney, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,8,4]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Jimmy Ba and Rich Caruana. 2014. Do deep nets really need to be deep?. In Advances in neural information processing systems. 2654--2662.  Jimmy Ba and Rich Caruana. 2014. Do deep nets really need to be deep?. In Advances in neural information processing systems. 2654--2662."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"e_1_3_2_1_3_1","volume-title":"Greedy layer-wise training of deep networks. Advances in neural information processing systems 19","author":"Bengio Yoshua","year":"2007","unstructured":"Yoshua Bengio , Pascal Lamblin , Dan Popovici , Hugo Larochelle , and others. 2007. Greedy layer-wise training of deep networks. Advances in neural information processing systems 19 ( 2007 ), 153. Yoshua Bengio, Pascal Lamblin, Dan Popovici, Hugo Larochelle, and others. 2007. Greedy layer-wise training of deep networks. Advances in neural information processing systems 19 (2007), 153."},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 535--541","author":"Buciluffj Cristian","year":"2006","unstructured":"Cristian Buciluffj , Rich Caruana , and Alexandru Niculescu-Mizil . 2006 . Model compression . In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 535--541 . Cristian Buciluffj, Rich Caruana, and Alexandru Niculescu-Mizil. 2006. Model compression. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 535--541."},{"key":"e_1_3_2_1_5_1","unstructured":"Wenlin Chen James T Wilson Stephen Tyree Kilian Q Weinberger and Yixin Chen. 2015. Compressing Neural Networks with the Hashing Trick.. In ICML. 2285--2294.  Wenlin Chen James T Wilson Stephen Tyree Kilian Q Weinberger and Yixin Chen. 2015. Compressing Neural Networks with the Hashing Trick.. In ICML. 2285--2294."},{"key":"e_1_3_2_1_6_1","volume-title":"Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv preprint arXiv:1602.02830","author":"Courbariaux Matthieu","year":"2016","unstructured":"Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , and Yoshua Bengio . 2016. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv preprint arXiv:1602.02830 ( 2016 ). Matthieu Courbariaux, Itay Hubara, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio. 2016. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv preprint arXiv:1602.02830 (2016)."},{"key":"e_1_3_2_1_7_1","unstructured":"Misha Denil Babak Shakibi Laurent Dinh Nando de Freitas and others. 2013. Predicting parameters in deep learning. In Advances in Neural Information Processing Systems. 2148--2156.  Misha Denil Babak Shakibi Laurent Dinh Nando de Freitas and others. 2013. Predicting parameters in deep learning. In Advances in Neural Information Processing Systems. 2148--2156."},{"key":"e_1_3_2_1_8_1","first-page":"153","article-title":"The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training","volume":"5","author":"Erhan Dumitru","year":"2009","unstructured":"Dumitru Erhan , Pierre-Antoine Manzagol , Yoshua Bengio , Samy Bengio , and Pascal Vincent . 2009 . The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training .. In AISTATS , Vol. 5. 153 -- 160 . Dumitru Erhan, Pierre-Antoine Manzagol, Yoshua Bengio, Samy Bengio, and Pascal Vincent. 2009. The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training.. In AISTATS, Vol. 5. 153--160.","journal-title":"AISTATS"},{"key":"e_1_3_2_1_9_1","volume-title":"Compressing deep convolutional networks using vector quantization. arXiv preprint arXiv:1412.6115","author":"Gong Yunchao","year":"2014","unstructured":"Yunchao Gong , Liu Liu , Ming Yang , and Lubomir Bourdev . 2014. Compressing deep convolutional networks using vector quantization. arXiv preprint arXiv:1412.6115 ( 2014 ). Yunchao Gong, Liu Liu, Ming Yang, and Lubomir Bourdev. 2014. Compressing deep convolutional networks using vector quantization. arXiv preprint arXiv:1412.6115 (2014)."},{"key":"e_1_3_2_1_10_1","volume-title":"Maxout Networks. ICML (3) 28","author":"Goodfellow Ian J","year":"2013","unstructured":"Ian J Goodfellow , David Warde-Farley , Mehdi Mirza , Aaron C Courville , and Yoshua Bengio . 2013. Maxout Networks. ICML (3) 28 ( 2013 ), 1319--1327. Ian J Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron C Courville, and Yoshua Bengio. 2013. Maxout Networks. ICML (3) 28 (2013), 1319--1327."},{"key":"e_1_3_2_1_11_1","first-page":"1","article-title":"Knowledge matters: Importance of prior information for optimization","volume":"17","author":"G\u00fcl\u00e7ehre \u00c7alar","year":"2016","unstructured":"\u00c7alar G\u00fcl\u00e7ehre and Yoshua Bengio . 2016 . Knowledge matters: Importance of prior information for optimization . Journal of Machine Learning Research 17 , 8 (2016), 1 -- 32 . \u00c7alar G\u00fcl\u00e7ehre and Yoshua Bengio. 2016. Knowledge matters: Importance of prior information for optimization. Journal of Machine Learning Research 17, 8 (2016), 1--32.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_12_1","volume-title":"Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149","author":"Han Song","year":"2015","unstructured":"Song Han , Huizi Mao , and William J Dally . 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 ( 2015 ). Song Han, Huizi Mao, and William J Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015)."},{"key":"e_1_3_2_1_13_1","unstructured":"Song Han Jeff Pool John Tran and William Dally. 2015. Learning both weights and connections for efficient neural network. In Advances in Neural Information Processing Systems. 1135--1143.  Song Han Jeff Pool John Tran and William Dally. 2015. Learning both weights and connections for efficient neural network. In Advances in Neural Information Processing Systems. 1135--1143."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_15_1","volume-title":"Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton , Oriol Vinyals , and Jeff Dean . 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 ( 2015 ). Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)."},{"key":"e_1_3_2_1_16_1","volume-title":"A fast learning algorithm for deep belief nets. Neural computation 18, 7","author":"Hinton Geoffrey E","year":"2006","unstructured":"Geoffrey E Hinton , Simon Osindero , and Yee-Whye Teh . 2006. A fast learning algorithm for deep belief nets. Neural computation 18, 7 ( 2006 ), 1527--1554. Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh. 2006. A fast learning algorithm for deep belief nets. Neural computation 18, 7 (2006), 1527--1554."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24261-3_7"},{"key":"e_1_3_2_1_18_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classiffca- tion with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.  Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classiffca- tion with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273556"},{"key":"e_1_3_2_1_20_1","first-page":"5","article-title":"Deeply-Supervised Nets","volume":"2","author":"Lee Chen-Yu","year":"2015","unstructured":"Chen-Yu Lee , Saining Xie , Patrick W Gallagher , Zhengyou Zhang , and Zhuowen Tu . 2015 . Deeply-Supervised Nets .. In AISTATS , Vol. 2. 5 . Chen-Yu Lee, Saining Xie, Patrick W Gallagher, Zhengyou Zhang, and Zhuowen Tu. 2015. Deeply-Supervised Nets.. In AISTATS, Vol. 2. 5.","journal-title":"AISTATS"},{"key":"e_1_3_2_1_21_1","volume-title":"Network in network. arXiv preprint arXiv:1312.4400","author":"Lin Min","year":"2013","unstructured":"Min Lin , Qiang Chen , and Shuicheng Yan . 2013. Network in network. arXiv preprint arXiv:1312.4400 ( 2013 ). Min Lin, Qiang Chen, and Shuicheng Yan. 2013. Network in network. arXiv preprint arXiv:1312.4400 (2013)."},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 806--814","author":"Liu Baoyuan","year":"2015","unstructured":"Baoyuan Liu , Min Wang , Hassan Foroosh , Marshall Tappen , and Marianna Pensky . 2015 . Sparse convolutional neural networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 806--814 . Baoyuan Liu, Min Wang, Hassan Foroosh, Marshall Tappen, and Marianna Pensky. 2015. Sparse convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 806--814."},{"key":"e_1_3_2_1_23_1","volume-title":"Unifying distillation and privileged information. arXiv preprint arXiv:1511.03643","author":"Lopez-Paz David","year":"2015","unstructured":"David Lopez-Paz , L\u00e9on Bottou , Bernhard Sch\u00f6lkopf , and Vladimir Vapnik . 2015. Unifying distillation and privileged information. arXiv preprint arXiv:1511.03643 ( 2015 ). David Lopez-Paz, L\u00e9on Bottou, Bernhard Sch\u00f6lkopf, and Vladimir Vapnik. 2015. Unifying distillation and privileged information. arXiv preprint arXiv:1511.03643 (2015)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2016.00131"},{"key":"e_1_3_2_1_25_1","volume-title":"Structural neighborhood based classification of nodes in a network. KDD. ACM","author":"Nandanwar Sharad","year":"2016","unstructured":"Sharad Nandanwar and MN Murty . 2016. Structural neighborhood based classification of nodes in a network. KDD. ACM ( 2016 ). Sharad Nandanwar and MN Murty. 2016. Structural neighborhood based classification of nodes in a network. KDD. ACM (2016)."},{"key":"e_1_3_2_1_26_1","volume-title":"Antoine Chassang, Carlo Gatta, and Yoshua Bengio.","author":"Romero Adriana","year":"2014","unstructured":"Adriana Romero , Nicolas Ballas , Samira Ebrahimi Kahou , Antoine Chassang, Carlo Gatta, and Yoshua Bengio. 2014 . Fitnets : Hints for thin deep nets. arXiv preprint arXiv:1412.6550 (2014). Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. 2014. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550 (2014)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"e_1_3_2_1_28_1","volume-title":"Pattern Recognition (ICPR), 2012 21st International Conference on. IEEE, 3288--3291","author":"Sermanet Pierre","year":"2012","unstructured":"Pierre Sermanet , Soumith Chintala , and Yann LeCun . 2012 . Convolutional neural networks applied to house numbers digit classification . In Pattern Recognition (ICPR), 2012 21st International Conference on. IEEE, 3288--3291 . Pierre Sermanet, Soumith Chintala, and Yann LeCun. 2012. Convolutional neural networks applied to house numbers digit classification. In Pattern Recognition (ICPR), 2012 21st International Conference on. IEEE, 3288--3291."},{"key":"e_1_3_2_1_29_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"e_1_3_2_1_31_1","volume-title":"Training deeper convolutional networks with deep supervision. arXiv preprint arXiv:1505.02496","author":"Wang Liwei","year":"2015","unstructured":"Liwei Wang , Chen-Yu Lee , Zhuowen Tu , and Svetlana Lazebnik . 2015. Training deeper convolutional networks with deep supervision. arXiv preprint arXiv:1505.02496 ( 2015 ). Liwei Wang, Chen-Yu Lee, Zhuowen Tu, and Svetlana Lazebnik. 2015. Training deeper convolutional networks with deep supervision. arXiv preprint arXiv:1505.02496 (2015)."},{"key":"e_1_3_2_1_32_1","unstructured":"Yunhe Wang Chang Xu Shan You Dacheng Tao and Chao Xu. 2016. CNNpack: Packing Convolutional Neural Networks in the Frequency Domain. In Advances In Neural Information Processing Systems. 253--261.  Yunhe Wang Chang Xu Shan You Dacheng Tao and Chao Xu. 2016. CNNpack: Packing Convolutional Neural Networks in the Frequency Domain. In Advances In Neural Information Processing Systems. 253--261."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35289-8_34"},{"key":"e_1_3_2_1_34_1","volume-title":"A survey on multi-view learning. arXiv preprint arXiv:1304.5634","author":"Xu Chang","year":"2013","unstructured":"Chang Xu , Dacheng Tao , and Chao Xu. 2013. A survey on multi-view learning. arXiv preprint arXiv:1304.5634 ( 2013 ). Chang Xu, Dacheng Tao, and Chao Xu. 2013. A survey on multi-view learning. arXiv preprint arXiv:1304.5634 (2013)."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.2296528"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2417578"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783304"}],"event":{"name":"KDD '17: The 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","location":"Halifax NS Canada","acronym":"KDD '17","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3097983.3098135","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3097983.3098135","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:30:02Z","timestamp":1750203002000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3097983.3098135"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,4]]},"references-count":37,"alternative-id":["10.1145\/3097983.3098135","10.1145\/3097983"],"URL":"https:\/\/doi.org\/10.1145\/3097983.3098135","relation":{},"subject":[],"published":{"date-parts":[[2017,8,4]]},"assertion":[{"value":"2017-08-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}