{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:28:33Z","timestamp":1750220913085,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,1,7]],"date-time":"2020-01-07T00:00:00Z","timestamp":1578355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,1,7]]},"DOI":"10.1145\/3378184.3378224","type":"proceedings-article","created":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T03:31:51Z","timestamp":1581996711000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["An Experimental Study of the Impact of Pre-Training on the Pruning of a Convolutional Neural Network"],"prefix":"10.1145","author":[{"given":"Nathan","family":"Hubens","sequence":"first","affiliation":[{"name":"ISIA, Engineering, IP Paris, Telecom SudParis"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matei","family":"Mancas","sequence":"additional","affiliation":[{"name":"ISIA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Decombas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marius","family":"Preda","sequence":"additional","affiliation":[{"name":"IP Paris, Telecom SudParis"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Titus","family":"Zaharia","sequence":"additional","affiliation":[{"name":"IP Paris, Telecom SudParis"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernard","family":"Gosselin","sequence":"additional","affiliation":[{"name":"ISIA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thierry","family":"Dutoit","sequence":"additional","affiliation":[{"name":"ISIA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,2,17]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Sajid Anwar Kyuyeon Hwang and Wonyong Sung. 2015. Structured Pruning of Deep Convolutional Neural Networks. CoRR abs\/1512.08571 (2015). arXiv:1512.08571 http:\/\/arxiv.org\/abs\/1512.08571  Sajid Anwar Kyuyeon Hwang and Wonyong Sung. 2015. Structured Pruning of Deep Convolutional Neural Networks. CoRR abs\/1512.08571 (2015). arXiv:1512.08571 http:\/\/arxiv.org\/abs\/1512.08571"},{"key":"e_1_3_2_1_2_1","unstructured":"Jimmy Ba and Rich Caruana. 2014. Do Deep Nets Really Need to be Deep? In Advances in Neural Information Processing Systems. Curran Associates Inc. 2654--2662. http:\/\/papers.nips.cc\/paper\/5484-do-deep-nets-really-need-to-be-deep.pdf  Jimmy Ba and Rich Caruana. 2014. Do Deep Nets Really Need to be Deep? In Advances in Neural Information Processing Systems. Curran Associates Inc. 2654--2662. http:\/\/papers.nips.cc\/paper\/5484-do-deep-nets-really-need-to-be-deep.pdf"},{"key":"e_1_3_2_1_3_1","unstructured":"Jian Cheng Peisong Wang Gang Li Qinghao Hu and Hanqing Lu. 2018. Recent Advances in Efficient Computation of Deep Convolutional Neural Networks. CoRR abs\/1802.00939 (2018). arXiv:1802.00939 http:\/\/arxiv.org\/abs\/1802.00939  Jian Cheng Peisong Wang Gang Li Qinghao Hu and Hanqing Lu. 2018. Recent Advances in Efficient Computation of Deep Convolutional Neural Networks. CoRR abs\/1802.00939 (2018). arXiv:1802.00939 http:\/\/arxiv.org\/abs\/1802.00939"},{"volume-title":"Xception: Deep Learning with Depthwise Separable Convolutions. CoRR abs\/1610.02357","year":"2016","author":"Chollet Fran\u00e7ois","key":"e_1_3_2_1_4_1"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_1_6_1","unstructured":"Emily Denton Wojciech Zaremba Joan Bruna Yann LeCun and Rob Fergus. 2014. Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation. CoRR abs\/1404.0736 (2014). arXiv:1404.0736 http:\/\/arxiv.org\/abs\/1404.0736  Emily Denton Wojciech Zaremba Joan Bruna Yann LeCun and Rob Fergus. 2014. Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation. CoRR abs\/1404.0736 (2014). arXiv:1404.0736 http:\/\/arxiv.org\/abs\/1404.0736"},{"key":"e_1_3_2_1_7_1","unstructured":"Jonathan Frankle and Michael Carbin. 2018. The Lottery Ticket Hypothesis: Training Pruned Neural Networks. CoRR abs\/1803.03635 (2018). arXiv:1803.03635 http:\/\/arxiv.org\/abs\/1803.03635  Jonathan Frankle and Michael Carbin. 2018. The Lottery Ticket Hypothesis: Training Pruned Neural Networks. CoRR abs\/1803.03635 (2018). arXiv:1803.03635 http:\/\/arxiv.org\/abs\/1803.03635"},{"key":"e_1_3_2_1_8_1","unstructured":"Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy and Michael Carbin. 2019. The Lottery Ticket Hypothesis at Scale. CoRR abs\/1903.01611 (2019). arXiv:1903.01611 http:\/\/arxiv.org\/abs\/1903.01611  Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy and Michael Carbin. 2019. The Lottery Ticket Hypothesis at Scale. CoRR abs\/1903.01611 (2019). arXiv:1903.01611 http:\/\/arxiv.org\/abs\/1903.01611"},{"volume":"201","journal-title":"William J. Dally.","author":"Han Song","key":"e_1_3_2_1_9_1"},{"key":"e_1_3_2_1_10_1","unstructured":"Babak Hassibi David G. Stork Gregory Wolff and Takahiro Watanabe. 1994. Optimal Brain Surgeon: Extensions and performance comparisons. In Advances in Neural Information Processing Systems 6. Morgan-Kaufmann 263--270. http:\/\/papers.nips.cc\/paper\/749-optimal-brain-surgeon-extensions-and-performance-comparisons.pdf  Babak Hassibi David G. Stork Gregory Wolff and Takahiro Watanabe. 1994. Optimal Brain Surgeon: Extensions and performance comparisons. In Advances in Neural Information Processing Systems 6. Morgan-Kaufmann 263--270. http:\/\/papers.nips.cc\/paper\/749-optimal-brain-surgeon-extensions-and-performance-comparisons.pdf"},{"key":"e_1_3_2_1_11_1","unstructured":"Kaiming He and Jian Sun. 2014. Convolutional Neural Networks at Constrained Time Cost. CoRR abs\/1412.1710 (2014). arXiv:1412.1710 http:\/\/arxiv.org\/abs\/1412.1710  Kaiming He and Jian Sun. 2014. Convolutional Neural Networks at Constrained Time Cost. CoRR abs\/1412.1710 (2014). arXiv:1412.1710 http:\/\/arxiv.org\/abs\/1412.1710"},{"key":"e_1_3_2_1_12_1","unstructured":"Yihui He Xiangyu Zhang and Jian Sun. 2017. Channel Pruning for Accelerating Very Deep Neural Networks. CoRR abs\/1707.06168 (2017). arXiv:1707.06168 http:\/\/arxiv.org\/abs\/1707.06168  Yihui He Xiangyu Zhang and Jian Sun. 2017. Channel Pruning for Accelerating Very Deep Neural Networks. CoRR abs\/1707.06168 (2017). arXiv:1707.06168 http:\/\/arxiv.org\/abs\/1707.06168"},{"key":"e_1_3_2_1_13_1","unstructured":"Geoffrey Hinton Oriol Vinyals and Jeffrey Dean. 2015. Distilling the Knowledge in a Neural Network. In NIPS Deep Learning and Representation Learning-Workshop. http:\/\/arxiv.org\/abs\/1503.02531  Geoffrey Hinton Oriol Vinyals and Jeffrey Dean. 2015. Distilling the Knowledge in a Neural Network. In NIPS Deep Learning and Representation Learning-Workshop. http:\/\/arxiv.org\/abs\/1503.02531"},{"key":"e_1_3_2_1_14_1","unstructured":"Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto and Hartwig Adam. 2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. CoRR abs\/1704.04861 (2017). arXiv:1704.04861 http:\/\/arxiv.org\/abs\/1704.04861  Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto and Hartwig Adam. 2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. CoRR abs\/1704.04861 (2017). arXiv:1704.04861 http:\/\/arxiv.org\/abs\/1704.04861"},{"volume-title":"Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures. CoRR abs\/1607.03250","year":"2016","author":"Hu Hengyuan","key":"e_1_3_2_1_15_1"},{"key":"e_1_3_2_1_16_1","unstructured":"Alex Krizhevsky. 2009. Learning Multiple Layers of Features from Tiny Images.  Alex Krizhevsky. 2009. Learning Multiple Layers of Features from Tiny Images."},{"key":"e_1_3_2_1_17_1","unstructured":"Yann LeCun and Corinna Cortes. 2010. MNIST handwritten digit database. http:\/\/yann.lecun.com\/exdb\/mnist\/. (2010). http:\/\/yann.lecun.com\/exdb\/mnist\/  Yann LeCun and Corinna Cortes. 2010. MNIST handwritten digit database. http:\/\/yann.lecun.com\/exdb\/mnist\/. (2010). http:\/\/yann.lecun.com\/exdb\/mnist\/"},{"key":"e_1_3_2_1_18_1","unstructured":"Yann LeCun John S. Denker and Sara A. Solla. 1990. Optimal Brain Damage. In Advances in Neural Information Processing Systems 2 D. S. Touretzky (Ed.). Morgan-Kaufmann 598--605. http:\/\/papers.nips.cc\/paper\/250-optimal-brain-damage.pdf  Yann LeCun John S. Denker and Sara A. Solla. 1990. Optimal Brain Damage. In Advances in Neural Information Processing Systems 2 D. S. Touretzky (Ed.). Morgan-Kaufmann 598--605. http:\/\/papers.nips.cc\/paper\/250-optimal-brain-damage.pdf"},{"volume-title":"2004 Conference on Computer Vision and Pattern Recognition Workshop. 178--178","year":"2004","author":"Li Fei-Fei","key":"e_1_3_2_1_19_1"},{"key":"e_1_3_2_1_20_1","unstructured":"Hao Li Asim Kadav Igor Durdanovic Hanan Samet and Hans Peter Graf. 2016. Pruning Filters for Efficient ConvNets. CoRR abs\/1608.08710 (2016). arXiv:1608.08710 http:\/\/arxiv.org\/abs\/1608.08710  Hao Li Asim Kadav Igor Durdanovic Hanan Samet and Hans Peter Graf. 2016. Pruning Filters for Efficient ConvNets. CoRR abs\/1608.08710 (2016). arXiv:1608.08710 http:\/\/arxiv.org\/abs\/1608.08710"},{"volume-title":"Network In Network. In 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, Conference Track Proceedings. http:\/\/arxiv.org\/abs\/1312","year":"2014","author":"Lin Min","key":"e_1_3_2_1_21_1"},{"key":"e_1_3_2_1_22_1","unstructured":"Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang and Trevor Darrell. 2018. Rethinking the Value of Network Pruning. CoRR abs\/1810.05270 (2018). arXiv:1810.05270 http:\/\/arxiv.org\/abs\/1810.05270  Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang and Trevor Darrell. 2018. Rethinking the Value of Network Pruning. CoRR abs\/1810.05270 (2018). arXiv:1810.05270 http:\/\/arxiv.org\/abs\/1810.05270"},{"key":"e_1_3_2_1_23_1","unstructured":"Pavlo Molchanov Stephen Tyree Tero Karras Timo Aila and Jan Kautz. 2016. Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning. CoRR abs\/1611.06440 (2016). arXiv:1611.06440 http:\/\/arxiv.org\/abs\/1611.06440  Pavlo Molchanov Stephen Tyree Tero Karras Timo Aila and Jan Kautz. 2016. Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning. CoRR abs\/1611.06440 (2016). arXiv:1611.06440 http:\/\/arxiv.org\/abs\/1611.06440"},{"key":"e_1_3_2_1_24_1","unstructured":"Ari S. Morcos Haonan Yu Michela Paganini and Yuandong Tian. 2019. One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers. ArXiv abs\/1906.02773 (2019).  Ari S. Morcos Haonan Yu Michela Paganini and Yuandong Tian. 2019. One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers. ArXiv abs\/1906.02773 (2019)."},{"volume-title":"Reading Digits in Natural Images with Unsupervised Feature Learning. In Workshop on Deep Learning and Unsupervised Feature Learning, NeurIPS.","author":"Netzer Yuval","key":"e_1_3_2_1_25_1"},{"key":"e_1_3_2_1_26_1","unstructured":"Mohammad Rastegari Vicente Ordonez Joseph Redmon and Ali Farhadi. 2016. XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks. CoRR abs\/1603.05279 (2016). arXiv:1603.05279 http:\/\/arxiv.org\/abs\/1603.05279  Mohammad Rastegari Vicente Ordonez Joseph Redmon and Ali Farhadi. 2016. XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks. CoRR abs\/1603.05279 (2016). arXiv:1603.05279 http:\/\/arxiv.org\/abs\/1603.05279"},{"volume-title":"3rd International Conference on Learning Representations, ICLR","year":"2015","author":"Simonyan Karen","key":"e_1_3_2_1_27_1"},{"key":"e_1_3_2_1_28_1","unstructured":"Xavier Suau Luca Zappella Vinay Palakkode and Nicholas Apostoloff. 2018. Principal Filter Analysis for Guided Network Compression. CoRR abs\/1807.10585 (2018). arXiv:1807.10585 http:\/\/arxiv.org\/abs\/1807.10585  Xavier Suau Luca Zappella Vinay Palakkode and Nicholas Apostoloff. 2018. Principal Filter Analysis for Guided Network Compression. CoRR abs\/1807.10585 (2018). arXiv:1807.10585 http:\/\/arxiv.org\/abs\/1807.10585"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298594"},{"volume-title":"Rethinking the Inception Architecture for Computer Vision. In Conference on Computer Vision and Pattern Recognition, CVPR. https:\/\/doi.org\/10","year":"2016","author":"Szegedy Christian","key":"e_1_3_2_1_30_1"},{"key":"e_1_3_2_1_31_1","unstructured":"Jason Yosinski Jeff Clune Yoshua Bengio and Hod Lipson. 2014. How transferable are features in deep neural networks? CoRR abs\/1411.1792 (2014). arXiv:1411.1792 http:\/\/arxiv.org\/abs\/1411.1792  Jason Yosinski Jeff Clune Yoshua Bengio and Hod Lipson. 2014. How transferable are features in deep neural networks? CoRR abs\/1411.1792 (2014). arXiv:1411.1792 http:\/\/arxiv.org\/abs\/1411.1792"}],"event":{"name":"APPIS 2020: 3rd International Conference on Applications of Intelligent Systems","acronym":"APPIS 2020","location":"Las Palmas de Gran Canaria Spain"},"container-title":["Proceedings of the 3rd International Conference on Applications of Intelligent Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3378184.3378224","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3378184.3378224","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:45:03Z","timestamp":1750203903000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3378184.3378224"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,7]]},"references-count":31,"alternative-id":["10.1145\/3378184.3378224","10.1145\/3378184"],"URL":"https:\/\/doi.org\/10.1145\/3378184.3378224","relation":{},"subject":[],"published":{"date-parts":[[2020,1,7]]},"assertion":[{"value":"2020-02-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}