{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T04:49:15Z","timestamp":1782362955926,"version":"3.54.5"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T00:00:00Z","timestamp":1664496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"crossref","award":["2021R1A2C3010430, and 2020R1A4A1018309"],"award-info":[{"award-number":["2021R1A2C3010430, and 2020R1A4A1018309"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Institute of Information & communications Technology Planning & Evaluation","award":["2019-0-00079"],"award-info":[{"award-number":["2019-0-00079"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>Deep neural networks typically have extensive parameters and computational operations. Pruning and quantization techniques have been widely used to reduce the complexity of deep models. Both techniques can be jointly used for realizing significantly higher compression ratios. However, separate optimization processes and difficulties in choosing the hyperparameters limit the application of both the techniques simultaneously. In this study, we propose a novel compression framework, termed as quantized sparse training, that prunes and quantizes networks jointly in a unified training process. We integrate pruning and quantization into a gradient-based optimization process based on the straight-through estimator. Quantized sparse training enables us to simultaneously train, prune, and quantize a network from scratch. The empirical results validate the superiority of the proposed methodology over the recent state-of-the-art baselines with respect to both the model size and accuracy. Specifically, quantized sparse training achieves a 135 KB model size in the case of VGG16, without any accuracy degradation, which is 40% of the model size feasible based on the state-of-the-art pruning and quantization approach.<\/jats:p>","DOI":"10.1145\/3524066","type":"journal-article","created":{"date-parts":[[2022,7,15]],"date-time":"2022-07-15T11:32:01Z","timestamp":1657884721000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Quantized Sparse Training: A Unified Trainable Framework for Joint Pruning and Quantization in DNNs"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7900-3743","authenticated-orcid":false,"given":"Jun-Hyung","family":"Park","sequence":"first","affiliation":[{"name":"Korea University, Seongbuk-gu, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2335-7072","authenticated-orcid":false,"given":"Kang-Min","family":"Kim","sequence":"additional","affiliation":[{"name":"The Catholic University of Korea, Bucheon-si, Gyeonggi-do, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6249-8217","authenticated-orcid":false,"given":"Sangkeun","family":"Lee","sequence":"additional","affiliation":[{"name":"Korea University, Seongbuk-gu, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,10,8]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"223","article-title":"Rethinking floating point overheads for mixed precision DNN accelerators","volume":"3","author":"Abdelaziz Hamzah","year":"2021","unstructured":"Hamzah Abdelaziz, Jong Hoon Shin, Ardavan Pedram, Joseph Hassoun, et\u00a0al. 2021. Rethinking floating point overheads for mixed precision DNN accelerators. Proc. Mach. Learn. Syst. 3 (2021), 223\u2013239.","journal-title":"Proc. Mach. Learn. Syst."},{"key":"e_1_3_1_3_2","first-page":"2270","volume-title":"Advances in Neural Information Processing Systems","author":"Alvarez Jose M.","year":"2016","unstructured":"Jose M. Alvarez and Mathieu Salzmann. 2016. Learning the number of neurons in deep networks. In Advances in Neural Information Processing Systems. MIT Press, 2270\u20132278."},{"key":"e_1_3_1_4_2","first-page":"2654","volume-title":"Advances in Neural Information Processing Systems","author":"Ba Jimmy","year":"2014","unstructured":"Jimmy Ba and Rich Caruana. 2014. Do deep nets really need to be deep? In Advances in Neural Information Processing Systems. MIT Press, 2654\u20132662."},{"key":"e_1_3_1_5_2","volume-title":"Advances in Neural Information Processing Systems","author":"Banner Ron","year":"2019","unstructured":"Ron Banner, Yury Nahshan, Elad Hoffer, and Daniel Soudry. 2019. Post-training 4-bit quantization of convolution networks for rapid-deployment. In Advances in Neural Information Processing Systems. MIT Press."},{"key":"e_1_3_1_6_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Bellec Guillaume","year":"2017","unstructured":"Guillaume Bellec, David Kappel, Wolfgang Maass, and Robert Legenstein. 2017. Deep rewiring: Training very sparse deep networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_7_2","unstructured":"Yoshua Bengio Nicholas L\u00e9onard and Aaron Courville. 2013. Estimating or propagating gradients through stochastic neurons for conditional computation. Retrieved from https:\/\/arXiv:1308.3432."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00356"},{"key":"e_1_3_1_9_2","unstructured":"Tianqi Chen Ian Goodfellow and Jonathon Shlens. 2015. Net2net: Accelerating learning via knowledge transfer. Retrieved from https:\/\/arXiv:1511.05641."},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00363"},{"key":"e_1_3_1_11_2","unstructured":"Matthieu Courbariaux Itay Hubara Daniel Soudry Ran El-Yaniv and Yoshua Bengio. 2016. Binarized neural networks: Training deep neural networks with weights and activations constrained to +1 or  \\( -1 \\) . Retrieved from https:\/\/arXiv:1602.02830."},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2019.2914438"},{"key":"e_1_3_1_13_2","first-page":"1269","volume-title":"Advances in Neural Information Processing Systems","author":"Denton Emily L.","year":"2014","unstructured":"Emily L. Denton, Wojciech Zaremba, Joan Bruna, Yann LeCun, and Rob Fergus. 2014. Exploiting linear structure within convolutional networks for efficient evaluation. In Advances in Neural Information Processing Systems. MIT Press, 1269\u20131277."},{"key":"e_1_3_1_14_2","volume-title":"Advances in Neural Information Processing Systems","author":"Dettmers Tim","year":"2019","unstructured":"Tim Dettmers and Luke Zettlemoyer. 2019. Sparse networks from scratch: Faster training without losing performance. In Advances in Neural Information Processing Systems. MIT Press."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"e_1_3_1_16_2","unstructured":"Xuanyi Dong and Yi Yang. 2019. Network pruning via transformable architecture search. Retrieved from https:\/\/arXiv:1905.09717."},{"key":"e_1_3_1_17_2","volume-title":"Proceedings of the NeurIPS ML for Systems Workshop","author":"Elthakeb Ahmed","year":"2019","unstructured":"Ahmed Elthakeb, Prannoy Pilligundla, FatemehSadat Mireshghallah, Amir Yazdanbakhsh, Sicuan Gao, and Hadi Esmaeilzadeh. 2019. Releq: An automatic reinforcement learning approach for deep quantization of neural networks. In Proceedings of the NeurIPS ML for Systems Workshop."},{"key":"e_1_3_1_18_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Esser Steven K.","year":"2020","unstructured":"Steven K. Esser, Jeffrey L. McKinstry, Deepika Bablani, Rathinakumar Appuswamy, and Dharmendra S. Modha. 2020. Learned step size quantization. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Boyuan Feng Yuke Wang Tong Geng Ang Li and Yufei Ding. 2021. APNN-TC: Accelerating arbitrary precision neural networks on ampere GPU tensor cores. Retrieved from https:\/\/arXiv:2106.12169.","DOI":"10.1145\/3458817.3476157"},{"key":"e_1_3_1_20_2","unstructured":"Timothy Foldy-Porto Yeshwanth Venkatesha and Priyadarshini Panda. 2020. Activation density driven energy-efficient pruning in training. Retrieved from https:\/\/arXiv:2002.02949."},{"key":"e_1_3_1_21_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Frankle Jonathan","year":"2019","unstructured":"Jonathan Frankle and Michael Carbin. 2019. The lottery ticket hypothesis: Finding sparse, trainable neural networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_22_2","first-page":"249","volume-title":"Proceedings of the 13th International Conference on Artificial Intelligence and Statistics","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 249\u2013256."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/3176748.3176757"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00495"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00171"},{"key":"e_1_3_1_26_2","first-page":"1379","volume-title":"Advances in Neural Information Processing Systems","author":"Guo Yiwen","year":"2016","unstructured":"Yiwen Guo, Anbang Yao, and Yurong Chen. 2016. Dynamic network surgery for efficient dnns. In Advances in Neural Information Processing Systems. MIT Press, 1379\u20131387."},{"key":"e_1_3_1_27_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Han Song","year":"2015","unstructured":"Song Han, Huizi Mao, and William J. Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_28_2","first-page":"1135","volume-title":"Advances in Neural Information Processing Systems","author":"Han Song","year":"2015","unstructured":"Song Han, Jeff Pool, John Tran, and William Dally. 2015. Learning both weights and connections for efficient neural network. In Advances in Neural Information Processing Systems. MIT Press, 1135\u20131143."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.5555\/3304889.3304970"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_48"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00447"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2012.2205597"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00286"},{"key":"e_1_3_1_36_2","unstructured":"Sambhav R. Jain Albert Gural Michael Wu and Chris Dick. 2019. Trained uniform quantization for accurate and efficient neural network inference on fixed-point hardware. Retrieved from https:\/\/arXiv:1903.08066."},{"key":"e_1_3_1_37_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Jang Eric","year":"2017","unstructured":"Eric Jang, Shixiang Gu, and Ben Poole. 2017. Categorical reparameterization with Gumbel-Softmax. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_38_2","unstructured":"Zhe Jia Marco Maggioni Jeffrey Smith and Daniele Paolo Scarpazza. 2019. Dissecting the NVidia turing T4 GPU via microbenchmarking. Retrieved from https:\/\/arXiv:1903.07486."},{"key":"e_1_3_1_39_2","unstructured":"Jangho Kim Yash Bhalgat Jinwon Lee Chirag Patel and Nojun Kwak. 2019. QKD: Quantization-aware knowledge distillation. Retrieved from https:\/\/arXiv:1911.12491."},{"key":"e_1_3_1_40_2","unstructured":"Raghuraman Krishnamoorthi. 2018. Quantizing deep convolutional networks for efficient inference: A whitepaper. Retrieved from https:\/\/arXiv:1806.08342."},{"key":"e_1_3_1_41_2","first-page":"1097","volume-title":"Advances in Neural Information Processing Systems","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. MIT Press, 1097\u20131105."},{"key":"e_1_3_1_42_2","first-page":"598","volume-title":"Advances in Neural Information Processing Systems","author":"LeCun Yann","year":"1990","unstructured":"Yann LeCun, John S. Denker, and Sara A. Solla. 1990. Optimal brain damage. In Advances in Neural Information Processing Systems. MIT Press, 598\u2013605."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11713"},{"key":"e_1_3_1_44_2","unstructured":"Fengfu Li Bo Zhang and Bin Liu. 2016. Ternary weight networks. Retrieved from https:\/\/arXiv:1605.04711."},{"key":"e_1_3_1_45_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Li Hao","year":"2017","unstructured":"Hao Li, Asim Kadav, Igor Durdanovic, Hanan Samet, and Hans Peter Graf. 2017. Pruning filters for efficient convnets. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_46_2","unstructured":"Junjie Liu Zhe Xu Runbin Shi Ray C. C. Cheung and Hayden K. H. So. 2020. Dynamic sparse training: Find efficient sparse network from scratch with trainable masked layers. Retrieved from https:\/\/arXiv:2005.06870."},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.298"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00339"},{"key":"e_1_3_1_49_2","article-title":"Neural networks for machine learning, coursera","author":"Liu Zhuang","year":"2012","unstructured":"Zhuang Liu, Mingjie Sun, Tinghui Zhou, Gao Huang, and Trevor Darrell. 2012. Neural networks for machine learning, coursera. Coursera, Video Lectures.","journal-title":"Coursera, Video Lectures"},{"key":"e_1_3_1_50_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Liu Zhuang","year":"2019","unstructured":"Zhuang Liu, Mingjie Sun, Tinghui Zhou, Gao Huang, and Trevor Darrell. 2019. Rethinking the value of network pruning. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_51_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Louizos Christos","year":"2019","unstructured":"Christos Louizos, Matthias Reisser, Tijmen Blankevoort, Efstratios Gavves, and Max Welling. 2019. Relaxed quantization for discretized neural networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_52_2","volume-title":"Advances in Neural Information Processing Systems","author":"Louizos Christos","year":"2017","unstructured":"Christos Louizos, Karen Ullrich, and Max Welling. 2017. Bayesian compression for deep learning. In Advances in Neural Information Processing Systems. MIT Press."},{"key":"e_1_3_1_53_2","unstructured":"Jian-Hao Luo and Jianxin Wu. 2018. Autopruner: An end-to-end trainable filter pruning method for efficient deep model inference. Retrieved from https:\/\/arXiv:1805.08941."},{"key":"e_1_3_1_54_2","unstructured":"Chris J. Maddison Andriy Mnih and Yee Whye Teh. 2016. The concrete distribution: A continuous relaxation of discrete random variables. Retrieved from https:\/\/arxiv.org\/abs\/1611.00712?context=cs."},{"key":"e_1_3_1_55_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Micikevicius Paulius","year":"2018","unstructured":"Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory Diamos, Erich Elsen, David Garcia, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, et\u00a0al. 2018. Mixed precision training. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01097"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-04316-3"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01152"},{"key":"e_1_3_1_59_2","first-page":"4646","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Mostafa Hesham","year":"2019","unstructured":"Hesham Mostafa and Xin Wang. 2019. Parameter efficient training of deep convolutional neural networks by dynamic sparse reparameterization. In Proceedings of the International Conference on Machine Learning. PMLR, 4646\u20134655."},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00141"},{"key":"e_1_3_1_61_2","first-page":"8024","volume-title":"Advances in Neural Information Processing Systems","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An imperative Style, high-performance deep learning library. In Advances in Neural Information Processing Systems. MIT Press, 8024\u20138035."},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA47549.2020.00015"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00474"},{"key":"e_1_3_1_64_2","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. Retrieved from https:\/\/arXiv:1409.1556."},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00821"},{"key":"e_1_3_1_66_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Uhlich Stefan","year":"2020","unstructured":"Stefan Uhlich, Lukas Mauch, Fabien Cardinaux, Kazuki Yoshiyama, Javier Alonso Garcia, Stephen Tiedemann, Thomas Kemp, and Akira Nakamura. 2020. Mixed precision dnns: All you need is a good parametrization. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_67_2","volume-title":"Advances in Neural Information Processing Systems","author":"Baalen Mart van","year":"2020","unstructured":"Mart van Baalen, Christos Louizos, Markus Nagel, Rana Ali Amjad, Ying Wang, Tijmen Blankevoort, and Max Welling. 2020. Bayesian bits: Unifying quantization and pruning. In Advances in Neural Information Processing Systems. MIT Press."},{"key":"e_1_3_1_68_2","doi-asserted-by":"crossref","unstructured":"Karina Vasquez Yeshwanth Venkatesha Abhiroop Bhattacharjee Abhishek Moitra and Priyadarshini Panda. 2021. Activation density based mixed-precision quantization for energy efficient neural networks. Retrieved from https:\/\/arXiv:2101.04354.","DOI":"10.23919\/DATE51398.2021.9474031"},{"key":"e_1_3_1_69_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Adv. Neural Info. Process. Syst. 30 (2017).","journal-title":"Adv. Neural Info. Process. Syst."},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00881"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3410463.3414654"},{"key":"e_1_3_1_72_2","first-page":"2074","volume-title":"Advances in Neural Information Processing Systems","author":"Wen Wei","year":"2016","unstructured":"Wei Wen, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. 2016. Learning structured sparsity in deep neural networks. In Advances in Neural Information Processing Systems. MIT Press, 2074\u20132082."},{"key":"e_1_3_1_73_2","unstructured":"Bichen Wu Yanghan Wang Peizhao Zhang Yuandong Tian Peter Vajda and Kurt Keutzer. 2018. Mixed precision quantization of convnets via differentiable neural architecture search. Retrieved from https:\/\/arXiv:1812.00090."},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-03243-2_712-1"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00225"},{"key":"e_1_3_1_76_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Yang Huanrui","year":"2020","unstructured":"Huanrui Yang, Wei Wen, and Hai Li. 2020. DeepHoyer: Learning sparser neural network with differentiable scale-invariant sparsity measures. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_77_2","unstructured":"Shaokai Ye Tianyun Zhang Kaiqi Zhang Jiayu Li Jiaming Xie Yun Liang Sijia Liu Xue Lin and Yanzhi Wang. 2018. A unified framework of dnn weight pruning and weight clustering\/quantization using admm. Retrieved from https:\/\/arXiv:1811.01907."},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00874"},{"key":"e_1_3_1_79_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Yin Penghang","year":"2019","unstructured":"Penghang Yin, Jiancheng Lyu, Shuai Zhang, Stanley Osher, Yingyong Qi, and Jack Xin. 2019. Understanding straight-through estimator in training activation quantized neural nets. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.2020.3043870"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01237-3_12"},{"key":"e_1_3_1_82_2","first-page":"7543","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Zhao Ritchie","year":"2019","unstructured":"Ritchie Zhao, Yuwei Hu, Jordan Dotzel, Chris De Sa, and Zhiru Zhang. 2019. Improving neural network quantization without retraining using outlier channel splitting. In Proceedings of the International Conference on Machine Learning. PMLR, 7543\u20137552."},{"key":"e_1_3_1_83_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Zhou Aojun","year":"2017","unstructured":"Aojun Zhou, Anbang Yao, Yiwen Guo, Lin Xu, and Yurong Chen. 2017. Incremental network quantization: Towards lossless cnns with low-precision weights. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_84_2","unstructured":"Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen and Yuheng Zou. 2016. Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients. Retrieved from https:\/\/arXiv:1606.06160."},{"key":"e_1_3_1_85_2","unstructured":"Chen Zhu Zheng Xu Ali Shafahi Manli Shu Amin Ghiasi and Tom Goldstein. 2020. Towards accurate quantization and pruning via data-free knowledge transfer. Retrieved from https:\/\/arXiv:2010.07334."},{"key":"e_1_3_1_86_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Zoph Barret","year":"2017","unstructured":"Barret Zoph and Quoc V. Le. 2017. Neural architecture search with reinforcement learning. In Proceedings of the International Conference on Learning Representations."}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524066","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3524066","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:04Z","timestamp":1750188664000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524066"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,30]]},"references-count":85,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3524066"],"URL":"https:\/\/doi.org\/10.1145\/3524066","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,30]]},"assertion":[{"value":"2021-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}