{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T14:06:39Z","timestamp":1783433199473,"version":"3.54.6"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T00:00:00Z","timestamp":1616025600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100014553","name":"Samsung Advanced Institute of Technology","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014553","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2021,3,31]]},"abstract":"<jats:p>\n            This article presents Lane Compression, a lightweight lossless compression technique for machine learning that is based on a detailed study of the statistical properties of machine learning data. The proposed technique profiles machine learning data gathered ahead of run-time and partitions values bit-wise into different\n            <jats:italic>lanes<\/jats:italic>\n            with more distinctive statistical characteristics. Then the most appropriate compression technique is chosen for each lane out of a small number of low-cost compression techniques. Lane Compression\u2019s compute and memory requirements are very low and yet it achieves a compression rate comparable to or better than Huffman coding. We evaluate and analyse Lane Compression on a wide range of machine learning networks for both inference and re-training. We also demonstrate the profiling prior to run-time and the ability to configure the hardware based on the profiling guarantee robust performance across different models and datasets. Hardware implementations are described and the scheme\u2019s simplicity makes it suitable for compressing both on-chip and off-chip traffic.\n          <\/jats:p>","DOI":"10.1145\/3431815","type":"journal-article","created":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T16:06:50Z","timestamp":1616083610000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Lane Compression"],"prefix":"10.1145","volume":"20","author":[{"given":"Yousun","family":"Ko","sequence":"first","affiliation":[{"name":"University of Cambridge, Cambridge, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex","family":"Chadwick","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Bates","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Mullins","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,3,18]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Ziad Asghar and Jeff Gehlhaar. 2019. 2019 Snapdragon 865 5G AI Deep Dive. Retrieved from https:\/\/www.qualcomm.com\/media\/documents\/files\/2019-snapdragon-865-5g-ai-deep-dive-ziad-asghar-jeff-gehlhaar.pdf.  Ziad Asghar and Jeff Gehlhaar. 2019. 2019 Snapdragon 865 5G AI Deep Dive. Retrieved from https:\/\/www.qualcomm.com\/media\/documents\/files\/2019-snapdragon-865-5g-ai-deep-dive-ziad-asghar-jeff-gehlhaar.pdf."},{"key":"e_1_2_1_2_1","volume-title":"CAT: Compression-Aware Training for bandwidth reduction.","author":"Baskin Chaim","year":"2019","unstructured":"Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , and Avi Mendelson . 2019 . CAT: Compression-Aware Training for bandwidth reduction. Retrieved from https:\/\/arxiv:cs.CV\/1909.11481. Chaim Baskin, Brian Chmiel, Evgenii Zheltonozhskii, Ron Banner, Alex M. Bronstein, and Avi Mendelson. 2019. CAT: Compression-Aware Training for bandwidth reduction. Retrieved from https:\/\/arxiv:cs.CV\/1909.11481."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835420.1835424"},{"key":"e_1_2_1_4_1","first-page":"4","article-title":"EBPC: Extended bit-plane compression for deep neural network inference and training accelerators","volume":"9","author":"Cavigelli Lukas","year":"2019","unstructured":"Lukas Cavigelli , Georg Rutishauser , and Luca Benini . 2019 . EBPC: Extended bit-plane compression for deep neural network inference and training accelerators . IEEE J. Emerg. Select. Top. Circ. Syst. 9 , 4 (Dec. 2019), 723--734. Lukas Cavigelli, Georg Rutishauser, and Luca Benini. 2019. EBPC: Extended bit-plane compression for deep neural network inference and training accelerators. IEEE J. Emerg. Select. Top. Circ. Syst. 9, 4 (Dec. 2019), 723--734.","journal-title":"IEEE J. Emerg. Select. Top. Circ. Syst."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.2017.2749425"},{"key":"e_1_2_1_6_1","first-page":"2","article-title":"Eyeriss v2: A flexible accelerator for emerging deep neural networks on mobile devices","volume":"9","author":"Chen Yu-Hsin","year":"2019","unstructured":"Yu-Hsin Chen , Tien-Ju Yang , Joel Emer , and Vivienne Sze . 2019 . Eyeriss v2: A flexible accelerator for emerging deep neural networks on mobile devices . IEEE J. Emerg. Select. Top. Circ. Syst. 9 , 2 (June 2019), 292--308. Yu-Hsin Chen, Tien-Ju Yang, Joel Emer, and Vivienne Sze. 2019. Eyeriss v2: A flexible accelerator for emerging deep neural networks on mobile devices. IEEE J. Emerg. Select. Top. Circ. Syst. 9, 2 (June 2019), 292--308.","journal-title":"IEEE J. Emerg. Select. Top. Circ. Syst."},{"key":"e_1_2_1_7_1","unstructured":"Soumith Chintala. 2016. Word-level language modeling RNN. Retrieved from https:\/\/github.com\/pytorch\/examples\/tree\/master\/word_language_model.  Soumith Chintala. 2016. Word-level language modeling RNN. Retrieved from https:\/\/github.com\/pytorch\/examples\/tree\/master\/word_language_model."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2020.2975903"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference on Extending Database Technology (EDBT\u201917)","author":"Damme Patrick","year":"2017","unstructured":"Patrick Damme , Dirk Habich , Juliana Hildebrandt , and Wolfgang Lehner . 2017 . Lightweight data compression algorithms: An experimental survey (experiments and analyses) . In Proceedings of the International Conference on Extending Database Technology (EDBT\u201917) . Patrick Damme, Dirk Habich, Juliana Hildebrandt, and Wolfgang Lehner. 2017. Lightweight data compression algorithms: An experimental survey (experiments and analyses). In Proceedings of the International Conference on Extending Database Technology (EDBT\u201917)."},{"key":"e_1_2_1_10_1","unstructured":"Alberto Delmas Sayeh Sharify Patrick Judd Milos Nikolic and Andreas Moshovos. 2018. DPRed: Making typical activation values matter in deep learning computing. Retrieved from https:\/\/arxiv:1804.06732.  Alberto Delmas Sayeh Sharify Patrick Judd Milos Nikolic and Andreas Moshovos. 2018. DPRed: Making typical activation values matter in deep learning computing. Retrieved from https:\/\/arxiv:1804.06732."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.2976475"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/HOTCHIPS.2019.8875680"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICECS46596.2019.8965067"},{"key":"e_1_2_1_15_1","unstructured":"Georgios Georgiadis. 2018. Accelerating convolutional neural networks via activation map compression. Retrieved from https:\/\/arxiv:1812.04056.  Georgios Georgiadis. 2018. Accelerating convolutional neural networks via activation map compression. Retrieved from https:\/\/arxiv:1812.04056."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1816038.1815968"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3007787.3001163"},{"key":"e_1_2_1_18_1","volume-title":"Dally","author":"Han Song","year":"2015","unstructured":"Song Han , Huizi Mao , and William J . Dally . 2015 . Deep compression: Compressing deep neural network with pruning, trained quantization and Huffman coding. CoRR abs\/1510.00149. Song Han, Huizi Mao, and William J. Dally. 2015. Deep compression: Compressing deep neural network with pruning, trained quantization and Huffman coding. CoRR abs\/1510.00149."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969366"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_21_1","unstructured":"Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto and Hartwig Adam. 2017. MobileNets: Efficient convolutional neural networks for mobile vision applications. Retrieved from https:\/\/arxiv:1704.04861.  Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto and Hartwig Adam. 2017. MobileNets: Efficient convolutional neural networks for mobile vision applications. Retrieved from https:\/\/arxiv:1704.04861."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/JRPROC.1952.273898"},{"key":"e_1_2_1_23_1","unstructured":"Forrest N. Iandola Matthew W. Moskewicz Khalid Ashraf Song Han William J. Dally and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and &lt;1MB model size. CoRR abs\/1602.07360.  Forrest N. Iandola Matthew W. Moskewicz Khalid Ashraf Song Han William J. Dally and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and &lt;1MB model size. CoRR abs\/1602.07360."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2018.00070"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3140659.3080246"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00448"},{"key":"e_1_2_1_27_1","unstructured":"Wonkyung Jung Daejin Jung Byeongho Kim Sunjung Lee Wonjong Rhee and Jung Ho Ahn. 2018. Restructuring Batch Normalization to Accelerate CNN Training. Retrieved from https:\/\/arxiv:1807.01702.  Wonkyung Jung Daejin Jung Byeongho Kim Sunjung Lee Wonjong Rhee and Jung Ho Ahn. 2018. Restructuring Batch Normalization to Accelerate CNN Training. Retrieved from https:\/\/arxiv:1807.01702."},{"key":"e_1_2_1_28_1","unstructured":"Hyunjun Kim. 2016. SqueezeNet v1.1. Retrieved from https:\/\/github.com\/DeepScale\/SqueezeNet\/tree\/master\/SqueezeNet_v1.1.  Hyunjun Kim. 2016. SqueezeNet v1.1. Retrieved from https:\/\/github.com\/DeepScale\/SqueezeNet\/tree\/master\/SqueezeNet_v1.1."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3007787.3001172"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of 22nd Euromicro Conference. Beyond 2000: Hardware and Software Design Strategies. 423--430","author":"Kjels\u00f8 Morten","year":"1996","unstructured":"Morten Kjels\u00f8 , Mark Gooch , and Simon Jones . 1996 . Design and performance of a main memory hardware data compressor . In Proceedings of 22nd Euromicro Conference. Beyond 2000: Hardware and Software Design Strategies. 423--430 . Morten Kjels\u00f8, Mark Gooch, and Simon Jones. 1996. Design and performance of a main memory hardware data compressor. In Proceedings of 22nd Euromicro Conference. Beyond 2000: Hardware and Software Design Strategies. 423--430."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/3130379.3130424"},{"key":"e_1_2_1_32_1","unstructured":"Saluka Kodituwakku and U. S. Amarasinghe. 2010. Comparison of lossless data compression algorithms for text data. Indian J. Comput. Sci. Eng. 1 (12 2010).  Saluka Kodituwakku and U. S. Amarasinghe. 2010. Comparison of lossless data compression algorithms for text data. Indian J. Comput. Sci. Eng. 1 (12 2010)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/2999134.2999257"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_36_1","unstructured":"Arm Ltd. 2019. Arm Ethos-N series processors. Retrieved from https:\/\/developer.arm.com\/ip-products\/processors\/machine-learning\/arm-ethos-n.  Arm Ltd. 2019. Arm Ethos-N series processors. Retrieved from https:\/\/developer.arm.com\/ip-products\/processors\/machine-learning\/arm-ethos-n."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3109761.3109804"},{"key":"e_1_2_1_38_1","unstructured":"Stephen Merity Caiming Xiong James Bradbury and Richard Socher. 2016. Pointer sentinel mixture models. Retrieved from https:\/\/arxiv:1609.07843.  Stephen Merity Caiming Xiong James Bradbury and Richard Socher. 2016. Pointer sentinel mixture models. Retrieved from https:\/\/arxiv:1609.07843."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Micikevicius Paulius","year":"2018","unstructured":"Paulius Micikevicius , Sharan Narang , Jonah Alben , Gregory Diamos , Erich Elsen , David Garcia , Boris Ginsburg , Michael Houston , Oleksii Kuchaiev , Ganesh Venkatesh , and Hao Wu . 2018 . Mixed precision training . In Proceedings of the International Conference on Learning Representations. Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory Diamos, Erich Elsen, David Garcia, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, and Hao Wu. 2018. Mixed precision training. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_1_40_1","unstructured":"Daisuke Miyashita Edward H. Lee and Boris Murmann. 2016. Convolutional Neural Networks using Logarithmic Data Representation. Retrieved from https:\/\/arxiv:1603.01025.  Daisuke Miyashita Edward H. Lee and Boris Murmann. 2016. Convolutional Neural Networks using Logarithmic Data Representation. Retrieved from https:\/\/arxiv:1603.01025."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPASS.2019.00030"},{"key":"e_1_2_1_42_1","unstructured":"Nvidia. 2019. Deep Learning Performance. Retrieved from https:\/\/docs.nvidia.com\/deeplearning\/sdk\/pdf\/Deep-Learning-Performance-Guide.pdf.  Nvidia. 2019. Deep Learning Performance. Retrieved from https:\/\/docs.nvidia.com\/deeplearning\/sdk\/pdf\/Deep-Learning-Performance-Guide.pdf."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3140659.3080254"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370816.2370870"},{"key":"e_1_2_1_46_1","volume-title":"Keckler","author":"Rhu Minsoo","year":"2017","unstructured":"Minsoo Rhu , Mike O\u2019Connor , Niladrish Chatterjee , Jeff Pool , and Stephen W . Keckler . 2017 . Compressing DMA engine: Leveraging activation sparsity for training deep neural networks. Retrieved from https:\/\/arxiv:1705.01626. Minsoo Rhu, Mike O\u2019Connor, Niladrish Chatterjee, Jeff Pool, and Stephen W. Keckler. 2017. Compressing DMA engine: Leveraging activation sparsity for training deep neural networks. Retrieved from https:\/\/arxiv:1705.01626."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/163090.163096"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb01338.x"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2018.8342167"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2017.2778060"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.1984.1659158"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00748"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373376.3378514"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243176.3243188"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01237-3_23"},{"key":"e_1_2_1_58_1","unstructured":"Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen and Yuheng Zou. 2016. DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients. Retrieved from https:\/\/arxiv:1606.06160.  Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen and Yuheng Zou. 2016. DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients. Retrieved from https:\/\/arxiv:1606.06160."}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3431815","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3431815","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:46Z","timestamp":1750195486000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3431815"}},"subtitle":["A Lightweight Lossless Compression Method for Machine Learning on Embedded Systems"],"short-title":[],"issued":{"date-parts":[[2021,3,18]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,3,31]]}},"alternative-id":["10.1145\/3431815"],"URL":"https:\/\/doi.org\/10.1145\/3431815","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,18]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}