{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T09:43:30Z","timestamp":1775123010168,"version":"3.50.1"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T00:00:00Z","timestamp":1664496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>Efficient deployment of Deep Neural Networks (DNNs) on edge devices (i.e., FPGAs and mobile platforms) is very challenging, especially under a recent witness of the increasing DNN model size and complexity. Model compression strategies, including weight quantization and pruning, are widely recognized as effective approaches to significantly reduce computation and memory intensities, and have been implemented in many DNNs on edge devices. However, most state-of-the-art works focus on ad hoc optimizations, and there lacks a thorough study to comprehensively reveal the potentials and constraints of different edge devices when considering different compression strategies. In this article, we qualitatively and quantitatively compare the energy efficiency of FPGA-based and mobile-based DNN executions using mobile GPU and provide a detailed analysis. Based on the observations obtained from the analysis, we propose a unified optimization framework using block-based pruning to reduce the weight storage and accelerate the inference speed on mobile devices and FPGAs, achieving high hardware performance and energy-efficiency gain while maintaining accuracy.<\/jats:p>","DOI":"10.1145\/3528578","type":"journal-article","created":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T12:03:23Z","timestamp":1650456203000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework"],"prefix":"10.1145","volume":"21","author":[{"given":"Geng","family":"Yuan","sequence":"first","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peiyan","family":"Dong","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mengshu","family":"Sun","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Niu","sequence":"additional","affiliation":[{"name":"College of William and Mary, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhengang","family":"Li","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuxuan","family":"Cai","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanyu","family":"Li","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Liu","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiwen","family":"Jiang","sequence":"additional","affiliation":[{"name":"University of Notre Dame, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xue","family":"Lin","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Ren","sequence":"additional","affiliation":[{"name":"College of William and Mary, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xulong","family":"Tang","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanzhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,12,9]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"TensorFlow. [n.d.]. Retrieved from https:\/\/www.tensorflow.org\/mobile\/tflite\/."},{"key":"e_1_3_2_3_2","unstructured":"Qualcomm. [n.d.]. Retrieved from https:\/\/www.qualcomm.com\/products\/snapdragon-865-plus-5g-mobile-platform."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858788.2688521"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSII.2018.2865896"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1137\/141000671"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","unstructured":"Matthias Boehm Berthold Reinwald Dylan Hutchison Alexandre V. Evfimievski and Prithviraj Sen. 2018. On optimizing operator fusion plans for large-scale machine learning in SystemML. Retrieved from https:\/\/arXiv:1801.00829.","DOI":"10.14778\/3229863.3229865"},{"key":"e_1_3_2_8_2","unstructured":"Sung-En Chang Yanyu Li Mengshu Sun Weiwen Jiang Runbin Shi Xue Lin and Yanzhi Wang. 2020. MSP: An FPGA-specific mixed-scheme multi-precision deep neural network quantization framework. Retrieved from https:\/\/arXiv:2009.07460."},{"key":"e_1_3_2_9_2","first-page":"578","volume-title":"Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918)","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, and Arvind Krishnamurthy. 2018. TVM: An automated end-to-end optimizing compiler for deep learning. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918). 578\u2013594."},{"key":"e_1_3_2_10_2","article-title":"\\(\\mu\\) L2Q: An ultra-low loss quantization method for DNN","author":"Cheng Gong","year":"2019","unstructured":"Gong Cheng, Lu Ye, Li Tao, Zhang Xiaofan, Hao Cong, Chen Deming, and Chen Yao. 2019. \\(\\mu\\) L2Q: An ultra-low loss quantization method for DNN. Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201919).","journal-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201919)"},{"key":"e_1_3_2_11_2","unstructured":"Jungwook Choi Zhuo Wang Swagath Venkataramani Pierce I.-Jen Chuang Vijayalakshmi Srinivasan and Kailash Gopalakrishnan. 2018. Pact: Parameterized clipping activation for quantized neural networks. Retrieved from https:\/\/arXiv:1805.06085."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3174243.3174970"},{"key":"e_1_3_2_13_2","first-page":"3123","volume-title":"Advances in Neural Information Processing Systems","author":"Courbariaux Matthieu","year":"2015","unstructured":"Matthieu Courbariaux, Yoshua Bengio, and Jean-Pierre David. 2015. Binaryconnect: Training deep neural networks with binary weights during propagations. In Advances in Neural Information Processing Systems. MIT Press, 3123\u20133131."},{"key":"e_1_3_2_14_2","unstructured":"Matthieu Courbariaux Itay Hubara Daniel Soudry Ran El-Yaniv and Yoshua Bengio. 2016. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. Retrieved from https:\/\/arXiv:1602.02830."},{"key":"e_1_3_2_15_2","unstructured":"Xiaoliang Dai Hongxu Yin and Niraj K. Jha. 2017. NeST: A neural network synthesis tool based on a grow-and-prune paradigm. Retrieved from https:\/\/arXiv:1711.02017."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3123939.3124552"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3289602.3293904"},{"key":"e_1_3_2_19_2","first-page":"759","volume-title":"Advances in Neural Information Processing Systems","author":"Dong Xuanyi","year":"2019","unstructured":"Xuanyi Dong and Yi Yang. 2019. Network pruning via transformable architecture search. In Advances in Neural Information Processing Systems. MIT Press, 759\u2013770."},{"key":"e_1_3_2_20_2","article-title":"Learned step size quantization","author":"Esser Steven K.","year":"2019","unstructured":"Steven K. Esser, Jeffrey L. McKinstry, Deepika Bablani, Rathinakumar Appuswamy, and Dharmendra S. Modha. 2019. Learned step size quantization. In Proceedings of the International Conference on Learning Representations (ICLR\u201919).","journal-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201919)"},{"key":"e_1_3_2_21_2","unstructured":"M. Everingham L. Van Gool C. K. I. Williams J. Winn and A. Zisserman. [n.d.]. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. Retrieved from http:\/\/www.pascal-network.org\/challenges\/VOC\/voc2012\/workshop\/index.html."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3352460.3358291"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00495"},{"key":"e_1_3_2_24_2","first-page":"18","volume-title":"Proceedings of the 50th Annual IEEE\/ACM International Symposium on Microarchitecture","author":"Guo Kaiyuan","year":"2017","unstructured":"Kaiyuan Guo, Song Han, Song Yao, Yu Wang, Yuan Xie, and Huazhong Yang. 2017. Software-hardware codesign for efficient neural network acceleration. In Proceedings of the 50th Annual IEEE\/ACM International Symposium on Microarchitecture. IEEE Computer Society, 18\u201325."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2017.2705069"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPL.2018.00016"},{"key":"e_1_3_2_27_2","first-page":"1379","volume-title":"Advances In Neural Information Processing Systems","author":"Guo Yiwen","year":"2016","unstructured":"Yiwen Guo, Anbang Yao, and Yurong Chen. 2016. Dynamic network surgery for efficient DNNs. In Advances In Neural Information Processing Systems. 1379\u20131387."},{"key":"e_1_3_2_28_2","first-page":"1135","volume-title":"Advances in Neural Information Processing Systems","author":"Han Song","year":"2015","unstructured":"Song Han, Jeff Pool, John Tran, and William Dally. 2015. Learning both weights and connections for efficient neural network. In Advances in Neural Information Processing Systems. MIT Press, 1135\u20131143."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/309"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00447"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.155"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01170"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3307650.3322214"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3358192"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","unstructured":"Weiwen Jiang Lei Yang Sakyasingha Dasgupta Jingtong Hu and Yiyu Shi. 2020. Standing on the shoulders of giants: Hardware and neural architecture co-search with hot start. Retrieved from https:\/\/arXiv:2007.09087.","DOI":"10.1109\/TCAD.2020.3012863"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2020.2986127"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317757"},{"key":"e_1_3_2_38_2","first-page":"1","volume-title":"Proceedings of Machine Learning and Systems","volume":"2","author":"Jiang Xiaotang","year":"2020","unstructured":"Xiaotang Jiang, Huan Wang, Yiliu Chen, Ziqi Wu, Lichuan Wang, Bin Zou, Yafeng Yang, Zongyang Cui, Yu Cai, Tianhang Yu, Chengfei Lyu, and Zhihua Wu. 2020. MNN: A universal and efficient inference engine. In Proceedings of Machine Learning and Systems, I. Dhillon, D. Papailiopoulos, and V. Sze (Eds.). Vol. 2. 1\u201313."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00448"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11713"},{"key":"e_1_3_2_41_2","unstructured":"Fengfu Li Bo Zhang and Bin Liu. 2016. Ternary weight networks. Retrieved from https:\/\/arXiv:1605.04711."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00410"},{"key":"e_1_3_2_43_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201920)","author":"Li Yuhang","year":"2020","unstructured":"Yuhang Li, Xin Dong, and Wei Wang. 2020. Additive powers-of-two quantization: An efficient non-uniform discretization for neural networks. In Proceedings of the International Conference on Learning Representations (ICLR\u201920)."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_45_2","first-page":"345","volume-title":"Advances in Neural Information Processing Systems","author":"Lin Xiaofan","year":"2017","unstructured":"Xiaofan Lin, Cong Zhao, and Wei Pan. 2017. Towards accurate binary convolutional neural network. In Advances in Neural Information Processing Systems. MIT Press, 345\u2013353."},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","unstructured":"Ning Liu Xiaolong Ma Zhiyuan Xu Yanzhi Wang Jian Tang and Jieping Ye. 2019. AutoCompress: An automatic DNN structured pruning framework for ultra-high compression rates. Retrieved from https:\/\/arXiv:1907.03141.","DOI":"10.1609\/aaai.v34i04.5924"},{"key":"e_1_3_2_47_2","unstructured":"Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang and Trevor Darrell. 2018. Rethinking the value of network pruning. Retrieved from https:\/\/arXiv:1810.05270."},{"key":"e_1_3_2_48_2","unstructured":"Qing Lu Weiwen Jiang Xiaowei Xu Yiyu Shi and Jingtong Hu. 2019. On neural architecture search for resource-constrained hardware platforms. Retrieved from https:\/\/arXiv:1911.00105."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.2018RCP0008"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.541"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5954"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5954"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3020078.3021736"},{"key":"e_1_3_2_54_2","doi-asserted-by":"crossref","unstructured":"Huizi Mao Song Han Jeff Pool Wenshuo Li Xingyu Liu Yu Wang and William J. Dally. 2017. Exploring the regularity of sparse structure in convolutional neural networks. Retrieved from https:\/\/arXiv:1705.08922.","DOI":"10.1109\/CVPRW.2017.241"},{"key":"e_1_3_2_55_2","unstructured":"Daisuke Miyashita Edward H. Lee and Boris Murmann. 2016. Convolutional neural networks using logarithmic data representation. Retrieved from https:\/\/arXiv:1603.01025."},{"key":"e_1_3_2_56_2","first-page":"1","volume-title":"Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL\u201917)","author":"Nakahara Hiroki","year":"2017","unstructured":"Hiroki Nakahara, Tomoya Fujii, and Shimpei Sato. 2017. A fully connected layer elimination for a binarized convolutional neural network on an FPGA. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL\u201917). IEEE, 1\u20134."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPT.2018.00058"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3174243.3174266"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPT.2016.7929552"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2019.2905242"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373376.3378534"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375302"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2018.8342121"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICESS.2019.8782524"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/2847263.2847265"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_32"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.5555\/3195638.3195659"},{"key":"e_1_3_2_68_2","unstructured":"Runbin Shi Peiyan Dong Tong Geng Yuhao Ding Xiaolong Ma Hayden K.-H. So Martin Herbordt Ang Li and Yanzhi Wang. 2020. CSB-RNN: A faster-than-realtime RNN acceleration framework with compressed structured blocks. Retrieved from https:\/\/arXiv:2005.05758."},{"key":"e_1_3_2_69_2","unstructured":"Khurram Soomro Amir Roshan Zamir and Mubarak Shah. 2012. UCF101: A dataset of 101 human actions classes from videos in the wild. Retrieved from https:\/\/arXiv:1212.0402."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-78890-6_2"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2844093"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/FPL.2018.00035"},{"key":"e_1_3_2_73_2","first-page":"2074","volume-title":"Advances in Neural Information Processing Systems","author":"Wen Wei","year":"2016","unstructured":"Wei Wen, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. 2016. Learning structured sparsity in deep neural networks. In Advances in Neural Information Processing Systems. MIT Press, 2074\u20132082."},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2018.8342100"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00958"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375311"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3020078.3021727"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2017.2785257"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01237-3_23"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3307650.3322263"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3020078.3021698"},{"key":"e_1_3_2_82_2","doi-asserted-by":"crossref","unstructured":"Tianyun Zhang Shaokai Ye Kaiqi Zhang Jian Tang Wujie Wen Makan Fardad and Yanzhi Wang. 2018. A systematic DNN weight pruning framework using alternating direction method of multipliers. Retrieved from https:\/\/arXiv:1804.03294.","DOI":"10.1007\/978-3-030-01237-3_12"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56258-2_22"},{"key":"e_1_3_2_84_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201917)","author":"Zhou Aojun","year":"2017","unstructured":"Aojun Zhou, Anbang Yao, Yiwen Guo, Lin Xu, and Yurong Chen. 2017. Incremental network quantization: Towards lossless CNNs with low-precision weights. In Proceedings of the International Conference on Learning Representations (ICLR\u201917)."},{"key":"e_1_3_2_85_2","unstructured":"Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen and Yuheng Zou. 2016. Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients. Retrieved from https:\/\/arXiv:1606.06160."},{"key":"e_1_3_2_86_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201917)","author":"Zhu Chenzhuo","year":"2017","unstructured":"Chenzhuo Zhu, Song Han, Huizi Mao, and William J. Dally. 2017. Trained ternary quantization. In Proceedings of the International Conference on Learning Representations (ICLR\u201917)."}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528578","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3528578","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:33Z","timestamp":1750183833000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,30]]},"references-count":85,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3528578"],"URL":"https:\/\/doi.org\/10.1145\/3528578","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,30]]},"assertion":[{"value":"2021-07-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}