{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T14:45:26Z","timestamp":1776955526858,"version":"3.51.4"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T00:00:00Z","timestamp":1628726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U19B2019, 61832007, and 61621091"],"award-info":[{"award-number":["U19B2019, 61832007, and 61621091"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2017YFA02077600"],"award-info":[{"award-number":["2017YFA02077600"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100017582","name":"Beijing National Research Center for Information Science and Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100017582","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Beijing Innovation Center for Future Chips"},{"name":"Tsinghua University and Toyota Joint Research Center for AI Technology of Automated Vehicle","award":["TT2020-01"],"award-info":[{"award-number":["TT2020-01"]}]},{"name":"Beijing Academy of Artificial Intelligence"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Des. Autom. Electron. Syst."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>With the fast evolvement of embedded deep-learning computing systems, applications powered by deep learning are moving from the cloud to the edge. When deploying neural networks (NNs) onto the devices under complex environments, there are various types of possible faults: soft errors caused by cosmic radiation and radioactive impurities, voltage instability, aging, temperature variations, malicious attackers, and so on. Thus, the safety risk of deploying NNs is now drawing much attention. In this article, after the analysis of the possible faults in various types of NN accelerators, we formalize and implement various fault models from the algorithmic perspective. We propose Fault-Tolerant Neural Architecture Search (FT-NAS) to automatically discover convolutional neural network (CNN) architectures that are reliable to various faults in nowadays devices. Then, we incorporate fault-tolerant training (FTT) in the search process to achieve better results, which is referred to as FTT-NAS. Experiments on CIFAR-10 show that the discovered architectures outperform other manually designed baseline architectures significantly, with comparable or fewer floating-point operations (FLOPs) and parameters. Specifically, with the same fault settings, F-FTT-Net discovered under the feature fault model achieves an accuracy of 86.2% (VS. 68.1% achieved by MobileNet-V2), and W-FTT-Net discovered under the weight fault model achieves an accuracy of 69.6% (VS. 60.8% achieved by ResNet-18). By inspecting the discovered architectures, we find that the operation primitives, the weight quantization range, the capacity of the model, and the connection pattern have influences on the fault resilience capability of NN models.<\/jats:p>","DOI":"10.1145\/3460288","type":"journal-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T14:28:09Z","timestamp":1628778489000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["FTT-NAS: Discovering Fault-tolerant Convolutional Neural Architecture"],"prefix":"10.1145","volume":"26","author":[{"given":"Xuefei","family":"Ning","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guangjun","family":"Ge","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenshuo","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenhua","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yin","family":"Zheng","sequence":"additional","affiliation":[{"name":"Weixin Group, Tencent, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoming","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhen","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huazhong","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,8,12]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"IEEE High Performance Extreme Computing Conference (HPEC'18)","author":"Austin","unstructured":"Austin P. Arechiga and Alan J. Michaels. 2018. The robustness of modern deep learning architectures against single event upset errors . In IEEE High Performance Extreme Computing Conference (HPEC'18) . 1\u20136. Austin P. Arechiga and Alan J. Michaels. 2018. The robustness of modern deep learning architectures against single event upset errors. In IEEE High Performance Extreme Computing Conference (HPEC'18). 1\u20136."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2007.909795"},{"key":"e_1_2_1_3_1","unstructured":"Bowen Baker Otkrist Gupta R. Raskar and N. Naik. 2017. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 (2017).  Bowen Baker Otkrist Gupta R. Raskar and N. Naik. 2017. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 (2017)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1302493.1302727"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2005.110"},{"key":"e_1_2_1_6_1","first-page":"v1","article-title":"Correcting single-event upsets through Virtex partial configuration","volume":"216","author":"Carmichael Carl","year":"2000","unstructured":"Carl Carmichael , Michael Caffrey , and Anthony Salazar . 2000 . Correcting single-event upsets through Virtex partial configuration . Xilinx Application Notes 216 (2000), v1 . Carl Carmichael, Michael Caffrey, and Anthony Salazar. 2000. Correcting single-event upsets through Virtex partial configuration. Xilinx Application Notes 216 (2000), v1.","journal-title":"Xilinx Application Notes"},{"key":"e_1_2_1_7_1","first-page":"1","article-title":"RRAM defect modeling and failure analysis based on march test and a novel squeeze-search scheme","volume":"64","author":"Chen Ching-Yi","year":"2015","unstructured":"Ching-Yi Chen , Hsiu-Chuan Shih , Cheng-Wen Wu , C. Lin , Pi-Feng Chiu , S. Sheu , and F. Chen . 2015 . RRAM defect modeling and failure analysis based on march test and a novel squeeze-search scheme . IEEE Trans. Comput. 64 , 1 (Jan. 2015), 180\u2013190. Ching-Yi Chen, Hsiu-Chuan Shih, Cheng-Wen Wu, C. Lin, Pi-Feng Chiu, S. Sheu, and F. Chen. 2015. RRAM defect modeling and failure analysis based on march test and a novel squeeze-search scheme. IEEE Trans. Comput. 64, 1 (Jan. 2015), 180\u2013190.","journal-title":"IEEE Trans. Comput."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/3130379.3130384"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2654822.2541967"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3007787.3001140"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289185"},{"key":"e_1_2_1_12_1","volume-title":"IEEE International Symposium on Circuits and Systems (ISCAS'19)","author":"Hacene Ghouthi Boukli","unstructured":"Ghouthi Boukli Hacene , Fran\u00e7ois Leduc-Primeau , Amal Ben Soussia , Vincent Gripon , and F. Gagnon . 2019. Training modern deep neural networks for memory-fault robustness . In IEEE International Symposium on Circuits and Systems (ISCAS'19) . 1\u20135. Ghouthi Boukli Hacene, Fran\u00e7ois Leduc-Primeau, Amal Ben Soussia, Vincent Gripon, and F. Gagnon. 2019. Training modern deep neural networks for memory-fault robustness. In IEEE International Symposium on Circuits and Systems (ISCAS'19). 1\u20135."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MWSCAS.2009.5236054"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317870"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463209.2488857"},{"key":"e_1_2_1_17_1","volume-title":"IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA'13)","author":"Hu Miao","unstructured":"Miao Hu , Hai Li , Yiran Chen , Q. Wu , and G. Rose . 2013. BSB training scheme implementation on memristor-based circuit . In IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA'13) . IEEE, 80\u201387. Miao Hu, Hai Li, Yiran Chen, Q. Wu, and G. Rose. 2013. BSB training scheme implementation on memristor-based circuit. In IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA'13). IEEE, 80\u201387."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASPDAC.2017.7858421"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242044"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2015.2394434"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLSID.2013.219"},{"key":"e_1_2_1_22_1","volume-title":"International Conference on Learning Representations (ICLR'15)","author":"Diederik","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization . In International Conference on Learning Representations (ICLR'15) . Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In International Conference on Learning Representations (ICLR'15)."},{"key":"e_1_2_1_23_1","unstructured":"Alex Krizhevsky. 2009. Learning multiple layers of features from tiny images. http:\/\/www.cs.toronto.edu\/ kriz\/cifar.html.  Alex Krizhevsky. 2009. Learning multiple layers of features from tiny images. http:\/\/www.cs.toronto.edu\/ kriz\/cifar.html."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TED.2018.2879788"},{"key":"e_1_2_1_25_1","volume-title":"ACM\/IEEE Supercomputing Conference (SC'17)","author":"Li Guanpeng","unstructured":"Guanpeng Li , S. Hari , M. Sullivan , T. Tsai , K. Pattabiraman , J. Emer , and Stephen W. Keckler . 2017. Understanding error propagation in deep learning neural network (DNN) accelerators and applications . In ACM\/IEEE Supercomputing Conference (SC'17) . ACM, 8. Guanpeng Li, S. Hari, M. Sullivan, T. Tsai, K. Pattabiraman, J. Emer, and Stephen W. Keckler. 2017. Understanding error propagation in deep learning neural network (DNN) accelerators and applications. In ACM\/IEEE Supercomputing Conference (SC'17). ACM, 8."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNS.2018.2884460"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2744769.2744930"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3062310"},{"key":"e_1_2_1_29_1","volume-title":"International Conference on Learning Representations (ICLR'19)","author":"Liu Hanxiao","year":"2019","unstructured":"Hanxiao Liu , K. Simonyan , and Yiming Yang . 2019 . DARTS: Differentiable architecture search . In International Conference on Learning Representations (ICLR'19) . Hanxiao Liu, K. Simonyan, and Yiming Yang. 2019. DARTS: Differentiable architecture search. In International Conference on Learning Representations (ICLR'19)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317742"},{"key":"e_1_2_1_31_1","volume-title":"Berg","author":"Liu Wei","year":"2016","unstructured":"Wei Liu , Dragomir Anguelov , Dumitru Erhan , Christian Szegedy , Scott Reed , Cheng-Yang Fu , and Alexander C . Berg . 2016 . SSD : Single shot MultiBox detector. In European Conference on Computer Vision (ECCV'16). Springer , 21\u201337. Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C. Berg. 2016. SSD: Single shot MultiBox detector. In European Conference on Computer Vision (ECCV'16). Springer, 21\u201337."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_1_33_1","volume-title":"International Conference on Learning Representations (ICLR'17)","author":"Loshchilov Ilya","year":"2017","unstructured":"Ilya Loshchilov and Frank Hutter . 2017 . SGDR: Stochastic gradient descent with warm restarts . In International Conference on Learning Representations (ICLR'17) . Ilya Loshchilov and Frank Hutter. 2017. SGDR: Stochastic gradient descent with warm restarts. In International Conference on Learning Representations (ICLR'17)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327757.3327879"},{"key":"e_1_2_1_35_1","volume-title":"European Conference on Computer Vision (ECCV'20)","author":"Ning Xuefei","year":"2020","unstructured":"Xuefei Ning , Yin Zheng , Tianchen Zhao , Yu Wang , and Huazhong Yang . 2020 . A generic graph-based neural architecture encoding scheme for predictor-based NAS . In European Conference on Computer Vision (ECCV'20) . Xuefei Ning, Yin Zheng, Tianchen Zhao, Yu Wang, and Huazhong Yang. 2020. A generic graph-based neural architecture encoding scheme for predictor-based NAS. In European Conference on Computer Vision (ECCV'20)."},{"key":"e_1_2_1_36_1","volume-title":"International Conference on Machine Learning (ICML'18)","author":"Pham Hieu","year":"2018","unstructured":"Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , and Jeff Dean . 2018 . Efficient neural architecture search via parameter sharing . In International Conference on Machine Learning (ICML'18) . Hieu Pham, Melody Y. Guan, Barret Zoph, Quoc V. Le, and Jeff Dean. 2018. Efficient neural architecture search via parameter sharing. In International Conference on Machine Learning (ICML'18)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2847263.2847265"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3195970.3195997"},{"key":"e_1_2_1_39_1","volume-title":"AAAI Conference on Artificial Intelligence","volume":"33","author":"Real Esteban","unstructured":"Esteban Real , Alok Aggarwal , Yanping Huang , and Quoc V. Le . 2019. Regularized evolution for image classifier architecture search . In AAAI Conference on Artificial Intelligence , Vol. 33 . 4780\u20134789. Esteban Real, Alok Aggarwal, Yanping Huang, and Quoc V. Le. 2019. Regularized evolution for image classifier architecture search. In AAAI Conference on Artificial Intelligence, Vol. 33. 4780\u20134789."},{"key":"e_1_2_1_40_1","volume-title":"Automation and Test in Europe Conference (DATE'18)","author":"Schorn Christoph","year":"2018","unstructured":"Christoph Schorn , Andre Guntoro , and Gerd Ascheid . 2018 . Accurate neuron resilience prediction for a flexible reliability management in neural network accelerators. In IEEE\/ACM Design , Automation and Test in Europe Conference (DATE'18) . Christoph Schorn, Andre Guntoro, and Gerd Ascheid. 2018. Accurate neuron resilience prediction for a flexible reliability management in neural network accelerators. In IEEE\/ACM Design, Automation and Test in Europe Conference (DATE'18)."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327345.3327509"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNS.2017.2743198"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/RAMS.2011.5754515"},{"key":"e_1_2_1_44_1","unstructured":"Christian Szegedy W. Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian J. Goodfellow and R. Fergus. 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 (2013).  Christian Szegedy W. Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian J. Goodfellow and R. Fergus. 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 (2013)."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2844093"},{"key":"e_1_2_1_46_1","volume-title":"A study of deep learning robustness against computation failures. arXiv:1704.05396","author":"Vialatte Jean-Charles","year":"2017","unstructured":"Jean-Charles Vialatte and Fran\u00e7ois Leduc-Primeau . 2017. A study of deep learning robustness against computation failures. arXiv:1704.05396 ( 2017 ). Jean-Charles Vialatte and Fran\u00e7ois Leduc-Primeau. 2017. A study of deep learning robustness against computation failures. arXiv:1704.05396 (2017)."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992696"},{"key":"e_1_2_1_48_1","volume-title":"Jeong-Hun Kim, J. Im, Solyee Im, Yeriaron Kim, Kyeong-Sik Min, and S. Moon.","author":"Woo Jiyong","year":"2020","unstructured":"Jiyong Woo , Tien Van Nguyen , Jeong-Hun Kim, J. Im, Solyee Im, Yeriaron Kim, Kyeong-Sik Min, and S. Moon. 2020 . Exploiting defective RRAM array as synapses of HTM spatial pooler with boost-factor adjustment scheme for defect-tolerant neuromorphic systems. Sci. Rep . 10 (2020). Jiyong Woo, Tien Van Nguyen, Jeong-Hun Kim, J. Im, Solyee Im, Yeriaron Kim, Kyeong-Sik Min, and S. Moon. 2020. Exploiting defective RRAM array as synapses of HTM spatial pooler with boost-factor adjustment scheme for defect-tolerant neuromorphic systems. Sci. Rep. 10 (2020)."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/JETCAS.2017.2776980"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3062248"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSCC42613.2021.9365769"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASP-DAC47756.2020.9045134"},{"key":"e_1_2_1_53_1","volume-title":"AAAI Conference on Artificial Intelligence.","author":"Zhang Quanshi","year":"2018","unstructured":"Quanshi Zhang , Ruiming Cao , Feng Shi , Ying Nian Wu , and Song-Chun Zhu . 2018 . Interpreting CNN knowledge via an explanatory graph . In AAAI Conference on Artificial Intelligence. Quanshi Zhang, Ruiming Cao, Feng Shi, Ying Nian Wu, and Song-Chun Zhu. 2018. Interpreting CNN knowledge via an explanatory graph. In AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_54_1","volume-title":"Automation and Test in Europe Conference (DATE'19)","author":"Zhao Yang","year":"2019","unstructured":"Yang Zhao , X. Hu , Shuangchen Li , Jing Ye , Lei Deng , Y. Ji , Jianyu Xu , Dong Wu , and Yuan Xie . 2019 . Memory Trojan attack on neural network accelerators. IEEE\/ACM Design , Automation and Test in Europe Conference (DATE'19) . 1415\u20131420. Yang Zhao, X. Hu, Shuangchen Li, Jing Ye, Lei Deng, Y. Ji, Jianyu Xu, Dong Wu, and Yuan Xie. 2019. Memory Trojan attack on neural network accelerators. IEEE\/ACM Design, Automation and Test in Europe Conference (DATE'19). 1415\u20131420."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173549"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3316781.3317739"},{"key":"e_1_2_1_57_1","volume-title":"International Conference on Learning Representations (ICLR'17)","author":"Zoph Barret","year":"2017","unstructured":"Barret Zoph and Quoc V. Le . 2017. Neural architecture search with reinforcement learning . In International Conference on Learning Representations (ICLR'17) ( 2017 ). Barret Zoph and Quoc V. Le. 2017. Neural architecture search with reinforcement learning. In International Conference on Learning Representations (ICLR'17) (2017)."}],"container-title":["ACM Transactions on Design Automation of Electronic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460288","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460288","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:31Z","timestamp":1750193311000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460288"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,12]]},"references-count":57,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3460288"],"URL":"https:\/\/doi.org\/10.1145\/3460288","relation":{},"ISSN":["1084-4309","1557-7309"],"issn-type":[{"value":"1084-4309","type":"print"},{"value":"1557-7309","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,12]]},"assertion":[{"value":"2020-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}