{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T16:12:15Z","timestamp":1774455135183,"version":"3.50.1"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T00:00:00Z","timestamp":1675987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Archit. Code Optim."],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>The workload co-location, such as deploying offline analysis workloads with online service workloads on the same node, has become common for modern data centers. Workload co-location deployment improves data center resource utilization significantly. Still, it also introduces resource contention, resulting in the online service\u2019s quality of service fluctuation, which we call performance interference. As the online service is a tail-latency-sensitive workload, the tail-latency metric can reflect the performance interference degree of the co-location workloads at the application level. However, to guide system design and evaluation, quantitatively evaluating the resource contention of the co-located workloads at the system level is also essential. This article proposes a novel metric called System-Level Entropy (SLE). As a system-level metric, SLE can measure quantitatively resource contention of the co-location systems and perform the apples-to-apples comparison between systems. The experimental results show that SLE can accurately reflect the performance interference of workloads and then evaluate the system resource contention. We also demonstrate two case studies of the SLE. We quantify the affinity of different co-location combinations, including three online services and five offline workloads. Furthermore, we evaluate the effects of state-of-the-art isolated mechanisms (the container and the CPU\u2013affinity binding) with these co-location combinations.<\/jats:p>","DOI":"10.1145\/3563696","type":"journal-article","created":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T11:20:08Z","timestamp":1663845608000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Quantifying Resource Contention of Co-located Workloads with the System-level Entropy"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1296-4371","authenticated-orcid":false,"given":"Yi","family":"Liang","sequence":"first","affiliation":[{"name":"Beijing University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0202-9179","authenticated-orcid":false,"given":"Shaokang","family":"Zeng","sequence":"additional","affiliation":[{"name":"Beijing University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6909-9561","authenticated-orcid":false,"given":"Lei","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,2,10]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Sort Benchmark. Retrieved from http:\/\/sortbenchmark.org\/."},{"key":"e_1_3_2_3_2","unstructured":"Speccpu. Retrieved from http:\/\/www.spec.org\/cpu."},{"key":"e_1_3_2_4_2","unstructured":"Tpcc. Retrieved from http:\/\/www.tpc.org\/tpcc."},{"key":"e_1_3_2_5_2","unstructured":"Martin Abadi Paul Barham Jianmin Chen Zhifeng Chen Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Geoffrey Irving and Michael Isard. 2016. In Proceeding of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI\u201916) Savannah GA 265\u2013283. https:\/\/www.usenix.org\/conference\/osdi16\/technical-sessions\/presentation\/abadi."},{"key":"e_1_3_2_6_2","first-page":"1","volume-title":"Proceedings of the 19th IEEE International Symposium on High Performance Computer Architecture (HPCA\u201913)","author":"Blem Emily R.","year":"2013","unstructured":"Emily R. Blem, Jaikrishnan Menon, and Karthikeyan Sankaralingam. 2013. Power struggles: Revisiting the RISC vs. CISC debate on contemporary ARM and x86 architectures. In Proceedings of the 19th IEEE International Symposium on High Performance Computer Architecture (HPCA\u201913). 1\u201312. 10.1109\/HPCA.2013.6522302"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-010-2091-6","volume-title":"Theoretical Physics and Philosophical Problems","author":"Boltzmann Ludwig","year":"1974","unstructured":"Ludwig Boltzmann. 1974. Theoretical Physics and Philosophical Problems. Reidel Pub. Co."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2890784"},{"key":"e_1_3_2_9_2","unstructured":"Neal Cardwell Stefan Savage and Thomas E. Anderson. 2000. Modeling TCP latency. 3 (2000) 1742\u20131751."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TETCI.2017.2755691"},{"key":"e_1_3_2_11_2","first-page":"516","volume-title":"Proceedings of the IEEE International Conference on Big Data (Big Data\u201918)","author":"Chen Hsing-bung H. B.","year":"2018","unstructured":"Hsing-bung H. B. Chen. 2018. A universal namespace approach to support metadata management and efficient data convergence of HPC and cloud scientific workflows. In Proceedings of the IEEE International Conference on Big Data (Big Data\u201918). 516\u2013521. 10.1109\/BigData.2018.8622588"},{"key":"e_1_3_2_12_2","first-page":"125","volume-title":"Proceedings of the IEEE International Symposium on Workload Characterization (IISWC\u201917)","author":"Chen Shuang","year":"2017","unstructured":"Shuang Chen, Shay GalOn, Christina Delimitrou, Srilatha Manne, and Jos\u00e9 F. Mart\u00ednez. 2017. Workload characterization of interactive cloud services on big and small server platforms. In Proceedings of the IEEE International Symposium on Workload Characterization (IISWC\u201917). 125\u2013134. 10.1109\/IISWC.2017.8167770"},{"key":"e_1_3_2_13_2","first-page":"2278","volume-title":"Proceedings of the 21st IEEE International Conference on High Performance Computing and Communications, the 17th IEEE International Conference on Smart City, the 5th IEEE International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS\u201919)","author":"Chen Wenyan","year":"2019","unstructured":"Wenyan Chen, Kejiang Ye, and Cheng-Zhong Xu. 2019. Co-locating online workload and offline workload in the cloud: An interference analysis. In Proceedings of the 21st IEEE International Conference on High Performance Computing and Communications, the 17th IEEE International Conference on Smart City, the 5th IEEE International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS\u201919). 2278\u20132283. 10.1109\/HPCC\/SmartCity\/DSS.2019.00316"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-016-1630-1"},{"key":"e_1_3_2_15_2","first-page":"12:1\u201312:3","volume-title":"Proceedings of the 9th Asia-Pacific Workshop on Systems (APSys\u201918)","author":"Cheng Yue","year":"2018","unstructured":"Yue Cheng, Zheng Chai, and Ali Anwar. 2018. Characterizing co-located datacenter workloads: An Alibaba case study. In Proceedings of the 9th Asia-Pacific Workshop on Systems (APSys\u201918). 12:1\u201312:3. 10.1145\/3265723.3265742"},{"issue":"1015","key":"e_1_3_2_16_2","first-page":"38","article-title":"Pearson\u2019s correlation coefficient.","volume":"109","author":"Coefficient Pearson\u2019s Correlation","year":"1996","unstructured":"Pearson\u2019s Correlation Coefficient. 1996. Pearson\u2019s correlation coefficient. N. Z. Med. J. 109, 1015 (1996), 38.","journal-title":"N. Z. Med. J."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2019.2926142"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2408776.2408794"},{"key":"e_1_3_2_19_2","first-page":"77","volume-title":"Proceedings of the Architectural Support for Programming Languages and Operating Systems (ASPLOS\u201913)","author":"Delimitrou Christina","year":"2013","unstructured":"Christina Delimitrou and Christos Kozyrakis. 2013. Paragon: QoS-aware scheduling for heterogeneous datacenters. In Proceedings of the Architectural Support for Programming Languages and Operating Systems (ASPLOS\u201913). 77\u201388. 10.1145\/2451116.2451125"},{"key":"e_1_3_2_20_2","first-page":"127","volume-title":"Proceedings of the Architectural Support for Programming Languages and Operating Systems (ASPLOS\u201914)","author":"Delimitrou Christina","year":"2014","unstructured":"Christina Delimitrou and Christos Kozyrakis. 2014. Quasar: Resource-efficient and QoS-aware cluster management. In Proceedings of the Architectural Support for Programming Languages and Operating Systems (ASPLOS\u201914). 127\u2013144. 10.1145\/2541940.2541941"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2980024.2872365"},{"issue":"9","key":"e_1_3_2_22_2","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1002\/cpe.728","article-title":"The LINPACK benchmark: Past, present and future","volume":"15","author":"Dongarra J. J.","year":"2003","unstructured":"J. J. Dongarra, P. Luszczek, and A. Petitet. 2003. The LINPACK benchmark: Past, present and future. Concurr. Comput.: Pract. Exper. 15, 9 (2003), 803\u2013820.","journal-title":"Concurr. Comput.: Pract. Exper."},{"key":"e_1_3_2_23_2","first-page":"7","volume-title":"Proceedings of the 1st COSH Workshop on Co-Scheduling of HPC Applications (COSH@HiPEAC\u201916)","author":"Haritatos Alexandros-Herodotos","year":"2016","unstructured":"Alexandros-Herodotos Haritatos, Konstantinos Nikas, Georgios I. Goumas, and Nectarios Koziris. 2016. A resource-centric application classification approach. In Proceedings of the 1st COSH Workshop on Co-Scheduling of HPC Applications (COSH@HiPEAC\u201916). 7\u201312. 10.14459\/2016md1286948"},{"key":"e_1_3_2_24_2","volume-title":"Computer Architecture: A Quantitative Approach","author":"Hennessy John L.","year":"2012","unstructured":"John L. Hennessy and David A. Patterson. 2012. Computer Architecture: A Quantitative Approach. Elsevier."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-44728-1_4"},{"key":"e_1_3_2_26_2","volume-title":"The Art of Computer Systems Performance Analysis","author":"Jain Raj","year":"1991","unstructured":"Raj Jain. 1991. The Art of Computer Systems Performance Analysis, Vol. 182. John Wiley & Sons Chichester."},{"key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1145\/3127479.3132244","volume-title":"Proceedings of the Symposium on Cloud Computing (SoCC\u201917)","author":"Janus Pawel","year":"2017","unstructured":"Pawel Janus and Krzysztof Rzadca. 2017. SLO-aware colocation of data center tasks based on instantaneous processor requirements. In Proceedings of the Symposium on Cloud Computing (SoCC\u201917). 256\u2013268. 10.1145\/3127479.3132244"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/1837915.1837922"},{"key":"e_1_3_2_29_2","first-page":"3","volume-title":"Proceedings of the IEEE International Symposium on Workload Characterization (IISWC\u201916)","author":"Kasture Harshad","year":"2016","unstructured":"Harshad Kasture and Daniel S\u00e1nchez. 2016. Tailbench: A benchmark suite and evaluation methodology for latency-critical applications. In Proceedings of the IEEE International Symposium on Workload Characterization (IISWC\u201916). 3\u201312. 10.1109\/IISWC.2016.7581261"},{"key":"e_1_3_2_30_2","first-page":"549","volume-title":"Proceedings of the 23rd International Conference on Architectural Support for Programming Languages and Operating Systems","author":"Lee Jaewon","year":"2018","unstructured":"Jaewon Lee, Changkyu Kim, Kun Lin, Liqun Cheng, Rama Govindaraju, and Jangwoo Kim. 2018. WSMeter: A performance evaluation methodology for Google\u2019s production warehouse-scale computers. In Proceedings of the 23rd International Conference on Architectural Support for Programming Languages and Operating Systems. ACM, 549\u2013563."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.3233\/JCM-160608"},{"key":"e_1_3_2_32_2","first-page":"393","volume-title":"Proceedings of the International Symposium on Computer Architecture","author":"Liu Shaoli","year":"2016","unstructured":"Shaoli Liu, Zidong Du, Jinhua Tao, Dong Han, Tao Luo, Yuan Xie, Yunji Chen, and Tianshi Chen. 2016. Cambricon: An instruction set architecture for neural networks. In Proceedings of the International Symposium on Computer Architecture. 393\u2013405."},{"key":"e_1_3_2_33_2","first-page":"421","volume-title":"Proceedings of the IEEE International Symposium on High Performance Computer Architecture (HPCA\u201917)","author":"Llull Qiuyun","year":"2017","unstructured":"Qiuyun Llull, Songchun Fan, Seyed Majid Zahedi, and Benjamin C. Lee. 2017. Cooper: Task colocation with cooperative games. In Proceedings of the IEEE International Symposium on High Performance Computer Architecture (HPCA\u201917). 421\u2013432. 10.1109\/HPCA.2017.22"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/2882783"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1145\/2155620.2155650","volume-title":"Proceedings of the 44rd Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO\u201911)","author":"Mars Jason","year":"2011","unstructured":"Jason Mars, Lingjia Tang, Robert Hundt, Kevin Skadron, and Mary Lou Soffa. 2011. Bubble-up: Increasing utilization in modern warehouse scale computers via sensible co-locations. In Proceedings of the 44rd Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO\u201911). 248\u2013259. 10.1145\/2155620.2155650"},{"key":"e_1_3_2_36_2","first-page":"1616","volume-title":"Proceedings of the IEEE International Solid-State Circuits Conference (ISSCC\u201906)","author":"Nakajima Masami","year":"2006","unstructured":"Masami Nakajima, Hideyuki Noda, Katsumi Dosaka, Kiyoshi Nakata, Motoki Higashida, Osamu Yamamoto, Katsuya Mizumoto, Hiroyuki Kondo, Yukihiko Shimazu, and Kazutami Arimoto. 2006. A 40GOPS 250mW massively parallel processor based on matrix architecture. In Proceedings of the IEEE International Solid-State Circuits Conference (ISSCC\u201906). IEEE, 1616\u20131625."},{"key":"e_1_3_2_37_2","first-page":"51","volume-title":"Proceedings of the 4th IEEE\/ACIS International Conference on Big Data, Cloud Computing, Data Science and Engineering (BCD\u201919)","author":"Noor Shahid","year":"2019","unstructured":"Shahid Noor, Bridget Koehler, Abby Steenson, Jesus Caballero, David Ellenberger, and Lucas Heilman. 2019. IoTDoc: A docker-container based architecture of IoT-enabled cloud system. In Proceedings of the 4th IEEE\/ACIS International Conference on Big Data, Cloud Computing, Data Science and Engineering (BCD\u201919). 51\u201368. 10.1007\/978-3-030-24405-7_4"},{"key":"e_1_3_2_38_2","unstructured":"S. Gopal Krishna Patro and Kishore Kumar Sahu. 2015. Normalization: A preprocessing stage. arxiv:1503.06462. Retrieved from http:\/\/arxiv.org\/abs\/1503.06462."},{"key":"e_1_3_2_39_2","first-page":"743","volume-title":"Proceedings of the 35th International Convention on Information, Communication and Electronic Technology (MIPRO\u201912)","author":"Pesovic U.","year":"2012","unstructured":"U. Pesovic, Z. Jovanovic, S. Randjic, and D. Markovic. 2012. Benchmarking performance and energy efficiency of microprocessors for wireless sensor network applications. In Proceedings of the 35th International Convention on Information, Communication and Electronic Technology (MIPRO\u201912). IEEE, 743\u2013747."},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the 30th Norsk Informatikkonferanse (NIK\u201917)","author":"Raknes Inge Alexander","year":"2017","unstructured":"Inge Alexander Raknes, Bj\u00f8rn Fjukstad, and Lars Ailo Bongo. 2017. nsroot: Minimalist process isolation tool implemented with Linux namespaces. In Proceedings of the 30th Norsk Informatikkonferanse (NIK\u201917). https:\/\/ojs.bibsys.no\/index.php\/NIK\/article\/view\/432."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2010.68"},{"key":"e_1_3_2_42_2","first-page":"351","volume-title":"Proceedings of the 8th European Conference on Computer Systems (EuroSys\u201913)","author":"Schwarzkopf Malte","year":"2013","unstructured":"Malte Schwarzkopf, Andy Konwinski, Michael Abd-El-Malek, and John Wilkes. 2013. Omega: Flexible, scalable schedulers for large compute clusters. In Proceedings of the 8th European Conference on Computer Systems (EuroSys\u201913). 351\u2013364. 10.1145\/2465351.2465386"},{"key":"e_1_3_2_43_2","first-page":"82","volume-title":"Proceedings of the 11th IEEE International Conference on Cloud Computing (CLOUD\u201918)","author":"Shekhar Shashank","year":"2018","unstructured":"Shashank Shekhar, Hamzah Abdel-Aziz, Anirban Bhattacharjee, Aniruddha S. Gokhale, and Xenofon D. Koutsoukos. 2018. Performance interference-aware vertical elasticity for cloud-hosted latency-sensitive applications. In Proceedings of the 11th IEEE International Conference on Cloud Computing (CLOUD\u201918). 82\u201389. 10.1109\/CLOUD.2018.00018"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3382190"},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","unstructured":"Chunqiang Tang Thawan Kooburat Pradeep Venkatachalam Akshay Chander Zhe Wen Aravind Narayanan Patrick Dowell and Robert Karl. 2015. Holistic configuration management at Facebook. InProceedings of the ACM Symposium on Operating Systems Principles (SOSP\u201915). Association for Computing Machinery New York NY 328\u2013343. 10.1145\/2815400.2815401","DOI":"10.1145\/2815400.2815401"},{"key":"e_1_3_2_46_2","first-page":"18:1\u201318:17","volume-title":"Proceedings of the 10th European Conference on Computer Systems (EuroSys\u201915)","author":"Verma Abhishek","year":"2015","unstructured":"Abhishek Verma, Luis Pedrosa, Madhukar Korupolu, David Oppenheimer, Eric Tune, and John Wilkes. 2015. Large-scale cluster management at Google with Borg. In Proceedings of the 10th European Conference on Computer Systems (EuroSys\u201915). 18:1\u201318:17. 10.1145\/2741948.2741964"},{"key":"e_1_3_2_47_2","first-page":"19","volume-title":"Proceedings of the 1st COSH Workshop on Co-Scheduling of HPC Applications (COSH@HiPEAC\u201916)","author":"Weidendorfer Josef","year":"2016","unstructured":"Josef Weidendorfer and Jens Breitbart. 2016. Detailed characterization of HPC applications for co-scheduling. In Proceedings of the 1st COSH Workshop on Co-Scheduling of HPC Applications (COSH@HiPEAC\u201916). 19\u201324. 10.14459\/2016md1286951"},{"key":"e_1_3_2_48_2","first-page":"105","volume-title":"Proceedings of the First BenchCouncil International Symposium on Benchmarking, Measuring, and Optimizing (Bench\u201918)","author":"Xiong Xingwang","year":"2018","unstructured":"Xingwang Xiong, Lei Wang, Wanling Gao, Rui Ren, Ke Liu, Chen Zheng, Yu Wen, and Yi Liang. 2018. DCMIX: Generating mixed workloads for the cloud data center. In Proceedings of the First BenchCouncil International Symposium on Benchmarking, Measuring, and Optimizing (Bench\u201918). 105\u2013117. 10.1007\/978-3-030-32813-9_10"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSYST.2015.2429731"},{"key":"e_1_3_2_50_2","first-page":"146","volume-title":"Proceedings of the 19th International Middleware Conference (Middleware\u201918)","author":"Xu Ran","year":"2018","unstructured":"Ran Xu, Subrata Mitra, Jason Rahman, Peter Bai, Bowen Zhou, Greg Bronevetsky, and Saurabh Bagchi. 2018. Pythia: Improving datacenter utilization via precise contention prediction for multiple co-located workloads. In Proceedings of the 19th International Middleware Conference (Middleware\u201918). 146\u2013160. 10.1145\/3274808.3274820"},{"key":"e_1_3_2_51_2","first-page":"1057","volume-title":"Proceedings of the 24th IEEE International Conference on Parallel and Distributed Systems (ICPADS\u201918)","author":"Ye Kejiang","year":"2018","unstructured":"Kejiang Ye, Yanmin Kou, Chengzhi Lu, Yang Wang, and Cheng-Zhong Xu. 2018. Modeling application performance in docker containers using machine learning techniques. In Proceedings of the 24th IEEE International Conference on Parallel and Distributed Systems (ICPADS\u201918). 1057\u20131062. 10.1109\/PADSW.2018.8644581"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2017.2758781"},{"key":"e_1_3_2_53_2","first-page":"772","volume-title":"Proceedings of the 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD\u201916)","author":"Zhang Jing","year":"2016","unstructured":"Jing Zhang, Jiang Rong, Qiujun Liao, Jia Wang, and Xiaoyun Yang. 2016. Cloud computing credibility evaluation based on grey clustering and entropy. In Proceedings of the 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD\u201916). 772\u2013776. 10.1109\/FSKD.2016.7603273"},{"key":"e_1_3_2_54_2","first-page":"379","volume-title":"Proceedings of the 8th European Conference on Computer Systems (EuroSys\u201913)","author":"Zhang Xiao","year":"2013","unstructured":"Xiao Zhang, Eric Tune, Robert Hagmann, Rohit Jnagal, Vrigo Gokhale, and John Wilkes. 2013. CPI \\({}^{{2}}\\) : CPU performance isolation for shared compute clusters. In Proceedings of the 8th European Conference on Computer Systems (EuroSys\u201913). 379\u2013391. 10.1145\/2465351.2465388"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3034517"}],"container-title":["ACM Transactions on Architecture and Code Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3563696","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3563696","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:38:09Z","timestamp":1750178289000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3563696"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,10]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3563696"],"URL":"https:\/\/doi.org\/10.1145\/3563696","relation":{},"ISSN":["1544-3566","1544-3973"],"issn-type":[{"value":"1544-3566","type":"print"},{"value":"1544-3973","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,10]]},"assertion":[{"value":"2021-12-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-05","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}