{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:10:40Z","timestamp":1750219840285,"version":"3.41.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T00:00:00Z","timestamp":1698710400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003696","name":"Electronics and Telecommunications Research Institute","doi-asserted-by":"crossref","award":["23ZS1310"],"award-info":[{"award-number":["23ZS1310"]}],"id":[{"id":"10.13039\/501100003696","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"crossref","award":["2019R1A2C2089773"],"award-info":[{"award-number":["2019R1A2C2089773"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Institute of Information & communications Technology Planning & Evaluation","award":["IITP-2021-0-01363"],"award-info":[{"award-number":["IITP-2021-0-01363"]}]},{"name":"Korea government"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:p>There have been drastic changes in the storage device landscape recently. At the center of the diverse storage landscape lies the NVMe interface, which allows high-performance and flexible communication models required by these next-generation device types. However, its hardware-oriented definition and specification are bottlenecking the development and evaluation cycle for new revolutionary storage devices. Furthermore, existing emulators lack the capability to support the advanced storage configurations that are currently in the spotlight.<\/jats:p>\n          <jats:p>In this article, we present NVMeVirt, a novel approach to facilitate software-defined NVMe devices. A user can define any NVMe device type with custom features, and NVMeVirt allows it to bridge the gap between the host I\/O stack and the virtual NVMe device in software. We demonstrate the advantages and features of NVMeVirt by realizing various storage types and configurations, such as conventional SSDs, low-latency high-bandwidth NVM SSDs, zoned namespace SSDs, and key-value SSDs with the support of PCI peer-to-peer DMA and NVMe-oF target offloading. We also make cases for storage research with NVMeVirt, such as studying the performance characteristics of database engines and extending the NVMe specification for the improved key-value SSD performance.<\/jats:p>","DOI":"10.1145\/3625006","type":"journal-article","created":{"date-parts":[[2023,9,21]],"date-time":"2023-09-21T12:14:17Z","timestamp":1695298457000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Empowering Storage Systems Research with NVMeVirt: A Comprehensive NVMe Device Emulator"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2105-1734","authenticated-orcid":false,"given":"Sang-Hoon","family":"Kim","sequence":"first","affiliation":[{"name":"Ajou University, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9299-2663","authenticated-orcid":false,"given":"Jaehoon","family":"Shim","sequence":"additional","affiliation":[{"name":"Seoul National University, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-3434-1343","authenticated-orcid":false,"given":"Euidong","family":"Lee","sequence":"additional","affiliation":[{"name":"Seoul National University, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3126-5008","authenticated-orcid":false,"given":"Seongyeop","family":"Jeong","sequence":"additional","affiliation":[{"name":"Seoul National University, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-7391-0900","authenticated-orcid":false,"given":"Ilkueon","family":"Kang","sequence":"additional","affiliation":[{"name":"Seoul National University, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1065-9362","authenticated-orcid":false,"given":"Jin-Soo","family":"Kim","sequence":"additional","affiliation":[{"name":"Seoul National University, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,31]]},"reference":[{"key":"e_1_3_1_2_2","volume-title":"Proceedings of the 2011 USENIX Annual Technical Conference (ATC\u201911)","author":"Amit Nadav","year":"2011","unstructured":"Nadav Amit, Muli Ben-Yehuda, Dan Tsafrir, and Assaf Schuster. 2011. vIOMMU: Efficient IOMMU emulation. In Proceedings of the 2011 USENIX Annual Technical Conference (ATC\u201911). USENIX Association."},{"key":"e_1_3_1_3_2","unstructured":"Jens Axboe. n. d. fio: Flexible I\/O Tester. https:\/\/github.com\/axboe\/fio"},{"key":"e_1_3_1_4_2","volume-title":"Proceedings of the 19th USENIX Conference on File and Storage Technologies (FAST\u201921)","author":"Bae Jonghyun","year":"2021","unstructured":"Jonghyun Bae, Jongsung Lee, Yunho Jin, Sam Son, Shine Kim, Hakbeom Jang, Tae Jun Ham, and Jae W. Lee. 2021. FlashNeuron: SSD-enabled large-batch training of very deep neural networks. In Proceedings of the 19th USENIX Conference on File and Storage Technologies (FAST\u201921). USENIX Association."},{"key":"e_1_3_1_5_2","volume-title":"Proceedings of the 2021 USENIX Annual Technical Conference (ATC\u201921)","author":"Bj\u00f8rling Matias","year":"2021","unstructured":"Matias Bj\u00f8rling, Abutalib Aghayev, Hans Holmberg, Aravind Ramesh, Damien Le Moal, Gregory R. Ganger, and George Amvrosiadis. 2021. ZNS: Avoiding the block interface tax for flash-based SSDs. In Proceedings of the 2021 USENIX Annual Technical Conference (ATC\u201921). USENIX Association."},{"key":"e_1_3_1_6_2","first-page":"359","volume-title":"Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST\u201917)","author":"Bj\u00f8rling Matias","year":"2017","unstructured":"Matias Bj\u00f8rling, Javier Gonzalez, and Philippe Bonnet. 2017. LightNVM: The Linux open-channel SSD subsystem. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST\u201917). USENIX Association, 359\u2013375."},{"key":"e_1_3_1_7_2","unstructured":"Couchbase Labs. n. d. ForestDB Benchmark. https:\/\/github.com\/couchbaselabs\/ForestDB-Benchmark"},{"key":"e_1_3_1_8_2","unstructured":"db ranking. n. d. DB-Engines Ranking. https:\/\/db-engines.com\/en\/ranking"},{"key":"e_1_3_1_9_2","unstructured":"DeepSpeed. n. d. ZeRO-Inference: Democratizing massive model inference. https:\/\/www.deepspeed.ai\/2022\/09\/09\/zero-inference.html"},{"issue":"4","key":"e_1_3_1_10_2","first-page":"21","article-title":"Cost-effective, energy-efficient, and scalable storage computing for large-scale AI applications","volume":"16","author":"Do Jaeyoung","year":"2020","unstructured":"Jaeyoung Do, Victor C. Ferreira, Hossein Bobarshad, Mahdi Torabzadehkashi, Siavash Rezaei, Ali Heydarigorji, Diego Souza, Brunno F. Goldstien, Leandro Santiago, Min Soo Kim, Priscila M. V. Lima, M. G. Fran\u00e7a, and Vladimir Alves. 2020. Cost-effective, energy-efficient, and scalable storage computing for large-scale AI applications. ACM Transactions on Storage 16, 4, Article 21 (2020), 37 pages.","journal-title":"ACM Transactions on Storage"},{"key":"e_1_3_1_11_2","unstructured":"Samsung Electronics. n. d. Samsung Enterprise SSD. https:\/\/www.samsung.com\/semiconductor\/ssd\/enterprise-ssd\/"},{"key":"e_1_3_1_12_2","unstructured":"NVM Express. n. d. NVMe-oF Specification. https:\/\/nvmexpress.org\/developers\/nvme-of-specification\/"},{"issue":"9","key":"e_1_3_1_13_2","first-page":"133","article-title":"Reprogramming 3D TLC flash memory based solid state drives","volume":"18","author":"Gao Congming","year":"2022","unstructured":"Congming Gao, Min Ye, Chun Jason Xue, Youtao Zhang, Liang Shi, Jiwu Shu, and Jun Yang. 2022. Reprogramming 3D TLC flash memory based solid state drives. ACM Transactions on Storage 18, 9 (May2022), 133 pages.","journal-title":"ACM Transactions on Storage"},{"key":"e_1_3_1_14_2","first-page":"469","volume-title":"Proceedings of the 51st Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO\u201918)","author":"Gouk Donghyun","year":"2018","unstructured":"Donghyun Gouk, Miryeong Kwon, Jie Zhang, Sungjoon Koh, Wonil Choi, Nam Sung Kim, Mahmut Kandemir, and Myoungsoo Jung. 2018. Amber: Enabling precise full-system simulation with detailed modeling of all SSD resources. In Proceedings of the 51st Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO\u201918). 469\u2013481."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2016.23"},{"key":"e_1_3_1_16_2","volume-title":"Proceedings of the 15nd USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201921)","author":"Han Kyuhwa","year":"2021","unstructured":"Kyuhwa Han, Hyunho Gwak, Dongkun Shin, and Jooyoung Hwang. 2021. ZNS+: Advanced zoned namespace interface for supporting in-storage zone compaction. In Proceedings of the 15nd USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201921)."},{"key":"e_1_3_1_17_2","unstructured":"Major Hayden. n. d. MySQLTuner. https:\/\/github.com\/major\/MySQLTuner-perl"},{"key":"e_1_3_1_18_2","first-page":"6","volume-title":"Proceedings of the 55th ACM\/ESDA\/IEEE Annual Design Automation Conference (DAC\u201918)","author":"Ho Chien-Chung","year":"2018","unstructured":"Chien-Chung Ho, Yung-Chun Li, Yuan-Hao Chang, and Yu-Ming Chang. 2018. Achieving defect-free multilevel 3D flash memories with one-shot program design. In Proceedings of the 55th ACM\/ESDA\/IEEE Annual Design Automation Conference (DAC\u201918). 6 pages."},{"key":"e_1_3_1_19_2","unstructured":"Junsu Im Jinwook Bae Chanwoo Chung Arvind and Sungjin Lee. 2020. PinK: High-speed in-storage key-value store with bounded tails. In Proceedings of the 2020 USENIX Annual Technical Conference (ATC\u201920) 173\u2013187."},{"key":"e_1_3_1_20_2","unstructured":"Intel. n. d. Intel I\/O Acceleration Technology. https:\/\/www.intel.co.kr\/content\/www\/kr\/ko\/wireless-network\/accel-technology.html"},{"key":"e_1_3_1_21_2","unstructured":"Intel. n. d. Intel Optane SSD 9 Series. https:\/\/www.intel.com\/content\/www\/us\/en\/products\/details\/memory-storage\/consumer-ssds\/optane-ssd-9-series.html"},{"key":"e_1_3_1_22_2","unstructured":"Joseph Izraelevitz Jian Yang Lu Zhang Juno Kim Xiao Liu Amirsaman Memaripour Yun Joon Soh Zixuan Wang Yi Xu Subramanya R. Dulloor Jishen Zhao and Steven Swanson. n. d. Basic Performance Measurements of the Intel Optane DC Persistent Memory Module. arxiv:1903.05714http:\/\/arxiv.org\/abs\/1903.05714"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/2464821"},{"key":"e_1_3_1_24_2","first-page":"373","volume-title":"Proceedings of the 23rd IEEE Symposium on High Performance Computer Architecture (HPCA\u201917)","author":"Jin Yanqin","year":"2017","unstructured":"Yanqin Jin, Hung-Wei Tseng, Yannis Papakonstantinou, and Steven Swanson. 2017. KAML: A flexible, high-performance key-value SSD. In Proceedings of the 23rd IEEE Symposium on High Performance Computer Architecture (HPCA\u201917). IEEE, 373\u2013384."},{"key":"e_1_3_1_25_2","volume-title":"Proceedings of the 45rd ACM\/IEEE International Symposium on Computer Architecture (ISCA\u201918)","author":"Jun Sang-Woo","year":"2018","unstructured":"Sang-Woo Jun, Andy Wright, Sizhuo Zhang, Shuotao Xu, and Arvind. 2018. GraFBoost: Using accelerated flash storage for external graph analytics. In Proceedings of the 45rd ACM\/IEEE International Symposium on Computer Architecture (ISCA\u201918). Los Angeles, CA."},{"key":"e_1_3_1_26_2","unstructured":"Myoungsoo Jung. 2020. OpenExpress: Fully hardware automated open research framework for future fast NVMe devices. In Proceedings of the 2020 USENIX Annual Technical Conference (ATC\u201920) ."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/LCA.2017.2750658"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3319647.3325831"},{"key":"e_1_3_1_29_2","volume-title":"Proceedings of the 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage\u201916)","author":"Kim Hyeong-Jun","year":"2016","unstructured":"Hyeong-Jun Kim, Young-Sik Lee, and Jin-Soo Kim. 2016. NVMeDirect: A user-space I\/O framework for application-specific optimization on NVMe SSDs. In Proceedings of the 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage\u201916)."},{"issue":"2","key":"e_1_3_1_30_2","first-page":"14","article-title":"Performance modeling and practical use cases for black-box SSDs","volume":"17","author":"Kim Joonsung","year":"2021","unstructured":"Joonsung Kim, Kanghyun Choi, Wonsik Lee, and Jangwoo Kim. 2021. Performance modeling and practical use cases for black-box SSDs. ACM Transactions on Storage 17, 2, Article 14 (June2021), 38 pages.","journal-title":"ACM Transactions on Storage"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.5555\/3357062.3357064"},{"key":"e_1_3_1_32_2","unstructured":"kvceph. n. d. Open memory platform development kit. http:\/\/github.com\/OpenMPDK"},{"issue":"3","key":"e_1_3_1_33_2","first-page":"15","article-title":"Cosmos+ OpenSSD: Rapid prototype for flash storage systems","volume":"16","author":"Kwak Jaewook","year":"2020","unstructured":"Jaewook Kwak, Sangjin Lee, Kibin Park, Jinwoo Jeong, and Yong Ho Song. 2020. Cosmos+ OpenSSD: Rapid prototype for flash storage systems. ACM Transactions on Storage 16, 3, Article 15 (Aug.2020), 35 pages.","journal-title":"ACM Transactions on Storage"},{"key":"e_1_3_1_34_2","volume-title":"Proceedings of the 20th USENIX Conference on File and Storage Technologies (FAST\u201922)","author":"Kwon Miryeong","year":"2022","unstructured":"Miryeong Kwon, Donghyun Gouk, Sangwon Lee, and Myoungsoo Jung. 2022. Hardware\/software co-programmable framework for computational SSDs to accelerate deep learning service on large-scale graphs. In Proceedings of the 20th USENIX Conference on File and Storage Technologies (FAST\u201922). USENIX Association."},{"key":"e_1_3_1_35_2","unstructured":"Parallel Data Lab. n. d. The DiskSim Simulation Environment v4.0. https:\/\/www.pdl.cmu.edu\/DiskSim\/index.shtml"},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.future.2016.03.003","article-title":"ActiveSort: Efficient external sorting using active SSDs in the MapReduce framework","volume":"65","author":"Lee Young-Sik","year":"2016","unstructured":"Young-Sik Lee, Luis Cavazos Quero, Sang-Hoon Kim, Jin-Soo Kim, and Seungryoul Maeng. 2016. ActiveSort: Efficient external sorting using active SSDs in the MapReduce framework. Future Generation Computer Systems 65, C (Dec.2016), 76\u201389.","journal-title":"Future Generation Computer Systems"},{"key":"e_1_3_1_37_2","unstructured":"Huaicheng Li Mingzhe Hao Michael Hao Tong Swaminathan Sundararaman Matias Bj\u00f8rling and Haryadi S. Gunawi. 2018. The CASE of FEMU: Cheap accurate scalable and extensible flash emulator. In Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST\u201918) ."},{"key":"e_1_3_1_38_2","volume-title":"Proceedings of the 2019 USENIX Annual Technical Conference (ATC\u201919)","author":"Liang Shengwen","year":"2019","unstructured":"Shengwen Liang, Ying Wang, Youyou Lu, Zhe Yang, Huawei Li, and Xiaowei Li. 2019. Cognitive SSD: A deep learning engine for in-storage data retrieval. In Proceedings of the 2019 USENIX Annual Technical Conference (ATC\u201919). USENIX Association."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/2591272.2591299"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCC-SmartCity-DSS.2016.0157"},{"key":"e_1_3_1_41_2","first-page":"1","volume-title":"Proceedings of the 2017 International Conference on Networking, Architecture, and Storage (NAS\u201917)","author":"Malladi Krishna T.","year":"2017","unstructured":"Krishna T. Malladi, Mu-Tien Chang, Dimin Niu, and Hongzhong Zheng. 2017. FlashStorageSim: Performance modeling for SSD architectures. In Proceedings of the 2017 International Conference on Networking, Architecture, and Storage (NAS\u201917). 1\u20132."},{"key":"e_1_3_1_42_2","unstructured":"Microsoft. n. d. Megatron-DeepSpeed. https:\/\/github.com\/microsoft\/Megatron-DeepSpeed"},{"key":"e_1_3_1_43_2","unstructured":"Landon Curt Noll. n. d. FNV Hash. http:\/\/isthe.com\/chongo\/tech\/comp\/fnv\/"},{"key":"e_1_3_1_44_2","unstructured":"NVIDIA. n. d. GPUDirect Storage: A Direct Path Between Storage and GPU Memory. https:\/\/developer.nvidia.com\/blog\/gpudirect-storage"},{"key":"e_1_3_1_45_2","unstructured":"NVIDIA. n. d. The NVIDIA Magnum IO GPUDIrect Storage Overview Guide. https:\/\/docs.nvidia.com\/gpudirect-storage\/overview-guide\/index.html"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2541940.2541959"},{"key":"e_1_3_1_47_2","unstructured":"PCI SIG. n. d. PCI SIG. https:\/\/pcisig.com"},{"key":"e_1_3_1_48_2","unstructured":"pgtune. n. d. PGTune: configuration for PostgreSQL based on the maximum performance for a given hardware configuration. https:\/\/pgtune.leopard.in.ua\/"},{"key":"e_1_3_1_49_2","unstructured":"QMEU. n. d. QEMU: A Generic and Open Source Machine Emulator and Virtualizer. https:\/\/qemu.org"},{"key":"e_1_3_1_50_2","unstructured":"Facebook Research. n. d. Metaseq. https:\/\/github.com\/facebookresearch\/metaseq"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/DAC18074.2021.9586111"},{"key":"e_1_3_1_52_2","unstructured":"Samsung Electronics. n. d. OpenMPDK KVSSD. https:\/\/github.com\/OpenMPDK\/KVSSD\/"},{"key":"e_1_3_1_53_2","unstructured":"sysbench. n. d. Scriptable database and system performance benchmark. https:\/\/github.com\/akopytov\/sysbench"},{"key":"e_1_3_1_54_2","unstructured":"Arash Tavakkol Juan G\u00f3mez-Luna Mohammad Sadrosadati Saugata Ghose and Onur Mutlu. 2018. MQSim: A framework for enabling realistic studies of modern multi-queue SSD devices. In Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST\u201918) ."},{"key":"e_1_3_1_55_2","unstructured":"Tech Power Up. n. d. Samsung 970 Pro 512 GB. https:\/\/www.techpowerup.com\/ssd-specs\/samsung-970-pro-512-gb.d54"},{"key":"e_1_3_1_56_2","volume-title":"Proceedings of the 2019 International Conference for High Performance Computing, Networking, Storage and Analysis (SC\u201919)","author":"Weiland Mich\u00e8le","year":"2019","unstructured":"Mich\u00e8le Weiland, Holger Brunst, Tiago Quintino, Nick Johnson, Olivier Iffrig, Simon Smart, Christian Herold, Antonino Bonanni, Adrian Jackson, and Mark Parsons. 2019. An early evaluation of Intel\u2019s Optane DC persistent memory module and its impact on high-performance scientific applications. In Proceedings of the 2019 International Conference for High Performance Computing, Networking, Storage and Analysis (SC\u201919)."},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446763"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.5555\/3357062.3357066"},{"key":"e_1_3_1_59_2","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1109\/CloudCom.2017.14","volume-title":"Proceedings of the 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom\u201917)","author":"Yang Ziye","year":"2017","unstructured":"Ziye Yang, James R. Harris, Benjamin Walker, Daniel Verkamp, Changpeng Liu, Cunyin Chang, Gang Cao, Jonathan Stern, Vishal Verma, and Luse E. Paul. 2017. SPDK: A development kit to build high performance storage applications. In Proceedings of the 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom\u201917). 154\u2013161."},{"key":"e_1_3_1_60_2","volume-title":"Proceedings of the 29th IEEE Conference on Massive Data Storage (MSST\u201913)","author":"Yoo Jinsoo","year":"2013","unstructured":"Jinsoo Yoo, Youjip Won, Joongwoo Hwang, Sooyong Kang, Jongmoo Choi, Sungroh Yoon, and Jaehyuk Cha. 2013. VSSIM: Virtual machine based SSD simulator. In Proceedings of the 29th IEEE Conference on Massive Data Storage (MSST\u201913)."},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.5555\/2208461.2208462"}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3625006","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3625006","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:48Z","timestamp":1750178808000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3625006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,31]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,11,30]]}},"alternative-id":["10.1145\/3625006"],"URL":"https:\/\/doi.org\/10.1145\/3625006","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"type":"print","value":"1553-3077"},{"type":"electronic","value":"1553-3093"}],"subject":[],"published":{"date-parts":[[2023,10,31]]},"assertion":[{"value":"2023-05-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-12","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}