{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T23:40:17Z","timestamp":1783035617262,"version":"3.54.6"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"5s","license":[{"start":{"date-parts":[[2017,9,27]],"date-time":"2017-09-27T00:00:00Z","timestamp":1506470400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"crossref","award":["NRF-2016M3A7B4909604"],"award-info":[{"award-number":["NRF-2016M3A7B4909604"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2017,10,31]]},"abstract":"<jats:p>\n            NAND flash memory is widely used in various systems, ranging from real-time embedded systems to enterprise server systems. Because the flash memory has erase-before-write characteristics, we need flash-memory management methods, i.e., address translation and garbage collection. In particular, garbage collection (GC) incurs long-tail latency, e.g., 100 times higher latency than the average latency at the 99\n            <jats:sup>th<\/jats:sup>\n            percentile. Thus, real-time and quality-critical systems fail to meet the given requirements such as deadline and QoS constraints. In this study, we propose a novel method of GC based on reinforcement learning. The objective is to reduce the long-tail latency by exploiting the idle time in the storage system. To improve the efficiency of the reinforcement learning-assisted GC scheme, we present new optimization methods that exploit fine-grained GC to further reduce the long-tail latency. The experimental results with real workloads show that our technique significantly reduces the long-tail latency by 29--36% at the 99.99\n            <jats:sup>th<\/jats:sup>\n            percentile compared to state-of-the-art schemes.\n          <\/jats:p>","DOI":"10.1145\/3126537","type":"journal-article","created":{"date-parts":[[2017,9,27]],"date-time":"2017-09-27T12:33:53Z","timestamp":1506515633000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":60,"title":["Reinforcement Learning-Assisted Garbage Collection to Mitigate Long-Tail Latency in SSD"],"prefix":"10.1145","volume":"16","author":[{"given":"Wonkyung","family":"Kang","sequence":"first","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongkun","family":"Shin","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University, Gyeonggi-do, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sungjoo","family":"Yoo","sequence":"additional","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,9,27]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2746236"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/RTAS.2012.27"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/SIMUL.2009.17"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMSCS.2016.2516015"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1450135.1450141"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968456.2968475"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897937.2898018"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSCC.2017.7870331"},{"key":"e_1_2_1_9_1","volume-title":"Proceeding. 2014 IEEE International Solid-State Circuits Conference (ISSCC). 328--330","author":"Choi Sungdae","year":"2014"},{"key":"e_1_2_1_10_1","volume-title":"Barto","author":"Sutton Richard S.","year":"1998"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508244.1508271"},{"key":"e_1_2_1_12_1","volume-title":"Arpaci-Dusseau","author":"Arpaci-Dusseau Remzi H.","year":"2015"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2011.5937217"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEE.2010.5558538"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/11833529_11"},{"key":"e_1_2_1_16_1","first-page":"3","article-title":"Efficient and intelligent garbage collection policy for NAND flash-based consumer electronics","volume":"2","author":"Lin Mingwei","year":"2013","journal-title":"IEEE Trans. On Consumer Electronics."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027794.1027801"},{"key":"e_1_2_1_18_1","unstructured":"Samsung Electronics. 2014. Samsung V-NAND technology white paper. http:\/\/www.samsung.com\/us\/business\/oem-solutions\/pdfs\/V-NAND_technology_WP.pdf.  Samsung Electronics. 2014. Samsung V-NAND technology white paper. http:\/\/www.samsung.com\/us\/business\/oem-solutions\/pdfs\/V-NAND_technology_WP.pdf."},{"key":"e_1_2_1_19_1","unstructured":"SNIA IOTTA: Storage Networking Industry Association's Input\/Output Traces Tools and Analysis. http:\/\/iotta.snia.org.  SNIA IOTTA: Storage Networking Industry Association's Input\/Output Traces Tools and Analysis. http:\/\/iotta.snia.org."},{"key":"e_1_2_1_20_1","unstructured":"Filebench. https:\/\/github.com\/filebench\/filebench\/wiki.  Filebench. https:\/\/github.com\/filebench\/filebench\/wiki."},{"key":"e_1_2_1_21_1","unstructured":"Top considerations for Enterprise SSDs a primer. 2016. http:\/\/ingrammicrosystemarchitechs.com\/wp-content\/uploads\/2015\/10\/White-Paper-Top-Considerations-for-Enterprise-SSDs-WP30.pdf.  Top considerations for Enterprise SSDs a primer. 2016. http:\/\/ingrammicrosystemarchitechs.com\/wp-content\/uploads\/2015\/10\/White-Paper-Top-Considerations-for-Enterprise-SSDs-WP30.pdf."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2408776.2408794"},{"key":"e_1_2_1_23_1","first-page":"1","article-title":"Reviewing the evolution of the NAND flash technology","volume":"99","author":"Compagnoni Christian Monzio","year":"2017","journal-title":"Proceedings of the IEEE."},{"key":"e_1_2_1_24_1","first-page":"1","article-title":"Array architectures for 3-D NAND flash memories","volume":"99","author":"Micheloni Rino","year":"2017","journal-title":"Proceedings of the IEEE."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2008.21"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024724.2024735"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2749469.2749473"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3126537","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3126537","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:02Z","timestamp":1750273502000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3126537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,27]]},"references-count":27,"journal-issue":{"issue":"5s","published-print":{"date-parts":[[2017,10,31]]}},"alternative-id":["10.1145\/3126537"],"URL":"https:\/\/doi.org\/10.1145\/3126537","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,27]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}