{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T08:39:46Z","timestamp":1777106386366,"version":"3.51.4"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,11,30]],"date-time":"2018-11-30T00:00:00Z","timestamp":1543536000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2018,11,30]]},"abstract":"<jats:p>Despite its widespread use in consumer devices and enterprise storage systems, NAND flash faces a growing number of challenges. While technology advances have helped to increase the storage density and reduce costs, they have also led to reduced endurance and larger block variations, which cannot be compensated solely by stronger ECC or read-retry schemes but have to be addressed holistically.<\/jats:p>\n          <jats:p>Our goal is to enable low-cost NAND flash in enterprise storage for cost efficiency. We present novel flash-management approaches that reduce write amplification, achieve better wear leveling, and enhance endurance without sacrificing performance. We introduce block calibration, a technique to determine optimal read-threshold voltage levels that minimize error rates, and novel garbage-collection as well as data-placement schemes that alleviate the effects of block health variability and show how these techniques complement one another and thereby achieve enterprise storage requirements.<\/jats:p>\n          <jats:p>By combining the proposed schemes, we improve endurance by up to 15\u00d7 compared to the baseline endurance of NAND flash without using a stronger ECC scheme. The flash-management algorithms presented herein were designed and implemented in simulators, hardware test platforms, and eventually in the flash controllers of production enterprise all-flash arrays. Their effectiveness has been validated across thousands of customer deployments since 2015.<\/jats:p>","DOI":"10.1145\/3241060","type":"journal-article","created":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T15:32:40Z","timestamp":1543937560000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Management of Next-Generation NAND Flash to Achieve Enterprise-Level Endurance and Latency Targets"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6162-3741","authenticated-orcid":false,"given":"Roman","family":"Pletka","sequence":"first","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ioannis","family":"Koltsidas","sequence":"additional","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikolas","family":"Ioannou","sequence":"additional","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sa\u0161a","family":"Tomi\u0107","sequence":"additional","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikolaos","family":"Papandreou","sequence":"additional","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Parnell","sequence":"additional","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haralampos","family":"Pozidis","sequence":"additional","affiliation":[{"name":"IBM Research -- Zurich, R\u00fcschlikon, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron","family":"Fry","sequence":"additional","affiliation":[{"name":"IBM Systems, Houston, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tim","family":"Fisher","sequence":"additional","affiliation":[{"name":"IBM Systems, Houston, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Jens Axboe. 2014. FIO\u2014Flexible IO Tester. Retrieved from https:\/\/linux.die.net\/man\/1\/fio.  Jens Axboe. 2014. FIO\u2014Flexible IO Tester. Retrieved from https:\/\/linux.die.net\/man\/1\/fio."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/11841036_12"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1855511.1855520"},{"key":"e_1_2_1_4_1","volume-title":"Biennial Conference on Innovative Data Systems Research (CIDR\u201909)","author":"Bouganim Luc","year":"2009","unstructured":"Luc Bouganim , Bj\u00f6rn Por Jonsson , and Philippe Bonnet . 2009 . uFLIP: Understanding flash IO patterns . In Biennial Conference on Innovative Data Systems Research (CIDR\u201909) . Luc Bouganim, Bj\u00f6rn Por Jonsson, and Philippe Bonnet. 2009. uFLIP: Understanding flash IO patterns. In Biennial Conference on Innovative Data Systems Research (CIDR\u201909)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.peva.2010.07.003"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2485288.2485597"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD.2013.6657034"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD.2012.6378623"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1244002.1244248"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027794.1027801"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2408776.2408794"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2367589.2367603"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2011.197"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089733.1089735"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TDMR.2015.2448108"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1669112.1669118"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1534530.1534544"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASCOTS.2011.50"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST\u201917)","author":"Huang Jian","unstructured":"Jian Huang , Anirudh Badam , Laura Caulfield , Suman Nath , Sudipta Sengupta , Bikash Sharma , and Moinuddin K. Qureshi . 2017. FlashBlox: Achieving both performance isolation and uniform lifetime for virtualized SSDs . In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST\u201917) . 375--390. Jian Huang, Anirudh Badam, Laura Caulfield, Suman Nath, Sudipta Sengupta, Bikash Sharma, and Moinuddin K. Qureshi. 2017. FlashBlox: Achieving both performance isolation and uniform lifetime for virtualized SSDs. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST\u201917). 375--390."},{"key":"e_1_2_1_20_1","unstructured":"IBM. 2015. FlashSystem 900. Retrieved from http:\/\/www-03.ibm.com\/systems\/storage\/flash\/900\/.  IBM. 2015. FlashSystem 900. Retrieved from http:\/\/www-03.ibm.com\/systems\/storage\/flash\/900\/."},{"key":"e_1_2_1_21_1","unstructured":"JEDEC 2017. Stress-Test-Driven Qualification of Integrated Circuits. Retrieved from http:\/\/jedec.org\/.  JEDEC 2017. Stress-Test-Driven Qualification of Integrated Circuits. Retrieved from http:\/\/jedec.org\/."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASCOTS.2010.52"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/645981.674620"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the IEEE International Solid-State Circuit Conference (ISSCC\u201912)","author":"Lee Youngjoo","year":"2012","unstructured":"Youngjoo Lee , Hoyoung Yoo , Injae Yoo , and In-Cheol Park . 2012 . 6.4 Gb\/s multi-threaded BCH encoder and decoder for multi-channel SSD controllers . In Proceedings of the IEEE International Solid-State Circuit Conference (ISSCC\u201912) . DOI:https:\/\/doi.org\/ISSCC.2012.6177075 Youngjoo Lee, Hoyoung Yoo, Injae Yoo, and In-Cheol Park. 2012. 6.4 Gb\/s multi-threaded BCH encoder and decoder for multi-channel SSD controllers. In Proceedings of the IEEE International Solid-State Circuit Conference (ISSCC\u201912). DOI:https:\/\/doi.org\/ISSCC.2012.6177075"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Jai Menon and Larry Stockmeyer. 1998. An age-threshold algorithm for garbage collection in log-structured arrays and file systems. In High Performance Computing Systems and Applications. 119--132.  Jai Menon and Larry Stockmeyer. 1998. An age-threshold algorithm for garbage collection in log-structured arrays and file systems. In High Performance Computing Systems and Applications. 119--132.","DOI":"10.1007\/978-1-4615-5611-4_13"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 46th Annual Int. Reliability Physics Symposium (IRPS\u201908)","author":"Mielke Neal","unstructured":"Neal Mielke , Todd Marquart , Ning Wu , Jeff Kessenich , Hanmant P. Belgal , Eric Schares , Falgun Trivedi , Evan Goodness , and Leland R. Nevill . 2008. Bit error rate in NAND flash memories . In Proceedings of the 46th Annual Int. Reliability Physics Symposium (IRPS\u201908) . 9--19. Neal Mielke, Todd Marquart, Ning Wu, Jeff Kessenich, Hanmant P. Belgal, Eric Schares, Falgun Trivedi, Evan Goodness, and Leland R. Nevill. 2008. Bit error rate in NAND flash memories. In Proceedings of the 46th Annual Int. Reliability Physics Symposium (IRPS\u201908). 9--19."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST\u201912)","author":"Min Changwoo","year":"2012","unstructured":"Changwoo Min , Kangnyeon Kim , Hyunjin Cho , Sang-Won Lee , and Young Ik Eom . 2012 . SFS: Random write considered harmful in solid state drives . In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST\u201912) . 139--154. http:\/\/dl.acm.org\/citation.cfm?id&equals;2208461.2208473 Changwoo Min, Kangnyeon Kim, Hyunjin Cho, Sang-Won Lee, and Young Ik Eom. 2012. SFS: Random write considered harmful in solid state drives. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST\u201912). 139--154. http:\/\/dl.acm.org\/citation.cfm?id&equals;2208461.2208473"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 2nd USENIX Conference on Hot Topics in Storage and File Systems (HotStorage\u201910)","author":"Mohan Vidyabhushan","unstructured":"Vidyabhushan Mohan , Taniya Siddiqua , Sudhanva Gurumurthi , and Mircea R. Stan . 2010. How I learned to stop worrying and love flash endurance . In Proceedings of the 2nd USENIX Conference on Hot Topics in Storage and File Systems (HotStorage\u201910) . Vidyabhushan Mohan, Taniya Siddiqua, Sudhanva Gurumurthi, and Mircea R. Stan. 2010. How I learned to stop worrying and love flash endurance. In Proceedings of the 2nd USENIX Conference on Hot Topics in Storage and File Systems (HotStorage\u201910)."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2012.2210256"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 2013 18th International Conference on Digital Signal Processing (DSP\u201913)","author":"Papandreaou Nikolaos","year":"2013","unstructured":"Nikolaos Papandreaou , Theodore Antonakopoulos , Urs Egger , Aspa Palli , Haris Pozidis , and Evangelos S. Eleftheriou . 2013. A versatile platform for characterization of solid-state memory channels . In Proceedings of the 2013 18th International Conference on Digital Signal Processing (DSP\u201913) . 1--5. DOI:https:\/\/doi.org\/ICDSP. 2013 .6622745 Nikolaos Papandreaou, Theodore Antonakopoulos, Urs Egger, Aspa Palli, Haris Pozidis, and Evangelos S. Eleftheriou. 2013. A versatile platform for characterization of solid-state memory channels. In Proceedings of the 2013 18th International Conference on Digital Signal Processing (DSP\u201913). 1--5. DOI:https:\/\/doi.org\/ICDSP.2013.6622745"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591513.2591594"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.2014.2352293"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the IEEE International Conference on Communications (ICC\u201915)","author":"Peleato B.","unstructured":"B. Peleato , H. Tabrizi , R. Agarwal , and J. Ferreira . 2015. BER-based wear leveling and bad block management for NAND flash . In Proceedings of the IEEE International Conference on Communications (ICC\u201915) . 295--300. B. Peleato, H. Tabrizi, R. Agarwal, and J. Ferreira. 2015. BER-based wear leveling and bad block management for NAND flash. In Proceedings of the IEEE International Conference on Communications (ICC\u201915). 295--300."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2928275.2928279"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/146941.146943"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 14th USENIX Conference on File and Storage Technologies (FAST\u201916)","author":"Schroeder Bianca","year":"2016","unstructured":"Bianca Schroeder , Raghav Lagisetty , and Arif Merchant . 2016 . Flash reliability in production: The expected and the unexpected . In Proceedings of the 14th USENIX Conference on File and Storage Technologies (FAST\u201916) . 67--80. http:\/\/dl.acm.org\/citation.cfm?id&equals;2930583.2930589 Bianca Schroeder, Raghav Lagisetty, and Arif Merchant. 2016. Flash reliability in production: The expected and the unexpected. In Proceedings of the 14th USENIX Conference on File and Storage Technologies (FAST\u201916). 67--80. http:\/\/dl.acm.org\/citation.cfm?id&equals;2930583.2930589"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536360.2536372"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the IEEE Workshop on Signal Processing Systems: Design and Implementation (SiPS\u201906)","author":"Sun Fei","year":"2006","unstructured":"Fei Sun , Ken Rose , and Tong Zhang . 2006 . On the use of strong BCH codes for improving multilevel NAND flash memory storage capacity . In Proceedings of the IEEE Workshop on Signal Processing Systems: Design and Implementation (SiPS\u201906) . 241--249. Fei Sun, Ken Rose, and Tong Zhang. 2006. On the use of strong BCH codes for improving multilevel NAND flash memory storage capacity. In Proceedings of the IEEE Workshop on Signal Processing Systems: Design and Implementation (SiPS\u201906). 241--249."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465529.2465543"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494232.2465543"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.peva.2013.08.010"},{"key":"e_1_2_1_42_1","unstructured":"Steven E. Wells. 1994. Method for Wear Leveling in a Flash EEPROM Memory. U.S. Patent 5\u00a0341\u00a0339.  Steven E. Wells. 1994. Method for Wear Leveling in a Flash EEPROM Memory. U.S. Patent 5\u00a0341\u00a0339."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2485732.2485743"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908557"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 11th USENIX Conference on File and Storage Technologies (FAST\u201913)","author":"Zhao Kai","year":"2013","unstructured":"Kai Zhao , Wenzhe Zhao , Hongbin Sun , Tong Zhang , Xiaodong Zhang , and Nanning Zheng . 2013 . LDPC-in-SSD: Making advanced error correction codes work effectively in solid state drives . In Proceedings of the 11th USENIX Conference on File and Storage Technologies (FAST\u201913) . 243--256. http:\/\/dl.acm.org\/citation.cfm?id&equals;2591272.2591298 Kai Zhao, Wenzhe Zhao, Hongbin Sun, Tong Zhang, Xiaodong Zhang, and Nanning Zheng. 2013. LDPC-in-SSD: Making advanced error correction codes work effectively in solid state drives. In Proceedings of the 11th USENIX Conference on File and Storage Technologies (FAST\u201913). 243--256. http:\/\/dl.acm.org\/citation.cfm?id&equals;2591272.2591298"},{"key":"e_1_2_1_46_1","first-page":"10","article-title":"SSDExplorer: A virtual platform for performance\/reliability-oriented fine-grained design space exploration of solid state drives","volume":"34","author":"Zuolo Lorenzo","year":"2015","unstructured":"Lorenzo Zuolo , Christian Zambelli , Rino Micheloni , Marco Indaco , Stefano Di Carlo , Paolo Prinetto , Davide Pertozzi , and Piero Olivo . 2015 . SSDExplorer: A virtual platform for performance\/reliability-oriented fine-grained design space exploration of solid state drives . IEEE Trans. Comput.-Aid. Design Integrat. Circ. Syst. 34 , 10 (Oct. 2015), 1627--1638. Lorenzo Zuolo, Christian Zambelli, Rino Micheloni, Marco Indaco, Stefano Di Carlo, Paolo Prinetto, Davide Pertozzi, and Piero Olivo. 2015. SSDExplorer: A virtual platform for performance\/reliability-oriented fine-grained design space exploration of solid state drives. IEEE Trans. Comput.-Aid. Design Integrat. Circ. Syst. 34, 10 (Oct. 2015), 1627--1638.","journal-title":"IEEE Trans. Comput.-Aid. Design Integrat. Circ. Syst."}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3241060","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3241060","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:43:46Z","timestamp":1750207426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3241060"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,30]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,11,30]]}},"alternative-id":["10.1145\/3241060"],"URL":"https:\/\/doi.org\/10.1145\/3241060","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"value":"1553-3077","type":"print"},{"value":"1553-3093","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,30]]},"assertion":[{"value":"2017-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}