{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,20]],"date-time":"2025-06-20T11:09:14Z","timestamp":1750417754373,"version":"3.41.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,5,21]],"date-time":"2019-05-21T00:00:00Z","timestamp":1558396800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1814890"],"award-info":[{"award-number":["CNS-1814890"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2019,8,31]]},"abstract":"<jats:p>\n            This article presents a design framework aiming to reduce mass data storage cost in data centers. Its underlying principle is simple: Assume one may noticeably reduce the HDD manufacturing cost by significantly (i.e., at least several orders of magnitude) relaxing raw HDD reliability, which ensures the eventual data storage integrity via low-cost system-level redundancy. This is called system-assisted HDD bit cost reduction. To better utilize both capacity and random IOPS of HDDs, it is desirable to mix data with complementary requirements on capacity and random IOPS in each HDD. Nevertheless, different capacity and random IOPS requirements may demand different raw HDD reliability vs.\u00a0bit cost trade-offs and hence different forms of system-assisted bit cost reduction. This article presents a software-centric design framework to realize data-adaptive system-assisted bit cost reduction for data center HDDs. Implementation is solely handled by the filesystem and demands only minor change of the error correction coding (ECC) module inside HDDs. Hence, it is completely transparent to all the other components in the software stack (e.g., applications, OS kernel, and drivers) and keeps fundamental HDD design practice (e.g., firmware, media, head, and servo) intact. We carried out analysis and experiments to evaluate its implementation feasibility and effectiveness. We integrated the design techniques into\n            <jats:italic>ext4<\/jats:italic>\n            to further quantitatively measure its impact on system speed performance.\n          <\/jats:p>","DOI":"10.1145\/3319405","type":"journal-article","created":{"date-parts":[[2019,5,21]],"date-time":"2019-05-21T15:03:51Z","timestamp":1558451031000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["An Exploratory Study on Software-Defined Data Center Hard Disk Drives"],"prefix":"10.1145","volume":"15","author":[{"given":"Yin","family":"Li","sequence":"first","affiliation":[{"name":"Rensselaer Polytechnic Institute, Troy, NY USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xubin","family":"Chen","sequence":"additional","affiliation":[{"name":"Rensselaer Polytechnic Institute, Troy, NY USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ning","family":"Zheng","sequence":"additional","affiliation":[{"name":"Scaleflux, Inc., CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingpeng","family":"Hao","sequence":"additional","affiliation":[{"name":"Rensselaer Polytechnic Institute, Troy, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Rensselaer Polytechnic Institute, Troy, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,5,21]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"HBase. 2018. https:\/\/hbase.apache.org\/.  HBase. 2018. https:\/\/hbase.apache.org\/."},{"key":"e_1_2_1_2_1","unstructured":"HiBench 3.0. 2018. https:\/\/github.com\/intel-hadoop\/HiBench\/releases.  HiBench 3.0. 2018. https:\/\/github.com\/intel-hadoop\/HiBench\/releases."},{"key":"e_1_2_1_3_1","unstructured":"Private Communication with Engineers of a Major HDD Manufacturer. 2018.  Private Communication with Engineers of a Major HDD Manufacturer. 2018."},{"key":"e_1_2_1_4_1","unstructured":"YCSB. 2018. https:\/\/github.com\/brianfrankcooper\/YCSB.  YCSB. 2018. https:\/\/github.com\/brianfrankcooper\/YCSB."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1269899.1254917"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the Flash Memory Summit. 1--12","author":"Bates Stephen","year":"2013","unstructured":"Stephen Bates . 2013 . Using rate-adaptive LDPC codes to maximize the capacity of SSDs . In Proceedings of the Flash Memory Summit. 1--12 . Stephen Bates. 2013. Using rate-adaptive LDPC codes to maximize the capacity of SSDs. In Proceedings of the Flash Memory Summit. 1--12."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/12.364531"},{"key":"e_1_2_1_8_1","unstructured":"E. Brewer L. Ying L. Greenfield Robert Cypher and T. T\u2019so. 2016. Disks for Data Centers. Technical Report. Google. https:\/\/ai.google\/research\/pubs\/pub44830.  E. Brewer L. Ying L. Greenfield Robert Cypher and T. T\u2019so. 2016. Disks for Data Centers. Technical Report. Google. https:\/\/ai.google\/research\/pubs\/pub44830."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/176979.176981"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989357"},{"key":"e_1_2_1_11_1","volume-title":"Magnetic Recording: The First 100 Years","author":"Daniel E.","year":"1999","unstructured":"E. Daniel , C. Mee , and M. Clark . 1999 . Magnetic Recording: The First 100 Years . John Wiley 8 Sons. E. Daniel, C. Mee, and M. Clark. 1999. Magnetic Recording: The First 100 Years. John Wiley 8 Sons."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2010.2054295"},{"key":"e_1_2_1_13_1","first-page":"093","article-title":"Disk drive charging capacitor using motor supply voltage during power failure","volume":"9","author":"Ferris Timothy A.","year":"2015","unstructured":"Timothy A. Ferris and Robert P. Ryan . 2015 . Disk drive charging capacitor using motor supply voltage during power failure . US Patent 9 , 093 ,105. Timothy A. Ferris and Robert P. Ryan. 2015. Disk drive charging capacitor using motor supply voltage during power failure. US Patent 9,093,105.","journal-title":"US Patent"},{"key":"e_1_2_1_14_1","volume-title":"Klosterman","author":"Ganger Gregory R.","year":"2003","unstructured":"Gregory R. Ganger , John D. Strunk , and Andrew J . Klosterman . 2003 . Self-* Storage : Brick-based Storage with Automated Administration. Technical Report. Carnegie Mellon University School of Computer Science , Pittsburgh, PA. Gregory R. Ganger, John D. Strunk, and Andrew J. Klosterman. 2003. Self-* Storage: Brick-based Storage with Automated Administration. Technical Report. Carnegie Mellon University School of Computer Science, Pittsburgh, PA."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2010.5496983"},{"volume-title":"Proceedings of the USENIX Annual Technical Conference. 15--26","author":"Huang C.","key":"e_1_2_1_16_1","unstructured":"C. Huang , H. Simitci , Y. Xu , A. Ogus , B. Calder , P. Gopalan , J. Li , and S. Yekhanin . 2012. Erasure coding in windows azure storage . In Proceedings of the USENIX Annual Technical Conference. 15--26 . C. Huang, H. Simitci, Y. Xu, A. Ogus, B. Calder, P. Gopalan, J. Li, and S. Yekhanin. 2012. Erasure coding in windows azure storage. In Proceedings of the USENIX Annual Technical Conference. 15--26."},{"key":"e_1_2_1_17_1","first-page":"10","article-title":"2-D magnetic recording: Read channel modeling and detection","volume":"45","author":"Krishnan A. R.","year":"2009","unstructured":"A. R. Krishnan , R. Radhakrishnan , B. Vasic , A. Kavcic , W. Ryan , and F. Erden . 2009 . 2-D magnetic recording: Read channel modeling and detection . IEEE Trans. Magnetics 45 , 10 (Oct. 2009), 3830--3836. A. R. Krishnan, R. Radhakrishnan, B. Vasic, A. Kavcic, W. Ryan, and F. Erden. 2009. 2-D magnetic recording: Read channel modeling and detection. IEEE Trans. Magnetics 45, 10 (Oct. 2009), 3830--3836.","journal-title":"IEEE Trans. Magnetics"},{"volume-title":"Proceedings of the 7th Workshop on Hot Topics in Operating Systems. IEEE, 14--19","author":"Tom","key":"e_1_2_1_18_1","unstructured":"Tom M. Kroeger and Darrell D. E. Long. 1999. The case for efficient file access pattern modeling . In Proceedings of the 7th Workshop on Hot Topics in Operating Systems. IEEE, 14--19 . Tom M. Kroeger and Darrell D. E. Long. 1999. The case for efficient file access pattern modeling. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems. IEEE, 14--19."},{"key":"e_1_2_1_19_1","unstructured":"E. Kurtas and B. Vasic. 2005. Coding and Signal Processing for Magnetic Recording Systems. CRC Press.  E. Kurtas and B. Vasic. 2005. Coding and Signal Processing for Magnetic Recording Systems. CRC Press."},{"volume-title":"Proceedings of the USENIX Conference on File and Storage Technologies. 135--148","author":"Li Y.","key":"e_1_2_1_20_1","unstructured":"Y. Li , H. Wang , X. Zhang , N. Zheng , S. Dahandeh , and T. Zhang . 2017. Facilitating magnetic recording technology scaling for data center hard disk drives through filesystem-level transparent local erasure coding . In Proceedings of the USENIX Conference on File and Storage Technologies. 135--148 . Y. Li, H. Wang, X. Zhang, N. Zheng, S. Dahandeh, and T. Zhang. 2017. Facilitating magnetic recording technology scaling for data center hard disk drives through filesystem-level transparent local erasure coding. In Proceedings of the USENIX Conference on File and Storage Technologies. 135--148."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMAG.2009.2038281"},{"key":"e_1_2_1_22_1","unstructured":"S. Lin and D. J. Costello. 2004. Error Control Coding: Fundamentals and Applications (2nd Ed.). Prentice Hall.   S. Lin and D. J. Costello. 2004. Error Control Coding: Fundamentals and Applications (2nd Ed.). Prentice Hall."},{"key":"e_1_2_1_23_1","first-page":"645","article-title":"Method to protect data on a disk drive from uncorrectable media errors","volume":"8","author":"Menon Jaishankar Moothedath","year":"2014","unstructured":"Jaishankar Moothedath Menon and Krishnakumar Surugucchi . 2014 . Method to protect data on a disk drive from uncorrectable media errors . US Patent 8 , 645 ,622. Jaishankar Moothedath Menon and Krishnakumar Surugucchi. 2014. Method to protect data on a disk drive from uncorrectable media errors. US Patent 8,645,622.","journal-title":"US Patent"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1078026.1078408"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMAG.2009.2023850"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1088\/0022-3727\/35\/19\/201"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/50202.50214"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559865"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1095810.1095830"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/2535573.2488339"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837915.1837917"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMAG.2007.911029"},{"volume-title":"Proceedings of the Annual Reliability and Maintainability Symposium. IEEE, 226--231","author":"Shah Sandeep","key":"e_1_2_1_33_1","unstructured":"Sandeep Shah and Jon G. Elerath . 2005. Reliability analysis of disk drive failure mechanisms . In Proceedings of the Annual Reliability and Maintainability Symposium. IEEE, 226--231 . Sandeep Shah and Jon G. Elerath. 2005. Reliability analysis of disk drive failure mechanisms. In Proceedings of the Annual Reliability and Maintainability Symposium. IEEE, 226--231."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMAG.2009.2024879"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.2013.2280078"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMAG.2013.2281027"},{"key":"e_1_2_1_37_1","unstructured":"S. B. Wicker and V. K. Bhargava. 1994. Reed-Solomon Codes and Their Applications. IEEE Press.   S. B. Wicker and V. K. Bhargava. 1994. Reed-Solomon Codes and Their Applications. IEEE Press."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMAG.2014.2354632"},{"volume-title":"Proceedings of the USENIX Conference on File and Storage Technologies. 243--256","author":"Zhao K.","key":"e_1_2_1_39_1","unstructured":"K. Zhao , W. Zhao , H. Sun , T. Zhang , X. Zhang , and N. Zheng . 2013. LDPC-in-SSD: Making advanced error correction codes work effectively in solid state drives . In Proceedings of the USENIX Conference on File and Storage Technologies. 243--256 . K. Zhao, W. Zhao, H. Sun, T. Zhang, X. Zhang, and N. Zheng. 2013. LDPC-in-SSD: Making advanced error correction codes work effectively in solid state drives. In Proceedings of the USENIX Conference on File and Storage Technologies. 243--256."}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3319405","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3319405","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3319405","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:21Z","timestamp":1750199901000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3319405"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,21]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,8,31]]}},"alternative-id":["10.1145\/3319405"],"URL":"https:\/\/doi.org\/10.1145\/3319405","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"type":"print","value":"1553-3077"},{"type":"electronic","value":"1553-3093"}],"subject":[],"published":{"date-parts":[[2019,5,21]]},"assertion":[{"value":"2018-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-05-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}