{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T02:54:03Z","timestamp":1768532043381,"version":"3.49.0"},"reference-count":22,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T00:00:00Z","timestamp":1717113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>With the rapid growth of the data scale in data centers, the high reliability of storage is facing various challenges. Specifically, hardware failures such as disk faults occur frequently, causing serious system availability issues. In this context, hardware fault prediction based on AI and big data technologies has become a research hotspot, aiming to guide operation and maintenance personnel to implement preventive replacement through accurate prediction to reduce hardware failure rates. However, existing methods still have weaknesses in terms of accuracy due to the impacts of data quality issues such as the sample imbalance. This article proposes a disk fault prediction method based on classification intensity resampling, which fills the gap between the degree of data imbalance and the actual classification intensity of the task by introducing a base classifier to calculate the classification intensity, thus better preserving the data features of the original dataset. In addition, using ensemble learning methods such as random forests, combined with resampling, an integrated classifier for imbalanced data is developed to further improve the prediction accuracy. Experimental verification shows that compared with traditional methods, the F1-score of disk fault prediction is improved by 6%, and the model training time is also greatly reduced. The fault prediction method proposed in this paper has been applied to approximately 80 disk drives and nearly 40,000 disks in the production environment of a large bank\u2019s data center to guide preventive replacements. Compared to traditional methods, the number of preventive replacements based on our method has decreased by approximately 21%, while the overall disk failure rate remains unchanged, thus demonstrating the effectiveness of our method.<\/jats:p>","DOI":"10.3390\/info15060322","type":"journal-article","created":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T06:35:32Z","timestamp":1717137332000},"page":"322","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Prediction of Disk Failure Based on Classification Intensity Resampling"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-2355-2727","authenticated-orcid":false,"given":"Sheng","family":"Wu","sequence":"first","affiliation":[{"name":"College of Electronic Information and Engineering, Tongji University, Shanghai 201804, China"},{"name":"ICBC Data Center, Shanghai 200131, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jihong","family":"Guan","sequence":"additional","affiliation":[{"name":"College of Electronic Information and Engineering, Tongji University, Shanghai 201804, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chaves, I.C. (2018, January 8\u201313). Hard Disk Drive Failure Prediction Method Based On A Bayesian Network. Proceedings of the The International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489097"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhu, B., Wang, G., Liu, X., Hu, D., Lin, S., and Ma, J. (2013, January 6\u201310). Proactive drive failure prediction for large scale storage systems. Proceedings of the IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013, Long Beach, CA, USA.","DOI":"10.1109\/MSST.2013.6558427"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aussel, N., Jaulin, S., Gandon, G., Petetin, Y., and Chabridon, S. (2017, January 18\u201321). Predictive models of hard drive failures based on operational data. Proceedings of the IEEE International Conference on Machine Learning & Applications, Cancun, Mexico.","DOI":"10.1109\/ICMLA.2017.00-92"},{"key":"ref_4","unstructured":"Xu, Y., Sui, K., Yao, R., Zhang, H., Lin, Q., Dang, Y., Li, P., Jiang, K., Zhang, W., and Lou, J.G. (2018, January 11\u201313). Improving Service Availability of Cloud Systems by Predicting Disk Error. Proceedings of the USENIX Annual Technical Conference, Boston, MA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Botezatu, M.M., Giurgiu, I., Bogojeska, J., and Wiesmann, D. (2016, January 17\u201313). Predicting Disk Replacement towards Reliable Data Centers. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939699"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mohapatra, R., Coursey, A., and Sengupta, S. (2023, January 26\u201330). Large-scale End-of-Life Prediction of Hard Disks in Distributed Datacenters. Proceedings of the 2023 IEEE International Conference on Smart Computing (SMARTCOMP), Nashville, TN, USA.","DOI":"10.1109\/SMARTCOMP58114.2023.00069"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1016\/j.future.2023.05.020","article-title":"SPAE: Lifelong disk failure prediction via end-to-end GAN-based anomaly detection with ensemble update","volume":"148","author":"Liu","year":"2023","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1631\/FITEE.2200488","article-title":"A disk failure prediction model for multiple issues","volume":"24","author":"Guan","year":"2023","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1109\/TC.2022.3160365","article-title":"A General Stream Mining Framework for Adaptive Disk Failure Prediction","volume":"72","author":"Han","year":"2023","journal-title":"IEEE Trans. Comput."},{"key":"ref_10","unstructured":"Zach, M., Olusiji, M., Madhavan, R., Alex, B., and Fred, L. (2023, January 27\u201330). Hard Disk Drive Failure Analysis and Prediction: An Industry View. Proceedings of the 2023 53rd Annual IEEE\/IFIP International Conference on Dependable Systems and Networks\u2014Supplemental Volume (DSN-S), Porto, Portugal."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pandey, C., Angryk, R.A., and Aydin, B. (2023). Explaining Full-disk Deep Learning Model for Solar Flare Prediction using Attribution Methods. arXiv.","DOI":"10.1007\/978-3-031-43430-3_5"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic Minority Over-sampling Technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_13","unstructured":"Zhang, J., and Mani, I. (2003, January 21). KNN Approach to Unbalanced Data Distributions: A Case Study Involving Information Extraction. Proceedings of the ICML Workshop on Learning from Imbalanced Datasets, Washington, DC, USA."},{"key":"ref_14","unstructured":"He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1\u20138). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong."},{"key":"ref_15","unstructured":"Elkan, C. (2001). The Foundations of Cost-Sensitive Learning, Morgan Kaufmann Publishers Inc."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, X.Y., and Zhou, Z.H. (2006, January 18\u201322). The Influence of Class Imbalance on Cost-Sensitive Lear-ning: An Empirical Study. Proceedings of the Sixth International Conference on Data Mining (ICDM\u201906), Hong Kong.","DOI":"10.1109\/ICDM.2006.158"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Han, H., Wang, W., and Mao, B. (2005, January 23\u201326). Borderline-SMOTE: A New Over-sampling Method in Imbalanced Data Sets Learning. Proceedings of the Advances in Intelligent Computing, International Conference on Intelligent Computing, ICIC 2005, Hefei, China.","DOI":"10.1007\/11538059_91"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bunkhumpornpat, C., Sinapiromsaran, K., and Lursinsap, C. (2009, January 27\u201330). Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling TEchnique for Handling the Class Imbalanced Problem. Proceedings of the Pacific-asia Conference on Advances in Knowledge Discovery & Data Mining, Bangkok, Thailand.","DOI":"10.1007\/978-3-642-01307-2_43"},{"key":"ref_19","unstructured":"Seagate (2024, March 19). The SMART Dataset from Nankai University and Baidu, Inc.. Available online: http:\/\/pan.baidu.com\/share\/link?shareid=189977&uk=4278294944."},{"key":"ref_20","unstructured":"(2024, March 19). Scikit-Learn-Contrib (2016) Imbalanced-Learn (Version 0.9.0) [Source Code]. Available online: https:\/\/github.com\/scikit-learn-contrib\/imbalanced-learn."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3784","DOI":"10.1109\/TNNLS.2017.2736643","article-title":"Credit Card Fraud Detection: A Realistic Modeling and a Novel Learning Strategy","volume":"29","author":"Pozzolo","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_22","first-page":"2272","article-title":"Automated Feature Selection: A Reinforcement Learning Perspective","volume":"35","author":"Liu","year":"2023","journal-title":"IEEE Trans. Knowl. Data Eng."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/6\/322\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:51:44Z","timestamp":1760107904000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/6\/322"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,31]]},"references-count":22,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["info15060322"],"URL":"https:\/\/doi.org\/10.3390\/info15060322","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,31]]}}}