{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T07:35:35Z","timestamp":1781422535426,"version":"3.54.1"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,10,5]],"date-time":"2022-10-05T00:00:00Z","timestamp":1664928000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,5]],"date-time":"2022-10-05T00:00:00Z","timestamp":1664928000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61662018"],"award-info":[{"award-number":["61662018"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61661015"],"award-info":[{"award-number":["61661015"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61831013"],"award-info":[{"award-number":["61831013"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010031","name":"Postdoctoral Research Foundation of China","doi-asserted-by":"publisher","award":["2016M602922XB"],"award-info":[{"award-number":["2016M602922XB"]}],"id":[{"id":"10.13039\/501100010031","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018602","name":"Guangxi Innovation-Driven Development Project","doi-asserted-by":"publisher","award":["AA18118031"],"award-info":[{"award-number":["AA18118031"]}],"id":[{"id":"10.13039\/501100018602","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Guilin University of Technology Research Start-up Fund Project","award":["GUTQDJJ20172000019"],"award-info":[{"award-number":["GUTQDJJ20172000019"]}]},{"name":"Innovation Project of Guangxi Graduate Education","award":["YCSW2021179"],"award-info":[{"award-number":["YCSW2021179"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The advent of the Big Data era has brought considerable challenges to storing and managing massive data. Moreover, distributed storage systems are critical to the pressure and storage capacity costs. The Ceph cloud storage system only selects data storage nodes based on node storage capacity. This node selection method results in load imbalance and limited storage scenarios in heterogeneous storage systems. Therefore, we add node heterogeneity, network state, and node load as performance weights to the CRUSH algorithm and optimize the performance of the Ceph system by improving load balancing. We designed a cloud storage system model based on Software Defined Network (SDN) technology. This system model can avoid the tedious configuration and significant measurement overhead required to obtain network status in traditional network architecture. Then we propose adaptive read and write optimization algorithms based on SDN technology. The Object Storage Device (OSD) is initially classified based on the Node Heterogeneous Resource Classification Strategy. Then the SDN technology is used\u00a0to obtain network and load conditions in real-time and an OSD performance prediction model is built\u00a0to obtain weights\u00a0for performance impact factors. Finally, a mathematical model is proposed\u00a0for multi-attribute decision\u00a0making in conjunction with the OSD state and its prediction model. Furthermore, this model is addressed\u00a0to optimize read and write performance adaptively. Compared with the original Ceph system, TOPSIS_PA improves the performance of reading operations by 36%; TOPSIS_CW and TOPSIS_PACW algorithms improve the elastic read performance by 23 to 60% and 36 to 85%, and the elastic write performance by 180 to 468% and 188 to 611%, respectively.<\/jats:p>","DOI":"10.1007\/s10586-022-03764-3","type":"journal-article","created":{"date-parts":[[2022,10,5]],"date-time":"2022-10-05T12:05:43Z","timestamp":1664971543000},"page":"1125-1146","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["An adaptive read\/write optimized algorithm for Ceph heterogeneous systems via performance prediction and multi-attribute decision making"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3878-3472","authenticated-orcid":false,"given":"Zhike","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,10,5]]},"reference":[{"issue":"14","key":"3764_CR1","doi-asserted-by":"publisher","first-page":"e4474","DOI":"10.1002\/dac.4474","volume":"33","author":"A Heidari","year":"2020","unstructured":"Heidari, A., et al.: Internet of things offloading: ongoing issues, opportunities, and future challenges. Int. J. Commun. Syst. 33(14), e4474 (2020)","journal-title":"Int. J. Commun. Syst."},{"issue":"2","key":"3764_CR2","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1007\/s12525-016-0219-0","volume":"26","author":"S Akter","year":"2016","unstructured":"Akter, S., Wamba, S.F.: Big data analytics in E-commerce: a systematic review and agenda for future research. Electron. Mark. 26(2), 173\u2013194 (2016)","journal-title":"Electron. Mark."},{"key":"3764_CR3","doi-asserted-by":"publisher","first-page":"952","DOI":"10.1108\/K-12-2020-0909","volume":"51","author":"A Heidari","year":"2021","unstructured":"Heidari, A., Navimipour, N.J.: Service discovery mechanisms in cloud computing: a comprehensive and systematic literature review. Kybernetes 51, 952\u2013981 (2021)","journal-title":"Kybernetes"},{"key":"3764_CR4","doi-asserted-by":"publisher","first-page":"e539","DOI":"10.7717\/peerj-cs.539","volume":"7","author":"A Heidari","year":"2021","unstructured":"Heidari, A., Navimipour, N.J.: A new SLA-aware method for discovering the cloud services using an improved nature-inspired optimization algorithm. PeerJ Comput. Sci. 7, e539 (2021)","journal-title":"PeerJ Comput. Sci."},{"key":"3764_CR5","doi-asserted-by":"crossref","unstructured":"Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system[C]\/\/Proceedings of the nineteenth ACM symposium on Operating systems principles, 29\u201343 (2003)","DOI":"10.1145\/1165389.945450"},{"key":"3764_CR6","unstructured":"Weil, S.A., Brandt, S.A., Miller, E.L., et al.: Ceph: a scalable, high-performance distributed file system [C]\/\/Proceedings of the 7th symposium on Operating systems design and implement-ation, 307\u2013320 (2006)"},{"key":"3764_CR7","unstructured":"Huang, C., Simitci, H., Xu, Y\/, et al.: Erasure coding in windows azure storage[C]\/\/2012 USENIX Annual Technical Conference (USENIX ATC 12), 15\u201326 (2012)"},{"key":"3764_CR8","doi-asserted-by":"crossref","unstructured":"Palankar, M.R,, Iamnitchi, A., Ripeanu, M., et al.: Amazon S3 for science grids: a viable solution? [C]\/\/Proceedings of the 2008 international workshop on Data-aware distributed computing, 55\u201364 (2008)","DOI":"10.1145\/1383519.1383526"},{"key":"3764_CR9","doi-asserted-by":"crossref","unstructured":"Bollig, E.F., Allan, G.T., Lynch, B.J., et al.: Leveraging openstack and ceph for a controlled-access data cloud[M]\/\/Proceedings of the practice and experience on advanced research computing, 1\u20137 (2018)","DOI":"10.1145\/3219104.3219165"},{"key":"3764_CR10","doi-asserted-by":"crossref","unstructured":"Weil, S.A., Brandt, S.A., Miller, E.L., et al.: CRUSH: controlled, scalable, decentralized placement of replicated data[C]\/\/SC\u201906: Proceedings of the 2006 ACM\/IEEE Conference on Super-computing. IEEE, 31\u201331 (2006)","DOI":"10.1109\/SC.2006.19"},{"issue":"7","key":"3764_CR11","doi-asserted-by":"publisher","first-page":"847","DOI":"10.3390\/electronics10070847","volume":"10","author":"S Chum","year":"2021","unstructured":"Chum, S., Park, H., Choi, J.: Supporting SLA via adaptive mapping and heterogeneous storage devices in Ceph. Electronics 10(7), 847 (2021)","journal-title":"Electronics"},{"key":"3764_CR12","doi-asserted-by":"crossref","unstructured":"Karger, D., Lehman, E., Leighton, T., et al.: Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the world wide web[C]\/\/Proceedings of the twenty-ninth annual ACM symposium on Theory of computing, 654\u2013663 (1997)","DOI":"10.1145\/258533.258660"},{"issue":"4","key":"3764_CR13","first-page":"887","volume":"49","author":"T Chen","year":"2012","unstructured":"Chen, T., Xiao, N., Liu, F.: An efficient hierarchical object placement algorithm for object storage systems. J. Comput. Res. Dev. 49(4), 887 (2012)","journal-title":"J. Comput. Res. Dev."},{"key":"3764_CR14","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/j.cpc.2017.11.011","volume":"224","author":"CJ Jia","year":"2018","unstructured":"Jia, C.J., Wang, Y., Mendl, C.B., et al.: Paradeisos: a perfect hashing algorithm for many-body eigenvalue problems. Comput. Phys. Commun. 224, 81\u201389 (2018)","journal-title":"Comput. Phys. Commun."},{"issue":"2","key":"3764_CR15","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1007\/s10586-018-2832-5","volume":"22","author":"B Jeong","year":"2019","unstructured":"Jeong, B., Khan, A., Park, S.: Async-LCAM: a lock contention aware messenger for Ceph distributed storage system. Clust. Comput. 22(2), 373\u2013384 (2019)","journal-title":"Clust. Comput."},{"issue":"3","key":"3764_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11432-019-2808-x","volume":"65","author":"L Qian","year":"2022","unstructured":"Qian, L., Tang, B., Ye, B., et al.: Stabilizing and boosting I\/O performance for file systems with journaling on NVMe SSD. Sci. China Inf. Sci. 65(3), 1\u201315 (2022)","journal-title":"Sci. China Inf. Sci."},{"key":"3764_CR17","doi-asserted-by":"publisher","first-page":"147672","DOI":"10.1109\/ACCESS.2019.2946962","volume":"7","author":"CT Yang","year":"2019","unstructured":"Yang, C.T., Chen, S.T., Cheng, W.H., et al.: A heterogeneous cloud storage platform with uniform data distribution by software-defined storage technologies. IEEE Access 7, 147672\u2013147682 (2019)","journal-title":"IEEE Access"},{"issue":"2","key":"3764_CR18","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1109\/TCC.2018.2874054","volume":"9","author":"LW Kong","year":"2018","unstructured":"Kong, L.W., Moreno, O.: Characterization and prediction of performance loss and MTTR during fault recovery on scale-out storage using DOE & RSM: a case study with Ceph. IEEE Trans. Cloud Comput. 9(2), 492\u2013503 (2018)","journal-title":"IEEE Trans. Cloud Comput."},{"key":"3764_CR19","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Debroy, S., Calyam, P.: Network measurement recommendations for performance bottleneck correlation analysis[C]\/\/2016 IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN). IEEE, 1\u20137 (2016)","DOI":"10.1109\/LANMAN.2016.7548869"},{"issue":"6","key":"3764_CR20","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1049\/iet-com.2008.0068","volume":"3","author":"RG Clegg","year":"2009","unstructured":"Clegg, R.G., Withall, M.S., Moore, A.W., et al.: Challenges in the capture and dissemination of measurements from high-speed networks. IET Commun. 3(6), 957\u2013966 (2009)","journal-title":"IET Commun."},{"key":"3764_CR21","doi-asserted-by":"crossref","unstructured":"Tootoonchian, A., Ghobadi, M., Ganjali, Y.: OpenTM: traffic matrix estimator for OpenFlow networks [C]\/\/International Conference on Passive and Active Network Measurement, pp. 201\u2013210. Springer, Berlin, Heidelberg (2010)","DOI":"10.1007\/978-3-642-12334-4_21"},{"issue":"4","key":"3764_CR22","doi-asserted-by":"publisher","first-page":"1473","DOI":"10.1109\/TNSM.2018.2876845","volume":"15","author":"A Liberato","year":"2018","unstructured":"Liberato, A., Martinello, M., Gomes, R.L., et al.: RDNA: residue-defined networking architecture enabling ultra-reliable low-latency datacenters. IEEE Trans. Netw. Serv. Manage. 15(4), 1473\u20131487 (2018)","journal-title":"IEEE Trans. Netw. Serv. Manage."},{"key":"3764_CR23","doi-asserted-by":"publisher","first-page":"9989","DOI":"10.1109\/ACCESS.2022.3144072","volume":"10","author":"D Kafetzis","year":"2022","unstructured":"Kafetzis, D., Vassilaras, S., Vardoulias, G., et al.: Software-defined networking meets software-defined radio in mobile Ad hoc networks: state of the art and future directions. IEEE Access 10, 9989\u201310014 (2022)","journal-title":"IEEE Access"},{"key":"3764_CR24","doi-asserted-by":"crossref","unstructured":"Girisankar, S.T., Truong-Huu, T., Gurusamy, M:. SDN-based dynamic flow scheduling in optical data centers[C]\/\/2017 9th International Conference on Communication Systems and Networks (COMSNETS). IEEE, 190\u2013197 (2017)","DOI":"10.1109\/COMSNETS.2017.7945376"},{"key":"3764_CR25","doi-asserted-by":"crossref","unstructured":"Weil, S.A., Leung, A.W., Brandt, S.A., et al.: Rados: a scalable, reliable storage service for petabyte-scale storage clusters[C]\/\/Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing'07, 35\u201344 (2007)","DOI":"10.1145\/1374596.1374606"},{"key":"3764_CR26","doi-asserted-by":"crossref","unstructured":"Honicky, R.J., Miller, E.L.: Replication under scalable hashing: a family of algorithms for scalable decentralized data distribution[C]\/\/18th International Parallel and Distributed Processing Symposium, 2004. Proceedings. IEEE, 96 (2004)","DOI":"10.1109\/IPDPS.2004.1303042"},{"key":"3764_CR27","doi-asserted-by":"crossref","unstructured":"Liu, G., Liu, X.: The Complexity of Weak Consistency[C]\/\/International Workshop on Frontiers in Algorithmics, pp. 224\u2013237. Springer, Cham (2018)","DOI":"10.1007\/978-3-319-78455-7_17"},{"issue":"434(02)","key":"3764_CR28","first-page":"93","volume":"42","author":"W Yong","year":"2019","unstructured":"Yong, W., Miao, Ye., Qian, He., WenJie, K.: Based on software-defined networking and multi-attribute decision-making node selection method for Ceph storage systems. J. Comput. Sci. 42(434(02)), 93\u2013108 (2019)","journal-title":"J. Comput. Sci."},{"key":"3764_CR29","doi-asserted-by":"publisher","first-page":"23979","DOI":"10.1109\/ACCESS.2017.2744259","volume":"5","author":"L Wu","year":"2017","unstructured":"Wu, L., Zhuge, Q., Sha, E.H.M., et al.: BOSS: An efficient data distribution strategy for object storage systems with hybrid devices. IEEE Access 5, 23979\u201323993 (2017)","journal-title":"IEEE Access"},{"key":"3764_CR30","doi-asserted-by":"publisher","unstructured":"Watkins, L.A.: Using network traffic to infer CPU and memory utilization for cluster grid computing applications. (2010). https:\/\/doi.org\/10.57709\/1347999","DOI":"10.57709\/1347999"},{"issue":"5","key":"3764_CR31","doi-asserted-by":"publisher","first-page":"1470","DOI":"10.1109\/TPDS.2015.2449299","volume":"27","author":"Z Bei","year":"2015","unstructured":"Bei, Z., Yu, Z., Zhang, H., et al.: RFHOC: a random-forest approach to auto-tuning Hadoop\u2019s configuration. IEEE Trans. Parallel Distrib. Syst. 27(5), 1470\u20131483 (2015)","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"issue":"2","key":"3764_CR32","first-page":"347","volume":"40","author":"Yu Chen","year":"2020","unstructured":"Chen, Yu., Ying-Chi, M.: Based on random forests and genetic algorithms, automatic tuning of Ceph parameters. Comput. Appl. 40(2), 347\u2013351 (2020)","journal-title":"Comput. Appl."},{"key":"3764_CR33","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1007\/978-3-642-46768-4_5","volume-title":"Fuzzy Multiple Attribute Decision Making","author":"SJ Chen","year":"1992","unstructured":"Chen, S.J., Hwang, C.L.: Fuzzy multiple attribute decision making methods. In: Fuzzy Multiple Attribute Decision Making, pp. 289\u2013486. Springer, Berlin, Heidelberg (1992)"},{"key":"3764_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.future.2017.08.011","volume":"79","author":"Z Bei","year":"2018","unstructured":"Bei, Z., Yu, Z., Luo, N., et al.: Configuring in-memory cluster computing using random forest. Future Gener. Comput. Syst. 79, 1\u201315 (2018)","journal-title":"Future Gener. Comput. Syst."},{"issue":"1","key":"3764_CR35","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1080\/00031305.2000.10474502","volume":"54","author":"S Menard","year":"2000","unstructured":"Menard, S.: Coefficients of determination for multiple logistic regression analysis. Am. Stat. 54(1), 17\u201324 (2000)","journal-title":"Am. Stat."}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-022-03764-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-022-03764-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-022-03764-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,5]],"date-time":"2024-10-05T06:52:13Z","timestamp":1728111133000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-022-03764-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,5]]},"references-count":35,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["3764"],"URL":"https:\/\/doi.org\/10.1007\/s10586-022-03764-3","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"value":"1386-7857","type":"print"},{"value":"1573-7543","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,5]]},"assertion":[{"value":"12 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 August 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 September 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflicts of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}