{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T16:37:22Z","timestamp":1781714242402,"version":"3.54.5"},"reference-count":28,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2014,10,30]],"date-time":"2014-10-30T00:00:00Z","timestamp":1414627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In order to solve the problems of ill-balanced task allocation, long response time, low throughput rate and poor performance when the cluster system is assigning tasks, we introduce the concept of entropy in thermodynamics into load balancing algorithms. This paper proposes a new load balancing algorithm for homogeneous clusters based on the Maximum Entropy Method (MEM). By calculating the entropy of the system and using the maximum entropy principle to ensure that each scheduling and migration is performed following the increasing tendency of the entropy, the system can achieve the load balancing status as soon as possible, shorten the task execution time and enable high performance. The result of simulation experiments show that this algorithm is more advanced when it comes to the time and extent of the load balance of the homogeneous cluster system compared with traditional algorithms. It also provides novel thoughts of solutions for the load balancing problem of the homogeneous cluster system.<\/jats:p>","DOI":"10.3390\/e16115677","type":"journal-article","created":{"date-parts":[[2014,10,30]],"date-time":"2014-10-30T11:53:25Z","timestamp":1414670005000},"page":"5677-5697","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Load Balancing Algorithm Based on Maximum Entropy Methods in Homogeneous Clusters"],"prefix":"10.3390","volume":"16","author":[{"given":"Long","family":"Chen","sequence":"first","affiliation":[{"name":"North China Electric Power University, No. 2 Beinong Road, Changping District, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kehe","family":"Wu","sequence":"additional","affiliation":[{"name":"North China Electric Power University, No. 2 Beinong Road, Changping District, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi","family":"Li","sequence":"additional","affiliation":[{"name":"North China Electric Power University, No. 2 Beinong Road, Changping District, Beijing 102206, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2014,10,30]]},"reference":[{"key":"ref_1","first-page":"581","article-title":"The entropy value of load blance algorithm about cloud computer cluster","volume":"65","author":"Dong","year":"2010","journal-title":"J. Chengdu Univ. Inf. Tech."},{"key":"ref_2","first-page":"26","article-title":"Parallel computing entropy in homogeneous cluster","volume":"1","author":"Lu","year":"2009","journal-title":"J. Shenzhen Univ. Sci. Eng."},{"key":"ref_3","unstructured":"LV, S. Available online: http:\/\/kh.linuxvirtualserver.org\/wiki\/Load_balancing#Computing_Loa-d_Balancing."},{"key":"ref_4","unstructured":"Ibrahim, M.A.M., and Lu, X. (2002, January 23\u201325,). In Performance of dynamic load balancing algorithm on cluster of workstations and PCs, Los Alamitos, CA, USA."},{"key":"ref_5","first-page":"9","article-title":"Load balancing algorithm with genetic algorithm in virtual machines of cloud computing","volume":"4","author":"Liu","year":"2012","journal-title":"J. Fuzhou Univ. (Nat. Sci. Ed.)"},{"key":"ref_6","unstructured":"Chau, S.C., and Fu, A.W. (2003, January 27#x02013;29,). Load balancing between computing clusters, Chengdu, China."},{"key":"ref_7","unstructured":"Balasubramaniam, M., Barker, K., Banicescu, I., Chrisochoides, N., Pabico, J.P., and Carino, R.L. (2004, January 5\u20137,). A novel dynamic load balancing library for cluster computing, Cork, Ireland."},{"key":"ref_8","unstructured":"Sit, H.Y., Ho, K.S., Leong, H.V., Luk, R.W., and Ho, L.K. (2004, January 10\u201312,). An adaptive clustering approach to dynamic load balancing, Hong Kong, China."},{"key":"ref_9","first-page":"84","article-title":"Fuzzy control-based heuristic algorithm for load balancing in workflow engine","volume":"27","author":"Dai","year":"2006","journal-title":"J. Commun."},{"key":"ref_10","unstructured":"Kim, Y.J., and Kim, B.K. (November, January 31). Load balancing algorithm of parallel vision processing system for real-time navigation, Takamatsu, Japan."},{"key":"ref_11","unstructured":"Nair, C., Prabhakar, B., and Shah, D. (, January October). The randomness in randomized load balancing, Monticello, IL, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.3724\/SP.J.1001.2013.04364","article-title":"Virtual resource evaluation model based on entropy optimized and dynamic weighted in cloud computing","volume":"24","author":"Zuo","year":"2013","journal-title":"J. Softw."},{"key":"ref_13","unstructured":"Leibnitz, K., Shimokawa, T., Peper, F., and Murata, M. (2013, January 25#x02013;27,). Maximum entropy based randomized routing in data-centric networks, Hiroshima, Japan."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1109\/TSMC.1984.6313278","article-title":"An information measure for fuzzy sets","volume":"1","author":"Xie","year":"1984","journal-title":"IEEE Trans. Syst. Man Cybern"},{"key":"ref_15","first-page":"87","article-title":"Distribution model based on maximum entropy principle","volume":"21","author":"Hu","year":"2008","journal-title":"J. Shandong Univ. Tech.(Nat. Sci. Ed."},{"key":"ref_16","first-page":"810","article-title":"Bayesian uncertainty inverse analysis method based on pome","volume":"40","author":"Yang","year":"2006","journal-title":"J. Zhejiang Univ.(Eng. Sci.)"},{"key":"ref_17","unstructured":"Lv, W. (2006). The applications of Maximum Entropy Method (MEM) and Bayes in data processing. Univ. Electron. Sci. Tech. China., volume, firstpage\u2013lastpage. (In Chinese)."},{"key":"ref_18","first-page":"375","article-title":"The computer cluster and the parrllel computer environment based on the networks","volume":"23","author":"Zou","year":"2001","journal-title":"Comput. Tech. Geophys. Geochem. Explor."},{"key":"ref_19","first-page":"134","article-title":"Summarization of the load-balancing algorithm","volume":"18","author":"Luo","year":"2008","journal-title":"Sci-Tech Inf. Dev. Econ."},{"key":"ref_20","first-page":"24","article-title":"Load balancing algorithm based on Parallel computing entropy in HPC","volume":"1","author":"Sun","year":"2007","journal-title":"J. Shenzhen Univ. Sci. Eng."},{"key":"ref_21","unstructured":"Heirich, A. (1997). Analysis of Scalable Algorithms for Dynamic Load Balancing and Mapping with Application to Photo-Realistic Rendering. [Ph.D. Thesis, California Institute of Technology]."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sharma, R., and Kanungo, P. (2014, January 7\u20139,). Dynamic load balancing algorithm for heterogeneous multi-core processors cluster, Bhopal, India.","DOI":"10.1109\/CSNT.2014.63"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yun, S.Y., and Proutiere, A. (2014, January 19\u201321,). Distributed load balancing in heterogenous systems, Princeton, NJ, USA.","DOI":"10.1145\/2745844.2745861"},{"key":"ref_24","first-page":"112","article-title":"A load-balancing scheduling scheme based on heterogeneous workloads in cloud data centers","volume":"45","author":"Li","year":"2013","journal-title":"J. Sichuan Univ. (Eng. Sci. Ed.)"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Overman, R.E., Prins, J.F., Miller, L.A., and Minion, M.L. (2013, January 20\u201324,). Dynamic load balancing of the adaptive fast multipole method in heterogeneous systems, Cambridge, MA, USA.","DOI":"10.1109\/IPDPSW.2013.218"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sheng, J., Qi, B., Dong, X., and Tang, L. (2012, January 21\u201323,). Entropy weight and grey relation analysis based load balancing algorithm in heterogeneous wireless networks, Shanghai, China.","DOI":"10.1109\/WiCOM.2012.6478516"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2569","DOI":"10.1007\/s11277-013-1488-y","article-title":"Load distribution in non-homogeneous wireless local area networks","volume":"75","author":"Chi","year":"2014","journal-title":"Wirel. Pers. Commun."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.parco.2011.11.001","article-title":"Load balancing in homogeneous pipeline based applications","volume":"38","author":"Moreno","year":"2012","journal-title":"Parallel Comput"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/11\/5677\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:17:37Z","timestamp":1760217457000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/11\/5677"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,30]]},"references-count":28,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2014,11]]}},"alternative-id":["e16115677"],"URL":"https:\/\/doi.org\/10.3390\/e16115677","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,30]]}}}