{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T16:12:06Z","timestamp":1764000726678,"version":"3.37.3"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,7,10]],"date-time":"2020-07-10T00:00:00Z","timestamp":1594339200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,10]],"date-time":"2020-07-10T00:00:00Z","timestamp":1594339200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Big Data constructed based on the advancement of distributed computing and virtualization is considered as the current emerging trends in Data Analytics. It is used for supporting potential utilization of computing resources focusing on, on-demand services and resource scalability. In particular, resource scheduling is considered as the process of resource distribution through an effective decision making process with the objective of facilitating required tasks over time. The incorporation of heterogeneous computing resources by the Big Data consumers also permits the option of reducing energy usage and enhanced resource efficiency. Further, optimal scheduling of resources is considered as an NP hard problem due to the dynamic characteristics of the resources and fluctuating users\u2019 demand. In this paper, a Hybrid Gradient Descent Spider Monkey Optimization (HGDSMO) algorithm is proposed to efficient resource scheduling by handling the issues and challenges in the Hadoop heterogenous environment. The proposed HGDSMO algorithm uses the Gradient Descentand foraging and social behavior of the spider monkey optimization algorithm involved in the objective of effective resource allocation. It is designed as the efficient task scheduling approach that balances the load of the cloud by allocating them to appropriate VMs depending on their requirements. It is also proposed as a dynamic resource management scheme for efficiently allocating the cloud resources for effective execution of clients\u2019 tasks. The simulation results of the proposed HGDSMO algorithm confirmed to be potent in throughput, load balancing and makespan compared to the baseline hybrid meta-heuristic resource allocation algorithms used for investigation.<\/jats:p>","DOI":"10.1186\/s40537-020-00321-w","type":"journal-article","created":{"date-parts":[[2020,7,10]],"date-time":"2020-07-10T07:03:42Z","timestamp":1594364622000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Hybrid gradient descent spider monkey optimization (HGDSMO) algorithm for efficient resource scheduling for big data processing in heterogenous environment"],"prefix":"10.1186","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2151-4911","authenticated-orcid":false,"given":"V.","family":"Seethalakshmi","sequence":"first","affiliation":[]},{"given":"V.","family":"Govindasamy","sequence":"additional","affiliation":[]},{"given":"V.","family":"Akila","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,7,10]]},"reference":[{"issue":"1","key":"321_CR1","first-page":"43","volume":"1","author":"S Bose","year":"2019","unstructured":"Bose S, Sarkar D, Mukherjee NA. Framework for heterogeneous resource allocation in sensor-cloud environment. Wirel Pers Commun. 2019;1(1):43\u201354.","journal-title":"Wirel Pers Commun."},{"issue":"1","key":"321_CR2","first-page":"43","volume":"1","author":"PM Rekha","year":"2019","unstructured":"Rekha PM, Dakshayini M. Efficient task allocation approach using genetic algorithm for cloud environment. Clust Comput. 2019;1(1):43\u201356.","journal-title":"Clust Comput"},{"issue":"3","key":"321_CR3","first-page":"67","volume":"8","author":"N Rana","year":"2018","unstructured":"Rana N, Abd Latiff MS, Muhammad Abdulhamid S. A cloud-based conceptual framework for multi-objective virtual machine scheduling using whale optimization algorithm. Int J Innovat Comput. 2018;8(3):67\u201376.","journal-title":"Int J Innovat Comput"},{"issue":"4","key":"321_CR4","doi-asserted-by":"crossref","first-page":"3585","DOI":"10.1007\/s13369-018-3602-7","volume":"44","author":"SH Madni","year":"2018","unstructured":"Madni SH, Latiff MS, Ali J, Abdulhamid SM. Multi-objective-oriented cuckoo search optimization-based resource scheduling algorithm for clouds. Arabian J Sci Eng. 2018;44(4):3585\u2013602.","journal-title":"Arabian J Sci Eng"},{"issue":"2","key":"321_CR5","first-page":"45","volume":"1","author":"AM Senthil Kumar","year":"2018","unstructured":"Senthil Kumar AM, Venkatesan M. Task scheduling in a cloud computing environment using HGPSO algorithm. Clust Comput. 2018;1(2):45\u201356.","journal-title":"Clust Comput"},{"issue":"1","key":"321_CR6","first-page":"34","volume":"1","author":"G Natesan","year":"2018","unstructured":"Natesan G, Chokkalingam A. Task scheduling in heterogeneous cloud environment using mean grey wolf optimization algorithm. ICT Express. 2018;1(1):34\u201345.","journal-title":"ICT Express"},{"issue":"4","key":"321_CR7","doi-asserted-by":"crossref","first-page":"2287","DOI":"10.1007\/s11277-018-5816-0","volume":"101","author":"K Pradeep","year":"2018","unstructured":"Pradeep K, Prem Jacob T. A hybrid approach for task scheduling using the cuckoo and harmony search in cloud computing environment. Wirel Pers Commun. 2018;101(4):2287\u2013311.","journal-title":"Wirel Pers Commun"},{"issue":"1","key":"321_CR8","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s10586-018-2856-x","volume":"22","author":"SH Madni","year":"2018","unstructured":"Madni SH, Abd Latiff MS, Abdulhamid SM, Ali J. Hybrid gradient descent cuckoo search (HGDCS) algorithm for resource scheduling in iaas cloud computing environment. Clust Comput. 2018;22(1):301\u201334.","journal-title":"Clust Comput"},{"issue":"1\u20133","key":"321_CR9","first-page":"56","volume":"9","author":"SH Madni","year":"2017","unstructured":"Madni SH, Abd Latiff MS, Abdulhamid SM. Optimal resource scheduling for IaaS cloud computing using cuckoo search algorithm. Sains Humanika. 2017;9(1\u20133):56\u201367.","journal-title":"Sains Humanika"},{"issue":"1","key":"321_CR10","first-page":"78","volume":"1","author":"X Chen","year":"2017","unstructured":"Chen X, Long D. Task scheduling of cloud computing using integrated particle swarm algorithm and ant colony algorithm. Clust Comput. 2017;1(1):78\u201388.","journal-title":"Clust Comput"},{"issue":"1","key":"321_CR11","first-page":"1","volume":"1","author":"M Shojafar","year":"2016","unstructured":"Shojafar M, Canali C, Lancellotti R, Abawajy J. Adaptive computing-plus-communication optimization framework for multimedia processing in cloud systems. IEEE Transact Cloud Comput. 2016;1(1):1.","journal-title":"IEEE Transact Cloud Comput"},{"key":"321_CR12","doi-asserted-by":"crossref","unstructured":"Kimpan W, Kruekaew B. Heuristic task scheduling with artificial bee colony algorithm for virtual machines. 2016 Joint 8th International Conference on Soft Computing and Intelligent Systems (SCIS) and 17th International Symposium on Advanced Intelligent Systems (ISIS), 2016: 1(1); 32\u201346.","DOI":"10.1109\/SCIS-ISIS.2016.0067"},{"issue":"1","key":"321_CR13","doi-asserted-by":"crossref","first-page":"65","DOI":"10.5121\/ijfcst.2016.6106","volume":"6","author":"J Thaman","year":"2016","unstructured":"Thaman J, Singh M. Current perspective in task scheduling techniques in cloud computing: a review. Int J Foundat Comput Sci Technol. 2016;6(1):65\u201385.","journal-title":"Int J Foundat Comput Sci Technol"},{"issue":"7","key":"321_CR14","doi-asserted-by":"crossref","first-page":"e0158102","DOI":"10.1371\/journal.pone.0158102","volume":"11","author":"SM Abdulhamid","year":"2016","unstructured":"Abdulhamid SM, Abd Latiff MS, Abdul-Salaam G, Hussain Madni SH. Secure scientific applications scheduling technique for cloud computing environment using global league championship algorithm. PLoS ONE. 2016;11(7):e0158102.","journal-title":"PLoS ONE"},{"issue":"1","key":"321_CR15","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1016\/j.future.2015.08.006","volume":"56","author":"M Abdullahi","year":"2016","unstructured":"Abdullahi M, Ngadi MA, Abdulhamid SM. Symbiotic organism search optimization based task scheduling in cloud computing environment. Future Generat Comput Syst. 2016;56(1):640\u201350.","journal-title":"Future Generat Comput Syst"},{"issue":"3","key":"321_CR16","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.eij.2015.07.001","volume":"16","author":"M Kalra","year":"2015","unstructured":"Kalra M, Singh S. A review of metaheuristic scheduling techniques in cloud computing. Egypt Inform J. 2015;16(3):275\u201395.","journal-title":"Egypt Inform J"},{"issue":"1","key":"321_CR17","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1007\/978-3-319-11897-0_10","volume":"1","author":"AS Beegom","year":"2014","unstructured":"Beegom AS, Rajasree MS. A particle swarm optimization based pareto optimal task scheduling in cloud computing. Lect Notes Comput Sci. 2014;1(1):79\u201386.","journal-title":"Lect Notes Comput Sci"},{"issue":"3","key":"321_CR18","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1007\/s11227-014-1126-9","volume":"68","author":"N Netjinda","year":"2014","unstructured":"Netjinda N, Sirinaovakul B, Achalakul T. Cost optimal scheduling in Iaas for dependent workload with particle swarm optimization. J Supercomput. 2014;68(3):1579\u2013603.","journal-title":"J Supercomput"},{"issue":"6","key":"321_CR19","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1007\/s00521-014-1804-9","volume":"26","author":"K Cho","year":"2014","unstructured":"Cho K, Tsai P, Tsai C, Yang C. A hybrid meta-heuristic algorithm for VM scheduling with load balancing in cloud computing. Neural Comput Appl. 2014;26(6):1297\u2013309.","journal-title":"Neural Comput Appl"},{"issue":"1","key":"321_CR20","doi-asserted-by":"crossref","first-page":"3236","DOI":"10.4028\/www.scientific.net\/AMR.926-930.3236","volume":"926\u2013930","author":"MG Huang","year":"2014","unstructured":"Huang MG, Ou ZQ. Review of task scheduling algorithm research in cloud computing. Adv Mater Res. 2014;926\u2013930(1):3236\u20139.","journal-title":"Adv Mater Res"},{"issue":"1","key":"321_CR21","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1109\/JSYST.2013.2256731","volume":"8","author":"C Tsai","year":"2014","unstructured":"Tsai C, Rodrigues JJ. Metaheuristic scheduling for cloud: a survey. IEEE Syst J. 2014;8(1):279\u201391.","journal-title":"IEEE Syst J"},{"issue":"4","key":"321_CR22","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1002\/cpe.3029","volume":"28","author":"P Mehrotra","year":"2013","unstructured":"Mehrotra P, Djomehri J, Heistand S, Hood R, Jin H, Lazanoff A, Biswas R. Performance evaluation of amazon elastic compute cloud for NASA high-performance computing applications. Concurr Comput Pract Exp. 2013;28(4):1041\u201355.","journal-title":"Concurr Comput Pract Exp"},{"key":"321_CR23","doi-asserted-by":"crossref","unstructured":"Tawfeek MA, El-Sisi A, Keshk AE, Torkey FA. Cloud task scheduling based on ant colony optimization. 2013 8th International Conference on Computer Engineering & Systems (ICCES). 2013: 1(2); 67\u201375.","DOI":"10.1109\/ICCES.2013.6707172"},{"issue":"1","key":"321_CR24","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/978-3-642-38027-3_11","volume":"1","author":"S Anousha","year":"2013","unstructured":"Anousha S, Ahmadi M. An improved min-min task scheduling algorithm in grid computing. Grid Pervasive Comput. 2013;1(1):103\u201313.","journal-title":"Grid Pervasive Comput"},{"issue":"1","key":"321_CR25","first-page":"184","volume":"31","author":"J Li","year":"2011","unstructured":"Li J, Peng J. Task scheduling algorithm based on improved genetic algorithm in cloud computing environment. J Comput Appl. 2011;31(1):184\u20136.","journal-title":"J Comput Appl"},{"issue":"4","key":"321_CR26","doi-asserted-by":"crossref","first-page":"459","DOI":"10.15837\/ijccc.2019.4.3491","volume":"14","author":"G Balakrishna","year":"2019","unstructured":"Balakrishna G, Moparthi NR. ESBL: design and implement a cloud integrated framework for IoT load balancing. Int J Comput Commun Control. 2019;14(4):459\u201374.","journal-title":"Int J Comput Commun Control"},{"issue":"1","key":"321_CR27","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1186\/s40537-019-0253-9","volume":"6","author":"A Gandomi","year":"2019","unstructured":"Gandomi A, Reshadi M, Movaghar A, Khademzadeh A. HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework. J Big Data. 2019;6(1):106.","journal-title":"J Big Data"},{"key":"321_CR28","doi-asserted-by":"crossref","unstructured":"Kumar M, Sharma SC, Goel S, Mishra SK, Husain A. Autonomic cloud resource provisioning and scheduling using meta-heuristic algorithm. Neural Comput Appl. 2020: 1(1).","DOI":"10.1007\/s00521-020-04955-y"},{"issue":"2","key":"321_CR29","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/TASE.2013.2272758","volume":"11","author":"X Zuo","year":"2014","unstructured":"Zuo X, Zhang G, Tan W. Self-adaptive learning PSO-based deadline constrained task scheduling for hybrid IaaS cloud. IEEE Trans Autom Sci Eng. 2014;11(2):564\u201373.","journal-title":"IEEE Trans Autom Sci Eng"},{"issue":"2","key":"321_CR30","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1007\/s10586-017-1040-z","volume":"21","author":"SS Gill","year":"2017","unstructured":"Gill SS, Chana I, Singh M, Buyya R. Chopper: an intelligent qos-aware autonomic resource management approach for cloud computing. Clust Comput. 2017;21(2):1203\u201341.","journal-title":"Clust Comput"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-020-00321-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-020-00321-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-020-00321-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,9]],"date-time":"2021-07-09T23:19:47Z","timestamp":1625872787000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-020-00321-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,10]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["321"],"URL":"https:\/\/doi.org\/10.1186\/s40537-020-00321-w","relation":{},"ISSN":["2196-1115"],"issn-type":[{"type":"electronic","value":"2196-1115"}],"subject":[],"published":{"date-parts":[[2020,7,10]]},"assertion":[{"value":"31 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"I\u2019 being the corresponding author declare that we have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"49"}}