{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T01:15:59Z","timestamp":1768007759703,"version":"3.49.0"},"reference-count":36,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2020,6,30]],"date-time":"2020-06-30T00:00:00Z","timestamp":1593475200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJICC"],"published-print":{"date-parts":[[2020,6,30]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The intelligence in the Internet of Things (IoT) can be embedded by analyzing the huge volumes of data generated by it in an ultralow latency environment. The computational latency incurred by the cloud-only solution can be significantly brought down by the fog computing layer, which offers a computing infrastructure to minimize the latency in service delivery and execution. For this purpose, a task scheduling policy based on reinforcement learning (RL) is developed that can achieve the optimal resource utilization as well as minimum time to execute tasks and significantly reduce the communication costs during distributed execution.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>To realize this, the authors proposed a two-level neural network (NN)-based task scheduling system, where the first-level NN (feed-forward neural network\/convolutional neural network [FFNN\/CNN]) determines whether the data stream could be analyzed (executed) in the resource-constrained environment (edge\/fog) or be directly forwarded to the cloud. The second-level NN ( RL module) schedules all the tasks sent by level 1 NN to fog layer, among the available fog devices. This real-time task assignment policy is used to minimize the total computational latency (makespan) as well as communication costs.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Experimental results indicated that the RL technique works better than the computationally infeasible greedy approach for task scheduling and the combination of RL and task clustering algorithm reduces the communication costs significantly.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>The proposed algorithm fundamentally solves the problem of task scheduling in real-time fog-based IoT with best resource utilization, minimum makespan and minimum communication cost between the tasks.<\/jats:p><\/jats:sec>","DOI":"10.1108\/ijicc-03-2020-0021","type":"journal-article","created":{"date-parts":[[2020,7,3]],"date-time":"2020-07-03T10:20:57Z","timestamp":1593771657000},"page":"261-282","source":"Crossref","is-referenced-by-count":43,"title":["Adaptive task scheduling in IoT using reinforcement learning"],"prefix":"10.1108","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3755-3245","authenticated-orcid":false,"given":"Mohammad Khalid","family":"Pandit","sequence":"first","affiliation":[]},{"given":"Roohie Naaz","family":"Mir","sequence":"additional","affiliation":[]},{"given":"Mohammad Ahsan","family":"Chishti","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"issue":"1","key":"key2020082108460802100_ref001","first-page":"450","article-title":"Mobile edge computing: a survey","volume":"5","year":"2017","journal-title":"IEEE Internet of Things Journal"},{"key":"key2020082108460802100_ref002","first-page":"150","article-title":"Graph-partitioning based instruction scheduling for clustered processors","year":"2001"},{"key":"key2020082108460802100_ref003","first-page":"963","article-title":"Network aware resource allocation in distributed clouds","year":"2012"},{"key":"key2020082108460802100_ref004","doi-asserted-by":"publisher","DOI":"10.1108\/IJPCC-06-2019-059","article-title":"Survey of applications, challenges and opportunities in fog computing","year":"2019","journal-title":"International Journal of Pervasive Computing and Communications"},{"key":"key2020082108460802100_ref005","first-page":"13","article-title":"Fog computing and its role in the internet of things","year":"2012"},{"key":"key2020082108460802100_ref006","first-page":"15","article-title":"A comparison study of static mapping heuristics for a class of meta-tasks on heterogeneous computing systems","year":"1999"},{"key":"key2020082108460802100_ref007","first-page":"1280","article-title":"Multi-tier multi-access edge computing: the role for the fourth industrial revolution","year":"2017"},{"key":"key2020082108460802100_ref008","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/B978-0-12-805395-9.00004-6","article-title":"Fog computing: principles, architectures, and applications","volume-title":"Internet of Things","year":"2016"},{"issue":"2","key":"key2020082108460802100_ref009","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1260\/174830109787914001","article-title":"Directed acyclic task graph scheduling for heterogeneous computing systems by dynamic critical path duplication algorithm","volume":"3","year":"2009","journal-title":"Journal of Algorithms and Computational Technology"},{"issue":"6","key":"key2020082108460802100_ref010","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1109\/71.242154","article-title":"On the granularity and clustering of directed acyclic task graphs","volume":"4","year":"1993","journal-title":"IEEE Transactions on Parallel and Distributed Systems"},{"key":"key2020082108460802100_ref011","first-page":"1","article-title":"Hybrid evolutionary algorithms: methodologies, architectures, and reviews","volume-title":"Hybrid Evolutionary Algorithms","year":"2007"},{"issue":"2","key":"key2020082108460802100_ref012","first-page":"677","article-title":"Multitier fog computing with large-scale iot data analytics for smart cities","volume":"5","year":"2017","journal-title":"IEEE Internet of Things Journal"},{"key":"key2020082108460802100_ref013","article-title":"A hybrid genetic algorithm for multi-objective flexible job shop scheduling problem considering transportation time","year":"2019","journal-title":"International Journal of Intelligent Computing and Cybernetics"},{"key":"key2020082108460802100_ref014","first-page":"328","article-title":"Applying cluster computing to enable a large-scale smart grid stability monitoring application","year":"2012"},{"issue":"2","key":"key2020082108460802100_ref015","doi-asserted-by":"crossref","first-page":"289","DOI":"10.12785\/ijcds\/090214","article-title":"Data aggregation mechanisms in the internet of things: a study, qualitative and quantitative analysis","volume":"9","year":"2020","journal-title":"International Journal of Computing and Digital Systems"},{"key":"key2020082108460802100_ref016","first-page":"975","article-title":"Task scheduling in fog enabled internet of things for smart cities","year":"2017"},{"key":"key2020082108460802100_ref017","article-title":"A task scheduling algorithm based on classification mining in fog computing environment","volume":"2018","year":"2018","journal-title":"Wireless Communications and Mobile Computing"},{"key":"key2020082108460802100_ref018","volume-title":"The Internet of Flying-Things: Opportunities and Challenges with Airborne Fog Computing and Mobile Cloud in the Clouds","year":"2015"},{"issue":"2","key":"key2020082108460802100_ref019","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1006\/jpdc.1999.1581","article-title":"Dynamic mapping of a class of independent tasks onto heterogeneous computing systems","volume":"59","year":"1999","journal-title":"Journal of Parallel and Distributed Computing"},{"issue":"9","key":"key2020082108460802100_ref020","doi-asserted-by":"crossref","first-page":"2830","DOI":"10.3390\/s18092830","article-title":"Real-time task assignment approach leveraging reinforcement learning with evolution strategies for long-term latency minimization in fog computing","volume":"18","year":"2018","journal-title":"Sensors"},{"issue":"1","key":"key2020082108460802100_ref021","first-page":"416","article-title":"A comprehensive survey on fog computing: state-of-the-art and research challenges","volume":"20","year":"2017","journal-title":"IEEE Communications Surveys and Tutorials"},{"issue":"3","key":"key2020082108460802100_ref022","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/S0164-1212(02)00147-4","article-title":"Genetic-algorithm-based real-time task scheduling with multiple goals","volume":"71","year":"2004","journal-title":"Journal of Systems and Software"},{"issue":"8","key":"key2020082108460802100_ref023","first-page":"28","article-title":"Machine learning at the edge of internet of things","volume":"41","year":"2017","journal-title":"CSI Communications"},{"key":"key2020082108460802100_ref024","first-page":"27","article-title":"Distributed iot analytics across edge, fog and cloud","year":"2018"},{"issue":"1","key":"key2020082108460802100_ref025","article-title":"Adaptive deep neural networks for internet of things","volume":"10","year":"2020","journal-title":"International Journal of Sensors, Wireless Communications and Control"},{"issue":"4","key":"key2020082108460802100_ref026","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MNET.2016.7513863","article-title":"Fog-computing-based radio access networks: issues and challenges","volume":"30","year":"2016","journal-title":"Ieee Network"},{"key":"key2020082108460802100_ref027","first-page":"1","article-title":"Towards task scheduling in a cloud-fog computing system","year":"2016"},{"key":"key2020082108460802100_ref028","first-page":"395","article-title":"Echo: an adaptive orchestration platform for hybrid dataflows across cloud and edge","year":"2017"},{"key":"key2020082108460802100_ref029","volume-title":"Iot Analytics across Edge and Cloud Platforms","year":"2017"},{"key":"key2020082108460802100_ref030","first-page":"933","article-title":"Greedy grid scheduling algorithm in dynamic job submission environment","year":"2011"},{"key":"key2020082108460802100_ref031","volume-title":"Introduction to Reinforcement Learning","year":"1998"},{"key":"key2020082108460802100_ref032","first-page":"65","article-title":"Workflow scheduling to minimize data movement using multi-constraint graph partitioning","year":"2012"},{"issue":"12","key":"key2020082108460802100_ref033","doi-asserted-by":"crossref","first-page":"3045","DOI":"10.1016\/j.cor.2013.06.012","article-title":"Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm","volume":"40","year":"2013","journal-title":"Computers and Operations Research"},{"key":"key2020082108460802100_ref034","volume-title":"Feasibility of Fog Computing","year":"2017"},{"key":"key2020082108460802100_ref035","first-page":"115","article-title":"Demystifying fog computing: characterizing architectures, applications and abstractions","year":"2017"},{"key":"key2020082108460802100_ref036","first-page":"325","article-title":"Key ingredients in an iot recipe: fog computing, cloud computing, and more fog computing","year":"2014"}],"container-title":["International Journal of Intelligent Computing and Cybernetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJICC-03-2020-0021\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJICC-03-2020-0021\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:54:10Z","timestamp":1753397650000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijicc\/article\/13\/3\/261-282\/516153"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,30]]},"references-count":36,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,6,30]]}},"alternative-id":["10.1108\/IJICC-03-2020-0021"],"URL":"https:\/\/doi.org\/10.1108\/ijicc-03-2020-0021","relation":{},"ISSN":["1756-378X"],"issn-type":[{"value":"1756-378X","type":"print"}],"subject":[],"published":{"date-parts":[[2020,6,30]]}}}