{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T09:40:41Z","timestamp":1769766041360,"version":"3.49.0"},"reference-count":16,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2023,1,30]]},"abstract":"<jats:p>Flink is regarded as a promising distributed data processing engine for unifying bounded data and unbounded data. Unbalanced workloads upon multiple workers\/task managers\/servers in the Flink bring congestion, which will lead to the quality of service (QoS) decreasing. The balanced load distribution could efficiently improve QoS. Besides, existing works are lagging behind the current Flink version. To distribute workloads upon workers evenly, a resource-oriented load balancing task scheduling (RoLBTS) mechanism for Flink is proposed. The capacities of CPU, memory, and bandwidth are taken into consideration. Based on the barrel principle, the memory, and the bandwidth are respectively selected to model the resource occupancy ratio of the physical node and that of the physical link. On the based of modeled resource occupancy ratio, the data processing of load-balancing resource usage in Flink is formulated as a quadratic programming problem. Based on the self-recursive calling, a RoLBTS algorithm for scheduling task-needed resources is presented. Trough the numerical simulation, the superiority of our work is evaluated in terms of resource score, the number of possible scheduling solutions, and resource usage ratio.<\/jats:p>","DOI":"10.3233\/jifs-222524","type":"journal-article","created":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T10:46:30Z","timestamp":1668768390000},"page":"2703-2713","source":"Crossref","is-referenced-by-count":5,"title":["A resource occupancy ratio-oriented load balancing task scheduling mechanism for Flink"],"prefix":"10.1177","volume":"44","author":[{"given":"Qinglong","family":"Dai","sequence":"first","affiliation":[{"name":"Smart City College, Beijing Union University, Beijing, P. R. China"}]},{"given":"Guangjun","family":"Qin","sequence":"additional","affiliation":[{"name":"Smart City College, Beijing Union University, Beijing, P. R. China"}]},{"given":"Jianwu","family":"Li","sequence":"additional","affiliation":[{"name":"Advanced Technology Reseach Institute, Beijing Institute of Technology, Beijing, P. R. China"}]},{"given":"Jun","family":"Zhao","sequence":"additional","affiliation":[{"name":"Institute of Big Data and Artificial Intelligence, Chinatelecom Research Institute, Beijing, P. R. China"}]},{"given":"Jifan","family":"Cai","sequence":"additional","affiliation":[{"name":"Smart City College, Beijing Union University, Beijing, P. R. China"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-222524_ref2","unstructured":"Saxena S. and Gupta S. , Practical real-time data processing and analytics: distributed computing and event processing using Apache Spark, Flink, Storm, and Kafka. Packt Publishing Ltd, 2017."},{"issue":"1","key":"10.3233\/JIFS-222524_ref3","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TBDATA.2019.2898067","article-title":"Guest Editors\u2019 Introduction: Special Issue on Big Data Systems on Emerging Architectures","volume":"5","author":"He","year":"2019","journal-title":"IEEETransactions on Big Data"},{"issue":"4","key":"10.3233\/JIFS-222524_ref4","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1109\/TPDS.2020.3035170","article-title":"SEIZE:Runtime Inspection for Parallel Dataflow Systems","volume":"32","author":"Li","year":"2021","journal-title":"IEEETransactions on Parallel and Distributed Systems"},{"key":"10.3233\/JIFS-222524_ref5","unstructured":"The Apache Software Foundation. Apache Flink \u2013 Stateful Computations over Data Streams, Jan 2022."},{"issue":"1","key":"10.3233\/JIFS-222524_ref6","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/TBDATA.2017.2697441","article-title":"In-Memory Stream Indexing of Massive and Fast Incoming Multimedia Content","volume":"4","author":"Antaris","year":"2018","journal-title":"IEEE Transactions on Big Data"},{"issue":"6","key":"10.3233\/JIFS-222524_ref7","doi-asserted-by":"crossref","first-page":"3623","DOI":"10.1109\/TIT.2021.3054385","article-title":"EvaluatingLoad Balancing Performance in Distributed Storage With Redundancy","volume":"67","author":"Akta\u015f","year":"2021","journal-title":"IEEE Transactions on Information Theory"},{"issue":"4","key":"10.3233\/JIFS-222524_ref8","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1109\/TBC.2019.2906783","article-title":"A Load Balancing Solution for Improving Video Quality in Loaded Wireless Network Conditions","volume":"65","author":"Hava","year":"2019","journal-title":"IEEE Transactions on Broadcasting"},{"issue":"8","key":"10.3233\/JIFS-222524_ref9","doi-asserted-by":"crossref","first-page":"7043","DOI":"10.1109\/JIOT.2020.2982305","article-title":"Load-Balancing Algorithm for Multiple Gateways in Fog-Based Internetof Things","volume":"7","author":"Banaie","year":"2020","journal-title":"IEEE Internet of Things Journal"},{"issue":"8","key":"10.3233\/JIFS-222524_ref10","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1364\/JOCN.394023","article-title":"Load balance algorithm for an OPSquare datacenter network under real application traffic","volume":"12","author":"Yan","year":"2020","journal-title":"Journal of Optical Communications and Networking"},{"issue":"8","key":"10.3233\/JIFS-222524_ref11","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1109\/TPDS.2020.2978480","article-title":"Evaluation of Stream Processing Frameworks","volume":"31","author":"van Dongen","year":"2020","journal-title":"IEEE Transactions on Parallel and Distributed Systems"},{"issue":"8","key":"10.3233\/JIFS-222524_ref13","first-page":"85","article-title":"Flow-network based auto rescale strategy for Flink","volume":"40","author":"Li","year":"2019","journal-title":"Journal onCommunications"},{"issue":"10","key":"10.3233\/JIFS-222524_ref14","first-page":"92","article-title":"Load prediction based elastic resource scheduling strategy in Flink","volume":"41","author":"Li","year":"2020","journal-title":"Journal on Communications"},{"issue":"7","key":"10.3233\/JIFS-222524_ref16","doi-asserted-by":"publisher","first-page":"6679","DOI":"10.1109\/TITS.2021.3060576","article-title":"A dynamic pyramid tilling method for traffic data stream based on Flink","volume":"23","author":"Hu","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"issue":"3","key":"10.3233\/JIFS-222524_ref18","first-page":"379","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"The BellSystem Technical Journal"},{"issue":"07","key":"10.3233\/JIFS-222524_ref19","first-page":"1173","article-title":"Task schedulingoptimization of Flink in container environment","volume":"43","author":"Huang","year":"2021","journal-title":"ComputerEngineering & Science"},{"key":"10.3233\/JIFS-222524_ref20","doi-asserted-by":"crossref","unstructured":"Hueske F. and Kalavri V. , Stream processing with Apache Flink: fundamentals, implementation, and operation of streaming applications. O\u2019Reilly Media, 2019.","DOI":"10.1007\/978-3-319-77525-8_303"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-222524","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T09:24:06Z","timestamp":1769678646000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-222524"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,30]]},"references-count":16,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/jifs-222524","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,30]]}}}