{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T22:26:43Z","timestamp":1782944803104,"version":"3.54.5"},"reference-count":43,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T00:00:00Z","timestamp":1700352000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["SIMULATION"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:p>With the rapid development of cognitive radio technology, multilayer heterogeneous cognitive radio computing platforms with large computing, high-throughput, ultralarge bandwidth and ultralow latency have become a research hotspot. Aiming at the core scheduling problems of multilayer heterogeneous computing platforms, this paper abstracts the bidirectional interconnection topology, node computing capacity, and internode communication capability of the heterogeneous computing platform into an undirected graph model and abstracts the nodes with dependencies, nodes\u2019 computing requirements, and internode communication requirements in streaming tasks into a directed acyclic graph (DAG) model so as to transform the task-scheduling problem into a deployment-scheduling problem from DAG to undirected graph. To efficiently solve this graph model, this paper calculates and forms a component scheduling sequence based on the dependencies of functional components in streaming domain tasks. Then, according to the scheduling sequence, ant colony optimization (ACO) algorithms, such as ant colonies and Q-learning select functional components, deploy components to different computing nodes, calculate the scheduling cost, guide the solution space search of agents, and complete the scenario migration adaptation of the scheduling algorithms to intelligent scheduling of domain tasks. So, this paper proposes the ACO field task intelligent scheduling algorithm based on Q-learning optimization (QACO). QACO uses the Q-table matrix of Q-learning as the initial pheromone of the ant colony algorithm, which not only solves the dimensional disaster of the Q-learning algorithm but also accelerates the convergence speed of the ant colony intelligent scheduling algorithm, reduces the task scheduling length, and further enhances the search ability of the existing scheduling algorithm to solve the spatial set. Based on the randomly generated DAG domain task map, three experimental test scenarios are designed to verify the algorithm performance. The experimental results show that compared with the Q-learning, ACO, and genetic algorithms (GA) algorithms, the proposed algorithm improves the convergence speed of the solution by 72.3%, 63.4%, and 64% on average, reduces the scheduling length by 2.8%, 2.2%, and 0.9% on average, and increases the parallel acceleration ratio by 2.8%, 2.1%, and 0.9% on average, respectively. The practical application value of the algorithm is analyzed through typical radar task simulation, but the load balancing of the algorithm needs to be further improved.<\/jats:p>","DOI":"10.1177\/00375497231208481","type":"journal-article","created":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T23:50:00Z","timestamp":1700437800000},"page":"509-537","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["ACO intelligent task scheduling algorithm based on Q-learning optimization in a multilayer cognitive radio platform"],"prefix":"10.1177","volume":"101","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2979-4345","authenticated-orcid":false,"given":"Zongfu","family":"Xie","sequence":"first","affiliation":[{"name":"University of Information Engineering, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinjin","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Information Engineering, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yawei","family":"Ji","sequence":"additional","affiliation":[{"name":"University of Information Engineering, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wanwan","family":"Li","sequence":"additional","affiliation":[{"name":"Advanced Technology Research Institute of Zhengzhou Xinda, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunxiao","family":"Dong","sequence":"additional","affiliation":[{"name":"University of Information Engineering, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Information Engineering, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2023,11,19]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aeue.2016.04.003"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.5772\/66675"},{"key":"e_1_3_3_4_2","volume-title":"Hardware and software for WiNC2R cognitive radio platform","author":"Jain S","year":"2008","unstructured":"Jain S. Hardware and software for WiNC2R cognitive radio platform. New Brunswick, NJ: Rutgers University, 2008."},{"key":"e_1_3_3_5_2","unstructured":"Dave BP Jha NK Lakshminarayana G. Scheduling-based hardware-software co-synthesis of heterogeneous distributed embedded systems. Google Patents US6112023A 2000."},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2021.3104255"},{"key":"e_1_3_3_7_2","volume-title":"Research on task scheduling algorithm in heterogeneous computing environment","author":"Jiang W","year":"2010","unstructured":"Jiang W. Research on task scheduling algorithm in heterogeneous computing environment. Changsha, China: Hunan University, 2010."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2022.110259"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1177\/00375497221105530"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1177\/00375497231156618."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/00375497221132566"},{"key":"e_1_3_3_12_2","volume-title":"Design and implementation of communication middleware for heterogeneous signal processing platform","author":"Wang T","year":"2019","unstructured":"Wang T. Design and implementation of communication middleware for heterogeneous signal processing platform. Zhengzhou, China: Strategic Support Force Information Engineering University, 2019."},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/1562164.1562186"},{"key":"e_1_3_3_14_2","volume-title":"Research on heterogeneous computing system and task scheduling algorithm based on CPU-GPU-FPGA","author":"Ye S","year":"2019","unstructured":"Ye S. Research on heterogeneous computing system and task scheduling algorithm based on CPU-GPU-FPGA. Xi\u2019an, China: Xidian University, 2019."},{"key":"e_1_3_3_15_2","volume-title":"2013 fifth international conference on ubiquitous and future networks (ICUFN)","author":"Zhang W","unstructured":"Zhang W, Kwak KS, Yin X, et al. Efficient resource scheduling algorithm for the reconfiguration of a cognitive radio terminal. In: 2013 fifth international conference on ubiquitous and future networks (ICUFN), Da Nang, Vietnam, 2\u20135 July 2013. New York: IEEE."},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/2303\/1\/012002"},{"key":"e_1_3_3_17_2","volume-title":"Research on resource scheduling and management in hybrid cloud environment","author":"Jiang H","year":"2017","unstructured":"Jiang H. Research on resource scheduling and management in hybrid cloud environment. Beijing, China: Beijing University of Posts and Telecommunications, 2017."},{"issue":"1","key":"e_1_3_3_18_2","first-page":"31","article-title":"Adaptive task scheduling strategy under heterogeneous spark cluster","volume":"42","author":"Yang Z","year":"2016","unstructured":"Yang Z, Zheng Q, Wang S, et al. Adaptive task scheduling strategy under heterogeneous spark cluster. Comput Eng 2016; 42(1): 31\u201335.","journal-title":"Comput Eng"},{"key":"e_1_3_3_19_2","volume-title":"Research on the reliability task scheduling strategy of the heterogeneous distributed system","author":"Zhu Y","year":"2019","unstructured":"Zhu Y. Research on the reliability task scheduling strategy of the heterogeneous distributed system. Nanjing: Nanjing University of Science and Technology, 2019."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2665971"},{"key":"e_1_3_3_21_2","article-title":"Task scheduling algorithm for improving ant colony algorithm in edge computing environment","author":"Zhang Y","year":"2021","unstructured":"Zhang Y, Gao L, Ding C, et al. Task scheduling algorithm for improving ant colony algorithm in edge computing environment. Computer Technology and Development 2021; 31(9): 86\u201391.","journal-title":"Computer Technology and Development"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TFUZZ.2020.2998174"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2019.106007"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.2478\/fcds-2021-0003"},{"key":"e_1_3_3_25_2","volume-title":"Research on cloud computing task scheduling based on improved differential evolution algorithm","author":"Hu Y","year":"2021","unstructured":"Hu Y. Research on cloud computing task scheduling based on improved differential evolution algorithm. Inner Mongolia, China: Inner Mongolia Agricultural University, 2021."},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2936116"},{"issue":"7","key":"e_1_3_3_27_2","first-page":"1774","article-title":"Task allocation algorithm for mobile crowd sensing based on Q-learning","volume":"24","author":"Hu H","year":"2018","unstructured":"Hu H, Zhang Q, Hu H, et al. Task allocation algorithm for mobile crowd sensing based on Q-learning. Comput Integ Manuf Syst 2018; 24(7): 1774\u20131783.","journal-title":"Comput Integ Manuf Syst"},{"key":"e_1_3_3_28_2","volume-title":"2012 IEEE international conference on pervasive computing and communications workshops","author":"Khan MI","unstructured":"Khan MI, Rinner B (eds). Resource coordination in wireless sensor networks by cooperative reinforcement learning. In: 2012 IEEE international conference on pervasive computing and communications workshops, Lugano, 19\u201323 March 2012. New York: IEEE."},{"issue":"8","key":"e_1_3_3_29_2","first-page":"17","article-title":"Temperature-aware multi-core task scheduling based on reinforcement learning","volume":"32","author":"Yang S","year":"2021","unstructured":"Yang S, Wang Y, Liu W, et al. Temperature-aware multi-core task scheduling based on reinforcement learning. J Softw 2021; 32(8): 17.","journal-title":"J Softw"},{"issue":"2","key":"e_1_3_3_30_2","first-page":"225","article-title":"Q-learning and ACO hybridisation for real-time scheduling on heterogeneous distributed architectures","volume":"20","author":"Youssfi M","year":"2019","unstructured":"Youssfi M, Bouattane O, Hajoui Y, et al. Q-learning and ACO hybridisation for real-time scheduling on heterogeneous distributed architectures. Int J Comput Sci Eng 2019; 20(2): 225.","journal-title":"Int J Comput Sci Eng"},{"issue":"005","key":"e_1_3_3_31_2","first-page":"21","article-title":"Componentized design and implementation of demodulator based on heterogeneous signal processing platform","volume":"032","author":"Ji L","year":"2019","unstructured":"Ji L, Huang Y, Wang Y. Componentized design and implementation of demodulator based on heterogeneous signal processing platform. Electr Sci Tech 2019; 032(005): 21\u201327.","journal-title":"Electr Sci Tech"},{"key":"e_1_3_3_32_2","volume-title":"Design of modular radar modeling and simulation platform","author":"Sun H","unstructured":"Sun H. Design of modular radar modeling and simulation platform. Xi\u2019an: Xidian University."},{"issue":"11","key":"e_1_3_3_33_2","first-page":"5","article-title":"Modular modeling and simulation of radar system based on C~ (++) language","volume":"28","author":"Zhang X","year":"2020","unstructured":"Zhang X, Li X. Modular modeling and simulation of radar system based on C~ (++) language. Comput Meas Control 2020; 28(11): 5.","journal-title":"Comput Meas Control"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/71.762819"},{"key":"e_1_3_3_35_2","first-page":"137","article-title":"Ant colony optimization algorithm for multi-objective satellite data transmission scheduling","volume":"48","author":"Bing S","year":"2012","unstructured":"Bing S. Ant colony optimization algorithm for multi-objective satellite data transmission scheduling. Comput Eng Appl 2012; 48: 137\u2013142.","journal-title":"Comput Eng Appl"},{"key":"e_1_3_3_36_2","volume-title":"Parallel problem solving from nature 2, PPSN-II","author":"Colorni A","unstructured":"Colorni A, Dorigo M, Maniezzo V, et al. An investigation of some properties of an \u201cAnt algorithm.\u201d In: Parallel problem solving from nature 2, PPSN-II, Brussels, 28\u201330 September 1992."},{"key":"e_1_3_3_37_2","volume-title":"Adaptive particle swarm optimization algorithm and its application","author":"Shen X","year":"2015","unstructured":"Shen X. Adaptive particle swarm optimization algorithm and its application. Beijing, China: Tsinghua University Press, 2015."},{"issue":"8","key":"e_1_3_3_38_2","first-page":"767","article-title":"Ant colony optimization swarm intelligence","volume":"49","author":"Dorigo ME","year":"2004","unstructured":"Dorigo ME (ed.) Ant colony optimization swarm intelligence. 4th International Workshop, ANTS 2004, Proceedings[J]. Lect Notes Comput Sci, 2004; 49(8): 767\u2013771.","journal-title":"Lect Notes Comput Sci"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2020.03.051"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"e_1_3_3_41_2","volume-title":"Foundations of Machine Learning","author":"Mohri M","year":"2018","unstructured":"Mohri M, Rostamizadeh A, Talwalkar A. Foundations of Machine Learning. Cambridge, MA: MIT Press, 2018."},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.1998.712192"},{"key":"e_1_3_3_43_2","unstructured":"Mnih V Kavukcuoglu K Silver D et al. Playing Atari with deep reinforcement learning. Computer Science 2013 https:\/\/www.cs.toronto.edu\/~vmnih\/docs\/dqn.pdf"},{"key":"e_1_3_3_44_2","volume-title":"2016 IEEE international conference on real-time computing and robotics (RCAR)","author":"Tai L","unstructured":"Tai L, Liu M (eds). A robot exploration strategy based on Q-learning network. In: 2016 IEEE international conference on real-time computing and robotics (RCAR), Angkor Wat, 6\u201310 June 2016. New York: IEEE."}],"container-title":["SIMULATION"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00375497231208481","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/00375497231208481","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00375497231208481","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T11:33:41Z","timestamp":1777635221000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/00375497231208481"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,19]]},"references-count":43,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["10.1177\/00375497231208481"],"URL":"https:\/\/doi.org\/10.1177\/00375497231208481","relation":{},"ISSN":["0037-5497","1741-3133"],"issn-type":[{"value":"0037-5497","type":"print"},{"value":"1741-3133","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,19]]}}}