{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T22:13:15Z","timestamp":1774390395067,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T00:00:00Z","timestamp":1681948800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T00:00:00Z","timestamp":1681948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EURASIP J. Adv. Signal Process."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper investigates a non-orthogonal multiple access (NOMA)-aided mobile edge computing (MEC) network with multiple sources and one computing access point (CAP), in which NOMA technology is applied to transmit multi-source data streams to CAP for computing. To measure the performance of the considered NOMA-aided MEC network, we first design the system cost as a linear weighting function of energy consumption and delay under the NOMA-aided MEC network. Moreover, we propose a deep Q network (DQN)-based offloading strategy to minimize the system cost by jointly optimizing the offloading ratio and transmission power allocation. Finally, we design experiments to demonstrate the effectiveness of the proposed strategy. Specifically, the designed strategy can decrease the system cost by about 15% compared with local computing when the number of sources is 5.<\/jats:p>","DOI":"10.1186\/s13634-023-01005-2","type":"journal-article","created":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T17:27:27Z","timestamp":1682011647000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["DQN-based resource allocation for NOMA-MEC-aided multi-source data stream"],"prefix":"10.1186","volume":"2023","author":[{"given":"Jing","family":"Ling","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2787-6582","authenticated-orcid":false,"given":"Junjuan","family":"Xia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fusheng","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chongzhi","family":"Gao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shiwei","family":"Lai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Venki","family":"Balasubramanian","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,4,20]]},"reference":[{"issue":"1","key":"1005_CR1","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1109\/TCOMM.2019.2949994","volume":"68","author":"W Wu","year":"2020","unstructured":"W. Wu, F. Zhou, R.Q. Hu, B. Wang, Energy-efficient resource allocation for secure noma-enabled mobile edge computing networks. IEEE Trans. Commun. 68(1), 493\u2013505 (2020)","journal-title":"IEEE Trans. Commun."},{"issue":"99","key":"1005_CR2","first-page":"1","volume":"PP","author":"L Chen","year":"2022","unstructured":"L. Chen, X. Lei, Relay-assisted federated edge learning: performance analysis and system optimization. IEEE Trans. Commun. PP(99), 1\u201312 (2022)","journal-title":"IEEE Trans. Commun."},{"issue":"99","key":"1005_CR3","first-page":"1","volume":"PP","author":"R Zhao","year":"2022","unstructured":"R. Zhao, M. Tang, Profit maximization in cache-aided intelligent computing networks. Phys. Commun. PP(99), 1\u201310 (2022)","journal-title":"Phys. Commun."},{"key":"1005_CR4","doi-asserted-by":"crossref","unstructured":"J. Ren, X. Lei, Z. Peng, X. Tang, O.A. Dobre, Ris-assisted cooperative NOMA with SWIPT. IEEE Wirel. Commun. Lett. (2023)","DOI":"10.1109\/LWC.2022.3229843"},{"issue":"5","key":"1005_CR5","doi-asserted-by":"publisher","first-page":"3391","DOI":"10.1109\/TII.2020.2987421","volume":"17","author":"X Liu","year":"2021","unstructured":"X. Liu, C. Sun, M. Zhou, C. Wu, B. Peng, P. Li, Reinforcement learning-based multislot double-threshold spectrum sensing with Bayesian fusion for industrial big spectrum data. IEEE Trans. Ind. Inform. 17(5), 3391\u20133400 (2021)","journal-title":"IEEE Trans. Ind. Inform."},{"issue":"5","key":"1005_CR6","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/MNET.001.2100128","volume":"35","author":"Z Na","year":"2021","unstructured":"Z. Na, B. Li, X. Liu, J. Wan, M. Zhang, Y. Liu, B. Mao, Uav-based wide-area internet of things: An integrated deployment architecture. IEEE Netw. 35(5), 122\u2013128 (2021)","journal-title":"IEEE Netw."},{"issue":"99","key":"1005_CR7","first-page":"1","volume":"PP","author":"W Zhou","year":"2023","unstructured":"W. Zhou, F. Zhou, Profit maximization for cache-enabled vehicular mobile edge computing networks. IEEE Trans. Veh. Technol. PP(99), 1\u20136 (2023)","journal-title":"IEEE Trans. Veh. Technol."},{"key":"1005_CR8","doi-asserted-by":"crossref","unstructured":"W. Xu, Z. Yang, D.W.K. Ng, M. Levorato, Y.C. Eldar, M. Debbah, Edge learning for B5G networks with distributed signal processing: Semantic communication, edge computing, and wireless sensing. IEEE J. Sel. Top. Signal Process. arXiv:2206.00422 (2023)","DOI":"10.1109\/JSTSP.2023.3239189"},{"key":"1005_CR9","doi-asserted-by":"crossref","unstructured":"X. Zheng, C. Gao, Intelligent computing for WPT-MEC aided multi-source data stream. to appear in EURASIP J. Adv. Signal Process. 2023(1) (2023)","DOI":"10.1186\/s13634-023-01006-1"},{"issue":"3","key":"1005_CR10","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/TNSE.2022.3154758","volume":"9","author":"S Tang","year":"2022","unstructured":"S. Tang, L. Chen, Computational intelligence and deep learning for next-generation edge-enabled industrial IoT. IEEE Trans. Netw. Sci. Eng. 9(3), 105\u2013117 (2022)","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"issue":"4","key":"1005_CR11","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1109\/MWC.103.2100286","volume":"29","author":"W Wu","year":"2022","unstructured":"W. Wu, F. Zhou, B. Wang, Q. Wu, C. Dong, R.Q. Hu, Unmanned aerial vehicle swarm-enabled edge computing: potentials, promising technologies, and challenges. IEEE Wirel. Commun. 29(4), 78\u201385 (2022)","journal-title":"IEEE Wirel. Commun."},{"issue":"99","key":"1005_CR12","first-page":"1","volume":"PP","author":"W Zhou","year":"2023","unstructured":"W. Zhou, X. Lei, Priority-aware resource scheduling for uav-mounted mobile edge computing networks. IEEE Trans. Veh. Technol. PP(99), 1\u20136 (2023)","journal-title":"IEEE Trans. Veh. Technol."},{"key":"1005_CR13","doi-asserted-by":"publisher","DOI":"10.1016\/j.phycom.2022.101896","volume":"55","author":"L Zhang","year":"2022","unstructured":"L. Zhang, C. Gao, Deep reinforcement learning based IRS-assisted mobile edge computing under physical-layer security. Phys. Commun. 55, 101896 (2022)","journal-title":"Phys. Commun."},{"issue":"1","key":"1005_CR14","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.comcom.2022.07.037","volume":"194","author":"L Chen","year":"2022","unstructured":"L. Chen, Physical-layer security on mobile edge computing for emerging cyber physical systems. Comput. Commun. 194(1), 180\u2013188 (2022)","journal-title":"Comput. Commun."},{"key":"1005_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.phycom.2022.101867","volume":"55","author":"Y Wu","year":"2022","unstructured":"Y. Wu, C. Gao, Task offloading for vehicular edge computing with imperfect CSI: a deep reinforcement approach. Phys. Commun. 55, 101867 (2022)","journal-title":"Phys. Commun."},{"issue":"4","key":"1005_CR16","doi-asserted-by":"publisher","first-page":"2389","DOI":"10.1007\/s10586-021-03414-0","volume":"25","author":"W Zhou","year":"2022","unstructured":"W. Zhou, L. Chen, S. Tang, L. Lai, J. Xia, F. Zhou, L. Fan, Offloading strategy with PSO for mobile edge computing based on cache mechanism. Clust. Comput. 25(4), 2389\u20132401 (2022)","journal-title":"Clust. Comput."},{"key":"1005_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.phycom.2022.101905","volume":"55","author":"R Zhao","year":"2022","unstructured":"R. Zhao, C. Fan, J. Ou, D. Fan, J. Ou, M. Tang, Impact of direct links on intelligent reflect surface-aided mec networks. Phys. Commun. 55, 101905 (2022)","journal-title":"Phys. Commun."},{"issue":"12","key":"1005_CR18","doi-asserted-by":"publisher","first-page":"1875","DOI":"10.1109\/LSP.2018.2876019","volume":"25","author":"Z Ding","year":"2018","unstructured":"Z. Ding, D.W.K. Ng, R. Schober, H.V. Poor, Delay minimization for NOMA-MEC offloading. IEEE Signal Process. Lett. 25(12), 1875\u20131879 (2018)","journal-title":"IEEE Signal Process. Lett."},{"issue":"5","key":"1005_CR19","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1109\/MWC.001.1900493","volume":"27","author":"X Liu","year":"2020","unstructured":"X. Liu, Q. Sun, W. Lu, C. Wu, H. Ding, Big-data-based intelligent spectrum sensing for heterogeneous spectrum communications in 5g. IEEE Wirel. Commun. 27(5), 67\u201373 (2020)","journal-title":"IEEE Wirel. Commun."},{"issue":"20","key":"1005_CR20","doi-asserted-by":"publisher","first-page":"15041","DOI":"10.1109\/JIOT.2020.3004432","volume":"8","author":"Z Na","year":"2021","unstructured":"Z. Na, Y. Liu, J. Shi, C. Liu, Z. Gao, Uav-supported clustered NOMA for 6g-enabled internet of things: Trajectory planning and resource allocation. IEEE Internet Things J. 8(20), 15041\u201315048 (2021)","journal-title":"IEEE Internet Things J."},{"key":"1005_CR21","doi-asserted-by":"publisher","first-page":"112762","DOI":"10.1109\/ACCESS.2020.3002895","volume":"8","author":"S Li","year":"2020","unstructured":"S. Li, B. Li, W. Zhao, Joint optimization of caching and computation in multi-server NOMA-MEC system via reinforcement learning. IEEE Access 8, 112762\u2013112771 (2020)","journal-title":"IEEE Access"},{"issue":"4","key":"1005_CR22","doi-asserted-by":"publisher","first-page":"2802","DOI":"10.1109\/JIOT.2020.3020542","volume":"8","author":"C Li","year":"2021","unstructured":"C. Li, H. Wang, R. Song, Intelligent offloading for noma-assisted MEC via dual connectivity. IEEE Internet Things J. 8(4), 2802\u20132813 (2021)","journal-title":"IEEE Internet Things J."},{"issue":"5","key":"1005_CR23","doi-asserted-by":"publisher","first-page":"3364","DOI":"10.1109\/TCOMM.2022.3159703","volume":"70","author":"W Lu","year":"2022","unstructured":"W. Lu, Y. Ding, Y. Gao, Y. Chen, N. Zhao, Z. Ding, A. Nallanathan, Secure noma-based UAV-MEC network towards a flying eavesdropper. IEEE Trans. Commun. 70(5), 3364\u20133376 (2022)","journal-title":"IEEE Trans. Commun."},{"issue":"13","key":"1005_CR24","doi-asserted-by":"publisher","first-page":"10731","DOI":"10.1109\/JIOT.2020.3048937","volume":"8","author":"L Shi","year":"2021","unstructured":"L. Shi, Y. Ye, X. Chu, G. Lu, Computation energy efficiency maximization for a noma-based WPT-MEC network. IEEE Internet Things J. 8(13), 10731\u201310744 (2021)","journal-title":"IEEE Internet Things J."},{"issue":"20","key":"1005_CR25","doi-asserted-by":"publisher","first-page":"15049","DOI":"10.1109\/JIOT.2020.3007017","volume":"8","author":"X Liu","year":"2021","unstructured":"X. Liu, H. Ding, S. Hu, Uplink resource allocation for noma-based hybrid spectrum access in 6g-enabled cognitive internet of things. IEEE Internet Things J. 8(20), 15049\u201315058 (2021)","journal-title":"IEEE Internet Things J."},{"issue":"6","key":"1005_CR26","doi-asserted-by":"publisher","first-page":"4244","DOI":"10.1109\/TII.2021.3113949","volume":"18","author":"X Liu","year":"2022","unstructured":"X. Liu, C. Sun, W. Yu, M. Zhou, Reinforcement-learning-based dynamic spectrum access for software-defined cognitive industrial internet of things. IEEE Trans. Ind. Inform. 18(6), 4244\u20134253 (2022)","journal-title":"IEEE Trans. Ind. Inform."},{"key":"1005_CR27","doi-asserted-by":"publisher","first-page":"79877","DOI":"10.1109\/ACCESS.2019.2922362","volume":"7","author":"B Li","year":"2019","unstructured":"B. Li, Z. Fei, J. Shen, X. Jiang, X. Zhong, Dynamic offloading for energy harvesting mobile edge computing: architecture, case studies, and future directions. IEEE Access 7, 79877\u201379886 (2019)","journal-title":"IEEE Access"},{"issue":"99","key":"1005_CR28","first-page":"1","volume":"PP","author":"L He","year":"2023","unstructured":"L. He, X. Tang, Learning-based MIMO detection with dynamic spatial modulation. IEEE Trans. Cogn. Commun. Netw PP(99), 1\u201312 (2023)","journal-title":"IEEE Trans. Cogn. Commun. Netw"},{"issue":"99","key":"1005_CR29","first-page":"1","volume":"PP","author":"L Zhang","year":"2023","unstructured":"L. Zhang, S. Tang, Scoring Aided Federated Learning on Long-tailed Data for Wireless IoMT based Healthcare System. IEEE J. Biomed. Health Inform. PP(99), 1\u201312 (2023)","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"1005_CR30","doi-asserted-by":"crossref","unstructured":"J. Li, S. Dang, Y. Huang, Composite multiple-mode orthogonal frequency division multiplexing with index modulation. IEEE Trans. Wirel. Commun. (2023)","DOI":"10.1109\/TWC.2022.3220752"},{"issue":"3","key":"1005_CR31","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1109\/JSAC.2023.3234693","volume":"41","author":"S Tang","year":"2023","unstructured":"S. Tang, X. Lei, Collaborative cache-aided relaying networks: performance evaluation and system optimization. IEEE J. Sel. Areas Commun. 41(3), 706\u2013719 (2023)","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"1005_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.phycom.2022.101869","volume":"55","author":"J Lu","year":"2022","unstructured":"J. Lu, M. Tang, Performance analysis for IRS-assisted MEC networks with unit selection. Phys. Commun. 55, 101869 (2022)","journal-title":"Phys. Commun."},{"issue":"3","key":"1005_CR33","doi-asserted-by":"publisher","first-page":"2922","DOI":"10.1109\/TVT.2021.3058995","volume":"70","author":"C Li","year":"2021","unstructured":"C. Li, J. Xia, F. Liu, D. Li, L. Fan, G.K. Karagiannidis, A. Nallanathan, Dynamic offloading for multiuser muti-cap MEC networks: A deep reinforcement learning approach. IEEE Trans. Veh. Technol. 70(3), 2922\u20132927 (2021)","journal-title":"IEEE Trans. Veh. Technol."},{"key":"1005_CR34","doi-asserted-by":"crossref","unstructured":"Y. Wu, C. Gao, Intelligent resource allocation scheme for cloud-edge-end framework aided multi-source data stream. EURASIP J. Adv. Signal Process. 2023(1) (2023, to appear)","DOI":"10.1186\/s13634-023-01018-x"},{"issue":"1","key":"1005_CR35","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1109\/LCOMM.2020.3024256","volume":"25","author":"W Zhou","year":"2021","unstructured":"W. Zhou, C. Li, M. Hua, Worst-case robust MIMO transmission based on subgradient projection. IEEE Commun. Lett. 25(1), 239\u2013243 (2021)","journal-title":"IEEE Commun. Lett."},{"key":"1005_CR36","doi-asserted-by":"crossref","unstructured":"J. Li, S. Dang, M. Wen, Index modulation multiple access for 6G communications: principles, applications, and challenges. IEEE Netw. (2023)","DOI":"10.1109\/MNET.002.2200433"},{"issue":"5","key":"1005_CR37","first-page":"211","volume":"71","author":"S Tang","year":"2022","unstructured":"S. Tang, Dilated convolution based CSI feedback compression for massive MIMO systems. IEEE Trans. Veh. Technol. 71(5), 211\u2013216 (2022)","journal-title":"IEEE Trans. Veh. Technol."}],"container-title":["EURASIP Journal on Advances in Signal Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13634-023-01005-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13634-023-01005-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13634-023-01005-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T04:02:10Z","timestamp":1702267330000},"score":1,"resource":{"primary":{"URL":"https:\/\/asp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13634-023-01005-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,20]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1005"],"URL":"https:\/\/doi.org\/10.1186\/s13634-023-01005-2","relation":{},"ISSN":["1687-6180"],"issn-type":[{"value":"1687-6180","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,20]]},"assertion":[{"value":"3 January 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"44"}}