{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T23:39:43Z","timestamp":1771025983932,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T00:00:00Z","timestamp":1667952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62176088"],"award-info":[{"award-number":["62176088"]}]},{"name":"National Natural Science Foundation of China","award":["212102210412"],"award-info":[{"award-number":["212102210412"]}]},{"name":"National Natural Science Foundation of China","award":["222102210067"],"award-info":[{"award-number":["222102210067"]}]},{"name":"National Natural Science Foundation of China","award":["222102210022"],"award-info":[{"award-number":["222102210022"]}]},{"name":"National Natural Science Foundation of China","award":["2022HYTP013"],"award-info":[{"award-number":["2022HYTP013"]}]},{"name":"Program for Science &amp; Technology Development of Henan Province","award":["62176088"],"award-info":[{"award-number":["62176088"]}]},{"name":"Program for Science &amp; Technology Development of Henan Province","award":["212102210412"],"award-info":[{"award-number":["212102210412"]}]},{"name":"Program for Science &amp; Technology Development of Henan Province","award":["222102210067"],"award-info":[{"award-number":["222102210067"]}]},{"name":"Program for Science &amp; Technology Development of Henan Province","award":["222102210022"],"award-info":[{"award-number":["222102210022"]}]},{"name":"Program for Science &amp; Technology Development of Henan Province","award":["2022HYTP013"],"award-info":[{"award-number":["2022HYTP013"]}]},{"name":"Young Elite Scientist Sponsorship Program by Henan Association for Science and Technology","award":["62176088"],"award-info":[{"award-number":["62176088"]}]},{"name":"Young Elite Scientist Sponsorship Program by Henan Association for Science and Technology","award":["212102210412"],"award-info":[{"award-number":["212102210412"]}]},{"name":"Young Elite Scientist Sponsorship Program by Henan Association for Science and Technology","award":["222102210067"],"award-info":[{"award-number":["222102210067"]}]},{"name":"Young Elite Scientist Sponsorship Program by Henan Association for Science and Technology","award":["222102210022"],"award-info":[{"award-number":["222102210022"]}]},{"name":"Young Elite Scientist Sponsorship Program by Henan Association for Science and Technology","award":["2022HYTP013"],"award-info":[{"award-number":["2022HYTP013"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Unmanned Aerial Vehicles (UAVs) can be employed as low-altitude aerial base stations (UAV-BSs) to provide communication services for ground users (GUs). However, most existing works mainly focus on optimizing coverage and maximizing throughput, without considering the fairness of the GUs in communication services. This may result in certain GUs being underserviced by UAV-BSs in pursuit of maximum throughput. In this paper, we study the problem of UAV-assisted communication with the consideration of user fairness. We first design a Ratio Fair (RF) metric by weighting fairness and throughput to evaluate the tradeoff between fairness and communication efficiency when UAV-BSs serve GUs. The problem is formulated as a mixed-integer non-convex optimization problem based on the RF metric and we propose a UAV-Assisted Fair Communication (UAFC) algorithm based on multi-agent deep reinforcement learning to maximize the fair throughput of the system. The UAFC algorithm comprehensively considers fair throughput, UAV-BSs coverage, and flight status to design a reasonable reward function. In addition, the UAFC algorithm establishes an information sharing mechanism based on gated functions by sharing neural networks, which effectively reduces the distributed decision-making uncertainty of UAV-BSs. To reduce the impact of state dimension imbalance on the convergence of the algorithm, we design a new state decomposing and coupling actor network architecture. Simulation results show that the proposed UAFC algorithm increases fair throughput by 5.62%, 26.57% and fair index by 1.99%, 13.82% compared to the MATD3 and MADDPG algorithms, respectively. Meanwhile, UAFC can also meet energy consumption limitation and network connectivity requirement.<\/jats:p>","DOI":"10.3390\/rs14225662","type":"journal-article","created":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T02:07:48Z","timestamp":1668046068000},"page":"5662","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["UAV-Assisted Fair Communication for Mobile Networks: A Multi-Agent Deep Reinforcement Learning Approach"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7657-6100","authenticated-orcid":false,"given":"Yi","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, Henan University, Zhengzhou 450046, China"},{"name":"International Joint Research Laboratory for Cooperative Vehicular Networks of Henan, Zhengzhou 450046, China"}]},{"given":"Zhanqi","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Henan University, Zhengzhou 450046, China"},{"name":"International Joint Research Laboratory for Cooperative Vehicular Networks of Henan, Zhengzhou 450046, China"}]},{"given":"Huaguang","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Henan University, Zhengzhou 450046, China"},{"name":"International Joint Research Laboratory for Cooperative Vehicular Networks of Henan, Zhengzhou 450046, China"}]},{"given":"Zhangyun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Henan University, Zhengzhou 450046, China"},{"name":"International Joint Research Laboratory for Cooperative Vehicular Networks of Henan, Zhengzhou 450046, China"}]},{"given":"Ning","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Queen\u2019s University, Kingston, ON K7L 3N6, Canada"}]},{"given":"Fuqiang","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Electronic and Information Engineering, Tongji University, Shanghai 201804, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/COMST.2021.3124512","article-title":"A survey on millimeter-wave beamforming enabled UAV communications & networking","volume":"24","author":"Xiao","year":"2022","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4225","DOI":"10.1109\/TVT.2022.3141799","article-title":"Deep reinforcement learning based latency minimization for mobile edge computing with virtualization in maritime UAV communication network","volume":"71","author":"Liu","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2473","DOI":"10.1109\/TCOMM.2021.3049387","article-title":"3D Deployment of multiple UAV-mounted base stations for UAV communications","volume":"69","author":"Zhang","year":"2021","journal-title":"IEEE Trans Commun."},{"key":"ref_4","first-page":"804","article-title":"Joint optimization of relay deployment, channel allocation, and relay assignment for UAVs-aided D2D networks","volume":"28","author":"Zhong","year":"2020","journal-title":"IEEE Trans Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"86","DOI":"10.23919\/JCIN.2020.9055113","article-title":"Multi-antenna UAV data harvesting: Joint trajectory and communication optimization","volume":"5","author":"Zhang","year":"2020","journal-title":"J. Commun. Inf. Netw."},{"key":"ref_6","first-page":"2704","article-title":"Resource and trajectory optimization for secure communications in dual unmanned aerial vehicle mobile edge computing systems","volume":"18","author":"Lu","year":"2022","journal-title":"IEEE Trans Commun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"467","DOI":"10.23919\/JCN.2020.000034","article-title":"Optimal 3D UAV base station placement by considering autonomous coverage hole detection, wireless backhaul and user demand","volume":"22","author":"Shakir","year":"2020","journal-title":"J. Commun. Netw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7371","DOI":"10.1109\/TVT.2022.3166237","article-title":"Joint optimization on trajectory, transmission and time for effective data acquisition in UAV-enabled IoT","volume":"71","author":"Hao","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3097","DOI":"10.1109\/JSAC.2021.3088693","article-title":"UAV-aided wireless power transfer and data collection in rician fading","volume":"39","author":"Liu","year":"2021","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"9098","DOI":"10.1109\/TVT.2019.2927425","article-title":"A near-optimal UAV-aided radio coverage strategy for dense urban areas","volume":"68","author":"Li","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"10320","DOI":"10.1109\/TVT.2020.3004855","article-title":"Energy-saving deployment algorithms of UAV swarm for sustainable wireless coverage","volume":"69","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6650","DOI":"10.1109\/ACCESS.2022.3142529","article-title":"Downlink performance analysis in MIMO UAV-cellular communication with LOS\/NLOS propagation under 3D beamforming","volume":"10","author":"Alkama","year":"2022","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"47","DOI":"10.23919\/JCN.2021.000026","article-title":"Joint deployment and trajectory optimization in UAV-assisted vehicular edge computing networks","volume":"24","author":"Wu","year":"2022","journal-title":"J. Commun. Netw."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6553","DOI":"10.1109\/TWC.2022.3150429","article-title":"Deployment and association of multiple UAVs in UAV-assisted cellular networks with the knowledge of statistical user position","volume":"21","author":"Wang","year":"2022","journal-title":"IEEE Wirel. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3834","DOI":"10.1109\/TCOMM.2022.3170458","article-title":"Resource scheduling based on deep reinforcement learning in UAV assisted emergency communication networks","volume":"70","author":"Wang","year":"2022","journal-title":"IEEE Trans. Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/OJVT.2020.2971594","article-title":"A Reinforcement learning approach for fair user coverage using UAV mounted base stations under energy constraints","volume":"1","author":"Abeywickrama","year":"2020","journal-title":"IEEE Open J. Veh. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"53172","DOI":"10.1109\/ACCESS.2020.2981403","article-title":"Energy Efficient 3-D UAV Control for Persistent Communication Service and Fairness: A Deep Reinforcement Learning Approach","volume":"8","author":"Qi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1109\/JIOT.2020.3008299","article-title":"Mean Field Deep Reinforcement Learning for Fair and Efficient UAV Control","volume":"8","author":"Chen","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8044","DOI":"10.1109\/JIOT.2020.3043210","article-title":"Simultaneous wireless information and power transfer for multiuser UAV-enabled IoT networks","volume":"8","author":"Jeong","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8227","DOI":"10.1109\/TVT.2019.2923214","article-title":"Intelligent trajectory design in UAV-aided communications with reinforcement learning","volume":"68","author":"Yin","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5028","DOI":"10.1109\/TVT.2021.3075860","article-title":"Energy minimization in UAV-aided networks: Actor-critic learning for constrained scheduling optimization","volume":"70","author":"Yuan","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6721","DOI":"10.1109\/TVT.2018.2816244","article-title":"Energy tradeoff in ground-to-UAV communication via trajectory design","volume":"67","author":"Yang","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1236","DOI":"10.1109\/TGCN.2021.3068333","article-title":"Trajectory optimization for UAV emergency communication with limited user equipment energy: A safe-DQN approach","volume":"5","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Green Commun. Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9800","DOI":"10.1109\/JIOT.2020.3020067","article-title":"Drone-cell trajectory planning and resource allocation for highly mobile networks: A hierarchical DRL approach","volume":"8","author":"Shi","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"7634","DOI":"10.1109\/TVT.2020.2986776","article-title":"Resource allocation and trajectory optimization for QoE provisioning in energy-efficient UAV-enabled wireless networks","volume":"69","author":"Zeng","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5785","DOI":"10.1109\/JIOT.2021.3062091","article-title":"Trajectory design and access control for air\u2013ground coordinated communications system with multiagent deep reinforcement learning","volume":"9","author":"Ding","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2357","DOI":"10.1109\/LCOMM.2019.2943461","article-title":"Fair data allocation and trajectory optimization for UAV-assisted mobile edge computing","volume":"23","author":"Diao","year":"2019","journal-title":"IEEE Commun. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"7796","DOI":"10.1109\/TWC.2020.3016024","article-title":"3D UAV trajectory design and frequency band allocation for energy-efficient and fair communication: A deep reinforcement learning approach","volume":"19","author":"Ding","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1109\/JSAC.2018.2864373","article-title":"Energy-efficient UAV control for effective and fair communication coverage: A deep reinforcement learning approach","volume":"36","author":"Liu","year":"2018","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nemer, I.A., Sheltami, T.R., Belhaiza, S., and Mahmoud, A.S. (2022). Energy-efficient UAV movement control for fair communication coverage: A deep reinforcement learning approach. Sensors, 22.","DOI":"10.3390\/s22051919"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4222","DOI":"10.1109\/TCOMM.2022.3170615","article-title":"Fair and energy-efficient coverage optimization for UAV placement problem in the cellular network","volume":"70","author":"Liu","year":"2022","journal-title":"IEEE Trans Commun."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2329","DOI":"10.1109\/TWC.2019.2902559","article-title":"Energy minimization for wireless communication with rotary-wing UAV","volume":"18","author":"Zeng","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1109\/LWC.2019.2916549","article-title":"Energy minimization in internet-of-things system based on rotary-wing UAV","volume":"8","author":"Cheng","year":"2019","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1109\/LWC.2014.2342736","article-title":"Optimal LAP altitude for maximum coverage","volume":"3","author":"Kandeepan","year":"2014","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Al-Hourani, A., Kandeepan, S., and Jamalipour, A. (2014, January 8\u201312). Modeling air-to-ground path loss for low altitude platforms in urban environments. Proceedings of the 2014 IEEE Global Communications Conference, Austin, TX, USA.","DOI":"10.1109\/GLOCOM.2014.7037248"},{"key":"ref_36","unstructured":"Jain, R.K., Chiu, D.M.W., and Hawe, W.R. (1998). A quantitative measure of fairness and discrimination for resource allocation in shared computer systems. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2532","DOI":"10.1109\/TCYB.2014.2309898","article-title":"Hierarchical heuristic search using a gaussian mixture model for UAV coverage planning","volume":"44","author":"Lin","year":"2014","journal-title":"IEEE Trans Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3485","DOI":"10.1109\/TWC.2019.2914203","article-title":"Completion time minimization with path planning for fixed-wing UAV communications","volume":"18","author":"Wang","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"21583","DOI":"10.1109\/JIOT.2022.3185012","article-title":"Joint optimization of deployment and trajectory in UAV and IRS-assisted IoT data collection system","volume":"9","author":"Dong","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3688","DOI":"10.1109\/JSAC.2021.3118352","article-title":"Optimizing federated learning in distributed industrial IoT: A multi-agent approach","volume":"39","author":"Zhang","year":"2021","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1049\/iet-com.2016.0076","article-title":"Opportunistic scheduling for a two-way relay network using markov decision process","volume":"10","author":"Meshgi","year":"2016","journal-title":"IET Commun."},{"key":"ref_42","unstructured":"Papoudakis, G., Christianos, F., Rahman, A., and Albrecht, S.V. (2019). Dealing with non-stationarity in multi-agent deep reinforcement learning. arXiv."},{"key":"ref_43","unstructured":"Ackermann, J., Gabler, V., Osa, T., and Sugiyama, M. (2019). Reducing overestimation bias in multi-agent domains using double centralized critics. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1109\/TNSM.2020.3047765","article-title":"Dynamic controller assignment in software defined internet of vehicles through multi-agent deep reinforcement learning","volume":"18","author":"Yuan","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_45","unstructured":"Pesce, E., and Montana, G. (2018, January 3\u20138). Improving coordination in small-scale multi-agent deep reinforcement learning through memory-driven communication. Proceedings of the Conference and Workshop on Neural Information Processing Systems, Montreal, QC, Cananda."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"112575","DOI":"10.1016\/j.cam.2019.112575","article-title":"Gradient estimation algorithms for the parameter identification of bilinear systems using the auxiliary model","volume":"369","author":"Ding","year":"2020","journal-title":"J. Comput. Appl. Math."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"139670","DOI":"10.1109\/ACCESS.2020.3012756","article-title":"Multi-agent deep reinforcement learning for trajectory design and power allocation in multi-UAV networks","volume":"8","author":"Zhao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"6949","DOI":"10.1109\/TWC.2022.3153316","article-title":"Multi-agent deep reinforcement learning for task offloading in UAV-assisted mobile edge computing","volume":"21","author":"Zhao","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/22\/5662\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:13:25Z","timestamp":1760145205000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/22\/5662"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,9]]},"references-count":48,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["rs14225662"],"URL":"https:\/\/doi.org\/10.3390\/rs14225662","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,9]]}}}