{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T13:42:38Z","timestamp":1761745358331,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T00:00:00Z","timestamp":1611100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Structureless communications such as Device-to-Device (D2D) relaying are undeniably of paramount importance to improving the performance of today\u2019s mobile networks. Such a communication paradigm requires implementing a certain level of intelligence at device level, allowing to interact with the environment and select proper decisions. However, decentralizing decision making sometimes may induce some paradoxical outcomes resulting, therefore, in a performance drop, which sustains the design of self-organizing, yet efficient systems. Here, each device decides either to directly connect to the eNodeB or get access via another device through a D2D link. Given the set of active devices and the channel model, we derive the outage probability for both cellular link and D2D link, and compute the system throughput. We capture the device behavior using a biform game perspective. In the first part of this article, we analyze the pure and mixed Nash equilibria of the induced game where each device seeks to maximize its own throughput. Our framework allows us to analyse and predict the system\u2019s performance. The second part of this article is devoted to implement two Reinforcement Learning (RL) algorithms enabling devices to self-organize themselves and learn their equilibrium pure\/mixed strategies, in a fully distributed fashion. Simulation results show that offloading the network by means of D2D-relaying improves per device throughput. Moreover, detailed analysis on how the network parameters affect the global performance is provided.<\/jats:p>","DOI":"10.3390\/s21030702","type":"journal-article","created":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T00:53:41Z","timestamp":1611190421000},"page":"702","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["D2D Mobile Relaying Meets NOMA\u2014Part I: A Biform Game Analysis"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1681-993X","authenticated-orcid":false,"given":"Safaa","family":"Driouech","sequence":"first","affiliation":[{"name":"NEST Research Group, LRI Lab., ENSEM, Hassan II University of Casablanca, Casablanca 20000, Morocco"},{"name":"Laoratoire de Reacherche en Informatique, Sorbonne Universit\u00e9, CNRS, LIP6, F-75005 Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9946-5761","authenticated-orcid":false,"given":"Essaid","family":"Sabir","sequence":"additional","affiliation":[{"name":"NEST Research Group, LRI Lab., ENSEM, Hassan II University of Casablanca, Casablanca 20000, Morocco"},{"name":"Department of Computer Science, University of Quebec at Montreal, Montreal, QC H2L 2C4, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0055-7867","authenticated-orcid":false,"given":"Mounir","family":"Ghogho","sequence":"additional","affiliation":[{"name":"TICLab, International University of Rabat, Rabat 11100, Morocco"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6630-5083","authenticated-orcid":false,"given":"El-Mehdi","family":"Amhoud","sequence":"additional","affiliation":[{"name":"School of Computer Science, Mohammed VI Polytechnic University, Ben Guerir 43150, Morocco"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/MNET.2018.1700232","article-title":"5G Radio Network Design for Ultra-Reliable Low-Latency Communication","volume":"32","author":"Sachs","year":"2018","journal-title":"IEEE Netw."},{"key":"ref_2","unstructured":"Aazhang, B., Ahokangas, P., Alves, H., Alouini, M.S., Beek, J., Benn, H., Bennis, M., Belfiore, J., Strinati, E., and Chen, F. (2019). Key Drivers and Research Challenges for 6G Ubiquitous Wireless Intelligence (White Paper), 6G Flagship, University of Oulu."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Alsharif, M.H., Kelechi, A.H., Albreem, M.A., Chaudhry, S.A., Zia, M.S., and Kim, S. (2020). Sixth Generation (6G) Wireless Networks: Vision, Research Activities, Challenges and Potential Solutions. Symmetry, 12.","DOI":"10.3390\/sym12040676"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1109\/MNET.001.1900287","article-title":"A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems","volume":"34","author":"Saad","year":"2020","journal-title":"IEEE Netw."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1038\/s41928-019-0355-6","article-title":"What should 6G be?","volume":"3","author":"Dang","year":"2019","journal-title":"Nat. Electron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/MWC.001.1900488","article-title":"A Speculative Study on 6G","volume":"27","author":"Tariq","year":"2020","journal-title":"IEEE Wirel. Commun."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Driouech, S., and Sabir, E. (2018, January 26\u201328). Turning Competition Onto Cooperation in D2D Communications: A Quitting Game Perspective. Proceedings of the 2018 25th International Conference on Telecommunications (ICT), Saint Malo, France.","DOI":"10.1109\/ICT.2018.8464861"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Adnan, M.H., and Ahmad Zukarnain, Z. (2020). Device-To-Device Communication in 5G Environment: Issues, Solutions, and Challenges. Symmetry, 12.","DOI":"10.3390\/sym12111762"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Habachi, O., Meghdadi, V., Sabir, E., and Cances, J.P. (2020). Combined Beam Alignment and Power Allocation for NOMA-Empowered mmWave Communications, Springer International Publishing. Ubiquitous, Networking.","DOI":"10.1007\/978-3-030-58008-7"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Do, D.T., Nguyen, M.S.V., and Lee, B.M. (2019). Outage Performance Improvement by Selected User in D2D Transmission and Implementation of Cognitive Radio-Assisted NOMA. Sensors, 19.","DOI":"10.3390\/s19224840"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4312","DOI":"10.1109\/TWC.2019.2923172","article-title":"Resource Optimization in Full Duplex Non-Orthogonal Multiple Access Systems","volume":"18","author":"Singh","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Driouech, S., Sabir, E., Ghogho, M., and Amhoud, E.M. (2021). D2D Mobile Relaying Meets NOMA \u2013Part II: A Reinforcement Learning Perspective. Sensors, in press.","DOI":"10.3390\/s21051755"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pradhan, A., Basu, S., Sarkar, S., Mitra, S., and Roy, S.D. (2018, January 3\u20137). Implementation of relay hopper model for reliable communication of IoT devices in LTE environment through D2D link. Proceedings of the 2018 10th International Conference on Communication Systems & Networks (COMSNETS), Bangalore, India.","DOI":"10.1109\/COMSNETS.2018.8328275"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1109\/TWC.2015.2489651","article-title":"Heterogeneous cellular network with energy harvesting-based D2D communication","volume":"15","author":"Yang","year":"2015","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Afzal, A., Feki, A., Debbah, M., Zaidi, S.A., Ghogho, M., and McLernon, D. (2017, January 15\u201319). Leveraging D2D communication to maximize the spectral efficiency of massive MIMO systems. Proceedings of the 2017 15th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt), Paris, France.","DOI":"10.23919\/WIOPT.2017.7959929"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.cor.2004.06.005","article-title":"A survey on networking games in telecommunications","volume":"33","author":"Altman","year":"2006","journal-title":"Comput. Oper. Res."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gu, W., and Zhu, Q. (2019). Stackelberg Game Based Social-Aware Resource Allocation for NOMA Enhanced D2D Communications. Electronics, 8.","DOI":"10.3390\/electronics8111360"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Driouech, S., Sabir, E., Bennis, M., and Elbiaze, H. (2018, January 9\u201313). A Quitting Game Framework for Self-Organized D2D Mobile Relaying in 5G. Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM), Abu Dhabi, UAE.","DOI":"10.1109\/GLOCOM.2018.8647479"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/TETC.2014.2384372","article-title":"A game-theoretic resource allocation approach for intercell device-to-device communications in cellular networks","volume":"4","author":"Huang","year":"2014","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1109\/TWC.2016.2641959","article-title":"Distributed interference and energy-aware power control for ultra-dense D2D networks: A mean field game","volume":"16","author":"Yang","year":"2016","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"8461","DOI":"10.1109\/TVT.2015.2511924","article-title":"A stackelberg game model for overlay D2D transmission with heterogeneous rate requirements","volume":"65","author":"Lyu","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TWC.2014.2325552","article-title":"Coalitional games for resource allocation in the device-to-device uplink underlaying cellular networks","volume":"13","author":"Li","year":"2014","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/CJECE.2015.2469724","article-title":"Cooperative energy-efficient content dissemination using coalition formation game over device-to-device communications","volume":"39","author":"Zhang","year":"2016","journal-title":"Can. J. Electr. Comput. Eng."},{"key":"ref_24","first-page":"4271","article-title":"Protocol design and game theoretic solutions for device-to-device radio resource allocation","volume":"66","author":"Su","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Baniasadi, M., Maham, B., and Kebriaei, H. (2016, January 27\u201328). Power control for D2D underlay cellular communication: Game theory approach. Proceedings of the 2016 8th International Symposium on Telecommunications (IST), Tehran, Iran.","DOI":"10.1109\/ISTEL.2016.7881832"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Driouech, S., Sabir, E., and Tembine, H. (2017, January 1\u20134). Self-organized device-to-device communications as a non-cooperative quitting game. Proceedings of the 2017 International Conference on Wireless Networks and Mobile Communications (WINCOM), Rabat, Morocco.","DOI":"10.1109\/WINCOM.2017.8238170"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1109\/SURV.2012.021312.00116","article-title":"A survey of self organisation in future cellular networks","volume":"15","author":"Aliu","year":"2012","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4316","DOI":"10.1109\/TWC.2009.081386","article-title":"Power control in two-tier femtocell networks","volume":"8","author":"Chandrasekhar","year":"2009","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2524","DOI":"10.3390\/e15072524","article-title":"A decentralized heuristic approach towards resource allocation in femtocell networks","volume":"15","author":"Shahid","year":"2013","journal-title":"Entropy"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1109\/ACCESS.2017.2651578","article-title":"Self-organized energy-efficient cross-layer optimization for device to device communication in heterogeneous cellular networks","volume":"5","author":"Shahid","year":"2017","journal-title":"IEEE Access"},{"key":"ref_31","unstructured":"Abera, T., Brasser, F., Gunn, L.J., Koisser, D., and Sadeghi, A.R. (2019). SADAN: Scalable Adversary Detection in Autonomous Networks. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"14318","DOI":"10.1109\/ACCESS.2018.2796247","article-title":"Multi-hop relay-aided underlay D2D communications for improving cellular coverage quality","volume":"6","author":"Gui","year":"2018","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5209","DOI":"10.1109\/ACCESS.2016.2577020","article-title":"Mode selection and resource allocation in device-to-device communications with user arrivals and departures","volume":"4","author":"Lei","year":"2016","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"60045","DOI":"10.1109\/ACCESS.2018.2874815","article-title":"A distributed mode selection approach based on evolutionary game for device-to-device communications","volume":"6","author":"Li","year":"2018","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"95251","DOI":"10.1109\/ACCESS.2020.2995833","article-title":"Energy Efficiency Optimization and Dynamic Mode Selection Algorithms for D2D Communication Under HetNet in Downlink Reuse","volume":"8","author":"Algedir","year":"2020","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"87369","DOI":"10.1109\/ACCESS.2019.2924488","article-title":"Delay-Aware Energy-Efficient Joint Power Control and Mode Selection in Device-to-Device Communications for FREEDM Systems in Smart Grids","volume":"7","author":"Asuhaimi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4720","DOI":"10.1109\/ACCESS.2016.2603237","article-title":"Device-to-device communications in unlicensed spectrum: Mode selection and resource allocation","volume":"4","author":"Liu","year":"2016","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"179929","DOI":"10.1109\/ACCESS.2019.2956111","article-title":"Mode selection and resource allocation algorithm in energy-harvesting D2D heterogeneous network","volume":"7","author":"Yan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"25263","DOI":"10.1109\/ACCESS.2019.2900422","article-title":"D2D communication mode selection and resource optimization algorithm with optimal throughput in 5G network","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"64350","DOI":"10.1109\/ACCESS.2018.2871223","article-title":"Joint mode selection and resource allocation for scalable video multicast in hybrid cellular and D2D network","volume":"6","author":"Li","year":"2018","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1109\/COMST.2016.2621116","article-title":"Power-domain non-orthogonal multiple access (NOMA) in 5G systems: Potentials and challenges","volume":"19","author":"Islam","year":"2016","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2181","DOI":"10.1109\/JSAC.2017.2725519","article-title":"A survey on non-orthogonal multiple access for 5G networks: Research challenges and future trends","volume":"35","author":"Ding","year":"2017","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_43","unstructured":"Tabassum, H., Ali, M.S., Hossain, E., Hossain, M., and Kim, D.I. (2016). Non-orthogonal multiple access (NOMA) in cellular uplink and downlink: Challenges and enabling techniques. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1287\/mnsc.1060.0591","article-title":"Biform games","volume":"53","author":"Brandenburger","year":"2007","journal-title":"Manag. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.ijpe.2012.10.021","article-title":"Biform game: Reflection as a stochastic programming problem","volume":"142","author":"Summerfield","year":"2013","journal-title":"Int. J. Prod. Econ."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/702\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:13:18Z","timestamp":1760159598000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/702"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,20]]},"references-count":45,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21030702"],"URL":"https:\/\/doi.org\/10.3390\/s21030702","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,1,20]]}}}