{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T10:36:48Z","timestamp":1780051008924,"version":"3.53.1"},"reference-count":48,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T00:00:00Z","timestamp":1675641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"University of Antwerp and Flanders Make Strategic Research Center","award":["AssistedDfA"],"award-info":[{"award-number":["AssistedDfA"]}]},{"name":"University of Antwerp and Flanders Make Strategic Research Center","award":["PACo"],"award-info":[{"award-number":["PACo"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, the development of smart cities has accelerated. There are several issues to handle in smart cities, one of the most important of which is efficient resource allocation. For the modeling of smart cities, multi-agent systems (MASs) can be used. In this paper, an efficient approach is proposed for resource allocation in smart cities based on the multi-agent credit assignment problem (MCA) and bankruptcy game. To this end, the resource allocation problem is mapped to MCA and the bankruptcy game. To solve this problem, first, a task start threshold (TST) constraint is introduced. The MCA turns into a bankruptcy problem upon introducing such a constraint. Therefore, based on the concept of bankruptcy, three methods of TS-Only, TS + MAS, and TS + ExAg are presented to solve the MCA. In addition, this work introduces a multi-score problem (MSP) in which a different reward is offered for solving each part of the problem, and we used it in our experiments to examine the proposed methods. The proposed approach is evaluated based on the learning rate, confidence, expertness, efficiency, certainty, and correctness parameters. The results reveal the better performance of the proposed approach compared to the existing methods in five parameters.<\/jats:p>","DOI":"10.3390\/s23041804","type":"journal-article","created":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T02:29:23Z","timestamp":1675650563000},"page":"1804","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Multi-Agent Credit Assignment and Bankruptcy Game for Improving Resource Allocation in Smart Cities"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0722-7596","authenticated-orcid":false,"given":"Hossein","family":"Yarahmadi","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran 1477893855, Iran"},{"name":"Department of Computer Science, University of Antwerp, 2020 Antwerp, Belgium"},{"name":"Flanders Make Strategic Research Center, 3001 Leuven, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad Ebrahim","family":"Shiri","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran 1477893855, Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5436-6070","authenticated-orcid":false,"given":"Moharram","family":"Challenger","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Antwerp, 2020 Antwerp, Belgium"},{"name":"Flanders Make Strategic Research Center, 3001 Leuven, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1072-8786","authenticated-orcid":false,"given":"Hamidreza","family":"Navidi","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Shahed University, Tehran 3319118651, Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arash","family":"Sharifi","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran 1477893855, Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"103794","DOI":"10.1016\/j.cities.2022.103794","article-title":"Future smart cities requirements, emerging technologies, applications, challenges, and future aspects","volume":"129","author":"Javed","year":"2022","journal-title":"Cities"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mahmood, O.A., Abdellah, A.R., Muthanna, A., and Koucheryavy, A. (2022). Distributed Edge Computing for Resource Allocation in Smart Cities Based on the IoT. Information, 13.","DOI":"10.3390\/info13070328"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1109\/MWC.2019.1800512","article-title":"Designing a smart transportation system: An internet of things and big data approach","volume":"26","author":"Jan","year":"2019","journal-title":"IEEE Wirel. Commun."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Verg\u00fctz, A., G. Prates, N., Henrique Schwengber, B., Santos, A., and Nogueira, M. (2020). An Architecture for the Performance Management of Smart Healthcare Applications. Sensors, 20.","DOI":"10.3390\/s20195566"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, H., Li, S., and Sun, W. (2020). Resource allocation for edge computing without using cloud center in smart home environment: A pricing approach. Sensors, 20.","DOI":"10.3390\/s20226545"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100626","DOI":"10.1016\/j.envdev.2021.100626","article-title":"Smart energy cities: The evolution of the city-energy-sustainability nexus","volume":"39","author":"Thornbush","year":"2021","journal-title":"Environ. Dev."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Pech, M., Vrchota, J., and Bedn\u00e1\u0159, J. (2021). Predictive maintenance and intelligent sensors in smart factory. Sensors, 21.","DOI":"10.3390\/s21041470"},{"key":"ref_8","unstructured":"Wooldridge, M. (2009). An Introduction to Multiagent Systems, John Wiley & Sons."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"105329","DOI":"10.1016\/j.engappai.2022.105329","article-title":"Correcting biased value estimation in mixing value-based multi-agent reinforcement learning by multiple choice learning","volume":"116","author":"Liu","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/JSYST.2007.901641","article-title":"Knowledge-based multiagent credit assignment: A study on task type and critic information","volume":"1","author":"Harati","year":"2007","journal-title":"IEEE Syst. J."},{"key":"ref_11","unstructured":"Nguyen, D.T., Kumar, A., and Lau, H.C. (2018, January 3\u20138). Credit Assignment for Collective Multiagent RL with Global Rewards. Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS\u201918, Montreal, QC, Canada."},{"key":"ref_12","unstructured":"Wang, Y., Han, B., Wang, T., Dong, H., and Zhang, C. (2020). Off-policy multi-agent decomposed policy gradients. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3465","DOI":"10.3233\/IFS-162093","article-title":"Critic learning in multi agent credit assignment problem","volume":"30","author":"Rahaie","year":"2016","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3288","DOI":"10.1108\/ECAM-01-2021-0038","article-title":"Applications of multi-agent systems from the perspective of construction management: A literature review","volume":"29","author":"Xiang","year":"2021","journal-title":"Eng. Constr. Archit. Manag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"11103","DOI":"10.1016\/j.eswa.2012.03.060","article-title":"Application of strategic fuzzy games to wage increase negotiation and decision problems","volume":"39","author":"Oderanti","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/0165-4896(82)90029-4","article-title":"A problem of rights arbitration from the Talmud","volume":"2","year":"1982","journal-title":"Math. Soc. Sci."},{"key":"ref_17","unstructured":"Streitz, N.A. (2015). International Biennial Conference Hybrid City, Academia."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ram\u00edrez-Moreno, M.A., Keshtkar, S., Padilla-Reyes, D.A., Ramos-L\u00f3pez, E., Garc\u00eda-Mart\u00ednez, M., Hern\u00e1ndez-Luna, M.C., Mogro, A.E., Mahlknecht, J., Huertas, J.I., and Peimbert-Garc\u00eda, R.E. (2021). Sensors for sustainable smart cities: A review. Appl. Sci., 11.","DOI":"10.3390\/app11178198"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/MNET.2019.1800221","article-title":"Optimal edge resource allocation in IoT-based smart cities","volume":"33","author":"Zhao","year":"2019","journal-title":"IEEE Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1080\/07293682.2015.1019752","article-title":"Smart cities: An effective urban development and management model?","volume":"52","author":"Yigitcanlar","year":"2015","journal-title":"Aust. Plan."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Clemen, T., Ahmady-Moghaddam, N., Lenfers, U.A., Ocker, F., Osterholz, D., Str\u00f6bele, J., and Glake, D. (June, January 31). Multi-agent systems and digital twins for smarter cities. Proceedings of the 2021 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, Virtual Event.","DOI":"10.1145\/3437959.3459254"},{"key":"ref_22","unstructured":"De Haan, J.B. (2018). Animal Psychology: Its Nature and Its Problems, Routledge."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, X., and Liu, G. (2022). Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network. Sensors, 22.","DOI":"10.3390\/s22134738"},{"key":"ref_24","unstructured":"Zhang, K., Yang, Z., and Ba\u015far, T. (2021). Handbook of Reinforcement Learning and Control, Springer."},{"key":"ref_25","first-page":"11853","article-title":"Learning implicit credit assignment for cooperative multi-agent reinforcement learning","volume":"33","author":"Zhou","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","unstructured":"Skinner, B.F. (2019). The Behavior of Organisms: An Experimental Analysis, BF Skinner Foundation."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1016\/j.procs.2016.05.376","article-title":"Reinforcement learning with multiple shared rewards","volume":"80","author":"Guisi","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_28","first-page":"91","article-title":"On local rewards and scaling distributed reinforcement learning","volume":"18","author":"Bagnell","year":"2005","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","unstructured":"Omidshafiei, S., Kim, D.K., Liu, M., Tesauro, G., Riemer, M., Amato, C., Campbell, M., and How, J.P. (February, January 27). Learning to teach in cooperative multiagent reinforcement learning. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_30","unstructured":"Kim, W., Park, J., and Sung, Y. (2020, January 26\u201330). Communication in multi-agent reinforcement learning: Intention sharing. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Salimibeni, M., Mohammadi, A., Malekzadeh, P., and Plataniotis, K.N. (2022). Multi-Agent Reinforcement Learning via Adaptive Kalman Temporal Difference and Successor Representation. Sensors, 22.","DOI":"10.3390\/s22041393"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Li, J., Kuang, K., Wang, B., Liu, F., Chen, L., Wu, F., and Xiao, J. (2021). Shapley Counterfactual Credits for Multi-Agent Reinforcement Learning. arXiv.","DOI":"10.1145\/3447548.3467420"},{"key":"ref_33","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rahmattalabi, A., Chung, J.J., Colby, M., and Tumer, K. (2016, January 9\u201314). D++: Structural credit assignment in tightly coupled multiagent domains. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Republic of Korea.","DOI":"10.1109\/IROS.2016.7759651"},{"key":"ref_35","unstructured":"Mao, W., and Gratch, J. The social credit assignment problem. Proceedings of the International Workshop on Intelligent Virtual Agents."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"e16","DOI":"10.1017\/S026988891700011X","article-title":"Multi-agent credit assignment in stochastic resource management games","volume":"32","author":"Mannion","year":"2017","journal-title":"Knowl. Eng. Rev."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"511","DOI":"10.3233\/IDA-140654","article-title":"Expertness framework in multi-agent systems and its application in credit assignment problem","volume":"18","author":"Rahaie","year":"2014","journal-title":"Intell. Data Anal."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1017\/S0269888913000106","article-title":"Cooperative games and multiagent systems","volume":"28","author":"Airiau","year":"2013","journal-title":"Knowl. Eng. Rev."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1109\/JAS.2022.105506","article-title":"Cooperative and Competitive Multi-Agent Systems: From Optimization to Games","volume":"9","author":"Wang","year":"2022","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"102219","DOI":"10.1016\/j.jairtraman.2022.102219","article-title":"Baking and slicing the pie: An application to the airline alliance\u2019s profit-sharing based on cooperative game theory","volume":"102","author":"Yea","year":"2022","journal-title":"J. Air Transp. Manag."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"104350","DOI":"10.1016\/j.engappai.2021.104350","article-title":"A real Shapley value for evidential games with fuzzy characteristic function","volume":"104","author":"Xue","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/BF01753431","article-title":"Cores of convex games","volume":"1","author":"Shapley","year":"1971","journal-title":"Int. J. Game Theory"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"102638","DOI":"10.1016\/j.omega.2022.102638","article-title":"Core, shapley value, nucleolus and nash bargaining solution: A Survey of recent developments and applications in operations management","volume":"110","author":"Luo","year":"2022","journal-title":"Omega"},{"key":"ref_44","first-page":"A143","article-title":"Bankruptcy games","volume":"31","author":"Curiel","year":"1987","journal-title":"Z. F\u00fcr Oper. Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"100959","DOI":"10.1016\/j.swevo.2021.100959","article-title":"EvoBank: An evolutionary game solution for Bankruptcy problem","volume":"67","author":"Mahini","year":"2021","journal-title":"Swarm Evol. Comput."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"104797","DOI":"10.1016\/j.engappai.2022.104797","article-title":"Control with adaptive Q-learning: A comparison for two classical control problems","volume":"112","author":"Figueiredo","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Ram\u00edk, J., and Vlach, M. (2022). Bankruptcy problem under uncertainty of claims and estate. Fuzzy Sets Syst.","DOI":"10.1016\/j.fss.2022.06.023"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Arunraja, A., and Jayanthy, S. (2021). Tuning methods of various controllers. Mater. Today Proc.","DOI":"10.1016\/j.matpr.2020.12.870"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1804\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:25:15Z","timestamp":1760120715000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1804"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,6]]},"references-count":48,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23041804"],"URL":"https:\/\/doi.org\/10.3390\/s23041804","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,6]]}}}