{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T21:14:10Z","timestamp":1774127650622,"version":"3.50.1"},"reference-count":16,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T00:00:00Z","timestamp":1719446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Recent work on decentralized computational trust models for open multi-agent systems has resulted in the development of CA, a biologically inspired model which focuses on the trustee\u2019s perspective. This new model addresses a serious unresolved problem in existing trust and reputation models, namely the inability to handle constantly changing behaviors and agents\u2019 continuous entry and exit from the system. In previous work, we compared CA to FIRE, a well-known trust and reputation model, and found that CA is superior when the trustor population changes, whereas FIRE is more resilient to the trustee population changes. Thus, in this paper, we investigate how the trustors can detect the presence of several dynamic factors in their environment and then decide which trust model to employ in order to maximize utility. We frame this problem as a machine learning problem in a partially observable environment, where the presence of several dynamic factors is not known to the trustor, and we describe how an adaptable trustor can rely on a few measurable features so as to assess the current state of the environment and then use Deep Q-Learning (DQL), in a single-agent reinforcement learning setting, to learn how to adapt to a changing environment. We ran a series of simulation experiments to compare the performance of the adaptable trustor with the performance of trustors using only one model (FIRE or CA) and we show that an adaptable agent is indeed capable of learning when to use each model and, thus, perform consistently in dynamic environments.<\/jats:p>","DOI":"10.3390\/make6030067","type":"journal-article","created":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T06:51:53Z","timestamp":1719557513000},"page":"1413-1438","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Using Deep Q-Learning to Dynamically Toggle between Push\/Pull Actions in Computational Trust Mechanisms"],"prefix":"10.3390","volume":"6","author":[{"given":"Zoi","family":"Lygizou","sequence":"first","affiliation":[{"name":"School of Science & Technology, Hellenic Open University, 263 35 Patra, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0364-5966","authenticated-orcid":false,"given":"Dimitris","family":"Kalles","sequence":"additional","affiliation":[{"name":"School of Science & Technology, Hellenic Open University, 263 35 Patra, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2816826","article-title":"Trust and reputation models for multiagent systems","volume":"48","author":"Granatyr","year":"2015","journal-title":"ACM Comput. Surv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Alghofaili, Y., and Rassam, M.A. (2022). A Trust Management Model for IoT Devices and Services Based on the Multi-Criteria Decision-Making Approach and Deep Long Short-Term Memory Technique. Sensors, 22.","DOI":"10.3390\/s22020634"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e3","DOI":"10.1017\/S0269888920000429","article-title":"A generic model for representing openness in multi-agent systems","volume":"36","author":"Hattab","year":"2021","journal-title":"Knowl. Eng. Rev."},{"key":"ref_4","unstructured":"Keung, S., and Griffiths, N. (2008, January 1\u20134). Using Recency and Relevance to Assess Trust and Reputation. Proceedings of the AISB 2008 Symposium on Behaviour Regulation in Multi-Agent Systems, Aberdeen, UK."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lygizou, Z., and Kalles, D. (2022, January 7\u20139). A Biologically Inspired Computational Trust Model based on the Perspective of the Trustee. Proceedings of the 12th Hellenic Conference on Artificial Intelligence (SETN 2022), New York, NY, USA.","DOI":"10.1145\/3549737.3549748"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lygizou, Z., and Kalles, D. (2024). A biologically inspired computational trust model for open multi-agent systems which is resilient to trustor population changes. arXiv.","DOI":"10.21203\/rs.3.rs-2835188\/v1"},{"key":"ref_7","first-page":"1","article-title":"A survey on trust evaluation based on machine learning","volume":"53","author":"Wang","year":"2020","journal-title":"ACM Comput. Surv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3645100","article-title":"On Trust Recommendations in the Social Internet of Things\u2014A Survey","volume":"56","author":"Becherer","year":"2024","journal-title":"ACM Comput. Surv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10458-005-6825-4","article-title":"An integrated trust and reputation model for open multi-agent systems","volume":"13","author":"Huynh","year":"2006","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s12243-020-00792-1","article-title":"Toward unified trust and reputation messaging in ubiquitous systems","volume":"76","author":"Jelenc","year":"2021","journal-title":"Ann. Telecommun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jezic, G., Chen-Burger, J., Kusek, M., Sperka, R., Howlett, R.J., and Jain, L.C. (2021). Multi-Agent Task Allocation Based on Reciprocal Trust in Distributed Environments. Agents and Multi-Agent Systems: Technologies and Applications 2021, Springer. Smart Innovation, Systems and Technologies.","DOI":"10.1007\/978-981-16-2994-5"},{"key":"ref_12","first-page":"28","article-title":"A Trust-based Mechanism for Avoiding Liars in Referring of Reputation in Multiagent System","volume":"4","author":"Nguyen","year":"2015","journal-title":"Int. J. Adv. Res. Artif. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sutton, R., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_16","unstructured":"Cohen, P.R. (1995). Empirical Methods for Artificial Intelligence, The MIT Press."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/6\/3\/67\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:06:32Z","timestamp":1760108792000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/6\/3\/67"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,27]]},"references-count":16,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["make6030067"],"URL":"https:\/\/doi.org\/10.3390\/make6030067","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,27]]}}}