{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T03:49:04Z","timestamp":1747194544819,"version":"3.40.5"},"reference-count":26,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2019,7,1]],"date-time":"2019-07-01T00:00:00Z","timestamp":1561939200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Distributed Sensor Networks"],"published-print":{"date-parts":[[2019,7]]},"abstract":"<jats:p>Internet of Things simulations play significant roles in the diverse kinds of activities in our daily lives and have been extensively researched. Creating and controlling virtual agents in three-dimensional Internet of Things simulations is a key technology for achieving realism in three-dimensional simulations. Given that traditional virtual agent-based approaches have limitations for realism, it is necessary to improve the realism of three-dimensional Internet of Things simulations. This article proposes a Q-Network-based motivation framework that applies a Q-Network to select motivations from desires and hierarchical task network planning to execute actions based on goals of the selected motivations. The desires are to be identified and calculated based on states. Selected motivations will be chosen to determine the goals that agents must achieve. In the experiments, the proposed framework achieved an average accuracy of up to 85.5% when the Q-Network-based motivation model was trained. To verify the Q-Network-based motivation framework, a traditional Q-learning is also applied in the three-dimensional virtual environment. Comparing the results of the two frameworks, the Q-Network-based motivation framework shows better results than those of traditional Q-learning, as the accuracy of the Q-Network-based motivation is higher by 15.58%. The proposed framework can be applied to the diverse kinds of Internet of Things systems such as a training autonomous vehicle. Moreover, the proposed framework can generate big data on animal behaviors for other training systems.<\/jats:p>","DOI":"10.1177\/1550147719866385","type":"journal-article","created":{"date-parts":[[2019,7,31]],"date-time":"2019-07-31T12:51:41Z","timestamp":1564577501000},"page":"155014771986638","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Intelligent motivation framework based on Q-network for multiple agents in Internet of Things simulations"],"prefix":"10.1177","volume":"15","author":[{"given":"Hieu Trong","family":"Nguyen","sequence":"first","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Phuong Minh","family":"Chu","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jisun","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunsick","family":"Sung","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2219-0848","authenticated-orcid":false,"given":"Kyungeun","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2019,7,31]]},"reference":[{"key":"bibr1-1550147719866385","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511804779","volume-title":"Bayesian reasoning and machine learning","author":"Barber D.","year":"2012"},{"volume-title":"Pattern recognition and machine learning","year":"2006","author":"Bishop CM.","key":"bibr2-1550147719866385"},{"volume-title":"Machine learning: a probabilistic perspective","year":"2012","author":"Murphy KP.","key":"bibr3-1550147719866385"},{"volume-title":"Deep learning","year":"2016","author":"Bengio IGY","key":"bibr4-1550147719866385"},{"volume-title":"AI game programming wisdom 3","year":"2006","author":"Rabin S.","key":"bibr5-1550147719866385"},{"first-page":"1","volume-title":"Proceedings of the IEEE international conference on fuzzy systems","author":"Ayesh A","key":"bibr6-1550147719866385"},{"first-page":"277","volume-title":"Proceedings of the international workshop on agent theories, architectures, and languages","author":"Norman TJ","key":"bibr7-1550147719866385"},{"key":"bibr8-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1080\/02699938708408049"},{"volume-title":"Motivation: the organization of action","year":"1987","author":"Mook DG.","key":"bibr9-1550147719866385"},{"key":"bibr10-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.8.3.179"},{"key":"bibr11-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1007\/s10955-014-1024-9"},{"issue":"107","key":"bibr12-1550147719866385","first-page":"1","volume":"6","author":"Capraro V","year":"2018","journal-title":"Frontier Phys"},{"volume-title":"Essential animal behavior","year":"2005","author":"Scott G.","key":"bibr13-1550147719866385"},{"volume-title":"Exploring HTN planners through example in game AI pro 2: collected wisdom of game AI professionals","year":"2015","author":"Humphreys T.","key":"bibr14-1550147719866385"},{"key":"bibr15-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1007\/BF02136175"},{"issue":"1","key":"bibr16-1550147719866385","first-page":"91","volume":"8","author":"Song W","year":"2008","journal-title":"Korea Game Soc"},{"first-page":"213","volume-title":"Proceedings of computer graphics international (CDI)","author":"De Sevin E","key":"bibr17-1550147719866385"},{"key":"bibr18-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2354400"},{"volume-title":"Reinforcement learning: an introduction","year":"1998","author":"Sutton RS","key":"bibr19-1550147719866385"},{"key":"bibr20-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"first-page":"1","volume-title":"Proceedings of the NIPS deep learning workshop 2013","author":"Mnih V","key":"bibr23-1550147719866385"},{"first-page":"1","volume-title":"Proceedings of the IEEE conference on computational intelligence and games (CIG)","author":"Kempka M","key":"bibr24-1550147719866385"},{"first-page":"1","volume-title":"Proceedings of the thirty-first AAAI conference on artificial intelligence (AAAI-17)","author":"Tessler C","key":"bibr25-1550147719866385"},{"first-page":"1","volume-title":"Proceedings conference on neural information processing systems (NIPS 2017)","author":"Oh J","key":"bibr27-1550147719866385"},{"first-page":"1","volume-title":"Proceedings of the thirty-second AAAI conference on artificial intelligence","author":"Hessel M","key":"bibr29-1550147719866385"},{"key":"bibr31-1550147719866385","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89187-1"}],"container-title":["International Journal of Distributed Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1550147719866385","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1550147719866385","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1550147719866385","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,24]],"date-time":"2022-09-24T23:04:22Z","timestamp":1664060662000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1177\/1550147719866385"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7]]},"references-count":26,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,7,31]]},"published-print":{"date-parts":[[2019,7]]}},"alternative-id":["10.1177\/1550147719866385"],"URL":"https:\/\/doi.org\/10.1177\/1550147719866385","relation":{},"ISSN":["1550-1477","1550-1477"],"issn-type":[{"type":"print","value":"1550-1477"},{"type":"electronic","value":"1550-1477"}],"subject":[],"published":{"date-parts":[[2019,7]]}}}