{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T17:50:11Z","timestamp":1772301011329,"version":"3.50.1"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,8]]},"abstract":"<jats:p>Deep Q-Network (DQN) is an algorithm that achieves human-level performance in complex domains like Atari games. One of the important elements of DQN is its use of a target network, which is necessary to stabilize learning. We argue that using a target network is incompatible with online reinforcement learning, and it is possible to achieve faster and more stable learning without a target network when we use Mellowmax, an alternative softmax operator. We derive novel properties of Mellowmax, and empirically show that the combination of DQN and Mellowmax, but without a target network, outperforms DQN with a target network.<\/jats:p>","DOI":"10.24963\/ijcai.2019\/379","type":"proceedings-article","created":{"date-parts":[[2019,7,28]],"date-time":"2019-07-28T07:46:05Z","timestamp":1564299965000},"page":"2733-2739","source":"Crossref","is-referenced-by-count":34,"title":["DeepMellow: Removing the Need for a Target Network in Deep Q-Learning"],"prefix":"10.24963","author":[{"given":"Seungchan","family":"Kim","sequence":"first","affiliation":[{"name":"Brown University Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kavosh","family":"Asadi","sequence":"additional","affiliation":[{"name":"Brown University Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Littman","sequence":"additional","affiliation":[{"name":"Brown University Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Konidaris","sequence":"additional","affiliation":[{"name":"Brown University Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10584","event":{"name":"Twenty-Eighth International Joint Conference on Artificial Intelligence {IJCAI-19}","theme":"Artificial Intelligence","location":"Macao, China","acronym":"IJCAI-2019","number":"28","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2019,8,10]]},"end":{"date-parts":[[2019,8,16]]}},"container-title":["Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2019,7,28]],"date-time":"2019-07-28T07:48:54Z","timestamp":1564300134000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2019\/379"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2019,8]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2019\/379","relation":{},"subject":[],"published":{"date-parts":[[2019,8]]}}}