{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:10Z","timestamp":1750220290215,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,5]],"date-time":"2022-04-05T00:00:00Z","timestamp":1649116800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,4,5]]},"DOI":"10.1145\/3517207.3526968","type":"proceedings-article","created":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T22:09:26Z","timestamp":1648591766000},"page":"95-100","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Temporal shift reinforcement learning"],"prefix":"10.1145","author":[{"given":"Deepak George","family":"Thomas","sequence":"first","affiliation":[{"name":"Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tichakorn","family":"Wongpiromsarn","sequence":"additional","affiliation":[{"name":"Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ali","family":"Jannesari","sequence":"additional","affiliation":[{"name":"Department of Computer Science"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,5]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Conference on Robot Learning. PMLR, 156--168","author":"Amiranashvili Artemij","year":"2018","unstructured":"Artemij Amiranashvili , Alexey Dosovitskiy , Vladlen Koltun , and Thomas Brox . 2018 . Motion perception in reinforcement learning with dynamic objects . In Conference on Robot Learning. PMLR, 156--168 . Artemij Amiranashvili, Alexey Dosovitskiy, Vladlen Koltun, and Thomas Brox. 2018. Motion perception in reinforcement learning with dynamic objects. In Conference on Robot Learning. PMLR, 156--168."},{"key":"e_1_3_2_1_2_1","volume-title":"Miles Brundage, and Anil Anthony Bharath.","author":"Arulkumaran Kai","year":"2017","unstructured":"Kai Arulkumaran , Marc Peter Deisenroth , Miles Brundage, and Anil Anthony Bharath. 2017 . A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017). Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/2566972.2566979"},{"key":"e_1_3_2_1_4_1","volume-title":"Openai gym. arXiv preprint arXiv:1606.01540","author":"Brockman Greg","year":"2016","unstructured":"Greg Brockman , Vicki Cheung , Ludwig Pettersson , Jonas Schneider , John Schulman , Jie Tang , and Wojciech Zaremba . 2016. Openai gym. arXiv preprint arXiv:1606.01540 ( 2016 ). Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. Openai gym. arXiv preprint arXiv:1606.01540 (2016)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.502"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989384"},{"key":"e_1_3_2_1_7_1","volume-title":"Advances in neural information processing systems 23","author":"Hasselt Hado","year":"2010","unstructured":"Hado Hasselt . 2010. Double Q-learning. Advances in neural information processing systems 23 ( 2010 ), 2613--2621. Hado Hasselt. 2010. Double Q-learning. Advances in neural information processing systems 23 (2010), 2613--2621."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8794033"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.223"},{"key":"e_1_3_2_1_10_1","volume-title":"Reinforcement learning with augmented data. arXiv preprint arXiv:2004.14990","author":"Laskin Michael","year":"2020","unstructured":"Michael Laskin , Kimin Lee , Adam Stooke , Lerrel Pinto , Pieter Abbeel , and Aravind Srinivas . 2020. Reinforcement learning with augmented data. arXiv preprint arXiv:2004.14990 ( 2020 ). Michael Laskin, Kimin Lee, Adam Stooke, Lerrel Pinto, Pieter Abbeel, and Aravind Srinivas. 2020. Reinforcement learning with augmented data. arXiv preprint arXiv:2004.14990 (2020)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00718"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski etal 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.  Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_13_1","unstructured":"Bradford W Mott and Stella Team. 1996. Stella: a multiplatform Atari 2600 VCS emulator.  Bradford W Mott and Stella Team. 1996. Stella: a multiplatform Atari 2600 VCS emulator."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of SAI Intelligent Systems Conference. Springer, 115--128","author":"Roghair Jeremy","year":"2021","unstructured":"Jeremy Roghair , Amir Niaraki , Kyungtae Ko , and Ali Jannesari . 2021 . A vision based deep reinforcement learning algorithm for uav obstacle avoidance . In Proceedings of SAI Intelligent Systems Conference. Springer, 115--128 . Jeremy Roghair, Amir Niaraki, Kyungtae Ko, and Ali Jannesari. 2021. A vision based deep reinforcement learning algorithm for uav obstacle avoidance. In Proceedings of SAI Intelligent Systems Conference. Springer, 115--128."},{"key":"e_1_3_2_1_15_1","volume-title":"Prioritized experience replay. arXiv preprint arXiv:1511.05952","author":"Schaul Tom","year":"2015","unstructured":"Tom Schaul , John Quan , Ioannis Antonoglou , and David Silver . 2015. Prioritized experience replay. arXiv preprint arXiv:1511.05952 ( 2015 ). Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver. 2015. Prioritized experience replay. arXiv preprint arXiv:1511.05952 (2015)."},{"key":"e_1_3_2_1_16_1","volume-title":"Reinforcement Learning with Latent Flow. arXiv preprint arXiv:2101.01857","author":"Shang Wenling","year":"2021","unstructured":"Wenling Shang , Xiaofei Wang , Aravind Srinivas , Aravind Rajeswaran , Yang Gao , Pieter Abbeel , and Michael Laskin . 2021. Reinforcement Learning with Latent Flow. arXiv preprint arXiv:2101.01857 ( 2021 ). Wenling Shang, Xiaofei Wang, Aravind Srinivas, Aravind Rajeswaran, Yang Gao, Pieter Abbeel, and Michael Laskin. 2021. Reinforcement Learning with Latent Flow. arXiv preprint arXiv:2101.01857 (2021)."},{"key":"e_1_3_2_1_17_1","volume-title":"Two-stream convolutional networks for action recognition in videos. arXiv preprint arXiv:1406.2199","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Two-stream convolutional networks for action recognition in videos. arXiv preprint arXiv:1406.2199 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Two-stream convolutional networks for action recognition in videos. arXiv preprint arXiv:1406.2199 (2014)."},{"key":"e_1_3_2_1_18_1","volume-title":"Curl: Contrastive unsupervised representations for reinforcement learning. arXiv preprint arXiv:2004.04136","author":"Srinivas Aravind","year":"2020","unstructured":"Aravind Srinivas , Michael Laskin , and Pieter Abbeel . 2020 . Curl: Contrastive unsupervised representations for reinforcement learning. arXiv preprint arXiv:2004.04136 (2020). Aravind Srinivas, Michael Laskin, and Pieter Abbeel. 2020. Curl: Contrastive unsupervised representations for reinforcement learning. arXiv preprint arXiv:2004.04136 (2020)."},{"key":"e_1_3_2_1_19_1","unstructured":"Chandan Kumar Subrahmanyam Vaddi and Ali Jannesari. 2019. Efficient Object Detection Model for Real-Time UAV Applications. (2019).  Chandan Kumar Subrahmanyam Vaddi and Ali Jannesari. 2019. Efficient Object Detection Model for Real-Time UAV Applications. (2019)."},{"key":"e_1_3_2_1_20_1","volume-title":"David Budden, Abbas Abdolmaleki, Josh Merel, Andrew Lefrancq, et al.","author":"Tassa Yuval","year":"2018","unstructured":"Yuval Tassa , Yotam Doron , Alistair Muldal , Tom Erez , Yazhe Li , Diego de Las Casas , David Budden, Abbas Abdolmaleki, Josh Merel, Andrew Lefrancq, et al. 2018 . Deepmind control suite. arXiv preprint arXiv:1801.00690 (2018). Yuval Tassa, Yotam Doron, Alistair Muldal, Tom Erez, Yazhe Li, Diego de Las Casas, David Budden, Abbas Abdolmaleki, Josh Merel, Andrew Lefrancq, et al. 2018. Deepmind control suite. arXiv preprint arXiv:1801.00690 (2018)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_2"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_49"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01216-8_43"}],"event":{"name":"EuroSys '22: Seventeenth European Conference on Computer Systems","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems"],"location":"Rennes France","acronym":"EuroSys '22"},"container-title":["Proceedings of the 2nd European Workshop on Machine Learning and Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517207.3526968","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3517207.3526968","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:29Z","timestamp":1750188689000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517207.3526968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,5]]},"references-count":25,"alternative-id":["10.1145\/3517207.3526968","10.1145\/3517207"],"URL":"https:\/\/doi.org\/10.1145\/3517207.3526968","relation":{},"subject":[],"published":{"date-parts":[[2022,4,5]]},"assertion":[{"value":"2022-04-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}