{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:21:20Z","timestamp":1750220480655,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Turkish Scientific and Technical Research Council (TUBITAK)","award":["217E040"],"award-info":[{"award-number":["217E040"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3479944","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T14:41:47Z","timestamp":1634308907000},"page":"613-618","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Engagement Rewarded Actor-Critic with Conservative Q-Learning for Speech-Driven Laughter Backchannel Generation"],"prefix":"10.1145","author":[{"given":"\u00d6yk\u00fc Zeynep","family":"Bayramo\u011flu","sequence":"first","affiliation":[{"name":"KUIS AI Lab, Ko\u00e7 University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Engin","family":"Erzin","sequence":"additional","affiliation":[{"name":"KUIS AI Lab, Ko\u00e7 University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tevfik Metin","family":"Sezgin","sequence":"additional","affiliation":[{"name":"KUIS AI Lab, Ko\u00e7 University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Y\u00fccel","family":"Yemez","sequence":"additional","affiliation":[{"name":"KUIS AI Lab, Ko\u00e7 University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Machine Learning. 104\u2013114","author":"Agarwal Rishabh","year":"2020","unstructured":"Rishabh Agarwal , Dale Schuurmans , and Mohammad Norouzi . 2020 . An optimistic perspective on offline reinforcement learning . In International Conference on Machine Learning. 104\u2013114 . Rishabh Agarwal, Dale Schuurmans, and Mohammad Norouzi. 2020. An optimistic perspective on offline reinforcement learning. In International Conference on Machine Learning. 104\u2013114."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-377-6.50013-X"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2016.10.004"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-008-9076-6"},{"key":"e_1_3_2_1_5_1","volume-title":"International Conference on Machine Learning. 2021\u20132030","author":"Fu Justin","year":"2019","unstructured":"Justin Fu , Aviral Kumar , Matthew Soh , and Sergey Levine . 2019 . Diagnosing bottlenecks in deep Q-learning algorithms . In International Conference on Machine Learning. 2021\u20132030 . Justin Fu, Aviral Kumar, Matthew Soh, and Sergey Levine. 2019. Diagnosing bottlenecks in deep Q-learning algorithms. In International Conference on Machine Learning. 2021\u20132030."},{"key":"e_1_3_2_1_6_1","volume-title":"International Conference on Machine Learning, Vol.\u00a097","author":"Fujimoto Scott","year":"2019","unstructured":"Scott Fujimoto , David Meger , and Doina Precup . 2019 . Off-Policy Deep Reinforcement Learning without Exploration . In International Conference on Machine Learning, Vol.\u00a097 . 2052\u20132062. Scott Fujimoto, David Meger, and Doina Precup. 2019. Off-Policy Deep Reinforcement Learning without Exploration. In International Conference on Machine Learning, Vol.\u00a097. 2052\u20132062."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.9914"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23974-8_8"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2019-2521"},{"volume-title":"IEEE International Conference on Big Data (Big Data). 881\u2013888","author":"Hyv\u00f6nen V.","key":"e_1_3_2_1_10_1","unstructured":"V. Hyv\u00f6nen , T. Pitk\u00e4nen , S. Tasoulis , E. J\u00e4\u00e4saari , R. Tuomainen , L. Wang , J. Corander , and T. Roos . 2016. Fast nearest neighbor search through sparse random projections and voting . In IEEE International Conference on Big Data (Big Data). 881\u2013888 . V. Hyv\u00f6nen, T. Pitk\u00e4nen, S. Tasoulis, E. J\u00e4\u00e4saari, R. Tuomainen, L. Wang, J. Corander, and T. Roos. 2016. Fast nearest neighbor search through sparse random projections and voting. In IEEE International Conference on Big Data (Big Data). 881\u2013888."},{"key":"e_1_3_2_1_11_1","unstructured":"Aviral Kumar Justin Fu Matthew Soh George Tucker and Sergey Levine. 2019. Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction. In Advances in Neural Information Processing Systems Vol.\u00a032.  Aviral Kumar Justin Fu Matthew Soh George Tucker and Sergey Levine. 2019. Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction. In Advances in Neural Information Processing Systems Vol.\u00a032."},{"key":"e_1_3_2_1_12_1","unstructured":"Aviral Kumar Aurick Zhou George Tucker and Sergey Levine. 2020. Conservative Q-Learning for Offline Reinforcement Learning. In Advances in Neural Information Processing Systems Vol.\u00a033. 1179\u20131191.  Aviral Kumar Aurick Zhou George Tucker and Sergey Levine. 2020. Conservative Q-Learning for Offline Reinforcement Learning. In Advances in Neural Information Processing Systems Vol.\u00a033. 1179\u20131191."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2010.2051874"},{"key":"e_1_3_2_1_14_1","volume-title":"Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv:2005.01643","author":"Levine Sergey","year":"2020","unstructured":"Sergey Levine , Aviral Kumar , George Tucker , and Justin Fu. 2020. Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv:2005.01643 ( 2020 ). Sergey Levine, Aviral Kumar, George Tucker, and Justin Fu. 2020. Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv:2005.01643 (2020)."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2014.02.002"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2012.08.018"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Louis-Philippe Morency Iwan de Kok and Jonathan Gratch. 2008. Predicting Listener Backchannels: A Probabilistic Multimodal Approach. In Intelligent Virtual Agents. 176\u2013190.  Louis-Philippe Morency Iwan de Kok and Jonathan Gratch. 2008. Predicting Listener Backchannels: A Probabilistic Multimodal Approach. In Intelligent Virtual Agents. 176\u2013190.","DOI":"10.1007\/978-3-540-85483-8_18"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-018-0488-1"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23974-8_25"},{"key":"e_1_3_2_1_20_1","volume-title":"ACM\/IEEE International Conference on Human-Robot Interaction (HRI). 375\u2013382","author":"Rich C.","year":"2010","unstructured":"C. Rich , B. Ponsler , A. Holroyd , and C.\u00a0 L. Sidner . 2010 . Recognizing engagement in human-robot interaction . In ACM\/IEEE International Conference on Human-Robot Interaction (HRI). 375\u2013382 . https:\/\/doi.org\/10.1109\/HRI.2010.5453163 C. Rich, B. Ponsler, A. Holroyd, and C.\u00a0L. Sidner. 2010. Recognizing engagement in human-robot interaction. In ACM\/IEEE International Conference on Human-Robot Interaction (HRI). 375\u2013382. https:\/\/doi.org\/10.1109\/HRI.2010.5453163"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/11564096_32"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2017.8172330"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.34"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1090725.1644610"},{"key":"e_1_3_2_1_25_1","volume-title":"Keep Doing What Worked: Behavior Modelling Priors for Offline Reinforcement Learning. In International Conference on Learning Representations.","author":"Siegel Noah","year":"2020","unstructured":"Noah Siegel , Jost\u00a0Tobias Springenberg , Felix Berkenkamp , Abbas Abdolmaleki , Michael Neunert , Thomas Lampe , Roland Hafner , Nicolas Heess , and Martin Riedmiller . 2020 . Keep Doing What Worked: Behavior Modelling Priors for Offline Reinforcement Learning. In International Conference on Learning Representations. Noah Siegel, Jost\u00a0Tobias Springenberg, Felix Berkenkamp, Abbas Abdolmaleki, Michael Neunert, Thomas Lampe, Roland Hafner, Nicolas Heess, and Martin Riedmiller. 2020. Keep Doing What Worked: Behavior Modelling Priors for Offline Reinforcement Learning. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5527"},{"volume-title":"Introduction to reinforcement learning. Vol.\u00a0135","author":"Sutton S","key":"e_1_3_2_1_27_1","unstructured":"Richard\u00a0 S Sutton , Andrew\u00a0 G Barto , 1998. Introduction to reinforcement learning. Vol.\u00a0135 . MIT press Cambridge . Richard\u00a0S Sutton, Andrew\u00a0G Barto, 1998. Introduction to reinforcement learning. Vol.\u00a0135. MIT press Cambridge."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207679"},{"key":"e_1_3_2_1_29_1","volume-title":"International Conference on Machine Learning. 2139\u20132148","author":"Thomas Philip","year":"2016","unstructured":"Philip Thomas and Emma Brunskill . 2016 . Data-efficient off-policy policy evaluation for reinforcement learning . In International Conference on Machine Learning. 2139\u20132148 . Philip Thomas and Emma Brunskill. 2016. Data-efficient off-policy policy evaluation for reinforcement learning. In International Conference on Machine Learning. 2139\u20132148."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2018-2215"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2017-1395"},{"key":"e_1_3_2_1_32_1","volume-title":"Empirical study of off-policy policy evaluation for reinforcement learning. arXiv:1911.06854","author":"Voloshin Cameron","year":"2019","unstructured":"Cameron Voloshin , Hoang\u00a0 M Le , Nan Jiang , and Yisong Yue . 2019. Empirical study of off-policy policy evaluation for reinforcement learning. arXiv:1911.06854 ( 2019 ). Cameron Voloshin, Hoang\u00a0M Le, Nan Jiang, and Yisong Yue. 2019. Empirical study of off-policy policy evaluation for reinforcement learning. arXiv:1911.06854 (2019)."},{"key":"e_1_3_2_1_33_1","volume-title":"Sample efficient actor-critic with experience replay. arXiv:1611.01224","author":"Wang Ziyu","year":"2016","unstructured":"Ziyu Wang , Victor Bapst , Nicolas Heess , Volodymyr Mnih , Remi Munos , Koray Kavukcuoglu , and Nando de Freitas . 2016. Sample efficient actor-critic with experience replay. arXiv:1611.01224 ( 2016 ). Ziyu Wang, Victor Bapst, Nicolas Heess, Volodymyr Mnih, Remi Munos, Koray Kavukcuoglu, and Nando de Freitas. 2016. Sample efficient actor-critic with experience replay. arXiv:1611.01224 (2016)."}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Montr\u00e9al QC Canada","acronym":"ICMI '21"},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479944","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3479944","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:55Z","timestamp":1750193335000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479944"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":33,"alternative-id":["10.1145\/3462244.3479944","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3479944","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}