{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T03:34:28Z","timestamp":1783740868930,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":59,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Academy of Finland","award":["318559"],"award-info":[{"award-number":["318559"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445497","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T04:19:40Z","timestamp":1620447580000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":96,"title":["Adapting User Interfaces with Model-based Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Kashyap","family":"Todi","sequence":"first","affiliation":[{"name":"Aalto University, Helsinki, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gilles","family":"Bailly","sequence":"additional","affiliation":[{"name":"Sorbonne Universit\u00e9, CNRS, ISIR, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luis","family":"Leiva","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg City, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antti","family":"Oulasvirta","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781315805696"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2186810"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1385569.1385575"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3002171"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557093"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502024"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.17.4.B141"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3233\/ICG-1996-19303"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2186810"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.2001.0469"},{"key":"e_1_3_2_1_11_1","volume-title":"Algorithms and Architectures for Parallel Processing","author":"Cai Yuan","unstructured":"Yuan Cai and Xiang Ji. 2018. ASA-routing: A-Star Adaptive Routing Algorithm for Network-on-Chips . In Algorithms and Architectures for Parallel Processing , Jaideep Vaidyaand Jin Li (Eds.). Springer International Publishing , Cham , 187\u2013198. Yuan Cai and Xiang Ji. 2018. ASA-routing: A-Star Adaptive Routing Algorithm for Network-on-Chips. In Algorithms and Architectures for Parallel Processing, Jaideep Vaidyaand Jin Li (Eds.). Springer International Publishing, Cham, 187\u2013198."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370020902990402"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240723"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2013.06.002"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300482"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985704"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518956"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208380"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.20.2.423"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347933"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302314"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449298508901785"},{"key":"e_1_3_2_1_23_1","volume-title":"International Conference on Computer Vision Systems: Proceedings","author":"Hoey Jesse","year":"2007","unstructured":"Jesse Hoey , Axel Von\u00a0Bertoldi , Pascal Poupart , and Alex Mihailidis . 2007 . Assisting persons with dementia during handwashing using a partially observable Markov decision process .. In International Conference on Computer Vision Systems: Proceedings (2007). Jesse Hoey, Axel Von\u00a0Bertoldi, Pascal Poupart, and Alex Mihailidis. 2007. Assisting persons with dementia during handwashing using a partially observable Markov decision process.. In International Conference on Computer Vision Systems: Proceedings (2007)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258621"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1502650.1502691"},{"key":"e_1_3_2_1_26_1","unstructured":"Michael Janner Justin Fu Marvin Zhang and Sergey Levine. 2019. When to trust your model: Model-based policy optimization. In Advances in Neural Information Processing Systems. 12498\u201312509.  Michael Janner Justin Fu Marvin Zhang and Sergey Levine. 2019. When to trust your model: Model-based policy optimization. In Advances in Neural Information Processing Systems. 12498\u201312509."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025580"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622737.1622748"},{"key":"e_1_3_2_1_29_1","volume-title":"Model-based reinforcement learning for atari. arXiv:1903.00374","author":"Kaiser Lukasz","year":"2019","unstructured":"Lukasz Kaiser , Mohammad Babaeizadeh , Piotr Milos , Blazej Osinski , Roy\u00a0 H Campbell , Konrad Czechowski , Dumitru Erhan , Chelsea Finn , Piotr Kozakowski , Sergey Levine , 2019. Model-based reinforcement learning for atari. arXiv:1903.00374 ( 2019 ). Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy\u00a0H Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, 2019. Model-based reinforcement learning for atari. arXiv:1903.00374 (2019)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376735"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/11871842_29"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/3540634932_3"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2010.01.004"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2003.07.004"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308557.3308704"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2166966.2167028"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025707"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858425"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0701_3"},{"key":"e_1_3_2_1_40_1","volume-title":"The psychology of menu selection: Designing cognitive control at the human\/computer interface","author":"Norman L","unstructured":"Kent\u00a0 L Norman . 1991. The psychology of menu selection: Designing cognitive control at the human\/computer interface . Intellect Books . Kent\u00a0L Norman. 1991. The psychology of menu selection: Designing cognitive control at the human\/computer interface. Intellect Books."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.2969687"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/199288.184583"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376538"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/174630.174632"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025207"},{"key":"e_1_3_2_1_50_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton S","unstructured":"Richard\u00a0 S Sutton and Andrew\u00a0 G Barto . 2018. Reinforcement learning: An introduction . MIT press . Richard\u00a0S Sutton and Andrew\u00a0G Barto. 2018. Reinforcement learning: An introduction. MIT press."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172949"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241381"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901817"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240806"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3237190"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/636772.636794"},{"key":"e_1_3_2_1_57_1","volume-title":"Gesture-Based Communication in Human-Computer Interaction","author":"Wu Ying","unstructured":"Ying Wu and Thomas\u00a0 S. Huang . 1999. Vision-Based Gesture Recognition: A Review . In Gesture-Based Communication in Human-Computer Interaction , Annelies Braffort, Rachid Gherbi, Sylvie Gibet, Daniel Teil, and James Richardson(Eds.). Springer Berlin Heidelberg, Berlin , Heidelberg , 103\u2013115. Ying Wu and Thomas\u00a0S. Huang. 1999. Vision-Based Gesture Recognition: A Review. In Gesture-Based Communication in Human-Computer Interaction, Annelies Braffort, Rachid Gherbi, Sylvie Gibet, Daniel Teil, and James Richardson(Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 103\u2013115."},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2012.2225812"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376870"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445497","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445497","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:48Z","timestamp":1750195728000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445497"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":59,"alternative-id":["10.1145\/3411764.3445497","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445497","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}