{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T18:56:10Z","timestamp":1767034570597,"version":"3.37.3"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"9-10","license":[{"start":{"date-parts":[[2024,10,1]],"date-time":"2024-10-01T00:00:00Z","timestamp":1727740800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,30]],"date-time":"2024-11-30T00:00:00Z","timestamp":1732924800000},"content-version":"vor","delay-in-days":60,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"R &D Division Manufacturing of the OFFIS Institute for Information Technology in Oldenburg, Germany"},{"DOI":"10.13039\/100019559","name":"Carl von Ossietzky Universit\u00e4t Oldenburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100019559","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J of Soc Robotics"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Inclusion of people with disabilities in the open labor market using robotic assistance is a promising new and important field of research, albeit challenging. People with disabilities are severely underrepresented in the open labor market, although inclusion adds significant value on both financial and social levels. Here, collaborative industrial robots offer great potential for support. This work conducted a month-long, in-field user study in a workshop for people with disabilities to improve learning progress through collaboration with an innovative intelligent robotic tutoring system. Seven workers with a wide variety of disabilities solved assembly tasks while being supervised by the system. In case of errors or hesitations, different modes of assistance were automatically offered. Modes of assistance included robotic pointing gestures, speech prompts, and calling a supervisor. Which assistance to offer the different participants during the study was personalized by a shared policy using reinforcement learning. Here, new, non-stationary Contextual Multi-Armed Bandit algorithms were developed during the prior simulation-based study planning to include the workers contextual information. Pioneering results were obtained in three main areas. The participants significantly improved their skills in terms of time required per task. The algorithm learned within only one session per participant which modes of assistance were preferred. Finally, a comparison between simulation and re-simulation, including the study results, revealed the underlying basic assumptions to be correct but individual variation led to strong performance differences in the real-world setting. Looking ahead, the innovative system developed could pave the way for many people with disabilities to enter the open labor market.<\/jats:p>","DOI":"10.1007\/s12369-024-01165-7","type":"journal-article","created":{"date-parts":[[2024,11,30]],"date-time":"2024-11-30T14:36:57Z","timestamp":1732977417000},"page":"1933-1952","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Improving Work Skills in People with Disabilities in a Long-Term, In-Field Study on Robotic Tutors"],"prefix":"10.1007","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0876-856X","authenticated-orcid":false,"given":"Sandra","family":"Drolshagen","sequence":"first","affiliation":[]},{"given":"Max","family":"Pfingsthorn","sequence":"additional","affiliation":[]},{"given":"Andreas","family":"Hein","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,30]]},"reference":[{"key":"1165_CR1","unstructured":"World Health Organization and World Bank (2011) World report on disability (2011). World Health Organization, Geneva, Switzerland"},{"key":"1165_CR2","unstructured":"Convention on the Rights of Persons with Disabilities (2006) (United Nations, New York, USA, 2006)"},{"key":"1165_CR3","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1016\/j.mechatronics.2018.02.009","volume":"55","author":"V Villani","year":"2018","unstructured":"Villani V, Pini F, Leali F, Secchi F (2018) Survey on human-robot collaboration in industrial settings: safety, intuitive interfaces and applications. Mechatronics 55:248\u2013266","journal-title":"Mechatronics"},{"key":"1165_CR4","doi-asserted-by":"publisher","unstructured":"Walters ML, Dautenhahn K, Woods SN, Koay KL (2007) Robotic etiquette: results from user studies involving a fetch and carry task. In: Proceedings of the 2nd ACM\/IEEE international conference human-robot interaction, 9\u201311 March 2007, Arlington, VA, USA, pp 317\u2013324. https:\/\/doi.org\/10.1145\/1228716.1228759","DOI":"10.1145\/1228716.1228759"},{"key":"1165_CR5","doi-asserted-by":"publisher","first-page":"813907","DOI":"10.3389\/frobt.2022.813907","volume":"9","author":"M Lorenzini","year":"2023","unstructured":"Lorenzini M, Lagomarsino M, Fortini L, Gholami S, Ajoudani A (2023) Ergonomic human-robot collaboration in industry: a review. Front Robot AI 9:813907. https:\/\/doi.org\/10.3389\/frobt.2022.813907","journal-title":"Front Robot AI"},{"key":"1165_CR6","doi-asserted-by":"publisher","unstructured":"Paxton C, Hundt A, Jonathan F, Guerin K, Hager GD (2017) CoSTAR: instructing collaborative robots with behavior trees and vision. In: Proceedings of the 2017 IEEE international conference on robotics and automation, 29 May - 3 June 2017, Singapore, pp 564\u2013571. https:\/\/doi.org\/10.1109\/ICRA.2017.7989070","DOI":"10.1109\/ICRA.2017.7989070"},{"key":"1165_CR7","doi-asserted-by":"publisher","unstructured":"Giullian N, Ricks D, Atherton J, Colton M, Goodrich M, Brinton B (2010) Detailed requirements for robots in autism therapy. In: Proceedings of the 2010 IEEE international conference on systems, man and cybernetics, 10\u201313 October 2010, Istanbul, Turkey, pp 2595\u20132602. https:\/\/doi.org\/10.1109\/ICSMC.2010.5641908","DOI":"10.1109\/ICSMC.2010.5641908"},{"key":"1165_CR8","doi-asserted-by":"publisher","unstructured":"Ricks D, Colton M (2010) Trends and considerations in robot-assisted autism therapy. In: Proceedings of the IEEE international conference on robotics and automation, 3\u20137 May 2010, Anchorage, AK, USA, pp 4354\u20134359. https:\/\/doi.org\/10.1109\/ROBOT.2010.5509327","DOI":"10.1109\/ROBOT.2010.5509327"},{"key":"1165_CR9","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1007\/s12369-019-00598-9","volume":"11","author":"M Jouaiti","year":"2019","unstructured":"Jouaiti M, H\u00e9naff P (2019) Robot-based motor rehabilitation in autism: a systematic review. Int J Soc Robot 11:753\u2013764. https:\/\/doi.org\/10.1007\/s12369-019-00598-9","journal-title":"Int J Soc Robot"},{"key":"1165_CR10","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aao6760","author":"O Rudovic","year":"2018","unstructured":"Rudovic O, Lee J, Dai M, Schuller B, Picard RW (2018) Personalized machine learning for robot perception of affect and engagement in autism therapy. Sci Robot. https:\/\/doi.org\/10.1126\/scirobotics.aao6760","journal-title":"Sci Robot"},{"key":"1165_CR11","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1109\/MRA.2018.2868865","volume":"26","author":"C Reardon","year":"2018","unstructured":"Reardon C, Zhang H, Wright R, Parker LE (2018) Robots can teach students with intellectual disabilities: educational benefits of using robotic and augmented reality applications. IEEE Robot Autom Mag 26:79\u201393. https:\/\/doi.org\/10.1109\/MRA.2018.2868865","journal-title":"IEEE Robot Autom Mag"},{"issue":"5","key":"1165_CR12","doi-asserted-by":"publisher","first-page":"132","DOI":"10.3390\/robotics12050132","volume":"12","author":"S Drolshagen","year":"2023","unstructured":"Drolshagen S, Pfingsthorn M, Hein A (2023) Context-aware robotic assistive system: robotic pointing gesture-based assistance for people with disabilities in sheltered workshops. Robotics 12(5):132. https:\/\/doi.org\/10.3390\/robotics12050132","journal-title":"Robotics"},{"key":"1165_CR13","unstructured":"Kremer D (2019) Robotik f\u00fcr den Menschen - Zukunftsszenarien der Mensch-Roboter-Kollaboration im Jahr 2030. AQUIAS research project, Fraunhofer-Institut f\u00fcr Arbeitswirtschaft und Organisation IAO, Stuttgart, Germany"},{"issue":"4","key":"1165_CR14","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1109\/MRA.2013.2275695","volume":"20","author":"A Graser","year":"2013","unstructured":"Graser A, Heyer T, Fotoohi L, Lange U, Kampe H, Enjarini B, Heyer S, Fragkopoulos C, Ristic-Durrant D (2013) A supportive friend at work: robotic workplace assistance for the disabled. IEEE Robot Autom Mag 20(4):148\u2013159. https:\/\/doi.org\/10.1109\/MRA.2013.2275695","journal-title":"IEEE Robot Autom Mag"},{"key":"1165_CR15","doi-asserted-by":"publisher","unstructured":"Kremer D, Hermann S, Henkel C, Schneider M (2018) Inclusion through robotics: designing human-robot collaboration for handicapped workers. In: Peruzzini M, Pellicciari M, Bil C, Stjepandic J, Wognum N (eds) Transdisciplinary engineering methods for social innovation of industry, IOS Press, Amsterdam, The Netherlands, pp 239\u2013248 https:\/\/doi.org\/10.3233\/978-1-61499-898-3-239","DOI":"10.3233\/978-1-61499-898-3-239"},{"key":"1165_CR16","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2020.541741","author":"S Drolshagen","year":"2021","unstructured":"Drolshagen S, Pfingsthorn M, Gliesche P, Hein A (2021) Acceptance of industrial collaborative robots by people with disabilities in sheltered workshops. Front Robot AI. https:\/\/doi.org\/10.3389\/frobt.2020.541741","journal-title":"Front Robot AI"},{"key":"1165_CR17","doi-asserted-by":"publisher","unstructured":"Arboleda SA, Pascher M, Lakhnati Y, Gerken J (2020) Understanding human-robot collaboration for people with mobility impairments at the workplace, a thematic analysis. In: Proceedings of the 29th IEEE international conference on robot and human interactive communication, August\u20134 September 2020, Naples, Italy, pp 561\u2013566. https:\/\/doi.org\/10.1109\/RO-MAN47096.2020.9223489","DOI":"10.1109\/RO-MAN47096.2020.9223489"},{"key":"1165_CR18","doi-asserted-by":"publisher","unstructured":"Arboleda SA, Pascher M, Baumeister A, Klein B, Gerken J (2021) Reflecting upon participatory design in human-robot collaboration for people with motor disabilities: challenges and lessons learned from three multiyear projects. In: Proceedings of the 14th pervasive technologies related to assistive environments conference, 29 June - 1 July 2021, Corfu, Greece, pp 147\u2013155. https:\/\/doi.org\/10.1145\/3453892.3458044","DOI":"10.1145\/3453892.3458044"},{"key":"1165_CR19","unstructured":"Dei C, Meregalli Falerni M, Lavit Nicora M, Chiappini M, Malosio M, Storm FA (2023) Design of a multimodal device to improve well-being of autistic workers interacting with collaborative robots, arXiv:2304.14191v1"},{"key":"1165_CR20","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aat7544","author":"B Scassellati","year":"2018","unstructured":"Scassellati B, Boccanfuso L, Huang CM, Mademtzi M, Qin M, Salomons N, Ventola P, Shic F (2018) Improving social skills in children with ASD using a long-term, in-home social robot. Sci Robot. https:\/\/doi.org\/10.1126\/scirobotics.aat7544","journal-title":"Sci Robot"},{"key":"1165_CR21","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aaz3791","author":"S Jain","year":"2020","unstructured":"Jain S, Thiagarajan B, Shi Z, Clabaugh C, Mataric M (2020) Modeling engagement in long-term, in-home socially assistive robot interventions for children with autism spectrum disorders. Sci Robot. https:\/\/doi.org\/10.1126\/scirobotics.aaz3791","journal-title":"Sci Robot"},{"key":"1165_CR22","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3102\/0013189X013006004","volume":"13","author":"BS Bloom","year":"1984","unstructured":"Bloom BS (1984) The 2 sigma problem: the search for methods of group instruction as effective as one-to-one tutoring. Educ Res 13:4\u201316","journal-title":"Educ Res"},{"key":"1165_CR23","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1007\/BF00168958","volume":"4","author":"HS Nwana","year":"1990","unstructured":"Nwana HS (1990) Intelligent tutoring systems: an overview. Artif Intell Rev 4:251\u2013277. https:\/\/doi.org\/10.1007\/BF00168958","journal-title":"Artif Intell Rev"},{"volume-title":"Intelligent tutoring systems","year":"1982","key":"1165_CR24","unstructured":"Sleeman DH, Brown JS (eds) (1982) Intelligent tutoring systems. Academic Press, New York"},{"key":"1165_CR25","doi-asserted-by":"publisher","first-page":"246","DOI":"10.4324\/9781315617572-24","volume-title":"International handbook of the learning sciences","author":"AC Graesser","year":"2018","unstructured":"Graesser AC, Hu X, Sottilare R (2018) Intelligent tutoring systems. International handbook of the learning sciences. Routledge, London, pp 246\u2013255"},{"issue":"4","key":"1165_CR26","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1080\/00461520.2011.611369","volume":"46","author":"K VanLEHN","year":"2011","unstructured":"VanLEHN K (2011) The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ Psychol 46(4):197\u2013221. https:\/\/doi.org\/10.1080\/00461520.2011.611369","journal-title":"Educ Psychol"},{"key":"1165_CR27","doi-asserted-by":"publisher","first-page":"212","DOI":"10.3200\/JMBR.36.2.212-224","volume":"36","author":"MA Guadagnoli","year":"2004","unstructured":"Guadagnoli MA, Timothy DL (2004) Challenge point: a framework for conceptualizing the effects of various practice conditions in motor learning. J Mot Behav 36:212\u201324. https:\/\/doi.org\/10.3200\/JMBR.36.2.212-224","journal-title":"J Mot Behav"},{"key":"1165_CR28","doi-asserted-by":"publisher","first-page":"3726","DOI":"10.1007\/s10803-013-1918-4","volume":"45","author":"ZE Warren","year":"2015","unstructured":"Warren ZE, Zheng Z, Swanson AR, Bekele ET, Zhang L, Crittendon JA, Weitlauf AF, Sarkar N (2015) Can robotic interaction improve joint attention skills? J Autism Dev Disord 45:3726\u20133734. https:\/\/doi.org\/10.1007\/s10803-013-1918-4","journal-title":"J Autism Dev Disord"},{"key":"1165_CR29","doi-asserted-by":"publisher","first-page":"119","DOI":"10.5898\/JHRI.1.1.Riek","volume":"1","author":"LD Riek","year":"2012","unstructured":"Riek LD (2012) Wizard of Oz studies in HRI: a systematic review and new reporting guidelines. J Hum Robot Interact 1:119\u2013136. https:\/\/doi.org\/10.5898\/JHRI.1.1.Riek","journal-title":"J Hum Robot Interact"},{"key":"1165_CR30","doi-asserted-by":"publisher","unstructured":"Palestra G, Varni G, Chetouani M, Esposito F (2016) A multimodal and multilevel system for robotics treatment of autism in children. In: Proceedings of the international workshop on social learning and multimodal interaction for designing artifcial agents, 16 November 2016, Tokyo, Japan, pp 1\u20136. https:\/\/doi.org\/10.1145\/3005338.3005341","DOI":"10.1145\/3005338.3005341"},{"key":"1165_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-020-09458-7","author":"K Baraka","year":"2020","unstructured":"Baraka K, Melo FS, Couto M, Veloso M (2020) Optimal action sequence generation for assistive agents in fixed horizon tasks. Auton Agent Multi-Agent Syst. https:\/\/doi.org\/10.1007\/s10458-020-09458-7","journal-title":"Auton Agent Multi-Agent Syst"},{"key":"1165_CR32","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aat5954","author":"T Belpaeme","year":"2018","unstructured":"Belpaeme T, Kennedy J, Ramachandran A, Scassellati B, Tanaka F (2018) Social robots for education: a review. Sci Robot. https:\/\/doi.org\/10.1126\/scirobotics.aat5954","journal-title":"Sci Robot"},{"key":"1165_CR33","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1007\/s40593-019-00187-x","volume":"29","author":"S Doroudi","year":"2019","unstructured":"Doroudi S, Aleven V, Brunskill E (2019) Where\u2019s the Reward? Int J Artif Intell Educ 29:568\u2013620. https:\/\/doi.org\/10.1007\/s40593-019-00187-x","journal-title":"Int J Artif Intell Educ"},{"key":"1165_CR34","volume-title":"Dynamic programming and Markov processes","author":"RA Howard","year":"1960","unstructured":"Howard RA (1960) Dynamic programming and Markov processes. MIT Press, Cambridge"},{"key":"1165_CR35","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1037\/H0033475","volume":"96","author":"RC Atkinson","year":"1972","unstructured":"Atkinson RC (1972) Optimizing the learning of a second-language vocabulary. J Exp Psychol 96:124\u2013129. https:\/\/doi.org\/10.1037\/H0033475","journal-title":"J Exp Psychol"},{"key":"1165_CR36","unstructured":"Sondik EJ (1971) The optimal control of partially observable Markov decision processes. PhD thesis, Stanford University, Stanford, CA, USA"},{"key":"1165_CR37","doi-asserted-by":"publisher","first-page":"1290","DOI":"10.1111\/cogs.12290","volume":"40","author":"AN Rafferty","year":"2015","unstructured":"Rafferty AN, Brunskill E, Griffiths TL, Shafto P (2015) Faster teaching via POMDP planning. Cognit Sci 40:1290\u20131332. https:\/\/doi.org\/10.1111\/cogs.12290","journal-title":"Cognit Sci"},{"key":"1165_CR38","doi-asserted-by":"publisher","unstructured":"Barnes TM, Stamper J (2008) Towards automatic hint generation for logic proof tutoring using historical student data. In: Woolf BP, A\u00efmeur E, Nkambou R, Lajoie S (eds) (intelligent tutoring systems. ITS 2008. Lecture notes in computer science, Springer, Berlin, Heidelberg) vol 5091. https:\/\/doi.org\/10.1007\/978-3-540-69132-7_41","DOI":"10.1007\/978-3-540-69132-7_41"},{"key":"1165_CR39","unstructured":"Reddy S, Levine S, Dragan A (2017) Accelerating human learning with deep reinforcement learning. NIPS workshop: teaching machines, robots, and humans, 9 December 2017. Long Beach, CA, USA, pp 5\u20139"},{"key":"1165_CR40","unstructured":"Lee J, Brunskill E (2012) The impact on individualizing student models on necessary practice opportunities. In: Proceedings of the 5th international conference on educational data mining, 19\u201321 June 2012, Chania Greece"},{"key":"1165_CR41","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1090\/S0002-9904-1952-09620-8","volume":"58","author":"H Robbins","year":"1952","unstructured":"Robbins H (1952) Some aspects of the sequential design of experiments. Bull Am Math Soc 58:527\u2013535","journal-title":"Bull Am Math Soc"},{"key":"1165_CR42","unstructured":"Clement B, Oudeyer PY, Lopes M (2016) A comparison of automatic teaching strategies for heterogeneous student populations. In: Proceedings of the 9th international conference on educational data mining, 29 June- 2 July 2016, Raleigh, NC, USA, pp 330\u2013335"},{"issue":"8","key":"1165_CR43","doi-asserted-by":"publisher","first-page":"4378","DOI":"10.1109\/LRA.2023.3280752","volume":"8","author":"M Lagomarsino","year":"2023","unstructured":"Lagomarsino M, Lorenzini M, Constable MD, Becchio C, Ajoudani A (2023) Maximising coefficiency in human-robot handovers through reinforcement learning. IEEE Robot Autom Lett 8(8):4378\u20134385","journal-title":"IEEE Robot Autom Lett"},{"key":"1165_CR44","doi-asserted-by":"crossref","unstructured":"Pandya R, Huang SH, Hadfield-Menell D, Dragan AD (2019) Human-AI learning performance in multi-armed bandits. In: Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society (AIES \u201919). Association for Computing Machinery, New York, NY, USA, pp 369\u2013375","DOI":"10.1145\/3306618.3314245"},{"key":"1165_CR45","unstructured":"Lan AS, Baraniuk RG (2016) A contextual bandits framework for personalized learning action selection. In: Proceedings of the 9th international conference on educational data mining, 29 June\u20132 July 2016, Raleigh, NC, USA, pp 424\u2013429"},{"key":"1165_CR46","doi-asserted-by":"publisher","unstructured":"Wu Q, Iyer N, Wang H (2018) Learning contextual bandits in a non-stationary environment. In: Proceedings of the 41st international ACM SIGIR conference on research and development in information retrieval. 8-12 July 2018, Ann Arbor, MI, USA, pp 495\u2013504. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3209978.3210051","DOI":"10.1145\/3209978.3210051"},{"key":"1165_CR47","unstructured":"Russac Y, Vernade C, Capp\u00e9 O (2019) Weighted linear bandits for non-stationary environments. In: Proceedings of the 33rd conference on neural information processing systems, 8\u201314 December 2019, Vancouver, Canada"},{"key":"1165_CR48","unstructured":"Hartland C, Gelly S, Baskiotis N, Teytaud O, Sebag O (2006) Multi-armed Bandit, Dynamic Environments and Meta-Bandits, hal-00113668"},{"key":"1165_CR49","doi-asserted-by":"publisher","unstructured":"Garivier A, Moulines E (2011) On upper-confidence bound policies for switching bandit problems. In: Kivinen J, Szepesv\u00e1ri C, Ukkonen E, Zeugmann T(eds) Algorithmic learning theory. Lecture Notes in Computer Science, vol 6925. Springer, Berlin, Heidelberg, https:\/\/doi.org\/10.1007\/978-3-642-24412-4_16","DOI":"10.1007\/978-3-642-24412-4_16"},{"key":"1165_CR50","unstructured":"Kr\u00e4ling K (2000) Auf der Suche nach einem Sinnerf\u00fcllten Lebensabend. Tagesstrukturierende Angebote und Rahmenbedingungen f\u00fcr \u00c4lter werdende und alte Menschen mit geistiger Behinderung. In: Fachdienst der Lebenshilfe 2, (Bundesvereinigung Lebenshilfe f\u00fcr Menschen mit geistiger Behinderung e.V., Marburg, Germany, 2000)"},{"key":"1165_CR51","unstructured":"Dud\u00edk M, Erhan D, Langford J, Li L (2012) Sample-efficient nonstationary policy evaluation for contextual bandits. In: Proceedings of the twenty-eighth conference on uncertainty in artificial intelligence, AUAI Press, 14\u201318 August 2012, Arlington, Virginia, USA, pp 247\u2013254"},{"key":"1165_CR52","doi-asserted-by":"publisher","unstructured":"Li L, Chu W, Langford J, Schapire RE (2010) A contextual-bandit approach to personalized news article recommendation. In: Proceedings of the 19th international conference on World wide web, 26\u201330 April 2010, Raleigh, NC, USA, pp 661\u2013670. https:\/\/doi.org\/10.1145\/1772690.1772758","DOI":"10.1145\/1772690.1772758"},{"key":"1165_CR53","doi-asserted-by":"publisher","unstructured":"Li L, Chu W, Langford J, Wang X (2011) Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms. In: Proceedings of the fourth ACM international conference on Web search and data mining, 9\u201312 February 2011, Hong Kong, China, pp 297\u2013306. Publisher: Association for Computing Machinery, New York, NY, United States. https:\/\/doi.org\/10.1145\/1935826.1935878","DOI":"10.1145\/1935826.1935878"},{"key":"1165_CR54","doi-asserted-by":"publisher","first-page":"20","DOI":"10.5281\/zenodo.3554667","volume":"7","author":"B Clement","year":"2015","unstructured":"Clement B, Rox D, Oudeyer PY (2015) Multi-armed bandits for intelligent tutoring systems. J Educ Data Min 7:20\u201348. https:\/\/doi.org\/10.5281\/zenodo.3554667","journal-title":"J Educ Data Min"},{"key":"1165_CR55","doi-asserted-by":"publisher","first-page":"107","DOI":"10.3233\/DS-200028","volume":"3","author":"F den Hengst","year":"2020","unstructured":"den Hengst F, Grua EM, el Hassouni A, Hoogendoorn M (2020) Reinforcement Learning for Personalization: a Systematic Literature Review. Data Sci 3:107\u2013147. https:\/\/doi.org\/10.3233\/DS-200028","journal-title":"Data Sci"},{"key":"1165_CR56","unstructured":"Hambleton RK (1991) Fundamentals of item response theory, vol 2. Sage Publications"},{"key":"1165_CR57","unstructured":"Funk M (2016) Augmented reality at the workplace - a context-aware assistive system using in-situ projection. PhD thesis, Institut f\u00fcr Visualisierung und Interaktive Systeme der Universit\u00e4t Stuttgart, Stuttgart, Germany"},{"key":"1165_CR58","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1016\/0196-8858(85)90002-8","volume":"6","author":"TL Lai","year":"1985","unstructured":"Lai TL, Robbins H (1985) Asymptotically efficient adaptive allocation rules. Adv Appl Math 6:4\u201322. https:\/\/doi.org\/10.1016\/0196-8858(85)90002-8","journal-title":"Adv Appl Math"},{"key":"1165_CR59","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.2307\/1427934","volume":"27","author":"R Agrawal","year":"1995","unstructured":"Agrawal R (1995) Sample mean based index policies with O(log n) regret for the multi-armed bandit problem. Adv Appl Probab 27:1054\u20131078. https:\/\/doi.org\/10.2307\/1427934","journal-title":"Adv Appl Probab"},{"key":"1165_CR60","doi-asserted-by":"crossref","unstructured":"Tran-Thanh L, Chapman A, Munoz De Cote Flores Luna J, Rogers A, Jennings N (2010) Epsilon-first policies for budget-limited multi-armed bandits. In: Twenty-fourth AAAI conference on artificial intelligence, pp 1211\u20131216","DOI":"10.1609\/aaai.v24i1.7758"},{"key":"1165_CR61","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1109\/TSMCC.2011.2106494","volume":"42","author":"S Adam","year":"2012","unstructured":"Adam S, Busoniu L, Babuska R (2012) Experience replay for real-time reinforcement learning control. IEEE Trans Syst Man Cybern Part C (Appl Rev) 42:201\u2013212. https:\/\/doi.org\/10.1109\/TSMCC.2011.2106494","journal-title":"IEEE Trans Syst Man Cybern Part C (Appl Rev)"},{"key":"1165_CR62","doi-asserted-by":"publisher","unstructured":"Jiang L, Huang H, Ding Z (2020) Path planning for intelligent robots based on deep Q-learning with experience replay and heuristic knowledge. IEEE\/CAA J Autom Sin 7:1179\u20131189. https:\/\/doi.org\/10.1109\/JAS.2019.1911732","DOI":"10.1109\/JAS.2019.1911732"},{"key":"1165_CR63","unstructured":"Quigley M, Gerkey B, Conley K, Faust J, Foote T, Leibs J, Ng AY (2009) ROS: an open-source robot operating system. in: ICRA workshop on open source software, vol 3, p 5"},{"key":"1165_CR64","doi-asserted-by":"crossref","unstructured":"Colledanchise M, \u00d6gren P (2018) Behavior trees in robotics and AI: an introduction. CRC Press, Boca Raton","DOI":"10.1201\/9780429489105"},{"key":"1165_CR65","unstructured":"Faconti D (2019) MOOD2Be: models and tools to design robotic behaviors. Autonomous System Group, Eurocat Centre Tecnologic, Barcelona, Spain"},{"key":"1165_CR66","doi-asserted-by":"publisher","first-page":"3912","DOI":"10.3390\/s20143912","volume":"20","author":"Rico F Mart\u00edn","year":"2020","unstructured":"Mart\u00edn Rico F, Rodr\u00edguez-Lera FJ, Gin\u00e9s Clavero J, Guerrero-Higueras \u00c1M, Matell\u00e1n Olivera V (2020) An acceptance test for assistive robots. Sensors 20:3912. https:\/\/doi.org\/10.3390\/s20143912","journal-title":"Sensors"},{"key":"1165_CR67","unstructured":"R Core Team (2012) R: A language and environment for statistical computing. (R Foundation for Statistical Computing, Vienna, Austria, 2012)"},{"key":"1165_CR68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","volume":"67","author":"D Bates","year":"2015","unstructured":"Bates D, M\u00e4chler M, Bolker B, Walker S (2015) Fitting linear mixed-effects models using lme4. J Stat Softw 67:1\u201348. https:\/\/doi.org\/10.18637\/jss.v067.i01","journal-title":"J Stat Softw"},{"key":"1165_CR69","unstructured":"Barto\u0144 K (2022) MuMIn\u2014multi-model inference. (R Package, 2022)"},{"key":"1165_CR70","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1007\/s11910-017-0723-4","volume":"17","author":"TP Garcia","year":"2017","unstructured":"Garcia TP, Marder K (2017) Statistical approaches to longitudinal data analysis in neurodegenerative diseases: Huntington\u2019s disease as a model. Curr Neurol Neurosci Rep 17:14. https:\/\/doi.org\/10.1007\/s11910-017-0723-4","journal-title":"Curr Neurol Neurosci Rep"},{"key":"1165_CR71","doi-asserted-by":"publisher","DOI":"10.4324\/9781315165547","volume-title":"Statistics for linguists: an introduction using r","author":"B Winter","year":"2019","unstructured":"Winter B (2019) Statistics for linguists: an introduction using r. Routledge, London"},{"key":"1165_CR72","doi-asserted-by":"publisher","first-page":"5978","DOI":"10.3390\/su11215978","volume":"11","author":"BG Mark","year":"2019","unstructured":"Mark BG, Hofmayer S, Rauch E, Matt DT (2019) Inclusion of workers with disabilities in production 4.0: legal foundations in Europe and potentials through worker assistance system. Sustainability 11:5978. https:\/\/doi.org\/10.3390\/su11215978","journal-title":"Sustainability"},{"key":"1165_CR73","doi-asserted-by":"publisher","first-page":"110","DOI":"10.3389\/frobt.2019.00110","volume":"6","author":"C Clabaugh","year":"2019","unstructured":"Clabaugh C, Mahajan K, Jain S, Pakkar R, Becerra D, Shi Z, Deng E, Lee R, Ragusa G, Matari\u0107 MJ (2019) Long-term personalization of an in-home socially assistive robot for children with autism spectrum disorders. Front Robot AI 6:110. https:\/\/doi.org\/10.3389\/frobt.2019.00110","journal-title":"Front Robot AI"}],"container-title":["International Journal of Social Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-024-01165-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12369-024-01165-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-024-01165-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,9]],"date-time":"2024-12-09T16:21:50Z","timestamp":1733761310000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12369-024-01165-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10]]},"references-count":73,"journal-issue":{"issue":"9-10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["1165"],"URL":"https:\/\/doi.org\/10.1007\/s12369-024-01165-7","relation":{},"ISSN":["1875-4791","1875-4805"],"issn-type":[{"type":"print","value":"1875-4791"},{"type":"electronic","value":"1875-4805"}],"subject":[],"published":{"date-parts":[[2024,10]]},"assertion":[{"value":"29 July 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 November 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This study was carried out in line with the principles of the Declaration of Helsinki and in accordance with the recommendations of the regulations governing the principles for safeguarding good academic practice at the Carl von Ossietzky University Oldenburg, Germany, by the Commission for Research Impact Assessment and Ethics. The protocol was approved by the Commission for Research Impact Assessment and Ethics (Drs.EK\/2019\/038-1).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"All participants, or, if required, their legal guardian, gave written informed consent.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"The supplementary materials contain Movies S1 to S4, which are exemplary scenes from the study in which the IRTS provides modes of assistance to the participants.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Supplementary information"}}]}}