{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T10:18:40Z","timestamp":1777976320466,"version":"3.51.4"},"reference-count":66,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T00:00:00Z","timestamp":1777939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Spanish Ministry for Digital Transformation and the Civil Service","award":["TSI-064100-2022-025"],"award-info":[{"award-number":["TSI-064100-2022-025"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Laparoscopy is one of the most widely used surgical techniques in clinical practice. However, its practice is associated with medium- and long-term musculoskeletal disorders in surgeons. In this context, robot-assisted surgery has emerged as a promising approach for mitigating ergonomic constraints while enhancing control and precision during laparoscope manipulation. Despite these advances, existing research predominantly focuses on robotic control strategies, whereas the study of human\u2013robot interaction in the operating room remains comparatively underexplored. This paper presents a proof-of-concept framework for workspace-aware posture adaptation in collaborative surgical robotics. The proposed approach combines vision-based human activity recognition with reinforcement learning to control the shoulder\u2013elbow\u2013wrist redundant angle of a seven-degree-of-freedom manipulator holding a laparoscope. Based on the detected interaction context, the system distinguishes between controlling, observing, cutting, and blocked states. During the observation and cutting phases, the controller allows the robot\u2019s posture to be reconfigured so that it tilts away from the human operator while maintaining the position of the laparoscope; when the surgeon moves away, the robot gradually returns to its default configuration. Two reward formulations, dense and fuzzy, are compared. Real-world experiments show that both approaches learn the desired reflexive behavior, while the fuzzy reward yields improved training stability and more consistent real-system performance, increasing workspace availability around the surgeon.<\/jats:p>","DOI":"10.3390\/s26092881","type":"journal-article","created":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T10:01:30Z","timestamp":1777975290000},"page":"2881","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Adaptive Control of the Redundant Axis of a Surgical Robot for Operating Room Workspace Optimization Using Reinforcement Learning"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-7236-9613","authenticated-orcid":false,"given":"Irati","family":"Renedo-Alonso","sequence":"first","affiliation":[{"name":"Robotics and Automation Electronics and Computer Science Department, University of Mondragon, 20500 Mondragon, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0100-2695","authenticated-orcid":false,"given":"Juan A.","family":"S\u00e1nchez-Margallo","sequence":"additional","affiliation":[{"name":"Bioengineering and Health Technologies Unit, Jes\u00fas Us\u00f3n Minimally Invasive Surgery Centre, 10071 C\u00e1ceres, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3305-8108","authenticated-orcid":false,"given":"Nestor","family":"Arana-Arexolaleiba","sequence":"additional","affiliation":[{"name":"Robotics and Automation Electronics and Computer Science Department, University of Mondragon, 20500 Mondragon, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6511-8542","authenticated-orcid":false,"given":"\u00cd\u00f1igo","family":"Elguea-Aguinaco","sequence":"additional","affiliation":[{"name":"Research & Development Department, Electrot\u00e9cnica Alavesa S.L., 01010 Vitoria-Gasteiz, Spain"},{"name":"Research & Development Department, Sortech 2030 S.L., 31800 Alsasua, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"238","DOI":"10.5662\/wjm.v5.i4.238","article-title":"Laparoscopic surgery: A qualified systematic review","volume":"5","author":"Buia","year":"2015","journal-title":"World J. Methodol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhai, L., Chen, Y., and Zhang, S. (2024). The effect of laparoscopic and abdominal surgery on the treatment of ectopic pregnancy: A systematic review and meta-analysis. Front. Med., 11.","DOI":"10.3389\/fmed.2024.1400970"},{"key":"ref_3","first-page":"800295","article-title":"Artificial intelligence, predictive modelling and robotics in minimally invasive surgery: Towards precision surgery","volume":"104","author":"Caballero","year":"2026","journal-title":"Cirug\u00eda Espa\u00f1ola (Engl. Ed.)"},{"key":"ref_4","first-page":"222","article-title":"Ergonom\u00eda en cirug\u00eda laparosc\u00f3pica ginecol\u00f3gica Ergonomics and gynecologic laparoscopic surgery","volume":"85","author":"Allendes","year":"2020","journal-title":"Comentario Sobre la Asociaci\u00f3n Entre la v\u00eda de Parto y el Da\u00f1o Perineal e Incontinencia Urinaria y Fecal"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bessone, V., Roppenecker, D.B., and Adamsen, S. (2024). Work-related musculoskeletal injury rates, risk factors, and ergonomics in different endoscopic specialties: A review. Healthcare, 12.","DOI":"10.3390\/healthcare12090885"},{"key":"ref_6","first-page":"1","article-title":"Minimal access surgery (MAS)-related surgeon morbidity syndromes","volume":"20","author":"Reyes","year":"2006","journal-title":"Surg. Endosc. Other Interv. Tech."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"142","DOI":"10.4253\/wjge.v14.i3.142","article-title":"Ergonomics of gastrointestinal endoscopies: Musculoskeletal injury among endoscopy physicians, nurses, and technicians","volume":"14","author":"Shah","year":"2022","journal-title":"World J. Gastrointest. Endosc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"E1095","DOI":"10.1055\/a-1869-9202","article-title":"Endoscopy-related injury among gastroenterology trainees","volume":"10","author":"Pawa","year":"2022","journal-title":"Endosc. Int. Open"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Salazar, M.J., Caballero, D., S\u00e1nchez-Margallo, J.A., and S\u00e1nchez-Margallo, F.M. (2024). Comparative study of ergonomics in conventional and robotic-assisted laparoscopic surgery. Sensors, 24.","DOI":"10.3390\/s24123840"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5669","DOI":"10.55248\/gengpi.6.0325.11166","article-title":"Reinforcement Learning for Robotic-Assisted Surgeries: Optimizing Procedural Outcomes and Minimizing Post-Operative Complication","volume":"6","author":"Kumar","year":"2025","journal-title":"Int. J. Res. Publ. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1145\/3722121","article-title":"Evaluating Human-Robot Interfaces for Maneuvering Surgical Laparoscopes using Robotic Scope Assistant Systems","volume":"14","author":"Basha","year":"2025","journal-title":"ACM Trans. Hum.-Robot Interact."},{"key":"ref_12","first-page":"609","article-title":"What have we learnt after two years working with the da Vinci robot system in digestive surgery?","volume":"104","author":"Hubens","year":"2004","journal-title":"Acta Chir. Belg."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"105824","DOI":"10.1016\/j.mechmachtheory.2024.105824","article-title":"Redundancy parameterization and inverse kinematics of 7-DOF revolute manipulators","volume":"204","author":"Elias","year":"2024","journal-title":"Mech. Mach. Theory"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Elguea-Aguinaco, \u00cd., Serrano-Mu\u00f1oz, A., Chrysostomou, D., Inziarte-Hidalgo, I., B\u00f8gh, S., and Arana-Arexolaleiba, N. (2022). Goal-conditioned reinforcement learning within a human\u2013robot disassembly environment. Appl. Sci., 12.","DOI":"10.3390\/app122211610"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1636497","DOI":"10.1155\/int\/1636497","article-title":"A Review on Reinforcement Learning for Motion Planning of Robotic Manipulators","volume":"2024","year":"2024","journal-title":"Int. J. Intell. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_17","first-page":"17665","article-title":"Lapgym-an open source framework for reinforcement learning in robot-assisted laparoscopic surgery","volume":"24","author":"Scheikl","year":"2023","journal-title":"J. Mach. Learn. Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3861","DOI":"10.1109\/TFUZZ.2024.3387429","article-title":"Fuzzy machine learning: A comprehensive framework and systematic review","volume":"32","author":"Lu","year":"2024","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1038\/s41746-024-01316-0","article-title":"A primer on reinforcement learning in medicine for clinicians","volume":"7","author":"Jayaraman","year":"2024","journal-title":"NPJ Digit. Med."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lowery, C., and Faisal, A.A. (2013). Towards efficient, personalized anesthesia using continuous reinforcement learning for propofol infusion control. Proceedings of the 2013 6th International IEEE\/EMBS Conference on Neural Engineering (NER), IEEE.","DOI":"10.1109\/NER.2013.6696208"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Qian, C., and Ren, H. (2025). Deep reinforcement learning in surgical robotics: Enhancing the automation level. Handbook of Robotic Surgery, Elsevier.","DOI":"10.1016\/B978-0-443-13271-1.00055-8"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Murali, A., Sen, S., Kehoe, B., Garg, A., McFarland, S., Patil, S., Boyd, W.D., Lim, S., Abbeel, P., and Goldberg, K. (2015). Learning by observation for surgical subtasks: Multilateral cutting of 3d viscoelastic and 2d orthotropic tissue phantoms. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ICRA.2015.7139344"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Thananjeyan, B., Garg, A., Krishnan, S., Chen, C., Miller, L., and Goldberg, K. (2017). Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ICRA.2017.7989275"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2502","DOI":"10.1109\/LRA.2023.3254860","article-title":"Sim-to-real surgical robot learning and autonomous planning for internal tissue points manipulation using reinforcement learning","volume":"8","author":"Ou","year":"2023","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nguyen, T., Nguyen, N.D., Bello, F., and Nahavandi, S. (2019). A new tensioning method using deep reinforcement learning for surgical pattern cutting. Proceedings of the 2019 IEEE International Conference on Industrial Technology (ICIT), IEEE.","DOI":"10.1109\/ICIT.2019.8755235"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Nguyen, N.D., Nguyen, T., Nahavandi, S., Bhatti, A., and Guest, G. (2019). Manipulating soft tissues by deep reinforcement learning for autonomous robotic surgery. Proceedings of the 2019 IEEE International Systems Conference (SysCon), IEEE.","DOI":"10.1109\/SYSCON.2019.8836924"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"0114","DOI":"10.34133\/cbsystems.0114","article-title":"Intuition-guided reinforcement learning for soft tissue manipulation with unknown constraints","volume":"6","author":"He","year":"2025","journal-title":"Cyborg Bionic Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shin, C., Ferguson, P.W., Pedram, S.A., Ma, J., Dutson, E.P., and Rosen, J. (2019). Autonomous tissue manipulation via surgical robot using learning based model predictive control. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ICRA.2019.8794159"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1177\/0278364918784350","article-title":"SWIRL: A sequential windowed inverse reinforcement learning algorithm for robot tasks with delayed rewards","volume":"38","author":"Krishnan","year":"2019","journal-title":"Int. J. Robot. Res."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Pedram, S.A., Ferguson, P.W., Shin, C., Mehta, A., Dutson, E.P., Alambeigi, F., and Rosen, J. (2020). Toward synergic learning for autonomous manipulation of deformable tissues via surgical robots: An approximate q-learning approach. Proceedings of the 2020 8th IEEE RAS\/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob), IEEE.","DOI":"10.1109\/BioRob49111.2020.9224421"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Huang, T., Chen, K., Li, B., Liu, Y.H., and Dou, Q. (2023). Guided reinforcement learning with efficient exploration for task automation of surgical robot. arXiv.","DOI":"10.1109\/ICRA48891.2023.10160327"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3374","DOI":"10.1109\/TAI.2024.3351797","article-title":"Learn from safe experience: Safe reinforcement learning for task automation of surgical robot","volume":"5","author":"Fan","year":"2024","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_33","first-page":"100290","article-title":"Deep reinforcement learning-based dynamic path planning of flexible needle in robotic puncturing","volume":"6","author":"Leng","year":"2026","journal-title":"Biomim. Intell. Robot."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"13145","DOI":"10.1109\/LRA.2025.3627088","article-title":"SurgIRL: Toward Life-Long Learning for Surgical Automation by Incremental Reinforcement Learning","volume":"10","author":"Ho","year":"2025","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"101964","DOI":"10.1016\/j.artmed.2020.101964","article-title":"Reinforcement learning for intelligent healthcare applications: A survey","volume":"109","author":"Coronato","year":"2020","journal-title":"Artif. Intell. Med."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kaur, P., and Mahajan, R. (2024). Human Robot Collaboration in Surgery: Communication Interface and Interaction Design. Proceedings of the 2024 MIT Art, Design and Technology School of Computing International Conference (MITADTSoCiCon), IEEE.","DOI":"10.1109\/MITADTSoCiCon60330.2024.10575199"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Colan, J., Davila, A., Yamada, Y., and Hasegawa, Y. (2025). Human-Robot collaboration in surgery: Advances and challenges towards autonomous surgical assistants. Proceedings of the 2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), IEEE.","DOI":"10.1109\/RO-MAN63969.2025.11217781"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2400319","DOI":"10.1002\/aisy.202400319","article-title":"Review of human\u2013robot collaboration in robotic surgery","volume":"7","author":"Wan","year":"2025","journal-title":"Adv. Intell. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1007\/s10514-017-9670-9","article-title":"Early prediction for physical human robot collaboration in the operating room","volume":"42","author":"Zhou","year":"2018","journal-title":"Auton. Robot."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Su, H., Sandoval, J., Makhdoomi, M., Ferrigno, G., and De Momi, E. (2018). Safety-enhanced human\u2013robot interaction control of redundant robot for teleoperated minimally invasive surgery. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ICRA.2018.8463148"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1109\/LRA.2019.2897145","article-title":"Improved human\u2013robot collaborative control of redundant robot for teleoperated minimally invasive surgery","volume":"4","author":"Su","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/TMRB.2026.3654137","article-title":"Human\u2013robot collaboration in healthcare: A comprehensive review of key components, applications, and future research","volume":"8","author":"Yang","year":"2026","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/3623384","article-title":"Unified learning from demonstrations, corrections, and preferences during physical human\u2013robot interaction","volume":"13","author":"Mehta","year":"2024","journal-title":"ACM Trans. Hum.-Robot Interact."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"112870","DOI":"10.1016\/j.knosys.2024.112870","article-title":"Novel automated interactive reinforcement learning framework with a constraint-based supervisor for procedural tasks","volume":"309","year":"2025","journal-title":"Knowl.-Based Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/LRA.2020.3047730","article-title":"Human-centered collaborative robots with deep reinforcement learning","volume":"6","author":"Ghadirzadeh","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"31282","DOI":"10.1109\/ACCESS.2023.3262450","article-title":"Affordance-based human\u2013robot interaction with reinforcement learning","volume":"11","author":"Veeramani","year":"2023","journal-title":"IEEE Access"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/2.53","article-title":"Fuzzy logic","volume":"21","author":"Zadeh","year":"1988","journal-title":"Computer"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhao, W., Queralta, J.P., and Westerlund, T. (2020). Sim-to-real transfer in deep reinforcement learning for robotics: A survey. Proceedings of the 2020 IEEE Symposium Series on Computational Intelligence (SSCI), IEEE.","DOI":"10.1109\/SSCI47803.2020.9308468"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_51","first-page":"12005","article-title":"skrl: Modular and flexible library for reinforcement learning","volume":"24","author":"Chrysostomou","year":"2023","journal-title":"J. Mach. Learn. Res."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Serrano-Mu\u00f1oz, A., Elguea-Aguinaco, \u00cd., Chrysostomou, D., B\u00f8gh, S., and Arana-Arexolaleiba, N. (2023). A scalable and unified multi-control framework for KUKA LBR iiwa collaborative robots. Proceedings of the 2023 IEEE\/SICE International Symposium on System Integration (SII), IEEE.","DOI":"10.1109\/SII55687.2023.10039308"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., and Abbeel, P. (2017). Domain randomization for transferring deep neural networks from simulation to the real world. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.","DOI":"10.1109\/IROS.2017.8202133"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"4710","DOI":"10.1109\/TIE.2017.2674624","article-title":"Manipulability optimization of redundant manipulators using dynamic neural networks","volume":"64","author":"Jin","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Shi, X., Guo, Y., Chen, X., Chen, Z., and Yang, Z. (2021). Kinematics and singularity analysis of a 7-DOF redundant manipulator. Sensors, 21.","DOI":"10.3390\/s21217257"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"7469","DOI":"10.1109\/TII.2019.2957186","article-title":"A fault-tolerant method for motion planning of industrial redundant manipulator","volume":"16","author":"Li","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Wang, H. (2025). Redundancy-based motion planning with task constraints for robot manipulators. Sensors, 25.","DOI":"10.3390\/s25061900"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1109\/TRO.2015.2430053","article-title":"Variable impedance control of redundant manipulators for intuitive human\u2013robot physical interaction","volume":"31","author":"Ficuciello","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1109\/TRO.2019.2945876","article-title":"Hierarchical impedance-based tracking control of kinematically redundant robots","volume":"36","author":"Dietrich","year":"2019","journal-title":"IEEE Trans. Robot."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"132344","DOI":"10.1016\/j.eswa.2026.132344","article-title":"Evolution of fuzzy logic in medical applications: Methods, trends and clinical applications","volume":"321","author":"Salvi","year":"2026","journal-title":"Expert Syst. Appl."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Autsou, S., Dunajeva, O., Pentel, A., Shvets, O., and Roosileht, M. (2025). Application of fuzzy logic for collaborative robot control. Electronics, 14.","DOI":"10.3390\/electronics14204029"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Odriozola-Olalde, H., Zamalloa, M., and Arana-Arexolaleiba, N. (2023). Shielded reinforcement learning: A review of reactive methods for safe learning. Proceedings of the 2023 IEEE\/SICE International Symposium on System Integration (SII), IEEE.","DOI":"10.1109\/SII55687.2023.10039301"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"McAtamney, L., and Corlett, N. (2004). Rapid upper limb assessment (RULA). Handbook of Human Factors and Ergonomics Methods, CRC Press.","DOI":"10.1201\/9780203489925.ch7"},{"key":"ref_64","unstructured":"Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv."},{"key":"ref_65","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv."},{"key":"ref_66","unstructured":"Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018). Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. Proceedings of the International Conference on Machine Learning, Pmlr."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/9\/2881\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T10:05:18Z","timestamp":1777975518000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/9\/2881"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,5]]},"references-count":66,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["s26092881"],"URL":"https:\/\/doi.org\/10.3390\/s26092881","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,5]]}}}