{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T01:12:13Z","timestamp":1774573933526,"version":"3.50.1"},"reference-count":146,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T00:00:00Z","timestamp":1731369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["955901"],"award-info":[{"award-number":["955901"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["CUP G43C22001370007"],"award-info":[{"award-number":["CUP G43C22001370007"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["ECS00000037"],"award-info":[{"award-number":["ECS00000037"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["2023-NAZ-0207\/DIP-ECC-DISCO23"],"award-info":[{"award-number":["2023-NAZ-0207\/DIP-ECC-DISCO23"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["232\/2016"],"award-info":[{"award-number":["232\/2016"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["4-PE00000013-D53C22002380006"],"award-info":[{"award-number":["4-PE00000013-D53C22002380006"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["NRPP M4C2"],"award-info":[{"award-number":["NRPP M4C2"]}]},{"name":"European Union-NextGenerationEU","award":["955901"],"award-info":[{"award-number":["955901"]}]},{"name":"European Union-NextGenerationEU","award":["CUP G43C22001370007"],"award-info":[{"award-number":["CUP G43C22001370007"]}]},{"name":"European Union-NextGenerationEU","award":["ECS00000037"],"award-info":[{"award-number":["ECS00000037"]}]},{"name":"European Union-NextGenerationEU","award":["2023-NAZ-0207\/DIP-ECC-DISCO23"],"award-info":[{"award-number":["2023-NAZ-0207\/DIP-ECC-DISCO23"]}]},{"name":"European Union-NextGenerationEU","award":["232\/2016"],"award-info":[{"award-number":["232\/2016"]}]},{"name":"European Union-NextGenerationEU","award":["4-PE00000013-D53C22002380006"],"award-info":[{"award-number":["4-PE00000013-D53C22002380006"]}]},{"name":"European Union-NextGenerationEU","award":["NRPP M4C2"],"award-info":[{"award-number":["NRPP M4C2"]}]},{"name":"Italian University and Research Ministry","award":["955901"],"award-info":[{"award-number":["955901"]}]},{"name":"Italian University and Research Ministry","award":["CUP G43C22001370007"],"award-info":[{"award-number":["CUP G43C22001370007"]}]},{"name":"Italian University and Research Ministry","award":["ECS00000037"],"award-info":[{"award-number":["ECS00000037"]}]},{"name":"Italian University and Research Ministry","award":["2023-NAZ-0207\/DIP-ECC-DISCO23"],"award-info":[{"award-number":["2023-NAZ-0207\/DIP-ECC-DISCO23"]}]},{"name":"Italian University and Research Ministry","award":["232\/2016"],"award-info":[{"award-number":["232\/2016"]}]},{"name":"Italian University and Research Ministry","award":["4-PE00000013-D53C22002380006"],"award-info":[{"award-number":["4-PE00000013-D53C22002380006"]}]},{"name":"Italian University and Research Ministry","award":["NRPP M4C2"],"award-info":[{"award-number":["NRPP M4C2"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["955901"],"award-info":[{"award-number":["955901"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["CUP G43C22001370007"],"award-info":[{"award-number":["CUP G43C22001370007"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["ECS00000037"],"award-info":[{"award-number":["ECS00000037"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["2023-NAZ-0207\/DIP-ECC-DISCO23"],"award-info":[{"award-number":["2023-NAZ-0207\/DIP-ECC-DISCO23"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["232\/2016"],"award-info":[{"award-number":["232\/2016"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["4-PE00000013-D53C22002380006"],"award-info":[{"award-number":["4-PE00000013-D53C22002380006"]}]},{"name":"FAIR-Future Artificial Intelligence Research-Spoke","award":["NRPP M4C2"],"award-info":[{"award-number":["NRPP M4C2"]}]},{"name":"European Union-Next Generation EU","award":["955901"],"award-info":[{"award-number":["955901"]}]},{"name":"European Union-Next Generation EU","award":["CUP G43C22001370007"],"award-info":[{"award-number":["CUP G43C22001370007"]}]},{"name":"European Union-Next Generation EU","award":["ECS00000037"],"award-info":[{"award-number":["ECS00000037"]}]},{"name":"European Union-Next Generation EU","award":["2023-NAZ-0207\/DIP-ECC-DISCO23"],"award-info":[{"award-number":["2023-NAZ-0207\/DIP-ECC-DISCO23"]}]},{"name":"European Union-Next Generation EU","award":["232\/2016"],"award-info":[{"award-number":["232\/2016"]}]},{"name":"European Union-Next Generation EU","award":["4-PE00000013-D53C22002380006"],"award-info":[{"award-number":["4-PE00000013-D53C22002380006"]}]},{"name":"European Union-Next Generation EU","award":["NRPP M4C2"],"award-info":[{"award-number":["NRPP M4C2"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>While AI-driven automation can increase the performance and safety of systems, humans should not be replaced in safety-critical systems but should be integrated to collaborate and mitigate each other\u2019s limitations. The current trend in Industry 5.0 is towards human-centric collaborative paradigms, with an emphasis on collaborative intelligence (CI) or Hybrid Intelligent Systems. In this survey, we search and review recent work that employs AI methods for collaborative intelligence applications, specifically those that focus on safety and safety-critical industries. We aim to contribute to the research landscape and industry by compiling and analyzing a range of scenarios where AI can be used to achieve more efficient human\u2013machine interactions, improved collaboration, coordination, and safety. We define a domain-focused taxonomy to categorize the diverse CI solutions, based on the type of collaborative interaction between intelligent systems and humans, the AI paradigm used and the domain of the AI problem, while highlighting safety issues. We investigate 91 articles on CI research published between 2014 and 2023, providing insights into the trends, gaps, and techniques used, to guide recommendations for future research opportunities in the fast developing collaborative intelligence field.<\/jats:p>","DOI":"10.3390\/info15110728","type":"journal-article","created":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T08:12:39Z","timestamp":1731399159000},"page":"728","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Collaborative Intelligence for Safety-Critical Industries: A Literature Review"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3576-2550","authenticated-orcid":false,"given":"In\u00eas F.","family":"Ramos","sequence":"first","affiliation":[{"name":"Department of Computer Science, Universit\u00e0 degli Studi di Milano, 20122 Milano, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5186-0199","authenticated-orcid":false,"given":"Gabriele","family":"Gianini","sequence":"additional","affiliation":[{"name":"Department of Informatics, Systems and Communication (DISCo), Universit\u00e0 degli Studi di Milano-Bicocca, 20126 Milano, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6770-8332","authenticated-orcid":false,"given":"Maria Chiara","family":"Leva","sequence":"additional","affiliation":[{"name":"School of Food Science and Environmental Health, Technological University Dublin, D07 H6K8 Dublin, Ireland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9557-6496","authenticated-orcid":false,"given":"Ernesto","family":"Damiani","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Universit\u00e0 degli Studi di Milano, 20122 Milano, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1080\/001401300409044","article-title":"From human-machine interaction to human-machine cooperation","volume":"43","author":"Hoc","year":"2000","journal-title":"Ergonomics"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sendhoff, B., and Wersing, H. (2020, January 7\u20139). Cooperative Intelligence-A Humane Perspective. Proceedings of the 2020 IEEE International Conference on Human-Machine Systems, ICHMS 2020, Rome, Italy.","DOI":"10.1109\/ICHMS49158.2020.9209387"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"209","DOI":"10.57062\/ijpem-st.2024.00115","article-title":"Introduction of Human-in-the-Loop in Smart Manufacturing (H-SM)","volume":"2","author":"Kim","year":"2024","journal-title":"Int. J. Precis. Eng. Manuf.-Smart Tech."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Valtonen, L., and M\u00e4kinen, S.J. (2022, January 19\u201323). Human-in-the-loop: Explainable or accurate artificial intelligence by exploiting human bias?. Proceedings of the 2022 IEEE 28th International Conference on Engineering, Technology and Innovation (ICE\/ITMC) & 31st International Association For Management of Technology (IAMOT) Joint Conference, Nancy, France.","DOI":"10.1109\/ICE\/ITMC-IAMOT55089.2022.10033225"},{"key":"ref_5","unstructured":"Ma, L., and Wang, C. (July, January 26). Safety Issues in Human-Machine Collaboration and Possible Countermeasures. Proceedings of the Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Anthropometry, Human Behavior, and Communication, Virtual Event."},{"key":"ref_6","unstructured":"(2020). High-Level Expert Group on AI (AI HLEG). Assessment List for Trustworthy Artificial Intelligence (ALTAI) for Self-Assessment|Shaping Europe\u2019s Digital Future, European Commission."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1016\/j.ifacol.2021.08.082","article-title":"An AI adoption model for SMEs: A conceptual framework","volume":"54","author":"Bettoni","year":"2021","journal-title":"IFAC-PapersOnLine"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Alix, C., Lafond, D., Mattioli, J., Heer, J.D., Chattington, M., and Robic, P.O. (2021, January 14\u201318). Empowering Adaptive Human Autonomy Collaboration with Artificial Intelligence. Proceedings of the 2021 16th International System of Systems Engineering Conference, SoSE 2021, Vasteras, Sweden.","DOI":"10.1109\/SOSE52739.2021.9497497"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MC.2020.2996587","article-title":"A Research Agenda for Hybrid Intelligence: Augmenting Human Intellect with Collaborative, Adaptive, Responsible, and Explainable Artificial Intelligence","volume":"53","author":"Akata","year":"2020","journal-title":"Computer"},{"key":"ref_10","unstructured":"(2010). Safety of Machinery\u2014General Principles for Design\u2014Risk Assessment and Risk Reduction (Standard No. EN ISO 12100)."},{"key":"ref_11","unstructured":"(2011). Robots and Robotic Devices\u2014Safety Requirements for Industrial Robots Part 2: Robot Systems and Integration (Standard No. EN ISO 10218-2)."},{"key":"ref_12","unstructured":"(2023). Railway Applications\u2014Requirements for Software Development (Standard No. EN 50716)."},{"key":"ref_13","unstructured":"(2018). Road Vehicles\u2014Functional Safety (Standard No. EN ISO 26262)."},{"key":"ref_14","unstructured":"(2022). Road Vehicles\u2014Safety of the Intended Functionality (Standard No. EN ISO 21448)."},{"key":"ref_15","unstructured":"(2023). Standard for Evaluation of Autonomous Products (Standard No. UL 4600)."},{"key":"ref_16","unstructured":"(2019). Ergonomics of Human-System Interaction Part 210: Human-Centred Design for Interactive Systems (Standard No. EN ISO 9241-210)."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hua, J., Zeng, L., Li, G., and Ju, Z. (2021). Learning for a robot: Deep reinforcement learning, imitation learning, transfer learning. Sensors, 21.","DOI":"10.3390\/s21041278"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Borboni, A., Reddy, K.V.V., Elamvazuthi, I., AL-Quraishi, M.S., Natarajan, E., and Azhar Ali, S.S. (2023). The Expanding Role of Artificial Intelligence in Collaborative Robots for Industrial Applications: A Systematic Review of Recent Works. Machines, 11.","DOI":"10.3390\/machines11010111"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.ergon.2017.02.004","article-title":"Gesture recognition for human-robot collaboration: A review","volume":"68","author":"Liu","year":"2018","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_20","first-page":"4951","article-title":"Human gaze assisted artificial intelligence: A review","volume":"2021","author":"Zhang","year":"2020","journal-title":"Ijcai Int. Jt. Conf. Artif. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"\u0160umak, B., Brdnik, S., and Pu\u0161nik, M. (2022). Sensors and artificial intelligence methods and algorithms for human\u2013computer intelligent interaction: A systematic mapping study. Sensors, 22.","DOI":"10.3390\/s22010020"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.future.2022.05.014","article-title":"A survey of human-in-the-loop for machine learning","volume":"135","author":"Wu","year":"2022","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3005","DOI":"10.1007\/s10462-022-10246-w","article-title":"Human-in-the-loop machine learning: A state of the art","volume":"56","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rajendran, P.T., Espinoza, H., Delaborde, A., and Mraidha, C. (2021). Human-in-the-Loop Learning Methods Toward Safe DL-Based Autonomous Systems: A Review. Computer Safety, Reliability, and Security. SAFECOMP 2021 Workshops. SAFECOMP 2021, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-83906-2_20"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Papernot, N., McDaniel, P., Jha, S., Fredrikson, M., Celik, Z.B., and Swami, A. (2016, January 21\u201324). The Limitations of Deep Learning in Adversarial Settings. Proceedings of the 2016 IEEE European Symposium on Security and Privacy (EuroS&P), Saarbrucken, Germany.","DOI":"10.1109\/EuroSP.2016.36"},{"key":"ref_26","unstructured":"Gianini, G., and Guzzo, L. (2022, July 05). Artificial Intelligence and Machine Learning: An Introduction\u2014 Astrofisica Alla Statale. Available online: https:\/\/astro.fisica.unimi.it\/people\/luigi-guzzo\/ml-intro\/."},{"key":"ref_27","unstructured":"HELGA (2019). A Definition of AI: Main Capabilities and Scientific Disciplines, European Commission."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Corea, F. (2019). AI Knowledge Map: How to Classify AI Technologies, Springer.","DOI":"10.1007\/978-3-030-04468-8_4"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Calegari, R., Ciatto, G., Denti, E., and Omicini, A. (2020). Logic-based technologies for intelligent systems: State of the art and perspectives. Information, 11.","DOI":"10.3390\/info11030167"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/3-540-58107-3_1","article-title":"Foundations of knowledge representation and reasoning: A guide to this volume","volume":"Volume 810","author":"Lakemeyer","year":"1994","journal-title":"Foundations of Knowledge Representation and Reasoning"},{"key":"ref_31","first-page":"14","article-title":"An introduction to restricted Boltzmann machines","volume":"Volume 7441","author":"Fischer","year":"2012","journal-title":"Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2012"},{"key":"ref_32","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kelleher, J.D. (2019). Deep Learning, MIT Press.","DOI":"10.7551\/mitpress\/11171.001.0001"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Fernandes Ramos, I.F., Gianini, G., and Damiani, E. (September, January 28). Neuro-Symbolic AI for Sensor-based Human Performance Prediction: Challenges and Solutions. Proceedings of the 32nd European Safety and Reliability Conference (ESREL 2022), Dublin, Ireland.","DOI":"10.3850\/978-981-18-5183-4_S33-01-310-cd"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Venter, G. (2010). Review of Optimization Techniques. Encycl. Aerosp. Eng., 1\u201312.","DOI":"10.1002\/9780470686652.eae495"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1146\/annurev-control-080320-011601","article-title":"What Is Robotics? Why Do We Need It and How Can We Get It?","volume":"4","author":"Koditschek","year":"2021","journal-title":"Annu. Rev. Control. Robot. Auton. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cirp.2017.04.095","article-title":"Motion planning and scheduling for human and industrial-robot collaboration","volume":"66","author":"Pellegrinelli","year":"2017","journal-title":"CIRP Ann.-Manuf. Technol."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Guo, M., Andersson, S., and Dimarogonas, D.V. (2018, January 21\u201325). Human-in-the-Loop Mixed-Initiative Control under Temporal Tasks. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460793"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1016\/j.procir.2018.03.022","article-title":"Fostering Robust Human-Robot Collaboration through AI Task Planning","volume":"72","author":"Cesta","year":"2018","journal-title":"Proc. Procedia Cirp"},{"key":"ref_40","first-page":"655","article-title":"Dynamic motion planning algorithm in human-robot collision avoidance","volume":"Volume 11745","author":"Zhu","year":"2019","journal-title":"Intelligent Robotics and Applications, Proceedings of the 12th International Conference, ICIRA 2019, Shenyang, China, 8\u201311 August 2019"},{"key":"ref_41","unstructured":"Kulkarni, A., Vadlamudi, S.G., Zha, Y., Zhang, Y., Chakraborti, T., and Kambhampati, S. (June, January 29). Explicable planning as minimizing distance from expected behavior. Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, London, UK."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3719","DOI":"10.1109\/LRA.2019.2928760","article-title":"Learning Intention Aware Online Adaptation of Movement Primitives","volume":"4","author":"Koert","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"El-Shamouty, M., Wu, X., Yang, S., Albus, M., and Huber, M.F. (\u201331, January 31). Towards Safe Human-Robot Collaboration Using Deep Reinforcement Learning. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196924"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1049\/iet-its.2019.0411","article-title":"Iterative learning of an unknown road path through cooperative driving of vehicles","volume":"14","author":"Yang","year":"2020","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_45","unstructured":"Yang, X., Cheng, J., and Michael, N. (June, January 30). An Intention Guided Hierarchical Framework for Trajectory-based Teleoperation of Mobile Robots. Proceedings of the IEEE International Conference on Robotics and Automation, Xi\u2019an, China."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ionescu, T.B. (2021). Adaptive simplex architecture for safe, real-time robot path planning. Sensors, 21.","DOI":"10.3390\/s21082589"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1016\/j.jmsy.2021.02.011","article-title":"A digital twin-driven human-robot collaborative assembly approach in the wake of COVID-19","volume":"60","author":"Lv","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Khawaja, F.I., Kanazawa, A., Kinugawa, J., and Kosuge, K. (2021). A human-following motion planning and control scheme for collaborative robots based on human motion prediction. Sensors, 21.","DOI":"10.20944\/preprints202111.0181.v1"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Eckhoff, M., Knobbe, D., Zwirnmann, H., Swikir, A., and Haddadin, S. (2023, January 1\u20135). Towards Connecting Control to Perception: High-Performance Whole-Body Collision Avoidance Using Control-Compatible Obstacles. Proceedings of the 2023 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.","DOI":"10.1109\/IROS55552.2023.10342515"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Tausch, A., Kluge, A., and Adolph, L. (2020). Psychological Effects of the Allocation Process in Human\u2013Robot Interaction\u2014A Model for Research on ad hoc Task Allocation. Front. Psychol., 11.","DOI":"10.3389\/fpsyg.2020.564672"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1177\/0018720813501549","article-title":"Human performance consequences of stages and levels of automation: An integrated meta-analysis","volume":"56","author":"Onnasch","year":"2014","journal-title":"Hum. Factors"},{"key":"ref_52","first-page":"280","article-title":"Hybrid force\/position control of a collaborative parallel robot using adaptive neural network","volume":"Volume 11097","author":"Zabihifar","year":"2018","journal-title":"Interactive Collaborative Robotics, Proceedings of the Third International Conference, ICR 2018, Leipzig, Germany, 18\u201322 September 2018"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Roveda, L., Haghshenas, S., Caimmi, M., Pedrocchi, N., and Tosatti, L.M. (2019). Assisting operators in heavy industrial tasks: On the design of an optimized cooperative impedance fuzzy-controller with embedded safety rules. Front. Robot. AI, 6.","DOI":"10.3389\/frobt.2019.00075"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"6068","DOI":"10.1109\/LRA.2021.3088091","article-title":"An Efficient and Responsive Robot Motion Controller for Safe Human-Robot Collaboration","volume":"6","author":"Zhao","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_55","unstructured":"Oh, Y., Toussaint, M., and Mainprice, J. (October, January 27). Learning to Arbitrate Human and Robot Control using Disagreement between Sub-Policies. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Prague, Czech Republic."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1109\/TASE.2020.3043286","article-title":"A Multimodal Approach to Human Safety in Collaborative Robotic Workcells","volume":"19","author":"Costanzo","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"15980","DOI":"10.1109\/TITS.2022.3146895","article-title":"Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving","volume":"23","author":"Li","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"010804","DOI":"10.1115\/1.4039145","article-title":"A Review of Intent Detection, Arbitration, and Communication Aspects of Shared Control for Physical Human\u2013Robot Interaction","volume":"70","author":"Losey","year":"2018","journal-title":"Appl. Mech. Rev."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.ifacol.2023.01.126","article-title":"Preference-Based Optimization of a Human-Robot Collaborative Controller","volume":"55","author":"Maccarini","year":"2022","journal-title":"IFAC-PapersOnLine"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"103495","DOI":"10.1016\/j.robot.2020.103495","article-title":"Human-in-the-loop optimization of wearable robots to reduce the human metabolic energy cost in physical movements","volume":"127","author":"Fang","year":"2020","journal-title":"Robot. Auton. Syst."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1109\/TII.2021.3074394","article-title":"Optimization Techniques and Formal Verification for the Software Design of Boolean Algebra Based Safety-Critical Systems","volume":"18","author":"Perez","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"106313","DOI":"10.1016\/j.ssci.2023.106313","article-title":"Occupational health and safety issues in human-robot collaboration: State of the art and open challenges","volume":"169","author":"Giallanza","year":"2024","journal-title":"Saf. Sci."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"103807","DOI":"10.1016\/j.apergo.2022.103807","article-title":"Development and evaluation of design guidelines for cognitive ergonomics in human-robot collaborative assembly systems","volume":"104","author":"Gualtieri","year":"2022","journal-title":"Appl. Ergon."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1080\/0951192X.2023.2189304","article-title":"On the quantification of human-robot collaboration quality","volume":"36","author":"Kokotinis","year":"2023","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/s11042-012-0994-3","article-title":"Efficient tracking using a robust motion estimation technique","volume":"69","author":"Lalos","year":"2014","journal-title":"Multimed. Tools Appl."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Maderna, R., Lanfredini, P., Zanchettin, A.M., and Rocco, P. (2019, January 3\u20138). Real-time monitoring of human task advancement. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8967933"},{"key":"ref_67","first-page":"240","article-title":"Assessing Deep Learning Models for Human-Robot Collaboration Collision Detection in Industrial Environments","volume":"Volume 12319","author":"Silva","year":"2020","journal-title":"Intelligent Systems, Proceedings of the 9th Brazilian Conference, BRACIS 2020, Rio Grande, Brazil, 20\u201323 October 2020"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Fraga-Lamas, P., Barros, D., Lopes, S.I., and Fern\u00e1ndez-Caram\u00e9s, T.M. (2022). Mist and Edge Computing Cyber-Physical Human-Centered Systems for Industry 5.0: A Cost-Effective IoT Thermal Imaging Safety System. Sensors, 22.","DOI":"10.3390\/s22218500"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Driggs-Campbell, K., and Bajcsy, R. (2015, January 15\u201318). Identifying Modes of Intent from Driver Behaviors in Dynamic Environments. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, Gran Canaria, Spain.","DOI":"10.1109\/ITSC.2015.125"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1016\/j.promfg.2015.07.216","article-title":"Gesture Recognition Using a Depth Camera for Human Robot Collaboration on Assembly Line","volume":"3","author":"Moutarde","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_71","unstructured":"Liu, C., Hamrick, J.B., Fisac, J.F., Dragan, A.D., Hedrick, J.K., Sastry, S.S., and Griffiths, T.L. (23, January 19\u201323). Goal inference improves objective and perceived performance in human-robot collaboration. Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, New York, NY, USA."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.cirp.2018.04.066","article-title":"Deep learning-based human motion recognition for predictive context-aware human-robot collaboration","volume":"67","author":"Wang","year":"2018","journal-title":"Cirp-Ann.-Manuf. Technol."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"3934","DOI":"10.1109\/TII.2018.2882741","article-title":"Prediction of Human Activity Patterns for Human-Robot Collaborative Assembly Tasks","volume":"15","author":"Zanchettin","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Wu, M., Louw, T., Lahijanian, M., Ruan, W., Huang, X., Merat, N., and Kwiatkowska, M. (2019, January 3\u20138). Gaze-based Intention Anticipation over Driving Manoeuvres in Semi-Autonomous Vehicles. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8967779"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s00170-018-2788-x","article-title":"Gesture-based human-robot interaction for human assistance in manufacturing","volume":"101","author":"Neto","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/THMS.2018.2883176","article-title":"Controlling object hand-over in human-robot collaboration via natural wearable sensing","volume":"49","author":"Wang","year":"2019","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Luo, R.C., and Mai, L. (2019, January 4\u20138). Human Intention Inference and On-Line Human Hand Motion Prediction for Human-Robot Collaboration. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8968192"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Casalino, A., Brameri, A., Zanchettin, A.M., and Rocco, P. (2019, January 3\u20138). Adaptive swept volumes generation for human-robot coexistence using Gaussian Processes. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8967807"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Shih, J.C. (2019, January 10\u201312). Predicting stochastic human forward reachable sets based on learned human behavior. Proceedings of the American Control Conference, Philadelphia, PA, USA.","DOI":"10.23919\/ACC.2019.8814396"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"105","DOI":"10.2514\/1.D0180","article-title":"Toward individual-sensitive automation for air traffic control using convolutional neural networks","volume":"28","author":"Ellerbroek","year":"2020","journal-title":"Proc. J. Air Transp."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Amin, F.M., Rezayati, M., van de Venn, H.W., and Karimpour, H. (2020). A mixed-perception approach for safe human\u2013robot collaboration in industrial automation. Sensors, 20.","DOI":"10.3390\/s20216347"},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"1659103","DOI":"10.1155\/2020\/1659103","article-title":"An Air Traffic Controller Action Extraction-Prediction Model Using Machine Learning Approach","volume":"2020","author":"Pham","year":"2020","journal-title":"Complexity"},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Anvaripour, M., Khoshnam, M., Menon, C., and Saif, M. (2020). FMG- and RNN-Based Estimation of Motor Intention of Upper-Limb Motion in Human-Robot Collaboration. Front. Robot. AI, 7.","DOI":"10.3389\/frobt.2020.573096"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"102137","DOI":"10.1016\/j.rcim.2021.102137","article-title":"EEG based arm movement intention recognition towards enhanced safety in symbiotic Human-Robot Collaboration","volume":"70","author":"Buerkle","year":"2021","journal-title":"Robot.-Comput.-Integr. Manuf."},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Elmalaki, S. FaiR-IoT: Fairness-Aware Human-in-the-Loop Reinforcement Learning for Harnessing Human Variability in Personalized IoT. Proceedings of the Proceedings of the International Conference on Internet-of-Things Design and Implementation, New York, NY, USA, 18\u201321 May 2021.","DOI":"10.1145\/3450268.3453525"},{"key":"ref_86","first-page":"586","article-title":"Transfer Learning-Based Intention Recognition of Human Upper Limb in Human\u2014Robot Collaboration","volume":"Volume 13014","author":"Dong","year":"2021","journal-title":"Intelligent Robotics and Applications, Proceedings of the 14th International Conference, ICIRA 2021, Yantai, China, 22\u201325 October 2021"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1016\/j.procir.2021.11.303","article-title":"Transfer Learning-enabled Action Recognition for Human-robot Collaborative Assembly","volume":"104","author":"Li","year":"2021","journal-title":"Proc. Procedia Cirp"},{"key":"ref_88","first-page":"428","article-title":"Intention Recognition in Human Robot Interaction Based on Eye Tracking","volume":"Volume 12934","author":"Rehm","year":"2021","journal-title":"Human-Computer Interaction\u2014INTERACT 2021, Proceedings of the 18th IFIP TC 13 International Conference, Bari, Italy, 30 August\u20133 September 2021"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s12559-022-10051-1","article-title":"A Brain-Controlled Vehicle System Based on Steady State Visual Evoked Potentials","volume":"15","author":"Zhang","year":"2023","journal-title":"Cogn. Comput."},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Orsag, L., Stipancic, T., and Koren, L. (2023). Towards a Safe Human\u2013Robot Collaboration Using Information on Human Worker Activity. Sensors, 23.","DOI":"10.3390\/s23031283"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Dimova-Edeleva, V., Rivera, O.S., Laha, R., Figueredo, L.F.C., Zavaglia, M., and Haddadin, S. (2023, January 24\u201327). Error-related Potentials in a Virtual Pick-and-Place Experiment: Toward Real-world Shared-control. Proceedings of the 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Sydney, Australia.","DOI":"10.1109\/EMBC40787.2023.10340244"},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"107141","DOI":"10.1016\/j.engappai.2023.107141","article-title":"Adaptive technique for physical human-robot interaction handling using proprioceptive sensors","volume":"126","author":"Popov","year":"2023","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"McAllister, R., Gal, Y., Kendall, A., Van Der Wilk, M., Shah, A., Cipolla, R., and Weller, A. (2017). Concrete problems for autonomous vehicle safety: Advantages of Bayesian deep learning. IJCAI Int. Jt. Conf. Artif. Intell., 4745\u20134753.","DOI":"10.24963\/ijcai.2017\/661"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Li, N., Misu, T., and Miranda, A. (2016, January 1\u20134). Driver behavior event detection for manual annotation by clustering of the driver physiological signals. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795971"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Ma, Y., Zhang, S., Qi, D., Luo, Z., Li, R., Potter, T., and Zhang, Y. (2020). Driving drowsiness detection with EEG using a modified hierarchical extreme learning machine algorithm with particle swarm optimization: A pilot study. Electronics, 9.","DOI":"10.3390\/electronics9050775"},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Huang, H., Cappel, H.F., Thomas, G.C., He, B., and Sentis, L. (2020, January 1\u20133). Adaptive Compliance Shaping with Human Impedance Estimation. Proceedings of the American Control Conference, Denver, CO, USA.","DOI":"10.23919\/ACC45564.2020.9147875"},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"106287","DOI":"10.1016\/j.ress.2018.10.012","article-title":"Multi-source information fusion to assess control room operator performance","volume":"194","author":"Zhang","year":"2020","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_98","doi-asserted-by":"crossref","unstructured":"Diamantopoulos, H., and Wang, W. (2021, January 16\u201319). Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding. Proceedings of the 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021, Athens, Greece.","DOI":"10.1109\/ICMAE52228.2021.9522451"},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1109\/TNSRE.2022.3157446","article-title":"Unraveling the Physiological Correlates of Mental Workload Variations in Tracking and Collision Prediction Tasks","volume":"30","author":"John","year":"2022","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_100","doi-asserted-by":"crossref","unstructured":"Alkinani, M.H., Khan, W.Z., Arshad, Q., and Raza, M. (2022). HSDDD: A Hybrid Scheme for the Detection of Distracted Driving through Fusion of Deep Learning and Handcrafted Features. Sensors, 22.","DOI":"10.3390\/s22051864"},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Sukhavasi, S.B., Sukhavasi, S.B., Elleithy, K., El-Sayed, A., and Elleithy, A. (2022). A Hybrid Model for Driver Emotion Detection Using Feature Fusion Approach. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19053085"},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"Shayesteh, S., Ojha, A., Liu, Y., and Jebelli, H. (2023). Human-robot teaming in construction: Evaluative safety training through the integration of immersive technologies and wearable physiological sensing. Saf. Sci., 159.","DOI":"10.1016\/j.ssci.2022.106019"},{"key":"ref_103","first-page":"1","article-title":"FABRIC: A Framework for the Design and Evaluation of Collaborative Robots with Extended Human Adaptation","volume":"12","author":"Rosman","year":"2023","journal-title":"J. Hum.-Robot Interact."},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Zanoli, C., Villani, V., and Picone, M. (2023, January 1\u20134). The Road to Industry 5.0: The Challenges of Human Fatigue Modeling. Proceedings of the 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Honolulu, HI, USA.","DOI":"10.1109\/SMC53992.2023.10394500"},{"key":"ref_105","doi-asserted-by":"crossref","unstructured":"Tabrez, A., Agrawal, S., and Hayes, B. (2019, January 1\u201314). Explanation-Based Reward Coaching to Improve Human Performance via Reinforcement Learning. Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction, Daegu, Republic of Korea.","DOI":"10.1109\/HRI.2019.8673104"},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1111\/tops.12594","article-title":"Cognitive Modeling of Anticipation: Unsupervised Learning and Symbolic Modeling of Pilots\u2019 Mental Representations","volume":"14","author":"Blum","year":"2022","journal-title":"Top. Cogn. Sci."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhu, Y., and Lin, H. (2016, January 6\u20138). Performance guaranteed human-robot collaboration through correct-by-design. Proceedings of the 2016 American Control Conference (ACC), Boston, MA, USA.","DOI":"10.1109\/ACC.2016.7526641"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1108\/IR-04-2018-0079","article-title":"A neural network based monitoring system for safety in shared work-space human-robot collaboration","volume":"45","author":"Rajnathsing","year":"2018","journal-title":"Ind. Robot."},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Fisac, J., Bajcsy, A., Herbert, S., Fridovich-Keil, D., Wang, S., Tomlin, C., and Dragan, A. (2018, January 26\u201330). Probabilistically Safe Robot Planning with Confidence-Based Human Predictions. Proceedings of the Robotics: Science and Systems, Pittsburgh, PA, USA.","DOI":"10.15607\/RSS.2018.XIV.069"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1177\/0278364919859436","article-title":"Confidence-aware motion prediction for real-time collision avoidance1","volume":"39","author":"Bajcsy","year":"2020","journal-title":"Int. J. Robot. Res."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"109654","DOI":"10.1016\/j.automatica.2021.109654","article-title":"Supervisor synthesis of POMDP via automata learning","volume":"129","author":"Wu","year":"2021","journal-title":"Automatica"},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"6783","DOI":"10.1007\/s00170-022-09781-1","article-title":"Enhancing fluency and productivity in human-robot collaboration through online scaling of dynamic safety zones","volume":"121","author":"Scalera","year":"2022","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_113","doi-asserted-by":"crossref","unstructured":"Haindl, P., Buchgeher, G., Khan, M., and Moser, B. (2022, January 22\u201324). Towards a Reference Software Architecture for Human-AI Teaming in Smart Manufacturing. Proceedings of the ACM\/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, New York, NY, USA.","DOI":"10.1145\/3510455.3512788"},{"key":"ref_114","doi-asserted-by":"crossref","unstructured":"Kottinger, J., Almagor, S., and Lahijanian, M. (2022, January 13\u201324). Conflict-Based Search for Explainable Multi-Agent Path Finding. Proceedings of the International Conference on Automated Planning and Scheduling, ICAPS, Virtual.","DOI":"10.1609\/icaps.v32i1.19859"},{"key":"ref_115","doi-asserted-by":"crossref","unstructured":"Lloyd-Roberts, B., James, P., Edwards, M., Robinson, S., and Werner, T. (2023, January 23\u201328). Improving Railway Safety: Human-in-the-loop Invariant Finding. Proceedings of the Conference on Human Factors in Computing Systems-Proceedings, Hamburg, Germany.","DOI":"10.1145\/3544549.3573853"},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"11621","DOI":"10.1007\/s13369-022-07490-1","article-title":"A Connective Framework for Safe Human\u2013Robot Collaboration in Cyber-Physical Production Systems","volume":"48","author":"Islam","year":"2023","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"5371","DOI":"10.1007\/s00170-023-11404-2","article-title":"Modeling of human-robot collaboration for flexible assembly-a hidden semi-Markov-based simulation approach","volume":"126","author":"Wang","year":"2023","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/0890-5401(87)90052-6","article-title":"Learning regular sets from queries and counterexamples","volume":"75","author":"Angluin","year":"1987","journal-title":"Inf. Comput."},{"key":"ref_119","first-page":"616","article-title":"Constructing a decision-support system for safe ship-navigation using a Bayesian network","volume":"Volume 9745","author":"Zhang","year":"2016","journal-title":"Digital Human Modeling: Applications in Health, Safety, Ergonomics and Risk Management, Proceedings of the7th International Conference, DHM 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, 17\u201322 July 2016"},{"key":"ref_120","doi-asserted-by":"crossref","unstructured":"Elmalaki, S., Tsai, H.R., and Srivastava, M. (2018, January 4\u20137). Sentio: Driver-in-the-loop forward collision warning using multisample reinforcement learning. Proceedings of the SenSys 2018-Proceedings of the 16th Conference on Embedded Networked Sensor Systems, Shenzhen China.","DOI":"10.1145\/3274783.3274843"},{"key":"ref_121","doi-asserted-by":"crossref","unstructured":"Singh, H.V., and Mahmoud, Q.H. (2020, January 11\u201314). Human-in-the-Loop Error Precursor Detection using Language Translation Modeling of HMI States. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Toronto, ON Canada.","DOI":"10.1109\/SMC42975.2020.9283392"},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1109\/TIV.2020.2991948","article-title":"Driver Behavior Modeling Using Game Engine and Real Vehicle: A Learning-Based Approach","volume":"5","author":"Wang","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1038\/s42256-018-0008-x","article-title":"Robots and the return to collaborative intelligence","volume":"1","author":"Goldberg","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_124","unstructured":"Saunders, W., Sastry, G., Stuhlm\u00fcller, A., and Evans, O. (2018, January 10\u201315). Trial without Error: Towards Safe Reinforcement Learning via Human Intervention. Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems, Stockholm, Sweden."},{"key":"ref_125","doi-asserted-by":"crossref","unstructured":"Chen, J., Wu, T., Shi, M., and Jiang, W. (2020). PORF-DDPG: Learning personalized autonomous driving behavior with progressively optimized reward function. Sensors, 20.","DOI":"10.3390\/s20195626"},{"key":"ref_126","doi-asserted-by":"crossref","unstructured":"Rozo, L., Silv\u00e9rio, J., Calinon, S., and Caldwell, D.G. (2016). Learning controllers for reactive and proactive behaviors in human-robot collaboration. Front. Robot. AI, 3.","DOI":"10.3389\/frobt.2016.00030"},{"key":"ref_127","first-page":"69","article-title":"Managing Complexity: Towards Intelligent Error-Handling Assistance Trough Interactive Alarm Flood Reduction","volume":"Volume 10410","author":"Wunderlich","year":"2017","journal-title":"Machine Learning and Knowledge Extraction, Proceedings of the First IFIP TC 5, WG 8.4, 8.9, 12.9 International Cross-Domain Conference, CD-MAKE 2017, Reggio, Italy, 29 August\u20131 September 2017"},{"key":"ref_128","doi-asserted-by":"crossref","unstructured":"Zeestraten, M.J., Pereira, A., Althoff, M., and Calinon, S. (2017, January 5\u20138). Online motion synthesis with minimal intervention control and formal safety guarantees. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016-Conference Proceedings, Banff, AB, Canada.","DOI":"10.1109\/SMC.2016.7844552"},{"key":"ref_129","unstructured":"Pan, X., and Shen, Y. (2018, January 10\u201315). Human-Interactive Subgoal Supervision for Efficient Inverse Reinforcement Learning. Proceedings of the AAMAS \u201918: Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems, Stockholm, Sweden."},{"key":"ref_130","doi-asserted-by":"crossref","unstructured":"Lombardi, M., Liuzza, D., and Bemardo, M.D. (2019, January 6\u20139). Deep learning control of artificial avatars in group coordination tasks. Proceedings of the-IEEE International Conference on Systems, Man and Cybernetics, Bari, Italy.","DOI":"10.1109\/SMC.2019.8914294"},{"key":"ref_131","doi-asserted-by":"crossref","unstructured":"Kelly, M., Sidrane, C., Driggs-Campbell, K., and Kochenderfer, M.J. (2019, January 20\u201324). HG-DAgger: Interactive imitation learning with human experts. Proceedings of the IEEE International Conference on Robotics and Automation, Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793698"},{"key":"ref_132","doi-asserted-by":"crossref","unstructured":"Nguyen, K., Dey, D., Brockett, C., and Dolan, B. (2019, January 20). Vision-based navigation with language-based assistance via imitation learning with indirect intervention. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01281"},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1109\/LCSYS.2019.2917805","article-title":"Vector Autoregressive POMDP Model Learning and Planning for Human\u2013Robot Collaboration","volume":"3","author":"Zheng","year":"2019","journal-title":"IEEE Control Syst. Lett."},{"key":"ref_134","doi-asserted-by":"crossref","first-page":"101946","DOI":"10.1016\/j.rcim.2020.101946","article-title":"Design of an intelligent robotic precise assembly system for rapid teaching and admittance control","volume":"64","author":"Lin","year":"2020","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_135","doi-asserted-by":"crossref","first-page":"2023","DOI":"10.1109\/LRA.2020.2970619","article-title":"A Framework for Learning from Demonstration with Minimal Human Effort","volume":"5","author":"Rigter","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_136","doi-asserted-by":"crossref","first-page":"2225","DOI":"10.1109\/LRA.2021.3061374","article-title":"Learning Variable Impedance Control via Inverse Reinforcement Learning for Force-Related Tasks","volume":"6","author":"Zhang","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_137","unstructured":"Ross, S., Gordon, G.J., and Bagnell, J.A. (2011, January 11\u201313). A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning. Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA."},{"key":"ref_138","doi-asserted-by":"crossref","first-page":"102179","DOI":"10.1016\/j.rcim.2021.102179","article-title":"Feasibility of Detecting Potential Emergencies in Symbiotic Human-Robot Collaboration with a mobile EEG","volume":"72","author":"Buerkle","year":"2021","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_139","first-page":"191","article-title":"Gaze Assisted Visual Grounding","volume":"Volume 13086","author":"Johari","year":"2021","journal-title":"Social Robotics, Proceedings of the 13th International Conference, ICSR 2021, Singapore, 10\u201313 November 2021"},{"key":"ref_140","doi-asserted-by":"crossref","first-page":"6714","DOI":"10.1109\/TNNLS.2022.3222265","article-title":"An Online Active Broad Learning Approach for Real-Time Safety Assessment of Dynamic Systems in Nonstationary Environments","volume":"34","author":"Liu","year":"2023","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_141","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_142","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3551385","article-title":"Taxonomy of Machine Learning Safety: A Survey and Primer","volume":"55","author":"Mohseni","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_143","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1146\/annurev-control-100819-063206","article-title":"Recent Advances in Robot Learning from Demonstration","volume":"3","author":"Ravichandar","year":"2020","journal-title":"Annu. Rev. Control. Robot. Auton. Syst."},{"key":"ref_144","doi-asserted-by":"crossref","first-page":"4436","DOI":"10.1109\/TFUZZ.2024.3399617","article-title":"Feature Selection for Handling Label Ambiguity Using Weighted Label-Fuzzy Relevancy and Redundancy","volume":"32","author":"Deng","year":"2024","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_145","doi-asserted-by":"crossref","first-page":"9659","DOI":"10.1109\/LRA.2022.3191950","article-title":"Quantifying Demonstration Quality for Robot Learning and Generalization","volume":"7","author":"Sakr","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_146","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MC.2018.3620965","article-title":"Toward Human-Understandable, Explainable AI","volume":"51","author":"Hagras","year":"2018","journal-title":"Computer"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/11\/728\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:30:50Z","timestamp":1760113850000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/11\/728"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,12]]},"references-count":146,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["info15110728"],"URL":"https:\/\/doi.org\/10.3390\/info15110728","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,12]]}}}