{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T03:02:14Z","timestamp":1776740534033,"version":"3.51.2"},"reference-count":51,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,3,23]],"date-time":"2021-03-23T00:00:00Z","timestamp":1616457600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Typically, humans interact with a humanoid robot with apprehension. This lack of trust can seriously affect the effectiveness of a team of robots and humans. We can create effective interactions that generate trust by augmenting robots with an explanation capability. The explanations provide justification and transparency to the robot\u2019s decisions. To demonstrate such effective interaction, we tested this with an interactive, game-playing environment with partial information that requires team collaboration, using a game called Spanish Domino. We partner a robot with a human to form a pair, and this team opposes a team of two humans. We performed a user study with sixty-three human participants in different settings, investigating the effect of the robot\u2019s explanations on the humans\u2019 trust and perception of the robot\u2019s behaviour. Our explanation-generation mechanism produces natural-language sentences that translate the decision taken by the robot into human-understandable terms. We video-recorded all interactions to analyse factors such as the participants\u2019 relational behaviours with the robot, and we also used questionnaires to measure the participants\u2019 explicit trust in the robot. Overall, our main results demonstrate that explanations enhanced the participants\u2019 understandability of the robot\u2019s decisions, because we observed a significant increase in the participants\u2019 level of trust in their robotic partner. These results suggest that explanations, stating the reason(s) for a decision, combined with the transparency of the decision-making process, facilitate collaborative human\u2013humanoid interactions.<\/jats:p>","DOI":"10.3390\/robotics10010051","type":"journal-article","created":{"date-parts":[[2021,3,23]],"date-time":"2021-03-23T23:59:41Z","timestamp":1616543981000},"page":"51","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Explanations from a Robotic Partner Build Trust on the Robot\u2019s Decisions for Collaborative Human-Humanoid Interaction"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4794-4549","authenticated-orcid":false,"given":"Misbah","family":"Javaid","sequence":"first","affiliation":[{"name":"School of Information and Communication Technology, Griffith University, Brisbane 4111, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7775-0780","authenticated-orcid":false,"given":"Vladimir","family":"Estivill-Castro","sequence":"additional","affiliation":[{"name":"Departament de Tecnologies de la Informaci\u00f3 i les Comunicacions, Universitat Pompeu Fabra, 08018 Barcelona, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,23]]},"reference":[{"key":"ref_1","unstructured":"Schaefer, K.E. (2013). The Perception and Measurement of Human-Robot Trust. [Ph.D. Thesis, University of Central Florida]."},{"key":"ref_2","unstructured":"Wang, N., Pynadath, D.V., and Hill, S.G. (December, January 30). Building Trust in a Human-Robot Team with Automatically Generated Explanations. Proceedings of the Interservice\/Industry Training, Simulation, and Education Conference (I\/ITSEC), Orlando, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: Designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum. Factors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1177\/0018720811417254","article-title":"A meta-analysis of factors affecting trust in human-robot interaction","volume":"53","author":"Hancock","year":"2011","journal-title":"Hum. Factors"},{"key":"ref_5","unstructured":"Salem, M., and Dautenhahn, K. (2015). Evaluating trust and safety in HRI: Practical issues and ethical challenges. Emerging Policy and Ethics of Human-Robot Interaction Workshop @HRI 2015, ACM Press. [2nd ed.]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1518\/001872097778543886","article-title":"Humans and automation: Use, misuse, disuse, abuse","volume":"39","author":"Parasuraman","year":"1997","journal-title":"Hum. Factors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s10676-010-9253-3","article-title":"Explanation and trust: What to tell the user in security and AI?","volume":"13","author":"Pieters","year":"2011","journal-title":"Ethics Inform. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"40","DOI":"10.13189\/ujca.2013.010204","article-title":"Aspects of intelligent systems explanation","volume":"1","author":"Darlington","year":"2013","journal-title":"Univers. J. Control Automat."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, N., Pynadath, D.V., and Hill, S.G. (2016, January 7\u201310). Trust calibration within a human-robot team: Comparing automatically generated explanations. Proceedings of the IEEE Eleventh ACM\/IEEE International Conference on Human Robot Interaction, Christchurch, New Zealand.","DOI":"10.1109\/HRI.2016.7451741"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Swartout, W.R., and Moore, J.D. (1993). Explanation in second generation expert systems. Second Generation Expert Systems, Springer.","DOI":"10.1007\/978-3-642-77927-5_24"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"157","DOI":"10.2307\/249686","article-title":"The Impact of Explanation Facilities on User Acceptance of Expert Systems Advice","volume":"19","author":"Ye","year":"1995","journal-title":"MIS Q."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1016\/S1071-5819(03)00038-7","article-title":"The role of trust in automation reliance","volume":"58","author":"Dzindolet","year":"2003","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1561\/1100000005","article-title":"Human\u2014robot interaction: A survey","volume":"Volume 1","author":"Goodrich","year":"2008","journal-title":"Foundations and Trends\u00ae in Human\u2013Computer Interaction"},{"key":"ref_14","unstructured":"Sheh, R. (2017, January 4\u20135). \u201cWhy Did You Do That?\u201d Explainable Intelligent Robots. Proceedings of the AAMAS Workshops at the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA."},{"key":"ref_15","unstructured":"Stange, S., Buschmeier, H., Hassan, T., Ritter, C., and Kopp, S. (2019, January 13\u201317). Towards self-explaining social robots. Verbal explanation strategies for a needs-based architecture. Proceedings of the AAMAS 2019 Workshop on Cognitive Architectures for HRI: Embodied Models of Situated Natural Language Interactions, Montreal, QC, Canada."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Correia, F., Alves-Oliveira, P., Maia, N., Ribeiro, T., Petisca, S., Melo, F.S., and Paiva, A. (2016, January 26\u201331). Just follow the suit! trust in human-robot interactions during card game playing. Proceedings of the 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.","DOI":"10.1109\/ROMAN.2016.7745165"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1111\/j.1751-9004.2009.00232.x","article-title":"The psychology (and economics) of trust","volume":"3","author":"Evans","year":"2009","journal-title":"Soc. Person. Psychol. Compass"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/TASE.2016.2530623","article-title":"Synthesis of Human-in-the-Loop Control Protocols for Autonomous Systems","volume":"13","author":"Feng","year":"2016","journal-title":"IEEE Trans. Automat. Sci. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Orsag, M., Haus, T., Toli\u0107, D., Ivanovic, A., Car, M., Palunko, I., and Bogdan, S. (July, January 29). Human-in-the-loop control of multi-agent aerial systems. Proceedings of the 2016 European Control Conference (ECC), Aalborg, Denmark.","DOI":"10.1109\/ECC.2016.7810608"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1109\/COMST.2015.2398816","article-title":"A Survey on Human-in-the-Loop Applications Towards an Internet of All","volume":"17","author":"Nunes","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_21","unstructured":"Javid, M., Estivill-Castro, V., and Hexel, R. (2020, January 21\u201325). Enhancing Humans Trust and Perception of Robots Through Explanations. Proceedings of the ACHI 2020: The Thirteenth International Conference on Advances in Computer-Human Interactions, Valencia, Spain."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Paeng, E., Wu, J., and Boerkoel, J.C. (2016, January 12\u201317). Human-Robot Trust and Cooperation Through a Game Theoretic Framework. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence AAAI, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.9961"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/s12369-012-0144-0","article-title":"You want me to trust a ROBOT? The development of a human\u2013robot interaction trust scale","volume":"4","author":"Yagoda","year":"2012","journal-title":"Int. J. Soc. Robot."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Billings, D.R., Schaefer, K.E., Chen, J.Y., Kocsis, V., Barrera, M.L., Cook, J., and Hancock, P.A. (2012). Human-Animal Trust as an Analog for Human-Robot Trust: A Review of Current Evidence, University of Central Florida. Technical Report.","DOI":"10.21236\/ADA559369"},{"key":"ref_25","unstructured":"Miller, C.A. (2005, January 22\u201327). Trust in adaptive automation: The role of etiquette in tuning trust via analogic and affective methods. Proceedings of the 1st International Conference on Augmented Cognition, Las Vegas, NV, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Salem, M., Lakatos, G., Amirabdollahian, F., and Dautenhahn, K. (2015, January 2\u20135). Would you trust a (faulty) robot? Effects of error, task type and personality on human-robot cooperation and trust. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction, ACM, Portland, OR, USA.","DOI":"10.1145\/2696454.2696497"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1207\/s15327809jls0402_2","article-title":"Cognitive tutors: Lessons learned","volume":"4","author":"Anderson","year":"1995","journal-title":"J. Learn. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"497","DOI":"10.2307\/249487","article-title":"Explanations from intelligent systems: Theoretical foundations and implications for practice","volume":"23","author":"Gregor","year":"1999","journal-title":"J. MIS Q."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1126\/science.228.4698.456","article-title":"Intelligent tutoring systems","volume":"228","author":"Anderson","year":"1985","journal-title":"Science"},{"key":"ref_30","unstructured":"Jackson, P. (1998). Introduction to Expert Systems, Addison-Wesley Longman Publishing Co. Inc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1017\/S026988890200019X","article-title":"A review of explanation methods for Bayesian networks","volume":"17","author":"Lacave","year":"2002","journal-title":"Know. Eng. Rev."},{"key":"ref_32","unstructured":"S\u00f8rmo, F., and Cassens, J. (September, January 30). Explanation goals in case-based reasoning. Proceedings of the ECCBR 2004 Workshops, Madrid, Spain."},{"key":"ref_33","first-page":"309","article-title":"Most relevant explanation in Bayesian networks","volume":"42","author":"Yuan","year":"2011","journal-title":"J. Artif. Intel. Res."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lim, B.Y., Dey, A.K., and Avrahami, D. (2009, January 4\u20139). Why and why not explanations improve the intelligibility of context-aware intelligent systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, Boston, MA, USA.","DOI":"10.1145\/1518701.1519023"},{"key":"ref_35","first-page":"73","article-title":"Finding appropriate interaction strategies for proactive dialogue systems\u2014an open quest","volume":"Volume 110","author":"Nothdurft","year":"2015","journal-title":"Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nothdurft, F., and Minker, W. (2016). Justification and transparency explanations in dialogue systems to maintain human-computer trust. Situated Dialog in Speech-Based Human-Computer Interaction, Springer.","DOI":"10.1007\/978-3-319-21834-2_4"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Glass, A., McGuinness, D.L., and Wolverton, M. (2008, January 13\u201316). Toward establishing trust in adaptive agents. Proceedings of the 13th International Conference on Intelligent user Interfaces, ACM, Gran Canaria, Spain.","DOI":"10.1145\/1378773.1378804"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Nothdurft, F., Richter, F., and Minker, W. (2014, January 18\u201320). Probabilistic Human-Computer Trust Handling. Proceedings of the SIGDIAL 2014 Conference, 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Philadelphia, PA, USA.","DOI":"10.3115\/v1\/W14-4307"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Javaid, M., Estivill-Castro, V., and Hexel, R. (2019). Knowledge-Based Robotic Agent as a Game Player. Pacific Rim: Trends In Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-030-29894-4_27"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Darlington, K.W. (2011). Designing for Explanation in Health Care Applications of Expert Systems. SAGE Open, 1.","DOI":"10.1177\/2158244011408618"},{"key":"ref_41","unstructured":"Malle, F.B. (2006). How the Mind Explains Behavior: Folk Explanations, Meaning, and Social Interaction, Mit Press."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1207\/s15327809jls0401_2","article-title":"Interaction analysis: Foundations and practice","volume":"4","author":"Jordan","year":"1995","journal-title":"J. Learn. Sci."},{"key":"ref_43","unstructured":"Heath, C., Hindmarsh, J., and Luff, P. (2010). Video in Qualitative Research, Sage Publications."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"841","DOI":"10.3758\/BRM.41.3.841","article-title":"Coding gestural behavior with the NEUROGES-ELAN system","volume":"41","author":"Lausberg","year":"2009","journal-title":"Behav. Res. Methods"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Hamacher, A., Bianchi-Berthouze, N., Pipe, A.G., and Eder, K. (2016, January 26\u201331). Believing in BERT: Using expressive communication to enhance trust and counteract operational error in physical Human-Robot Interaction. Proceedings of the 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.","DOI":"10.1109\/ROMAN.2016.7745163"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Walter, M.L., Dautenhahn, K., Te Boekhorst, R., Koay, K.L., Kaouri, C., Woods, S., and Werry, I. (2005, January 13\u201315). The influence of subjects\u2019 personality traits on personal spatial zones in a human-robot interaction experiment. Proceedings of the ROMAN 2005, IEEE International Workshop on Robot and Human Interactive Communication, Nashville, TN, USA.","DOI":"10.1109\/ROMAN.2005.1513803"},{"key":"ref_47","unstructured":"Chen, M., Nikolaidis, S., Soh, H., Hsu, D., and Srinivasa, S. (2017, January 10\u201312). The role of trust in decision-making for human robot collaboration. Proceedings of the Human-Centered Robotics workshop of the 13th International Conference on Robotics: Science and System (RSS), Cambridge, MA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Haring, K.S., Silvera-Tawil, D., Matsumoto, Y., Velonaki, M., and Watanabe, K. (2014, January 27\u201329). Perception of an android robot in Japan and Australia: A cross-cultural comparison. Proceedings of the International Conference on Social Robotics, Sydney, NSW, Australia.","DOI":"10.1007\/978-3-319-11973-1_17"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s12369-008-0001-3","article-title":"Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots","volume":"1","author":"Bartneck","year":"2009","journal-title":"Int. J. Soc. Robot."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Kiesler, S., and Goetz, J. (2002, January 20\u201325). Mental models of robotic assistants. Extended abstracts. Proceedings of the CHI\u201902 Human Factors in Computing Systems, Minneapolis, MN, USA.","DOI":"10.1145\/506443.506491"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","article-title":"Explanation in artificial intelligence: Insights from the social sciences","volume":"267","author":"Miller","year":"2018","journal-title":"Artif. Intell."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/1\/51\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:39:59Z","timestamp":1760161199000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/1\/51"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,23]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["robotics10010051"],"URL":"https:\/\/doi.org\/10.3390\/robotics10010051","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,23]]}}}