{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T03:31:04Z","timestamp":1776828664471,"version":"3.51.2"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:00:00Z","timestamp":1687478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["CNS-1836952"],"award-info":[{"award-number":["CNS-1836952"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2023,9,30]]},"abstract":"<jats:p>Autonomous systems that can assist humans with increasingly complex tasks are becoming ubiquitous. Moreover, it has been established that a human\u2019s decision to rely on such systems is a function of both their trust in the system and their own self-confidence as it relates to executing the task of interest. Given that both under- and over-reliance on automation can pose significant risks to humans, there is motivation for developing autonomous systems that could appropriately calibrate a human\u2019s trust or self-confidence to achieve proper reliance behavior. In this article, a computational model of coupled human trust and self-confidence dynamics is proposed. The dynamics are modeled as a partially observable Markov decision process without a reward function (POMDP\/R) that leverages behavioral and self-report data as observations for estimation of these cognitive states. The model is trained and validated using data collected from 340 participants. Analysis of the transition probabilities shows that the proposed model captures the probabilistic relationship between trust, self-confidence, and reliance for all discrete combinations of high and low trust and self-confidence. The use of the proposed model to design an optimal policy to facilitate trust and self-confidence calibration is a goal of future work.<\/jats:p>","DOI":"10.1145\/3594715","type":"journal-article","created":{"date-parts":[[2023,4,27]],"date-time":"2023-04-27T11:57:08Z","timestamp":1682596628000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["A Computational Model of Coupled Human Trust and Self-confidence Dynamics"],"prefix":"10.1145","volume":"12","author":[{"given":"Katherine J.","family":"Williams","sequence":"first","affiliation":[{"name":"Purdue University, USA"}]},{"given":"Madeleine S.","family":"Yuh","sequence":"additional","affiliation":[{"name":"Purdue University, USA"}]},{"given":"Neera","family":"Jain","sequence":"additional","affiliation":[{"name":"Purdue University, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,6,23]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"2018. Amazon Mechanical Turk. https:\/\/www.mturk.com\/."},{"key":"e_1_3_3_3_2","unstructured":"2021. MATLAB Optimization Toolbox. https:\/\/www.mathworks.com\/products\/optimization.html#resources."},{"key":"e_1_3_3_4_2","volume-title":"Reimagining Human-machine Interactions through Trust-based Feedback","author":"Akash Kumar","year":"2020","unstructured":"Kumar Akash. 2020. Reimagining Human-machine Interactions through Trust-based Feedback. Thesis. Purdue University Graduate School."},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132743"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCS.2020.3019151"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2019.01.026"},{"key":"e_1_3_3_8_2","doi-asserted-by":"crossref","first-page":"1542","DOI":"10.23919\/ACC.2017.7963172","volume-title":"2017 American Control Conference (ACC\u201917)","author":"Akash Kumar","year":"2017","unstructured":"Kumar Akash, Wan-Lin Hu, Tahira Reid, and Neera Jain. 2017. Dynamic modeling of trust in human-machine interactions. In 2017 American Control Conference (ACC\u201917). IEEE, Seattle, WA, 1542\u20131548. DOI:10.23919\/ACC.2017.7963172"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1259\/bjr\/37221979"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-020-00694-1"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssci.2013.10.014"},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","DOI":"10.4324\/9781315806624","volume-title":"Human Factors in Intelligent Transportation Systems","author":"Barfield Woodrow","year":"2014","unstructured":"Woodrow Barfield and Thomas A. Dingus. 2014. Human Factors in Intelligent Transportation Systems. (1st ed.) Taylor & Francis, New York."},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213601672"},{"key":"e_1_3_3_14_2","unstructured":"Erik Brockbank Haoliang Wang Justin Yang Suvir Mirchandani Erdem B\u0131y\u0131k Dorsa Sadigh and Judith E. Fan. 2022. How do people incorporate advice from artificial agents when making physical judgments? (May 2022). DOI:10.48550\/arXiv.2205.11613"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.100.3.432"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816682648"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140130802680773"},{"key":"e_1_3_3_18_2","first-page":"307","volume-title":"Proceedings of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201918)","author":"Chen Min","year":"2018","unstructured":"Min Chen, Stefanos Nikolaidis, Harold Soh, David Hsu, and Siddhartha Srinivasa. 2018. Planning with trust for human-robot collaboration. In Proceedings of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201918). Association for Computing Machinery, New York, NY, 307\u2013315. DOI:10.1145\/3171221.3171264"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1037\/xap0000092"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2018.1457725"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1177\/1555343411410160"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-019-00596-x"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00039-9"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0073415"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00038-7"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816681350"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720812443983"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24586-7_10"},{"key":"e_1_3_3_29_2","volume-title":"Report on Technology Horizons: A Vision for Air Force Science & Technology during 2010\u2013203","author":"Force US Air","year":"2010","unstructured":"US Air Force. 2010. Report on Technology Horizons: A Vision for Air Force Science & Technology during 2010\u2013203. Technical Report. https:\/\/www.airuniversity.af.edu\/AUPress\/Book-Reviews\/Display\/Article\/1194559\/report-on-technology-horizons-a-vision-for-air-force-science-technology-during\/."},{"issue":"1","key":"e_1_3_3_30_2","first-page":"121","article-title":"Drones, drone strikes, and US policy: The politics of unmanned aerial vehicles","volume":"44","author":"Franke Ulrike Esther","year":"2014","unstructured":"Ulrike Esther Franke. 2014. Drones, drone strikes, and US policy: The politics of unmanned aerial vehicles. Parameters 44, 1 (2014), 121\u2013130.","journal-title":"Parameters"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2007.4621745"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2005.855783"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-90-481-9707-1_23"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1177\/1064804613477099"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720814547570"},{"issue":"1","key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3233\/WIA-130260","article-title":"Modelling biased human trust dynamics","volume":"11","author":"Hoogendoorn Mark","year":"2013","unstructured":"Mark Hoogendoorn, Syed Waqar Jaffry, Peter Paul Van Maanen, and Jan Treur. 2013. Modelling biased human trust dynamics. Web Intelligence and Agent Systems 11, 1 (Aug. 2013), 21\u201340.","journal-title":"Web Intelligence and Agent Systems"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2016.12.188"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2874188"},{"key":"e_1_3_3_39_2","volume-title":"Proceedings of the 53rd Hawaii International Conference on System Sciences","author":"Hussein Aya","year":"2020","unstructured":"Aya Hussein, Sondoss Elsawah, and Hussein Abbass. 2020. Towards trust-aware human-automation interaction: An overview of the potential of computational trust models. In Proceedings of the 53rd Hawaii International Conference on System Sciences. DOI:10.24251\/HICSS.2020.047"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3230735"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jarmac.2014.09.004"},{"key":"e_1_3_3_42_2","article-title":"Adaptive cognitive mechanisms to maintain calibrated trust and reliance in automation","volume":"8","author":"Lebiere Christian","year":"2021","unstructured":"Christian Lebiere, Leslie M. Blaha, Corey K. Fallon, and Brett Jefferson. 2021. Adaptive cognitive mechanisms to maintain calibrated trust and reliance in automation. Frontiers in Robotics and AI 8 (2021). https:\/\/www.frontiersin.org\/article\/10.3389\/frobt.2021.652776.","journal-title":"Frontiers in Robotics and AI"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139208967392"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1994.1007"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50_30392"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1037\/1076-898X.6.2.104"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1177\/014233129902100405"},{"key":"e_1_3_3_48_2","first-page":"287","volume-title":"Proceedings of the 2011 IEEE\/WIC\/ACM International Conference on Intelligent Agent Technology","author":"Maanen Peter-Paul","year":"2011","unstructured":"Peter-Paul Maanen, Francien Wisse, Jurriaan Diggelen, and Robbert Jan Beun. 2011. Effects of reliance support on team performance by advising and adaptive autonomy. In Proceedings of the 2011 IEEE\/WIC\/ACM International Conference on Intelligent Agent Technology. IEEE, 287. DOI:10.1109\/WI-IAT.2011.117"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1080\/14639220500337708"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1117\/12.918927"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(87)80013-5"},{"key":"e_1_3_3_52_2","volume-title":"Operators\u2019 Trust in and Use of Automatic Controllers in a Supervisory Process Control Task.","author":"Muir Bonnie M.","year":"1990","unstructured":"Bonnie M. Muir. 1990. Operators\u2019 Trust in and Use of Automatic Controllers in a Supervisory Process Control Task. Ph.D. Thesis. University of Toronto, Toronto, ON, Canada."},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139608964474"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1518\/107118109X1252444108002"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0229132"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720810376055"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778543886"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCS.2015.2471056"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-48113-3_7"},{"key":"e_1_3_3_60_2","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/978-3-540-71805-5_44","volume-title":"Applications of Evolutionary Computing","author":"P\u00e9rez \u00d3scar","year":"2007","unstructured":"\u00d3scar P\u00e9rez, Massimo Piccardi, Jes\u00fas Garc\u00eda, Miguel \u00c1ngel Patricio, and Jos\u00e9 Manuel Molina. 2007. Comparison between genetic algorithms and the Baum-Welch algorithm in learning HMMs for human activity classification. In Applications of Evolutionary Computing, Mario Giacobini (Ed.). Lecture Notes in Computer Science, Vol. 4448. Springer, Berlin, 399\u2013406."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/MASSP.1986.1165342"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1080\/00207540050204894"},{"key":"e_1_3_3_63_2","first-page":"19","volume-title":"Automation and Human Performance: Theory and Applications","author":"Riley Victor","year":"1996","unstructured":"Victor Riley. 1996. Operator reliance on automation: Theory and data. In Automation and Human Performance: Theory and Applications (1st ed.), Raja Parasuraman and Mustapha Mouloua (Eds.). CRC Press, Mahwah, NJ, 19\u201335."},{"key":"e_1_3_3_64_2","first-page":"V001T04A015 (8","volume-title":"ASME 2018 Dynamic Systems and Control Conference","author":"Sadrfaridpour Behzad","year":"2018","unstructured":"Behzad Sadrfaridpour, Maziar Fooladi Mahani, Zhanrui Liao, and Yue Wang. 2018. Trust-based impedance control strategy for human-robot cooperative manipulation. In ASME 2018 Dynamic Systems and Control Conference. American Society of Mechanical Engineers, V001T04A015 (8 pages). DOI:10.1115\/DSCC2018-9170"},{"key":"e_1_3_3_65_2","doi-asserted-by":"crossref","first-page":"6052","DOI":"10.1109\/CDC.2015.7403171","volume-title":"2015 54th IEEE Conference on Decision and Control (CDC\u201915)","author":"Saeidi Hamed","year":"2015","unstructured":"Hamed Saeidi and Yue Wang. 2015. Trust and self-confidence based autonomy allocation for robotic systems. In 2015 54th IEEE Conference on Decision and Control (CDC\u201915). IEEE, 6052\u20136057. DOI:10.1109\/CDC.2015.7403171"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2886406"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-819472-0.00019-8"},{"key":"e_1_3_3_68_2","volume-title":"Telerobotics, Automation, and Human Supervisory Control","author":"Sheridan Thomas B.","year":"1992","unstructured":"Thomas B. Sheridan. 1992. Telerobotics, Automation, and Human Supervisory Control. MIT Press, Cambridge, MA."},{"key":"e_1_3_3_69_2","doi-asserted-by":"crossref","DOI":"10.1002\/9781118557426","volume-title":"Markov Decision Processes in Artificial Intelligence","author":"Sigaud Olivier","year":"2013","unstructured":"Olivier Sigaud and Olivier Buffet. 2013. Markov Decision Processes in Artificial Intelligence. John Wiley & Sons, Hoboken, NJ. 2009048651"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919866905"},{"key":"e_1_3_3_71_2","first-page":"247","volume-title":"2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR\u201920)","author":"Tao Yudong","year":"2020","unstructured":"Yudong Tao, Erik Coltey, Tianyi Wang, Miguel Alonso, Mei-Ling Shyu, Shu-Ching Chen, Hadi Alhaffar, Albert Elias, Biayna Bogosian, and Shahin Vassigh. 2020. Confidence estimation using machine learning in immersive learning environments. In 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR\u201920). IEEE, 247\u2013252. DOI:10.1109\/MIPR49039.2020.00058"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2012.10.018"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3152890"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1177\/1071181311551077"},{"key":"e_1_3_3_75_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-4948-1","volume-title":"An Attribution Theory of Motivation and Emotion","author":"Weiner Bernard","year":"1986","unstructured":"Bernard Weiner. 1986. An Attribution Theory of Motivation and Emotion. Vol. 92. Springer-Verlag, New York, NY."},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.00519"},{"key":"e_1_3_3_77_2","first-page":"221","volume-title":"Proceedings of the 10th Annual ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201915)","author":"Xu Anqi","year":"2015","unstructured":"Anqi Xu and Gregory Dudek. 2015. OPTIMo: Online probabilistic trust inference model for asymmetric human-robot collaborations. In Proceedings of the 10th Annual ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201915). ACM, New York, NY, 221\u2013228. DOI:10.1145\/2696454.2696492"},{"key":"e_1_3_3_78_2","first-page":"408","volume-title":"Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201917)","author":"Yang X. Jessie","year":"2017","unstructured":"X. Jessie Yang, Vaibhav V. Unhelkar, Kevin Li, and Julie A. Shah. 2017. Evaluating effects of user experience and system transparency on trust in automation. In Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201917). Association for Computing Machinery, New York, NY, 408\u2013416. DOI:10.1145\/2909824.3020230"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3594715","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3594715","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:50Z","timestamp":1750178270000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3594715"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,23]]},"references-count":77,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,30]]}},"alternative-id":["10.1145\/3594715"],"URL":"https:\/\/doi.org\/10.1145\/3594715","relation":{},"ISSN":["2573-9522","2573-9522"],"issn-type":[{"value":"2573-9522","type":"print"},{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,23]]},"assertion":[{"value":"2021-08-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-06","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}