{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T05:14:41Z","timestamp":1778303681671,"version":"3.51.4"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ONR","award":["N00014-18-S-B001"],"award-info":[{"award-number":["N00014-18-S-B001"]}]},{"DOI":"10.13039\/100007187","name":"MIT Lincoln Laboratory","doi-asserted-by":"crossref","award":["7000437192"],"award-info":[{"award-number":["7000437192"]}],"id":[{"id":"10.13039\/100007187","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Georgia Tech Institute"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>As robots become ubiquitous in the workforce, it is essential that human-robot collaboration be both intuitive and adaptive. A robot\u2019s ability to coordinate team activities improves based on its ability to infer and reason about the dynamic (i.e., the \u201clearning curve\u201d) and stochastic task performance of its human counterparts. We introduce a novel resource coordination algorithm that enables robots to schedule team activities by (1) actively characterizing the task performance of their human teammates and (2) ensuring the schedule is robust to temporal constraints given this characterization. We first validate our modeling assumptions via user study. From this user study, we create a data-driven prior distribution over human task performance for our virtual and physical evaluations of human-robot teaming. Second, we show that our methods are scalable and produce high-quality schedules. Third, we conduct a between-subjects experiment (n = 90) to assess the effects on a human-robot team of a robot scheduler actively exploring the humans\u2019 task proficiency. Our results indicate that human-robot working alliance (<jats:inline-formula content-type=\"math\/tex\"><jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\( p\\lt 0.001 \\)<\/jats:tex-math><\/jats:inline-formula>) and human performance (<jats:inline-formula content-type=\"math\/tex\"><jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\( p=0.00359 \\)<\/jats:tex-math><\/jats:inline-formula>) are maximized when the robot dedicates more time to exploring the capabilities of human teammates.<\/jats:p>","DOI":"10.1145\/3477391","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T00:28:21Z","timestamp":1634603301000},"page":"1-42","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Coordinating Human-Robot Teams with Dynamic and Stochastic Task Proficiencies"],"prefix":"10.1145","volume":"11","author":[{"given":"Ruisen","family":"Liu","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, Georgia"}]},{"given":"Manisha","family":"Natarajan","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, Georgia"}]},{"given":"Matthew C.","family":"Gombolay","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, Georgia"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0262.2006.00655.x"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/PESGM.2017.8273755"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2013.07.026"},{"key":"e_1_3_2_5_2","unstructured":"Laura Barbulescu Zachary Rubinstein Stephen Smith and Terry Zimmerman. 2010. Distributed coordination of mobile agent teams: The advantage of planning ahead. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems . Vol. 1 1331\u20131338. https:\/\/doi.org\/10.1145\/1838206.1838380."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.1996.573689"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/PL00011380"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1137\/S1052623400374756"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1030.0065"},{"key":"e_1_3_2_10_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Boerkoel James C.","year":"2012","unstructured":"James C. Boerkoel and Edmund H. Durfee. 2012. A distributed approach to summarizing spaces of multiagent schedules. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201912)."},{"key":"e_1_3_2_11_2","volume-title":"Proceedings of the 27th AAAI Conference on Artificial Intelligence","author":"Boerkoel Jr. James","year":"2013","unstructured":"James Boerkoel Jr. and Edmund Durfee. 2013. Decoupling the multiagent disjunctive temporal problem. Proceedings of the 27th AAAI Conference on Artificial Intelligence (AAAI\u201913)."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-0676-1"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2006.875041"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/9.895560"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAdLT.2014.6866316"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1080\/0951192X.2011.575181"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.1.1.Chao"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.6.1.73"},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Min Chen Stefanos Nikolaidis Harold Soh David Hsu and Siddhartha Srinivasa. 2018. Planning with trust for human-robot collaboration. In Proceedings of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201918) . Association for Computing Machinery New York NY USA 307\u2013315. DOI:https:\/\/doi.org\/10.1145\/3171221.3171264","DOI":"10.1145\/3171221.3171264"},{"key":"e_1_3_2_20_2","first-page":"13","article-title":"An approach to planning and control of ship repair manufacturing operations","volume":"32","author":"Chryssolouris George","year":"2003","unstructured":"George Chryssolouris, Dimitris Mourtzis, and S. Makris. 2003. An approach to planning and control of ship repair manufacturing operations. CIRP J. Manufact. Sci. Technol. 32 (01 2003), 13\u201319.","journal-title":"CIRP J. Manufact. Sci. Technol."},{"key":"e_1_3_2_21_2","unstructured":"Houston Claure Yifang Chen Jignesh Modi Malte Jung and Stefanos Nikolaidis. 2019. Reinforcement Learning with Fairness Constraints for Resource Distribution in Human-Robot Teams. arXiv preprint arXiv:1907.00313."},{"key":"e_1_3_2_22_2","volume-title":"Proceedings of the Workshop on Constraint Satisfaction Techniques for Planning and Scheduling Problems","author":"Coles Amanda","year":"2009","unstructured":"Amanda Coles, Andrew Coles, Maria Fox, and Derek Long. 2009. Incremental constraint-posting algorithms in interleaved planning and scheduling. In Proceedings of the Workshop on Constraint Satisfaction Techniques for Planning and Scheduling Problems (COPLAS\u201909)."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.6.1.80"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(87)90002-6"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.5555\/2447556.2447663"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2006.876939"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479896298130"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1137\/S1052623496305717"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1518\/001872095779049543"},{"key":"e_1_3_2_30_2","first-page":"2264","volume-title":"Proceedings of the 28th AAAI Conference on Artificial Intelligence","author":"Fang Cheng","year":"2014","unstructured":"Cheng Fang, Peng Yu, and Brian C. Williams. 2014. Chance-constrained probabilistic simple temporal problems. In Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI\u201914). AAAI Press, 2264\u20132270."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0014-2921(01)00208-2"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364916688255"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-015-9457-9"},{"key":"e_1_3_2_34_2","volume-title":"Proceedings of the AAAI Fall Symposia","author":"Gombolay Matthew Craig","year":"2015","unstructured":"Matthew Craig Gombolay, Cindy Huang, and Julie A. Shah. 2015. Coordination of human-robot teaming with human task preferences. In Proceedings of the AAAI Fall Symposia."},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","unstructured":"Matthew C. Gombolay Reed Jensen Jessica Stigile Toni Golen Neel Shah Sung-Hyun Son and Julie A. Shah. 2018. Human-machine collaborative optimization via apprenticeship scheduling. Retrieved from http:\/\/arxiv.org\/abs\/1805.04220.","DOI":"10.1613\/jair.1.11233"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2018.2795034"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2014.12.006"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1177\/1541931218621034"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1075\/is.8.3.10gro"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2004.04.002"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2019.2904558"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Chien-Ming Huang Maya Cakmak and Bilge Mutlu. 2015. Adaptive coordination strategies for human-robot handovers. In Robotics: Science and Systems Vol. 11 .","DOI":"10.15607\/RSS.2015.XI.031"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMAS.2000.858447"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1568-4946(01)00005-9"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.1996.573700"},{"key":"e_1_3_2_46_2","unstructured":"Sven Koenig Craig Tovey Michail Lagoudakis Evangelos Markakis David Kempe Pinar Keskinocak Anton Kleywegt Adam Meyerson and Sonal Jain. 2006. The power of sequential single-item auctions for agent coordination. In AAAI . 1625\u20131629."},{"key":"e_1_3_2_47_2","volume-title":"xBots: An Approach to Generating and Executing Optimal Multi-Robot Plans with Constraints","author":"Korsah G. Ayorkor","year":"2011","unstructured":"G. Ayorkor Korsah, Balajee Kannan, Brett Browning, and M. Bernardine Dias. 2011. xBots: An Approach to Generating and Executing Optimal Multi-Robot Plans with Constraints. Technical Report CMU-RI-TR-11-25. Carnegie Mellon University, Pittsburgh, PA."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2014.08.021"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2005.I.045"},{"key":"e_1_3_2_50_2","first-page":"135","volume-title":"The Role of Trust in Human-Robot Interaction","author":"Lewis Michael","year":"2018","unstructured":"Michael Lewis, Katia Sycara, and Phillip Walker. 2018. The Role of Trust in Human-Robot Interaction. Springer, Cham, 135\u2013159. https:\/\/doi.org\/10.1007\/978-3-319-64816-3_8"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1287\/opre.8.2.219"},{"key":"e_1_3_2_52_2","first-page":"3427","volume-title":"Proceedings of the 47th IEEE Conference on Decision and Control","author":"Ono Masahiro","year":"2008","unstructured":"Masahiro Ono and B. C. Williams. 2008. Iterative risk allocation: A new approach to robust Model Predictive Control with a joint chance constraint. In Proceedings of the 47th IEEE Conference on Decision and Control. 3427\u20133432. https:\/\/doi.org\/10.1109\/CDC.2008.4739221"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.disopt.2016.01.005"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2010.03.011"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1137\/050622328"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.5555\/2447556.2447563"},{"key":"e_1_3_2_57_2","first-page":"2110","volume-title":"Proceedings of the 29th AAAI Conference on Artificial Intelligence","author":"Nunes Ernesto","year":"2015","unstructured":"Ernesto Nunes and Maria Gini. 2015. Multi-robot auctions for allocation of tasks with temporal constraints. In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI\u201915). AAAI Press, 2110\u20132216. http:\/\/dl.acm.org\/citation.cfm?id=2886521.2886614"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2016.10.008"},{"key":"e_1_3_2_59_2","unstructured":"Leon Planken Mathijs Weerdt and Roman Krogt. 2008. P3C: A new algorithm for the simple temporal problem. In International Conference on Automated Planning and Scheduling Vol. 2008. 256\u2013263."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mechatronics.2018.07.007"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.5555\/3176788.3176800"},{"key":"e_1_3_2_62_2","first-page":"8602","volume-title":"The Learning Curve","author":"Ritter F. E.","year":"2001","unstructured":"F. E. Ritter and L. J. Schooler. 2001. The Learning Curve. In International Encyclopedia of the Social and Behavioral Sciences. Pergamon, Amsterdam, 8602\u20138605. https:\/\/doi.org\/10.1016\/B0-08-043076-7\/01480-7"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2017.2648849"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9816.003.0061"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1080\/09511920802209033"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/2696454.2696497"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479803430953"},{"key":"e_1_3_2_68_2","doi-asserted-by":"crossref","unstructured":"Sarah Sebo Ling Dong Nicholas Chang and Brian Scassellati. 2020. Strategies for the inclusion of human members within human-robot teams. In Proceedings of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction . 309\u2013317. https:\/\/doi.org\/10.1145\/3319502.3374808","DOI":"10.1145\/3319502.3374808"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v042.i07"},{"key":"e_1_3_2_70_2","doi-asserted-by":"crossref","unstructured":"Marc Sevaux and Kenneth S\u00f6rensen. 2004. A genetic algorithm for robust schedules in a just-in-time environment with ready times and due dates. Working Papers 2003008. University of Antwerp Faculty of Business and Economics. https:\/\/ideas.repec.org\/p\/ant\/wpaper\/2003008.html.","DOI":"10.1007\/s10288-003-0028-0"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957668"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1287\/opre.21.5.1154"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2210-10-6"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/9.62270"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1214\/09-STS313"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1016\/0925-5273(93)90007-8"},{"key":"e_1_3_2_77_2","doi-asserted-by":"crossref","unstructured":"Ioannis Tsamardinos. 2002. A probabilistic approach to robust execution of temporal plans with uncertainty. In Hellenic Conference on Artificial Intelligence . Springer Berlin Heidelberg 97\u2013108.","DOI":"10.1007\/3-540-46014-4_10"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1080\/0951192X.2016.1187297"},{"key":"e_1_3_2_79_2","volume-title":"Statistical Learning Theory","author":"Vapnik Vladimir N.","year":"1998","unstructured":"Vladimir N. Vapnik. 1998. Statistical Learning Theory. Wiley-Interscience."},{"key":"e_1_3_2_80_2","volume-title":"A Theory of Learning and Generalization: With Applications to Neural Networks and Control Systems","author":"Vidyasagar M.","year":"1997","unstructured":"M. Vidyasagar. 1997. A Theory of Learning and Generalization: With Applications to Neural Networks and Control Systems. Springer-Verlag, Berlin."},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-1098(01)00122-4"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.5555\/3378680.3378846"},{"key":"e_1_3_2_83_2","doi-asserted-by":"crossref","unstructured":"Yang Xu Paul Scerri Bin Yu Steven Okamoto and Michael Lewis. 2005. An integrated token-based algorithm for scalable coordination. In Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems . 407\u2013414.","DOI":"10.1145\/1082473.1082536"},{"key":"e_1_3_2_84_2","first-page":"408","volume-title":"Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction","author":"Yang X. Jessie","year":"2017","unstructured":"X. Jessie Yang, Vaibhav V. Unhelkar, Kevin Li, and Julie A. Shah. 2017. Evaluating effects of user experience and system transparency on trust in automation. In Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201917). Association for Computing Machinery, New York, NY, 408\u2013416. https:\/\/doi.org\/10.1145\/2909824.3020230"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477391","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477391","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477391","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:32Z","timestamp":1750188632000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477391"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":83,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3477391"],"URL":"https:\/\/doi.org\/10.1145\/3477391","relation":{},"ISSN":["2573-9522","2573-9522"],"issn-type":[{"value":"2573-9522","type":"print"},{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2020-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}