{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T08:08:15Z","timestamp":1774512495297,"version":"3.50.1"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T00:00:00Z","timestamp":1774483200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100007493","name":"University of Colorado Boulder","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007493","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Human\u2013machine teaming allows people to leverage the impressive capabilities of autonomous robotic teammates to safely accomplish challenging tasks. Although users may be experts in their fields, robotic interfaces need to be intuitive to the general population and able to quickly interpret minimal user input from multiple modalities in directing autonomous teammates toward key locations for information-based tasking. This work presents a flexible multimodal algorithmic and visual interface that enables dynamic reprogramming of autonomous planning algorithms, focusing on the use of uncrewed aerial systems engaged in outdoor search and rescue. The Responsive Interface for iNtuitive Aircraft Operation (RINAO) leverages known geographic database information, such as trail networks, in conjunction with a variable set of user-defined features, such as search areas and landmarks, to efficiently infer a mission-specific, uncertainty-aware geospatial interest distribution that informs optimal planning algorithms through reward shaping. The approach is validated using 10 experts in public safety with 13.5 years of median operational experience. Results of this user evaluation show that the system enables effective and efficient alignment of geospatial interest and above-average usability. Evaluating the system\u2019s performance against an inverse reinforcement learning (IRL) baseline, we find that our approach meets or exceeds the baseline\u2019s value alignment while performing inference in substantially less time and with less user input. These results demonstrate that multimodal preference inference can enable rapid and intuitive mission specification for human\u2014robot teams operating in time-critical environments.<\/jats:p>","DOI":"10.3389\/frobt.2026.1751002","type":"journal-article","created":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T06:33:49Z","timestamp":1774506829000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Data sparse inference of operator spatial reward models in uncertain environments"],"prefix":"10.3389","volume":"13","author":[{"given":"Hunter M.","family":"Ray","sequence":"first","affiliation":[{"name":"Cooperative Human-Robot Intelligence Laboratory, Department of Aerospace Engineering, University of Colorado Boulder","place":["Boulder, CO, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aditya","family":"Pandey","sequence":"additional","affiliation":[{"name":"Cooperative Human-Robot Intelligence Laboratory, Department of Aerospace Engineering, University of Colorado Boulder","place":["Boulder, CO, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nisar","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Cooperative Human-Robot Intelligence Laboratory, Department of Aerospace Engineering, University of Colorado Boulder","place":["Boulder, CO, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,3,26]]},"reference":[{"key":"B1","first-page":"1","article-title":"Apprenticeship learning via inverse reinforcement learning","author":"Abbeel","year":"2004"},{"key":"B2","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1109\/TRO.2012.2214556","article-title":"Bayesian multicategorical soft data fusion for human\u2013robot Collaboration","volume":"29","author":"Ahmed","year":"2013","journal-title":"IEEE Trans. Robotics"},{"key":"B39","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.1109\/LSP.2018.2860238","article-title":"Data-free\/data-sparse softmax parameter estimation with structured class geometries","volume":"25","author":"Ahmed","year":"2018","journal-title":"IEEE Signal Process. Lett."},{"key":"B3","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1145\/2735960.2735970","article-title":"Fully bayesian learning and spatial reasoning with flexible human sensor networks","volume-title":"Proceedings of the ACM\/IEEE sixth international conference on cyber-physical systems - ICCPS \u201915","author":"Ahmed","year":"2015"},{"key":"B4","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.artint.2018.01.002","article-title":"Autonomous agents modelling Other Agents: a Comprehensive Survey and open problems","volume":"258","author":"Albrecht","year":"2018","journal-title":"Artif. Intell."},{"key":"B5","doi-asserted-by":"publisher","first-page":"103500","DOI":"10.1016\/j.artint.2021.103500","article-title":"A survey of inverse reinforcement learning: challenges, methods and progress","volume":"297","author":"Arora","year":"2021","journal-title":"Artif. Intell."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1827","DOI":"10.1007\/s10514-019-09836-5","article-title":"Multi-modal active perception for information gathering in science missions","volume":"43","author":"Arora","year":"2019","journal-title":"Aut. Robots"},{"key":"B7","volume-title":"Pattern recognition and machine learning","author":"Bishop","year":"2006"},{"key":"B8","article-title":"Gaussian process preference elicitation","volume-title":"Advances in Neural Information Processing Systems","author":"Bonilla","year":"2010"},{"key":"B9","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v37i5.25733","article-title":"The perils of trial-and-error reward design: misdesign through overfitting and invalid task specifications","volume-title":"Proceedings of the 37th AAAI conference on artificial intelligence (AAAI)","author":"Booth","year":"2023"},{"key":"B10","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/MIS.2013.70","article-title":"The seven deadly myths of \u201cAutonomous Systems\u201d","volume":"28","author":"Bradshaw","year":"2013","journal-title":"IEEE Intell. Syst."},{"key":"B11","first-page":"189","article-title":"SUS\u2014a quick and dirty usability scale","volume-title":"Usability Evaluation in Industry","author":"Brooke","year":"1995"},{"key":"B12","volume-title":"Active collaborative planning and sensing in human-robot teams","author":"Burks","year":"2020"},{"key":"B13","doi-asserted-by":"publisher","first-page":"3024","DOI":"10.1109\/TRO.2023.3263460","article-title":"HARPS: an online POMDP framework for human-assisted robotic planning and sensing","volume":"39","author":"Burks","year":"2023","journal-title":"IEEE Trans. Robotics"},{"key":"B14","article-title":"Efficient selectivity and backup operators in Monte-Carlo tree search","volume-title":"International Conference on Computer and Games","author":"Coulom","year":"2006"},{"key":"B15","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/j.procir.2021.05.067","article-title":"Active preference learning in product design decisions","volume":"100","author":"Desmedt","year":"2021","journal-title":"Procedia CIRP"},{"key":"B16","first-page":"1","article-title":"POMDPs.jl: a framework for sequential decision making under uncertainty","volume":"18","author":"Egorov","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"B17","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1007\/s11750-008-0055-2","article-title":"A practical algorithm for decomposing polygonal domains into convex polygons by diagonals","volume":"16","author":"Fern\u00e1ndez","year":"2008","journal-title":"TOP"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1002\/rob.21947","article-title":"Field observation of tornadic supercells by multiple autonomous fixed-wing unmanned aircraft","volume":"37","author":"Frew","year":"2020","journal-title":"J. Field Robotics"},{"key":"B19","doi-asserted-by":"publisher","first-page":"429","DOI":"10.5555\/3398761.3398815","article-title":"Toward genuine robot teammates: improving human-robot team performance using robot shared mental models","volume":"19","author":"Gervits","year":"2020","journal-title":"Proc. 19th Int. Conf. Aut. Agents Multiagent Syst."},{"key":"B20","article-title":"Inverse reward design","volume-title":"Advances in Neural Information Processing Systems","author":"Hadfield-Menell","year":"2017"},{"key":"B21","first-page":"1806","article-title":"Active reward learning for Co-Robotic vision based exploration in bandwidth limited environments","volume-title":"2020","author":"Jamieson","year":"2020"},{"key":"B22","volume-title":"Algorithms for decision making","author":"Kochenderfer","year":"2022"},{"key":"B23","article-title":"Rapidly-exploring random trees: a new tool for path planning","author":"LaValle","year":"1998"},{"key":"B24","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1145\/1772690.1772758","article-title":"A contextual-bandit approach to personalized news article recommendation","volume-title":"Proceedings of the 19th International Conference on World Wide Web","author":"Li","year":"2010"},{"key":"B25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2669592.2669649","article-title":"Delegation and intent expression for human-automation interaction: thoughts for single pilot operations","volume-title":"Proceedings of the International Conference on Human-Computer Interaction in Aerospace","author":"Miller","year":"2014"},{"key":"B26","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1109\/HRI.2013.6483499","article-title":"Human-robot cross-training: computational formulation, modeling and evaluation of a human team training strategy","author":"Nikolaidis","year":"2013","journal-title":"2013 8th ACM\/IEEE International Conference on Human-Robot Interaction (HRI)"},{"key":"B27","first-page":"2343","volume-title":"User preference elicitation for unmanned aircraft System collaborative search","author":"Ray","year":""},{"key":"B28","first-page":"922","article-title":"A review of the operational use of UAS in public safety emergency incidents","volume-title":"International conference on unmanned aerial systems (ICUAS)","author":"Ray","year":""},{"key":"B29","doi-asserted-by":"crossref","first-page":"9563","DOI":"10.1109\/ICRA57147.2024.10611708","article-title":"Human-Centered autonomy for UAS target search","volume-title":"2024 IEEE International Conference on Robotics and Automation (ICRA)","author":"Ray","year":"2024"},{"key":"B30","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1037\/0033-2909.100.3.349","article-title":"On looking into the black box: prospects and limits in the search for mental models","volume":"100","author":"Rouse","year":"1986","journal-title":"Psychol. Bull."},{"key":"B31","doi-asserted-by":"publisher","first-page":"107809","DOI":"10.1016\/j.chb.2023.107809","article-title":"Validating metrics for reward alignment in human-autonomy teaming","volume":"146","author":"Sanneman","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"B32","volume-title":"A practical guide to the System usability Scale: Background, benchmarks and best practices","author":"Sauro","year":"2011"},{"key":"B33","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1177\/1555343416682891","article-title":"A framework for developing and using shared mental models in human-agent teams","volume":"11","author":"Scheutz","year":"2017","journal-title":"J. Cognitive Eng. Decis. Mak."},{"key":"B34","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780192845290.001.0001","volume-title":"Human-Centered AI","author":"Shneiderman","year":"2022"},{"key":"B35","doi-asserted-by":"crossref","first-page":"5479","DOI":"10.1109\/ACC.2016.7526529","article-title":"Structured synthesis and compression of semantic human sensor models for Bayesian estimation","volume-title":"2016 American Control conference (ACC)","author":"Sweet","year":"2016"},{"key":"B36","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1007\/s43154-020-00019-0","article-title":"A survey of mental modeling techniques in human\u2013robot teaming","volume":"1","author":"Tabrez","year":"2020","journal-title":"Curr. Robot. Rep."},{"key":"B37","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA48891.2023.10160593","article-title":"Active inference for autonomous decision-making with contextual multi-armed bandits","volume-title":"IEEE international conference on robotics and automation (ICRA 2023)","author":"Wakayama","year":"2023"},{"key":"B38","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1177\/21695067231193673","article-title":"Level of detail in visualization for human autonomy teaming: speed, accuracy, and workload effects","volume":"67","author":"Wang","year":"2023","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1751002\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T06:33:56Z","timestamp":1774506836000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1751002\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,26]]},"references-count":39,"alternative-id":["10.3389\/frobt.2026.1751002"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2026.1751002","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,26]]},"article-number":"1751002"}}