{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T07:26:39Z","timestamp":1774596399332,"version":"3.50.1"},"reference-count":58,"publisher":"SAGE Publications","issue":"8","license":[{"start":{"date-parts":[[2021,9,23]],"date-time":"2021-09-23T00:00:00Z","timestamp":1632355200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"NSF CAREER award"},{"name":"DARPA Young Faculty Award"},{"name":"NSF CNS"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p> Awareness of team behaviors (e.g., individual activities and team intents) plays a critical role in human\u2013robot teaming. Autonomous robots need to be aware of the overall intent of the team they are collaborating with in order to effectively aid their human peers or augment the team\u2019s capabilities. Team intents encode the goal of the team, which cannot be simply identified from a collection of individual activities. Instead, teammate relationships must also be encoded for team intent recognition. In this article, we introduce a novel representation learning approach to recognizing team intent awareness in real-time, based upon both individual human activities and the relationship between human peers in the team. Our approach formulates the task of robot learning for team intent recognition as a joint regularized optimization problem, which encodes individual activities as latent variables and represents teammate relationships through graph embedding. In addition, we design a new algorithm to efficiently solve the formulated regularized optimization problem, which possesses a theoretical guarantee to converge to the optimal solution. To evaluate our approach\u2019s performance on team intent recognition, we test our approach on a public benchmark group activity dataset and a multisensory underground search and rescue team behavior dataset newly collected from robots in an underground environment, as well as perform a proof-of-concept case study on a physical robot. The experimental results have demonstrated both the superior accuracy of our proposed approach and its suitability for real-time applications on mobile robots. <\/jats:p>","DOI":"10.1177\/02783649211043155","type":"journal-article","created":{"date-parts":[[2021,9,23]],"date-time":"2021-09-23T12:24:00Z","timestamp":1632399840000},"page":"798-811","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":9,"title":["Real-time recognition of team behaviors by multisensory graph-embedded robot learning"],"prefix":"10.1177","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5559-422X","authenticated-orcid":false,"given":"Brian","family":"Reily","sequence":"first","affiliation":[{"name":"Human-Centered Robotics Lab, Colorado School of Mines, Golden, CO, USA"}]},{"given":"Peng","family":"Gao","sequence":"additional","affiliation":[{"name":"Human-Centered Robotics Lab, Colorado School of Mines, Golden, CO, USA"}]},{"given":"Fei","family":"Han","sequence":"additional","affiliation":[{"name":"Human-Centered Robotics Lab, Colorado School of Mines, Golden, CO, USA"}]},{"given":"Hua","family":"Wang","sequence":"additional","affiliation":[{"name":"Human-Centered Robotics Lab, Colorado School of Mines, Golden, CO, USA"}]},{"given":"Hao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Human-Centered Robotics Lab, Colorado School of Mines, Golden, CO, USA"}]}],"member":"179","published-online":{"date-parts":[[2021,9,23]]},"reference":[{"key":"bibr1-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1145\/3029798.3038430"},{"key":"bibr2-02783649211043155","first-page":"961","author":"Alahi A","year":"2016","journal-title":"CVPR"},{"key":"bibr3-02783649211043155","first-page":"52","author":"Albrecht SV","year":"2015","journal-title":"UAI"},{"key":"bibr4-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.01.002"},{"key":"bibr5-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10599-4_37"},{"key":"bibr6-02783649211043155","first-page":"3425","author":"Bagautdinov TM","year":"2017","journal-title":"CVPR"},{"key":"bibr7-02783649211043155","first-page":"255","author":"Bard N","year":"2013","journal-title":"International Conference on Autonomous Agents and Multi-Agent Systems"},{"key":"bibr8-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v27i1.8659"},{"key":"bibr9-02783649211043155","volume-title":"Constrained Optimization and Lagrange Multiplier Methods","author":"Bertsekas DP","year":"1996"},{"key":"bibr10-02783649211043155","author":"Biswas S","year":"2018","journal-title":"arXiv preprint arXiv:1802.02091"},{"key":"bibr11-02783649211043155","first-page":"379","author":"Borck H","year":"2015","journal-title":"FLAIRS Conference"},{"key":"bibr12-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.220"},{"key":"bibr13-02783649211043155","first-page":"1282","volume-title":"ICCV Workshops","author":"Choi W","year":"2009"},{"key":"bibr14-02783649211043155","first-page":"3273","author":"Choi W","year":"2011","journal-title":"CVPR"},{"key":"bibr15-02783649211043155","first-page":"4772","author":"Deng Z","year":"2016","journal-title":"CVPR"},{"key":"bibr16-02783649211043155","author":"Deng Z","year":"2015","journal-title":"arXiv preprint arXiv:1506.04191"},{"key":"bibr17-02783649211043155","first-page":"2625","author":"Donahue J","year":"2015","journal-title":"CVPR"},{"key":"bibr18-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2017.05.021"},{"key":"bibr19-02783649211043155","unstructured":"Fong T (2017) Human-robot teaming: Communication, coordination, and collaboration. Report ARC-E-DAA-TA41527, NASA. Available at: https:\/\/ntrs.nasa.gov\/citations\/20170010160 (accessed 22 August 2021)."},{"key":"bibr20-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1177\/0278364916688255"},{"key":"bibr21-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2017.01.011"},{"key":"bibr22-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2662061"},{"key":"bibr23-02783649211043155","author":"Han F","year":"2017","journal-title":"ICRA"},{"key":"bibr24-02783649211043155","author":"Han F","year":"2018","journal-title":"ICRA"},{"key":"bibr25-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1145\/3173386.3176983"},{"key":"bibr26-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1145\/2701973.2702026"},{"key":"bibr27-02783649211043155","first-page":"1971","author":"Ibrahim MS","year":"2016","journal-title":"CVPR"},{"key":"bibr28-02783649211043155","author":"Ibrahim MS","year":"2016","journal-title":"arXiv preprint arXiv:1607.02643"},{"key":"bibr29-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40686-7_8"},{"key":"bibr30-02783649211043155","first-page":"1354","author":"Lan T","year":"2012","journal-title":"CVPR"},{"key":"bibr31-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.228"},{"key":"bibr32-02783649211043155","doi-asserted-by":"publisher","DOI":"10.3233\/AIC-2009-0442"},{"key":"bibr33-02783649211043155","author":"Li W","year":"2018","journal-title":"arXiv preprint arXiv:1807.01253"},{"key":"bibr34-02783649211043155","first-page":"532","author":"Li X","year":"2014","journal-title":"International Conference on Machine Learning"},{"key":"bibr35-02783649211043155","first-page":"649","author":"Ma LM","year":"2018","journal-title":"Field and Service Robotics"},{"key":"bibr36-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2011.6130272"},{"key":"bibr37-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2015.2491611"},{"key":"bibr38-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1177\/0278364915609673"},{"key":"bibr39-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1145\/3173386.3177000"},{"key":"bibr40-02783649211043155","doi-asserted-by":"publisher","DOI":"10.3390\/s16010115"},{"key":"bibr41-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-016-9359-z"},{"key":"bibr42-02783649211043155","first-page":"101","author":"Qi M","year":"2018","journal-title":"ECCV"},{"key":"bibr43-02783649211043155","first-page":"3043","author":"Ramanathan V","year":"2016","journal-title":"CVPR"},{"key":"bibr44-02783649211043155","first-page":"2475","author":"Ramanathan V","year":"2013","journal-title":"CVPR"},{"key":"bibr45-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/SSRR.2018.8468622"},{"key":"bibr46-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-017-9692-3"},{"key":"bibr47-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.04.032"},{"key":"bibr48-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459361"},{"key":"bibr49-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2017.02.002"},{"key":"bibr50-02783649211043155","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2018.00036"},{"key":"bibr51-02783649211043155","volume":"2","author":"Shu T","year":"2017","journal-title":"CVPR"},{"key":"bibr52-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"bibr53-02783649211043155","author":"Simonyan K","year":"2014","journal-title":"arXiv preprint arXiv:1409.1556"},{"key":"bibr54-02783649211043155","author":"Stone P","year":"2010","journal-title":"AAAI"},{"key":"bibr55-02783649211043155","author":"Wang H","year":"2013","journal-title":"International Conference on Machine Learning"},{"key":"bibr56-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.198"},{"key":"bibr57-02783649211043155","first-page":"50","volume-title":"Asian Conference on Computer Vision","author":"Yu G","year":"2014"},{"key":"bibr58-02783649211043155","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7353878"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649211043155","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649211043155","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649211043155","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T20:05:25Z","timestamp":1740859525000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649211043155"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,23]]},"references-count":58,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1177\/02783649211043155"],"URL":"https:\/\/doi.org\/10.1177\/02783649211043155","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,23]]}}}