{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:33:42Z","timestamp":1778168022419,"version":"3.51.4"},"reference-count":25,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T00:00:00Z","timestamp":1573776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Office of Naval Research under the Science of Autonomy program"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>Unmanned Aerial Vehicles (UAVs), also known as drones, have extensive applications in civilian rescue and military surveillance realms. A common drone control scheme among such applications is human supervisory control, in which human operators remotely navigate drones and direct them to conduct high-level tasks. However, different levels of autonomy in the control system and different operator training processes may affect operators\u2019 performance in task success rate and efficiency. An experiment was designed and conducted to investigate such potential impacts. The results showed us that a dedicated supervisory drone control interface tended toward increased operator successful task completion as compared to an enhanced teleoperation control interface, although this difference was not statistically significant. In addition, using Hidden Markov Models, operator behavior models were developed to further study the impact of operators\u2019 drone control strategies as a function of differing levels of autonomy. These models revealed that people with both supervisory and enhanced teleoperation control training were not able to determine the right control action at the right time to the same degree that people with just training in the supervisory control mode. Future work is needed to determine how trust plays a role in such settings.<\/jats:p>","DOI":"10.1145\/3344276","type":"journal-article","created":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T21:16:57Z","timestamp":1573852617000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["The Impact of Different Levels of Autonomy and Training on Operators\u2019 Drone Control Strategies"],"prefix":"10.1145","volume":"8","author":[{"given":"Jin","family":"Zhou","sequence":"first","affiliation":[{"name":"Duke University, NC, USA"}]},{"given":"Haibei","family":"Zhu","sequence":"additional","affiliation":[{"name":"Duke University, NC, USA"}]},{"given":"Minwoo","family":"Kim","sequence":"additional","affiliation":[{"name":"Duke University, NC, USA"}]},{"given":"Mary L.","family":"Cummings","sequence":"additional","affiliation":[{"name":"Duke University, NC, USA"}]}],"member":"320","published-online":{"date-parts":[[2019,11,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177699147"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2011.04.008"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.2514\/1.46767"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45732-1_4"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1260\/1756-8293.4.3.165"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12517-017-2989-x"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the Students Conference on Engineering and Systems. IEEE","author":"Gupta A.","year":"2012","unstructured":"A. Gupta and B. Dhingra . 2012. Stock market prediction using hidden Markov models . In Proceedings of the Students Conference on Engineering and Systems. IEEE , Allahabad, Uttar Pradesh, India, 1--4. DOI:https:\/\/doi.org\/10.1109\/SCES. 2012 .6199099 10.1109\/SCES.2012.6199099 A. Gupta and B. Dhingra. 2012. Stock market prediction using hidden Markov models. In Proceedings of the Students Conference on Engineering and Systems. IEEE, Allahabad, Uttar Pradesh, India, 1--4. DOI:https:\/\/doi.org\/10.1109\/SCES.2012.6199099"},{"key":"e_1_2_1_9_1","volume-title":"The Impact of Skill-based Training Across Different Levels of Autonomy for Drone Inspection Tasks. Master\u2019s thesis","author":"Kim Minwoo","unstructured":"Minwoo Kim . 2018. The Impact of Skill-based Training Across Different Levels of Autonomy for Drone Inspection Tasks. Master\u2019s thesis . Duke University , Durham, NC . Minwoo Kim. 2018. The Impact of Skill-based Training Across Different Levels of Autonomy for Drone Inspection Tasks. Master\u2019s thesis. Duke University, Durham, NC."},{"key":"e_1_2_1_10_1","volume-title":"CHI \u201914 Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201914)","author":"Kos\u2019myna Nataliya","unstructured":"Nataliya Kos\u2019myna , Franck Tarpin-Bernard , and Bertrand Rivet . 2014. Bidirectional feedback in motor imagery BCIs: Learn to control a drone within 5 minutes . In CHI \u201914 Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201914) . ACM , New York, NY . DOI:https:\/\/doi.org\/10.1145\/2559206.2574820 10.1145\/2559206.2574820 Nataliya Kos\u2019myna, Franck Tarpin-Bernard, and Bertrand Rivet. 2014. Bidirectional feedback in motor imagery BCIs: Learn to control a drone within 5 minutes. In CHI \u201914 Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201914). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/2559206.2574820"},{"key":"e_1_2_1_11_1","volume-title":"An Introduction to Animal Movement Modeling with Hidden Markov Models using Stan for Bayesian Inference. arXiv","author":"Barajas Vianey Leos","year":"1806","unstructured":"Vianey Leos Barajas and Theo Michelot . 2018. An Introduction to Animal Movement Modeling with Hidden Markov Models using Stan for Bayesian Inference. arXiv : 1806 .10639. Vianey Leos Barajas and Theo Michelot. 2018. An Introduction to Animal Movement Modeling with Hidden Markov Models using Stan for Bayesian Inference. arXiv: 1806.10639."},{"key":"e_1_2_1_12_1","volume-title":"Vincenzi","author":"Liu Dahai","year":"2008","unstructured":"Dahai Liu , Elizabeth L. Blickensderfer , Nikolas D. Macchiarella , and Dennis A . Vincenzi . 2008 . Transfer of training. In Human Factors in Simulation and Training, Peter A. Hancock, Dennis A. Vincenzi, John A. Wise, and Mustapha Mouloua (Eds.). CRC Press , Boca Raton, FL, 49--60. Dahai Liu, Elizabeth L. Blickensderfer, Nikolas D. Macchiarella, and Dennis A. Vincenzi. 2008. Transfer of training. In Human Factors in Simulation and Training, Peter A. Hancock, Dennis A. Vincenzi, John A. Wise, and Mustapha Mouloua (Eds.). CRC Press, Boca Raton, FL, 49--60."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14358\/PERS.81.4.281"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/3468.844354"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976699300016890"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1155\/2012\/768180"},{"key":"e_1_2_1_17_1","volume-title":"Proc. Hum. Factors Ergonom. Soc. Ann. Meet. 56","author":"Prinet Julie C.","year":"2016","unstructured":"Julie C. Prinet , Andrew Terhune , and Nadine B. Sarter . 2016. Supporting dynamic re-planning in multiple Uav control: A comparison of three levels of automation . Proc. Hum. Factors Ergonom. Soc. Ann. Meet. 56 , 1 ( Dec. 2016 ), 423--427. DOI:https:\/\/doi.org\/10.1177\/1071181312561095 10.1177\/1071181312561095 Julie C. Prinet, Andrew Terhune, and Nadine B. Sarter. 2016. Supporting dynamic re-planning in multiple Uav control: A comparison of three levels of automation. Proc. Hum. Factors Ergonom. Soc. Ann. Meet. 56, 1 (Dec. 2016), 423--427. DOI:https:\/\/doi.org\/10.1177\/1071181312561095"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/108235.108253"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASSP.1986.1165342"},{"key":"e_1_2_1_20_1","unstructured":"Narayanan Ramanathan. 2006. Applications of Hidden Markov Models. Retrieved from http:\/\/www.cs.umd.edu\/djacobs\/CMSC828\/ApplicationsHMMs.pdf.  Narayanan Ramanathan. 2006. Applications of Hidden Markov Models. Retrieved from http:\/\/www.cs.umd.edu\/djacobs\/CMSC828\/ApplicationsHMMs.pdf."},{"key":"e_1_2_1_21_1","unstructured":"R. Schaufele L. Ding Nick Miller H. Barlett Michael Lukacs and D. Bhadra. 2017. FAA aerospace forecast: Fiscal years 2017--2037. Technical Report. Federal Aviation Administration Washington DC.  R. Schaufele L. Ding Nick Miller H. Barlett Michael Lukacs and D. Bhadra. 2017. FAA aerospace forecast: Fiscal years 2017--2037. Technical Report. Federal Aviation Administration Washington DC."},{"key":"e_1_2_1_22_1","unstructured":"Thomas B. Sheridan. 1992. Telerobotics Automation and Human Supervisory Control. MIT Press Cambridge MA.  Thomas B. Sheridan. 1992. Telerobotics Automation and Human Supervisory Control. MIT Press Cambridge MA."},{"key":"#cr-split#-e_1_2_1_24_1.1","doi-asserted-by":"crossref","unstructured":"J. Zhang J. Jung G. Sohn and M. Cohen. 2015. Thermal infrared inspection of roof insulation using unmanned aerial vehicles. Int. Arch. Photogram. Remote Sens. Spatial Info. Sci. XL-1\/W4 (2015) 381--386. DOI:https:\/\/doi.org\/10.5194\/isprsarchives-XL-1-W4-381-2015 10.5194\/isprsarchives-XL-1-W4-381-2015","DOI":"10.5194\/isprsarchives-XL-1-W4-381-2015"},{"key":"#cr-split#-e_1_2_1_24_1.2","doi-asserted-by":"crossref","unstructured":"J. Zhang J. Jung G. Sohn and M. Cohen. 2015. Thermal infrared inspection of roof insulation using unmanned aerial vehicles. Int. Arch. Photogram. Remote Sens. Spatial Info. Sci. XL-1\/W4 (2015) 381--386. DOI:https:\/\/doi.org\/10.5194\/isprsarchives-XL-1-W4-381-2015","DOI":"10.5194\/isprsarchives-XL-1-W4-381-2015"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi6010014"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2888578"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3344276","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3344276","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:24Z","timestamp":1750203864000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3344276"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,15]]},"references-count":25,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3344276"],"URL":"https:\/\/doi.org\/10.1145\/3344276","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,15]]},"assertion":[{"value":"2018-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}