{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:42:00Z","timestamp":1760240520887,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,7,9]],"date-time":"2019-07-09T00:00:00Z","timestamp":1562630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>One of the active challenges in multi-robot missions is related to managing operator workload and situational awareness. Currently, the operators are trained to use interfaces, but in the near future this can be turned inside out: the interfaces will adapt to operators so as to facilitate their tasks. To this end, the interfaces should manage models of operators and adapt the information to their states and preferences. This work proposes a videogame-based approach to classify operator behavior and predict their actions in order to improve teleoperated multi-robot missions. First, groups of operators are generated according to their strategies by means of clustering algorithms. Second, the operators\u2019 strategies are predicted, taking into account their models. Multiple information sources and modeling methods are used to determine the approach that maximizes the mission goal. The results demonstrate that predictions based on previous data from single operators increase the probability of success in teleoperated multi-robot missions by 19%, whereas predictions based on operator clusters increase this probability of success by 28%.<\/jats:p>","DOI":"10.3390\/robotics8030053","type":"journal-article","created":{"date-parts":[[2019,7,10]],"date-time":"2019-07-10T03:05:26Z","timestamp":1562727926000},"page":"53","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Press Start to Play: Classifying Multi-Robot Operators and Predicting Their Strategies through a Videogame"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8863-4419","authenticated-orcid":false,"given":"Juan Jes\u00fas","family":"Rold\u00e1n","sequence":"first","affiliation":[{"name":"Centre for Automation and Robotics (UPM-CSIC), Technical University of Madrid, Jos\u00e9 Guti\u00e9rrez Abascal, 2, 28006 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"V\u00edctor","family":"D\u00edaz-Maroto","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (UPM-CSIC), Technical University of Madrid, Jos\u00e9 Guti\u00e9rrez Abascal, 2, 28006 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Javier","family":"Real","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (UPM-CSIC), Technical University of Madrid, Jos\u00e9 Guti\u00e9rrez Abascal, 2, 28006 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5944-0938","authenticated-orcid":false,"given":"Pablo R.","family":"Palafox","sequence":"additional","affiliation":[{"name":"Computer Vision &amp; Artificial Intelligence Group, Technical University of Munich, Boltzmannstrasse 3, 85748 Garching, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6241-4124","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Valente","sequence":"additional","affiliation":[{"name":"Information Technology Group, Wageningen University &amp; Research, 6708 PB Wageningen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6672-4827","authenticated-orcid":false,"given":"Mario","family":"Garz\u00f3n","sequence":"additional","affiliation":[{"name":"Inria, Universit\u00e9 Grenoble Alpes, Grenoble INP, 38000 Grenoble, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1691-3907","authenticated-orcid":false,"given":"Antonio","family":"Barrientos","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (UPM-CSIC), Technical University of Madrid, Jos\u00e9 Guti\u00e9rrez Abascal, 2, 28006 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,9]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Wong, C.Y., and Seet, G. (2017). Workload, awareness and automation in multiple-robot supervision. Int. J. Adv. Robot. Syst., 14.","key":"ref_1","DOI":"10.1177\/1729881417710463"},{"doi-asserted-by":"crossref","unstructured":"Lysaght, R.J., Hill, S.G., Dick, A.O., Plamondon, B.D., and Linton, P.M. (1989). Operator Workload: Comprehensive Review and Evaluation of Operator Workload Methodologies (No. TR-2075-3), Analytics Inc.","key":"ref_2","DOI":"10.21236\/ADA212879"},{"unstructured":"Moray, N. (2013). Mental Workload: Its Theory and Measurement, Springer Science & Business Media.","key":"ref_3"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research","volume":"52","author":"Hart","year":"1988","journal-title":"Adv. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1177\/154193128803200221","article-title":"Design and evaluation for situation awareness enhancement","volume":"Volume 32","author":"Endsley","year":"1988","journal-title":"Proceedings of the Human Factors Society Annual Meeting"},{"doi-asserted-by":"crossref","unstructured":"Rold\u00e1n, J.J., Pe\u00f1a-Tapia, E., Mart\u00edn-Barrio, A., Olivares-M\u00e9ndez, M.A., Del Cerro, J., and Barrientos, A. (2017). Multi-robot interfaces and operator situational awareness: Study of the impact of immersion and prediction. Sensors, 17.","key":"ref_6","DOI":"10.3390\/s17081720"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1109\/TSMCC.2010.2052041","article-title":"Optimizing operator\u2013agent interaction in intelligent adaptive interface design: A conceptual framework","volume":"41","author":"Hou","year":"2011","journal-title":"IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.)"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1007\/s10514-017-9686-1","article-title":"Analyzing and improving multi-robot missions by using process mining","volume":"42","author":"Barrientos","year":"2018","journal-title":"Auton. Robots"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1002\/rob.21568","article-title":"Analysis of human-robot interaction at the darpa robotics challenge trials","volume":"32","author":"Yanco","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/978-3-540-72696-8_2","article-title":"Predicting operator capacity for supervisory control of multiple UAVs","volume":"Volume 1","author":"Cummings","year":"2007","journal-title":"Innovations in Intelligent Machines"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.apergo.2016.05.011","article-title":"A meta-analysis of human-system interfaces in unmanned aerial vehicle (UAV) swarm management","volume":"58","author":"Hocraffer","year":"2017","journal-title":"Appl. Ergon."},{"doi-asserted-by":"crossref","unstructured":"Rold\u00e1n, J.J., Pe\u00f1a-Tapia, E., Garcia-Aunon, P., del Cerro, J., and Barrientos, A. (2019). Bringing adaptive & immersive interfaces to real-world multi-robot scenarios: Application to surveillance and intervention in infrastructures. IEEE Access.","key":"ref_12","DOI":"10.1109\/ACCESS.2019.2924938"},{"doi-asserted-by":"crossref","unstructured":"Loh, C.S., Sheng, Y., and Ifenthaler, D. (2015). Serious Games Analytics: Methodologies for Performance Measurement, Assessment, and Improvement, Springer International Publishing.","key":"ref_13","DOI":"10.1007\/978-3-319-05834-4"},{"unstructured":"Van Ruijven, T.W.J. (2011, January 8\u201311). Serious games as experiments for emergency management research: A review. Proceedings of the 8th International Conference on Information Systems for Crisis Response and Management (ISCRAM 2011), Lisbon, Portugal.","key":"ref_14"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1089\/cpb.2004.7.511","article-title":"Online data collection from video game players: Methodological issues","volume":"7","author":"Wood","year":"2004","journal-title":"CyberPsychology Behav."},{"doi-asserted-by":"crossref","unstructured":"Rodriguez-Fernandez, V., Ramirez-Atencia, C., and Camacho, D. (2015, January 25\u201328). A multi-uav mission planning videogame-based framework for player analysis. Proceedings of the 2015 IEEE Congress on Evolutionary Computation (CEC), Sendai, Japan.","key":"ref_16","DOI":"10.1109\/CEC.2015.7257064"},{"doi-asserted-by":"crossref","unstructured":"Jer\u010di\u0107, P., Hagelb\u00e4ck, J., and Lindley, C. (2018). Physiological Affect and Performance in a Collaborative Serious Game Between Humans and an Autonomous Robot. International Conference on Entertainment Computing, Springer.","key":"ref_17","DOI":"10.1007\/978-3-319-99426-0_11"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3192","DOI":"10.1007\/s00464-018-6036-0","article-title":"Saving robots improves laparoscopic performance: Transfer of skills from a serious game to a virtual reality simulator","volume":"32","author":"IJgosse","year":"2018","journal-title":"Surg. Endosc."},{"doi-asserted-by":"crossref","unstructured":"Bailey, K.D. (1994). Typologies and Taxonomies: An Introduction to Classification Techniques, Sage.","key":"ref_19","DOI":"10.4135\/9781412986397"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"14863","DOI":"10.1073\/pnas.95.25.14863","article-title":"Cluster analysis and display of genome-wide expression patterns","volume":"95","author":"Eisen","year":"1988","journal-title":"Proc. Natl. Acad. Sci. USA"},{"unstructured":"Rupp, A.A., and Sweet, S.J. (2019, May 20). Analysis of Multivariate Social Science Data. Available online: https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/10705511.2011.607725?journalCode=hsem20.","key":"ref_21"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1164\/rccm.200711-1754OC","article-title":"Cluster analysis and clinical asthma phenotypes","volume":"178","author":"Haldar","year":"2008","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1016\/0031-3203(95)00120-4","article-title":"Partially supervised clustering for image segmentation","volume":"29","author":"Bensaid","year":"1996","journal-title":"Pattern Recognit."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/j.chb.2014.10.055","article-title":"Problematic involvement in online games: A cluster analytic approach","volume":"43","author":"Billieux","year":"2015","journal-title":"Comput. Hum. Behav."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1307","DOI":"10.3233\/JIFS-169129","article-title":"A study on performance metrics and clustering methods for analyzing behavior in UAV operations","volume":"32","author":"Camacho","year":"2017","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s13748-015-0072-y","article-title":"Automatic profile generation for uav operators using a simulation-based training environment","volume":"5","author":"Camacho","year":"2016","journal-title":"Prog. Artif. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.eswa.2016.10.044","article-title":"Analysing temporal performance profiles of UAV operators using time series clustering","volume":"70","author":"Camacho","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/TETC.2014.2330519","article-title":"A survey of clustering algorithms for big data: Taxonomy and empirical analysis","volume":"2","author":"Fahad","year":"2014","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_29","first-page":"100","article-title":"Algorithm AS 136: A k-means clustering algorithm","volume":"28","author":"Hartigan","year":"1979","journal-title":"J. R. Stat. Soc. Ser. C (Appl. Stat.)"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1109\/5.58325","article-title":"The self-organizing map","volume":"78","author":"Kohonen","year":"1990","journal-title":"Proc. IEEE"},{"doi-asserted-by":"crossref","unstructured":"Kaufman, L., and Rousseeuw, P.J. (1990). Partitioning around medoids (program pam). Finding Groups in Data: An Introduction to Cluster Analysis, John Wiley & Sons, Inc.","key":"ref_31","DOI":"10.1002\/9780470316801"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1037\/0033-2909.83.3.377","article-title":"Mixture model tests of cluster analysis: Accuracy of four agglomerative hierarchical methods","volume":"83","author":"Blashfield","year":"1976","journal-title":"Psychol. Bull."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/03610927408827101","article-title":"A dendrite method for cluster analysis","volume":"3","author":"Calinski","year":"1974","journal-title":"Commun. Stat.-Theory Methods"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","article-title":"A cluster separation measure","volume":"2","author":"Davies","year":"1979","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: A graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J. Comput. Appl. Math."},{"unstructured":"Bishop, C. (2007). Pattern Recognition and Machine Learning (Information Science and Statistics), Springer.","key":"ref_36"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1109\/TSMCB.2003.811794","article-title":"Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center","volume":"33","author":"Casper","year":"2003","journal-title":"IEEE Trans. Syst. Man Cybern. Part B (Cybern.)"},{"unstructured":"Pe\u00f1a, D. (2002). An\u00e1lisis de Datos Multivariante, McGraw-Hill.","key":"ref_38"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/3\/53\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:03:47Z","timestamp":1760187827000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/3\/53"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,9]]},"references-count":38,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["robotics8030053"],"URL":"https:\/\/doi.org\/10.3390\/robotics8030053","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2019,7,9]]}}}