{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T14:35:31Z","timestamp":1764858931697,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T00:00:00Z","timestamp":1489449600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The Robot Operating System (ROS) provides roboticists with a standardized and distributed framework for real-time communication between robotic systems using a microkernel environment. This paper looks at how ROS metadata, Unified Robot Description Format (URDF), Semantic Robot Description Format (SRDF), and its message description language, can be used to identify key robot characteristics to inform User Interface (UI) design for the teleoperation of heterogeneous robot teams. Logical relationships between UI components and robot characteristics are defined by a set of relationship rules created using relevant and available information including developer expertise and ROS metadata. This provides a significant opportunity to move towards a rule-driven approach for generating the designs of teleoperation UIs; in particular the reduction of the number of different UI configurations required to teleoperate each individual robot within a heterogeneous robot team. This approach is based on using an underlying rule set identifying robots that can be teleoperated using the same UI configuration due to having the same or similar robot characteristics. Aside from reducing the number of different UI configurations an operator needs to be familiar with, this approach also supports consistency in UI configurations when a teleoperator is periodically switching between different robots. To achieve this aim, a Matlab toolbox is developed providing users with the ability to define rules specifying the relationship between robot characteristics and UI components. Once rules are defined, selections that best describe the characteristics of the robot type within a particular heterogeneous robot team can be made. A main advantage of this approach is that rather than specifying discrete robots comprising the team, the user can specify characteristics of the team more generally allowing the system to deal with slight variations that may occur in the future. In fact, by using the defined relationship rules and characteristic selections, the toolbox can automatically identify a reduced set of UI configurations required to control possible robot team configurations, as opposed to the traditional ad-hoc approach to teleoperation UI design. In the results section, three test cases are presented to demonstrate how the selection of different robot characteristics builds a number of robot characteristic combinations, and how the relationship rules are used to determine a reduced set of required UI configurations needed to control each individual robot in the robot team.<\/jats:p>","DOI":"10.3390\/s17030587","type":"journal-article","created":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T11:53:52Z","timestamp":1489492432000},"page":"587","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Building a Relationship between Robot Characteristics and Teleoperation User Interfaces"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7934-0395","authenticated-orcid":false,"given":"Michael","family":"Mortimer","sequence":"first","affiliation":[{"name":"School of Engineering, Deakin University, Pigdons Rd, Waurn Ponds, Victoria 3216, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6723-259X","authenticated-orcid":false,"given":"Ben","family":"Horan","sequence":"additional","affiliation":[{"name":"School of Engineering, Deakin University, Pigdons Rd, Waurn Ponds, Victoria 3216, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mehdi","family":"Seyedmahmoudian","sequence":"additional","affiliation":[{"name":"School of Engineering, Deakin University, Pigdons Rd, Waurn Ponds, Victoria 3216, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,3,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1002\/rob.21439","article-title":"Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots","volume":"30","author":"Nagatani","year":"2013","journal-title":"J. Field Robot."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"G\u00f3mez-de-Gabriel, J., and Harwin, W. (2015). Evaluation of Sensor Configurations for Robotic Surgical Instruments. Sensors, 15.","DOI":"10.3390\/s151027341"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/MRA.2011.2181683","article-title":"Robots for environmental monitoring: Significant advancements and applications","volume":"19","author":"Dunbabin","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1177\/0278364909359210","article-title":"Path planning for autonomous vehicles in unknown semi-structured environments","volume":"29","author":"Dolgov","year":"2010","journal-title":"Int. J. Robot. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1002\/rob.20403","article-title":"Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots","volume":"28","author":"Barrientos","year":"2011","journal-title":"J. Field Robot."},{"key":"ref_6","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 12\u201317). ROS: An Open-Source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/MRA.2010.938502","article-title":"ROS on the PR2 [ROS Topics]","volume":"17","author":"Cousins","year":"2010","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Agravante, D.J., Pages, J., and Chaumette, F. (2013, January 6\u201310). Visual servoing for the REEM humanoid robot\u2019s upper body. Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631328"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Arumugam, R., Enti, V.R., Liu, B., Wu, X., Baskaran, K., Kong, F.F., Kumar, A.S., Meng, K.D., and Kit, G.W. (2010, January 3\u20137). DAvinCi: A cloud computing framework for service robots. Proceedings of the 2010 IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509469"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/MRA.2010.940147","article-title":"Exponential Growth of ROS [ROS Topics]","volume":"18","author":"Cousins","year":"2011","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Badger, J.M., Hart, S.W., and Yamokoski, J. (2012, January 19\u201321). Towards autonomous operation of robonaut 2. Proceedings of the NASA, AIAA Infotech@ Aerospace 2012, Garden Grove, CA, USA.","DOI":"10.2514\/6.2012-2441"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MRA.2011.2181749","article-title":"MoveIt! [ROS TOPICS]","volume":"19","author":"Chitta","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MRA.2012.2221235","article-title":"Robot Web Tools [ROS Topics]","volume":"19","author":"Alexander","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_14","unstructured":"Crick, C., Jay, G., Osentoski, S., Pitzer, B., and Jenkins, O.C. (2011, January 9\u201312). Rosbridge: Ros for non-ros users. Proceedings of the 15th International Symposium on Robotics Research (ISRR), Flagstaff, AZ, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s10514-012-9321-0","article-title":"OctoMap: An efficient probabilistic 3D mapping framework based on octrees","volume":"34","author":"Hornung","year":"2013","journal-title":"Auton. Robot."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Santos, J.M., Portugal, D., and Rocha, R.P. (2013, January 21\u201326). An evaluation of 2D SLAM techniques available in robot operating system. Proceedings of the 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), Link\u00f6ping, Sweden.","DOI":"10.1109\/SSRR.2013.6719348"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1109\/TSMCC.2007.905819","article-title":"Human Performance Issues and User Interface Design for Teleoperated Robots","volume":"37","author":"Chen","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s10846-013-9822-x","article-title":"Robotic Urban Search and Rescue: A Survey from the Control Perspective","volume":"72","author":"Liu","year":"2013","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Velagapudi, P., Scerri, P., Sycara, K., Wang, H., Lewis, M., and Wang, J. (2008, January 22\u201326). Scaling effects in multi-robot control. Proceedings of the 2008 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Nice, France.","DOI":"10.1109\/IROS.2008.4651073"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hunziker, D., Gajamohan, M., Waibel, M., and D\u2019Andrea, R. (2013, January 6\u201310). Rapyuta: The roboearth cloud engine. Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630612"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lazewatsky, D.A., and Smart, W.D. (2011, January 9\u201313). An inexpensive robot platform for teleoperation and experimentation. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980230"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MRA.2011.943230","article-title":"Interactive Markers: 3-D User Interfaces for ROS Applications [ROS Topics]","volume":"18","author":"Gossow","year":"2011","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_23","unstructured":"Kruijff, G.-J.M., Jan\u00ed\u010dek, M., Keshavdas, S., Larochelle, B., Zender, H., Smets, N.J., Mioch, T., Neerincx, M.A., Diggelen, J., and Colas, F. (2014). Field and Service Robotics, Springer."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1109\/MRA.2011.941632","article-title":"A world wide web for robots","volume":"18","author":"Waibel","year":"2011","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kunze, L., Roehm, T., and Beetz, M. (2011, January 9\u201313). Towards semantic robot description languages. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980170"},{"key":"ref_26","unstructured":"Koenig, N., and Howard, A. (October, January 28). Design and use paradigms for gazebo, an open-source multi-robot simulator. Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), Sendai, Japan."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Boumghar, R., Lacroix, S., and Lefebvre, O. (2011, January 1\u20135). An information-driven navigation strategy for autonomous navigation in unknown environments. Proceedings of the 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics, Kyoto, Japan.","DOI":"10.1109\/SSRR.2011.6106782"},{"key":"ref_28","unstructured":"Fung, W., Lo, W., Liu, Y., and Xi, N. (2005, January 2\u20136). A case study of 3D stereoscopic vs. 2D monoscopic tele-reality in real-time dexterous teleoperation. Proceedings of the 2005 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mekonnen, A.A., Briand, C., Lerasle, F., and Herbulot, A. (2013, January 3\u20137). Fast HOG based person detection devoted to a mobile robot with a spherical camera. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696417"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Murphy, R.R., Srinivasan, V., Henkel, Z., Suarez, J., Minson, M., Straus, J.C., Hempstead, S., Valdez, T., and Egawa, S. (2013, January 12\u201314). Interacting with trapped victims using robots. Proceedings of the 2013 IEEE International Conference on Technologies for Homeland Security (HST), Waltham, MA, USA.","DOI":"10.1109\/THS.2013.6698972"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Horan, B., and Nahavandi, S. (2008, January 21\u201324). Intuitive Haptic Control Surface for Mobile Robot Motion Control. Proceedings of the 2008 IEEE International Workshop on Safety, Security and Rescue Robotics, Sendai, Japan.","DOI":"10.1109\/SSRR.2008.4745888"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Saska, M., Vonasek, V., Krajnik, T., and Preucil, L. (2012, January 7\u201312). Coordination and navigation of heterogeneous UAVs-UGVs teams localized by a hawk-eye approach. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura-Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385517"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Er, M.J., Yuan, S., and Wang, N. (2013, January 12\u201314). Development control and navigation of Octocopter. Proceedings of the 2013 10th IEEE International Conference on Control and Automation (ICCA), Hangzhou, China.","DOI":"10.1109\/ICCA.2013.6564974"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1724","DOI":"10.1109\/TMECH.2013.2274558","article-title":"Hardware and software architecture for nonlinear control of multirotor helicopters","volume":"18","author":"Omari","year":"2013","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kruijff, G.J.M., Tretyakov, V., Linder, T., Pirri, F., Gianni, M., Papadakis, P., Pizzoli, M., Sinha, A., Pianese, E., and Corrao, S. (2012, January 5\u20138). Rescue robots at earthquake-hit Mirandola, Italy: A field report. Proceedings of the 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), College Station, TX, USA.","DOI":"10.1109\/SSRR.2012.6523866"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kruckel, K., Nolden, F., Ferrein, A., and Scholl, I. (2015, January 26\u201330). Intuitive visual teleoperation for UGVs using free-look augmented reality displays. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139809"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kamali, K., Joubair, A., Bonev, I.A., and Bigras, P. (2016, January 16\u201321). Elasto-geometrical calibration of an industrial robot under multidirectional external loads using a laser tracker. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487630"},{"key":"ref_38","first-page":"1","article-title":"Interactive Teleoperation of a Mobile Manipulator Using a Shared-Control Approach","volume":"PP","author":"Song","year":"2016","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_39","first-page":"433","article-title":"General Dynamic Model for Skid-Steer Mobile Manipulators with Wheel-Ground Interactions","volume":"PP","author":"Cheein","year":"2016","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mortimer, M., Horan, B., Joordens, M., and Stojcevski, A. (2015, January 17\u201320). Searching Baxter\u2019s URDF robot joint and link tree for active serial chains. Proceedings of the 2015 10th System of Systems Engineering Conference (SoSE), San Antonio, TX, USA.","DOI":"10.1109\/SYSOSE.2015.7151971"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.3390\/s130201385","article-title":"Complete Low-Cost Implementation of a Teleoperated Control System for a Humanoid Robot","volume":"13","author":"Cela","year":"2013","journal-title":"Sensors"},{"key":"ref_42","unstructured":"Sian, N.E., Yokoi, K., Kajita, S., Kanehiro, F., and Tanie, K. (October, January 30). Whole body teleoperation of a humanoid robot-development of a simple master device using joysticks. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Lausanne, Switzerland."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1109\/TMECH.2008.2005197","article-title":"The Use of Aerial Images and GPS for Mobile Robot Waypoint Navigation","volume":"13","author":"Shair","year":"2008","journal-title":"IEEE\/ASME Trans. Mechatron."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/3\/587\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:30:25Z","timestamp":1760207425000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/3\/587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,14]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,3]]}},"alternative-id":["s17030587"],"URL":"https:\/\/doi.org\/10.3390\/s17030587","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,3,14]]}}}