{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T11:36:10Z","timestamp":1774611370809,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>With the evaluation of a next-generation human\u2013machine interface (HMI) concept for excavators, this study aims to discuss the HMI quality measurement based on usability and user experience (UUX) metrics. Regarding the digital transformation of construction sites, future work environments will have to be capable of presenting various complex visual data and enabling efficient and safe interactivity while working. The evaluated HMI focused on introducing a touch display-based interface, providing advanced operation functions and different interaction modalities. The assessment of UUX should show whether the novel HMI can be utilised to perform typical tasks (usability) and how it is accepted and assessed in terms of non-instrumental qualities (user experience, UX). Using the collected data, this article also aims to contribute to the general discussion about the role of UX beyond usability in industrial applications and deepen the understanding of non-instrumental qualities when it comes to user-oriented process and machine design. The exploratory study examines insights into the application of elaborated UUX measuring tools like the User Experience Questionnaire (UEQ) on the interaction with industrial goods accompanied by their rating with other tools, namely System Usability Scale (SUS), Intuitive Interaction Questionnaire (INTUI) and the National Aeronautics and Space Administration (NASA) Task Load Index (NASA-TLX). Four goals are pursued in this study. The first goal is to compare in-depth two different ways of interaction with the novel HMI\u2014namely one by a control pad on the right joystick and one by touch. Therefore, a sample of 17 subjects in total was split into two groups and differences in UUX measures were tested. Secondly, the performances of both groups were tested over the course of trials to investigate possible differences in detail. The third goal is to interpret measures of usability and user experience against existing benchmark values. Fourth and finally, we use the data gathered to analyse correlations between measures of UUX. The results of our study show that the different ways of interaction did not impact any of the measures taken. In terms of detailed performance analysis, both groups yielded differences in terms of time per action, but not between the groups. The comparison of UUX measures with benchmark values yielded mixed results. The UUX measures show some relevant significant correlations. The participants mostly reported enjoying the use of the HMI concept, but several practical issues (e.g., efficiency) still need to be overcome. Once again, the study confirms the urge of user inclusion in product development. Especially in the course of digitalisation, as big scale advancements of systems and user interfaces bring uncertainty for many manufacturers regarding whether or how a feature should be integrated.<\/jats:p>","DOI":"10.3390\/mti4030057","type":"journal-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T09:35:31Z","timestamp":1597916131000},"page":"57","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["UUX Evaluation of a Digitally Advanced Human\u2013Machine Interface for Excavators"],"prefix":"10.3390","volume":"4","author":[{"given":"Sebastian","family":"Lorenz","sequence":"first","affiliation":[{"name":"Industrial Design Engineering, Technische Universit\u00e4t Dresden, 01069 Dresden, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jens R.","family":"Helmert","sequence":"additional","affiliation":[{"name":"Engineering Psychology and Applied Cognitive Research, Technische Universit\u00e4t Dresden, 01069 Dresden, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruben","family":"Anders","sequence":"additional","affiliation":[{"name":"Independent Researcher, G\u00f6rlitzer Stra\u00dfe 42, 01099 Dresden, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"W\u00f6lfel","sequence":"additional","affiliation":[{"name":"Industrial Design Engineering, Technische Universit\u00e4t Dresden, 01069 Dresden, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jens","family":"Krzywinski","sequence":"additional","affiliation":[{"name":"Industrial Design Engineering, Technische Universit\u00e4t Dresden, 01069 Dresden, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chacko, V., Yu, H., Cang, S., and Vladareanu, L. (2014, January 10\u201312). State of the art in excavators. Proceedings of the 2014 International Conference on Advanced Mechatronic Systems, Kumamoto, Japan.","DOI":"10.1109\/ICAMechS.2014.6911593"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bauernhansl, T., ten Hompel, M., and Vogel-Heuser, B. (2014). Mensch-Maschine-Interaktion im Industrie 4.0-Zeitalter. Industrie 4.0 in Produktion, Automatisierung Und Logistik, Springer.","DOI":"10.1007\/978-3-658-04682-8"},{"key":"ref_3","unstructured":"Persson, D. (2018). Surveying in the Construction Industry-A study of Surveying and Machine Guidance Systems in Excavators on Ground Construction Projects. [Master\u2019s Thesis, Chalmers University of Technology]."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1080\/1463922X.2011.624647","article-title":"Challenges in evaluating skill transfer from construction equipment simulators","volume":"15","author":"Dunston","year":"2011","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wallmyr, M., Sitompul, T.A., Holstein, T., and Lindell, R. (2019). Evaluating Mixed Reality Notifications to Support Excavator Operator Awareness. IFIP Conference on Human-Computer Interaction, Springer Science and Business Media.","DOI":"10.1007\/978-3-030-29381-9_44"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/S0003-6870(96)00041-5","article-title":"A user-centred design approach for introducing computer-based process information systems","volume":"28","author":"Kontogiannis","year":"1997","journal-title":"Appl. Ergon."},{"key":"ref_7","unstructured":"H\u00e4rter, H. (2020, August 13). Touch-Display: Bedienelemente Auf Dem Display Blind Auffinden. Available online: https:\/\/www.elektronikpraxis.vogel.de\/touch-display-bedienelemente-auf-dem-display-blind-auffinden-a-807732\/."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Costes, A., Danieau, F., Argelaguet, F., Guillotel, P., and Lecuyer, A. (2020). Towards Haptic Images: A Survey on Touchscreen-Based Surface Haptics. IEEE Trans. Haptics, 1.","DOI":"10.1109\/TOH.2020.2984754"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Butz, A., and Kruger, A. (2017). Mensch-Maschine-Interaktion, Walter de Gruyter GmbH.","DOI":"10.1515\/9783110476378"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sakaida, Y., Chugo, D., Yamamoto, H., and Asama, H. (2008, January 20\u201322). The analysis of excavator operation by skillful operator-extraction of common skills. Proceedings of the 2008 SICE Annual Conference, Tokyo, Japan.","DOI":"10.1109\/SICE.2008.4654714"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1126\/science.1245842","article-title":"Designing Collective Behavior in a Termite-Inspired Robot Construction Team","volume":"343","author":"Werfel","year":"2014","journal-title":"Science"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.ergon.2013.12.002","article-title":"Evaluation of hydraulic excavator Human\u2013Machine Interface concepts using NASA TLX","volume":"44","author":"Akyeampong","year":"2014","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sitompul, T.A., and Wallmyr, M. (2019, January 14\u201316). Using Augmented Reality to Improve Productivity and Safety for Heavy Machinery Operators: State of the Art. Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry, Brisbane, Australia.","DOI":"10.1145\/3359997.3365689"},{"key":"#cr-split#-ref_14.1","unstructured":"DIN, E. (1998). Ergonomische Anforderungen f\u00fcr B\u00fcrot\u00e4tigkeiten mit Bildschirmger\u00e4ten-Teil 11: Anforderungen an die Gebrauchstauglichkeit"},{"key":"#cr-split#-ref_14.2","unstructured":"Leits\u00e4tze, Beuth. ISO 9241-11: 1998."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Richter, M., and Fl\u00fcckiger, M.D. (2013). Usability Engineering Kompakt: Benutzbare Produkte Gezielt Entwickeln, Springer.","DOI":"10.1007\/978-3-642-34832-7"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jordan, P.W., Thomas, B., and McClelland, I.L. (1996). Issues for Usability Evaluation in Industry: Seminar Discussions, Informa UK Limited.","DOI":"10.1201\/9781498710411"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.apergo.2017.05.013","article-title":"Digital, analogue, or redundant speedometers for truck driving: Impact on visual distraction, efficiency and usability","volume":"65","author":"Crave","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1207\/s15327051hci1904_2","article-title":"The Interplay of Beauty, Goodness, and Usability in Interactive Products","volume":"19","author":"Hassenzahl","year":"2004","journal-title":"Hum. Comput. Interact."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.intcom.2010.04.002","article-title":"Needs, affect, and interactive products\u2014Facets of user experience","volume":"22","author":"Hassenzahl","year":"2010","journal-title":"Interact. Comput."},{"key":"ref_20","unstructured":"Anderson, S.P. (2019, January 08). Creating Pleasurable Interfaces. Getting from Tasks to Experiences 2006. Available online: http:\/\/poetpainter.com\/thoughts\/file_download\/7."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1017\/S0269888913000258","article-title":"Knowing, reasoning and visualizing in industrial design","volume":"28","author":"Woelfel","year":"2013","journal-title":"Knowl. Eng. Rev."},{"key":"ref_22","unstructured":"Tripathi, S. (2011). Understanding Industrial User Experience. An Excerpt from 1st International Workshop on Industrial User Experience. 3rd International Conference on Human Computer Interaction 2011, ACM."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"140","DOI":"10.17011\/ht\/urn.201808103815","article-title":"Designing for Positive User Experience in Work Contexts: Experience Categories and their Applications","volume":"14","author":"Zeiner","year":"2018","journal-title":"Hum. Technol."},{"key":"ref_24","unstructured":"W\u00f6lfel, C., and Krzywinski, J. (2019). Human Needs as the Crux of the Matter in Product-Service Systems Development. Human Behaviour in Design: Proceedings of the 2nd SIG conference, Institut f\u00fcr Technische Produktentwicklung, Universit\u00e4t der Bundeswehr M\u00fcnchen."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"167","DOI":"10.7763\/IJCTE.2015.V7.950","article-title":"Utilitarian or Experiential? An Analysis of Usability Questionnaires","volume":"7","author":"Kun","year":"2015","journal-title":"Int. J. Comput. Theory Eng."},{"key":"ref_26","unstructured":"W\u00f6lfel, C., and Krzywinski, J. (2019). Ansatz und Modell der User Experience cyber-physischer Systeme in professionellen Kontexten und dessen Kommunikation in Industrieg\u00fcterunternehmen. Arbeit interdisziplin\u00e4r: Analysieren-bewerten-gestalten, Arbeitswissenschaftlichen Kongresses vom 27.02. bis 01.03.2019. Dokumentation des 65."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research","volume":"Volume 52","author":"Hart","year":"1988","journal-title":"Advances in Psychology"},{"key":"ref_28","unstructured":"Boll, S., Maa\u00df, S., and Malaka, R. (2013). meCUE\u2014Ein modularer Fragebogen zur Erfassung des Nutzungserlebens. Mensch & Computer, Interaktive Vielfalt; Oldenbourg Verlag."},{"key":"ref_29","unstructured":"Szwillus, G., and Ziegler, J. (2003). AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualit\u00e4t. Mensch & Computer, Vieweg+Teubner Verlag. Berichte des German Chapter of the ACM."},{"key":"ref_30","unstructured":"Brooke, J. (1996). SUS: A Quick and Dirty Usability Scale. Usability in Industry Evaluation, Taylor & Francis."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ullrich, D., and Diefenbach, S. (2010). Intui. Exploring the Facets of Intuitive Interaction. Mensch & Computer 2010: Interaktive Kulturen 2010, Oldenbourg Verlag.","DOI":"10.1524\/9783486853483.251"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Laugwitz, B., Held, T., and Schrepp, M. (2008). Construction and Evaluation of a User Experience Questionnaire. Symposium of the Austrian HCI and Usability Engineering Group, Springer.","DOI":"10.1007\/978-3-540-89350-9_6"},{"key":"ref_33","first-page":"37","article-title":"Die K\u00fcrzung des User Experience Questionnaire UEQ","volume":"Volume 17","author":"Alberola","year":"2018","journal-title":"Mensch Und Computer 2017-Tagungsband"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/15710882.2014.888183","article-title":"Probes, toolkits and prototypes: Three approaches to making in codesigning","volume":"10","author":"Sanders","year":"2014","journal-title":"CoDesign"},{"key":"ref_35","first-page":"1723","article-title":"Unveiling the Multiple and Complex Faces of Fidelity","volume":"Volume 1","author":"Fiorineschi","year":"2019","journal-title":"The Design Society: International Conference on Engineering Design"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1037\/met0000079","article-title":"Comparing the Pearson and Spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data","volume":"21","author":"Gosling","year":"2016","journal-title":"Psychol. Methods"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1727","DOI":"10.1177\/1541931215591373","article-title":"How High is High? A Meta-Analysis of NASA-TLX Global Workload Scores","volume":"59","author":"Grier","year":"2015","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_38","first-page":"114","article-title":"Determining what individual SUS scores mean: Adding an adjective rating scale","volume":"4","author":"Bangor","year":"2009","journal-title":"J. Usability Stud."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1145\/2413038.2413056","article-title":"Quantifying the user experience: Practical statistics for user research","volume":"38","author":"Sampaio","year":"2013","journal-title":"ACM Sigsoft Softw. Eng. Notes"},{"key":"ref_40","first-page":"158","article-title":"Item benchmarks for the system usability scale","volume":"13","author":"Lewis","year":"2018","journal-title":"J. Usability Stud."},{"key":"ref_41","first-page":"40","article-title":"Construction of a Benchmark for the User Experience Questionnaire (UEQ)","volume":"4","author":"Schrepp","year":"2017","journal-title":"Int. J. Interact. Multimed. Artif. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1177\/154193120605000909","article-title":"NASA-task load index (NASA-TLX); 20 years later","volume":"50","author":"Hart","year":"2006","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/4\/3\/57\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:03:50Z","timestamp":1760177030000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/4\/3\/57"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["mti4030057"],"URL":"https:\/\/doi.org\/10.3390\/mti4030057","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,20]]}}}