{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,29]],"date-time":"2026-03-29T06:05:07Z","timestamp":1774764307587,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,27]],"date-time":"2024-01-27T00:00:00Z","timestamp":1706313600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Technical University of Applied Sciences W\u00fcrzburg-Schweinfurt"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Even though assistance systems offer more potential due to the increasing maturity of the inherent technologies, Automatic Speech Recognition faces distinctive challenges in the industrial context. Speech recognition enables immersive assistance systems to handle inputs and commands hands-free during two-handed operative jobs. The results of the conducted study (with n = 22 participants) based on the counterbalanced within-subject design demonstrated the performance (word error rate and information transfer rate) of the HMD HoloLens 2 as a function of the sound pressure level of industrial noise. The negative influence of industrial noise was higher on the word error rate of dictation than on the information transfer rate of the speech command. Contrary to expectations, no statistically significant difference in performance was found between the stationary and non-stationary noise. Furthermore, this study confirmed the hypothesis that user acceptance was negatively influenced by erroneous speech interactions. Furthermore, the erroneous speech interaction had no statistically significant influence on the workload or physiological parameters (skin conductance level and heart rate). It can be summarized that Automatic Speech Recognition is not yet a capable interaction paradigm in an industrial context.<\/jats:p>","DOI":"10.3390\/mti8020008","type":"journal-article","created":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T11:35:34Z","timestamp":1706614534000},"page":"8","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Impact of Industrial Noise on Speech Interaction Performance and User Acceptance when Using the MS HoloLens 2"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4699-8139","authenticated-orcid":false,"given":"Maximilian","family":"Rosilius","sequence":"first","affiliation":[{"name":"Institute Digital Engineering, Technical University of Applied Sciences W\u00fcrzburg-Schweinfurt, 97070 W\u00fcrzburg, Germany"}]},{"given":"Martin","family":"Spiertz","sequence":"additional","affiliation":[{"name":"Institute Digital Engineering, Technical University of Applied Sciences W\u00fcrzburg-Schweinfurt, 97070 W\u00fcrzburg, Germany"}]},{"given":"Benedikt","family":"Wirsing","sequence":"additional","affiliation":[{"name":"Institute Digital Engineering, Technical University of Applied Sciences W\u00fcrzburg-Schweinfurt, 97070 W\u00fcrzburg, Germany"}]},{"given":"Manuel","family":"Geuen","sequence":"additional","affiliation":[{"name":"Department of Community Health, Bochum University of Applied Sciences, 44801 Bochum, Germany"}]},{"given":"Volker","family":"Br\u00e4utigam","sequence":"additional","affiliation":[{"name":"Institute Digital Engineering, Technical University of Applied Sciences W\u00fcrzburg-Schweinfurt, 97070 W\u00fcrzburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3599-2081","authenticated-orcid":false,"given":"Bernd","family":"Ludwig","sequence":"additional","affiliation":[{"name":"Department of Information Science, University of Regensburg, 93053 Regensburg, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,27]]},"reference":[{"key":"ref_1","first-page":"38","article-title":"Cognitive assistance systems for manual assembly throughout the German manufacturing industry","volume":"8","author":"Fink","year":"2020","journal-title":"J. Appl. Leadersh. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1016\/j.procir.2019.03.229","article-title":"Approach to increase worker acceptance of cognitive assistance systems in manual assembly","volume":"81","author":"Sochor","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1080\/00140139.2016.1216610","article-title":"Altering user\u2019acceptance of automation through prior automation exposure","volume":"60","author":"Bekier","year":"2017","journal-title":"Ergonomics"},{"key":"ref_4","unstructured":"Strohm, O., and Ulich, E. (1997). Unternehmen Arbeitspsychologisch bewerten: Ein Mehr-Ebenen-Ansatz unter Besonderer Ber\u00fccksichtigung von Mensch, Technik und Organisation, Vdf Hochschulverlag AG."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hirsch-Kreinsen, H., Ittermann, P., and Niehaus, J. (2018). Digitalisierung Industrieller Arbeit: Die Vision Industrie 4.0 und Ihre Sozialen Herausforderungen, Nomos Verlag.","DOI":"10.5771\/9783845283340"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1016\/j.eng.2019.07.015","article-title":"Human\u2013cyber\u2013physical systems (HCPSs) in the context of new-generation intelligent manufacturing","volume":"5","author":"Ji","year":"2019","journal-title":"Engineering"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, B., Li, X., Freiheit, T., and Epureanu, I.B. (2020, January 21\u201323). Learning and intelligence in human-cyber-physical systems: Framework and perspective. Proceedings of the 2020 Second International Conference on Transdisciplinary AI (TransAI), Irvine, CA, USA.","DOI":"10.1109\/TransAI49837.2020.00032"},{"key":"ref_8","unstructured":"Hadorn, B., Courant, M., Hirsbrunner, B., and Courant, M. (2016). Towards Human-Centered Cyber-Physical Systems: A Modeling Approach, D\u00e9partment d\u2019informatique Universit\u00e9 de Fribourg."},{"key":"ref_9","first-page":"88","article-title":"Industrial applications of automatic speech recognition systems","volume":"6","author":"Vajpai","year":"2016","journal-title":"Int. J. Eng. Res. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1177\/1071181319631279","article-title":"Text input performance with a mixed reality head-mounted display (HMD)","volume":"Volume 63","author":"Derby","year":"2019","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Eckert, M., Blex, M., and Friedrich, C.M. (2018, January 19\u201321). Object detection featuring 3D audio localization for Microsoft HoloLens. Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies, Funchal, Portugal.","DOI":"10.5220\/0006655605550561"},{"key":"ref_12","unstructured":"Estrella, J., and Benito, M. (2019, January 1\u20132). Voice Controlled Augmented Reality: A Comparison of Speech Recognition Tools for AR Applications. Proceedings of the 2019 Fall ASEE Midatlantic Conference, New York, NY, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fuhrmann, F., Weber, A., Ladst\u00e4tter, S., Dietrich, S., and Rella, J. (2021, January 18\u201322). Multimodal Interaction in the Production Line-An OPC UA-based Framework for Injection Molding Machinery. Proceedings of the 2021 International Conference on Multimodal Interaction, Montr\u00e9al, QC, Canada.","DOI":"10.1145\/3462244.3481300"},{"key":"ref_14","first-page":"20","article-title":"Comparing speech recognition systems (Microsoft API, Google API and CMU Sphinx)","volume":"7","author":"Bohouta","year":"2017","journal-title":"Int. J. Eng. Res. Appl."},{"key":"ref_15","unstructured":"Filippidou, F., and Moussiades, L. (2020, January 5\u20137). A benchmarking of IBM, Google and Wit SPC recognition systems. Proceedings of the Artificial Intelligence Applications and Innovations: 16th IFIP WG 12.5 International Conference, AIAI 2020, Neos Marmaras, Greece. Proceedings, Part I 16."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MMUL.2018.2873473","article-title":"Technical evaluation of HoloLens for multimedia: A first look","volume":"25","author":"Liu","year":"2018","journal-title":"IEEE MultiMedia"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1177\/0018720820943710","article-title":"Do Head-Mounted Augmented Reality Devices Affect Muscle Activity and Eye Strain of Utility Workers Who Do Procedural Work? Studies of Operators and Manhole Workers","volume":"64","author":"Marklin","year":"2022","journal-title":"Hum. Factors"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2102","DOI":"10.1177\/1071181320641509","article-title":"\u201cWe didn\u2019t catch that!\u201d using voice text input on a mixed reality headset in noisy environments","volume":"Volume 64","author":"Derby","year":"2020","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"ref_19","unstructured":"Sinlapanuntakul, W., Skilton, K., Mathew, J.N., Collard, A., and Chaparro, B.S. (2023, October 30). Assessing Mixed Reality Voice Dictation with Background Noise. Available online: https:\/\/commons.erau.edu\/db-srs\/2021\/poster-session-two\/4\/."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1080\/1463922X.2013.817625","article-title":"Understanding human management of automation errors","volume":"15","author":"McBride","year":"2014","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hutchinson, J., Strickland, L., Farrell, S., and Loft, S. (2022). The perception of automation reliability and acceptance of automated advice. Hum. Factors, 65.","DOI":"10.31219\/osf.io\/9qgdb"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Merino, L., Schwarzl, M., Kraus, M., Sedlmair, M., Schmalstieg, D., and Weiskopf, D. (2020, January 9\u201313). Evaluating mixed and augmented reality: A systematic literature review (2009\u20132019). Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Porto de Galinhas, Brazil.","DOI":"10.1109\/ISMAR50242.2020.00069"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"37","DOI":"10.3389\/frobt.2018.00037","article-title":"A systematic review of 10 years of augmented reality usability studies: 2005 to 2014","volume":"5","author":"Dey","year":"2018","journal-title":"Front. Robot. AI"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"106278","DOI":"10.1016\/j.buildenv.2019.106278","article-title":"Developing an innovative method for visual perception evaluation in a physical-based virtual environment","volume":"162","author":"Kent","year":"2019","journal-title":"Build. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Palanque, P., Cockburn, A., and Gutwin, C. (2020, January 16\u201318). A classification of faults covering the human-computer interaction loop. Proceedings of the Computer Safety, Reliability, and Security: 39th International Conference, SAFECOMP 2020, Lisbon, Portugal. Proceedings 39.","DOI":"10.1007\/978-3-030-54549-9_29"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"103112","DOI":"10.1016\/j.compind.2019.07.002","article-title":"Adopting augmented reality in the age of industrial digitalisation","volume":"115","author":"Masood","year":"2020","journal-title":"Comput. Ind."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Bahaei, S.S., and Gallina, B. (2019, January 22\u201326). Augmented reality-extended humans: Towards a taxonomy of failures\u2013focus on visual technologies. Proceedings of the European Safety and Reliability Conference (ESREL), Hannover, Germany.","DOI":"10.3850\/978-981-11-2724-3_0922-cd"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bahaei, S.S., Gallina, B.B., Laumann, K., and Skogstad, M.R. (2019, January 20\u201322). Effect of augmented reality on faults leading to human failures in socio-technical systems. Proceedings of the 2019 4th International Conference on System Reliability and Safety (ICSRS), Rome, Italy.","DOI":"10.1109\/ICSRS48664.2019.8987586"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bahaei, S.S., and Gallina, B. (2019, January 20\u201322). Extending CafeConcert for modelling augmented reality-equipped socio-technical systems. Proceedings of the 2019 4th International Conference on System Reliability and Safety (ICSRS), Rome, Italy.","DOI":"10.1109\/ICSRS48664.2019.8987702"},{"key":"ref_30","unstructured":"Br\u00e4uer, P., and Mazarakis, A. (2018). AR in order-picking\u2013experimental evidence with Microsoft HoloLens. Mensch und Computer 2018-Workshopband 2018, Dresden, Germany, September 2018, Gesellschaft f\u00fcr Informatik e.V."},{"key":"ref_31","unstructured":"Eveleigh, K., Mabee, D., Tieto, V., Ferrone, H., and Coulter, D. (2022). HoloLens (1st Gen) Input 212-Voice-Mixed Reality. Microsoft Learn, Available online: https:\/\/docs.microsoft.com\/en-us\/windows\/mixed-reality\/holograms-212."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"157","DOI":"10.2307\/41410412","article-title":"Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology","volume":"36","author":"Venkatesh","year":"2012","journal-title":"MIS Q."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1177\/154193120605000909","article-title":"NASA-task load index (NASA-TLX); 20 years later","volume":"Volume 50","author":"Hart","year":"2006","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1097\/YCO.0000000000000613","article-title":"Technostress at work and mental health: Concepts and research results","volume":"33","author":"Dragano","year":"2020","journal-title":"Curr. Opin. Psychiatry"},{"key":"ref_35","first-page":"20","article-title":"The utility metric: A novel method to assess the overall performance of discrete brain\u2013computer interfaces","volume":"18","author":"Matteucci","year":"2009","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_36","first-page":"54","article-title":"Is there more to blood volume pulse than heart rate variability, respiratory sinus arrhythmia, and cardiorespiratory synchrony?","volume":"35","author":"Peper","year":"2007","journal-title":"Biofeedback"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhou, J., Arshad, S.Z., Luo, S., Yu, K., Berkovsky, S., and Chen, F. (2017, January 6\u201311). Indexing cognitive load using blood volume pulse features. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, CO, USA.","DOI":"10.1145\/3027063.3053140"},{"key":"ref_38","unstructured":"European Parliament and European Council (2023, October 05). RICHTLINIE 2003\/10\/EG DES EUROP\u00c4ISCHEN PARLAMENTS UND DES RATES vom 6. Februar 2003. Available online: https:\/\/eur-lex.europa.eu\/legal-content\/DE\/TXT\/PDF\/?uri=CELEX:32003L0010&rid=3."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"811737","DOI":"10.3389\/fnbeh.2021.811737","article-title":"Toward a Computational Neuroethology of Vocal Communication: From Bioacoustics to Neurophysiology, Emerging Tools and Future Directions","volume":"15","author":"Sainburg","year":"2021","journal-title":"Front. Behav. Neurosci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Weinzierl, S. (2008). Handbuch der Audiotechnik, Springer Science & Business Media.","DOI":"10.1007\/978-3-540-34301-1"},{"key":"ref_41","first-page":"1","article-title":"Correct use of repeated measures analysis of variance","volume":"29","author":"Park","year":"2009","journal-title":"Korean J. Lab. Med."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yang, J., Rahardja, S., and Fr\u00e4nti, P. (2019, January 19\u201321). Outlier detection: How to threshold outlier scores?. Proceedings of the International Conference on Artificial Intelligence, Information Processing and Cloud Computing, Sanya, China.","DOI":"10.1145\/3371425.3371427"},{"key":"ref_43","unstructured":"Blaine, B.E. (2018). Winsorizing. The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation, Sage Publications."},{"key":"ref_44","first-page":"87","article-title":"Der t-, Welch-und U-Test im psychotherapiewissenschaftlichen Forschungskontext. Empfehlungen f\u00fcr Anwendung und Interpretation","volume":"8","author":"Seistock","year":"2020","journal-title":"SFU Forschungsbulletin"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Munteanu, C., Penn, G., Baecker, R., Toms, E., and James, D. (2006, January 17\u201321). Measuring the acceptable word error rate of machine-generated webcast transcripts. Proceedings of the Ninth International Conference on Spoken Language Processing, Pittsburgh, Pennsylvania.","DOI":"10.21437\/Interspeech.2006-40"},{"key":"ref_46","unstructured":"Urban, E., and Mehrotra, N. (2023). Testgenauigkeit eines Custom Speech-Modells\u2014Speech-Dienst\u2014Azure AI Services. Microsoft Learn, Available online: https:\/\/docs.microsoft.com\/de-de\/azure\/cognitive-services\/speech-service\/how-to-custom-speech-evaluate-data#sources-by-scenario."},{"key":"ref_47","unstructured":"Strange, A. (2023, October 08). Microsoft\u2019s HoloLens 2 team answers more questions about biometric security, audio, and hand tracking. Available online: https:\/\/hololens.reality.news\/news\/microsofts-hololens-2-team-answers-more-questions-about-biometric-security-audio-hand-tracking-0194712\/."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1121\/10.0013895","article-title":"The effect of hearing protection worn by talker and\/or target listener on speech production in quiet and noise","volume":"152","author":"Vaziri","year":"2022","journal-title":"J. Acoust. Soc. Am."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/2\/8\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:50:28Z","timestamp":1760104228000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/2\/8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,27]]},"references-count":48,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["mti8020008"],"URL":"https:\/\/doi.org\/10.3390\/mti8020008","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,27]]}}}