{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T16:10:15Z","timestamp":1762272615000,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2020,7,22]],"date-time":"2020-07-22T00:00:00Z","timestamp":1595376000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union, from the European Regional Development Fund within the framework of the Regional Operational Programme of the Opolskie region for the years 2014-2020: Priority Axis 01 Innovation in the Economy, Measure 1.1 Innovation in Enterprises","award":["RPOP.01.01.00-16-0072\/16-00"],"award-info":[{"award-number":["RPOP.01.01.00-16-0072\/16-00"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents a novel user experience optimization concept and method, named User Experience Sensor, applied within the Hybrid Intelligence System (HINT). The HINT system, defined as a combination of an extensive AI system and the possibility of attaching a human expert, is designed to be used by relational agents, which may have a physical form, such as a robot, a kiosk, be embodied in an avatar, or may also exist as only software. The proposed method focuses on automatic process evaluation as a common sensor for optimization of the user experience for every process stage and the indicator for human-expert automatic session activation. This functionality is realized by the User Experience Sensor, which constitutes one of main elements of the self-optimizing interaction system. The authors present the optimization mechanism of the HINT system as an analogy to the process of building a Tower of Hanoi. The proposed sensor evaluates the user experience and measures the user\/employee efficiency at every stage of a given process, offering the user to choose other forms of information, interaction, or expert support. The designed HINT system is able to learn and self-optimize, making the entire process more intuitive and easy for each and every user individually. The HINT system with the proposed sensor, implemented in a window assembly facility, successfully reduced assembly time, increased employees\u2019 satisfaction, and assembly quality. The proposed approach can be implemented in numerous man\u2013machine interaction applications.<\/jats:p>","DOI":"10.3390\/s20154074","type":"journal-article","created":{"date-parts":[[2020,7,22]],"date-time":"2020-07-22T07:31:28Z","timestamp":1595403088000},"page":"4074","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["User Experience Sensor for Man\u2013Machine Interaction Modeled as an Analogy to the Tower of Hanoi"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4420-1157","authenticated-orcid":false,"given":"Arkadiusz","family":"Gardecki","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, 45-758 Opole, Poland"},{"name":"Weegree Sp. z o.o. S.K., 45-018 Opole, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1080-6767","authenticated-orcid":false,"given":"Michal","family":"Podpora","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, 45-758 Opole, Poland"},{"name":"Weegree Sp. z o.o. S.K., 45-018 Opole, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9554-489X","authenticated-orcid":false,"given":"Ryszard","family":"Beniak","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, 45-758 Opole, Poland"},{"name":"Weegree Sp. z o.o. S.K., 45-018 Opole, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0577-7903","authenticated-orcid":false,"given":"Bartlomiej","family":"Klin","sequence":"additional","affiliation":[{"name":"Weegree Sp. z o.o. S.K., 45-018 Opole, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8128-5495","authenticated-orcid":false,"given":"S\u0142awomir","family":"Pochwa\u0142a","sequence":"additional","affiliation":[{"name":"Faculty of Mechanical Engineering, Opole University of Technology, 45-271 Opole, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,22]]},"reference":[{"key":"ref_1","unstructured":"Norman, D. (1998). The Invisible Computer: Why Good Products Can Fail, the Personal Computer is so Complex, and Information Appliances Are the Answer, The MIT Press."},{"key":"ref_2","unstructured":"ISO (2019). ISO FDIS 9241-210 Human-Centred Design Process for Interactive Systems, ISO."},{"key":"ref_3","unstructured":"Adikari, S., McDonald, C., and Campbell, J. (2010). User experience in HMI: An enhanced assessment model. Sustainable Development through Effective Man-Machine Co-Existence, IEEE. Available online: https:\/\/pdfs.semanticscholar.org\/6c09\/86422e23c53eaa32c1ed4c182df0f2940116.pdf."},{"key":"ref_4","unstructured":"ISO (2018). ISO 9241-11\u2014Ergonomic Requirements for Office Work with Visual Display Terminals (VDT)s\u2014Part 11 Guidance on Usability, ISO."},{"key":"ref_5","first-page":"1","article-title":"Aesthetics, visual appeal, usability, and user satisfaction: What do the user\u2019s eyes tell the user\u2019s brain","volume":"5","author":"Lindgaard","year":"2007","journal-title":"Aust. J. Emerg. Technol. Soc."},{"key":"ref_6","unstructured":"Protalinski, E. (2019, September 01). Google\u2019s Speech Recognition Technology Now Has a 4.9% Word Error Rate. Available online: https:\/\/venturebeat.com\/2017\/05\/17\/googles-speech-recognition-technology-now-has-a-4-9-word-error-rate\/."},{"key":"ref_7","unstructured":"Google Inc. (2017, August 31). Google Cloud Platform\u2014Cloud Speech API. Available online: https:\/\/cloud.google.com\/speech\/."},{"key":"ref_8","unstructured":"Pierce, D. (2017, September 02). Siri Finally Got its Coming Out Party. Available online: https:\/\/www.wired.com\/2017\/06\/siri-finally-got-coming-party\/."},{"key":"ref_9","unstructured":"Soto, P. (2016). The Major Advancements in Deep Learning in 2016, Tryo Labs. Available online: https:\/\/tryolabs.com\/blog\/2016\/12\/06\/major-advancements-deep-learning-2016\/."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1126\/science.357.6346.16","article-title":"The AI revolution in science","volume":"357","author":"Appenzeller","year":"2017","journal-title":"Science"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mao, A., Zhang, H., Liu, Y., Zheng, Y., Li, G., and Han, G. (2017). Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor. Sensors, 17.","DOI":"10.3390\/s17051113"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.ijhcs.2019.05.006","article-title":"History and future of human-automation interaction","volume":"131","author":"Janssen","year":"2019","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_13","unstructured":"Kamar, E. (2016, January 9\u201315). Directions in Hybrid Intelligence: Complementing AI Systems with Human Intelligence. Proceedings of the 25 International Joint Conference on Artificial Intelligence (IJCAI-16), New York, NY, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hussein, A., and Abbass, H. (2018, January 4). Mixed initiative systems for human-swarm interaction: Opportunities and challenges. Proceedings of the 2nd Annual Systems Modelling Conference (SMC), Canberra, Australia.","DOI":"10.1109\/SYSMC.2018.8509744"},{"key":"ref_15","unstructured":"Pollock, S. (2020, July 02). 6 Strategies for Effective Performance Management. Available online: https:\/\/hrdailyadvisor.blr.com\/2018\/01\/11\/6-strategies-effective-performance-management\/."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bevilacqua, M., Bottani, E., Ciarapica, F.E., Costantino, F., Di Donato, L., Ferraro, A., Mazzuto, G., Monteri\u00f9, A., Nardini, G., and Ortenzi, M. (2020). Digital Twin Reference Model Development to Prevent Operators\u2019 Risk in Process Plants. Sustainability, 12.","DOI":"10.3390\/su12031088"},{"key":"ref_17","unstructured":"Gibson, J., Ivancevich, J., and Konopaske, R. (2011). Organizations: Behavior, Structure, Processes, McGraw-Hill Higher Education."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Stein, M., Vincent-H\u00f6per, S., Sch\u00fcmann, M., and Gregersen, S. (2020). Beyond mistreatment at the relationship level: Abusive supervision and illegitimate tasks. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17082722"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5402","DOI":"10.3390\/s150305402","article-title":"Distributed multi-level supervision to effectively monitor the operations of a fleet of autonomous vehicles in agricultural tasks","volume":"15","author":"Ribeiro","year":"2015","journal-title":"Sensors"},{"key":"ref_20","unstructured":"Google Inc. (2020, April 15). Google Cloud Platform\u2014Google Speech-To-Text Official Documentation. Available online: https:\/\/cloud.google.com\/speech-to-text."},{"key":"ref_21","unstructured":"Google Inc. (2020, May 20). Dialogflow Documentation. Available online: https:\/\/dialogflow.com\/docs."},{"key":"ref_22","unstructured":"SoftBank Robotics (2020, May 01). Pepper. Available online: https:\/\/www.softbankrobotics.com\/us\/pepper."},{"key":"ref_23","unstructured":"Sanbot Innovation Technology Ltd. (2020, May 25). Sanbot Humanoid Webpage. Available online: http:\/\/en.sanbot.com\/product\/sanbot-elf."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chen, H., Zhang, P., and Yan, Y. (2019). Multi-Talker MVDR Beamforming Based on Extended Complex Gaussian Mixture Model. arXiv.","DOI":"10.1109\/ICDSP.2018.8631585"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fularz, M., Kraft, M., Schmidt, A., and Kasi\u0144ski, A. (2015). The architecture of an embedded smart camera for intelligent inspection and surveillance. International Conference on Automation, Springer.","DOI":"10.1007\/978-3-319-15796-2_5"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Schneider, M., Machacek, Z., Martinek, R., Koziorek, J., and Jaros, R. (2020). A System for the Detection of Persons in Intelligent Buildings Using Camera Systems\u2014A Comparative Study. Sensors, 20.","DOI":"10.3390\/s20123558"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1109\/JSTSP.2019.2908700","article-title":"Deep learning for audio signal processing","volume":"13","author":"Purwins","year":"2019","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_28","unstructured":"Hannun, A., Case, C., Casper, J., Catanzaro, B., Diamos, G., Elsen, E., and Ng, A.Y. (2014). Deep speech: Scaling up end-to-end speech recognition. arXiv."},{"key":"ref_29","unstructured":"Ni, Z., and Mandel, M.I. (2019). ONSSEN: An open-source speech separation and enhancement library. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4273","DOI":"10.1016\/j.eswa.2012.11.022","article-title":"Decision support analysis for safety control in complex project environments based on Bayesian Networks","volume":"40","author":"Zhang","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"533","DOI":"10.2478\/v10171-012-0041-z","article-title":"Estimation of parameters of selected converter drives","volume":"61","author":"Beniak","year":"2012","journal-title":"Arch. Electr. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPEL.2005.869742","article-title":"Two-Step Parameter Extraction Procedure With Formal Optimization for Physics-Based Circuit Simulator IGBT and p-i-n Diode Models","volume":"21","author":"Bryant","year":"2006","journal-title":"IEEE Trans. Power Electron."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/15\/4074\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:50:39Z","timestamp":1760176239000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/15\/4074"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,22]]},"references-count":32,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20154074"],"URL":"https:\/\/doi.org\/10.3390\/s20154074","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,7,22]]}}}