{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T05:16:11Z","timestamp":1762492571541,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T00:00:00Z","timestamp":1762128000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ag\u00eancia para a Competitividade e Inova\u00e7\u00e3o IP","award":["02\/C05-i01.02\/2022.PC644867037-00000013"],"award-info":[{"award-number":["02\/C05-i01.02\/2022.PC644867037-00000013"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The increasing demand for customized products has raised the significant challenges of increasing performance and reducing costs in the industry. Facing that demand requires operators to enhance their capabilities to cope with complexity, demanding skills, and higher cognitive levels, performance, and errors. To overcome this scenario, a virtual instructor framework is proposed to instruct operators and support procedural quality, enabled by the use of You Only Look Once (YOLO) models and by equipping the operators with Magic Leap 2 as a Head-Mounted Display (HMD). The framework relies on key modules, such as Instructor, Management, Core, Object Detection, 3D Modeling, and Storage. A use case in the automotive industry helped validate the Proof-of-concept (PoC) of the proposed framework. This framework can contribute to guiding the development of new tools supporting assembly operations in the industry.<\/jats:p>","DOI":"10.3390\/computers14110479","type":"journal-article","created":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T17:32:01Z","timestamp":1762191121000},"page":"479","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Mixed Reality-Based Training and Guidance System for Quality Control"],"prefix":"10.3390","volume":"14","author":[{"given":"Luzia","family":"Saraiva","sequence":"first","affiliation":[{"name":"Higher School of Technology and Management, Polytechnic University of Viseu, 3504-510 Viseu, Portugal"},{"name":"CISeD\u2014Research Centre in Digital Services, Polytechnic of Viseu, 3504-510 Viseu, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7380-9511","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Henriques","sequence":"additional","affiliation":[{"name":"Higher School of Technology and Management, Polytechnic University of Viseu, 3504-510 Viseu, Portugal"},{"name":"CISeD\u2014Research Centre in Digital Services, Polytechnic of Viseu, 3504-510 Viseu, Portugal"},{"name":"Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering, University of Coimbra, 3030-290 Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7285-8282","authenticated-orcid":false,"given":"Jos\u00e9","family":"Silva","sequence":"additional","affiliation":[{"name":"Higher School of Technology and Management, Polytechnic University of Viseu, 3504-510 Viseu, Portugal"},{"name":"CISeD\u2014Research Centre in Digital Services, Polytechnic of Viseu, 3504-510 Viseu, Portugal"}]},{"given":"Andr\u00e9","family":"Barbosa","sequence":"additional","affiliation":[{"name":"Inklusion Entertainment S.A., 6200-284 Covilh\u00e3, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3499-6681","authenticated-orcid":false,"given":"Serafim M.","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Higher School of Technology and Management, Polytechnic University of Viseu, 3504-510 Viseu, Portugal"},{"name":"CISeD\u2014Research Centre in Digital Services, Polytechnic of Viseu, 3504-510 Viseu, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6721","DOI":"10.1080\/00207543.2020.1823028","article-title":"Workforce reconfiguration strategies in manufacturing systems: A state of the art","volume":"59","author":"Dolgui","year":"2021","journal-title":"Int. J. Prod. Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Miqueo, A., Torralba, M., and Yag\u00fce-Fabra, J.A. (2020). Lean Manual Assembly 4.0: A Systematic Review. Appl. Sci., 10.","DOI":"10.3390\/app10238555"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wollter Bergman, M., Berlin, C., Babapour Chafi, M., Falck, A.C., and \u00d6rtengren, R. (2021). Cognitive Ergonomics of Assembly Work from a Job Demands\u2013Resources Perspective: Three Qualitative Case Studies. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph182312282"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chiang, F.K., Shang, X., and Qiao, L. (2022). Augmented reality in vocational training: A systematic review of research and applications. Comput. Hum. Behav., 129.","DOI":"10.1016\/j.chb.2021.107125"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1016\/j.promfg.2017.07.217","article-title":"Interdependencies of Industrie 4.0 & lean production systems: A use cases analysis","volume":"11","author":"Dombrowski","year":"2017","journal-title":"Procedia Manuf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"8407","DOI":"10.1109\/ACCESS.2023.3235871","article-title":"Fast Augmented Reality Authoring: Fast Creation of AR Step-by-Step Procedures for Maintenance Operations","volume":"11","author":"Palmarini","year":"2023","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Adel, A. (2022). Future of industry 5.0 in society: Human-centric solutions, challenges and prospective research areas. J. Cloud Comput., 11.","DOI":"10.1186\/s13677-022-00314-5"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.cirp.2018.04.120","article-title":"Workplace analysis and design using virtual reality techniques","volume":"67","author":"Michalos","year":"2018","journal-title":"CIRP Ann."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Peikos, G., and Sofianidis, A. (2024). What Is the Future of Augmented Reality in Science Teaching and Learning? An Exploratory Study on Primary and Pre-School Teacher Students\u2019 Views. Educ. Sci., 14.","DOI":"10.3390\/educsci14050480"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1007\/s10055-020-00427-9","article-title":"Evaluating the effectiveness of learning design with mixed reality (MR) in higher education","volume":"24","author":"Tang","year":"2020","journal-title":"Virtual Real."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.jmsy.2022.09.016","article-title":"Challenges and opportunities on AR\/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review","volume":"65","author":"Eswaran","year":"2022","journal-title":"J. Manuf. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rebol, M., Hood, C., Ranniger, C., Rutenberg, A., Sikka, N., Horan, E.M., G\u00fctl, C., and Pietroszek, K. (April, January 27). Remote Assistance with Mixed Reality for Procedural Tasks. Proceedings of the 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Lisbon, Portugal.","DOI":"10.1109\/VRW52623.2021.00209"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A survey of augmented reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_14","first-page":"510","article-title":"Students\u2019 Learning Experience in a Mixed Reality Environment: Drivers and Barriers","volume":"50","author":"John","year":"2022","journal-title":"Commun. Assoc. Inf. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Valizadeh, M., and Wolff, S.J. (2022). Convolutional Neural Network applications in additive manufacturing: A review. Adv. Ind. Manuf. Eng., 4.","DOI":"10.1016\/j.aime.2022.100072"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Park, S.-H., Lee, K.-H., Park, J.-S., and Shin, Y.-S. (2022). Deep learning-based visual inspection system for surface defect detection in manufacturing. Sustainability, 14.","DOI":"10.3390\/su14052697"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"121449","DOI":"10.1109\/ACCESS.2024.3453664","article-title":"A Survey of Computer Vision Algorithms for Manufacturing Quality Control","volume":"9","author":"Islam","year":"2024","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ameri, R., Hsu, C., and Band, S. (2024). A systematic review of deep learning approaches for surface defect detection in industrial applications. Eng. Appl. Artif. Intell., 130.","DOI":"10.1016\/j.engappai.2023.107717"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"473","DOI":"10.22161\/ijaers.74.56","article-title":"Deep Learning Models for Visual Inspection on Automotive Assembling Line","volume":"3","author":"Mazzetto","year":"2020","journal-title":"Int. J. Adv. Eng. Res. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bergmann, P., Fauser, M., Sattlegger, D., and Steger, C. (2019, January 15\u201320). MVTec AD\u2013A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00982"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mou, W., Peng, Z., and Wang, H. (2024). A Survey of Vision-Based Methods for Surface Defects\u2019 Detection and Classification in Steel Products. Informatics, 11.","DOI":"10.3390\/informatics11020025"},{"key":"ref_22","unstructured":"BMW Group (2025, June 20). Artificial Intelligence Improves Quality Assurance at BMW Group Plants. Available online: https:\/\/www.press.bmwgroup.com\/global\/article\/detail\/T0449729EN\/artificial-intelligence-as-a-quality-booster."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Silva, J., Coelho, P., Saraiva, L., Vaz, P., Martins, P., and L\u00f3pez-Rivero, A. (2024). Validating the Use of Smart Glasses in Industrial Quality Control: A Case Study. Appl. Sci., 14.","DOI":"10.3390\/app14051850"},{"key":"ref_24","unstructured":"Blog, M.D., and Bardeen, L. (2023, November 03). Ford Brings Microsoft HoloLens to Design Studio; Drives Speed, Creativity and Collaboration. Available online: https:\/\/blogs.windows.com\/devices\/2017\/09\/20\/ford-brings-microsoft-hololens-to-design-studio-drives-speed-creativity-and-collaboration\/."},{"key":"ref_25","unstructured":"Nogueira, P.A.L. (2023). Aplica\u00e7\u00e3o da Realidade Mista na Aprendizagem em Unidades Industriais-Learning Factory. [Master\u2019s Thesis, Polytechnic Institute of Viseu]."},{"key":"ref_26","unstructured":"Unity Technologies (2024, October 25). Plataforma de Desenvolvimento em Tempo Real do Unity | Engine para 3D, 2D, VR e AR. Available online: https:\/\/unity.com."},{"key":"ref_27","unstructured":"Epic Games, Inc (2023, October 30). Unreal Engine | A Mais Poderosa Ferramenta de 3D em Tempo Real. Available online: https:\/\/www.unrealengine.com\/pt-BR."},{"key":"ref_28","unstructured":"Porsche (2023, November 04). Designed by Innovation. Available online: https:\/\/newsroom.porsche.com\/en\/2019\/digital\/porsche-design-mixed-reality-technology-meyle-mueller-medialesson-hololens-interview-18189.html."},{"key":"ref_29","unstructured":"Team Viewer (2023, November 04). TeamViewer Customer Success Story: Audi. Available online: https:\/\/www.teamviewer.com\/en\/success-stories\/audi\/."},{"key":"ref_30","unstructured":"Chivukula, K. (2023, November 07). RAAF Uses HoloLens Mixed-Reality Device for C-17A Maintenance. Available online: https:\/\/www.airforce-technology.com\/news\/raaf-uses-hololens-mixed-reality-device-for-c-17a-maintenance\/."},{"key":"ref_31","unstructured":"Trimble Inc (2023, December 11). Laing O\u2019Rourke - Connect AR - Customer Study. Trimble Case Study. Available online: https:\/\/fieldtech.trimble.com\/resources\/mixed-reality\/laing-orourke-connect-ar-customer-study."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, R., Li, C., Tu, P., Ahmed, A., Ji, T., and Chen, X. (2021). Development and Application of Digital Maxillofacial Surgery System Based on Mixed Reality Technology. Front. Surg., 8.","DOI":"10.3389\/fsurg.2021.719985"},{"key":"ref_33","unstructured":"Energy, S. (2025, April 14). Siemens Uses Microsoft Teams and HoloLens for Energy Solutions. Available online: https:\/\/www.uctoday.com\/unified-communications\/siemens-uses-microsoft-teams-and-hololens-for-energy-solutions\/."},{"key":"ref_34","unstructured":"Honeywell (2023, November 04). Honeywell Introduces Virtual Reality-Based Simulator To Optimize Training For Industrial Workers. Available online: https:\/\/www.honeywell.com\/us\/en\/press\/2020\/10\/honeywell-introduces-virtual-reality-based-simulator-to-optimize-training-for-industrial-workers."},{"key":"ref_35","unstructured":"Agenda Green Auto (2025, February 11). Agenda Green Auto-Inova\u00e7\u00e3o Verde para a Ind\u00fastria Autom\u00f3vel. Available online: https:\/\/www.agendagreenauto.pt\/."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.precisioneng.2017.01.014","article-title":"A review on recent research trends in servo pneumatic positioning systems","volume":"49","author":"Saravanakumar","year":"2017","journal-title":"Precis. Eng."},{"key":"ref_37","unstructured":"Django (2024, November 01). Django. Available online: https:\/\/www.djangoproject.com\/."},{"key":"ref_38","unstructured":"Magic Leap (2025, January 09). Product Specifications. Available online: https:\/\/www.magicleap.care\/hc\/en-us\/articles\/7813913215373-Product-Specifications."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_40","unstructured":"Ultralytics (2024, December 16). YOLOv8. Available online: https:\/\/docs.ultralytics.com\/models\/yolov8."},{"key":"ref_41","unstructured":"Ultralytics (2025, January 27). Ultralytics | Revolucionando o Mundo da IA de Vis\u00e3o, 2025. Available online: https:\/\/www.ultralytics.com\/pt."},{"key":"ref_42","unstructured":"Ultralytics (2025, January 27). YOLOv3. Available online: https:\/\/docs.ultralytics.com\/models\/yolov3."},{"key":"ref_43","unstructured":"Ultralytics (2024, November 01). Predict. Available online: https:\/\/docs.ultralytics.com\/modes\/predict."},{"key":"ref_44","unstructured":"Blender, F. (2024, November 05). blender.org-Home of the Blender Project-Free and Open 3D Creation Software. Available online: https:\/\/www.blender.org\/."},{"key":"ref_45","unstructured":"Khronos Group (2025, January 04). glTF-Runtime 3D Asset Delivery. Available online: https:\/\/www.khronos.org\/gltf\/."},{"key":"ref_46","unstructured":"Brigsted, T. (2018, October 10). Siccity\/GLTFUtility. Available online: https:\/\/github.com\/Siccity\/GLTFUtility."},{"key":"ref_47","unstructured":"Newtonsoft (2024, November 05). Json.NET-Newtonsoft. Available online: https:\/\/www.newtonsoft.com\/json."},{"key":"ref_48","unstructured":"(2025, January 10). A, A.H.M. Create REST API Using Django REST Framework | Django REST Framework Tutorial. Available online: https:\/\/medium.com\/@ahmalopers703\/getting-started-with-django-rest-api-for-beginners-9c121a2ce0d3."},{"key":"ref_49","unstructured":"Christie, T. (2025, January 10). Home-Django REST Framework. Available online: https:\/\/www.django-rest-framework.org\/."},{"key":"ref_50","unstructured":"Kinsta (2024, November 02). O Que \u00e9 MySQL? Uma Explica\u00e7\u00e3o Simples para Quem Est\u00e1 Come\u00e7ando. Available online: https:\/\/kinsta.com\/pt\/base-de-conhecimento\/o-que-e-mysql\/."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/11\/479\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T05:11:29Z","timestamp":1762492289000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/11\/479"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,3]]},"references-count":50,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["computers14110479"],"URL":"https:\/\/doi.org\/10.3390\/computers14110479","relation":{},"ISSN":["2073-431X"],"issn-type":[{"type":"electronic","value":"2073-431X"}],"subject":[],"published":{"date-parts":[[2025,11,3]]}}}