{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T10:04:06Z","timestamp":1768989846167,"version":"3.49.0"},"reference-count":41,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T00:00:00Z","timestamp":1670889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Slovenian Research Agency (ARRS)","doi-asserted-by":"publisher","award":["P2-0028"],"award-info":[{"award-number":["P2-0028"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Slovenian Research Agency (ARRS)","doi-asserted-by":"publisher","award":["L5-2626"],"award-info":[{"award-number":["L5-2626"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Product assembly is often one of the last steps in the production process. Product assembly is often carried out by workers (assemblers) rather than robots, as it is generally challenging to adapt automation to any product. When assembling complex products, it can take a long time before the assembler masters all the steps and can assemble the product independently. Training time has no added value; therefore, it should be reduced as much as possible. This paper presents a custom-developed system that enables the guided assembly of complex and diverse products using modern technologies. The system is based on pick-to-light (PTL) modules, used primarily in logistics as an additional aid in the order picking process, and Computer Vision technology. The designed system includes a personal computer (PC), several custom-developed PTL modules and a USB camera. The PC with a touchscreen visualizes the assembly process and allows the assembler to interact with the system. The developed PC application guides the operator through the assembly process by showing all the necessary assembly steps and parts. Two-step verification is used to ensure that the correct part is picked out of the bin, first by checking that the correct pushbutton on the PTL module has been pressed and second by using a camera with a Computer Vision algorithm. The paper is supported by a use case demonstrating that the proposed system reduces the assembly time of the used product. The presented solution is scalable and flexible as it can be easily adapted to show the assembly steps of another product.<\/jats:p>","DOI":"10.3390\/s22249769","type":"journal-article","created":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T04:32:48Z","timestamp":1670905968000},"page":"9769","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Product Assembly Assistance System Based on Pick-To-Light and Computer Vision Technology"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8141-4189","authenticated-orcid":false,"given":"Darko","family":"Hercog","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, University of Maribor, Koro\u0161ka Cesta 46, SI-2000 Maribor, Slovenia"}]},{"given":"Primo\u017e","family":"Bencak","sequence":"additional","affiliation":[{"name":"Faculty of Logistics, University of Maribor, Mariborska Cesta 7, SI-3000 Celje, Slovenia"}]},{"given":"Uro\u0161","family":"Vinceti\u010d","sequence":"additional","affiliation":[{"name":"Faculty of Mechanical Engineering, University of Maribor, Smetanova ulica 17, SI-2000 Maribor, Slovenia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7474-182X","authenticated-orcid":false,"given":"Tone","family":"Lerher","sequence":"additional","affiliation":[{"name":"Faculty of Mechanical Engineering, University of Maribor, Smetanova ulica 17, SI-2000 Maribor, Slovenia"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s12599-014-0334-4","article-title":"Industry 4.0","volume":"6","author":"Lasi","year":"2014","journal-title":"Bus. Inf. Syst. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1080\/00207543.2018.1444806","article-title":"Industry 4.0: State of the art and future trends","volume":"56","author":"Xu","year":"2018","journal-title":"Int. J. Prod. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bousdekis, A., Lepenioti, K., Apostolou, D., and Mentzas, G. (2021). A review of data-driven decision-making methods for industry 4.0 maintenance applications. Electronics, 10.","DOI":"10.3390\/electronics10070828"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1080\/00207543.2017.1372647","article-title":"The industrial management of SMEs in the era of Industry 4.0","volume":"56","author":"Moeuf","year":"2018","journal-title":"Int. J. Prod. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1016\/J.ENG.2017.05.015","article-title":"Intelligent Manufacturing in the Context of Industry 4.0: A Review","volume":"3","author":"Zhong","year":"2017","journal-title":"Engineering"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1016\/j.ejor.2018.08.023","article-title":"Warehousing in the e-commerce era: A survey","volume":"277","author":"Boysen","year":"2019","journal-title":"Eur. J. Oper. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1080\/00207543.2019.1600759","article-title":"Ageing workforce management in manufacturing systems: State of the art and future research agenda","volume":"58","author":"Calzavara","year":"2020","journal-title":"Int. J. Prod. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1016\/j.promfg.2017.09.045","article-title":"Industry 4.0 implications in logistics: An overview","volume":"13","author":"Barreto","year":"2017","journal-title":"Procedia Manuf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1007\/s00287-015-0876-y","article-title":"Logistics 4.0: The vision of the Internet of Autonomous Things","volume":"38","author":"Kerner","year":"2015","journal-title":"Inform.-Spektrum"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Turk, M., Pipan, M., Simic, M., and Herakovic, N. (2020). A smart algorithm for personalizing the workstation in the assembly process. Appl. Sci., 10.","DOI":"10.3390\/app10238624"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gualtieri, L., Palomba, I., Merati, F.A., Rauch, E., and Vidoni, R. (2020). Design of human-centered collaborative assembly workstations for the improvement of operators\u2019 physical ergonomics and production efficiency: A case study. Sustainability, 12.","DOI":"10.3390\/su12093606"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gaj\u0161ek, B., \u0160inko, S., Kramberger, T., Butlewski, M., \u00d6zceylan, E., and \u0110uki\u0107, G. (2021). Towards productive and ergonomic order picking: Multi-objective modeling approach. Appl. Sci., 11.","DOI":"10.3390\/app11094179"},{"key":"ref_13","first-page":"14958","article-title":"Assembly system configuration through Industry 4.0 principles: The expected change in the actual paradigms","volume":"50","author":"Cohen","year":"2017","journal-title":"IFAC-Pap."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.jmsy.2021.02.017","article-title":"Worker assistance systems in manufacturing: A review of the state of the art and future directions","volume":"59","author":"Mark","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.jmsy.2021.04.003","article-title":"An experimental study on augmented reality assisted manual assembly with occluded components","volume":"61","author":"Chu","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Funk, M., Kosch, T., and Schmidt, A. (2016, January 12\u201316). Interactive worker assistance: Comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.","DOI":"10.1145\/2971648.2971706"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sand, O., B\u00fcttner, S., Paelke, V., and R\u00f6cker, C. (2016, January 17\u201322). smARt.Assembly\u2014Projection-based augmented reality for supporting assembly workers. Proceedings of the International Conference on Virtual, Augmented and Mixed Reality: VAMR 2016, Toronto, ON, Canada.","DOI":"10.1007\/978-3-319-39907-2_61"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.promfg.2018.10.072","article-title":"Spatial Augmented Reality: An application for human work in smart manufacturing environment","volume":"17","author":"Mengoni","year":"2018","journal-title":"Procedia Manuf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1177\/0018720819890966","article-title":"Biomechanical Evaluation of Passive Back-Support Exoskeletons in a Precision Manual Assembly Task: \u201cExpected\u201d Effects on Trunk Muscle Activity, Perceived Exertion, and Task Performance","volume":"62","author":"Madinei","year":"2020","journal-title":"Hum. Factors"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Palomba, I., Gualtieri, L., Rojas, R., Rauch, E., Vidoni, R., and Ghedin, A. (2021). Mechatronic re-design of a manual assembly workstation into a collaborative one for wire harness assemblies. Robotics, 10.","DOI":"10.3390\/robotics10010043"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-030-72632-4_1","article-title":"Augmented Reality in Assembly Systems: State of the Art and Future Perspectives","volume":"Volume 620","author":"Dini","year":"2021","journal-title":"IFIP Advances in Information and Communication Technology"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101410","DOI":"10.1016\/j.aei.2021.101410","article-title":"Exploring augmented reality for worker assistance versus training","volume":"50","author":"Moghaddam","year":"2021","journal-title":"Adv. Eng. Inform."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1016\/j.jmsy.2020.12.012","article-title":"Human acceptance evaluation of AR-assisted assembly scenarios","volume":"61","author":"Schuster","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s00170-020-06291-w","article-title":"User-oriented AR assembly guideline: A new classification method of assembly instruction for user cognition","volume":"112","author":"Wang","year":"2021","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/978-3-030-50726-8_60","article-title":"Mental Effort and Usability of Assistance Systems in Manual Assembly\u2014A Comparison of Pick-to-Light and AR Contours through VR Simulation","volume":"Volume 1224","author":"Minow","year":"2020","journal-title":"Communications in Computer and Information Science"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Manzini, R. (2012). Order Picking: Issues, Systems and Models. Warehousing in the Global Supply Chain: Advanced Models, Tools and Applications for Storage Systems, Springer.","DOI":"10.1007\/978-1-4471-2274-6"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107511","DOI":"10.1016\/j.cie.2021.107511","article-title":"Towards a conceptualisation of Order Picking 4.0","volume":"159","author":"Winkelhaus","year":"2021","journal-title":"Comput. Ind. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"6350","DOI":"10.1080\/00207543.2021.1991022","article-title":"Determining the source of human-system errors in manual order picking with respect to human factors","volume":"60","author":"Setayesh","year":"2021","journal-title":"Int. J. Prod. Res."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Guo, A., Raghu, S., Xie, X., Ismail, S., Luo, X., Simoneau, J., Gilliland, S., Baumann, H., Southern, C., and Starner, T. (2014, January 13\u201317). A comparison of order picking assisted by head-up display (HUD), cart-mounted display (CMD), light, and paper pick list. Proceedings of the 2014 ACM International Symposium on Wearable Computers, Seattle, DC, USA.","DOI":"10.1145\/2634317.2634321"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.cie.2019.01.034","article-title":"Kit preparation for mixed model assembly\u2014Efficiency impact of the picking information system","volume":"129","author":"Fager","year":"2019","journal-title":"Comput. Ind. Eng."},{"key":"ref_31","unstructured":"Alessandro, A., Daria, B., Martina, C., Mauro, G., Umberto, P., Alessandro, P., Francesco, P., and Fabio, S. (2013, January 11\u201313). New pick-to-light system configuration: A feasibility study. Proceedings of the XVIII Summer School Francesco Turco, Senigallia, Italy."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1016\/j.promfg.2020.01.105","article-title":"A fuzzy-based approach to improve the human pick-to-light efficiency incorporated with robots behavior in an intelligent distribution center","volume":"38","author":"Su","year":"2019","journal-title":"Procedia Manuf."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1108\/IMDS-10-2014-0314","article-title":"A comparative analysis of different paperless picking systems","volume":"115","author":"Battini","year":"2015","journal-title":"Ind. Manag. Data Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2023","DOI":"10.1007\/s00170-020-05771-3","article-title":"A scalable wearable AR system for manual order picking based on warehouse floor-related navigation","volume":"109","author":"Fang","year":"2020","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1108\/AA-06-2019-0103","article-title":"Design, engineering and testing of an innovative adaptive automation assembly system","volume":"40","author":"Bortolini","year":"2020","journal-title":"Assem. Autom."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bortolini, M., Faccio, M., Galizia, F.G., Gamberi, M., and Pilati, F. (2021). Adaptive automation assembly systems in the industry 4.0 era: A reference framework and full\u2013scale prototype. Appl. Sci., 11.","DOI":"10.3390\/app11031256"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1108\/AA-03-2017-032","article-title":"Synchronous AR assembly assistance and monitoring system based on ego-centric vision","volume":"39","author":"Yin","year":"2019","journal-title":"Assem. Autom."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.jmsy.2020.02.010","article-title":"Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing","volume":"55","author":"Lai","year":"2020","journal-title":"J. Manuf. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3193","DOI":"10.1007\/s00170-021-07624-z","article-title":"A mixed reality platform for assembly assistance based on gaze interaction in industry","volume":"116","author":"Wang","year":"2021","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ojer, M., Alvarez, H., Serrano, I., Saiz, F.A., Barandiaran, I., Aguinaga, D., Querejeta, L., and Alejandro, D. (2020). Projection-based augmented reality assistance for manual electronic component assembly processes. Appl. Sci., 10.","DOI":"10.3390\/app10030796"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sorostinean, R., Gellert, A., and Pirvu, B.C. (2021). Assembly assistance system with decision trees and ensemble learning. Sensors, 21.","DOI":"10.3390\/s21113580"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9769\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:40:20Z","timestamp":1760146820000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9769"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,13]]},"references-count":41,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22249769"],"URL":"https:\/\/doi.org\/10.3390\/s22249769","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,13]]}}}