{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T05:42:23Z","timestamp":1768455743011,"version":"3.49.0"},"reference-count":44,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,6,30]],"date-time":"2022-06-30T00:00:00Z","timestamp":1656547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"project TKP2020-NKA-04"},{"name":"National Research, Development, and Innovation Fund of Hungary"},{"name":"2020-4.1.1-TKP2020 funding scheme"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>In the spirit of innovation, the development of an intelligent robot system incorporating the basic principles of Industry 4.0 was one of the objectives of this study. With this aim, an experimental application of an industrial robot unit in its own isolated environment was carried out using neural networks. In this paper, we describe one possible application of deep learning in an Industry 4.0 environment for robotic units. The image datasets required for learning were generated using data synthesis. There are significant benefits to the incorporation of this technology, as old machines can be smartened and made more efficient without additional costs. As an area of application, we present the preparation of a robot unit which at the time it was originally produced and commissioned was not capable of using machine learning technology for object-detection purposes. The results for different scenarios are presented and an overview of similar research topics on neural networks is provided. A method for synthetizing datasets of any size is described in detail. Specifically, the working domain of a given robot unit, a possible solution to compatibility issues and the learning of neural networks from 3D CAD models with rendered images will be discussed.<\/jats:p>","DOI":"10.3390\/robotics11040069","type":"journal-article","created":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T01:40:36Z","timestamp":1656639636000},"page":"69","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Application of Deep Learning in the Deployment of an Industrial SCARA Machine for Real-Time Object Detection"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8183-2516","authenticated-orcid":false,"given":"Tibor P\u00e9ter","family":"Kapusi","sequence":"first","affiliation":[{"name":"Faculty of Informatics, Department of Data Science and Visualization, University of Debrecen, Kassai Str. 26, 4028 Debrecen, Hungary"}]},{"given":"Timotei Istv\u00e1n","family":"Erdei","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Department of Air- & Road Vehicles, University of Debrecen, \u00d3temet\u0151 Str. 2\u20134, 4028 Debrecen, Hungary"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9373-0189","authenticated-orcid":false,"given":"G\u00e9za","family":"Husi","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Department of Air- & Road Vehicles, University of Debrecen, \u00d3temet\u0151 Str. 2\u20134, 4028 Debrecen, Hungary"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1718-9770","authenticated-orcid":false,"given":"Andr\u00e1s","family":"Hajdu","sequence":"additional","affiliation":[{"name":"Faculty of Informatics, Department of Data Science and Visualization, University of Debrecen, Kassai Str. 26, 4028 Debrecen, Hungary"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Erdei, T.I., Moln\u00e1r, Z., Obinna, N.C., and Husi, G. (2017, January 6\u20137). A Novel Design of an Augmented Reality Based Navigation System & its Industrial Applications. Proceedings of the 15th IMEKO TC10\u2014Technical Diagnostics in Cyber-Physical Era, Budapest, Hungary.","DOI":"10.21014\/acta_imeko.v7i1.528"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tikhonova, A.V. (2020, January 5\u20136). Modeling the Social Consequences of Industrial Robotization. Proceedings of the 2nd International Scientific and Practical Conference on Digital Economy (ISCDE 2020), Yekaterinburg, Russia.","DOI":"10.2991\/aebmr.k.201205.038"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"47","DOI":"10.3389\/fnbot.2019.00047","article-title":"Deep Recurrent Neural Networks Based Obstacle Avoidance Control for Redundant Manipulators","volume":"13","author":"Xu","year":"2019","journal-title":"Front. Neurorobot."},{"key":"ref_4","unstructured":"Li, X., Xu, Z., Li, S., Su, Z., and Zhou, X. (2021). Simultaneous Obstacle Avoidance and Target Tracking of Multiple Wheeled Mobile Robots with Certified Safety. IEEE Trans. Cybern., 1\u201315."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3887","DOI":"10.1109\/TIE.2021.3073305","article-title":"Motion Planning of Manipulators for Simultaneous Obstacle Avoidance and Target Tracking: An RNN Approach with Guaranteed Performance","volume":"69","author":"Xu","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2021.05.049","article-title":"Collaboration of multiple SCARA robots with guaranteed safety using recurrent neural networks","volume":"456","author":"He","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_7","unstructured":"(2022, February 18). SCARA Robots: Robot Hall of Fame. Available online: http:\/\/www.robothalloffame.org\/inductees\/06inductees\/scara.html."},{"key":"ref_8","unstructured":"SONY SCARA SRX\u201411 (1996). High-Speed Assembly Robot, Operation Manual, SONY Corporation."},{"key":"ref_9","unstructured":"PARO QE 01 31-6000 (2016). Manual of the Modular Conveyor, PARO AG."},{"key":"ref_10","unstructured":"(2022, February 27). DataSheet: USB Bus Convert Chip CH341. Available online: http:\/\/www.anok.ceti.pl\/download\/ch341ds1.pdf."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Feng, X. (2005, January 18\u201322). Towards Real-Time Enabled Microsoft Windows. Proceedings of the 5th ACM International Conference on Embedded Software, Jersey City, NJ, USA.","DOI":"10.1145\/1086228.1086256"},{"key":"ref_12","unstructured":"Shirvaikar, M., and Satyala, N. (2007, January 24\u201327). A Virtual Machine Environment for Real Time Systems Laboratories. Proceedings of the Conference: ASEE Conference and Exhibition, Honolulu, HI, USA."},{"key":"ref_13","unstructured":"(2022, March 10). Lenovo: ThinkCentre M93p Mini Tower. Available online: https:\/\/www.lenovo.com\/hu\/hu\/desktops\/thinkcentre\/m-series-towers\/ThinkCentre-M93P\/p\/11TC1TMM93P."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Xu, H., Badawi, R., Fan, X., Ren, J., and Zhang, Z. (2009, January 14). Research for 3D visualization of Digital City based on SketchUp and ArcGIS. Proceedings of the SPIE\u2014the International Society for Optical Engineering, Wuhan, China.","DOI":"10.1117\/12.838558"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Takala, T.M., M\u00e4k\u00e4r\u00e4inen, M., and H\u00e4m\u00e4l\u00e4inen, P. (2013, January 16\u201317). Immersive 3D Modeling with Blender and off-the-shelf Hardware. Proceedings of the 3D User Interfaces (3DUI), 2013 IEEE Symposium, Orlando, FL, USA.","DOI":"10.1109\/3DUI.2013.6550243"},{"key":"ref_16","unstructured":"(2022, April 20). Lenovo:ThinkCentre M92p Tower. Available online: https:\/\/www.lenovo.com\/gb\/en\/desktops\/thinkcentre\/m-series-tiny\/m92p\/."},{"key":"ref_17","unstructured":"(2018, May 06). LabelImg. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Casuat, C.D., Merencilla, N.E., Reyes, R.C., Sevilla, R.V., and Pascion, C.G. (2020, January 18\u201320). Deep-Hart: An Inference Deep Learning Approach of Hard Hat Detection for Work Safety and Surveillanc. Proceedings of the 2020 IEEE 7th International Conference on Engineering Technologies and Applied Sciences (ICETAS), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICETAS51660.2020.9484208"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ren, X., Zhang, W., Wu, M., Li, C., and Wang, X. (2022). Meta-YOLO: Meta-Learning for Few-Shot Traffic Sign Detection via Decoupling Dependencies. Appl. Sci., 12.","DOI":"10.3390\/app12115543"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., and Igel, C. (2013, January 4\u20139). Detection of traffic signs in real-world images: The German Traffic Sign Detection Benchmark. Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA.","DOI":"10.1109\/IJCNN.2013.6706807"},{"key":"ref_22","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Traffic-Sign Detection and Classification in the Wild. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ertler, C., Mislej, J., Ollmann, T., Porzi, L., Neuhold, G., and Kuang, Y. (2020). The Mapillary Traffic Sign Dataset for Detection and Clas-sification on a Global Scale. Lecture Notes in Computer Science, Proceedings of the ECCV 2020, Glasgow, UK, 23\u201328 August 2020, Springer.","DOI":"10.1007\/978-3-030-58592-1_5"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yuan, S., Du, Y., Liu, M., Yue, S., Li, B., and Zhang, H. (2022). YOLOv5-Ytiny: A Miniature Aggregate Detection and Classification Model. Electronics, 11.","DOI":"10.3390\/electronics11111743"},{"key":"ref_25","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single Shot MultiBox Detector. Proceedings of the 2016 European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s00607-020-00869-8","article-title":"An improved YOLO-based road traffic monitoring system","volume":"103","author":"Abbasi","year":"2021","journal-title":"Computing"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Mao, W.-L., Chiu, Y.-Y., Lin, B.-H., Wang, C.-C., Wu, Y.-T., You, C.-Y., and Chien, Y.-R. (2022). Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application. Sensors, 22.","DOI":"10.3390\/s22103927"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Adarsh, P., Rathi, P., and Kumar, M. (2020, January 6\u20137). YOLO v3-Tiny: Object Detection and Recognition using one stage improved model. Proceedings of the 6th Inter-national Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.","DOI":"10.1109\/ICACCS48705.2020.9074315"},{"key":"ref_30","unstructured":"Radford, A., Metz, L., and Chintala, S. (2016). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Al-Alimi, D., Shao, Y., Feng, R., Al-Qaness, M.A.A., Elaziz, M.A., and Kim, S. (2019). Multi-Scale Geospatial Object Detection Based on Shallow-Deep Feature Extraction. Remote Sens., 11.","DOI":"10.3390\/rs11212525"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7405","DOI":"10.1109\/TGRS.2016.2601622","article-title":"Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images","volume":"54","author":"Cheng","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Han, X., Zhong, Y., and Zhang, L. (2017). An Efficient and Robust Integrated Geospatial Object Detection Framework for High Spatial Resolution Remote Sensing Imagery. Remote Sens., 9.","DOI":"10.3390\/rs9070666"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xu, Z., Xu, X., Wang, L., Yang, R., and Pu, F. (2017). Deformable ConvNet with Aspect Ratio Constrained NMS for Object Detection in Remote Sensing Imagery. Remote Sens., 9.","DOI":"10.3390\/rs9121312"},{"key":"ref_35","unstructured":"Fu, C.Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2022, May 12). DSSD: Deconvolutional Single Shot Detector. Available online: https:\/\/arxiv.org\/abs\/1701.06659."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18\u201323). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_37","unstructured":"Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). R-FCN: Object Detection via Region-based Fully Convolutional Networks. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_39","unstructured":"Arthur, D., and Vassilvitskii, S. (2007). K-Means++: The Advantages of Careful Seeding, Society for Industrial and Applied Mathematics."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Khalid, M., Baber, J., Kasi, M.K., Bakhtyar, M., Devi, V., and Sheikh, N. (2020, January 7\u20139). Empirical Evaluation of Activation Functions in Deep Convolution Neural Network for Facial Expression Recognition. Proceedings of the 43rd International Conference on Telecommunications and Signal Processing (TSP), Milan, Italy.","DOI":"10.1109\/TSP49548.2020.9163446"},{"key":"ref_41","unstructured":"Perez, L., and Wang, J. (2017). The Effectiveness of Data Augmentation in Image Classification using Deep Learning. arXiv."},{"key":"ref_42","unstructured":"Kingma, D.P., and Ba, J. (2015). A Method for Stochastic Optimization. arXiv."},{"key":"ref_43","unstructured":"Li, Z., and Arora, S. (2019). An Exponential Learning Rate Schedule for Deep Learning. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/4\/69\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:40:54Z","timestamp":1760139654000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/4\/69"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,30]]},"references-count":44,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["robotics11040069"],"URL":"https:\/\/doi.org\/10.3390\/robotics11040069","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,30]]}}}