{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T17:40:59Z","timestamp":1782322859168,"version":"3.54.5"},"reference-count":29,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,5,22]],"date-time":"2022-05-22T00:00:00Z","timestamp":1653177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology of Taiwan","doi-asserted-by":"publisher","award":["MOST 110-2221-E-224-049"],"award-info":[{"award-number":["MOST 110-2221-E-224-049"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology of Taiwan","doi-asserted-by":"publisher","award":["MOST 110-2622-E224-013"],"award-info":[{"award-number":["MOST 110-2622-E224-013"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automated inspection has proven to be the most effective approach to maintaining quality in industrial-scale manufacturing. This study employed the eye-in-hand architecture in conjunction with deep learning and convolutional neural networks to automate the detection of defects in forged aluminum rims for electric vehicles. RobotStudio software was used to simulate the environment and path trajectory for a camera installed on an ABB robot arm to capture 3D images of the rims. Four types of surface defects were examined: (1) dirt spots, (2) paint stains, (3) scratches, and (4) dents. Generative adversarial network (GAN) and deep convolutional generative adversarial networks (DCGAN) were used to generate additional images to expand the depth of the training dataset. We also developed a graphical user interface and software system to mark patterns associated with defects in the images. The defect detection algorithm based on YOLO algorithms made it possible to obtain results more quickly and with higher mean average precision (mAP) than that of existing methods. Experiment results demonstrated the accuracy and efficiency of the proposed system. Our developed system has been shown to be a helpful rim defective detection system for industrial applications.<\/jats:p>","DOI":"10.3390\/s22103927","type":"journal-article","created":{"date-parts":[[2022,5,22]],"date-time":"2022-05-22T07:13:57Z","timestamp":1653203637000},"page":"3927","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application"],"prefix":"10.3390","volume":"22","author":[{"given":"Wei-Lung","family":"Mao","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin 640301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-Ying","family":"Chiu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin 640301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing-Hong","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin 640301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chun-Chi","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin 640301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi-Ting","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin 640301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cheng-Yu","family":"You","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin 640301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3013-0290","authenticated-orcid":false,"given":"Ying-Ren","family":"Chien","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Ilan University, Yilan 260007, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,22]]},"reference":[{"key":"ref_1","first-page":"428","article-title":"A review of methods for automated recognition of casting defects","volume":"44","author":"Mery","year":"2002","journal-title":"Insight-Wigston Northamp."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, J., Guo, Z., Jiao, T., and Wang, M. (2018). Defect detection of aluminum alloy wheels in radiography images using adaptive threshold and morphological reconstruction. Appl. Sci., 12.","DOI":"10.3390\/app8122365"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3256","DOI":"10.3934\/math.2020209","article-title":"Mathematical morphology approach to internal defect analysis of a356 aluminum alloy wheel hubs","volume":"5","author":"Zhang","year":"2020","journal-title":"Aims Math."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lee, K.-H., Kim, H.-S., Lee, S.-J., and Choo, S.-W. (2018, January 24\u201327). High precision hand-eye self-calibration for industrial robots. Proceedings of the 2018 International Conference on Electronics, Information, and Communication (ICEIC), Honolulu, HI, USA.","DOI":"10.23919\/ELINFOCOM.2018.8330661"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bae, S.-H., Kim, E.-J., Yang, S.-J., Park, J.-K., and Kuc, T.-Y. (2018, January 24\u201327). A dynamic visual servoing of robot manipulator with eye-in-hand camera. Proceedings of the 2018 International Conference on Electronics, Information, and Communication (ICEIC), Honolulu, HI, USA.","DOI":"10.23919\/ELINFOCOM.2018.8330640"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Han, K., Sun, M., Zhou, X., Zhang, G., Dang, H., and Liu, Z. (2017, January 6\u20139). A new method in wheel hub surface defect detection: Object detection algorithm based on deep learning. Proceedings of the 2017 International Conference on Advanced Mechatronic Systems (ICAMechS), Xiamen, China.","DOI":"10.1109\/ICAMechS.2017.8316494"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sun, X., Gu, J., Huang, R., Zou, R., and Palomares, B.G. (2019). Surface defects recognition of wheel hub based on improved faster R-CNN. Electronics, 8.","DOI":"10.3390\/electronics8050481"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Degadwala, S., Vyas, D., Chakraborty, U., Dider, A.R., and Biswas, H. (2021, January 25\u201327). Yolo-v4 deep learning model for medical face mask detection. Proceedings of the 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), Coimbatore, India.","DOI":"10.1109\/ICAIS50930.2021.9395857"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chen, X., An, Z., Huang, L., He, S., Zhang, X., and Lin, S. (2020, January 25\u201327). Surface defect detection of electric power equipment in substation based on improved YOLO v4 algorithm. Proceedings of the 2020 10th International Conference on Power and Energy Systems (ICPES), Chengdu, China.","DOI":"10.1109\/ICPES51309.2020.9349721"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jiang, S., Zhu, M., He, Y., Zheng, Z., Zhou, F., and Zhou, G. (October, January 26). Ship detection with sar based on YOLO. Proceedings of the IGARSS 2020\u20132020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9324538"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"97228","DOI":"10.1109\/ACCESS.2021.3094201","article-title":"Yolo v4 for advanced traffic sign recognition with synthetic training data generated by various GAN","volume":"9","author":"Dewi","year":"2021","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sabir, S., Rosato, D., Hartmann, S., and G\u00fchmann, C. (2021, January 10\u201315). Signal generation using 1d deep convolutional generative adversarial networks for fault diagnosis of electrical machines. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9413119"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lorencin, L., \u0160egota, S.B., An\u0111eli\u0107, N., Mrzljak, V., \u0106abov, T., \u0160panjol, J., and Car, Z. (2021). On urinary bladder cancer diagnosis: Utilization of deep convolutional generative adversarial networks for data augmentation. Biology, 10.","DOI":"10.3390\/biology10030175"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Venu, S.K., and Ravula, S. (2021). Evaluation of deep convolutional generative adversarial networks for data augmentation of chest X-ray images. Future Internet, 13.","DOI":"10.3390\/fi13010008"},{"key":"ref_15","unstructured":"Goodfellow, L., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial network. Machine Learning. arXiv."},{"key":"ref_16","unstructured":"Bau, D., Zhu, J.-Y., Strobelt, H., Zhou, B., Tenenbaum, J.B., Freeman, W.T., and Torralba, A. (2018). GAN dissection: Visuzlizing and understanding generative adversarial networks. Computer Vision and Pattern Recognition. arXiv."},{"key":"ref_17","unstructured":"Radford, A., Metz, L., and Chintala, S. (2016). Unsupervised representation learning with deep convolutional generative adversarial networks. Machine Learning. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep residual learning for image recognition. Computer Vision and Pattern Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhao, L., and Li, S. (2020). Object detection algorithm based on improved YOLOv3. Electronics, 9.","DOI":"10.3390\/electronics9030537"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2016). Feature pyramid networks for object detection. Computer Vision and Pattern Recognition. arXiv.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_22","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. Computer Vision and Pattern Recognition. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Mark Liao, H.-Y., Yeh, I.-H., Wu, Y.-H., Chen, P.-Y., and Hsieh, J.-W. (2019). CSPNet: A new backbone that can enhance learning capability of CNN. Computer Vision and Pattern Recognition. arXiv.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Spatial pyramid pooling in deep convolutional networks for visual recognition. Machine Learning. arXiv.","DOI":"10.1109\/TPAMI.2015.2389824"},{"key":"ref_25","unstructured":"Lin, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018). Path aggregation network for instance segmentation. Computer Vision and Pattern Recognition. arXiv."},{"key":"ref_26","unstructured":"Misra, D. (2019). Mish: A self regularized non-monotonic activation function. Machine Learning. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yun, S., Han, D., Oh, S.J., Chun, S., Choe, J., and Yoo, Y. (2019). CutMix: Regularization strategy to train strong classifiers with localizable features. Computer Vision and Pattern Recognition. arXiv.","DOI":"10.1109\/ICCV.2019.00612"},{"key":"ref_28","unstructured":"Ghiasi, G., Lin, T.-Y., and Le, Q.Y. (2018). DropBlock: A regularization method for convolutional networks. Computer Vision and Pattern Recognition. arXiv."},{"key":"ref_29","unstructured":"M\u00fcller, R., Kornblith, S., and Hinton, G. (2019). When does label smoothing help. Machine Learning. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/10\/3927\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:16:31Z","timestamp":1760138191000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/10\/3927"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,22]]},"references-count":29,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["s22103927"],"URL":"https:\/\/doi.org\/10.3390\/s22103927","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,22]]}}}