{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T23:47:22Z","timestamp":1773964042501,"version":"3.50.1"},"reference-count":28,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T00:00:00Z","timestamp":1604016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003052","name":"Ministry of Trade, Industry and Energy","doi-asserted-by":"publisher","award":["N0002429"],"award-info":[{"award-number":["N0002429"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automatic robot gripper system which involves the automated object recognition of work-in-process in production line is the key technology of the upcoming manufacturing facility achieving Industry 4.0. Automatic robot gripper enables the manufacturing system to be autonomous, self-recognized, and adaptable by using artificial intelligence of robot programming dealing with arbitrary shapes of work-in-processes. This paper specifically explores the chain of key technologies, such as 3D object recognition with CAD and point cloud data, reinforcement learning of robot arm, and customized 3D printed gripper, in order to enhance the intelligence of the robot controller system. And it also proposes the integration with 3D point cloud based object recognition and game-engine based reinforcement learning. The result of the prototype of the intelligent robot gripping system developed by the proposed method with a 4 degree-of-freedom robot arm is explained in this paper.<\/jats:p>","DOI":"10.3390\/s20216183","type":"journal-article","created":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T09:29:32Z","timestamp":1604050172000},"page":"6183","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["GadgetArm\u2014Automatic Grasp Generation and Manipulation of 4-DOF Robot Arm for Arbitrary Objects Through Reinforcement Learning"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2422-9283","authenticated-orcid":false,"given":"JoungMin","family":"Park","sequence":"first","affiliation":[{"name":"Department of Industrial and Management Systems Engineering, Kyung Hee University, 1732 Deogyeong-daero, Yongin-si 17104, Korea"}]},{"given":"SangYoon","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Industrial and Management Systems Engineering, Kyung Hee University, 1732 Deogyeong-daero, Yongin-si 17104, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7892-9651","authenticated-orcid":false,"given":"JaeWoon","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Industrial and Management Systems Engineering, Kyung Hee University, 1732 Deogyeong-daero, Yongin-si 17104, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8040-6144","authenticated-orcid":false,"given":"Jumyung","family":"Um","sequence":"additional","affiliation":[{"name":"Department of Industrial and Management Systems Engineering, Kyung Hee University, 1732 Deogyeong-daero, Yongin-si 17104, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,30]]},"reference":[{"key":"ref_1","first-page":"62","article-title":"Mastering Mass customization\u2014A Concept for advanced, Human-centered assembly","volume":"11","author":"Gorecky","year":"2013","journal-title":"Acad. J. Manuf. Eng."},{"key":"ref_2","unstructured":"Bendiksen, A., and Hager, G. (1994, January 8\u201313). A vision-based grasping system for unfamiliar planar objects. Proceedings of the IEEE International Conference on Robotics and Automation, San Diego, CA, USA."},{"key":"ref_3","unstructured":"Perrin, D., Masoud, O., Smith, C.E., and Papanikolopoulos, N.P. (2000, January 24\u201328). Unknown object grasping using statistical pressure models. Proceedings of the ICRA. Millennium Conference, San Francisco, CA, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Speth, J., Morales, A., and Sanz, P.J. (2008, January 22\u201326). Vision-based grasp planning of 3D objects by extending 2D contour based algorithms. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Nice, France.","DOI":"10.1109\/IROS.2008.4650632"},{"key":"ref_5","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3d shapenets: A deep representation for volumetric shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_6","unstructured":"Maturana, D., and Scherer, S. (October, January 28). Voxnet: A 3d convolutional neural network for real-time object recognition. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany."},{"key":"ref_7","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, F., Liang, C., Ru, C., and Cheng, H. (2019). An Improved Point Cloud Descriptor for Vision Based Robotic Grasping System. Sensors, 19.","DOI":"10.3390\/s19102225"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ji, S.Q., Huang, M.B., and Huang, H.P. (2019). Robot intelligent grasp of unknown objects based on multi-sensor information. Sensors, 19.","DOI":"10.3390\/s19071595"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Erez, T., Tassa, Y., and Todorov, E. (2015, January 26\u201330). Simulation tools for model-based robotics: Comparison of bullet, havok, mujoco, ode and physx. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139807"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Johns, E., Leutenegger, S., and Davison, A.J. (2016, January 9\u201314). Deep learning a grasp function for grasping under gripper pose uncertainty. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejon, South Korea.","DOI":"10.1109\/IROS.2016.7759657"},{"key":"ref_12","unstructured":"Plappert, M., Andrychowicz, M., Ray, A., McGrew, B., Baker, B., Powell, G., Schneider, J., Tobin, J., Chociej, M., and Welinder, P. (2018). Multi-goal reinforcement learning: Challenging robotics environments and request for research. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, C., Zhang, Q., Tian, Q., Li, S., Wang, X., Lane, D., Petillot, Y., and Wang, S. (2020). Learning Mobile Manipulation through Deep Reinforcement Learning. Sensors, 20.","DOI":"10.3390\/s20030939"},{"key":"ref_14","unstructured":"Mousavian, A., Eppner, C., and Fox, D. (November, January 27). 6-dof graspnet: Variational grasp generation for object manipulation. Proceedings of the IEEE International Conference on Computer Vision, Seoul, South Korea."},{"key":"ref_15","unstructured":"Juliani, A., Berges, V.P., Vckay, E., Gao, Y., Henry, H., Mattar, M., and Lange, D. (2018). Unity: A general platform for intelligent agents. arXiv."},{"key":"ref_16","first-page":"255","article-title":"A review on importance of universal gripper in industrial robot applications","volume":"2","author":"Reddy","year":"2013","journal-title":"Int. J. Mech. Eng. Robot. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.rcim.2017.05.007","article-title":"A statistical review of industrial robotic grippers","volume":"49","author":"Birglen","year":"2018","journal-title":"Robot. -Comput.-Integr. Manuf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.rcim.2014.08.002","article-title":"Online robot calibration based on hybrid sensors using Kalman Filters","volume":"31","author":"Du","year":"2015","journal-title":"Robot. -Comput.-Integr. Manuf."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kraft, D., Ellekilde, L.-P., and J\u00f8rgensen, J.A. (2014). Automatic grasp generation and improvement for industrial bin-picking. Gearing Up and Accelerating Cross-fertilization between Academic and Industrial Robotics Research in Europe, Springer.","DOI":"10.1007\/978-3-319-02934-4_8"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1080\/0951192X.2015.1033753","article-title":"Process planning and offline programming for robotic remote laser welding systems","volume":"29","author":"Kardos","year":"2016","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Weigand, J., Volkmann, M., and Ruskowski, M. (2019). Neural Adaptive Control of a Robot Joint Using Secondary Encoders. International Conference on Robotics in Alpe-Adria Danube Region, Springer.","DOI":"10.1007\/978-3-030-19648-6_18"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Muthusamy, R., Huang, X., Zweiri, Y., Seneviratne, L., and Gan, D. (2020). Neuromorphic Event-Based Slip Detection and suppression in Robotic Grasping and Manipulation. arXiv.","DOI":"10.1109\/ACCESS.2020.3017738"},{"key":"ref_23","unstructured":"(2020, October 29). Unity-Technologies, ML-Agents Toolkit Overview, Github, 17 July, 2020. Available online: github.com\/Unity-Technologies\/ml-agents\/blob\/master\/docs\/ML-Agents-Overview.md."},{"key":"ref_24","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv."},{"key":"ref_25","first-page":"1889","article-title":"Trust region policy optimization","volume":"37","author":"Schulman","year":"2015","journal-title":"Int. Conf. Mach. Learn."},{"key":"ref_26","unstructured":"(2020, October 29). Francis Williams, point-cloud-utils, Github, 7 May, 2020. Available online: github.com\/fwilliams\/point-cloud-utils."},{"key":"ref_27","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv."},{"key":"ref_28","unstructured":"Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6183\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:26:53Z","timestamp":1760178413000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6183"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,30]]},"references-count":28,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20216183"],"URL":"https:\/\/doi.org\/10.3390\/s20216183","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,30]]}}}