{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T21:45:20Z","timestamp":1773265520408,"version":"3.50.1"},"reference-count":35,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,16]],"date-time":"2018-11-16T00:00:00Z","timestamp":1542326400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Inventec Co. Ltd., Taiwan (R.O.C)","award":["106A27017"],"award-info":[{"award-number":["106A27017"]}]},{"name":"Taiwan Building Technology Center","award":["107P011"],"award-info":[{"award-number":["107P011"]}]},{"name":"Center for Cyber-Physical System Innovation","award":["107P014"],"award-info":[{"award-number":["107P014"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automatic optical inspection (AOI) is a control process for precisely evaluating the completeness and quality of manufactured products with the help of visual information. Automatic optical inspection systems include cameras, light sources, and objects; AOI requires expert operators and time-consuming setup processes. In this study, a novel autonomous industrial robot-guided inspection system was hypothesized and developed to expedite and ease inspection process development. The developed platform is an intuitive and interactive system that does not require a physical object to test or an industrial robot; this allows nonexpert operators to perform object inspection planning by only using scanned data. The proposed system comprises an offline programming (OLP) platform and three-dimensional\/two-dimensional (3D\/2D) vision module. A robot program generated from the OLP platform is mapped to an industrial manipulator to scan a 3D point-cloud model of an object by using a laser triangulation sensor. After a reconstructed 3D model is aligned with a computer-aided design model on a common coordinate system, the OLP platform allows users to efficiently fine-tune the required inspection positions on the basis of the rendered images. The arranged inspection positions can be directed to an industrial manipulator on a production line to capture real images by using the corresponding 2D camera\/lens setup for AOI tasks. This innovative system can be implemented in smart factories, which are easily manageable from multiple locations. Workers can save scanned data when new inspection positions are included based on cloud data. The present system provides a new direction to cloud-based manufacturing industries and maximizes the flexibility and efficiency of the AOI setup process to increase productivity.<\/jats:p>","DOI":"10.3390\/s18114008","type":"journal-article","created":{"date-parts":[[2018,11,16]],"date-time":"2018-11-16T11:48:31Z","timestamp":1542368911000},"page":"4008","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Autonomous Robot-Guided Inspection System Based on Offline Programming and RGB-D Model"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3553-0824","authenticated-orcid":false,"given":"Amit Kumar","family":"Bedaka","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alaa M.","family":"Mahmoud","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shao-Chun","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chyi-Yeu","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan"},{"name":"Taiwan Building Technology Center, National Taiwan University of Science and Technology, Taipei 106, Taiwan"},{"name":"Center for Cyber-Physical System Innovation, National Taiwan University of Science and Technology, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"13927","DOI":"10.1364\/OE.26.013927","article-title":"Fast and cost-effective in-process defect inspection for printed electronics based on coherent optical processing","volume":"26","author":"Feng","year":"2018","journal-title":"Opt. Express"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chen, Y.T., Huang, Y.S., and Liu, C.S. (2016). An Optical Sensor for Measuring the Position and Slanting Direction of Flat Surfaces. Sensors, 16.","DOI":"10.3390\/s16071061"},{"key":"ref_3","first-page":"5","article-title":"Automation of manufacturing technologies with utilisation of industrial robots","volume":"11","year":"2015","journal-title":"Appl. Comput. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.rcim.2016.06.003","article-title":"IRoSim: Industrial Robotics Simulation Design Planning and Optimization platform based on CAD and knowledgeware technologies","volume":"42","author":"Baizid","year":"2016","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_5","first-page":"262","article-title":"Off-line programming of an industrial robot for manufacturing","volume":"26","author":"Mitsi","year":"2005","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_6","unstructured":"(2018, June 07). Most Advanced Robotics Simulation Software Overview. Available online: http:\/\/www.smashingrobotics.com\/most-advanced-and-used-robotics-simulation-software\/."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1108\/01439910210440237","article-title":"CAD-based automated robot trajectory planning for spray painting of free-form surfaces","volume":"29","author":"Chen","year":"2001","journal-title":"Ind. Robot Int. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1007\/s001700170145","article-title":"Generation and Simulation of Robot Trajectories in a Virtual CAD-Based Off-Line Programming Environment","volume":"17","author":"Zha","year":"2001","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1109\/3468.709600","article-title":"Obstacle Avoidance in a Dynamic Environment: A Collision Cone Approach","volume":"28","author":"Chakravarthy","year":"1998","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bedaka, A.K., and Lin, C.Y. (2017, January 6\u20138). Autonomous path generation platform for robot simulation. Proceedings of the 2017 International Conference on Advanced Robotics and Intelligent Systems (ARIS), Taipei, Taiwan.","DOI":"10.1109\/ARIS.2017.8297186"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.rcim.2011.08.004","article-title":"Recent progress on programming methods for industrial robots","volume":"28","author":"Pan","year":"2012","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_12","unstructured":"(2018, June 01). Open Cascade. Available online: http:\/\/www.opencascade.com\/."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1111\/j.1477-9730.2006.00383.x","article-title":"Image-based 3D modeling: A review","volume":"21","author":"Remondino","year":"2006","journal-title":"Photogramm. Rec."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MCG.2004.1318815","article-title":"Detailed 3D reconstruction of large-scale heritage sites with integrated techniques","volume":"24","author":"Beraldin","year":"2004","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_15","first-page":"2","article-title":"Review of image-based rendering techniques","volume":"4067","author":"Shum","year":"2000","journal-title":"Vis. Commun. Image Process. Int. Soc. Opt. Photonics"},{"key":"ref_16","first-page":"43","article-title":"Single view metrology","volume":"4067","author":"Criminisi","year":"1999","journal-title":"ICCV IEEE"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1007\/s10439-010-9901-0","article-title":"Image-based modeling of blood flow and vessel wall dynamics: Applications, methods and future directions","volume":"38","author":"Taylor","year":"2010","journal-title":"Ann. Biomed. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1917","DOI":"10.1109\/JSEN.2010.2101060","article-title":"Lock-in time-of-flight (ToF) cameras: A survey","volume":"11","author":"Foix","year":"2011","journal-title":"IEEE Sens. J."},{"key":"ref_19","unstructured":"Gokturk, S.B., Yalcin, H., and Bamji, C. (July, January 27). A time-of-flight depth sensor-system description, issues and solutions. Proceedings of the Computer Vision and Pattern Recognition Workshop 2004, Washington, DC, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1364\/AOP.3.000128","article-title":"Structured-light 3D surface imaging: A tutorial","volume":"3","author":"Geng","year":"2011","journal-title":"Adv. Opt. Photonics"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Song, L., Li, X., Yang, Y.G., Zhu, X., Guo, Q., and Liu, H. (2018). Structured-Light Based 3D Reconstruction System for Cultural Relic Packaging. Sensors, 18.","DOI":"10.3390\/s18092981"},{"key":"ref_22","unstructured":"Scharstein, D., and Szeliski, R. (2003, January 18\u201320). High-accuracy stereo depth maps using structured light. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_23","first-page":"46","article-title":"Laser Triangulation Sensors","volume":"28","author":"Wiese","year":"1989","journal-title":"Quality"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, X.Q., Wang, Z., and Fu, L.H. (2016). A laser-based measuring system for online quality control of car engine block. Sensors, 16.","DOI":"10.3390\/s16111877"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.promfg.2018.02.034","article-title":"Industry 4.0\u2014A Glimpse","volume":"20","author":"Vaidya","year":"2018","journal-title":"Procedia Manuf."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.mfglet.2014.12.001","article-title":"A cyber-physical systems architecture for industry 4.0-based manufacturing systems","volume":"3","author":"Lee","year":"2015","journal-title":"Manuf. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s12599-014-0334-4","article-title":"Industry 4.0","volume":"6","author":"Lasi","year":"2014","journal-title":"Bus. Inform. Syst. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1007\/BF03325096","article-title":"Agent-based systems for intelligent manufacturing: A state-of-the-art survey","volume":"1","author":"Shen","year":"1999","journal-title":"Knowl. Inf. Syst."},{"key":"ref_29","first-page":"53","article-title":"Three-Dimensional Measurements of Bodies in Motion Based on Multiple-Laser-Plane Triangulation","volume":"38","author":"Novak","year":"2015","journal-title":"Rev. T\u00e9c. Fac. Ing. Univ. Zulia"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/TPAMI.1982.4767309","article-title":"Automated visual inspection: A survey","volume":"6","author":"Chin","year":"1982","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bedaka, A.K., and Lin, C.Y. (2018). CAD-based robot path planning and simulation using OPEN CASCADE. Procedia Comput. Sci., 779\u2013785.","DOI":"10.1016\/j.procs.2018.07.119"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1016\/S0890-6955(02)00030-5","article-title":"Automated laser scanning system for reverse engineering and inspection","volume":"42","author":"Son","year":"2002","journal-title":"Int. J. Mach. Tools Manuf."},{"key":"ref_33","unstructured":"Hansen, C.D., and Johnson, C.R. (2011). Visualization Handbook, Elsevier."},{"key":"ref_34","unstructured":"Ning, P., and Hesselink, L. (1993, January 25\u201329). Fast volume rendering of compressed data. Proceedings of the IEEE Conference on Visualization\u201993, San Jose, CA, USA."},{"key":"ref_35","unstructured":"Leigh, J., Rajlich, P.J., Stein, R.J., Johnson, A.E., and DeFanti, T.A. (1998, January 18\u201323). LIMBO\/VTK: A tool for rapid tele-immersive visualization. Proceedings of the IEEE Visualizaton\u201998, Vancouver, BC, Canada."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/4008\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:30:17Z","timestamp":1760196617000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/4008"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,16]]},"references-count":35,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["s18114008"],"URL":"https:\/\/doi.org\/10.3390\/s18114008","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,16]]}}}