{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,4]],"date-time":"2025-09-04T13:32:38Z","timestamp":1756992758110,"version":"3.41.2"},"reference-count":26,"publisher":"ASME International","issue":"3","license":[{"start":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T00:00:00Z","timestamp":1696896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Accurate registration of Cartesian coordinate systems is necessary to facilitate metrology-based solutions for industrial robots in production environments. Conducting coordinate registration between industrial robots and their metrological systems requires measuring multiple points in the robot\u2019s and sensor system\u2019s coordinate frames. However, operators lack intuitive tools to interface, visualize, and characterize the quality of the selected points in the robot workspace for robot\u2013sensor coordinate registration. This article proposes an augmented reality system for human-in-the-loop, robot\u2013sensor coordinate registration to efficiently record and visualize the pose-dependent quality of computing the robot\u2013sensor transformation. Furthermore, this work establishes metrics to define the relative quality of measurement points used in robot\u2013sensor coordinate registration, which is shown by the augmented reality application. Experiments were conducted demonstrating the augmented reality environment in addition to investigating the pose dependency of the measurement point quality. The results indicate that the proposed metrics highlight the dependency of the poses on both robot and sensor placement and that the augmented reality system can provide a human-in-the-loop interface for robot\u2013sensor coordinate registration.<\/jats:p>","DOI":"10.1115\/1.4063131","type":"journal-article","created":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T03:02:58Z","timestamp":1691463778000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":1,"title":["Augmented Reality Interface for Robot-Sensor Coordinate Registration"],"prefix":"10.1115","volume":"24","author":[{"given":"Vinh","family":"Nguyen","sequence":"first","affiliation":[{"name":"Michigan Technological University Department of Mechanical Engineering-Engineering Mechanics, , Houghton, MI 49931"}]},{"given":"Xiaofeng","family":"Liu","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology School of Civil and Environmental Engineering, , Atlanta, GA 30332"}]},{"given":"Jeremy","family":"Marvel","sequence":"additional","affiliation":[{"name":"National Institute of Standards and Technology , Gaithersburg, MD 20899"}]}],"member":"33","published-online":{"date-parts":[[2023,10,10]]},"reference":[{"issue":"16","key":"2023101011135750100_CIT0001","doi-asserted-by":"crossref","first-page":"4354","DOI":"10.3390\/s20164354","article-title":"Absolute Positioning Accuracy Improvement in an Industrial Robot","volume":"20","author":"Jiang","year":"2020","journal-title":"Sensors"},{"key":"2023101011135750100_CIT0002","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1007\/s00170-019-03403-z","article-title":"Industrial Robotic Machining: A Review","volume":"103","author":"Ji","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"issue":"1","key":"2023101011135750100_CIT0003","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3150225","article-title":"Multi-Robot Assembly Strategies and Metrics","volume":"51","author":"Marvel","year":"2018","journal-title":"ACM Comput. Surv."},{"key":"2023101011135750100_CIT0004","article-title":"Tools for Robotics in SME Workcells: Challenges and Approaches for Calibration and Registration","author":"Marvel","year":"2015","journal-title":"NIST Internal Report"},{"issue":"1","key":"2023101011135750100_CIT0005","doi-asserted-by":"crossref","first-page":"87","DOI":"10.4271\/01-15-01-0006","article-title":"Precision Robotic Milling of Fiberglass Shims in Aircraft Wing Assembly Using Laser Tracker Feedback","volume":"15","author":"Nguyen","year":"2021","journal-title":"SAE Int. J. Aerosp."},{"key":"2023101011135750100_CIT0006","first-page":"472","article-title":"Calibration of a Multi-Sensor System Laser Rangefinder\/Camera","author":"Wasielewski","year":"1995"},{"key":"2023101011135750100_CIT0007","doi-asserted-by":"crossref","first-page":"102082","DOI":"10.1016\/j.rcim.2020.102082","article-title":"Dual-Edge Robotic Gear Chamfering With Registration Error Compensation","volume":"69","author":"Hu","year":"2021","journal-title":"Rob. Comput. Integr. Manuf."},{"key":"2023101011135750100_CIT0008","doi-asserted-by":"crossref","first-page":"4319","DOI":"10.4028\/www.scientific.net\/AMR.97-101.4319","article-title":"Calibration and Registration for Inspection Robot With Contact Probe","volume":"97\u2013101","author":"Chen","year":"2010","journal-title":"Adv. Mater. Res."},{"issue":"6","key":"2023101011135750100_CIT0009","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1016\/S0736-5845(01)00024-2","article-title":"Robot Calibration Using a 3D Vision-Based Measurement System With a Single Camera","volume":"17","author":"Motta","year":"2001","journal-title":"Rob. Comput. Integr. Manuf."},{"issue":"4","key":"2023101011135750100_CIT0010","doi-asserted-by":"crossref","first-page":"2154","DOI":"10.1109\/TASE.2020.2986503","article-title":"Camera-Robot Calibration for the da Vinci Robotic Surgery System","volume":"17","author":"\u00d6zg\u00fcner","year":"2020","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"2023101011135750100_CIT0011","first-page":"89","article-title":"A Marker Calibration Method Utilizing a Priori Knowledge on Marker Arrangement","author":"Kotake","year":"2004"},{"key":"2023101011135750100_CIT0012","doi-asserted-by":"crossref","first-page":"101992","DOI":"10.1016\/j.rcim.2020.101992","article-title":"Pose Optimization in Robotic Machining Using Static and Dynamic Stiffness Models","volume":"66","author":"Cvitanic","year":"2020","journal-title":"Rob. Comput. Integr. Manuf."},{"issue":"1","key":"2023101011135750100_CIT0013","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1109\/TASE.2017.2720478","article-title":"Strategies for Improving and Evaluating Robot Registration Performance","volume":"15","author":"van Wyk","year":"2017","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"2023101011135750100_CIT0014","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.jmapro.2017.06.010","article-title":"CCT-Based Mode Coupling Chatter Avoidance in Robotic Milling","volume":"29","author":"Cen","year":"2017","journal-title":"J. Manuf. Processes"},{"issue":"4","key":"2023101011135750100_CIT0015","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A Survey of Augmented Reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Pres. Teleop. Virt. Environ."},{"key":"2023101011135750100_CIT0016","doi-asserted-by":"crossref","first-page":"102321","DOI":"10.1016\/j.rcim.2022.102321","article-title":"AR-Assisted Digital Twin-Enabled Robot Collaborative Manufacturing System With Human-in-the-Loop","volume":"76","author":"Li","year":"2022","journal-title":"Rob. Comput. Integr. Manuf."},{"key":"2023101011135750100_CIT0017","first-page":"515","article-title":"Augmented Reality Interfaces for Additive Manufacturing","author":"Eiriksson","year":"2017"},{"key":"2023101011135750100_CIT0018","first-page":"934","article-title":"Augmented Reality Visualization for Laparoscopic Surgery","author":"Fuchs","year":"1998"},{"key":"2023101011135750100_CIT0019","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/s00779-008-0204-5","article-title":"Handheld Augmented Reality for Underground Infrastructure Visualization","volume":"13","author":"Schall","year":"2009","journal-title":"Pers. Ubiquitous Comput."},{"key":"2023101011135750100_CIT0020","first-page":"56","article-title":"Simplified Framework for Robot Coordinate Registration for Manufacturing Applications","author":"Marvel","year":"2016"},{"key":"2023101011135750100_CIT0021","doi-asserted-by":"crossref","first-page":"2396","DOI":"10.1007\/s11431-014-5694-y","article-title":"Tracking With Nonlinear Measurement Model by Coordinate Rotation Transformation","volume":"57","author":"Zeng","year":"2014","journal-title":"Sci. China: Technol. Sci."},{"article-title":"Technical Specifications UR10","year":"2022","author":"Universal Robots","key":"2023101011135750100_CIT0022"},{"year":"2022","author":"OptiTrack","key":"2023101011135750100_CIT0023"},{"key":"2023101011135750100_CIT0024","first-page":"59","article-title":"A Feature-Based Tracking Algorithm for Vehicles in Intersections","author":"Saunier","year":"2006"},{"key":"2023101011135750100_CIT0025","doi-asserted-by":"crossref","DOI":"10.1115\/MSEC2022-83907","article-title":"Evaluation of Data-Driven Models in Human-Robot Load-Sharing","author":"Nguyen","year":"2022"},{"key":"2023101011135750100_CIT0026","doi-asserted-by":"crossref","first-page":"1906","DOI":"10.1016\/j.proeng.2014.12.344","article-title":"Vision Assisted Robotic Deburring of Edge Burrs in Cast Parts","volume":"97","author":"Princely","year":"2014","journal-title":"Procedia Eng."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/24\/3\/034501\/7050086\/jcise_24_3_034501.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/24\/3\/034501\/7050086\/jcise_24_3_034501.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T11:15:07Z","timestamp":1696936507000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/24\/3\/034501\/1166204\/Augmented-Reality-Interface-for-Robot-Sensor"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,10]]},"references-count":26,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4063131","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2023,10,10]]},"article-number":"034501"}}