{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T18:36:42Z","timestamp":1770143802675,"version":"3.49.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T00:00:00Z","timestamp":1590019200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T00:00:00Z","timestamp":1590019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We adopted a vision-based tracking system for augmented reality (AR), and evaluated whether it helped surgeons to localize the recurrent laryngeal nerve (RLN) during robotic thyroid surgery. We constructed an AR image of the trachea, common carotid artery, and RLN using CT images. During surgery, an AR image of the trachea and common carotid artery were overlaid on the physical structures after they were exposed. The vision-based tracking system was activated so that the AR image of the RLN followed the camera movement. After identifying the RLN, the distance between the AR image of the RLN and the actual RLN was measured. Eleven RLNs (9 right, 4 left) were tested. The mean distance between the RLN AR image and the actual RLN was 1.9\u2009\u00b1\u20091.5\u2009mm (range 0.5 to 3.7). RLN localization using AR and vision-based tracking system was successfully applied during robotic thyroidectomy. There were no cases of RLN palsy. This technique may allow surgeons to identify hidden anatomical structures during robotic surgery.<\/jats:p>","DOI":"10.1038\/s41598-020-65439-6","type":"journal-article","created":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T10:03:14Z","timestamp":1590055394000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Vision-based tracking system for augmented reality to localize recurrent laryngeal nerve during robotic thyroid surgery"],"prefix":"10.1038","volume":"10","author":[{"given":"Dongheon","family":"Lee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyeong Won","family":"Yu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seunglee","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Yoon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keunchul","family":"Lee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Young Jun","family":"Chai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"June Young","family":"Choi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyoun-Joong","family":"Kong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kyu Eun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hwan Seong","family":"Cho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hee Chan","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,5,21]]},"reference":[{"key":"65439_CR1","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1089\/thy.2015.0407","volume":"26","author":"E Berber","year":"2016","unstructured":"Berber, E. et al. American Thyroid Association Statement on Remote Access Thyroid Surgery. Thyroid 26, 331\u2013337 (2016).","journal-title":"Thyroid"},{"key":"65439_CR2","doi-asserted-by":"publisher","first-page":"e1","DOI":"10.1016\/j.jamcollsurg.2009.05.003","volume":"209","author":"SW Kang","year":"2009","unstructured":"Kang, S. W. et al. Robot-Assisted Endoscopic Thyroidectomy for Thyroid Malignancies Using a Gasless Transaxillary Approach. J. Am. Coll. Surg. 209, e1\u2013e7 (2009).","journal-title":"J. Am. Coll. Surg."},{"key":"65439_CR3","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1016\/j.jviscsurg.2013.04.003","volume":"150","author":"N Christou","year":"2013","unstructured":"Christou, N. & Mathonnet, M. Complications after total thyroidectomy. J. Visc. Surg. 150, 249\u2013256 (2013).","journal-title":"J. Visc. Surg."},{"key":"65439_CR4","doi-asserted-by":"publisher","first-page":"239","DOI":"10.4174\/astr.2016.90.5.239","volume":"90","author":"YoungJun Chai","year":"2016","unstructured":"Chai, YoungJun et al. A comparative study of postoperative pain for open thyroidectomy versus bilateral axillo-breast approach robotic thyroidectomy using a self-reporting application for iPad. Ann. surgical Treat. Res. 90, 239\u2013245 (2016).","journal-title":"Ann. surgical Treat. Res."},{"key":"65439_CR5","doi-asserted-by":"publisher","first-page":"297","DOI":"10.4174\/astr.2018.95.6.297","volume":"95","author":"D Lee","year":"2018","unstructured":"Lee, D. et al. Preliminary study on application of augmented reality visualization in robotic thyroid surgery. Ann. Surg. Treat. Res. 95, 297\u2013302 (2018).","journal-title":"Ann. Surg. Treat. Res."},{"key":"65439_CR6","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1001\/archsurg.139.2.170","volume":"139","author":"JH Shuhaiber","year":"2004","unstructured":"Shuhaiber, J. H. Augmented Reality in Surgery. Arch. Surg. 139, 170\u2013174 (2004).","journal-title":"Arch. Surg."},{"key":"65439_CR7","doi-asserted-by":"publisher","first-page":"e55","DOI":"10.1016\/j.jamcollsurg.2014.12.053","volume":"220","author":"J Hallet","year":"2015","unstructured":"Hallet, J. et al. Trans-thoracic minimally invasive liver resection guided by augmented reality. J. Am. Coll. Surg. 220, e55\u2013e60 (2015).","journal-title":"J. Am. Coll. Surg."},{"key":"65439_CR8","doi-asserted-by":"crossref","unstructured":"Caudell, T. P. & Mizell, D. W. Augmented reality: an application of heads-up display technology to manual manufacturing processes. Proc Twenty-Fifth Hawaii Int Conf Syst Sci (7\u201310 Jan 1992, Kauai, HI, USA, USA). (1992)","DOI":"10.1109\/HICSS.1992.183317"},{"key":"65439_CR9","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","volume":"6","author":"RT Azuma","year":"1997","unstructured":"Azuma, R. T. A survey of augmented reality. Presence: Teleoperators Virtual Environ. 6, 355\u2013385 (1997).","journal-title":"Presence: Teleoperators Virtual Environ."},{"key":"65439_CR10","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1001\/jamasurg.2013.739","volume":"148","author":"J D\u2019Agostino","year":"2013","unstructured":"D\u2019Agostino, J. et al. Virtual neck exploration for parathyroid adenomas: A first step toward minimally invasive image-guided surgery. JAMA Surg. 148, 232\u2013238 (2013).","journal-title":"JAMA Surg."},{"key":"65439_CR11","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1007\/s00268-015-3229-8","volume":"40","author":"D Ntourakis","year":"2016","unstructured":"Ntourakis, D. et al. Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience. World J. Surg. 40, 419\u2013426 (2016).","journal-title":"World J. Surg."},{"key":"65439_CR12","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1093\/ons\/opx279","volume":"15","author":"K Maruyama","year":"2018","unstructured":"Maruyama, K. et al. Smart Glasses for Neurosurgical Navigation by Augmented Reality. Oper. Neurosurg. 15, 551\u2013556 (2018).","journal-title":"Oper. Neurosurg."},{"key":"65439_CR13","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/s10151-018-1914-y","volume":"23","author":"S Atallah","year":"2019","unstructured":"Atallah, S. et al. Robotic-assisted stereotactic real-time navigation: initial clinical experience and feasibility for rectal cancer surgery. Tech. Coloproctol. 23, 53\u201363 (2019).","journal-title":"Tech. Coloproctol."},{"key":"65439_CR14","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1097\/DCR.0000000000001259","volume":"62","author":"JM Kwak","year":"2019","unstructured":"Kwak, J. M. et al. Stereotactic Pelvic Navigation with Augmented Reality for Transanal Total Mesorectal Excision. Dis. Colon. Rectum 62, 123\u2013129 (2019).","journal-title":"Dis. Colon. Rectum"},{"key":"65439_CR15","doi-asserted-by":"crossref","unstructured":"Reitmayr, G. et al. Simultaneous localization and mapping for augmented reality. Proc - 2010 Int Symp Ubiquitous Virtual Reality, ISUVR 2010. 5\u20138 (2010).","DOI":"10.1109\/ISUVR.2010.12"},{"key":"65439_CR16","doi-asserted-by":"crossref","unstructured":"Liu, H., Zhang, G. & Bao, H. Robust Keyframe-Based Monocular SLAM for Augmented Reality. Adjun Proc 2016 IEEE Int Symp Mix Augment Reality, ISMAR-Adjunct 2016. 340\u2013341 (2017).","DOI":"10.1109\/ISMAR-Adjunct.2016.0111"},{"key":"65439_CR17","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1109\/MRA.2006.1678144","volume":"13","author":"T Bailey","year":"2016","unstructured":"Bailey, T. & Durrant-Whyte, H. Simultaneous localization and mapping (SLAM): Part II. IEEE Robot. Autom. Mag. 13, 108\u2013117 (2016).","journal-title":"IEEE Robot. Autom. Mag."},{"key":"65439_CR18","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1177\/0278364907081229","volume":"26","author":"CC Wang","year":"2007","unstructured":"Wang, C. C. et al. Simultaneous localization, mapping and moving object tracking. Int. J. Rob. Res. 26, 889\u2013916 (2007).","journal-title":"Int. J. Rob. Res."},{"key":"65439_CR19","doi-asserted-by":"publisher","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","volume":"32","author":"C Cadena","year":"2016","unstructured":"Cadena, C. et al. Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Trans. Robot. 32, 1309\u20131332 (2016).","journal-title":"IEEE Trans. Robot."},{"key":"65439_CR20","doi-asserted-by":"publisher","first-page":"854","DOI":"10.1002\/rob.20412","volume":"28","author":"S Weiss","year":"2011","unstructured":"Weiss, S., Scaramuzza, D. & Siegwart, R. Monocular-SLAM-based navigation for autonomous micro helicopters in GPS-denied environments. J. F. Robot. 28, 854\u2013874 (2011).","journal-title":"J. F. Robot."},{"key":"65439_CR21","doi-asserted-by":"crossref","unstructured":"Thrun, S. & Liu, Y. Multi-robot SLAM with sparse extended information filers. Robot Res Elev Int Symp Springer, Berlin, Heidelb. (2005)","DOI":"10.1007\/11008941_27"},{"key":"65439_CR22","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","volume":"33","author":"R Mur-Artal","year":"2017","unstructured":"Mur-Artal, R. & Tardos, J. D. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras. IEEE Trans. Robot. 33, 1255\u20131262 (2017).","journal-title":"IEEE Trans. Robot."},{"key":"65439_CR23","doi-asserted-by":"crossref","unstructured":"Klein, G., Murray, D. Parallel Tracking and Mapping for Small AR Workspaces. Proc 2007 6th IEEE ACM Int Symp Mix Augment Reality IEEE Comput Soc. (2007).","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"65439_CR24","first-page":"163","volume":"5","author":"EL William","year":"1987","unstructured":"William, E. L. & Harvery, E. C. Marching cubes: A high resolution 3D surface construction algorithm. Comput. Graph. 5, 163\u2013169 (1987).","journal-title":"Comput. Graph."},{"key":"65439_CR25","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","volume":"31","author":"R Mur-Artal","year":"2015","unstructured":"Mur-Artal, R., Martinez, J. M. M. & Tardos, J. D. ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans. Robot. 31, 1147\u20131163 (2015).","journal-title":"IEEE Trans. Robot."},{"key":"65439_CR26","doi-asserted-by":"crossref","unstructured":"Forster, C., Pizzoli, M. & Scaramuzza, D. SVO: Fast semi-direct monocular visual odometry. IEEE international conference on robotics and automation (ICRA). IEEE, 2014. (2014).","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"65439_CR27","doi-asserted-by":"crossref","unstructured":"Wagner, D. et al. Pose tracking from natural features on mobile phones. 7th IEEE\/ACM International Symposium on Mixed and Augmented Reality. IEEE, 2008. (2008).","DOI":"10.1109\/ISMAR.2008.4637338"},{"key":"65439_CR28","doi-asserted-by":"crossref","unstructured":"Klein, G. & Murray, D. Parallel tracking and mapping on a camera phone. 8th IEEE International Symposium on Mixed and Augmented Reality. IEEE, 2009. (2009).","DOI":"10.1109\/ISMAR.2009.5336495"},{"key":"65439_CR29","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1002\/cav.431","volume":"22","author":"K Cho","year":"2011","unstructured":"Cho, K. et al. Real\u2010time recognition and tracking for augmented reality books. Computer Animat. Virtual Worlds 22, 529\u2013541 (2011).","journal-title":"Computer Animat. Virtual Worlds"},{"key":"65439_CR30","unstructured":"Benhimane, S. & Malis, E. Real-time image-based tracking of planes using Efficient Second-order Minimization. IEEE international conference on Intelligent Robots and Systems, (2004)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-65439-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-65439-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-65439-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T11:34:31Z","timestamp":1670326471000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-65439-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,21]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["65439"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-65439-6","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,21]]},"assertion":[{"value":"27 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8437"}}