{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T17:48:44Z","timestamp":1770745724420,"version":"3.49.0"},"reference-count":52,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"NIH National Cancer Institute","doi-asserted-by":"publisher","award":["R01-CA151433"],"award-info":[{"award-number":["R01-CA151433"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The state-of-the-art procedure for examining the lymph nodes in a lung cancer patient involves using an endobronchial ultrasound (EBUS) bronchoscope. The EBUS bronchoscope integrates two modalities into one device: (1) videobronchoscopy, which gives video images of the airway walls; and (2) convex-probe EBUS, which gives 2D fan-shaped views of extraluminal structures situated outside the airways. During the procedure, the physician first employs videobronchoscopy to navigate the device through the airways. Next, upon reaching a given node\u2019s approximate vicinity, the physician probes the airway walls using EBUS to localize the node. Due to the fact that lymph nodes lie beyond the airways, EBUS is essential for confirming a node\u2019s location. Unfortunately, it is well-documented that EBUS is difficult to use. In addition, while new image-guided bronchoscopy systems provide effective guidance for videobronchoscopic navigation, they offer no assistance for guiding EBUS localization. We propose a method for registering a patient\u2019s chest CT scan to live surgical EBUS views, thereby facilitating accurate image-guided EBUS bronchoscopy. The method entails an optimization process that registers CT-based virtual EBUS views to live EBUS probe views. Results using lung cancer patient data show that the method correctly registered 28\/28 (100%) lymph nodes scanned by EBUS, with a mean registration time of 3.4 s. In addition, the mean position and direction errors of registered sites were 2.2 mm and 11.8\u2218, respectively. In addition, sensitivity studies show the method\u2019s robustness to parameter variations. Lastly, we demonstrate the method\u2019s use in an image-guided system designed for guiding both phases of EBUS bronchoscopy.<\/jats:p>","DOI":"10.3390\/jimaging8070189","type":"journal-article","created":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T11:37:08Z","timestamp":1657280228000},"page":"189","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Multimodal Registration for Image-Guided EBUS Bronchoscopy"],"prefix":"10.3390","volume":"8","author":[{"given":"Xiaonan","family":"Zang","sequence":"first","affiliation":[{"name":"School of Electrical Engineering and Computer Science, Penn State University, State College, PA 16802, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3153-5134","authenticated-orcid":false,"given":"Wennan","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, Penn State University, State College, PA 16802, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jennifer","family":"Toth","sequence":"additional","affiliation":[{"name":"Penn State Milton S. Hershey Medical Center, Hershey, PA 17033, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca","family":"Bascom","sequence":"additional","affiliation":[{"name":"Penn State Milton S. Hershey Medical Center, Hershey, PA 17033, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4781-9374","authenticated-orcid":false,"given":"William","family":"Higgins","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, Penn State University, State College, PA 16802, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1016\/j.chest.2019.10.013","article-title":"State of the Art: Interventional Pulmonology","volume":"157","author":"Wahidi","year":"2020","journal-title":"Chest"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1085","DOI":"10.21037\/jtd.2019.10.76","article-title":"Convex probe endobronchial ultrasound: Historical, contemporary, and cutting-edge applications","volume":"12","author":"Avasarala","year":"2020","journal-title":"J. Thorac. Disease"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1378\/chest.06-1735","article-title":"Endobronchial Ultrasound","volume":"133","author":"Sheski","year":"2008","journal-title":"Chest"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1164\/rccm.201311-2007CI","article-title":"Endobronchial Ultrasound\u2013guided Transbronchial Needle Aspiration for Non\u2013Small Cell Lung Cancer Staging","volume":"189","author":"Kinsey","year":"2014","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1378\/chest.11-1986","article-title":"The endobronchial ultrasound-guided transbronchial needle biopsy learning curve for mediastinal and hilar lymph node diagnosis","volume":"141","year":"2012","journal-title":"Chest"},{"key":"ref_6","unstructured":"Ernst, A., and Herth, F.J. (2009). Endobronchial Ultrasound: An Atlas and Practical Guide, Springer Science & Business Media."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1164\/rccm.201111-1968OC","article-title":"Endobronchial ultrasound skills and tasks assessment tool","volume":"186","author":"Davoudi","year":"2012","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1378\/chest.12-2462","article-title":"Point: Are > 50 supervised procedures required to develop competency in performing endobronchial ultrasound-guided transbronchial needle aspiration for mediastinal staging? Yes","volume":"143","author":"Folch","year":"2013","journal-title":"Chest"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1097\/LBR.0000000000000064","article-title":"Navigated bronchoscopy: A technical review","volume":"21","author":"Reynisson","year":"2014","journal-title":"J. Bronchol. Interv. Pulmonol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1164\/rccm.201907-1292SO","article-title":"Interventional Bronchoscopy: State-of-the-Art Review","volume":"202","author":"Criner","year":"2020","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1378\/chest.109.2.549","article-title":"Virtual bronchoscopy: Relationships of virtual reality endobronchial simulations to actual bronchoscopic findings","volume":"109","author":"Vining","year":"1996","journal-title":"Chest"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mori, K., Hasegawa, J., Toriwaki, J., Anno, H., and Katada, K. (1996, January 25\u201329). Recognition of bronchus in three dimensional X-Ray CT images with application to virtualized bronchoscopy system. Proceedings of the 13th International Conference on Pattern Recognition, Vienna, Austria.","DOI":"10.1109\/ICPR.1996.547003"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1148\/radiographics.18.3.9599397","article-title":"Virtual bronchoscopy for 3D pulmonary image assessment: State of the art and future needs","volume":"18","author":"Higgins","year":"1998","journal-title":"Radiographics"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1376","DOI":"10.1109\/TMI.2013.2252361","article-title":"Interactive CT-Video Registration for Image-Guided Bronchoscopy","volume":"32","author":"Merritt","year":"2013","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1378\/chest.13-0701","article-title":"Learning experience of linear endobronchial ultrasound among pulmonary trainees","volume":"145","author":"Wahidi","year":"2014","journal-title":"Chest"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1378\/chest.08-0603","article-title":"Image-Guided Bronchoscopy for Peripheral Lung Lesions: A Phantom Study","volume":"134","author":"Merritt","year":"2008","journal-title":"Chest"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1557","DOI":"10.1378\/chest.10-2914","article-title":"Diagnostic yield of endobronchial ultrasound-guided transbronchial needle aspiration: Results of the AQuIRE Bronchoscopy Registry","volume":"140","author":"Ost","year":"2011","journal-title":"Chest"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1164\/rccm.201507-1332OC","article-title":"Diagnostic Yield and Complications of Bronchoscopy for Peripheral Lung Lesions. Results of the AQuIRE Registry","volume":"193","author":"Ost","year":"2016","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1016\/j.jtcvs.2013.01.019","article-title":"Virtual endobronchial ultrasound for transbronchial needle aspiration","volume":"146","author":"Sato","year":"2013","journal-title":"J. Thorac. Cardiovas. Surg."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1007\/s11548-015-1326-7","article-title":"A novel platform for electromagnetic navigated ultrasound bronchoscopy (EBUS)","volume":"11","author":"Sorger","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sorger, H., Hofstad, E., Amundsen, T., Lango, T., Bakeng, J., and Leira, H. (2017). A multimodal image guiding system for Navigated Ultrasound Bronchoscopy (EBUS): A human feasibility study. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0171841"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1111\/resp.12095","article-title":"Diagnostic yield of combined bronchoscopy and endobronchial ultrasonography, under LungPoint guidance for small peripheral pulmonary lesions","volume":"18","author":"Tamiya","year":"2013","journal-title":"Respirology"},{"key":"ref_23","first-page":"388","article-title":"Beyond Current Guided Bronchoscopy: A Robust and Real-Time Bronchoscopic Ultrasound Navigation System","volume":"Volume 8149","author":"Mori","year":"2013","journal-title":"MICCAI 2013 Lecture Notes in Computer Science"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mehta, A., and Jain, P. (2013). Practical Application of Virtual Bronchoscopic Navigation. Interventional Bronchoscopy, Humana.","DOI":"10.1007\/978-1-62703-395-4"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"103361","DOI":"10.1016\/j.compbiomed.2019.103361","article-title":"Optimal Route Planning for Image-Guided EBUS Bronchoscopy","volume":"112","author":"Zang","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.imu.2021.100665","article-title":"Image-guided EBUS bronchoscopy system for lung-cancer staging","volume":"25","author":"Zang","year":"2021","journal-title":"Inform. Med. Unlocked"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1109\/TMI.2008.2011557","article-title":"Dynamic 2D Ultrasound and 3D CT Image Registration of the Beating Heart","volume":"28","author":"Huang","year":"2009","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kaar, M., Hoffmann, R., Bergmann, H., Figl, M., Bloch, C., Kratochwil, A., Birkfellner, W., and Hummel, J. (2011, January 13\u201317). Comparison of two navigation system designs for flexible endoscopes using abdominal 3D ultrasound. Proceedings of the SPIE Medical Imaging 2011, Lake Buena Vista, FL, USA.","DOI":"10.1117\/12.878056"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Rueckert, D., Clarkson, M.J., Hill, D.L.J., and Hawkes, D.J. (2000, January 18\u201329). Non-rigid registration using higher-order mutual information. Proceedings of the SPIE Medical Imaging 2000, San Diego, CA, USA.","DOI":"10.1117\/12.804801"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1109\/TMI.2013.2265603","article-title":"Deformable Medical Image Registration: A survey","volume":"32","author":"Sotiras","year":"2013","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/S0031-3203(98)00091-0","article-title":"An overlap invariant entropy measure of 3D medical image alignment","volume":"32","author":"Studholme","year":"1999","journal-title":"Pattern Recognit."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TMI.2006.872745","article-title":"Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change","volume":"25","author":"Studholme","year":"2006","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Knops, Z.F., Maintz, J.B.A., Viergever, M.A., and Pluim, J.P.W. (2004, January 26\u201329). Registration using segment intensity remapping and mutual information. Proceedings of the International Conference on Medical Imaging and Computer Assisted Intervention, Saint-Malo, France.","DOI":"10.1007\/978-3-540-30135-6_98"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1109\/TBME.2013.2285627","article-title":"Optimal procedure planning and guidance system for peripheral bronchoscopy","volume":"61","author":"Gibbs","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.compbiomed.2008.12.012","article-title":"3D MDCT-based system for planning peripheral bronchoscopic procedures","volume":"39","author":"Gibbs","year":"2009","journal-title":"Comput. Biol. Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1109\/TMI.2009.2035813","article-title":"Robust 3D Airway-Tree Segmentation for Image-Guided Peripheral Bronchoscopy","volume":"29","author":"Graham","year":"2010","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1016\/j.compbiomed.2011.06.014","article-title":"Segmentation of the central-chest lymph nodes in 3D MDCT images","volume":"41","author":"Lu","year":"2011","journal-title":"Comput. Biol. Med."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1109\/42.736022","article-title":"Registration of Real and CT-Derived Virtual Bronchoscopic Images to Assist Transbronchial Biopsy","volume":"17","author":"Bricault","year":"1998","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.cviu.2006.10.010","article-title":"Computer-based system for the virtual-endoscopic guidance of bronchoscopy","volume":"108","author":"Helferty","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1109\/TMI.2006.880587","article-title":"Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis","volume":"25","author":"Crum","year":"2006","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1109\/TMI.2013.2276943","article-title":"Evaluation and comparison of current fetal ultrasound image segmentation methods for biometric measurements: A grand challenge","volume":"33","author":"Rueda","year":"2014","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1426","DOI":"10.1109\/TBME.2015.2494838","article-title":"Methods for 2-D and 3-D Endobronchial Ultrasound Image Segmentation","volume":"63","author":"Zang","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1093\/comjnl\/7.4.308","article-title":"A simplex method for function optimization","volume":"7","author":"Nelder","year":"1965","journal-title":"Comput. J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.compmedimag.2007.11.001","article-title":"3D CT-video fusion for image-guided bronchoscopy","volume":"32","author":"Higgins","year":"2008","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_45","unstructured":"Schroeder, W., Martin, K., and Lorensen, B. (2008). The Visualization Toolkit, Prentice Hall. [4th ed.]."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2794","DOI":"10.1109\/TBME.2015.2401514","article-title":"Hands-Free System for Bronchoscopy Planning and Guidance","volume":"62","author":"Khare","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhao, W., Ahmad, D., Toth, J., Bascom, R., and Higgins, W.E. (2022). Endobronchial Ultrasound Image Simulation for Image-Guided Bronchoscopy. IEEE Trans. Biomed. Eng.","DOI":"10.1109\/TBME.2022.3190165"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"394","DOI":"10.3322\/caac.21492","article-title":"Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"68","author":"Bray","year":"2018","journal-title":"CA Cancer J. Clin."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1007\/s11548-011-0547-7","article-title":"Automatic definition of the central-chest lymph-node stations","volume":"6","author":"Lu","year":"2011","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_50","first-page":"113151T-1","article-title":"Multi-Destination Planning for Comprehensive Lymph Node Staging Bronchoscopy","volume":"Volume 11315","author":"Fei","year":"2020","journal-title":"SPIE Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling"},{"key":"ref_51","unstructured":"Zhao, W. (2022). Planning and Guidance Methods for Peripheral Bronchoscopy. [Ph.D. Thesis, The Pennsylvania State University, Department of Electrical Engineering]."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1016\/j.athoracsur.2018.11.068","article-title":"First Evaluation of the Next-Generation Endobronchial Ultrasound System in Preclinical Models","volume":"107","author":"Fujino","year":"2019","journal-title":"Ann. Thorac. Surg."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/7\/189\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:44:21Z","timestamp":1760139861000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/7\/189"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,8]]},"references-count":52,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["jimaging8070189"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8070189","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,8]]}}}