{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T13:21:10Z","timestamp":1777555270272,"version":"3.51.4"},"reference-count":37,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,12,7]],"date-time":"2020-12-07T00:00:00Z","timestamp":1607299200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Technology (MOST) , Taiwan, Republic of China","award":["MOST107-2221-E-182-026-MY2"],"award-info":[{"award-number":["MOST107-2221-E-182-026-MY2"]}]},{"name":"Chang Gung Memorial Hospital, Taiwan, Republic of China","award":["CMRPD2G0121"],"award-info":[{"award-number":["CMRPD2G0121"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, Image-Guide Navigation Systems (IGNS) have become an important tool for various surgical operations. In the preparations for planning a surgical path, verifying the location of a lesion, etc., it is an essential tool; in operations such as bronchoscopy, which is the procedure for the inspection and retrieval of diagnostic samples for lung-related surgeries, it is even more so. The IGNS for bronchoscopy uses 2D-based images from a flexible bronchoscope to navigate through the bronchial airways in order to reach the targeted location. In this procedure, the accurate localization of the scope becomes very important, because incorrect information could potentially cause a surgeon to mistakenly direct the scope down the wrong passage. It would be a great aid for the surgeon to be able to visualize the bronchoscope images alongside the current location of the bronchoscope. For this purpose, in this paper, we propose a novel registration method to match real bronchoscopy images with virtual bronchoscope images from a 3D bronchial tree model built using computed tomography (CT) image stacks in order to obtain the current 3D position of the bronchoscope in the airways. This method is a combination of a novel position-tracking method using the current frames from the bronchoscope and the verification of the position of the real bronchoscope image against an image extracted from the 3D model using an adaptive-network-based fuzzy inference system (ANFIS)-based image matching method. Experimental results show that the proposed method performs better than the other methods used in the comparison.<\/jats:p>","DOI":"10.3390\/s20236997","type":"journal-article","created":{"date-parts":[[2020,12,7]],"date-time":"2020-12-07T21:37:42Z","timestamp":1607377062000},"page":"6997","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Bronchoscope Localization Method Using an Augmented Reality Co-Display of Real Bronchoscopy Images with a Virtual 3D Bronchial Tree Model"],"prefix":"10.3390","volume":"20","author":[{"given":"Jong-Chih","family":"Chien","sequence":"first","affiliation":[{"name":"School of Informatics, Kainan University, Taoyuan 33857, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiann-Der","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Chang Gung University, Taoyuan 33302, Taiwan"},{"name":"Department of Neurosurgery, Chang Gung Memorial Hospital at Linkou, Taoyuan 33305, Taiwan"},{"name":"Department of Electrical Engineering, Ming Chi University of Technology, New Taipei City 24301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ellen","family":"Su","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Chang Gung University, Taoyuan 33302, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shih-Hong","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Thoracic Medicine, Chang Gung Memorial Hospital at LinKou, Taoyuan 33305, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,7]]},"reference":[{"key":"ref_1","first-page":"316","article-title":"Complications of bronchoscopy: Comparison of rigid bronchoscopy under general anesthesia and flexible fiberoptic bronchoscopy under topical anesthesia","volume":"79","author":"Lukomsky","year":"1981","journal-title":"Clin. Investig. Comment."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"454","DOI":"10.21037\/atm.2016.12.23","article-title":"Augmented and virtual reality in surgery\u2014The digital surgical environment: Applications, limitations and legal pitfalls","volume":"4","author":"Khor","year":"2016","journal-title":"Ann. Transl. Med."},{"key":"ref_3","first-page":"1","article-title":"Virtual reality in surgery and medicine","volume":"13","author":"Chinnock","year":"1994","journal-title":"Hosp. Technol. Ser."},{"key":"ref_4","first-page":"809","article-title":"Virtualized endoscope system an application of virtual reality technology to diagnostic aid","volume":"E79-D","author":"Mori","year":"1996","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hong, L., Muraki, S., Kaufman, A., Bartz, D., and He, T. (1997, January 1). Virtual voyage: Interactive navigation in the human colon. Proceedings of the Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA.","DOI":"10.1145\/258734.258750"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.2214\/ajr.179.6.1791414","article-title":"3D Image Processing: Techniques and Clinical Applications","volume":"179","author":"Fishman","year":"2002","journal-title":"Am. J. Roentgenol."},{"key":"ref_7","unstructured":"Koizumi, N., Sumiyama, K., Suzuki, N., Hattori, A., Tajiri, H., and Uchiyama, A. (2002). Robot Vision, The MIT Press."},{"key":"ref_8","unstructured":"Helferty, J., and Higgins, W. (2001, January 7\u201310). Technique for registering 3D virtual CT images to endoscopic video. Proceedings of the 2001 International Conference on Image Processing (Cat. No.01CH37205), Thessaloniki, Greece."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Merritt, S.A., Rai, L., and Higgins, W.E. (2006, January 12\u201314). Real-time CT-video registration for continuous endoscopic guidance. Proceedings of the Medical Imaging 2006: Physiology, Function, and Structure from Medical Images, San Diego, CA, USA.","DOI":"10.1117\/12.651695"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1109\/TMI.2006.871550","article-title":"Patient-specific bronchoscopy visualization through BRDF estimation and disocclusion correction","volume":"25","author":"Chung","year":"2006","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1016\/j.media.2009.06.001","article-title":"Selective image similarity measure for bronchoscope tracking based on image registration","volume":"13","author":"Deguchi","year":"2009","journal-title":"Med. Image Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/S1361-8415(02)00089-0","article-title":"Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images","volume":"6","author":"Mori","year":"2002","journal-title":"Med. Image Anal."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM System","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_14","first-page":"72","article-title":"ORBSLAM-based endoscope tracking and 3D reconstruction","volume":"Volume 10170","author":"Mahmoud","year":"2017","journal-title":"Public-Key Cryptography\u2014PKC 2018"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11548-020-02241-9","article-title":"A visual SLAM-based bronchoscope tracking scheme for bronchoscopic navigation","volume":"15","author":"Wang","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_16","unstructured":"Karami, E., Prasad, S., and Shehata, M. (2017). Image matching using SIFT, SURF, BRIEF and ORB: Performance comparison. arxiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1109\/21.256541","article-title":"ANFIS: Adaptive-network-based fuzzy inference system","volume":"23","author":"Jang","year":"1993","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_18","first-page":"214","article-title":"KAZE features","volume":"Volume 7577","author":"Alcantarilla","year":"2012","journal-title":"Advances in Computational Intelligence"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speed Up Robust Features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_20","unstructured":"Donoser, M., and Bischof, H. (2006, January 17\u201322). Efficient Maximally Stable Extremal Region (MSER) tracking. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014Volume 2 (CVPR\u201906), New York, NY, USA."},{"key":"ref_21","first-page":"27","article-title":"The Haar-wavelet transform in digital image processing: Its status and achievements","volume":"13","author":"Porwik","year":"2004","journal-title":"Mach. Graph. Vis."},{"key":"ref_22","unstructured":"Jang, J.-S., Sun, C.-T., and Mizutani, E. (1997). Neuro-Fuzzy and Soft Computing, Prentice Hall."},{"key":"ref_23","unstructured":"Jang, J.-S. (1996, January 11). Input selection for ANFIS learning. Proceedings of the IEEE 5th International Fuzzy Systems, New Orleans, LA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5267","DOI":"10.1016\/j.eswa.2014.02.047","article-title":"Modeling of daily pan evaporation in subtropical climates using ANN, LS-SVR, Fuzzy Logic, and ANFIS","volume":"41","author":"Goyal","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_25","first-page":"1","article-title":"Prediction of attendance demand in european football games: Comparison of ANFIS, fuzzy logic, and ANN","volume":"2018","author":"Erol","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/j.measurement.2015.07.020","article-title":"Arbitration algorithm of FIR filter and optical flow based on ANFIS for visual object tracking","volume":"75","author":"Choi","year":"2015","journal-title":"Measurement"},{"key":"ref_27","first-page":"509","article-title":"Shape matching and object recognition using chord contexts","volume":"24","author":"Mingqiang","year":"2008","journal-title":"2008 Int. Conf. Vis."},{"key":"ref_28","first-page":"279","article-title":"Hidden Markov models of minimally invasive surgery","volume":"70","author":"Rosen","year":"2000","journal-title":"Stud. Heal. Technol. Inform."},{"key":"ref_29","unstructured":"Sonnhammer, E.L., Von Heijne, G., and Krogh, A. (July, January 28). A hidden Markov model for predicting transmembrane helices in protein sequences. Proceedings of the International Conference on Intelligent Systems for Molecular Biology, Montr\u00e9al, QC, Canada."},{"key":"ref_30","unstructured":"(2017, December 09). 3DSlicer. Available online: https:\/\/www.slicer.org\/."},{"key":"ref_31","unstructured":"(2018, June 03). BF-F260 Bronchovideoscope Brochure. Available online: https:\/\/ssd.olympus.eu\/medical\/en\/medical_systems\/contact___support\/mediacentre\/media_detail_100873.jsp."},{"key":"ref_32","unstructured":"(2017, September 10). OpenCV Library. Available online: https:\/\/opencv.org."},{"key":"ref_33","unstructured":"(2018, September 10). Matlab\u2014MathWorks. Available online: https:\/\/www.mathworks.com\/products\/matlab.html."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/IJOCI.2020040101","article-title":"New approach to improve the classification process of multi-class objects","volume":"10","author":"Gafour","year":"2020","journal-title":"Int. J. Organ. Collect. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Brehmer, K., Wacker, B., and Modersitzki, J. (2018). A Novel Similarity Measure for Image Sequences, Springer Science and Business Media LLC.","DOI":"10.1007\/978-3-319-92258-4_5"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"LaValle, S.M., and Kuffner, J.J. (2001). Rapidly-exploring random trees: Progress and prospects. Algorithmic Comput. Robot., 303\u2013307.","DOI":"10.1201\/9781439864135-43"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1109\/70.660866","article-title":"Analysis of probabilistic roadmaps for path planning","volume":"14","author":"Kavraki","year":"2002","journal-title":"Proc. IEEE Int. Conf. Robot. Autom."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6997\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:42:03Z","timestamp":1760179323000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6997"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,7]]},"references-count":37,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236997"],"URL":"https:\/\/doi.org\/10.3390\/s20236997","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,7]]}}}