{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T21:40:57Z","timestamp":1769636457183,"version":"3.49.0"},"reference-count":28,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T00:00:00Z","timestamp":1576713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>C-arm X-ray imaging is commonly applied in operating rooms for guiding orthopedic surgeries. Augmented Reality (AR) with C-arm X-ray images during surgery is an efficient way to facilitate procedures for surgeons. However, the accurate calibration process for surgical AR based on C-arm is essential and still challenging due to the limitations of C-arm imaging systems, such as instability of C-arm calibration parameters and the narrow field of view. We extend existing methods using a depth camera and propose a new calibration procedure consisting of calibration of the C-arm imaging system, and 3D\/2D calibration of an RGB-D camera and C-arm system with a new method to achieve reliable data and promising accuracy and, at the same time, consistent with standard surgical protocols. For the calibration procedure, we apply bundle adjustment equations with a 3D designed Lego multi-modal phantom, in contrast to the previous methods in which planar calibration phantoms were applied. By using our method, the visualization of the X-ray image upon the 3D data was done, and the achieved mean overlay error was 1.03 mm. The evaluations showed that the proposed calibration procedure provided promising accuracy for AR surgeries and it improved the flexibility and robustness of existing C-arm calibration methods for surgical augmented reality (using C-arm and RGB-D sensor). Moreover, the results showed the efficiency of our method to compensate for the effects of the C-arm movement on calibration parameters. It was shown that the obtained overlay error was improved for the non-zero rotation movement of C-arm by using a virtual detector.<\/jats:p>","DOI":"10.3390\/s20010036","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T03:15:01Z","timestamp":1577070901000},"page":"36","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Toward an End-to-End Calibration for Mobile C-Arm in Combination with a Depth Sensor for Surgical Augmented Reality Applications"],"prefix":"10.3390","volume":"20","author":[{"given":"Sahar","family":"Hosseinian","sequence":"first","affiliation":[{"name":"School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8014-624X","authenticated-orcid":false,"given":"Hossein","family":"Arefi","sequence":"additional","affiliation":[{"name":"School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nassir","family":"Navab","sequence":"additional","affiliation":[{"name":"Chair for Computer Aided Medical Procedures &amp; Augmented Reality, Faculty of Computer Science, Technical University of Munich, Boltzmannstr. 3, 85748 Garching b. Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1109\/TMI.2009.2021947","article-title":"Camera augmented mobile C-arm (CAMC): Calibration, accuracy study, and clinical applications","volume":"29","author":"Navab","year":"2010","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/JRA.1987.1087109","article-title":"A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses","volume":"3","author":"Tsai","year":"1987","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"65","DOI":"10.3109\/10929089909148161","article-title":"Fluoroscopy as an Imaging Means for Computer-Assisted Surgical Navigation","volume":"4","author":"Hofstetter","year":"1999","journal-title":"Comput. Aided Surg."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2511","DOI":"10.1016\/j.jbiomech.2011.07.001","article-title":"A comparison of calibration methods for stereo fluoroscopic imaging systems","volume":"44","author":"Kaptein","year":"2011","journal-title":"J. Biomech."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yaniv, Z., Joskowicz, L., Simkin, A., Garza-Jinich, M., and Milgrom, C. (1998, January 11\u201313). Fluoroscopic image processing for computer-aided orthopedic surgery. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Cambridge MA, USA.","DOI":"10.1007\/BFb0056216"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Habert, S., Gardiazabal, J., Fallavollita, P., and Navab, N. (October, January 29). RGBDX: First Design and Experimental Validation of a Mirror-Based RGBD X-ray Imaging System. Proceedings of the 14th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2015), Fukuoka, Japan.","DOI":"10.1109\/ISMAR.2015.17"},{"key":"ref_7","unstructured":"Habert, S. (2018). Multi-Modal Visualization Paradigms for RGB-D Augmented X-ray Imaging. [Ph.D. Thesis, Technische Universit\u00e4t M\u00fcnchen]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Habert, S., Meng, M., Kehl, W., Wang, X., Tombari, F., Fallavollita, P., and Navab, N. (October, January 29). Augmenting Mobile C-arm Fluoroscopes via Stereo-RGBD Sensors for Multimodal Visualization. Proceedings of the 14th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2015), Fukuoka, Japan.","DOI":"10.1109\/ISMAR.2015.24"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A Flexible New Technique for Camera Calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1007\/s11548-015-1347-2","article-title":"Precise 3D\/2D calibration between an RGB-D sensor and a C-arm fluoroscope","volume":"11","author":"Wang","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_11","unstructured":"Groher, M. (2003). Development of a Planning and Navigation Tool for Endoscopic Treatment of Aortic Aneurysms-Computer Supported Implantation of a Stent Graft. [Ph.D. Thesis, Technische Universit\u00e4t M\u00fcnchen]."},{"key":"ref_12","unstructured":"Wang, L. (2012). Novel Techniques for Integrating Video Augmented X-ray Imaging into Orthopedic and Trauma Surgery. [Ph.D. Dissertation, Technische Universit\u00e4t M\u00fcnchen]."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.compbiomed.2016.08.008","article-title":"Inverse visualization concept for RGB-D augmented C-arms","volume":"77","author":"Wang","year":"2016","journal-title":"Comput. Biol. Med."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, X., Habert, S., Ma, M., Huang, C.H., Fallavollita, P., and Navab, N. (October, January 29). RGB-D\/C-arm Calibration and Application in Medical Augmented Reality. Proceedings of the 14th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2015), Fukuoka, Japan.","DOI":"10.1109\/ISMAR.2015.31"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1671","DOI":"10.1007\/s11548-018-1823-6","article-title":"Perspective Pinhole Model with Planar Source for Augmented Reality Surgical Navigation Based on C-Arm Imaging","volume":"13","author":"Ha","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1007\/s11548-016-1396-1","article-title":"Calibration of RGB-D camera and cone-beam CT for 3D intra-operative mixed reality visualization","volume":"11","author":"Lee","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Navab, N., Mitschke, M., and Sch\u00fctz, O. (1999, January 19\u201322). Camera-augmented mobile C-arm (CAMC) application: 3D reconstruction using a low-cost mobile C-arm. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI\u201999, Cambridge, UK.","DOI":"10.1007\/10704282_75"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kaplan, D.J., Patel Jay, N., Liporace Frank, A., and Yoon Richard, S. (2016). Intraoperative Radiation Safety in Orthopaedics: A Review of the ALARA (as Low as Reasonably Achievable) Principle. Patient Saf. Surg., 10.","DOI":"10.1186\/s13037-016-0115-8"},{"key":"ref_19","first-page":"266","article-title":"Digital camera calibration methods: Considerations and comparisons","volume":"36","author":"Remondino","year":"2006","journal-title":"Int. Arch. Photogramm Remote. Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1120\/jacmp.v13i1.3441","article-title":"Image intensifier distortion correction for fluoroscopic RSA: The need for independent accuracy assessment","volume":"13","author":"Kedgley","year":"2012","journal-title":"J. Appl. Clin. Med Phys."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1109\/TMI.2014.2362993","article-title":"Rigorous geometric self-calibrating bundle adjustment for a dual fluoroscopic imaging system","volume":"34","author":"Lichti","year":"2015","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Al-Durgham, K., Lichti, D., Kuntze, G., Sharma, G., and Ronsky, J. (2016, January 12\u201319). Toward an Automatic Calibration of Dual Fluoroscopy Imaging Systems. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLI-B5, 2016 XXIII ISPRS Congress, Prague, Czech Republic.","DOI":"10.5194\/isprsarchives-XLI-B5-757-2016"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"381","DOI":"10.14358\/PERS.79.4.381","article-title":"Automatic Camera Calibration in Close-Range Photogrammetry","volume":"79","author":"Fraser","year":"2012","journal-title":"Photogramm. Eng. Rem. Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hosseinian, S., and Arefi, H. (2016, January 12\u201319). Assessment of Restoration Methods of X-Ray Images with Emphasis on Medical Photogrammetric Usage. Proceedings of the International Archives of the Photogrammetric, Remote Sensing and Spatial Information Sciences, 2016 XXIII ISPRS Congress, Prague, Czech Republic.","DOI":"10.5194\/isprsarchives-XLI-B5-835-2016"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1118\/1.1488602","article-title":"Distortion correction for x-ray image intensifiers: Local unwarping polynomials and RBF neural networks","volume":"29","author":"Cerveri","year":"2002","journal-title":"Med. Phys."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgib-bon, A.W. (1999, January 21\u201322). Bundle Adjustmenta Modern Synthesis. Proceedings of the International Workshop on Vision Algorithms, Corfu, Greece.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"497","DOI":"10.5194\/isprs-archives-XLII-4-W18-497-2019","article-title":"C-Arm Pose Estimation and Navigation in Surgeries for Augmented Reality Application","volume":"XLII-4\/W18","author":"Hosseinian","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/TPAMI.2010.46","article-title":"Point set registration: Coherent Point Draft","volume":"32","author":"Myronenko","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/36\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:43:44Z","timestamp":1760190224000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/36"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,19]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["s20010036"],"URL":"https:\/\/doi.org\/10.3390\/s20010036","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,19]]}}}