{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T13:25:03Z","timestamp":1740144303165,"version":"3.37.3"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T00:00:00Z","timestamp":1728432000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T00:00:00Z","timestamp":1728432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004061","name":"Oesterreichische Nationalbank","doi-asserted-by":"publisher","award":["16154"],"award-info":[{"award-number":["16154"]}],"id":[{"id":"10.13039\/501100004061","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Multi-zoom microscopic surface reconstructions of operating sites, especially in ENT surgeries, would allow multimodal image fusion for determining the amount of resected tissue, for recognizing critical structures, and novel tools for intraoperative quality assurance. State-of-the-art three-dimensional model creation of the surgical scene is challenged by the surgical environment, illumination, and the homogeneous structures of skin, muscle, bones, etc., that lack invariant features for stereo reconstruction.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>An adaptive near-infrared pattern projector illuminates the surgical scene with optimized patterns to yield accurate dense multi-zoom stereoscopic surface reconstructions. The approach does not impact the clinical workflow. The new method is compared to state-of-the-art approaches and is validated by determining its reconstruction errors relative to a high-resolution 3D-reconstruction of CT data.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>200 surface reconstructions were generated for 5 zoom levels with 10 reconstructions for each object illumination method (standard operating room light, microscope light, random pattern and adaptive NIR pattern). For the adaptive pattern, the surface reconstruction errors ranged from 0.5 to 0.7 mm, as compared to 1\u20131.9 mm for the other approaches. The local reconstruction differences are visualized in heat maps.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Adaptive near-infrared (NIR) pattern projection in microscopic surgery allows dense and accurate microscopic surface reconstructions for variable zoom levels of small and homogeneous surfaces. This could potentially aid in microscopic interventions at the lateral skull base and potentially open up new possibilities for combining quantitative intraoperative surface reconstructions with preoperative radiologic imagery.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03242-8","type":"journal-article","created":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T14:02:24Z","timestamp":1728482544000},"page":"2311-2319","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Adaptive infrared patterns for microscopic surface reconstructions"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8440-1992","authenticated-orcid":false,"given":"Srdjan","family":"Milosavljevic","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zoltan","family":"Bardosi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yusuf","family":"Oezbek","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wolfgang","family":"Freysinger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,10,9]]},"reference":[{"key":"3242_CR1","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1038\/sdata.2018.297","volume":"6","author":"D Sieber","year":"2019","unstructured":"Sieber D, Erfurt P, John S (2019) The OpenEar library of 3D models of the human temporal bone based on computed tomography and micro-slicing. Sci Data 6:1038","journal-title":"Sci Data"},{"key":"3242_CR2","first-page":"17","volume":"85","author":"M Agus","year":"2002","unstructured":"Agus M, Giachetti A, Gobbetti E, Zanetti G, Zorcolo A, John N, Stone R (2002) Mastoidectomy simulation with combined visual and haptic feedback. Stud Health Technol Inform 85:17\u201323","journal-title":"Stud Health Technol Inform"},{"key":"3242_CR3","doi-asserted-by":"publisher","first-page":"3012","DOI":"10.1364\/OE.15.003012","volume":"15","author":"DL Psang","year":"2007","unstructured":"Psang DL, Sung K (2007) Comparing two new camera calibration methods with traditional pinhole calibrations. Opt Express 15:3012\u20133022","journal-title":"Opt Express"},{"key":"3242_CR4","doi-asserted-by":"publisher","first-page":"117","DOI":"10.3390\/s23010117","volume":"23","author":"F Akkoyun","year":"2023","unstructured":"Akkoyun F, Ozcelik A, Arpaci I, Er\u00e7etin A, Gucluer S (2023) A multi-flow production line for sorting of eggs using image processing. Sensors 23:117","journal-title":"Sensors"},{"key":"3242_CR5","first-page":"1455","volume":"21","author":"Z Yang","year":"2021","unstructured":"Yang Z (2021) Hierarchically adaptive image block matching under complicated illumination conditions. J Comput Methods Sci Eng 21:1455\u20131468","journal-title":"J Comput Methods Sci Eng"},{"key":"3242_CR6","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"D Lowe","year":"2004","unstructured":"Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60:91\u2013110","journal-title":"Int J Comput Vision"},{"key":"3242_CR7","first-page":"404","volume":"1","author":"H Bay","year":"2006","unstructured":"Bay H, Tuytelaars T, Van Gool L (2006) SURF: speeded up robust features. ECCV 1:404\u2013417","journal-title":"ECCV"},{"key":"3242_CR8","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","volume":"30","author":"H Hirschmuller","year":"2008","unstructured":"Hirschmuller H (2008) Stereo processing by semiglobal matching and mutual information. IEEE Trans Pattern Anal Mach Intell 30:328\u2013341","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"3242_CR9","unstructured":"Milosavljevic S, Freysinger W (2016)Quantitative measurements of surface reconstructions obtained with images a surgical stereo microscope. CURAC 47\u201352"},{"key":"3242_CR10","first-page":"196","volume":"2","author":"R Verma","year":"2014","unstructured":"Verma R, Verma AK (2014) A comparative evaluation of leading dense stereo vision algorithms using OpenCV. Int J Eng Res Technol 2:196\u2013201","journal-title":"Int J Eng Res Technol"},{"key":"3242_CR11","first-page":"18","volume":"5","author":"M Muja","year":"2009","unstructured":"Muja M (2009) Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP 5:18","journal-title":"VISAPP"},{"key":"3242_CR12","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1145\/361002.361007","volume":"18","author":"J Bentley","year":"1975","unstructured":"Bentley J (1975) Multidimensional binary search trees used for associative searching. Commun ACM 18:509\u2013517","journal-title":"Commun ACM"},{"key":"3242_CR13","doi-asserted-by":"crossref","unstructured":"Avrithis Y, Emiris IZ, Samaras G (2016) High-dimensional visual similarity search: k-d generalized randomized forests. Comput Graph Int, 25\u201328","DOI":"10.1145\/2949035.2949042"},{"key":"3242_CR14","doi-asserted-by":"publisher","first-page":"8872","DOI":"10.48084\/etasr.5022","volume":"12","author":"A Ozturk","year":"2022","unstructured":"Ozturk A, Cayiroglu I (2022) A real-time application of singular spectrum analysis to object tracking with SIFT. Eng Technol Appl Sci Res 12:8872\u20138877","journal-title":"Eng Technol Appl Sci Res"},{"key":"3242_CR15","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1016\/S1361-8415(01)80006-2","volume":"1","author":"AC Colchester","year":"1996","unstructured":"Colchester AC, Zhao J, Holton-Tainter KS, Henri CJ, Maitland N, Roberts PT, Harris CG, Evans RI (1996) Development and preliminary evaluation of VISLAN, a surgical planning and guidance system using intra-operative video imaging. Med Image Anal 1:73\u201390","journal-title":"Med Image Anal"},{"key":"3242_CR16","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1159\/000099672","volume":"66","author":"DG Thomas","year":"1996","unstructured":"Thomas DG, Doshi P, Colchester A, Hawkes DJ, Hill DL, Zhao J, Maitland N, Strong AJ, Evans RI (1996) Craniotomy guidance using a stereo-video-based tracking system. Stereotact Funct Neurosurg 66:81\u201383","journal-title":"Stereotact Funct Neurosurg"},{"key":"3242_CR17","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1002\/(SICI)1522-712X(1995)1:3<172::AID-IGS7>3.0.CO;2-7","volume":"1","author":"PJ Edwards","year":"1995","unstructured":"Edwards PJ, Hawkes DJ, Hill DL, Jewell D, Spink R, Strong A, Gleeson M (1995) Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. J Image Guid Surg 1:172\u2013178","journal-title":"J Image Guid Surg"},{"key":"3242_CR18","doi-asserted-by":"crossref","unstructured":"Wang Y (2018) Microscopy and microanalysis. disparity surface reconstruction based on a stereo light microscope and laser fringes, vol. 24. Cambridge University Press, pp 503\u2013515","DOI":"10.1017\/S143192761801512X"},{"key":"3242_CR19","first-page":"1","volume":"11","author":"B Pycinski","year":"2015","unstructured":"Pycinski B, Czajkowska J, Badura P, Juszczyk J, Pietka E (2015) Time-of-flight camera, optical tracker and computed tomography in pairwise data registration. PLoS ONE 11:1\u201320","journal-title":"PLoS ONE"},{"key":"3242_CR20","first-page":"39","volume":"10434","author":"J Lin","year":"2017","unstructured":"Lin J, Clancy N, Hu Y, Qi J, Tatla T, Stoyanov D, Maier-Hein L, Elson D (2017) Endoscopic depth measurement and super-spectral-resolution imaging. LNIP 10434:39\u201347","journal-title":"LNIP"},{"key":"3242_CR21","volume-title":"Pattern recognition and machine learning","author":"C Bishop","year":"2006","unstructured":"Bishop C (2006) Pattern recognition and machine learning. Springer, Berlin"},{"key":"3242_CR22","doi-asserted-by":"publisher","first-page":"9391","DOI":"10.3390\/s22239391","volume":"22","author":"Y Xu","year":"2022","unstructured":"Xu Y, So Y, Woo S (2022) Plane fitting in 3D reconstruction to preserve smooth homogeneous surfaces. Sensors 22:9391","journal-title":"Sensors"},{"key":"3242_CR23","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1016\/S0531-5131(01)00054-1","volume":"1230","author":"OJ Fleigab","year":"2001","unstructured":"Fleigab OJ, Devernayc F, Scarabinad JM, Jannin P (2001) Surface reconstruction of the surgical field from stereoscopic microscope views in neurosurgery. Int Congr Ser 1230:268\u2013274","journal-title":"Int Congr Ser"},{"key":"3242_CR24","doi-asserted-by":"crossref","unstructured":"Schroeder W, Martin KM, Lorensen WE (2006) The visualization toolkit: an object-oriented approach to 3D graphics. Kitware https:\/\/vtk.org\/vtk-textbook. Accessed 17 April 2024","DOI":"10.1016\/B978-012387582-2\/50003-4"},{"key":"3242_CR25","first-page":"586","volume":"85","author":"TS Yoo","year":"2002","unstructured":"Yoo TS, Ackerman MJ, Lorensen WE, Schroeder W, Chalana V, Aylward S et al (2002) Engineering and algorithm design for an image processing API: a technical report on ITK-the insight toolkit. Stud. Health Technol. Inform. 85:586\u2013592","journal-title":"Stud. Health Technol. Inform."},{"key":"3242_CR26","unstructured":"Bradski G (2008) The OpenCV library. Dr. Dobb\u2019s J Softw Tools. https:\/\/opencv.org\/. Accessed 17 April 2024"},{"key":"3242_CR27","doi-asserted-by":"crossref","unstructured":"Rusu RB, Cousins S (2011) 3D is here: point cloud library (PCL). In: IEEE international conference on robotics and automation, pp 1\u20134","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"3242_CR28","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/BF01143137","volume":"11","author":"C Parisot","year":"1995","unstructured":"Parisot C (1995) The DICOM standard. Int J Cardiac Imag 11:171\u2013177","journal-title":"Int J Cardiac Imag"},{"key":"3242_CR29","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","volume":"76","author":"F Romero-Ramirez","year":"2018","unstructured":"Romero-Ramirez F, Mu\u00f1oz-Salinas R, Carnicer R (2018) Speeded up detection of squared fiducial markers. Image Vis Comput 76:38\u201347","journal-title":"Image Vis Comput"},{"key":"3242_CR30","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1016\/j.patcog.2015.09.023","volume":"51","author":"S Garrido-Jurado","year":"2016","unstructured":"Garrido-Jurado S, Mu\u00f1oz Salinas R, Madrid-Cuevas FJ, Medina-Carnicer R (2016) Generation of fiducial marker dictionaries using mixed integer linear programming. Pattern Recogn 51:481\u2013491","journal-title":"Pattern Recogn"},{"key":"3242_CR31","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1145\/37402.37422","volume":"21","author":"WE Lorensen","year":"1987","unstructured":"Lorensen WE, Cline EH (1987) Marching cubes: a high resolution 3d surface construction algorithm. ACM Comput Graph 21:163\u2013169","journal-title":"ACM Comput Graph"},{"key":"3242_CR32","first-page":"277","volume":"19","author":"R Kikinis","year":"2014","unstructured":"Kikinis R, Pieper SD, Vosburgh K (2014) 3D Slicer: a platform for subject-specific image analysis, visualization, and clinical support. Intraoper Imaging Image-Guided Ther 19:277\u2013289","journal-title":"Intraoper Imaging Image-Guided Ther"},{"key":"3242_CR33","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.1109\/34.888718","volume":"22","author":"Z Zhang","year":"2000","unstructured":"Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22:1330\u20131334","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"3242_CR34","first-page":"629","volume":"4","author":"B Horn","year":"1987","unstructured":"Horn B (1987) Closed-form solution of absolute orientation using unit quaternions. Josa 4:629\u2013642","journal-title":"Josa"},{"key":"3242_CR35","unstructured":"Gonzalez J, Osborne M, Lawrence N (2016) GLASSES: relieving the myopia of Bayesian optimisation. AISTATS, 790\u2013799"},{"key":"3242_CR36","doi-asserted-by":"crossref","unstructured":"Quadrianto N, Kersting K, Xu Z (2011) Gaussian process. In: Encyclopedia of machine learning. Springer, pp 428\u2013439","DOI":"10.1007\/978-0-387-30164-8_324"},{"key":"3242_CR37","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3206.001.0001","volume-title":"Gaussian processes for machine learning","author":"CE Rasmussen","year":"2005","unstructured":"Rasmussen CE, Williams CKI (2005) Gaussian processes for machine learning. MIT Press, Cambridge"},{"key":"3242_CR38","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.4218\/etrij.13.2013.0052","volume":"35","author":"J Jeong","year":"2013","unstructured":"Jeong J, Shin H, Chang J, Lim E, Choi S, Yoon K, Cho J (2013) High-quality stereo depth map generation using infrared pattern projection. ETRI J 35:1011\u20131020","journal-title":"ETRI J"},{"key":"3242_CR39","first-page":"701","volume":"43","author":"BN Giacomini","year":"2021","unstructured":"Giacomini BN, Roncella A, Thoeni R (2021) Influence of illumination changes on image-based 3d surface reconstruction. Int Arch Photogramm Remote Sens Spatial Inf Sci 43:701\u2013708","journal-title":"Int Arch Photogramm Remote Sens Spatial Inf Sci"},{"key":"3242_CR40","doi-asserted-by":"crossref","unstructured":"Reiter A, Sigaras A, Fowler D, Allen PK (2014) Surgical structured light for 3D minimally invasive surgical imaging. In: International conference on intelligent robots and systems, 1282\u20131287","DOI":"10.1109\/IROS.2014.6942722"},{"key":"3242_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10916-016-0462-0","volume":"40","author":"Q Lin","year":"2016","unstructured":"Lin Q, Cai K, Yang R, Chen H, Wang Z, Zhou J (2016) Development and validation of a near-infrared optical system for tracking surgical instruments. J Med Syst 40:1\u201314","journal-title":"J Med Syst"},{"key":"3242_CR42","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1007\/s11263-021-01549-6","volume":"130","author":"X Song","year":"2022","unstructured":"Song X, Yang G, Zhu X, Zhou H, Ma Y, Wang Z, Jianping S (2022) AdaStereo: an efficient domain-adaptive stereo matching approach. Int J Comput Vision 130:226\u2013245","journal-title":"Int J Comput Vision"},{"key":"3242_CR43","volume-title":"CUDA programming: a developer\u2019s guide to parallel computing with GPUs","author":"S Cook","year":"2012","unstructured":"Cook S (2012) CUDA programming: a developer\u2019s guide to parallel computing with GPUs. Newnes, Waltham"},{"key":"3242_CR44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TIM.2021.3074388","volume":"70","author":"A Cavagna","year":"2021","unstructured":"Cavagna A, Feng X, Melillo S, Parisi L, Postiglione L, Villegas P (2021) CoMo: a novel comoving 3D camera system. IEEE Trans Instrum Meas 70:1\u201316","journal-title":"IEEE Trans Instrum Meas"},{"key":"3242_CR45","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1109\/TPAMI.2017.2699648","volume":"40","author":"F Vasconcelos","year":"2018","unstructured":"Vasconcelos F, Barreto JP, Boyer E (2018) Automatic camera calibration using multiple sets of pairwise correspondences. IEEE Trans Pattern Anal Mach Intell 40:791\u2013803","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"3242_CR46","doi-asserted-by":"publisher","first-page":"385","DOI":"10.7763\/IJFCC.2013.V2.191","volume":"5","author":"YB Mahdy","year":"2013","unstructured":"Mahdy YB, Hussain KF, Abdel-Maji MA (2013) Projector calibration using passive stereo and triangulation. Int J Future Comput Commun 5:385\u2013390","journal-title":"Int J Future Comput Commun"},{"key":"3242_CR47","doi-asserted-by":"crossref","unstructured":"Tan L, Wang Y, Yu H, Zhu J (2017) Automatic camera calibration using active displays of a virtual pattern. Sensors 17:685","DOI":"10.3390\/s17040685"},{"key":"3242_CR48","doi-asserted-by":"publisher","first-page":"612","DOI":"10.3390\/s16050612","volume":"16","author":"S Xiao","year":"2016","unstructured":"Xiao S, Tao W, Zhao H (2016) A flexible fringe projection vision system with extended mathematical model for accurate three-dimensional measurement. Sensors 16:612","journal-title":"Sensors"},{"key":"3242_CR49","doi-asserted-by":"crossref","unstructured":"Yang J, Li H, Jia Y (2013) Go-ICP: solving 3D registration efficiently and globally optimally. Int Conf Comput Vis 11:2241\u20132254","DOI":"10.1109\/ICCV.2013.184"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03242-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03242-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03242-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,29]],"date-time":"2024-11-29T15:15:36Z","timestamp":1732893336000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03242-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,9]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["3242"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03242-8","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2024,10,9]]},"assertion":[{"value":"28 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 October 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}