{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T16:25:41Z","timestamp":1779899141595,"version":"3.53.1"},"publisher-location":"Cham","reference-count":26,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031720888","type":"print"},{"value":"9783031720895","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,3]],"date-time":"2024-10-03T00:00:00Z","timestamp":1727913600000},"content-version":"vor","delay-in-days":276,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Hyperspectral imaging (HSI) is emerging as a promising novel imaging modality with various potential surgical applications. Currently available cameras, however, suffer from poor integration into the clinical workflow because they require the lights to be switched off, or the camera to be manually recalibrated as soon as lighting conditions change. Given this critical bottleneck, the contribution of this paper is threefold: (1) We demonstrate that dynamically changing lighting conditions in the operating room dramatically affect the performance of HSI applications, namely physiological parameter estimation, and surgical scene segmentation. (2) We propose a novel learning-based approach to automatically recalibrating hyperspectral images during surgery and show that it is sufficiently accurate to replace the tedious process of white reference-based recalibration. (3) Based on a total of 742 HSI cubes from a phantom, porcine models, and rats we show that our recalibration method not only outperforms previously proposed methods, but also generalizes across species, lighting conditions, and image processing tasks. Due to its simple workflow integration as well as high accuracy, speed, and generalization capabilities, our method could evolve as a central component in clinical surgical HSI.<\/jats:p>","DOI":"10.1007\/978-3-031-72089-5_12","type":"book-chapter","created":{"date-parts":[[2024,10,2]],"date-time":"2024-10-02T16:02:20Z","timestamp":1727884940000},"page":"120-131","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Deep Intra-operative Illumination Calibration of\u00a0Hyperspectral Cameras"],"prefix":"10.1007","author":[{"given":"Alexander","family":"Baumann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonardo","family":"Ayala","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Studier-Fischer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Sellner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Berkin","family":"\u00d6zdemir","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karl-Friedrich","family":"Kowalewski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Slobodan","family":"Ilic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Silvia","family":"Seidlitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lena","family":"Maier-Hein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,10,3]]},"reference":[{"key":"12_CR1","doi-asserted-by":"crossref","unstructured":"Ayala, L., Adler, T.J., Seidlitz, S., Wirkert, S., Engels, C., Seitel, A., Sellner, J., Aksenov, A., Bodenbach, M., Bader, P., et\u00a0al.: Spectral imaging enables contrast agent\u2013free real-time ischemia monitoring in laparoscopic surgery. Science advances 9(10), eadd6778 (2023)","DOI":"10.1126\/sciadv.add6778"},{"key":"12_CR2","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1007\/s11548-020-02195-y","volume":"15","author":"L Ayala","year":"2020","unstructured":"Ayala, L., Seidlitz, S., Vemuri, A., Wirkert, S.J., Kirchner, T., Adler, T.J., Engels, C., Teber, D., Maier-Hein, L.: Light source calibration for multispectral imaging in surgery. International Journal of Computer Assisted Radiology and Surgery 15, 1117\u20131125 (2020)","journal-title":"International Journal of Computer Assisted Radiology and Surgery"},{"key":"12_CR3","doi-asserted-by":"crossref","unstructured":"Ayala, L.A., Wirkert, S.J., Gr\u00f6hl, J., Herrera, M.A., Hernandez-Aguilera, A., Vemuri, A., Santos, E., Maier-Hein, L.: Live monitoring of haemodynamic changes with multispectral image analysis. In: OR 2.0 Context-Aware Operating Theaters and Machine Learning in Clinical Neuroimaging: Second International Workshop, OR 2.0 2019, and Second International Workshop, MLCN 2019, Held in Conjunction with MICCAI 2019, Shenzhen, China, October 13 and 17, 2019, Proceedings 2. pp. 38\u201346. Springer (2019)","DOI":"10.1007\/978-3-030-32695-1_5"},{"issue":"4","key":"12_CR4","doi-asserted-by":"publisher","first-page":"046001","DOI":"10.1117\/1.JMI.10.4.046001","volume":"10","author":"A Bahl","year":"2023","unstructured":"Bahl, A., Horgan, C.C., Janatka, M., MacCormac, O.J., Noonan, P., Xie, Y., Qiu, J., Cavalcanti, N., F\u00fcrnstahl, P., Ebner, M., et\u00a0al.: Synthetic white balancing for intra-operative hyperspectral imaging. Journal of Medical Imaging 10(4), 046001\u2013046001 (2023)","journal-title":"Journal of Medical Imaging"},{"issue":"1","key":"12_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0016-0032(80)90058-7","volume":"310","author":"G Buchsbaum","year":"1980","unstructured":"Buchsbaum, G.: A spatial processor model for object colour perception. Journal of the Franklin institute 310(1), 1\u201326 (1980)","journal-title":"Journal of the Franklin institute"},{"key":"12_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2020.101699","volume":"63","author":"NT Clancy","year":"2020","unstructured":"Clancy, N.T., Jones, G., Maier-Hein, L., Elson, D.S., Stoyanov, D.: Surgical spectral imaging. Medical image analysis 63, 101699 (2020)","journal-title":"Medical image analysis"},{"key":"12_CR7","doi-asserted-by":"crossref","unstructured":"Das, P., Liu, Y., Karaoglu, S., Gevers, T.: Generative models for multi-illumination color constancy. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision. pp. 1194\u20131203 (2021)","DOI":"10.1109\/ICCVW54120.2021.00139"},{"issue":"29","key":"12_CR8","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6463\/abfbf6","volume":"54","author":"M Ebner","year":"2021","unstructured":"Ebner, M., Nabavi, E., Shapey, J., Xie, Y., Liebmann, F., Spirig, J.M., Hoch, A., Farshad, M., Saeed, S.R., Bradford, R., et\u00a0al.: Intraoperative hyperspectral label-free imaging: from system design to first-in-patient translation. Journal of Physics D: Applied Physics 54(29), 294003 (2021)","journal-title":"Journal of Physics D: Applied Physics"},{"issue":"9","key":"12_CR9","doi-asserted-by":"publisher","first-page":"4387","DOI":"10.1109\/TIP.2019.2908783","volume":"28","author":"SB Gao","year":"2019","unstructured":"Gao, S.B., Ren, Y.Z., Zhang, M., Li, Y.J.: Combining bottom-up and top-down visual mechanisms for color constancy under varying illumination. IEEE Transactions on Image Processing 28(9), 4387\u20134400 (2019)","journal-title":"IEEE Transactions on Image Processing"},{"issue":"6","key":"12_CR10","doi-asserted-by":"publisher","first-page":"756","DOI":"10.3390\/cancers11060756","volume":"11","author":"M Halicek","year":"2019","unstructured":"Halicek, M., Fabelo, H., Ortega, S., Callico, G.M., Fei, B.: In-vivo and ex-vivo tissue analysis through hyperspectral imaging techniques: revealing the invisible features of cancer. Cancers 11(6), \u00a0756 (2019)","journal-title":"Cancers"},{"issue":"6","key":"12_CR11","doi-asserted-by":"publisher","first-page":"060503","DOI":"10.1117\/1.JBO.22.6.060503","volume":"22","author":"M Halicek","year":"2017","unstructured":"Halicek, M., Lu, G., Little, J.V., Wang, X., Patel, M., Griffith, C.C., El-Deiry, M.W., Chen, A.Y., Fei, B.: Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. Journal of biomedical optics 22(6), 060503\u2013060503 (2017)","journal-title":"Journal of biomedical optics"},{"key":"12_CR12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 770\u2013778 (2016)","DOI":"10.1109\/CVPR.2016.90"},{"issue":"11","key":"12_CR13","doi-asserted-by":"publisher","first-page":"2064","DOI":"10.1088\/0967-3334\/37\/11\/2064","volume":"37","author":"A Holmer","year":"2016","unstructured":"Holmer, A., Tetschke, F., Marotz, J., Malberg, H., Markgraf, W., Thiele, C., Kulcke, A.: Oxygenation and perfusion monitoring with a hyperspectral camera system for chemical based tissue analysis of skin and organs. Physiological measurement 37(11), \u00a02064 (2016)","journal-title":"Physiological measurement"},{"key":"12_CR14","doi-asserted-by":"publisher","first-page":"8964","DOI":"10.1109\/ACCESS.2018.2808502","volume":"6","author":"MA Hussain","year":"2018","unstructured":"Hussain, M.A., Akbari, A.S.: Color constancy algorithm for mixed-illuminant scene images. IEEE Access 6, 8964\u20138976 (2018)","journal-title":"IEEE Access"},{"key":"12_CR15","doi-asserted-by":"crossref","unstructured":"Kulcke, A., Holmer, A., Wahl, P., Siemers, F., Wild, T., Daeschlein, G.: A compact hyperspectral camera for measurement of perfusion parameters in medicine. Biomedical Engineering\/Biomedizinische Technik 63(5), 519\u2013527 (2018)","DOI":"10.1515\/bmt-2017-0145"},{"issue":"6","key":"12_CR16","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1038\/scientificamerican1277-108","volume":"237","author":"EH Land","year":"1977","unstructured":"Land, E.H.: The retinex theory of color vision. Scientific american 237(6), 108\u2013129 (1977)","journal-title":"Scientific american"},{"key":"12_CR17","doi-asserted-by":"crossref","unstructured":"Li, Y., Fu, Q., Heidrich, W.: Multispectral illumination estimation using deep unrolling network. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision. pp. 2672\u20132681 (2021)","DOI":"10.1109\/ICCV48922.2021.00267"},{"key":"12_CR18","unstructured":"Maier-Hein, L., Reinke, A., Godau, P., Tizabi, M.D., Buettner, F., Christodoulou, E., Glocker, B., Isensee, F., Kleesiek, J., Kozubek, M., et\u00a0al.: Metrics reloaded: recommendations for image analysis validation. Nature methods pp. 1\u201318 (2024)"},{"issue":"11","key":"12_CR19","doi-asserted-by":"publisher","first-page":"5383","DOI":"10.1109\/TIP.2016.2605003","volume":"25","author":"L Mutimbu","year":"2016","unstructured":"Mutimbu, L., Robles-Kelly, A.: Multiple illuminant color estimation via statistical inference on factor graphs. IEEE Transactions on Image Processing 25(11), 5383\u20135396 (2016)","journal-title":"IEEE Transactions on Image Processing"},{"key":"12_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102488","volume":"80","author":"S Seidlitz","year":"2022","unstructured":"Seidlitz, S., Sellner, J., Odenthal, J., \u00d6zdemir, B., Studier-Fischer, A., Kn\u00f6dler, S., Ayala, L., Adler, T.J., Kenngott, H.G., Tizabi, M., et\u00a0al.: Robust deep learning-based semantic organ segmentation in hyperspectral images. Medical Image Analysis 80, 102488 (2022)","journal-title":"Medical Image Analysis"},{"key":"12_CR21","doi-asserted-by":"crossref","unstructured":"Sellner, J., Seidlitz, S., Studier-Fischer, A., Motta, A., \u00d6zdemir, B., M\u00fcller-Stich, B.P., Nickel, F., Maier-Hein, L.: Semantic segmentation of surgical hyperspectral images under geometric domain shifts. arXiv preprint arXiv:2303.10972 (2023)","DOI":"10.1007\/978-3-031-43996-4_59"},{"issue":"9","key":"12_CR22","doi-asserted-by":"publisher","DOI":"10.1002\/jbio.201800455","volume":"12","author":"J Shapey","year":"2019","unstructured":"Shapey, J., Xie, Y., Nabavi, E., Bradford, R., Saeed, S.R., Ourselin, S., Vercauteren, T.: Intraoperative multispectral and hyperspectral label-free imaging: A systematic review of in vivo clinical studies. Journal of biophotonics 12(9), e201800455 (2019)","journal-title":"Journal of biophotonics"},{"key":"12_CR23","doi-asserted-by":"crossref","unstructured":"Sidorov, O.: Conditional gans for multi-illuminant color constancy: Revolution or yet another approach? In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition workshops. pp.\u00a00\u20130 (2019)","DOI":"10.1109\/CVPRW.2019.00225"},{"issue":"1","key":"12_CR24","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1038\/s41597-023-02315-8","volume":"10","author":"A Studier-Fischer","year":"2023","unstructured":"Studier-Fischer, A., Seidlitz, S., Sellner, J., Bressan, M., \u00d6zdemir, B., Ayala, L., Odenthal, J., Knoedler, S., Kowalewski, K.F., Haney, C.M., et\u00a0al.: Heiporspectral-the heidelberg porcine hyperspectral imaging dataset of 20 physiological organs. Scientific Data 10(1), \u00a0414 (2023)","journal-title":"Scientific Data"},{"issue":"4","key":"12_CR25","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.1109\/TBME.2020.3026683","volume":"68","author":"S Trajanovski","year":"2020","unstructured":"Trajanovski, S., Shan, C., Weijtmans, P.J., de\u00a0Koning, S.G.B., Ruers, T.J.: Tongue tumor detection in hyperspectral images using deep learning semantic segmentation. IEEE transactions on biomedical engineering 68(4), 1330\u20131340 (2020)","journal-title":"IEEE transactions on biomedical engineering"},{"key":"12_CR26","doi-asserted-by":"crossref","unstructured":"Wirkert, S.J., Vemuri, A.S., Kenngott, H.G., Moccia, S., G\u00f6tz, M., Mayer, B.F., Maier-Hein, K.H., Elson, D.S., Maier-Hein, L.: Physiological parameter estimation from multispectral images unleashed. In: Medical Image Computing and Computer Assisted Intervention- MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part III 20. pp. 134\u2013141. Springer (2017)","DOI":"10.1007\/978-3-319-66179-7_16"}],"container-title":["Lecture Notes in Computer Science","Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2024"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-72089-5_12","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,2]],"date-time":"2024-10-02T16:10:39Z","timestamp":1727885439000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-72089-5_12"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"ISBN":["9783031720888","9783031720895"],"references-count":26,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-72089-5_12","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024]]},"assertion":[{"value":"3 October 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure of Interests"}},{"value":"MICCAI","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Medical Image Computing and Computer-Assisted Intervention","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Marrakesh","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Morocco","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"7 October 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 October 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"27","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"miccai2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/conferences.miccai.org\/2024\/en\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}