{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T12:08:22Z","timestamp":1747224502310,"version":"3.37.3"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T00:00:00Z","timestamp":1648771200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T00:00:00Z","timestamp":1648771200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"ERC Starting Grant","award":["714562"],"award-info":[{"award-number":["714562"]}]},{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["WT203148\/Z\/16\/Z"],"award-info":[{"award-number":["WT203148\/Z\/16\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Wellcome Trust\/EPSRC","award":["203145Z\/16\/Z"],"award-info":[{"award-number":["203145Z\/16\/Z"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Purpose<\/jats:title><jats:p>Intra-retinal delivery of novel sight-restoring therapies will require the precision of robotic systems accompanied by excellent visualisation of retinal layers. Intra-operative Optical Coherence Tomography (iOCT) provides cross-sectional retinal images in real time but at the cost of image quality that is insufficient for intra-retinal therapy delivery.This paper proposes a super-resolution methodology that improves iOCT image quality leveraging spatiotemporal consistency of incoming iOCT video streams.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>To overcome the absence of ground truth high-resolution (HR) images, we first generate HR iOCT images by fusing spatially aligned iOCT video frames. Then, we automatically assess the quality of the HR images on key retinal layers using a deep semantic segmentation model. Finally, we use image-to-image translation models (Pix2Pix and CycleGAN) to enhance the quality of LR images via quality transfer from the estimated HR domain.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our proposed methodology generates iOCT images of improved quality according to both full-reference and no-reference metrics. A qualitative study with expert clinicians also confirms the improvement in the delineation of pertinent layers and in the reduction of artefacts. Furthermore, our approach outperforms conventional denoising filters and the learning-based state-of-the-art.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The results indicate that the learning-based methods using the estimated, through our pipeline, HR domain can be used to enhance the iOCT image quality. Therefore, the proposed method can computationally augment the capabilities of iOCT imaging helping this modality support the vitreoretinal surgical interventions of the future.<\/jats:p><\/jats:sec>","DOI":"10.1007\/s11548-022-02603-5","type":"journal-article","created":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T20:48:09Z","timestamp":1648846089000},"page":"877-883","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Surgical biomicroscopy-guided intra-operative optical coherence tomography (iOCT) image super-resolution"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5011-0521","authenticated-orcid":false,"given":"Charalampos","family":"Komninos","sequence":"first","affiliation":[]},{"given":"Theodoros","family":"Pissas","sequence":"additional","affiliation":[]},{"given":"Lina","family":"Mekki","sequence":"additional","affiliation":[]},{"given":"Blanca","family":"Flores","sequence":"additional","affiliation":[]},{"given":"Edward","family":"Bloch","sequence":"additional","affiliation":[]},{"given":"Tom","family":"Vercauteren","sequence":"additional","affiliation":[]},{"given":"S\u00e9bastien","family":"Ourselin","sequence":"additional","affiliation":[]},{"given":"Lyndon","family":"Da Cruz","sequence":"additional","affiliation":[]},{"given":"Christos","family":"Bergeles","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,4,1]]},"reference":[{"key":"2603_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.preteyeres.2015.06.004","volume":"48","author":"H Nazari","year":"2015","unstructured":"Nazari H, Zhang L, Zhu D, Chader GJ, Falabella P, Stefanini F, Rowland T, Clegg DO, Kashani AH, Hinton DR, Humayun MS (2015) Stem cell based therapies for age-related macular degeneration: the promises and the challenges. Progress Ret Eye Res 48:1\u201339","journal-title":"Progress Ret Eye Res"},{"issue":"4","key":"2603_CR2","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1038\/nbt.4114","volume":"36","author":"L da Cruz","year":"2018","unstructured":"da Cruz L, Fynes K, Georgiadis O, Kerby J, Luo YH, Ahmado A, Vernon A, Daniels JT, Nommiste B, Hasan SM, Gooljar SB, Carr AF, Vugler A, Ramsden CM, Bictash M, Fenster M, Steer J, Harbinson T, Wilbrey A, Tufail A, Feng G, Whitlock M, Robson AG, Holder GE, Sagoo MS, Loudon PT, Whiting P, Coffey PJ (2018) Phase 1 clinical study of an embryonic stem cell-derived retinal pigment epithelium patch in age-related macular degeneration. Nature Biotech 36(4):328","journal-title":"Nature Biotech"},{"key":"2603_CR3","doi-asserted-by":"crossref","unstructured":"de Jong EK, Geerlings MJ, den Hollander AI (2020) Age-related macular degeneration. Genetics and genomics of eye disease, 155\u2013180","DOI":"10.1016\/B978-0-12-816222-4.00010-1"},{"issue":"7","key":"2603_CR4","doi-asserted-by":"publisher","first-page":"1901","DOI":"10.1364\/JOSAA.24.001901","volume":"24","author":"A Ozcan","year":"2007","unstructured":"Ozcan A, Bilenca A, Desjardins AE, Bouma BE, Tearney GJ (2007) Speckle reduction in optical coherence tomography images using digital filtering. JOSA A 24(7):1901\u20131910","journal-title":"JOSA A"},{"issue":"5","key":"2603_CR5","doi-asserted-by":"publisher","first-page":"1815","DOI":"10.1364\/BOE.7.001815","volume":"7","author":"C Viehland","year":"2016","unstructured":"Viehland C, Keller B, Carrasco-Zevallos OM, Nankivil D, Shen L, Mangalesh S, Viet DT, Kuo AN, Toth CA, Izatt JA (2016) Enhanced volumetric visualization for real time 4D intraoperative ophthalmic swept-source OCT. Biomed Optic Exp 7(5):1815","journal-title":"Biomed Optic Exp"},{"issue":"24","key":"2603_CR6","doi-asserted-by":"publisher","first-page":"2878","DOI":"10.1364\/OL.29.002878","volume":"29","author":"DC Adler","year":"2004","unstructured":"Adler DC, Ko TH, Fujimoto JG (2004) Speckle reduction in optical coherence tomography images by use of a spatially adaptive wavelet filter. Optic Lett 29(24):2878\u20132880","journal-title":"Optic Lett"},{"issue":"23","key":"2603_CR7","doi-asserted-by":"publisher","first-page":"24048","DOI":"10.1364\/OE.18.024048","volume":"18","author":"R Bernardes","year":"2010","unstructured":"Bernardes R, Maduro C, Serranho P, Ara\u00fajo A, Barbeiro S, Cunha-Vaz J (2010) Improved adaptive complex diffusion despeckling filter. Optics Exp 18(23):24048\u201324059","journal-title":"Optics Exp"},{"issue":"2","key":"2603_CR8","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1136\/bjo.2004.045989","volume":"89","author":"B Sander","year":"2005","unstructured":"Sander B, Larsen M, Thrane L, Hougaard JL, J\u00f8rgensen TM (2005) Enhanced optical coherence tomography imaging by multiple scan averaging. Br J Ophthalm 89(2):207\u2013212","journal-title":"Br J Ophthalm"},{"key":"2603_CR9","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Advances in neural information processing systems, 27"},{"key":"2603_CR10","doi-asserted-by":"crossref","unstructured":"Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp. 694\u2013711 . Springer, Berlin","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"2603_CR11","doi-asserted-by":"crossref","unstructured":"Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International conference on computer vision, pp. 2223\u20132232","DOI":"10.1109\/ICCV.2017.244"},{"key":"2603_CR12","doi-asserted-by":"crossref","unstructured":"Isola P, Zhu J-Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1125\u20131134","DOI":"10.1109\/CVPR.2017.632"},{"key":"2603_CR13","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.media.2019.01.011","volume":"53","author":"D Rav\u00ec","year":"2019","unstructured":"Rav\u00ec D, Szczotka AB, Pereira SP, Vercauteren T (2019) Adversarial training with cycle consistency for unsupervised super-resolution in endomicroscopy. Med Image Anal 53:123\u2013131","journal-title":"Med Image Anal"},{"key":"2603_CR14","doi-asserted-by":"crossref","unstructured":"Wolterink JM, Dinkla AM, Savenije MH, Seevinck PR, van\u00a0denBerg CA, I\u0161gum I(2017) Deep mr to ct synthesis using unpaired data. In: International Workshop on Simulation and Synthesis in Medical Imaging, pp. 14\u201323 . Springer, Berlin","DOI":"10.1007\/978-3-319-68127-6_2"},{"issue":"1","key":"2603_CR15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"SK Devalla","year":"2019","unstructured":"Devalla SK, Subramanian G, Pham TH, Wang X, Perera S, Tun TA, Aung T, Schmetterer L, Thi\u00e9ry AH, Girard MJ (2019) A deep learning approach to denoise optical coherence tomography images of the optic nerve head. Scientif Report 9(1):1\u201313","journal-title":"Scientif Report"},{"key":"2603_CR16","doi-asserted-by":"crossref","unstructured":"Apostolopoulos S, Salas J, Ord\u00f3\u00f1ez JL, Tan SS, Ciller C, Ebneter A, Zinkernagel M, Sznitman R, Wolf S, De Zanet S, Munk MR (2020) Automatically enhanced oct scans of the retina: a proof of concept study. Scientif Report 10(1):1\u20138","DOI":"10.1038\/s41598-020-64724-8"},{"key":"2603_CR17","doi-asserted-by":"publisher","first-page":"101906","DOI":"10.1016\/j.media.2020.101906","volume":"68","author":"G Lazaridis","year":"2021","unstructured":"Lazaridis G, Lorenzi M, Ourselin S, Garway-Heath D (2021) Improving statistical power of glaucoma clinical trials using an ensemble of cyclical generative adversarial networks. Med Image Anal 68:101906","journal-title":"Med Image Anal"},{"issue":"12","key":"2603_CR18","doi-asserted-by":"publisher","first-page":"6205","DOI":"10.1364\/BOE.9.006205","volume":"9","author":"KJ Halupka","year":"2018","unstructured":"Halupka KJ, Antony BJ, Lee MH, Lucy KA, Rai RS, Ishikawa H, Wollstein G, Schuman JS, Garnavi R (2018) Retinal optical coherence tomography image enhancement via deep learning. Biomed Optics Exp 9(12):6205\u20136221","journal-title":"Biomed Optics Exp"},{"key":"2603_CR19","doi-asserted-by":"crossref","unstructured":"Komninos C, Pissas T, Flores B, Bloch E, Vercauteren T, Ourselin S, Cruz LD, Bergeles C(2021) Intra-operative oct (ioct) image quality enhancement: a super-resolution approach using high quality ioct 3d scans. In: International workshop on ophthalmic medical image analysis, pp. 21\u201331 . Springer, Berlin","DOI":"10.1007\/978-3-030-87000-3_3"},{"key":"2603_CR20","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/746150","author":"JS Hardin","year":"2015","unstructured":"Hardin JS, Taibbi G, Nelson SC, Chao D, Vizzeri G (2015) Factors affecting cirrus-hd oct optic disc scan quality: a review with case examples. J Ophthalmol. https:\/\/doi.org\/10.1155\/2015\/746150","journal-title":"J Ophthalmol"},{"key":"2603_CR21","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1007\/978-3-030-01234-2_49","volume-title":"Computer Vision - ECCV 2018","author":"L-C Chen","year":"2018","unstructured":"Chen L-C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer Vision - ECCV 2018. Springer, Cham, pp 833\u2013851"},{"key":"2603_CR22","doi-asserted-by":"crossref","unstructured":"Berman M, Triki AR, Blaschko MB (2018) The lov\u00e1sz-softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2018.00464"},{"key":"2603_CR23","unstructured":"Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S(2017) Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems, 30"},{"issue":"159\u2013168","key":"2603_CR24","first-page":"1","volume":"2005","author":"K Matkovic","year":"2005","unstructured":"Matkovic K, Neumann L, Neumann A, Psik T, Purgathofer W (2005) Global contrast factor-a new approach to image contrast. Computat Aesthet 2005(159\u2013168):1","journal-title":"Computat Aesthet"},{"issue":"3","key":"2603_CR25","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","volume":"20","author":"A Mittal","year":"2012","unstructured":"Mittal A, Soundararajan R, Bovik AC (2012) Making a completely blind image quality analyzer. IEEE Signal Process Letter 20(3):209\u2013212","journal-title":"IEEE Signal Process Letter"},{"issue":"3","key":"2603_CR26","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211\u2013252","journal-title":"Int J Comput Vision"},{"issue":"3","key":"2603_CR27","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/0167-8655(87)90002-X","volume":"6","author":"D Harwood","year":"1987","unstructured":"Harwood D, Subbarao M, Hakalahti H, Davis LS (1987) A new class of edge-preserving smoothing filters. Pattern Recognit Letter 6(3):155\u2013162","journal-title":"Pattern Recognit Letter"},{"key":"2603_CR28","doi-asserted-by":"crossref","unstructured":"Bakker P, van Vliet L.J, Verbeek PW (1999) Edge preserving orientation adaptive filtering. In: Proceedings. 1999 IEEE computer society conference on computer vision and pattern recognition (Cat. No PR00149), 1, pp. 535\u2013540","DOI":"10.1109\/CVPR.1999.786989"},{"issue":"8","key":"2603_CR29","doi-asserted-by":"publisher","first-page":"2080","DOI":"10.1109\/TIP.2007.901238","volume":"16","author":"K Dabov","year":"2007","unstructured":"Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Transact Image Process 16(8):2080\u20132095","journal-title":"IEEE Transact Image Process"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-022-02603-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-022-02603-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-022-02603-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T10:47:38Z","timestamp":1675162058000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-022-02603-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,1]]},"references-count":29,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["2603"],"URL":"https:\/\/doi.org\/10.1007\/s11548-022-02603-5","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2022,4,1]]},"assertion":[{"value":"3 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 March 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 April 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The data were acquired in accordance with the Declaration of Helsinki (1983 Revision) and its ethical principles.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"It was obtained from all individuals that participated in this work.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}}]}}