{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T21:53:15Z","timestamp":1768341195918,"version":"3.49.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T00:00:00Z","timestamp":1702080000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T00:00:00Z","timestamp":1702080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010662","name":"H2020 Excellent Science","doi-asserted-by":"publisher","award":["863146"],"award-info":[{"award-number":["863146"]}],"id":[{"id":"10.13039\/100010662","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>In twin-to-twin transfusion syndrome (TTTS), abnormal vascular anastomoses in the monochorionic placenta can produce uneven blood flow between the two fetuses. In the current practice, TTTS is treated surgically by closing abnormal anastomoses using laser ablation. This surgery is minimally invasive and relies on fetoscopy. Limited field of view makes anastomosis identification a challenging task for the surgeon.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>To tackle this challenge, we propose a learning-based framework for in vivo fetoscopy frame registration for field-of-view expansion. The novelties of this framework rely on a learning-based keypoint proposal network and an encoding strategy to filter (i) irrelevant keypoints based on fetoscopic semantic image segmentation and (ii) inconsistent homographies.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We validate our framework on a dataset of six intraoperative sequences from six TTTS surgeries from six different women against the most recent state-of-the-art algorithm, which relies on the segmentation of placenta vessels.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The proposed framework achieves higher performance compared to the state of the art, paving the way for robust mosaicking to provide surgeons with context awareness during TTTS surgery.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-023-03025-7","type":"journal-article","created":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T02:01:47Z","timestamp":1702087307000},"page":"481-492","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Learning-based keypoint registration for fetoscopic mosaicking"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5214-9443","authenticated-orcid":false,"given":"Alessandro","family":"Casella","sequence":"first","affiliation":[]},{"given":"Sophia","family":"Bano","sequence":"additional","affiliation":[]},{"given":"Francisco","family":"Vasconcelos","sequence":"additional","affiliation":[]},{"given":"Anna L.","family":"David","sequence":"additional","affiliation":[]},{"given":"Dario","family":"Paladini","sequence":"additional","affiliation":[]},{"given":"Jan","family":"Deprest","sequence":"additional","affiliation":[]},{"given":"Elena","family":"De Momi","sequence":"additional","affiliation":[]},{"given":"Leonardo S.","family":"Mattos","sequence":"additional","affiliation":[]},{"given":"Sara","family":"Moccia","sequence":"additional","affiliation":[]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,12,9]]},"reference":[{"issue":"2","key":"3025_CR1","first-page":"107","volume":"39","author":"A Baschat","year":"2011","unstructured":"Baschat A, Chmait RH, Deprest J, Gratac\u00f3s E, Hecher K, Kontopoulos E, Quintero R, Skupski DW, Valsky DV, Ville Y (2011) Twin-to-twin transfusion syndrome (TTTS). J Perinat Med 39(2):107\u2013112","journal-title":"J Perinat Med"},{"key":"3025_CR2","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.ajog.2012.09.025","volume":"208","author":"L Lewi","year":"2013","unstructured":"Lewi L, Deprest J, Hecher K (2013) The vascular anastomoses in monochorionic twin pregnancies and their clinical consequences. Am J Obstet Gynecol 208:19\u201330","journal-title":"Am J Obstet Gynecol"},{"issue":"1","key":"3025_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1159\/000331165","volume":"31","author":"V Beck","year":"2012","unstructured":"Beck V, Lewi P, Gucciardo L, Devlieger R (2012) Preterm prelabor rupture of membranes and fetal survival after minimally invasive fetal surgery: a systematic review of the literature. Fetal Diagn Ther 31(1):1\u20139","journal-title":"Fetal Diagn Ther"},{"issue":"3","key":"3025_CR4","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1017\/thg.2016.32","volume":"19","author":"R Cincotta","year":"2016","unstructured":"Cincotta R, Kumar S (2016) Future directions in the management of twin-to-twin transfusion syndrome. Twin Res Hum Genet 19(3):285\u2013291","journal-title":"Twin Res Hum Genet"},{"issue":"2\u20133","key":"3025_CR5","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1016\/j.placenta.2006.03.005","volume":"28","author":"E Lopriore","year":"2007","unstructured":"Lopriore E, Middeldorp JM, Oepkes D, Klumper FJ, Walther FJ, Vandenbussche FPHA (2007) Residual anastomoses after fetoscopic laser surgery in twin-to-twin transfusion syndrome: frequency, associated risks and outcome. Placenta 28(2\u20133):204\u2013208","journal-title":"Placenta"},{"key":"3025_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102306","volume":"76","author":"L Maier-Hein","year":"2022","unstructured":"Maier-Hein L, Eisenmann M, Sarikaya D, M\u00e4rz K, Collins T, Malpani A, Fallert J, Feussner H, Giannarou S, Mascagni P et al (2022) Surgical data science-from concepts toward clinical translation. Med Image Anal 76:102306","journal-title":"Med Image Anal"},{"key":"3025_CR7","doi-asserted-by":"crossref","unstructured":"Bano S, Casella A, Vasconcelos F, Qayyum A, Benzinou A, Mazher M, Meriaudeau F, Lena C, Cintorrino IA, Paolis GRD, Biagioli J, Grechishnikova D, Jiao J, Bai B, Qiao Y, Bhattarai B, Gaire RR, Subedi R, Vazquez E, Plotka S, Lisowska A, Sitek A, Attilakos G, Wimalasundera R, David AL, Paladini D, Deprest J, Momi ED, Mattos LS, Moccia S, Stoyanov D (2023) Placental vessel segmentation and registration in fetoscopy: literature review and MICCAI FetReg2021 challenge findings","DOI":"10.1016\/j.media.2023.103066"},{"issue":"11","key":"3025_CR8","doi-asserted-by":"publisher","first-page":"1807","DOI":"10.1007\/s11548-020-02242-8","volume":"15","author":"S Bano","year":"2020","unstructured":"Bano S, Vasconcelos F, Tella-Amo M, Dwyer G, Gruijthuijsen C, Vander Poorten E, Vercauteren T, Ourselin S, Deprest J, Stoyanov D (2020) Deep learning-based fetoscopic mosaicking for field-of-view expansion. Int J Comput Assist Radiol Surg 15(11):1807\u20131816","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"4","key":"3025_CR9","first-page":"044001","volume":"7","author":"J Jalili","year":"2020","unstructured":"Jalili J, Hejazi SM, Riazi-Esfahani M, Eliasi A, Ebrahimi M, Seydi M, Fard MA, Ahmadian A (2020) Retinal image mosaicking using scale-invariant feature transformation feature descriptors and Voronoi diagram. J Med Imaging 7(4):044001\u2013044001","journal-title":"J Med Imaging"},{"key":"3025_CR10","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1007\/s00450-010-0135-z","volume":"26","author":"A Behrens","year":"2011","unstructured":"Behrens A, Bommes M, Stehle T, Gross S, Leonhardt S, Aach T (2011) Real-time image composition of bladder mosaics in fluorescence endoscopy. Comput Sci-Res Dev 26:51\u201364","journal-title":"Comput Sci-Res Dev"},{"key":"3025_CR11","doi-asserted-by":"crossref","unstructured":"Du P, Zhou Y, Xing Q, Hu X (2011) Improved sift matching algorithm for 3d reconstruction from endoscopic images. In: Proceedings of the 10th international conference on virtual reality continuum and its applications in industry, pp 561\u2013564","DOI":"10.1145\/2087756.2087864"},{"key":"3025_CR12","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2022.840594","volume":"16","author":"Y Liu","year":"2022","unstructured":"Liu Y, Tian J, Hu R, Yang B, Liu S, Yin L, Zheng W (2022) Improved feature point pair purification algorithm based on sift during endoscope image stitching. Front Neurorobot 16:840594","journal-title":"Front Neurorobot"},{"key":"3025_CR13","doi-asserted-by":"crossref","unstructured":"Daga P, Chadebecq F, Shakir DI, Herrera LCG, Tella M, Dwyer G, David AL, Deprest J, Stoyanov D, Vercauteren T, Ourselin S (2016) Real-time mosaicing of fetoscopic videos using SIFT. In: Medical imaging 2016: image-guided procedures, robotic interventions, and modeling, vol 9786. International Society for Optics and Photonics, p 97861","DOI":"10.1117\/12.2217172"},{"key":"3025_CR14","unstructured":"Reeff M, Gerhard F, Cattin P, G\u00e1bor S (2006) Mosaicing of endoscopic placenta images. INFORMATIK"},{"key":"3025_CR15","doi-asserted-by":"crossref","unstructured":"Bano S, Vasconcelos F, Shepherd LM, Vander\u00a0Poorten E, Vercauteren T, Ourselin S, David AL, Deprest J, Stoyanov D (2020) Deep placental vessel segmentation for fetoscopic mosaicking. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 763\u2013773","DOI":"10.1007\/978-3-030-59716-0_73"},{"issue":"5","key":"3025_CR16","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1007\/s11548-018-1728-4","volume":"13","author":"L Peter","year":"2018","unstructured":"Peter L, Tella-Amo M, Shakir DI, Attilakos G, Wimalasundera R, Deprest J, Ourselin S, Vercauteren T (2018) Retrieval and registration of long-range overlapping frames for scalable mosaicking of in vivo fetoscopy. Int J Comput Assist Radiol Surg 13(5):713\u2013720","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"1","key":"3025_CR17","doi-asserted-by":"publisher","first-page":"24","DOI":"10.3390\/jimaging4010024","volume":"4","author":"F Gaisser","year":"2018","unstructured":"Gaisser F, Peeters SH, Lenseigne BA, Jonker PP, Oepkes D (2018) Stable image registration for in-vivo fetoscopic panorama reconstruction. J Imaging 4(1):24","journal-title":"J Imaging"},{"key":"3025_CR18","doi-asserted-by":"crossref","unstructured":"Bano S, Vasconcelos F, Amo MT, Dwyer G, Gruijthuijsen C, Deprest J, Ourselin S, Vander\u00a0Poorten E, Vercauteren T, Stoyanov D (2019) Deep sequential mosaicking of fetoscopic videos. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 311\u2013319","DOI":"10.1007\/978-3-030-32239-7_35"},{"key":"3025_CR19","doi-asserted-by":"publisher","first-page":"1125","DOI":"10.1007\/s11548-022-02623-1","volume":"17","author":"O Alabi","year":"2022","unstructured":"Alabi O, Bano S, Vasconcelos F, David AL, Deprest J, Stoyanov D (2022) Robust fetoscopic mosaicking from deep learned flow fields. Int J Comput Assist Radiol Surg 17:1125\u20131134","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3025_CR20","doi-asserted-by":"publisher","DOI":"10.1007\/s42452-021-04227-x","author":"STH Shah","year":"2021","unstructured":"Shah STH, Xuezhi X (2021) Traditional and modern strategies for optical flow: an investigation. SN Appl Sci. https:\/\/doi.org\/10.1007\/s42452-021-04227-x","journal-title":"SN Appl Sci"},{"key":"3025_CR21","doi-asserted-by":"crossref","unstructured":"Simo-Serra E, Trulls E, Ferraz L, Kokkinos I, Fua P, Moreno-Noguer F (2015) Discriminative learning of deep convolutional feature point descriptors. In: Proceedings of the IEEE international conference on computer vision, pp 118\u2013126","DOI":"10.1109\/ICCV.2015.22"},{"key":"3025_CR22","doi-asserted-by":"crossref","unstructured":"Tian Y, Fan B, Wu F (2017) L2-net: deep learning of discriminative patch descriptor in Euclidean space. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 661\u2013669","DOI":"10.1109\/CVPR.2017.649"},{"key":"3025_CR23","doi-asserted-by":"crossref","unstructured":"Luo Z, Shen T, Zhou L, Zhu S, Zhang R, Yao Y, Fang T, Quan L (2018) Geodesc: learning local descriptors by integrating geometry constraints. In: Proceedings of the European conference on computer vision (ECCV), pp 168\u2013183","DOI":"10.1007\/978-3-030-01240-3_11"},{"issue":"5","key":"3025_CR24","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","volume":"31","author":"R Mur-Artal","year":"2015","unstructured":"Mur-Artal R, Montiel JMM, Tard\u00f3s JD (2015) ORB-SLAM: a versatile and accurate monocular slam system. IEEE Trans Rob 31(5):1147\u20131163. https:\/\/doi.org\/10.1109\/TRO.2015.2463671","journal-title":"IEEE Trans Rob"},{"key":"3025_CR25","doi-asserted-by":"crossref","unstructured":"DeTone D, Malisiewicz T, Rabinovich A (2018) Superpoint: self-supervised interest point detection and description. In: IEEE conference on computer vision and pattern recognition, pp 224\u2013236","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"3025_CR26","doi-asserted-by":"publisher","first-page":"118696","DOI":"10.1016\/j.eswa.2022.118696","volume":"213","author":"M Farhat","year":"2023","unstructured":"Farhat M, Chaabouni-Chouayakh H, Ben-Hamadou A (2023) Self-supervised endoscopic image key-points matching. Expert Syst Appl 213:118696. https:\/\/doi.org\/10.1016\/j.eswa.2022.118696","journal-title":"Expert Syst Appl"},{"key":"3025_CR27","doi-asserted-by":"crossref","unstructured":"Azizi S, Mustafa B, Ryan F, Beaver Z, Freyberg J, Deaton J, Loh A, Karthikesalingam A, Kornblith S, Chen T, et al (2021) Big self-supervised models advance medical image classification. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 3478\u20133488","DOI":"10.1109\/ICCV48922.2021.00346"},{"key":"3025_CR28","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Doll\u00e1r P, Zitnick CL (2014) Microsoft coco: common objects in context. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) European conference on computer vision. Springer, Cham, pp 740\u2013755","DOI":"10.1007\/978-3-319-10602-1_48"},{"issue":"9","key":"3025_CR29","doi-asserted-by":"publisher","first-page":"1561","DOI":"10.1007\/s11548-020-02166-3","volume":"15","author":"MA Ahmad","year":"2020","unstructured":"Ahmad MA, Ourak M, Gruijthuijsen C, Deprest J, Vercauteren T, Poorten EV (2020) Deep learning-based monocular placental pose estimation: towards collaborative robotics in fetoscopy. Int J Comput-Assist Radiol Surg 15(9):1561\u20131571","journal-title":"Int J Comput-Assist Radiol Surg"},{"key":"3025_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102008","volume":"70","author":"A Casella","year":"2021","unstructured":"Casella A, Moccia S, Paladini D, Frontoni E, De Momi E, Mattos LS (2021) A shape-constraint adversarial framework with instance-normalized spatio-temporal features for inter-fetal membrane segmentation. Med Image Anal 70:102008","journal-title":"Med Image Anal"},{"key":"3025_CR31","doi-asserted-by":"crossref","unstructured":"Mertens T, Kautz J, Van\u00a0Reeth F (2007) Exposure fusion. In: 15th Pacific conference on computer graphics and applications, pp 382\u2013390","DOI":"10.1109\/PG.2007.17"},{"key":"3025_CR32","doi-asserted-by":"publisher","unstructured":"Liu X, Zheng Y, Killeen B, Ishii M, Hager GD, Taylor RH, Unberath M (2020) Extremely dense point correspondences using a learned feature descriptor. In: IEEE\/CVF conference on computer vision and pattern recognition, pp 4846\u20134855. https:\/\/doi.org\/10.1109\/CVPR42600.2020.00490","DOI":"10.1109\/CVPR42600.2020.00490"},{"key":"3025_CR33","doi-asserted-by":"crossref","unstructured":"Li L, Bano S, Deprest J, David AL, Stoyanov D, Vasconcelos F (2021) Globally optimal fetoscopic mosaicking based on pose graph optimisation with affine constraints. IEEE Robot Autom Lett 6(4):7831\u20137838","DOI":"10.1109\/LRA.2021.3100938"},{"key":"3025_CR34","unstructured":"Reinke A, Eisenmann M, Tizabi MD, Sudre CH, R\u00e4dsch T, Antonelli M, Arbel T, Bakas S, Cardoso MJ, Cheplygina V, et al (2021) Common limitations of performance metrics in biomedical image analysis. In: Medical imaging with deep learning"},{"key":"3025_CR35","unstructured":"Reinke A, Maier-Hein L, Christodoulou E, Glocker B, Scholz P, Isensee F, Kleesiek J, Kozubek M, Reyes M, Riegler MA, et al (2022) Metrics reloaded-a new recommendation framework for biomedical image analysis validation. In: Medical imaging with deep learning"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-023-03025-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-023-03025-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-023-03025-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,21]],"date-time":"2024-02-21T14:22:15Z","timestamp":1708525335000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-023-03025-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,9]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["3025"],"URL":"https:\/\/doi.org\/10.1007\/s11548-023-03025-7","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,9]]},"assertion":[{"value":"30 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No benefits in any form have been or will be received from a commercial party related directly or indirectly to the subjects of this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The proposed study is a retrospective study. Data used for the analysis were acquired during actual surgery procedures and then were anonymized to allow researchers to conduct the study. All the patients gave their consent on data processing for research purpose. The study fully respects and promotes the values of freedom, autonomy, integrity and dignity of the person, social solidarity and justice, including fairness of access. The study was carried out in compliance with the principles laid down in the Declaration of Helsinki, in accordance with the Guidelines for Good Clinical Practice.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}