{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T02:52:48Z","timestamp":1790823168047,"version":"4.1.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2020,4,30]],"date-time":"2020-04-30T00:00:00Z","timestamp":1588204800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,4,30]],"date-time":"2020-04-30T00:00:00Z","timestamp":1588204800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010790","name":"Erasmus","doi-asserted-by":"publisher","award":["FeatlMed PhD"],"award-info":[{"award-number":["FeatlMed PhD"]}],"id":[{"id":"10.13039\/501100010790","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["wt101957"],"award-info":[{"award-number":["wt101957"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Twin-to-twin transfusion syndrome (TTTS) is a placental defect occurring in monochorionic twin pregnancies. It is associated with high risks of fetal loss and perinatal death. Fetoscopic elective laser ablation (ELA) of placental anastomoses has been established as the most effective therapy for TTTS. Current tools and techniques face limitations in case of more complex ELA cases. Visualization of the entire placental surface and vascular equator; maintaining an adequate distance and a close to perpendicular angle between laser fiber and placental surface are central for the effectiveness of laser ablation and procedural success. Robot-assisted technology could address these challenges, offer enhanced dexterity and ultimately improve the safety and effectiveness of the therapeutic procedures.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>This work proposes a \u2018minimal\u2019 robotic TTTS approach whereby rather than deploying a massive and expensive robotic system, a compact instrument is \u2018robotised\u2019 and endowed with \u2018robotic\u2019 skills so that operators can quickly and efficiently use it. The work reports on automatic placental pose estimation in fetoscopic images. This estimator forms a key building block of a proposed shared-control approach for semi-autonomous fetoscopy. A convolutional neural network (CNN) is trained to predict the relative orientation of the placental surface from a single monocular fetoscope camera image. To overcome the absence of real-life ground-truth placenta pose data, similar to other works in literature (Handa et al. in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016; Gaidon et al. in: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016; Vercauteren et al. in: Proceedings of the IEEE, 2019) the network is trained with data generated in a simulated environment and an in-silico phantom model. A limited set of coarsely manually labeled samples from real interventions are added to the training dataset to improve domain adaptation.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The trained network shows promising results on unseen samples from synthetic, phantom and in vivo patient data. The performance of the network for collaborative control purposes was evaluated in a virtual reality simulator in which the virtual flexible distal tip was autonomously controlled by the neural network.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Improved alignment was established compared to manual operation for this setting, demonstrating the feasibility to incorporate a CNN-based estimator in a real-time shared control scheme for fetoscopic applications.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-020-02166-3","type":"journal-article","created":{"date-parts":[[2020,4,30]],"date-time":"2020-04-30T04:06:08Z","timestamp":1588219568000},"page":"1561-1571","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Deep learning-based monocular placental pose estimation: towards collaborative robotics in fetoscopy"],"prefix":"10.1007","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3975-012X","authenticated-orcid":false,"given":"Mirza Awais","family":"Ahmad","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mouloud","family":"Ourak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caspar","family":"Gruijthuijsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4920-945X","authenticated-orcid":false,"given":"Jan","family":"Deprest","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1794-0456","authenticated-orcid":false,"given":"Tom","family":"Vercauteren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3764-9551","authenticated-orcid":false,"given":"Emmanuel","family":"Vander Poorten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,4,30]]},"reference":[{"key":"2166_CR1","doi-asserted-by":"crossref","unstructured":"Ahmad MA, Ourak M, Gruijthuijsen C, Legrand J, Vercauteren T, Deprest J, Ourselin S, Vander\u00a0Poorten E (2019) Design and shared control of a flexible endoscope with autonomous distal tip alignment (accepted 2019)","DOI":"10.1109\/ICAR46387.2019.8981563"},{"key":"2166_CR2","unstructured":"AMS: Naneye, miniature cmos image camera. https:\/\/ams.com\/naneye"},{"issue":"5","key":"2166_CR3","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1046\/j.1469-0705.1998.11050347.x","volume":"11","author":"J Deprest","year":"1998","unstructured":"Deprest J, Van Schoubroeck D, Van Ballaer P, Flageole H, Van Assche FA, Vandenberghe K (1998) Alternative technique for ND: YAG laser coagulation in twin-to-twin transfusion syndrome with anterior placenta. Ultrasound Obstet Gynecol Off J Int Soci Ultrasound Obstet Gynecol 11(5):347\u2013352","journal-title":"Ultrasound Obstet Gynecol Off J Int Soci Ultrasound Obstet Gynecol"},{"key":"2166_CR4","volume-title":"Endoscopy in fetal medicine","author":"J Deprest","year":"2004","unstructured":"Deprest J, Ville Y, Barki G, Bui T, Hecher K, Dumez Y, Nicolini U (2004) Endoscopy in fetal medicine. The Eurofetus Group, Berlin"},{"issue":"6","key":"2166_CR5","doi-asserted-by":"publisher","first-page":"1512","DOI":"10.1016\/j.ajog.2006.01.074","volume":"195","author":"R Devlieger","year":"2006","unstructured":"Devlieger R, Millar LK, Bryant-Greenwood G, Lewi L, Deprest J (2006) Fetal membrane healing after spontaneous and iatrogenic membrane rupture: a review of current evidence. Am J Obstet Gynecol 195(6):1512\u20131520","journal-title":"Am J Obstet Gynecol"},{"issue":"3","key":"2166_CR6","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1016\/S0002-9378(96)70311-3","volume":"174","author":"E El Maradny","year":"1996","unstructured":"El Maradny E, Kanayama N, Halim A, Maehara K, Terao T (1996) Stretching of fetal membranes increases the concentration of interleukin-8 and collagenase activity. Am J Obstet Gynecol 174(3):843\u2013849","journal-title":"Am J Obstet Gynecol"},{"key":"2166_CR7","unstructured":"Gaidon A, Wang Q, Cabon Y, Vig E (2016) Virtual worlds as proxy for multi-object tracking analysis. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4340\u20134349"},{"key":"2166_CR8","unstructured":"Handa A, Patraucean V, Badrinarayanan V, Stent S, Cipolla R (2016) Understanding real world indoor scenes with synthetic data. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4077\u20134085"},{"key":"2166_CR9","doi-asserted-by":"crossref","unstructured":"Harada K, Bo Z, Enosawa S, Chiba T, Fujie MG (2007) Bending laser manipulator for intrauterine surgery and viscoelastic model of fetal rat tissue. In: IEEE international conference on robotics and automation. IEEE, pp 611\u2013616","DOI":"10.1109\/ROBOT.2007.363054"},{"key":"2166_CR10","doi-asserted-by":"publisher","first-page":"1949","DOI":"10.1007\/s11548-018-1822-7","volume":"13","author":"A Javaux","year":"2018","unstructured":"Javaux A, Bouget D, Gruijthuijsen C, Stoyanov D, Vercauteren T, Ourselin S, Deprest J, Denis K, Vander Poorten E (2018) A mixed-reality surgical trainer with comprehensive sensing for fetal laser minimally invasive surgery. Int J Comput Assist Radiol Surg 13:1949\u20131957","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"2166_CR11","unstructured":"Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980"},{"issue":"2","key":"2166_CR12","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1111\/j.1471-0528.2008.02021.x","volume":"116","author":"P Klaritsch","year":"2009","unstructured":"Klaritsch P, Albert K, Van Mieghem T, Gucciardo L, Done\u2019 E, Bynens B, Deprest J (2009) Instrumental requirements for minimal invasive fetal surgery. BJOG Int J Obstet Gynaecol 116(2):188\u2013197","journal-title":"BJOG Int J Obstet Gynaecol"},{"issue":"7553","key":"2166_CR13","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436","journal-title":"Nature"},{"issue":"4","key":"2166_CR14","doi-asserted-by":"publisher","first-page":"4359","DOI":"10.1109\/LRA.2018.2866204","volume":"3","author":"J Legrand","year":"2018","unstructured":"Legrand J, Ourak M, Javaux A, Gruijthuijsen C, Ahmad MA, Van Cleynenbreugel B, Vercauteren T, Deprest J, Ourselin S, Vander Poorten E (2018) From a disposable ureteroscope to an active lightweight fetoscope characterization and usability evaluation. IEEE Robot Autom Lett 3(4):4359\u20134366","journal-title":"IEEE Robot Autom Lett"},{"issue":"1","key":"2166_CR15","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.jpedsurg.2008.10.011","volume":"44","author":"CS Muratore","year":"2009","unstructured":"Muratore CS, Carr SR, Lewi L, Delieger R, Carpenter M, Jani J, Deprest JA, Luks FI (2009) Survival after laser surgery for twin-to-twin transfusion syndrome: when are they out of the woods? J Pediatr Surg 44(1):66\u201370","journal-title":"J Pediatr Surg"},{"key":"2166_CR16","unstructured":"NDI: Aurora, electromagnetic motion tracking system. https:\/\/www.ndigital.com\/medical\/products\/aurora\/"},{"key":"2166_CR17","doi-asserted-by":"crossref","unstructured":"Olmschenk G, Tang H, Zhu Z (2017) Pitch and roll camera orientation from a single 2d image using convolutional neural networks. In: 14th Conference on computer and robot vision (CRV). IEEE, pp 261\u2013268","DOI":"10.1109\/CRV.2017.53"},{"key":"2166_CR18","volume-title":"The visualization toolkit: an object-oriented approach to 3D graphics","author":"WJ Schroeder","year":"2004","unstructured":"Schroeder WJ, Lorensen B, Martin K (2004) The visualization toolkit: an object-oriented approach to 3D graphics. Kitware, New York"},{"issue":"2","key":"2166_CR19","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1056\/NEJMoa032597","volume":"351","author":"MV Senat","year":"2004","unstructured":"Senat MV, Deprest J, Boulvain M, Paupe A, Winer N, Ville Y (2004) Endoscopic laser surgery versus serial amnioreduction for severe twin-to-twin transfusion syndrome. N Engl J Med 351(2):136\u2013144","journal-title":"N Engl J Med"},{"issue":"3","key":"2166_CR20","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1016\/j.ajog.2014.05.012","volume":"211","author":"F Slaghekke","year":"2014","unstructured":"Slaghekke F, Lewi L, Middeldorp JM, Weingertner AS, Klumper FJ, Dekoninck P, Devlieger R, Lanna MM, Deprest J, Favre R, Oepkes D, Enrico L (2014) Residual anastomoses in twin-twin transfusion syndrome after laser: the solomon randomized trial. Am J Obstet Gynecol 211(3):285\u2013e1","journal-title":"Am J Obstet Gynecol"},{"issue":"2","key":"2166_CR21","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1109\/37.833638","volume":"20","author":"B Tondu","year":"2000","unstructured":"Tondu B, Lopez P (2000) Modeling and control of mckibben artificial muscle robot actuators. IEEE Control Syst Mag 20(2):15\u201338","journal-title":"IEEE Control Syst Mag"},{"key":"2166_CR22","doi-asserted-by":"crossref","unstructured":"Vercauteren T, Unberath M, Padoy N, Navab N (2019) Cai4cai: the rise of contextual artificial intelligence in computer-assisted interventions. In: Proceedings of the IEEE","DOI":"10.1109\/JPROC.2019.2946993"},{"key":"2166_CR23","unstructured":"Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network. arXiv preprint arXiv:1505.00853"},{"issue":"6","key":"2166_CR24","first-page":"898","volume":"15","author":"N Yamanaka","year":"2010","unstructured":"Yamanaka N, Yamashita H, Masamune K, Chiba T, Dohi T (2010) An endoscope with 2 dofs steering of coaxial ND: YAG laser beam for fetal surgery. IEEE\/ASME Trans Mechatron 15(6):898\u2013905","journal-title":"IEEE\/ASME Trans Mechatron"},{"key":"2166_CR25","first-page":"218","volume":"1","author":"H Yamashita","year":"2006","unstructured":"Yamashita H, Matsumiya K, Masamune K, Liao H, Chiba T, Dohi T (2006) Two-dofs bending forceps manipulator of 3.5-mm diameter for intrauterine fetus surgery: feasibility evaluation. Int J Comput Assist Radiol Surg 1:218","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"2166_CR26","unstructured":"Yang EY, Adzick NS (1998) Fetoscopy. In: Seminars in laparoscopic surgery, vol\u00a05. Sage Publications, Thousand Oaks, pp 31\u201339"},{"issue":"1","key":"2166_CR27","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.medengphy.2013.08.014","volume":"36","author":"W Yao","year":"2014","unstructured":"Yao W, Elangovan H, Nicolaides K (2014) Design of a flexible fetoscopy manipulation system for congenital diaphragmatic hernia. Med Eng Phys 36(1):32\u201338","journal-title":"Med Eng Phys"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-020-02166-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-020-02166-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-020-02166-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,30]],"date-time":"2021-04-30T00:48:44Z","timestamp":1619743724000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-020-02166-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,30]]},"references-count":27,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["2166"],"URL":"https:\/\/doi.org\/10.1007\/s11548-020-02166-3","relation":{},"ISSN":["1861-6410","1861-6429"],"issn-type":[{"value":"1861-6410","type":"print"},{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,30]]},"assertion":[{"value":"22 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 April 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}