{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T14:02:25Z","timestamp":1784296945335,"version":"3.55.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T00:00:00Z","timestamp":1713916800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T00:00:00Z","timestamp":1713916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Multi-Scale Medical Robotics Centre InnoHK","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]},{"name":"Research Grants Council of the Hong Kong Special Administrative Region, China","award":["T45-401\/22-N"],"award-info":[{"award-number":["T45-401\/22-N"]}]},{"name":"Shenzhen-Hong Kong Collaborative Development Zone","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>\n                           <jats:bold>Purpose<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>The healthcare industry has a growing need for realistic modeling and efficient simulation of surgical scenes. With effective models of deformable surgical scenes, clinicians are able to conduct surgical planning and surgery training on scenarios close to real-world cases. However, a significant challenge in achieving such a goal is the scarcity of high-quality soft tissue models with accurate shapes and textures. To address this gap, we present a data-driven framework that leverages emerging neural radiance field technology to enable high-quality surgical reconstruction and explore its application for surgical simulations.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>\n                           <jats:bold>Method<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>We first focus on developing a fast NeRF-based surgical scene 3D reconstruction approach that achieves state-of-the-art performance. This method can significantly outperform traditional 3D reconstruction methods, which have failed to capture large deformations and produce fine-grained shapes and textures. We then propose an automated creation pipeline of interactive surgical simulation environments through a closed mesh extraction algorithm.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>\n                           <jats:bold>Results<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>Our experiments have validated the superior performance and efficiency of our proposed approach in surgical scene 3D reconstruction. We further utilize our reconstructed soft tissues to conduct FEM and MPM simulations, showcasing the practical application of our method in data-driven surgical simulations.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>\n                           <jats:bold>Conclusion<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>We have proposed a novel NeRF-based reconstruction framework with an emphasis on simulation purposes. Our reconstruction framework facilitates the efficient creation of high-quality surgical soft tissue 3D models. With multiple soft tissue simulations demonstrated, we show that our work has the potential to benefit downstream clinical tasks, such as surgical education.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03114-1","type":"journal-article","created":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T16:02:22Z","timestamp":1713974542000},"page":"821-829","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation"],"prefix":"10.1007","volume":"19","author":[{"given":"Yuehao","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bingchen","family":"Gong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yonghao","family":"Long","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Siu Hin","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qi","family":"Dou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,24]]},"reference":[{"key":"3114_CR1","doi-asserted-by":"crossref","unstructured":"Liu X, Stiber M, Huang J, Ishii M, Hager GD, Taylor RH, Unberath M (2020) Reconstructing sinus anatomy from endoscopic video\u2013towards a radiation-free approach for quantitative longitudinal assessment. In: MICCAI, pp 3\u201313","DOI":"10.1007\/978-3-030-59716-0_1"},{"key":"3114_CR2","doi-asserted-by":"crossref","unstructured":"Chen W, Liao X, Sun Y, Wang Q (2020) Improved orb-slam based 3d dense reconstruction for monocular endoscopic image. In: ICVRV, pp 101\u2013106","DOI":"10.1109\/ICVRV51359.2020.00030"},{"issue":"4","key":"3114_CR3","doi-asserted-by":"publisher","first-page":"7225","DOI":"10.1109\/LRA.2021.3095528","volume":"6","author":"D Recasens","year":"2021","unstructured":"Recasens D, Lamarca J, F\u00e1cil JM, Montiel J, Civera J (2021) Endo-depth-and-motion: reconstruction and tracking in endoscopic videos using depth networks and photometric constraints. IEEE Robot Automat Lett 6(4):7225\u20137232","journal-title":"IEEE Robot Automat Lett"},{"key":"3114_CR4","doi-asserted-by":"crossref","unstructured":"Wei G, Yang H, Shi W, Jiang Z, Chen T, Wang Y (2021) Laparoscopic scene reconstruction based on multiscale feature patch tracking method. In: EIECS, pp 588\u2013592. IEEE","DOI":"10.1109\/EIECS53707.2021.9588016"},{"issue":"2","key":"3114_CR5","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1109\/TBME.2022.3195027","volume":"70","author":"R Wei","year":"2022","unstructured":"Wei R, Li B, Mo H, Lu B, Long Y, Yang B, Dou Q, Liu Y, Sun D (2022) Stereo dense scene reconstruction and accurate localization for learning-based navigation of laparoscope in minimally invasive surgery. IEEE Trans Biomed Eng 70(2):488\u2013500","journal-title":"IEEE Trans Biomed Eng"},{"key":"3114_CR6","doi-asserted-by":"crossref","unstructured":"Long Y, Li Z, Yee CH, Ng CF, Taylor RH, Unberath M, Dou Q (2021) E-dssr: efficient dynamic surgical scene reconstruction with transformer-based stereoscopic depth perception. In: MICCAI, pp 415\u2013425","DOI":"10.1007\/978-3-030-87202-1_40"},{"key":"3114_CR7","doi-asserted-by":"crossref","unstructured":"Wang Y, Long Y, Fan SH, Dou Q (2022) Neural rendering for stereo 3d reconstruction of deformable tissues in robotic surgery. MICCAI","DOI":"10.1007\/978-3-031-16449-1_41"},{"key":"3114_CR8","doi-asserted-by":"crossref","unstructured":"Mildenhall B, Srinivasan PP, Tancik M, Barron JT, Ramamoorthi R, Ng R (2020) Nerf: Representing scenes as neural radiance fields for view synthesis. In: ECCV, pp 405\u2013421","DOI":"10.1007\/978-3-030-58452-8_24"},{"issue":"2","key":"3114_CR9","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.jvcir.2007.01.005","volume":"18","author":"M M\u00fcller","year":"2007","unstructured":"M\u00fcller M, Heidelberger B, Hennix M, Ratcliff J (2007) Position based dynamics. J Vis Commun Image Represent 18(2):109\u2013118","journal-title":"J Vis Commun Image Represent"},{"key":"3114_CR10","doi-asserted-by":"crossref","unstructured":"Sifakis E, Barbic J (2012) Fem simulation of 3d deformable solids: a practitioner\u2019s guide to theory, discretization and model reduction. In: Acm Siggraph 2012 Courses, pp 1\u201350","DOI":"10.1145\/2343483.2343501"},{"issue":"2","key":"3114_CR11","doi-asserted-by":"publisher","first-page":"1724","DOI":"10.1002\/cav.1724","volume":"28","author":"K Qian","year":"2017","unstructured":"Qian K, Bai J, Yang X, Pan J, Zhang J (2017) Essential techniques for laparoscopic surgery simulation. Comput Animat Virtual Worlds 28(2):1724","journal-title":"Comput Animat Virtual Worlds"},{"key":"3114_CR12","doi-asserted-by":"crossref","unstructured":"Qian K, Jiang T, Wang M, Yang X, Zhang J (2016) Energized soft tissue dissection in surgery simulation. Comput Animat Virtual Worlds 27(3\u20134):280\u2013289","DOI":"10.1002\/cav.1691"},{"issue":"6","key":"3114_CR13","first-page":"1","volume":"38","author":"Y Hu","year":"2019","unstructured":"Hu Y, Li T-M, Anderson L, Ragan-Kelley J, Durand F (2019) Taichi: a language for high-performance computation on spatially sparse data structures. ACM Trans Gr(TOG) 38(6):1\u201316","journal-title":"ACM Trans Gr(TOG)"},{"issue":"4","key":"3114_CR14","first-page":"1","volume":"37","author":"Y Hu","year":"2018","unstructured":"Hu Y, Fang Y, Ge Z, Qu Z, Zhu Y, Pradhana A, Jiang C (2018) A moving least squares material point method with displacement discontinuity and two-way rigid body coupling. ACM Trans Graph(TOG) 37(4):1\u201314","journal-title":"ACM Trans Graph(TOG)"},{"key":"3114_CR15","unstructured":"Liang J, Makoviychuk V, Handa A, Chentanez N, Macklin M, Fox D (2018) Gpu-accelerated robotic simulation for distributed reinforcement learning. In: CoRL, pp. 270\u2013282. PMLR"},{"issue":"4","key":"3114_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3528223.3530127","volume":"41","author":"T M\u00fcller","year":"2022","unstructured":"M\u00fcller T, Evans A, Schied C, Keller A (2022) Instant neural graphics primitives with a multiresolution hash encoding. ACM Trans Graphics (ToG) 41(4):1\u201315","journal-title":"ACM Trans Graphics (ToG)"},{"key":"3114_CR17","doi-asserted-by":"crossref","unstructured":"Sun C, Sun M, Chen H-T (2022) Direct voxel grid optimization: Super-fast convergence for radiance fields reconstruction. In: CVPR","DOI":"10.1109\/CVPR52688.2022.00538"},{"key":"3114_CR18","doi-asserted-by":"crossref","unstructured":"Fridovich-Keil S, Yu A, Tancik M, Chen Q, Recht B, Kanazawa A (2022) Plenoxels: Radiance fields without neural networks. In: CVPR, pp. 5501\u20135510","DOI":"10.1109\/CVPR52688.2022.00542"},{"key":"3114_CR19","doi-asserted-by":"crossref","unstructured":"Fridovich-Keil S, Meanti G, Warburg FR, Recht B, Kanazawa A (2023) K-planes: Explicit radiance fields in space, time, and appearance. In: CVPR, pp. 12479\u201312488","DOI":"10.1109\/CVPR52729.2023.01201"},{"key":"3114_CR20","doi-asserted-by":"crossref","unstructured":"Pumarola A, Corona E, Pons-Moll G, Moreno-Noguer F (2021) D-nerf: Neural radiance fields for dynamic scenes. In: CVPR, pp. 10318\u201310327","DOI":"10.1109\/CVPR46437.2021.01018"},{"key":"3114_CR21","doi-asserted-by":"crossref","unstructured":"Park K, Sinha U, Barron JT, Bouaziz S, Goldman DB, Seitz SM, Martin-Brualla R (2021) Nerfies: Deformable neural radiance fields. In: ICCV, pp. 5865\u20135874","DOI":"10.1109\/ICCV48922.2021.00581"},{"key":"3114_CR22","doi-asserted-by":"crossref","unstructured":"Chen A, Xu Z, Geiger A, Yu J, Su H (2022) Tensorf: Tensorial radiance fields. In: ECCV, pp. 333\u2013350","DOI":"10.1007\/978-3-031-19824-3_20"},{"key":"3114_CR23","doi-asserted-by":"crossref","unstructured":"Cao A, Johnson J (2023) Hexplane: A fast representation for dynamic scenes. In: CVPR, pp. 130\u2013141","DOI":"10.1109\/CVPR52729.2023.00021"},{"key":"3114_CR24","doi-asserted-by":"crossref","unstructured":"Xu H, Zhang J, Cai J, Rezatofighi H, Yu F, Tao D, Geiger A (2023) Unifying flow, stereo and depth estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence","DOI":"10.1109\/TPAMI.2023.3298645"},{"key":"3114_CR25","doi-asserted-by":"crossref","unstructured":"Li Z, Liu X, Drenkow N, Ding A, Creighton FX, Taylor RH, Unberath M (2021) Revisiting stereo depth estimation from a sequence-to-sequence perspective with transformers. In: ICCV, pp. 6197\u20136206","DOI":"10.1109\/ICCV48922.2021.00614"},{"key":"3114_CR26","doi-asserted-by":"crossref","unstructured":"Huber PJ (1992) Robust estimation of a location parameter. In: Breakthroughs in Statistics: Methodology and Distribution, pp. 492\u2013518","DOI":"10.1007\/978-1-4612-4380-9_35"},{"issue":"4","key":"3114_CR27","first-page":"30","volume":"39","author":"X Wang","year":"2020","unstructured":"Wang X, Qiu Y, Slattery SR, Fang Y, Li M, Zhu S-C, Zhu Y, Tang M, Manocha D, Jiang C (2020) A massively parallel and scalable multi-GPU material point method. ACM Trans Graph(TOG) 39(4):30\u20131","journal-title":"ACM Trans Graph(TOG)"},{"issue":"4","key":"3114_CR28","first-page":"60","volume":"37","author":"Y Hu","year":"2018","unstructured":"Hu Y, Zhou Q, Gao X, Jacobson A, Zorin D, Panozzo D (2018) Tetrahedral meshing in the wild. ACM Trans Graph(TOG) 37(4):60\u20131","journal-title":"ACM Trans Graph(TOG)"},{"issue":"4","key":"3114_CR29","first-page":"117","volume":"39","author":"Y Hu","year":"2020","unstructured":"Hu Y, Schneider T, Wang B, Zorin D, Panozzo D (2020) Fast tetrahedral meshing in the wild. ACM Trans Graph(TOG) 39(4):117","journal-title":"ACM Trans Graph(TOG)"},{"issue":"2","key":"3114_CR30","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1145\/2629697","volume":"41","author":"H Si","year":"2015","unstructured":"Si H (2015) Tetgen, a delaunay-based quality tetrahedral mesh generator. ACM Trans Math Softw 41(2):11. https:\/\/doi.org\/10.1145\/2629697","journal-title":"ACM Trans Math Softw"},{"issue":"4","key":"3114_CR31","first-page":"1027","volume":"11","author":"Y Long","year":"2022","unstructured":"Long Y, Li C, Dou Q (2022) Robotic surgery remote mentoring via AR with 3D scene streaming and hand interaction. Comput Methods Biomech Biomed Eng: Imag Vis 11(4):1027\u20131032","journal-title":"Comput Methods Biomech Biomed Eng: Imag Vis"},{"key":"3114_CR32","doi-asserted-by":"crossref","unstructured":"Long Y, Wei W, Huang T, Wang Y, Dou Q (2023) Human-in-the-loop embodied intelligence with interactive simulation environment for surgical robot learning. IEEE Robotics and Automation Letters","DOI":"10.1109\/LRA.2023.3284380"},{"key":"3114_CR33","doi-asserted-by":"crossref","unstructured":"Sulsky D, Zhou S-J, Schreyer HL (1995) Application of a particle-in-cell method to solid mechanics. Comput Phys Commun. 87(1\u20132):236\u2013252","DOI":"10.1016\/0010-4655(94)00170-7"},{"key":"3114_CR34","doi-asserted-by":"crossref","unstructured":"Wolper J, Fang Y, Li M, Lu J, Gao M, Jiang C (2019) Cd-MPM: continuum damage material point methods for dynamic fracture animation. ACM Trans Graph (TOG) 38(4):1\u201315","DOI":"10.1145\/3306346.3322949"},{"key":"3114_CR35","doi-asserted-by":"crossref","unstructured":"Wolper J, Chen Y, Li M, Fang Y, Qu Z, Lu J, Cheng M, Jiang C (2020) AnisoMPM: animating anisotropic damage mechanics. ACM Trans Graph (TOG) 39(4):37","DOI":"10.1145\/3386569.3392428"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03114-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03114-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03114-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T13:17:28Z","timestamp":1715865448000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03114-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,24]]},"references-count":35,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["3114"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03114-1","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,24]]},"assertion":[{"value":"14 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}