{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T18:31:29Z","timestamp":1791484289028,"version":"4.3.4"},"reference-count":33,"publisher":"Public Library of Science (PLoS)","issue":"4","license":[{"start":{"date-parts":[[2025,4,14]],"date-time":"2025-04-14T00:00:00Z","timestamp":1744588800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>A method that allows a fast and accurate registration of digital tissue models obtained during preoperative, diagnostic imaging with those captured intraoperatively using lower-fidelity ultrasound imaging techniques is presented. Minimally invasive surgeries are often planned using preoperative, high-fidelity medical imaging techniques such as MRI and CT imaging. While these techniques allow clinicians to obtain detailed 3D models of the surgical region of interest (ROI), various factors such as physical changes to the tissue, changes in the body\u2019s configuration, or apparatus used during the surgery may cause large, non-linear deformations of the ROI. Such deformations of the tissue can result in a severe mismatch between the preoperatively obtained 3D model and the real-time image data acquired during surgery, potentially compromising surgical success. To overcome this challenge, this work presents a new approach for predicting intraoperative soft tissue deformations. The approach works by simply tracking the displacements of a handful of fiducial markers or analogous biological features embedded in the tissue, and produces a 3D deformed version of the high-fidelity ROI model that registers accurately with the intraoperative data. In an o\ufb04ine setting, we use the finite element method to generate deformation fields given various boundary conditions that mimic the realistic environment of soft tissues during a surgery. To reduce the dimensionality of the 3D deformation field involving thousands of degrees of freedom, we use an autoencoder neural network to encode each computed deformation field into a short latent space representation, such that a neural network can accurately map the fiducial marker displacements to the latent space. Our computational tests on a head and neck tumor, a kidney, and an aorta model show prediction errors as small as 0.5 mm. Considering that the typical resolution of interventional ultrasound is around 1 mm and each prediction takes less than 0.5 s, the proposed approach has the potential to be clinically relevant for an accurate tracking of soft tissue deformations during image-guided surgeries.<\/jats:p>","DOI":"10.1371\/journal.pone.0319196","type":"journal-article","created":{"date-parts":[[2025,4,14]],"date-time":"2025-04-14T20:02:46Z","timestamp":1744660966000},"page":"e0319196","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["A data-driven approach for real-time soft tissue deformation prediction using nonlinear presurgical simulations"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9237-5613","authenticated-orcid":true,"given":"Haolin","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ye","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-2149-0553","authenticated-orcid":true,"given":"Daniel","family":"Emerson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoed","family":"Rabin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2203-4020","authenticated-orcid":true,"given":"Levent Burak","family":"Kara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,4,14]]},"reference":[{"issue":"12","key":"pone.0319196.ref001","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1067\/j.cpsurg.2015.10.001","article-title":"Image-guided surgery","volume":"52","author":"DE Azagury","year":"2015","journal-title":"Curr Probl Surg"},{"key":"pone.0319196.ref002","doi-asserted-by":"crossref","first-page":"1533034618766792","DOI":"10.1177\/1533034618766792","article-title":"Reconstruction of a deformed tumor based on fiducial marker registration: A computational feasibility study","volume":"17","author":"Y Han","year":"2018","journal-title":"Technol Cancer Res Treat"},{"issue":"2","key":"pone.0319196.ref003","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1007\/s11548-019-02075-0","article-title":"Soft tissue deformation tracking by means of an optimized fiducial marker layout with application to cancer tumors","volume":"15","author":"Y Han","year":"2020","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"pone.0319196.ref004","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1038\/s41698-020-0115-0","article-title":"Accurate surgical navigation with real-time tumor tracking in cancer surgery","volume":"4","author":"END Kok","year":"2020","journal-title":"NPJ Precis Oncol"},{"key":"pone.0319196.ref005","article-title":"Fiducial marker placement","author":"America Radiological Society of North","year":"2023"},{"issue":"5","key":"pone.0319196.ref006","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/TMI.2002.1009381","article-title":"Consistent landmark and intensity-based image registration","volume":"21","author":"HJ Johnson","year":"2002","journal-title":"IEEE Trans Med Imaging"},{"issue":"2","key":"pone.0319196.ref007","doi-asserted-by":"crossref","first-page":"A69","DOI":"10.1038\/jcbfm.1991.40","article-title":"MRI-PET correlation in three dimensions using a volume-of-interest (VOI) atlas","volume":"11","author":"AC Evans","year":"1991","journal-title":"J Cereb Blood Flow Metab"},{"issue":"2","key":"pone.0319196.ref008","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1002\/(SICI)1522-712X(1995)1:2<94::AID-IGS4>3.0.CO;2-G","article-title":"Frameless patient registration using ultrasonic imaging: a preliminary study","volume":"1","author":"T Ault","year":"1995","journal-title":"J Image Guid Surg"},{"key":"pone.0319196.ref009","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1109\/RBME.2017.2773521","article-title":"Deformable Models for Surgical Simulation: A Survey","volume":"11","author":"J Zhang","year":"2018","journal-title":"IEEE Rev Biomed Eng"},{"issue":"10","key":"pone.0319196.ref010","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/j.medengphy.2005.10.005","article-title":"Application of soft tissue modelling to image-guided surgery","volume":"27","author":"TJ Carter","year":"2005","journal-title":"Med Eng Phys"},{"issue":"11","key":"pone.0319196.ref011","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1109\/TMI.2005.855434","article-title":"Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements","volume":"24","author":"DM Cash","year":"2005","journal-title":"IEEE Trans Med Imaging"},{"issue":"1","key":"pone.0319196.ref012","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/TMI.2013.2283016","article-title":"A mechanics-based nonrigid registration method for liver surgery using sparse intraoperative data","volume":"33","author":"DC Rucker","year":"2014","journal-title":"IEEE Trans Med Imaging"},{"issue":"2","key":"pone.0319196.ref013","first-page":"021203","article-title":"Characterization and correction of intraoperative soft tissue deformation in image-guided laparoscopic liver surgery","volume":"5","author":"JS Heiselman","year":"2018","journal-title":"J Med Imaging (Bellingham)"},{"issue":"2\u20133","key":"pone.0319196.ref014","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/S1077-3142(03)00005-5","article-title":"Nonrigid brain registration: Synthesizing full volume deformation fields from model basis solutions constrained by partial volume intraoperative data","volume":"89","author":"KE Lunn","year":"2003","journal-title":"Comput Vision Image Understand"},{"key":"pone.0319196.ref015","first-page":"2500113","article-title":"Near real-time computer assisted surgery for brain shift correction using biomechanical models","volume":"2","author":"K Sun","year":"2014","journal-title":"IEEE J Transl Eng Health Med"},{"issue":"11","key":"pone.0319196.ref016","doi-asserted-by":"crossref","first-page":"2404","DOI":"10.1109\/TMI.2015.2440253","article-title":"Biomechanically constrained surface registration: Application to MR-TRUS fusion for prostate interventions","volume":"34","author":"S Khallaghi","year":"2015","journal-title":"IEEE Trans Med Imaging"},{"issue":"6","key":"pone.0319196.ref017","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/S0090-3019(01)00628-0","article-title":"Intraoperative compensation for brain shift","volume":"56","author":"C Nimsky","year":"2001","journal-title":"Surg Neurol"},{"issue":"2","key":"pone.0319196.ref018","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0169-2607(00)00093-6","article-title":"A new approach for the real-time simulation of tissue deformations in surgery simulation","volume":"64","author":"C Monserrat","year":"2001","journal-title":"Comput Methods Programs Biomed"},{"issue":"11","key":"pone.0319196.ref019","doi-asserted-by":"crossref","first-page":"3494","DOI":"10.1109\/TCYB.2016.2560938","article-title":"A new deformation model of biological tissue for surgery simulation","volume":"47","author":"Y Zou","year":"2017","journal-title":"IEEE Trans Cybern"},{"key":"pone.0319196.ref020","doi-asserted-by":"crossref","unstructured":"Ling Z, Ying Y, Baoquan Z, Lijing W. An improved meshless method in virtual surgery simulation. 2014 international conference on virtual reality and visualization; 2014. p. 449\u201354. doi: 10.1109\/icvrv.2014.49","DOI":"10.1109\/ICVRV.2014.49"},{"key":"pone.0319196.ref021","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.eswa.2016.11.037","article-title":"A framework for modelling the biomechanical behaviour of the human liver during breathing in real time using machine learning","volume":"71","author":"D Lorente","year":"2017","journal-title":"Expert Systems with Applications"},{"key":"pone.0319196.ref022","doi-asserted-by":"crossref","first-page":"102165","DOI":"10.1016\/j.compmedimag.2022.102165","article-title":"Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning","volume":"104","author":"M Karami","year":"2023","journal-title":"Comput Med Imaging Graph"},{"key":"pone.0319196.ref023","doi-asserted-by":"crossref","first-page":"107150","DOI":"10.1016\/j.engappai.2023.107150","article-title":"A novel deep learning-driven approach for predicting the pelvis soft-tissue deformations toward a real-time interactive childbirth simulation","volume":"126","author":"DH Nguyen-Le","year":"2023","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"pone.0319196.ref024","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.compbiomed.2017.09.019","article-title":"A finite element-based machine learning approach for modeling the mechanical behavior of the breast tissues under compression in real-time","volume":"90","author":"F Mart\u00ednez-Mart\u00ednez","year":"2017","journal-title":"Computers in biology and medicine."},{"key":"pone.0319196.ref025","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.artmed.2017.07.004","article-title":"A machine learning approach for real-time modelling of tissue deformation in image-guided neurosurgery","volume":"80","author":"M Tonutti","year":"2017","journal-title":"Artif Intell Med"},{"issue":"1","key":"pone.0319196.ref026","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s007910050004","article-title":"NETGEN An advancing front 2D\/3D-mesh generator based on abstract rules","volume":"1","author":"J Sch \u00f6berl","year":"1997","journal-title":"Computing and Visualization in Science"},{"key":"pone.0319196.ref027","unstructured":"Bathe KJ. Finite element procedures Prentice-Hall. New Jersey; 1996. p. 1037."},{"key":"pone.0319196.ref028","doi-asserted-by":"crossref","unstructured":"Hu T, Desai JP. Soft-tissue material properties under large deformation: Strain rate effect. The 26th annual international conference of the IEEE engineering in medicine and biology society, vol. 1. IEEE; 2004. p. 2758\u201361.","DOI":"10.1109\/IEMBS.2004.1403789"},{"key":"pone.0319196.ref029","unstructured":"National Institutes of Health 3D Exchange. Kidney 3D model; 2014. Available from: https:\/\/3d.nih.gov\/entries\/3DPX-000906"},{"key":"pone.0319196.ref030","unstructured":"Bourdin X, Trosseille X, Petit P, Beillas P. Comparison of tetrahedral and hexahedral meshes for organ finite element modeling: An application to kidney impact. Proceedings of the 20th international technical conference on the enhanced safety of vehicles; 2007. p. 1\u201310."},{"issue":"1","key":"pone.0319196.ref031","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1002\/vis.279","article-title":"The creation of a high\u2010fidelity finite element model of the kidney for use in trauma research","volume":"13","author":"JG Snedeker","year":"2002","journal-title":"J Visual Comput Animat"},{"key":"pone.0319196.ref032","unstructured":"National Institutes of Health 3D Exchange. Aorta aneurysm 3D model; 2016. Available from: https:\/\/3d.nih.gov\/entries\/3DPX-003283"},{"key":"pone.0319196.ref033","first-page":"2753","volume-title":"Advances in neural information processing systems","author":"D Park","year":"2014"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0319196","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,14]],"date-time":"2025-04-14T20:03:01Z","timestamp":1744660981000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0319196"}},"subtitle":[],"editor":[{"given":"Longhui","family":"Qin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,4,14]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4,14]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0319196","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,14]]}}}