{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T05:15:43Z","timestamp":1783142143995,"version":"3.54.6"},"reference-count":56,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T00:00:00Z","timestamp":1782259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Following the PRISMA-ScR framework for scoping reviews, we systematically searched five databases (Scopus, IEEE Xplore, ScienceDirect, SpringerLink, Web of Science) using a Boolean query combining real-time processing, 3D reconstruction, and deformation modelling terms. From 86 records identified, 56 peer-reviewed publications (2009\u20132025) were retained after two-stage screening and organized into a unified taxonomy covering sensing modalities (RGB-D, LiDAR, tactile), reconstruction pipelines (volumetric fusion, NRSfM, neural radiance fields), and deformation models (FEM, PBD, mass-spring, GNN-based surrogates, differentiable simulators). Of the 56 included works, 60% were published between 2022 and 2025, confirming the field\u2019s rapid growth. Neural and implicit representations account for 20% of contributions, FEM-based methods for 16%, and hybrid or application-specific pipelines for 21%. Four systemic gaps emerge: the absence of a unified physics-aware benchmark; unresolved speed\u2013accuracy trade-offs (PBD achieves &gt;30 FPS on desktop GPUs for 103\u2013104 vertex meshes but lacks mapping to physical material constants (Young\u2019s modulus, Poisson\u2019s ratio), limiting material fidelity; full-order FEM ensures physically consistent stress\u2013strain behavior but runs at only 1\u201310 FPS without order reduction; reduced-order FEM recovers interactive rates for low-frequency deformation modes); fragile handling of occlusions and multi-object contact; and limited end-to-end integration of sensing and simulation. The findings support the presentation of a research roadmap centered on model order reduction, differentiable physics, multimodal sensing fusion, and standardized evaluation protocols, with implications for robust digital twins of deformable environments.<\/jats:p>","DOI":"10.3390\/s26134007","type":"journal-article","created":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T03:20:21Z","timestamp":1782357621000},"page":"4007","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Three-Dimensional Reconstruction and Real-Time Deformation of Flexible Bodies: A Scoping Review (2009\u20132025)"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-9180-8082","authenticated-orcid":false,"given":"Silvia","family":"Zisu","sequence":"first","affiliation":[{"name":"Department of Automotive and Transport Engineering, Transilvania University of Brasov, 29 Eroilor Blvd, RO-500036 Brasov, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5102-8407","authenticated-orcid":false,"given":"Silviu","family":"Butnariu","sequence":"additional","affiliation":[{"name":"Department of Automotive and Transport Engineering, Transilvania University of Brasov, 29 Eroilor Blvd, RO-500036 Brasov, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,24]]},"reference":[{"key":"ref_1","unstructured":"Huang, I. (2023). Deformation in Robotics: Applications in Tactile Sensing and Grasp Planning. [Ph.D. Thesis, UC Berkeley]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1007\/s11548-024-03114-1","article-title":"Efficient EndoNeRF Reconstruction and Its Application for Data-Driven Surgical Simulation","volume":"19","author":"Wang","year":"2024","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_3","unstructured":"Del Bue, A., Canton, C., Pont-Tuset, J., and Tommasi, T. (2025). Real-Time Neural Cloth Deformation Using a Compact Latent Space and a Latent Vector Predictor. Proceedings of the Computer Vision\u2014ECCV 2024 Workshops, Springer Nature."},{"key":"ref_4","unstructured":"Miller, S., Soares, T., Van Weddingen, Y., and Wendlandt, J. (2024). Modeling Flexible Bodies with Simscape Multibody Software, MathWorks."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4984","DOI":"10.1038\/s41467-019-12943-7","article-title":"Real-Time 3D Reconstruction from Single-Photon Lidar Data Using Plug-and-Play Point Cloud Denoisers","volume":"10","author":"Tachella","year":"2019","journal-title":"Nat. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/j.advengsoft.2008.09.002","article-title":"Geometry Features Measurement of Traffic Accident for Reconstruction Based on Close-Range Photogrammetry","volume":"40","author":"Du","year":"2009","journal-title":"Adv. Eng. Softw."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhou, L., Wu, G., Zuo, Y., Chen, X., and Hu, H. (2024). A Comprehensive Review of Vision-Based 3D Reconstruction Methods. Sensors, 24.","DOI":"10.3390\/s24072314"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ylim\u00e4ki, M., Heikkil\u00e4, J., and Kannala, J. (2018, January 20\u201324). Accurate 3-D Reconstruction with RGB-D Cameras Using Depth Map Fusion and Pose Refinement. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8545508"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Fox, D., and Seitz, S.M. (2015, January 7\u201312). DynamicFusion: Reconstruction and Tracking of Non-Rigid Scenes in Real-Time. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Slavcheva, M., Baust, M., Cremers, D., and Ilic, S. (2017, January 21\u201326). KillingFusion: Non-Rigid 3D Reconstruction without Correspondences. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.581"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). VolumeDeform: Real-Time Volumetric Non-Rigid Reconstruction. Proceedings of the Computer Vision\u2014ECCV 2016, Springer International Publishing.","DOI":"10.1007\/978-3-319-46466-4"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4365","DOI":"10.1109\/TPAMI.2020.2997026","article-title":"Deep Non-Rigid Structure from Motion with Missing Data","volume":"43","author":"Kong","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.patrec.2024.08.015","article-title":"Deep NRSFM for Multi-View Multi-Body Pose Estimation","volume":"185","author":"Skaf","year":"2024","journal-title":"Pattern Recognit. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1145\/3503250","article-title":"NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis","volume":"65","author":"Mildenhall","year":"2021","journal-title":"Commun. ACM"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pumarola, A., Corona, E., Pons-Moll, G., and Moreno-Noguer, F. (2021, January 20\u201325). D-NeRF: Neural Radiance Fields for Dynamic Scenes 2020. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01018"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, Z., Niklaus, S., Snavely, N., and Wang, O. (2021). Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes. arXiv.","DOI":"10.1109\/CVPR46437.2021.00643"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Park, K., Sinha, U., Barron, J.T., Bouaziz, S., Goldman, D.B., Seitz, S.M., and Martin-Brualla, R. (2021, January 10\u201317). Nerfies: Deformable Neural Radiance Fields. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00581"},{"key":"ref_18","first-page":"b573","article-title":"A Review of 3D Reconstruction and Its Applications","volume":"11","author":"Kularkar","year":"2023","journal-title":"Int. J. Creat. Res. Thoughts"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e15062","DOI":"10.1111\/cgf.15062","article-title":"Recent Trends in 3D Reconstruction of General Non-Rigid Scenes","volume":"43","author":"Yunus","year":"2024","journal-title":"Comput. Graph. Forum"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Marinkovic, D., and Zehn, M. (2019). Survey of Finite Element Method-Based Real-Time Simulations. Appl. Sci., 9.","DOI":"10.3390\/app9142775"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1007\/s11704-018-8081-1","article-title":"A Survey on Fast Simulation of Elastic Objects","volume":"13","author":"Huang","year":"2019","journal-title":"Front. Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"598415","DOI":"10.1155\/2015\/598415","article-title":"Deformation of Soft Tissue and Force Feedback Using the Smoothed Particle Hydrodynamics","volume":"2015","author":"Liu","year":"2015","journal-title":"Comput. Math. Methods Med."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hu, Y., Liu, J., Spielberg, A., Tenenbaum, J.B., Freeman, W.T., Wu, J., Rus, D., and Matusik, W. (2019, January 20\u201324). ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794333"},{"key":"ref_24","unstructured":"Lin, X., Wang, Y., Olkin, J., and Held, D. (2020, January 16\u201318). SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation 2021. Proceedings of the 2020 Conference on Robot Learning, Virtual."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1145\/3528223.3530182","article-title":"Contact-Centric Deformation Learning","volume":"41","author":"Romero","year":"2022","journal-title":"ACM Trans. Graph."},{"key":"ref_26","unstructured":"Jatavallabhula, K.M., Macklin, M., Golemo, F., Voleti, V., Petrini, L., Weiss, M., Considine, B., Parent-Levesque, J., Xie, K., and Erleben, K. (2021). gradSim: Differentiable Simulation for System Identification and Visuomotor Control 2021. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"22868","DOI":"10.1109\/ACCESS.2025.3534271","article-title":"Weakly-Supervised Deep Shape-From-Template","volume":"13","author":"Pizarro","year":"2025","journal-title":"IEEE Access"},{"key":"ref_28","unstructured":"K202enwright, B., Davison, R., and Morgan, G. (2011, January 25\u201330). Real-Time Deformable Soft-Body Simulation Using Distributed Mass-Spring Approximations. Proceedings of the Third International Conference on Creative Content Technologies (CONTENT), Rome, Italy."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Du, T. (2023). Deep Learning for Physics Simulation. Proceedings of the ACM SIGGRAPH 2023 Courses, Los Angeles, CA, USA, 6\u201310 August 2023, Association for Computing Machinery.","DOI":"10.1145\/3587423.3595518"},{"key":"ref_30","unstructured":"Hu, Y., Anderson, L., Li, T.-M., Sun, Q., Carr, N., Ragan-Kelley, J., and Durand, F. (2019). DiffTaichi: Differentiable Programming for Physical Simulation. arXiv."},{"key":"ref_31","first-page":"11361","article-title":"NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos 2025","volume":"40","author":"Xu","year":"2026","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yu, Z., Xu, W., Xie, P., Li, Y., Anthony, B.W., Zhang, Z., and Lu, C. (2025, January 19\u201320). Dynamic Reconstruction of Hand-Object Interaction with Distributed Force-Aware Contact Representation 2025. Proceedings of the 2025 IEEE\/CVF International Conference on Computer Vision (ICCV), Honolulu, HI, USA.","DOI":"10.1109\/ICCV51701.2025.00804"},{"key":"ref_33","unstructured":"Wi, Y., Zeng, A., Florence, P., and Fazeli, N. (2022, January 14\u201318). VIRDO++: Real-World, Visuo-Tactile Dynamics and Perception of Deformable Objects. Proceedings of the 6th Conference on Robot Learning, Auckland, New Zealand."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Magnenat-Thalmann, N., and Thalmann, D. (2001). Real-Time Simulation of Deformation and Fracture of Stiff Materials. Proceedings of the Computer Animation and Simulation 2001, Manchester, UK, 2\u20133 September 2001, Springer.","DOI":"10.1007\/978-3-7091-6240-8"},{"key":"ref_35","first-page":"156","article-title":"Real-Time Non-Rigid Reconstruction Using an RGB-D Camera","volume":"33","author":"Izadi","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_36","first-page":"1745","article-title":"NNWarp: Neural Network-Based Nonlinear Deformation","volume":"26","author":"Luo","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_37","unstructured":"Pfaff, T., Fortunato, M., Sanchez-Gonzalez, A., and Battaglia, P.W. (2020). Learning Mesh-Based Simulation with Graph Networks. arXiv."},{"key":"ref_38","unstructured":"Sanchez-Gonzalez, A., Godwin, J., Pfaff, T., Ying, R., Leskovec, J., and Battaglia, P.W. (2020). Learning to Simulate Complex Physics with Graph Networks. arXiv."},{"key":"ref_39","unstructured":"Wang, W., Zheng, K., Wang, Q., Chen, H., Shi, Z., Yang, C., Shen, Y., and Shen, C. (2023). GenDeF: Learning Generative Deformation Field for Video Generation 2023. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1111\/cgf.14774","article-title":"State of the Art in Dense Monocular Non-Rigid 3D Reconstruction","volume":"42","author":"Tretschk","year":"2023","journal-title":"Comput. Graph. Forum"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2126","DOI":"10.1177\/02783649251334661","article-title":"Differentiable Physics-Based System Identification for Robotic Manipulation of Elastoplastic Materials","volume":"44","author":"Yang","year":"2025","journal-title":"Int. J. Rob. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1007\/s11263-020-01406-y","article-title":"A Benchmark and Evaluation of Non-Rigid Structure from Motion","volume":"29","author":"Jensen","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1177\/02783649231191222","article-title":"Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation","volume":"43","author":"Shen","year":"2024","journal-title":"Int. J. Robot. Res."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"9513","DOI":"10.1038\/s41467-024-53654-y","article-title":"Capturing Forceful Interaction with Deformable Objects Using a Deep Learning-Powered Stretchable Tactile Array","volume":"15","author":"Jiang","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"111420","DOI":"10.1109\/ACCESS.2025.3582863","article-title":"Comprehensive Review of Digital Twin Technology for Deformable Objects: Integration of Modeling, Rendering, and Simulation","volume":"13","author":"Koo","year":"2025","journal-title":"IEEE Access"},{"key":"ref_46","unstructured":"Xie, N., Tian, Z., Yang, L., Zhang, X.-P., Guo, M., and Li, J. (2025). From 2D to 3D Cognition: A Brief Survey of General World Models 2025. arXiv."},{"key":"ref_47","unstructured":"Gu, F., He, B., Jiang, S., Wang, Z., and Zhou, Y. (2023). A Survey on Robotic Manipulation of Deformable Objects: Recent Advances, Open Challenges and New Frontiers. arXiv."},{"key":"ref_48","unstructured":"Shen, B. (2023). Generating Content for AI, and AI-Generated Content Synthetic Data for and from Machine Learning. [Ph.D. Thesis, Stanford University]."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s00371-016-1324-y","article-title":"New Advances for Haptic Rendering: State of the Art","volume":"34","author":"Xia","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Yang, D., and Lee, Y. (2025). Deformable and Fragile Object Manipulation: A Review and Prospects. Sensors, 25.","DOI":"10.3390\/s25175430"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Wu, C., Yuan, Y., Tang, Y., and Tian, B. (2022). Application of Terrestrial Laser Scanning (TLS) in the Architecture, Engineering and Construction (AEC) Industry. Sensors, 22.","DOI":"10.3390\/s22010265"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zhong, F., Fogarty, K., Hanji, P., Wu, T., Sztrajman, A., Spielberg, A., Tagliasacchi, A., Bosilj, P., and Oztireli, C. (2023). Neural Fields with Hard Constraints of Arbitrary Differential Order. Proceedings of the 37th International Conference on Neural Information Processing Systems, Orleans, LA, USA, 10\u201316 December 2023, Curran Associates Inc.","DOI":"10.52202\/075280-0992"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.cviu.2016.05.004","article-title":"Real-Time 3D Reconstruction of Non-Rigid Shapes with a Single Moving Camera","volume":"153","author":"Agudo","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_54","unstructured":"Zesch, R.S., Witemeyer, B.R., Xiong, Z., Levin, D.I.W., and Sueda, S. (2022). Neural Collision Detection for Deformable Objects 2022. arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"109533","DOI":"10.1016\/j.asoc.2022.109533","article-title":"Combining Physics-Based and Data-Driven Techniques for Reliable Hybrid Analysis and Modeling Using the Corrective Source Term Approach","volume":"128","author":"Blakseth","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Salzmann, M., and Fua, P. (2011). Formalizing Template-Based Reconstruction. Deformable Surface 3D Reconstruction from Monocular Images, Springer International Publishing.","DOI":"10.1007\/978-3-031-01810-7"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/13\/4007\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T04:21:00Z","timestamp":1783138860000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/13\/4007"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,24]]},"references-count":56,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["s26134007"],"URL":"https:\/\/doi.org\/10.3390\/s26134007","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,24]]}}}