{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:32:13Z","timestamp":1760236333805,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,14]],"date-time":"2021-11-14T00:00:00Z","timestamp":1636848000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Sichuan Science and Technology Program","award":["2021YFQ0003"],"award-info":[{"award-number":["2021YFQ0003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>At present, feature-based 3D reconstruction and tracking technology is widely applied in the medical field. In minimally invasive surgery, the surgeon can achieve three-dimensional reconstruction through the images obtained by the endoscope in the human body, restore the three-dimensional scene of the area to be operated on, and track the motion of the soft tissue surface. This enables doctors to have a clearer understanding of the location depth of the surgical area, greatly reducing the negative impact of 2D image defects and ensuring smooth operation. In this study, firstly, the 3D coordinates of each feature point are calculated by using the parameters of the parallel binocular endoscope and the spatial geometric constraints. At the same time, the discrete feature points are divided into multiple triangles using the Delaunay triangulation method. Then, the 3D coordinates of feature points and the division results of each triangle are combined to complete the 3D surface reconstruction. Combined with the feature matching method based on convolutional neural network, feature tracking is realized by calculating the three-dimensional coordinate changes of the same feature point in different frames. Finally, experiments are carried out on the endoscope image to complete the 3D surface reconstruction and feature tracking.<\/jats:p>","DOI":"10.3390\/s21227570","type":"journal-article","created":{"date-parts":[[2021,11,14]],"date-time":"2021-11-14T20:51:53Z","timestamp":1636923113000},"page":"7570","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface"],"prefix":"10.3390","volume":"21","author":[{"given":"Ziyan","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Innovation and Entrepreneurship, Xi\u2019an Fanyi University, Xi\u2019an 710105, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1407-0283","authenticated-orcid":false,"given":"Yan","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6398-7461","authenticated-orcid":false,"given":"Jiawei","family":"Tian","sequence":"additional","affiliation":[{"name":"School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8040-0367","authenticated-orcid":false,"given":"Shan","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"given":"Bo","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"given":"Longhai","family":"Xiang","sequence":"additional","affiliation":[{"name":"School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5022-610X","authenticated-orcid":false,"given":"Lirong","family":"Yin","sequence":"additional","affiliation":[{"name":"Department of Geography and Anthropology, Louisiana State University, Baton Rouge, LA 70803, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8486-1654","authenticated-orcid":false,"given":"Wenfeng","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1109\/JBHI.2014.2384134","article-title":"Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods","volume":"20","author":"Bergen","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e2015.00052","DOI":"10.4293\/JSLS.2015.00052","article-title":"Past, Present, and Future of Minimally Invasive Abdominal Surgery","volume":"19","author":"Antoniou","year":"2015","journal-title":"JSLS J. Soc. Laparoendosc. Surg."},{"key":"ref_3","first-page":"1","article-title":"Image-guided procedures: A review","volume":"3","author":"Yaniv","year":"2006","journal-title":"Comput. Aided Interv. Med. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"368","DOI":"10.4253\/wjge.v9.i8.368","article-title":"Evolution of stereoscopic imaging in surgery and recent advances","volume":"9","author":"Schwab","year":"2017","journal-title":"World J. Gastrointest. Endosc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"105344","DOI":"10.1016\/j.cmpb.2020.105344","article-title":"Construction of force haptic reappearance system based on Geomagic Touch haptic device","volume":"190","author":"Tang","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103261","DOI":"10.1016\/j.bspc.2021.103261","article-title":"Endoscope image mosaic based on pyramid ORB","volume":"71","author":"Zhang","year":"2021","journal-title":"Biomed. Signal Process. Control."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"110165","DOI":"10.1016\/j.measurement.2021.110165","article-title":"Power frequency estimation using sine filtering of optimal initial phase","volume":"186","author":"Guo","year":"2021","journal-title":"Measurement"},{"doi-asserted-by":"crossref","unstructured":"Li, Y., Zheng, W., Liu, X., Mou, Y., Yin, L., and Yang, B. (2021). Research and improvement of feature detection algorithm based on FAST. RENDICONTI Lince, 1\u201315.","key":"ref_8","DOI":"10.1007\/s12210-021-01020-1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1604824","DOI":"10.1155\/2016\/1604824","article-title":"A New Algorithm for Distributed Control Problem with Shortest-Distance Constraints","volume":"2016","author":"Zhou","year":"2016","journal-title":"Math. Probl. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.inffus.2016.09.004","article-title":"Motion prediction via online instantaneous frequency estimation for vision-based beating heart tracking","volume":"35","author":"Yang","year":"2017","journal-title":"Inf. Fusion"},{"doi-asserted-by":"crossref","unstructured":"Dankwa, S., and Zheng, W. (2019). Special Issue on Using Machine Learning Algorithms in the Prediction of Kyphosis Disease: A Comparative Study. Appl. Sci., 9.","key":"ref_11","DOI":"10.3390\/app9163322"},{"doi-asserted-by":"crossref","unstructured":"Ding, Y., Tian, X., Yin, L., Chen, X., Liu, S., Yang, B., and Zheng, W. (2019, January 23\u201325). Multi-scale Relation Network for Few-Shot Learning Based on Meta-learning. Proceedings of the 12th International Conference on Computer Vision Systems, Thessaloniki, Greece.","key":"ref_12","DOI":"10.1007\/978-3-030-34995-0_31"},{"unstructured":"Ni, X., Yin, L., Chen, X., Liu, S., Yang, B., and Zheng, W. (December, January 12). Semantic representation for visual reasoning. Proceedings of the 2018 International Joint Conference on Metallurgical and Materials Engineering (JCMME 2018), Wellington, New Zealand.","key":"ref_13"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1007\/s12040-018-1040-2","article-title":"Fractal dimension analysis for seismicity spatial and temporal distribution in the circum-Pacific seismic belt","volume":"128","author":"Yin","year":"2019","journal-title":"J. Earth Syst. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"134244","DOI":"10.1016\/j.scitotenv.2019.134244","article-title":"Temporal evolution characteristics of PM2.5 concentration based on continuous wavelet transform","volume":"699","author":"Chen","year":"2020","journal-title":"Sci. Total Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"102367","DOI":"10.1016\/j.bspc.2020.102367","article-title":"An improved method for soft tissue modeling","volume":"65","author":"Tang","year":"2021","journal-title":"Biomed. Signal Process. Control."},{"doi-asserted-by":"crossref","unstructured":"Zheng, W., Liu, X., and Yin, L. (2021). Sentence Representation Method Based on Multi-Layer Semantic Network. Appl. Sci., 11.","key":"ref_17","DOI":"10.3390\/app11031316"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.aei.2018.05.005","article-title":"A review of 3D reconstruction techniques in civil engineering and their applications","volume":"37","author":"Ma","year":"2018","journal-title":"Adv. Eng. Inform."},{"unstructured":"Wu, X., Xiao, S., and Wei, J. (2015, January 6\u20139). High accurate 3D reconstruction method using binocular stereo based on multiple constraints. Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.","key":"ref_19"},{"doi-asserted-by":"crossref","unstructured":"Joo, H., Simon, T., and Sheikh, Y. (2018, January 18\u201323). Total capture: A 3D deformation model for tracking faces, hands, and bodies. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","key":"ref_20","DOI":"10.1109\/CVPR.2018.00868"},{"doi-asserted-by":"crossref","unstructured":"Yang, Q., Engels, C., and Akbarzadeh, A. (2008, January 1\u20134). Near Real-time Stereo for Weakly-Textured Scenes. Proceedings of the 2008 BMVC, Leeds, UK.","key":"ref_21","DOI":"10.5244\/C.22.72"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1007\/s11760-017-1090-y","article-title":"A triangular radial cubic spline deformation model for efficient 3D beating heart tracking","volume":"11","author":"Yang","year":"2017","journal-title":"Signal Image Video Process."},{"doi-asserted-by":"crossref","unstructured":"Yang, B., Cao, T., Zheng, W., and Liu, S. (2018, January 18\u201321). Motion Tracking for Beating Heart Based on Sparse Statistic Pose Modeling. Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.","key":"ref_23","DOI":"10.1109\/EMBC.2018.8512404"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6222","DOI":"10.1364\/BOE.9.006222","article-title":"Reconstructing a 3D heart surface with stereo-endoscope by learning eig-en-shapes","volume":"9","author":"Yang","year":"2018","journal-title":"Biomed. Opt. Express"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"35469","DOI":"10.1364\/OE.404471","article-title":"Sparse-view CBCT reconstruction via weighted Schatten p-norm minimization","volume":"28","author":"Xu","year":"2020","journal-title":"Opt. Express"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1632","DOI":"10.1118\/1.3681017","article-title":"Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration","volume":"39","author":"Bodenstedt","year":"2012","journal-title":"Med. Phys."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"15635","DOI":"10.1007\/s11042-015-2845-5","article-title":"Binocular vision calibration and 3D re-construction with an orthogonal learning neural network","volume":"75","author":"Ge","year":"2015","journal-title":"Multimedia Tools Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/LRA.2017.2735487","article-title":"Dynamic Reconstruction of Deformable Soft-Tissue With Stereo Scope in Minimal Invasive Surgery","volume":"3","author":"Song","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1016\/j.media.2011.02.010","article-title":"Context specific descriptors for tracking deforming tissue","volume":"16","author":"Mountney","year":"2012","journal-title":"Med. Image Anal."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/TPAMI.2012.81","article-title":"Probabilistic Tracking of Affine-Invariant Anisotropic Regions","volume":"35","author":"Giannarou","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e353","DOI":"10.7717\/peerj-cs.353","article-title":"Joint embedding VQA model based on dynamic word vector","volume":"7","author":"Ma","year":"2021","journal-title":"PeerJ Comput. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"108153","DOI":"10.1016\/j.patcog.2021.108153","article-title":"Knowledge base graph embedding module design for Visual question answering model","volume":"120","author":"Zheng","year":"2021","journal-title":"Pattern Recognit."},{"doi-asserted-by":"crossref","unstructured":"Zhang, Z., Tian, J., Huang, W., Yin, L., Zheng, W., and Liu, S. (2021). A Haze Prediction Method Based on One-Dimensional Convolutional Neural Network. Atmosphere, 12.","key":"ref_33","DOI":"10.3390\/atmos12101327"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e613","DOI":"10.7717\/peerj-cs.613","article-title":"Research on image classification method based on improved multi-scale relational network","volume":"7","author":"Zheng","year":"2021","journal-title":"PeerJ Comput. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7570\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:30:04Z","timestamp":1760167804000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7570"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,14]]},"references-count":34,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21227570"],"URL":"https:\/\/doi.org\/10.3390\/s21227570","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,14]]}}}