{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T03:16:12Z","timestamp":1761621372362,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,3,16]],"date-time":"2018-03-16T00:00:00Z","timestamp":1521158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper deals with the 3D reconstruction problem for dynamic non-rigid objects with a single RGB-D sensor. It is a challenging task as we consider the almost inevitable accumulation error issue in some previous sequential fusion methods and also the possible failure of surface tracking in a long sequence. Therefore, we propose a global non-rigid registration framework and tackle the drifting problem via an explicit loop closure. Our novel scheme starts with a fusion step to get multiple partial scans from the input sequence, followed by a pairwise non-rigid registration and loop detection step to obtain correspondences between neighboring partial pieces and those pieces that form a loop. Then, we perform a global registration procedure to align all those pieces together into a consistent canonical space as guided by those matches that we have established. Finally, our proposed model-update step helps fixing potential misalignments that still exist after the global registration. Both geometric and appearance constraints are enforced during our alignment; therefore, we are able to get the recovered model with accurate geometry as well as high fidelity color maps for the mesh. Experiments on both synthetic and various real datasets have demonstrated the capability of our approach to reconstruct complete and watertight deformable objects.<\/jats:p>","DOI":"10.3390\/s18030886","type":"journal-article","created":{"date-parts":[[2018,3,20]],"date-time":"2018-03-20T06:57:11Z","timestamp":1521529031000},"page":"886","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Dynamic Non-Rigid Objects Reconstruction with a Single RGB-D Sensor"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1808-5239","authenticated-orcid":false,"given":"Sen","family":"Wang","sequence":"first","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Xinxin","family":"Zuo","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an 710072, China"},{"name":"University of Kentucky, Lexington, KY 40506, USA"}]},{"given":"Chao","family":"Du","sequence":"additional","affiliation":[{"name":"University of Kentucky, Lexington, KY 40506, USA"}]},{"given":"Runxiao","family":"Wang","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Jiangbin","family":"Zheng","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Ruigang","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Kentucky, Lexington, KY 40506, USA"},{"name":"Baidu Inc., Beijing 100085, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1177\/0278364916669237","article-title":"ElasticFusion: Real-Time Dense SLAM and Light Source Estimation","volume":"35","author":"Whelan","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A Versatile and Accurate Monocular SLAM System","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., and Burgard, W. (2012, January 14\u201318). An evaluation of the RGB-D SLAM system. Proceedings of the 2012 IEEE International Conference on Robotics and Automation (ICRA), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225199"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MCG.2007.68","article-title":"Surface Capture for Performance-Based Animation","volume":"27","author":"Starck","year":"2007","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1145\/1360612.1360697","article-title":"Performance capture from sparse multi-view video","volume":"27","author":"Aguiar","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1145\/1360612.1360696","article-title":"Articulated mesh animation from multi-view silhouettes","volume":"27","author":"Vlasic","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1007\/s00371-005-0346-7","article-title":"Scalable 3D video of dynamic scenes","volume":"21","author":"Cotting","year":"2005","journal-title":"Vis. Comput."},{"key":"ref_8","unstructured":"Dou, M., Fuchs, H., and Frahm, J.M. (2013, January 1\u20134). Scanning and tracking dynamic objects with commodity depth cameras. Proceedings of the 2013 IEEE Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, Australia."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TVCG.2012.56","article-title":"Scanning 3D full human bodies using Kinects","volume":"18","author":"Tong","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1109\/TMM.2012.2229264","article-title":"Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras","volume":"15","author":"Alexiadis","year":"2013","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1145\/2897824.2925969","article-title":"Fusion4D: real-time performance capture of challenging scenes","volume":"35","author":"Dou","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1145\/2508363.2508407","article-title":"3D self-portraits","volume":"32","author":"Li","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cui, Y., Chang, W., Nolly, T., and Stricker, D. (2012, January 5\u20139). Kinectavatar: Fully automatic body capture using a single Kinect. Proceedings of the Asian Conference on Computer Vision (ACCV), Daejeon, Korea.","DOI":"10.1007\/978-3-642-37484-5_12"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1145\/1073204.1073207","article-title":"SCAPE: shape completion and animation of people","volume":"24","author":"Anguelov","year":"2005","journal-title":"ACM Trans. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., and Seidel, H.-P. (2009, January 20\u201325). Motion capture using joint skeleton tracking and surface estimation. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206755"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Fox, D., and Seitz, S.M. (2015, January 7\u201312). DynamicFusion: Reconstruction and tracking of non-rigid scenes in real time. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Innmann, M., Zollh\u00f6fer, M., Nie\u00dfner, M., Theobalt, C., and Stamminger, M. (2016, January 8\u201316). VolumeDeform: Real-Time Volumetric Non-rigid Reconstruction. Proceedings of the 2016 European Conference on Computer Vision (ECCV), Amsterdam, The Netherland.","DOI":"10.1007\/978-3-319-46484-8_22"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Slavcheva, M., Baust, M., Cremers, D., and Ilic, S. (2017, January 21\u201326). KillingFusion: Non-rigid 3D Reconstruction without Correspondences. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.581"},{"key":"ref_19","first-page":"156","article-title":"Real-time non-rigid reconstruction using an RGB-D camera","volume":"33","author":"Izadi","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Guo, K., Xu, F., Wang, Y., Liu, Y., and Dai, Q. (2015, January 7\u201313). Robust Non-rigid Motion Tracking and Surface Reconstruction Using L0 Regularization. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.353"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bogo, F., Black, M.J., Loper, M., and Romero, J. (2015, January 7\u201313). Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.265"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Fu, B., Ye, M., and Yang, R. (2014, January 23\u201328). Quality dynamic human body modeling using a single low-cost depth camera. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.92"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhu, H.Y., Yu, Y., Zhou, Y., and Du, S.D. (2016). Dynamic human body modeling using a single RGB camera. Sensors, 16.","DOI":"10.3390\/s16030402"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1145\/3072959.3083722","article-title":"Real-time Geometry, Albedo and Motion Reconstruction Using a Single RGBD Camera","volume":"36","author":"Guo","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yu, T., Guo, K., Xu, F., Dong, Y., Su, Z., Zhao, J., Li, J., Dai, Q., and Liu, Y. (2017, January 22\u201329). BodyFusion: Real-time Capture of Human Motion and Surface Geometry Using a Single Depth Camera. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.104"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Dou, M., Taylor, J., Fuchs, H., Fitzgibbon, A., and Izadi, S. (2015, January 7\u201312). 3D scanning deformable objects with a single RGBD sensor. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298647"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1145\/1276377.1276478","article-title":"Embedded deformation for shape manipulation","volume":"26","author":"Sumner","year":"2007","journal-title":"ACM Trans. Graph."},{"key":"ref_28","unstructured":"Li, H., Sumner, R.W., and Pauly, M. (2008, January 2\u20134). Global correspondence optimization for non-rigid registration of depth scans. Proceedings of the 2008 Eurographics Association Symposium on Geometry Processing, Copenhagen, Denmark."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1109\/TPAMI.2010.143","article-title":"Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation","volume":"33","author":"Brox","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/3\/886\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:57:23Z","timestamp":1760194643000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/3\/886"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,16]]},"references-count":29,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["s18030886"],"URL":"https:\/\/doi.org\/10.3390\/s18030886","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,3,16]]}}}