{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:18:47Z","timestamp":1760242727587,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2016,3,18]],"date-time":"2016-03-18T00:00:00Z","timestamp":1458259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we present a novel automatic pipeline to build personalized parametric models of dynamic people using a single RGB camera. Compared to previous approaches that use monocular RGB images, our system can model a 3D human body automatically and incrementally, taking advantage of human motion. Based on coarse 2D and 3D poses estimated from image sequences, we first perform a kinematic classification of human body parts to refine the poses and obtain reconstructed body parts. Next, a personalized parametric human model is generated by driving a general template to fit the body parts and calculating the non-rigid deformation. Experimental results show that our shape estimation method achieves comparable accuracy with reconstructed models using depth cameras, yet requires neither user interaction nor any dedicated devices, leading to the feasibility of using this method on widely available smart phones.<\/jats:p>","DOI":"10.3390\/s16030402","type":"journal-article","created":{"date-parts":[[2016,3,18]],"date-time":"2016-03-18T13:31:03Z","timestamp":1458307863000},"page":"402","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Dynamic Human Body Modeling Using a Single RGB Camera"],"prefix":"10.3390","volume":"16","author":[{"given":"Haiyu","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yao","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sidan","family":"Du","sequence":"additional","affiliation":[{"name":"School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dou, M., Taylor, J., Fuchs, H., Fitzgibbon, A., and Izadi, S. (2015, January 7\u201312). 3D Scanning Deformable Objects with a Single RGBD Sensor. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298647"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Fox, D., and Seitz, S.M. (2015, January 7\u201312). DynamicFusion: Reconstruction and Tracking of non-Rigid Scenes in Real-Time. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A. (2011, January 26\u201329). KinectFusion: Real-time dense surface mapping and tracking. Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zeng, M., Zheng, J., Cheng, X., and Liu, X. (2013, January 25\u201327). Templateless quasi-rigid shape modeling with implicit loop-closure. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.26"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Fu, B., Ye, M., and Yang, R. (2014, January 23\u201328). Quality Dynamic Human Body Modeling Using a Single Low-Cost Depth Camera. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.92"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. (2005, January 31). SCAPE: Shape completion and animation of people. Proceedings of the ACM Transactions on Graphics (TOG), New York, NY, USA.","DOI":"10.1145\/1186822.1073207"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1109\/TSMCC.2007.905808","article-title":"Segmentation and modeling of full human body shape from 3-D scan data: A survey","volume":"37","author":"Werghi","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., and Seidel, H.P. (2009, January 20\u201325). Motion capture using joint skeleton tracking and surface estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206755"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Huang, C.H., Boyer, E., Navab, N., and Ilic, S. (2014, January 24\u201327). Human shape and pose tracking using keyframes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.440"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2720","DOI":"10.1109\/TPAMI.2013.47","article-title":"Markerless motion capture of multiple characters using multiview image segmentation","volume":"35","author":"Liu","year":"2013","journal-title":"PAMI"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Robertini, N., de Aguiar, E., Helten, T., and Theobalt, C. (2014, January 8\u201311). Efficient Multi-View Performance Capture of Fine-Scale Surface Detail. Proceedings of the 2014 2nd International Conference on 3D Vision (3DV), Tokyo, Japan.","DOI":"10.1109\/3DV.2014.46"},{"key":"ref_12","first-page":"156:1","article-title":"Real-time non-Rigid Reconstruction using an RGB-D Camera","volume":"33","author":"Izadi","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"187:1","DOI":"10.1145\/2508363.2508407","article-title":"3D self-portraits","volume":"32","author":"Li","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TVCG.2012.56","article-title":"Scanning 3d full human bodies using kinects","volume":"18","author":"Tong","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Weiss, A., Hirshberg, D., and Black, M.J. (2011, January 6\u201313). Home 3D body scans from noisy image and range data. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126465"},{"key":"ref_16","unstructured":"Bogo, F., Black, M.J., Loper, M., and Romero, J. (2011, January 6\u201313). Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences. Proceedings of the the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain."},{"key":"ref_17","unstructured":"Guan, P., Weiss, A., B\u0103lan, A.O., and Black, M.J. (October, January 29). Estimating human shape and pose from a single image. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hasler, N., Ackermann, H., Rosenhahn, B., Thormahlen, T., and Seidel, H.P. (2010, January 13\u201318). Multilinear pose and body shape estimation of dressed subjects from image sets. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539853"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jain, A., Thorm\u00e4hlen, T., Seidel, H.P., and Theobalt, C. (2010, January 12). Moviereshape: Tracking and reshaping of humans in videos. Proceedings of the ACM Transactions on Graphics (TOG), New York, NY, USA.","DOI":"10.1145\/1882262.1866174"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhou, S., Fu, H., Liu, L., Cohen-Or, D., and Han, X. (2010, January 26). Parametric reshaping of human bodies in images. Proceedings of the ACM Transactions on Graphics (TOG), New York, NY, USA.","DOI":"10.1145\/1833349.1778863"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yu, R., Russell, C., Campbell, N., and Agapito, L. (2015, January 13). Direct, Dense, and Deformable: Template-Based non-Rigid 3D Reconstruction from RGB Video. Proceedings of the IEEE International Conference on Computer Vision (ICCV 2016), Bath, UK.","DOI":"10.1109\/ICCV.2015.111"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1111\/j.1467-8659.2009.01373.x","article-title":"A statistical model of human pose and body shape","volume":"Volume 28","author":"Hasler","year":"2009","journal-title":"Computer Graphics Forum"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Ramanan, D. (2011, January 20\u201325). Articulated pose estimation with flexible mixtures-of-parts. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995741"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, C., Wang, Y., Lin, Z., Yuille, A.L., and Gao, W. (p2014, January 24\u201327). Robust estimation of 3d human poses from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.303"},{"key":"ref_25","first-page":"35","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Fluids Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/TPAMI.2010.46","article-title":"Point set registration: Coherent point drift","volume":"32","author":"Myronenko","year":"2010","journal-title":"PAMI"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1109\/TPAMI.2010.143","article-title":"Large displacement optical flow: Descriptor matching in variational motion estimation","volume":"33","author":"Brox","year":"2011","journal-title":"PAMI"},{"key":"ref_28","first-page":"109","article-title":"Efficient inference in fully connected crfs with gaussian edge potentials","volume":"24","author":"Koltun","year":"2011","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2:1","DOI":"10.1145\/1486525.1486527","article-title":"SBA: A software package for generic sparse bundle adjustment","volume":"36","author":"Lourakis","year":"2009","journal-title":"TOMS"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"11362","DOI":"10.3390\/s130911362","article-title":"Measuring Accurate Body Parameters of Dressed Humans with Large-Scale Motion Using a Kinect Sensor","volume":"13","author":"Xu","year":"2013","journal-title":"Sensors"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/402\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:20:57Z","timestamp":1760210457000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/402"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,18]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["s16030402"],"URL":"https:\/\/doi.org\/10.3390\/s16030402","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,3,18]]}}}