{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T16:40:18Z","timestamp":1772642418741,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2015,6,29]],"date-time":"2015-06-29T00:00:00Z","timestamp":1435536000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"US National Science Foundation","award":["NRI-1427345"],"award-info":[{"award-number":["NRI-1427345"]}]},{"DOI":"10.13039\/100008569","name":"Oklahoma Center for the Advancement of Science and Technology","doi-asserted-by":"publisher","award":["HR12-30"],"award-info":[{"award-number":["HR12-30"]}],"id":[{"id":"10.13039\/100008569","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We propose a generative framework for 3D human pose estimation that is able to operate on both individual point sets and sequential depth data. We formulate human pose estimation as a point set registration problem, where we propose three new approaches to address several major technical challenges in this research. First, we integrate two registration techniques that have a complementary nature to cope with non-rigid and articulated deformations of the human body under a variety of poses. This unique combination allows us to handle point sets of complex body motion and large pose variation without any initial conditions, as required by most existing approaches. Second, we introduce an efficient pose tracking strategy to deal with sequential depth data, where the major challenge is the incomplete data due to self-occlusions and view changes. We introduce a visible point extraction method to initialize a new template for the current frame from the previous frame, which effectively reduces the ambiguity and uncertainty during registration. Third, to support robust and stable pose tracking, we develop a segment volume validation technique to detect tracking failures and to re-initialize pose registration if needed. The experimental results on both benchmark 3D laser scan and depth datasets demonstrate the effectiveness of the proposed framework when compared with state-of-the-art algorithms.<\/jats:p>","DOI":"10.3390\/s150715218","type":"journal-article","created":{"date-parts":[[2015,6,29]],"date-time":"2015-06-29T10:05:22Z","timestamp":1435572322000},"page":"15218-15245","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Articulated Non-Rigid Point Set Registration for Human Pose Estimation from 3D Sensors"],"prefix":"10.3390","volume":"15","author":[{"given":"Song","family":"Ge","sequence":"first","affiliation":[{"name":"School of Electrical and Computer Engineering, Oklahoma State University, Stillwater, OK 74078, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guoliang","family":"Fan","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Oklahoma State University, Stillwater, OK 74078, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,6,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4189","DOI":"10.3390\/s140304189","article-title":"A survey on model based approaches for 2D and 3D visual human pose recovery","volume":"14","author":"Escalera","year":"2014","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Escalera, S. (2012, January 11\u201313). Human behavior analysis from depth maps. Mallorca, Spain.","DOI":"10.1007\/978-3-642-31567-1_28"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Grzegorzek, M., Theobalt, C., Koch, R., and Kolb, A. (2013). Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, Springer-Verlag.","DOI":"10.1007\/978-3-642-44964-2"},{"key":"ref_4","unstructured":"Avaliable online: http:\/\/www.xbox.com\/en-US\/xbox-one."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sanmart\u00edn, G., Flores, J., Arias, P., Cudeiro, J., and M\u00e9ndez, R. (2012, January 11\u201313). Motion capture for clinical purposes, an approach using primesense sensors. Mallorca, Spain.","DOI":"10.1007\/978-3-642-31567-1_27"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2756","DOI":"10.3390\/s140202756","article-title":"A depth-based fall detection system using a kinect sensor","volume":"14","author":"Gasparrini","year":"2014","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"11735","DOI":"10.3390\/s140711735","article-title":"A depth video sensor-based life-logging human activity recognition system for elderly care in smart indoor environments","volume":"14","author":"Jalal","year":"2014","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1785","DOI":"10.3390\/s150101785","article-title":"Pose estimation with a kinect for ergonomic studies: Evaluation of the accuracy using a virtual mannequin","volume":"15","author":"Plantard","year":"2015","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.cviu.2006.08.002","article-title":"A survey of advances in vision-based human motion capture and analysis","volume":"104","author":"Moeslund","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","unstructured":"Elgammal, A., and Lee, C.S. (July, January 27). Inferring 3D body pose from silhouettes using activity manifold learning. Washington DC, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1145\/1073204.1073207","article-title":"SCAPE: Shape completion and animation of people","volume":"24","author":"Anguelov","year":"2005","journal-title":"ACM Trans. Gr."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. (2011, January 20\u201325). Real-time human pose recognition in parts from single depth images. New York, NY, USA.","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Taylor, J., Shotton, J., Sharp, T., and Fitzgibbon, A.W. (2012, January 16\u201321). The vitruvian manifold: Inferring dense correspondences for one-shot human pose estimation. Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247664"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Burke, M., and Lasenby, J. (2014, January 16\u201318). Fast upper body joint tracking using kinect pose priors. Palma de Mallorca, Spain.","DOI":"10.1007\/978-3-319-08849-5_10"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Demirdjian, D. (2004, January 11\u201314). Combining geometric- and view-based approaches for articulated pose estimation. Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24672-5_15"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Pellegrini, S., Schindler, K., and Nardi, D. (2008, January 1\u20134). A generalization of the ICP algorithm for articulated bodies. Leeds, UK.","DOI":"10.5244\/C.22.87"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1109\/TPAMI.2010.94","article-title":"Rigid and articulated point registration with expectation conditional maximization","volume":"33","author":"Horaud","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ye, M., and Yang, R. (2014, January 23\u201328). Real-time simultaneous pose and shape estimation for articulated objects using a single depth camera. Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.301"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Baak, A., M\u00fcller, M., Bharaj, G., Seidel, H., and Theobalt, C. (2011, January 6\u201313). A data-driven approach for real-time full body pose reconstruction from a depth camera. Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126356"},{"key":"ref_20","unstructured":"Helten, T., Baak, A., Bharaj, G., M\u00c3ijller, M., Seidel, H., and Theobalt, C. (July, January 29). Personalization and evaluation of a real-time depth-based full body tracker. Seattle, WA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Stoll, C., Hasler, N., Gall, J., Seidel, H., and Theobalt, C. (2011, January 6\u201313). Fast articulated motion tracking using a sums of Gaussians body model. Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126338"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ye, M., Wang, X., Yang, R., Liu, R., and Pollefeys, M. (2011, January 6\u201313). Accurate 3D pose estimation from a single depth image. Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126310"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ge, S., Fan, G., and Ding, M. (2014, January 23\u201328). Non-rigid point set registration with global-local topology preservation. Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.45"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/BF01427149","article-title":"Iterative point matching for registration of free-form curves and surfaces","volume":"13","author":"Zhang","year":"1994","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TPAMI.2006.81","article-title":"Robust point matching for nonrigid shapes by preserving local neighborhood structures","volume":"28","author":"Zheng","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ma, J., Zhao, J., Tian, J., Tu, Z., and Yuille, A.L. (2013, January 23\u201328). Robust esitimation of nonrigid transformation for point set registration. Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.279"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1706","DOI":"10.1109\/TIP.2014.2307478","article-title":"Robust point matching via vector field consensus","volume":"23","author":"Ma","year":"2014","journal-title":"IEEE Trans. Image Process"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/j.patcog.2010.10.009","article-title":"A robust hybrid method for nonrigid image registration","volume":"44","author":"Yang","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1016\/j.patcog.2013.09.017","article-title":"Robust point pattern matching based on spectral context","volume":"47","author":"Tang","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chui, H., and Rangarajan, A. A feature registration framework using mixture models. 190\u2013197.","DOI":"10.1109\/MMBIA.2000.852377"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/S1077-3142(03)00009-2","article-title":"A new point matching algorithm for non-rigid registration","volume":"89","author":"Chui","year":"2003","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_33","unstructured":"Myronenko, A., Song, X., and Carreira-Perpinan, M.A. (2006, January 4\u20137). Non-rigid point set registration: Coherent point drift (CPD). Vancouver, BC, Canada."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/TPAMI.2010.46","article-title":"Point set registration: Coherent point drift","volume":"32","author":"Myronenko","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","unstructured":"Jian, B., and Vemuri, B.C. (2005, January 17\u201321). A robust algorithm for point set registration using mixture of Gaussians. Las Vegas, NV, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1109\/TPAMI.2010.223","article-title":"Robust point set registration using Gaussian mixture models","volume":"33","author":"Jian","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Panaganti, V., and Aravind, R. (2015, January 5\u20139). Robust nonrigid point set registration using Graph-Laplacian regularization. Waikoloa, HI, USA.","DOI":"10.1109\/WACV.2015.156"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.patcog.2014.06.011","article-title":"Graph-based point drift: Graph centrality on the registration of point-sets","volume":"48","author":"Kropatsch","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Droeschel, D., and Behnke, S. (2011, January 6\u20139). 3D body pose estimation using an adaptive person model for articulated ICP. Aachen, Germany.","DOI":"10.1007\/978-3-642-25489-5_16"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5280","DOI":"10.3390\/s100505280","article-title":"A bayesian framework for human body pose tracking from depth image sequences","volume":"10","author":"Zhu","year":"2010","journal-title":"Sensors"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gall, J., Stoll, C., Aguiar, E., Theobalt, C., Rosenhahn, B., and Seidel, H.P. (2009, January 20\u201325). Motion capture using joint skeleton tracking and surface estimation. Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206755"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"8835","DOI":"10.3390\/s130708835","article-title":"Model-based reinforcement of kinect depth data for human motion capture applications","volume":"13","author":"Calderita","year":"2013","journal-title":"Sensors"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1145\/1276377.1276407","article-title":"Direct visibility of point sets","volume":"26","author":"Katz","year":"2007","journal-title":"ACM Trans. Graph."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1007\/s00371-005-0344-9","article-title":"Mesh segmentation using feature point and core extraction","volume":"21","author":"Katz","year":"2005","journal-title":"Vis. Comput."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bishop, C.M. (1995). Neural Networks for Pattern Recognition, Oxford University Press Inc.","DOI":"10.1093\/oso\/9780198538493.001.0001"},{"key":"ref_47","first-page":"183","article-title":"Finding minimal enclosing boxes","volume":"14","year":"1985","journal-title":"Parallel Program"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"122.1","DOI":"10.1145\/2019627.2019641","article-title":"Fast oriented bounding box optimization on the rotation group SO(3,R)","volume":"30","author":"Chang","year":"2011","journal-title":"ACM Trans. Graph"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ge, S., and Fan, G. (2015, January 5\u20139). Non-rigid articulated point set registration for human pose estimation. Waikoloa, HI, USA.","DOI":"10.1109\/WACV.2015.20"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ganapathi, V., Plagemann, C., Thrun, S., and Koller, D. (2010, January 13\u201318). Real time motion capture using a single time-of-flight camera. San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540141"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/7\/15218\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:48:28Z","timestamp":1760215708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/7\/15218"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,29]]},"references-count":50,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2015,7]]}},"alternative-id":["s150715218"],"URL":"https:\/\/doi.org\/10.3390\/s150715218","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,6,29]]}}}