{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T17:59:28Z","timestamp":1760551168716,"version":"3.41.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,7,5]],"date-time":"2020-07-05T00:00:00Z","timestamp":1593907200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key R8D Program of China","award":["2018YFB1601101"],"award-info":[{"award-number":["2018YFB1601101"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities of China","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61673402, 61273270, and 60802069"],"award-info":[{"award-number":["61673402, 61273270, and 60802069"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003453","name":"Natural Science Foundation of Guangdong Province","doi-asserted-by":"crossref","award":["2017A030311029"],"award-info":[{"award-number":["2017A030311029"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and Technology Program of Guangzhou of China","award":["201704020180"],"award-info":[{"award-number":["201704020180"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2020,8,31]]},"abstract":"<jats:p>\n            Recently, tremendous progress has been achieved on human pose estimation with the development of convolutional neural networks (CNNs). However, current methods still suffer from severe occlusion, back view, and large pose variation due to the lack of consideration of the spatial relationship between different joints, which can provide strong cues for localizing the hidden keypoints. In this work, we design a Structural Pose Network (SPN) to take full advantage of joint structure for human pose estimation under unconstrained environment. Specifically, the proposed model is composed of two subnets: Structure Residual Network (SRN) and Structure Improving Network (SIN). Given an input image, SRN first captures rich joint structure as priors through a multi-branch feature extraction module, following a hourglass network with pyramid residual units to enlarge the receptive field and further obtain structural feature representations. SIN, based on coordinate regression, can optimize the spatial relationship of different joints via the attention mechanism, thus refining the initial prediction from SRN. In addition, we propose a novel structure-consistency constraint, which can maintain the structural consistency between the joints and body parts via estimating whether the joints are located in their corresponding parts. At the same time, an\n            <jats:italic>online hard regions mining<\/jats:italic>\n            (OHRM) strategy is introduced to drive the network to pay corresponding attention to different body parts. The experimental results on three challenging datasets show that our method outperforms other state-of-the-art algorithms.\n          <\/jats:p>","DOI":"10.1145\/3392302","type":"journal-article","created":{"date-parts":[[2020,7,6]],"date-time":"2020-07-06T04:16:30Z","timestamp":1594008990000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Learning Joint Structure for Human Pose Estimation"],"prefix":"10.1145","volume":"16","author":[{"given":"Shenming","family":"Feng","sequence":"first","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou, Guangdong, People's Republic of China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4884-323X","authenticated-orcid":false,"given":"Haifeng","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou, Guangdong, People's Republic of China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,7,5]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.1109\/CVPR.2014.471"},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.1109\/CVPR.2009.5206754"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.1007\/978-3-319-46478-7_44"},{"doi-asserted-by":"publisher","key":"e_1_2_1_4_1","DOI":"10.1109\/ICCV.2017.400"},{"doi-asserted-by":"publisher","key":"e_1_2_1_5_1","DOI":"10.1109\/ICCV.2019.00236"},{"doi-asserted-by":"publisher","key":"e_1_2_1_6_1","DOI":"10.1109\/CVPR.2016.512"},{"volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems. 1736--1744","author":"Chen Xianjie","key":"e_1_2_1_7_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1109\/ICCV.2017.137"},{"doi-asserted-by":"publisher","key":"e_1_2_1_9_1","DOI":"10.1109\/CVPR.2018.00742"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.23919\/APSIPA.2018.8659538"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.1109\/CVPR.2016.510"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1109\/CVPR.2017.601"},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.1016\/j.imavis.2015.11.004"},{"doi-asserted-by":"publisher","key":"e_1_2_1_14_1","DOI":"10.1109\/CVPR.2008.4587597"},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.1109\/T-C.1973.223602"},{"doi-asserted-by":"publisher","key":"e_1_2_1_16_1","DOI":"10.1109\/CVPR.2016.90"},{"volume-title":"Coarse-to-fine face alignment with multi-scale local patch regression. arXiv preprint arXiv:1511.04901","year":"2015","author":"Huang Zhiao","key":"e_1_2_1_17_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_18_1","DOI":"10.1007\/978-3-319-46466-4_3"},{"volume-title":"Proceedings of the Asian Conference on Computer Vision. 302--315","year":"2014","author":"Jain Arjun","key":"e_1_2_1_19_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.5244\/C.24.12"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.1007\/978-3-030-01216-8_44"},{"doi-asserted-by":"publisher","key":"e_1_2_1_22_1","DOI":"10.1109\/TPAMI.2019.2894422"},{"doi-asserted-by":"publisher","key":"e_1_2_1_23_1","DOI":"10.1007\/978-3-319-46484-8_29"},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.1109\/ICCV.2017.373"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1109\/CVPR.2018.00224"},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.1109\/CVPR.2016.533"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.1109\/CVPR.2013.471"},{"doi-asserted-by":"publisher","key":"e_1_2_1_28_1","DOI":"10.1109\/ICCV.2017.597"},{"doi-asserted-by":"publisher","key":"e_1_2_1_29_1","DOI":"10.1007\/978-3-030-01219-9_12"},{"key":"e_1_2_1_30_1","first-page":"26","article-title":"Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude","volume":"4","author":"Tieleman Tijmen","year":"2012","journal-title":"COURSERA: Neural Netw. Mach. Learn."},{"doi-asserted-by":"publisher","key":"e_1_2_1_31_1","DOI":"10.1109\/CVPR.2015.7298664"},{"volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems. 1799--1807","year":"2014","author":"Tompson Jonathan J.","key":"e_1_2_1_32_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_33_1","DOI":"10.1109\/CVPR.2014.214"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 915--922","author":"Wang Chunyu","key":"e_1_2_1_34_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.1109\/CVPR.2016.511"},{"doi-asserted-by":"publisher","key":"e_1_2_1_36_1","DOI":"10.1109\/CVPR.2016.140"},{"volume-title":"Proceedings of the International Conference on Articulated Motion and Deformable Objects. 114--123","author":"Xu Ran","key":"e_1_2_1_37_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_38_1","DOI":"10.1109\/ICCV.2017.144"},{"doi-asserted-by":"publisher","key":"e_1_2_1_39_1","DOI":"10.1109\/CVPR.2011.5995741"},{"volume-title":"Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122","year":"2015","author":"Yu Fisher","key":"e_1_2_1_40_1"},{"volume-title":"Human pose estimation with spatial contextual information. arXiv preprint arXiv:1901.01760","year":"2019","author":"Zhang Hong","key":"e_1_2_1_41_1"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3392302","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3392302","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:49Z","timestamp":1750199929000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3392302"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,5]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,8,31]]}},"alternative-id":["10.1145\/3392302"],"URL":"https:\/\/doi.org\/10.1145\/3392302","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2020,7,5]]},"assertion":[{"value":"2019-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}