{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:08:02Z","timestamp":1760144882969,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"],"award-info":[{"award-number":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"]}]},{"name":"Key Laboratory Project of the Ministry of Culture and Tourism","award":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"],"award-info":[{"award-number":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"]}]},{"name":"Science and Technology Plan Project of Xi\u2019an City","award":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"],"award-info":[{"award-number":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"]}]},{"name":"Key Research and Development Program of Shaanxi Province","award":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"],"award-info":[{"award-number":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"]}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"],"award-info":[{"award-number":["62271393","1222000812","crrt2021K01","2024JH-CXSF-0014","2024SF-YBXM-681","2019GY215","2021ZDLSF06-04","2018M643719"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Accurate and robust 3D human modeling from a single image presents significant challenges. Existing methods have shown potential, but they often fail to generate reconstructions that match the level of detail in the input image. These methods particularly struggle with loose clothing. They typically employ parameterized human models to constrain the reconstruction process, ensuring the results do not deviate too far from the model and produce anomalies. However, this also limits the recovery of loose clothing. To address this issue, we propose an end-to-end method called IHRPN for reconstructing clothed humans from a single 2D human image. This method includes a feature extraction module for semantic extraction of image features. We propose an image semantic feature extraction aimed at achieving pixel model space consistency and enhancing the robustness of loose clothing. We extract features from the input image to infer and recover the SMPL-X mesh, and then combine it with a normal map to guide the implicit function to reconstruct the complete clothed human. Unlike traditional methods, we use local features for implicit surface regression. Our experimental results show that our IHRPN method performs excellently on the CAPE and AGORA datasets, achieving good performance, and the reconstruction of loose clothing is noticeably more accurate and robust.<\/jats:p>","DOI":"10.3390\/jimaging10060133","type":"journal-article","created":{"date-parts":[[2024,5,30]],"date-time":"2024-05-30T03:45:08Z","timestamp":1717040708000},"page":"133","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Implicit 3D Human Reconstruction Guided by Parametric Models and Normal Maps"],"prefix":"10.3390","volume":"10","author":[{"given":"Yong","family":"Ren","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingquan","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yifan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Long","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiuquan","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6218-5715","authenticated-orcid":false,"given":"Kang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guohua","family":"Geng","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"},{"name":"National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi\u2019an 710127, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Feng, Y., Choutas, V., Bolkart, T., Tzionas, D., and Black, M.J. (2021, January 1\u20133). Collaborative regression of expressive bodies using moderation. Proceedings of the 2021 International Conference on 3D Vision (3DV)(IEEE2021), London, UK.","DOI":"10.1109\/3DV53792.2021.00088"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.-E., Marcotegui, B., Goulette, F., and Guibas, L.J. (November, January 27). Kpconv: Flexible and deformable convolution for point clouds. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2019), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00651"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Varol, G., Ceylan, D., Russell, B., Yang, J., Yumer, E., Laptev, I., and Schmid, C. (2018, January 8\u201314). Bodynet: Volumetric inference of 3d human body shapes. Proceedings of the European Conference on Computer Vision (ECCV) (2018), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_2"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, W., Ceylan, D., Mech, R., and Neumann, U. (2019, January 15\u201320). 3dn: 3d deformation network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2019), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00113"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Saito, S., Huang, Z., Natsume, R., Morishima, S., Kanazawa, A., and Li, H. (November, January 27). Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2019), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00239"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Saito, S., Simon, T., Saragih, J., and Joo, H. (2020, January 13\u201319). Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2020), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00016"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (November, January 27). Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2019), Seoul, Republic of Korea.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xiu, Y., Yang, J., Tzionas, D., and Black, M.J. (2022, January 18\u201324). Icon: Implicit clothed humans obtained from normals. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE2022), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01294"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3170","DOI":"10.1109\/TPAMI.2021.3050505","article-title":"Pamir: Parametric model-conditioned implicit representation for image-based human reconstruction","volume":"44","author":"Zheng","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Esser, P., Rombach, R., and Ommer, B. (2021, January 20\u201325). Taming transformers for high-resolution image synthesis. Proceedings of the IEEE\/CVF Conference on Computer Vision and pattern Recognition (2021), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Alldieck, T., Pons-Moll, G., Theobalt, C., and Magnor, M. (November, January 27). Tex2shape: Detailed full human body geometry from a single image. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2019), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00238"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Fan, H., Su, H., and Guibas, L.J. (2017, January 21\u201326). A point set generation network for 3d object reconstruction from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.264"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kanazawa, A., Black, M.J., Jacobs, D.W., and Malik, J. (2018, January 18\u201323). End-to-end recovery of human shape and pose. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00744"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jackson, A.S., Manafas, C., and Tzimiropoulos, G. (2018, January 8\u201314). 3d human body reconstruction from a single image via volumetric regression. Proceedings of the European Conference on Computer Vision (ECCV) Workshops (2018), Munich, Germany.","DOI":"10.1007\/978-3-030-11018-5_6"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lin, C.-H., Kong, C., and Lucey, S. (2018, January 2\u20137). Learning efficient point cloud generation for dense 3d object reconstruction. Proceedings of the AAAI Conference on Artificial Intelligence (2018), New Orleans, LO, USA.","DOI":"10.1609\/aaai.v32i1.12278"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yang, G., Huang, X., Hao, Z., Liu, M.-Y., Belongie, S., and Hariharan, B. (November, January 27). Pointflow: 3d point cloud generation with continuous normalizing flows. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2019), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00464"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, J., Bian, S., Liu, Q., Tang, J., Wang, F., and Lu, C. (2023, January 17\u201324). NIKI: Neural inverse kinematics with invertible neural networks for 3d human pose and shape estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2023), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01243"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, J., Xu, C., Chen, Z., Bian, S., Yang, L., and Lu, C. (2021, January 20\u201325). Hybrik: A hybrid analytical-neural inverse kinematics solution for 3d human pose and shape estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2021), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00339"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yi, H., Liang, H., Liu, Y., Cao, Q., Wen, Y., Bolkart, T., Tao, D., and Black, M.J. (2023, January 17\u201324). Generating holistic 3d human motion from speech. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2023), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00053"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tripathi, S., M\u00fcller, L., Huang, C.-H.P., Taheri, O., Black, M.J., and Tzionas, D. (2023, January 17\u201324). 3D human pose estimation via intuitive physics. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2023), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00457"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ma, Q., Yang, J., Ranjan, A., Pujades, S., Pons-Moll, G., Tang, S., and Black, M.J. (2020, January 13\u201319). Learning to dress 3d people in generative clothing. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2020), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00650"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lazova, V., Insafutdinov, E., and Pons-Moll, G. (2019, January 16\u201319). 360-degree textures of people in clothing from a single image. Proceedings of the 2019 International Conference on 3D Vision (3DV) (IEEE 2019), Quebec City, QC, Canada.","DOI":"10.1109\/3DV.2019.00076"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jiang, B., Zhang, J., Hong, Y., Luo, J., Liu, L., and Bao, H. (2020, January 23\u201328). Bcnet: Learning body and cloth shape from a single image. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK.","DOI":"10.1007\/978-3-030-58565-5_2"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bhatnagar, B.L., Tiwari, G., Theobalt, C., and Pons-Moll, G. (November, January 27). Multi-garment net: Learning to dress 3d people from images. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2019), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00552"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, T., Xu, Y., Saito, S., Soatto, S., and Tung, T. (2021, January 20\u201325). Arch++: Animation-ready clothed human reconstruction revisited. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2021), Nashville, TN, USA.","DOI":"10.1109\/ICCV48922.2021.01086"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bhatnagar, B.L., Sminchisescu, C., Theobalt, C., and Pons-Moll, G. (2020, January 23\u201328). Combining implicit function learning and parametric models for 3d human reconstruction. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK.","DOI":"10.1007\/978-3-030-58536-5_19"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chen, Z., and Zhang, H. (November, January 27). Learning implicit fields for generative shape modeling. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2019), Seoul, Republic of Korea.","DOI":"10.1109\/CVPR.2019.00609"},{"key":"ref_28","first-page":"9276","article-title":"Geo-pifu: Geometry and pixel aligned implicit functions for single-view human reconstruction","volume":"33","author":"He","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, Z., Yu, T., Pan, C., Zheng, Z., and Liu, Y. (2020, January 13\u201319). Robust 3d self-portraits in seconds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2020), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00142"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dong, Z., Guo, C., Song, J., Chen, X., Geiger, A., and Hilliges, O. (2022, January 18\u201324). PINA: Learning a personalized implicit neural avatar from a single RGB-D video sequence. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2022), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01982"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, Z., Wang, S., Manivasagam, S., Huang, Z., Ma, W.-C., Yan, X., Yumer, E., and Urtasun, R. (2021, January 20\u201325). S3: Neural shape, skeleton, and skinning fields for 3d human modeling. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2021), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01308"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Huang, Z., Xu, Y., Lassner, C., Li, H., and Tung, T. (2020, January 13\u201319). Arch: Animatable reconstruction of clothed humans. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2020), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00316"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Alldieck, T., Xu, H., and Sminchisescu, C. (2021, January 20\u201325). imghum: Implicit generative models of 3d human shape and articulated pose. Proceedings of the IEEE\/CVF International Conference on Computer Vision (2021), Nashville, TN, USA.","DOI":"10.1109\/ICCV48922.2021.00541"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lorensen, W.E., and Cline, H.E. (1998). Marching cubes: A high resolution 3D surface construction algorithm. Semin. Graph. Pioneer. Efforts Shaped Field, 347\u2013353.","DOI":"10.1145\/280811.281026"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yu, T., Zheng, Z., Guo, K., Liu, P., Dai, Q., and Liu, Y. (2021, January 20\u201325). Function4d: Real-time human volumetric capture from very sparse consumer rgbd sensors. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2021), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00569"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Patel, P., Huang, C.-H.P., Tesch, J., Hoffmann, D.T., Tripathi, S., and Black, M.J. (2021, January 20\u201325). AGORA: Avatars in geography optimized for regression analysis. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2021), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01326"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/6\/133\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:50:32Z","timestamp":1760107832000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/6\/133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,29]]},"references-count":36,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["jimaging10060133"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10060133","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2024,5,29]]}}}