{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:01:57Z","timestamp":1760148117656,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T00:00:00Z","timestamp":1680220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Jilin Province Science and Technology Development Plan Project","award":["20220401086YY"],"award-info":[{"award-number":["20220401086YY"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>There are six possible solutions for the surface normal vectors obtained from polarization information during 3D reconstruction. To resolve the ambiguity of surface normal vectors, scholars have introduced additional information, such as shading information. However, this makes the 3D reconstruction task too burdensome. Therefore, in order to make the 3D reconstruction more generally applicable, this paper proposes a complete framework to reconstruct the surface of an object using only polarized images. To solve the ambiguity problem of surface normal vectors, a jump-compensated U-shaped generative adversarial network (RU-Gan) based on jump compensation is designed for fusing six surface normal vectors. Among them, jump compensation is proposed in the encoder and decoder parts, and the content loss function is reconstructed, among other approaches. For the problem that the reflective region of the original image will cause the estimated normal vector to deviate from the true normal vector, a specular reflection model is proposed to optimize the dataset, thus reducing the reflective region. Experiments show that the estimated normal vector obtained in this paper improves the accuracy by about 20\u00b0 compared with the previous conventional work, and improves the accuracy by about 1.5\u00b0 compared with the recent neural network model, which means the neural network model proposed in this paper is more suitable for the normal vector estimation task. Furthermore, the object surface reconstruction framework proposed in this paper has the characteristics of simple implementation conditions and high accuracy of reconstructed texture.<\/jats:p>","DOI":"10.3390\/s23073638","type":"journal-article","created":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T08:27:27Z","timestamp":1680251247000},"page":"3638","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Polarized Object Surface Reconstruction Algorithm Based on RU-GAN Network"],"prefix":"10.3390","volume":"23","author":[{"given":"Xu","family":"Yang","sequence":"first","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7503-2766","authenticated-orcid":false,"given":"Cai","family":"Cheng","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Duan","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"You-Fei","family":"Hao","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Zhu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,31]]},"reference":[{"key":"ref_1","first-page":"248","article-title":"The principle and research progress of polarization three-dimensional imaging technology","volume":"40","author":"Li","year":"2021","journal-title":"J. Infrared Millim. Waves"},{"key":"ref_2","first-page":"803","article-title":"Dong Scientific Research. Development Status and Key Technologies of Polarization Imaging Detection Technology","volume":"6","author":"Li","year":"2013","journal-title":"China Opt."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aharchi, M., and Ait Kbir, M. (2019, January 2\u20134). A review on 3D reconstruction techniques from 2D images. Proceedings of the Third International Conference on Smart City Applications, Casablanca, Morocco.","DOI":"10.1007\/978-3-030-37629-1_37"},{"key":"ref_4","unstructured":"Koshikawa, K. (1979, January 20\u201323). A polarimetric approach to shape understanding of glossy objects. Proceedings of the International Conference on Artificial Intelligence, Tokyo, Japan."},{"key":"ref_5","first-page":"167","article-title":"Constraining Object Features using a Polarization Reflectance Model","volume":"1","author":"Wolff","year":"1993","journal-title":"Phys. Based Vis. Princ. Pract. Radiom"},{"key":"ref_6","first-page":"110","article-title":"Surface Orientation from Polarization Images. Optics, Illumination, and Image Sensing for Machine Vision II","volume":"850","author":"Wolff","year":"1988","journal-title":"Int. Soc. Opt. Photonics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1109\/TIP.2006.871114","article-title":"Recovery of Surface Orientation from Diffuse Polarization","volume":"15","author":"Atkinson","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2875","DOI":"10.1109\/TPAMI.2018.2868065","article-title":"Height-from-polarisation with Unknown Lighting or Albedo","volume":"41","author":"Smith","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","unstructured":"Mahmoud, A.H., El-Melegy, M.T., and Farag, A.A. (October, January 30). Direct Method for Shape Recovery from Polarization and Shading. Proceedings of the 19th IEEE International Conference on Image Processing, Orlando, FL, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Miyazaki, D., Tan, R.T., Hara, K., and Ikeuchi, K. (2003, January 13\u201316). Polarization-based Inverse Rendering from a Single View. Proceedings of the Computer Vision, IEEE International Conference on IEEE Computer Society, Nice, France.","DOI":"10.1109\/ICCV.2003.1238455"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/BF00128233","article-title":"Detection of diffuse and specular interface reflections interreflections by color image segmentation","volume":"17","author":"Bajcsy","year":"1996","journal-title":"Int. J. Comput. Vis."},{"key":"ref_12","first-page":"133","article-title":"Polarized multi view 3D reconstruction based on parallax angle and zenith angle optimization","volume":"40","author":"Zhang","year":"2021","journal-title":"J. Infrared Millim. Waves"},{"key":"ref_13","first-page":"819","article-title":"Polarization 3D reconstruction of low texture objects with rough depth information","volume":"38","author":"Yang","year":"2019","journal-title":"J. Infrared Millim. Wave"},{"key":"ref_14","unstructured":"Ba, Y., Chen, R., Wang, Y., Yan, L., Shi, B., and Kadambi, A. (2019). Physics-based Neural Networks for Shape from Polarization. arXiv, preprint."},{"key":"ref_15","unstructured":"Chen, C. (2021). Estimation of Surface Normals Based on Polarization Information. [Master\u2019s Thesis, Guangdong University of Technology]."},{"key":"ref_16","first-page":"321","article-title":"Research progress and prospect of generative countermeasure network GAN","volume":"43","author":"Wang","year":"2017","journal-title":"J. Autom."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.3724\/SP.J.1089.2021.18770","article-title":"Multi focus image fusion based on generation countermeasure network","volume":"33","author":"Jiang","year":"2021","journal-title":"J. Comput. Aided Des. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Waghule, D.R., and Ochawar, R.S. (2014, January 9\u201311). Overview on Edge Detection Methods. Proceedings of the 2014 International Conference on Electronic Systems, Signal Processing and Computing Technologies, Nagpur, India.","DOI":"10.1109\/ICESC.2014.31"},{"key":"ref_19","first-page":"44","article-title":"Research and implementation of image scaling algorithm based on bilinear interpolation","volume":"27","author":"Wang","year":"2008","journal-title":"Autom. Technol. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hudon, M., and Lutz, S. (2019, January 17\u201318). Augmenting Hand-Drawn Art with Global Illumination Effects through Surface Inflation. Proceedings of the European Conference on Visual Media Production, London, UK.","DOI":"10.1145\/3359998.3369400"},{"key":"ref_21","unstructured":"Hochreiter, S., Younger, A.S., and Conwell, P.R. (2001). Lecture Notes in Computer Science, Springer."},{"key":"ref_22","unstructured":"Agrawal, A., Raskar, R., and Chellappa, R. (2006). European Conference on Computer Vision, Proceedings of the 9th European Conference on Computer Vision, Graz, Austria, 7\u201313 May 2006, Springer."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kovesi, P. (2005, January 17\u201321). Shapelets correlated with surface normals produce surfaces. Proceedings of the IEEE International Conference on Computer Vision, Beijing, China.","DOI":"10.1109\/ICCV.2005.224"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3638\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:08:02Z","timestamp":1760123282000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3638"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,31]]},"references-count":23,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073638"],"URL":"https:\/\/doi.org\/10.3390\/s23073638","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,3,31]]}}}