{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T09:27:33Z","timestamp":1785230853714,"version":"3.55.0"},"reference-count":62,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T00:00:00Z","timestamp":1753315200000},"content-version":"vor","delay-in-days":23,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BB\/X01312X\/1"],"award-info":[{"award-number":["BB\/X01312X\/1"]}],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We tackle the problem of multi\u2010view shape\u2010from\u2010polarisation using a neural implicit surface representation and volume rendering of a polarised neural radiance field (P\u2010NeRF). The P\u2010NeRF predicts the parameters of a mixed diffuse\/specular polarisation model. This directly relates polarisation behaviour to the surface normal without explicitly modelling illumination or BRDF. Via the implicit surface representation, this allows polarisation to directly inform the estimated geometry. This improves shape estimation and also allows separation of diffuse and specular radiance. For polarimetric images from division\u2010of\u2010focal\u2010plane sensors, we fit directly to the raw data without first demosaicing. This avoids fitting to demosaicing artefacts and we propose losses and saturation masking specifically to handle HDR measurements. Our method achieves state\u2010of\u2010the\u2010art performance on the PANDORA benchmark. We apply our method in a lightstage setting, providing single\u2010shot face capture.<\/jats:p>","DOI":"10.1111\/cgf.70177","type":"journal-article","created":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T10:51:27Z","timestamp":1753354287000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Neural field multi\u2010view shape\u2010from\u2010polarisation"],"prefix":"10.1111","volume":"44","author":[{"given":"R.","family":"Wanaset","sequence":"first","affiliation":[{"name":"Department of Computer Science University of York  UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G. C.","family":"Guarnera","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of York  UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"W. A. P.","family":"Smith","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of York  UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,7,24]]},"reference":[{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.871114"},{"key":"e_1_2_10_3_2","first-page":"554","volume-title":"European Conference on Computer Vision","author":"Ba Y.","year":"2020"},{"key":"e_1_2_10_4_2","unstructured":"BossM. JampaniV. BraunR. LiuC. BarronJ. T. LenschH. P.: Neural-pil: Neural pre-integrated lighting for reflectance decomposition. InAdvances in Neural Information Processing Systems (NeurIPS)(2021)."},{"key":"e_1_2_10_5_2","doi-asserted-by":"crossref","unstructured":"BarronJ. T. MildenhallB. VerbinD. SrinivasanP. P. HedmanP.: Mip-nerf 360: Unbounded anti-aliased neural radiance fields.CVPR(2022).","DOI":"10.1109\/CVPR52688.2022.00539"},{"key":"e_1_2_10_6_2","doi-asserted-by":"crossref","unstructured":"CuiZ. GuJ. ShiB. TanP. KautzJ.: Polarimetric multiview stereo. In2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)(2017) pp.369\u2013378.","DOI":"10.1109\/CVPR.2017.47"},{"key":"e_1_2_10_7_2","doi-asserted-by":"crossref","unstructured":"CurlessB. LevoyM.: A volumetric method for building complex models from range images. InProceedings of the 23rd annual conference on Computer graphics and interactive techniques(1996) pp.303\u2013312.","DOI":"10.1145\/237170.237269"},{"key":"e_1_2_10_8_2","doi-asserted-by":"crossref","unstructured":"CaoX. SantoH. OkuraF. MatsushitaY.: Multiview azimuth stereo via tangent space consistency. InProc. CVPR(2023).","DOI":"10.1109\/CVPR52729.2023.00086"},{"key":"e_1_2_10_9_2","doi-asserted-by":"publisher","DOI":"10.1364\/OE.460984"},{"key":"e_1_2_10_10_2","unstructured":"DaveA. ZhaoY. VeeraraghavanA.: Pandora: Polarization-aided neural decomposition of radiance.arXiv preprint arXiv:2203.13458(2022)."},{"key":"e_1_2_10_11_2","doi-asserted-by":"crossref","unstructured":"GhoshA. FyffeG. TunwattanapongB. BuschJ. YuX. DebevecP.: Multiview face capture using polarized spherical gradient illumination. InProceedings of the 2011 SIGGRAPH Asia Conference(2011) pp.1\u201310.","DOI":"10.1145\/2024156.2024163"},{"key":"e_1_2_10_12_2","volume-title":"ACM SIGGRAPH 2017 Courses","author":"Guarnera G. C.","year":"2017"},{"key":"e_1_2_10_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33868-7_34"},{"key":"e_1_2_10_14_2","doi-asserted-by":"crossref","unstructured":"HanY. GuoH. FukaiK. SantoH. ShiB. OkuraF. MaZ. JiaY.: NeRSP: Neural 3d reconstruction for reflective objects with sparse polarized images. InProceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition(2024) pp.11821\u201311830.","DOI":"10.1109\/CVPR52733.2024.01123"},{"key":"e_1_2_10_15_2","doi-asserted-by":"crossref","unstructured":"IkeuchiK. MiyazakiD. TanR. T. IkeuchiK.: Separating reflection components of textured surfaces using a single image.Digitally Archiving Cultural Objects(2008) 353\u2013384.","DOI":"10.1007\/978-0-387-75807_17"},{"key":"e_1_2_10_16_2","volume":"7","author":"Kazhdan M.","year":"2006","journal-title":"Proceedings of the fourth Eurographics symposium on Geometry processing"},{"key":"e_1_2_10_17_2","doi-asserted-by":"crossref","unstructured":"KimY. JinW. ChoS. BaekS.-H.: Neural spectropolarimetric fields. InSIGGRAPH Asia 2023 Conference Papers(2023) pp.1\u201311.","DOI":"10.1145\/3610548.3618172"},{"key":"e_1_2_10_18_2","doi-asserted-by":"crossref","unstructured":"KellnhoferP. JebeL. JonesA. SpicerR. PulliK. WetzsteinG.: Neural lumigraph rendering. InCVPR(2021).","DOI":"10.1109\/CVPR46437.2021.00427"},{"key":"e_1_2_10_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3592433"},{"key":"e_1_2_10_20_2","doi-asserted-by":"crossref","unstructured":"KadambiA. TaamazyanV. ShiB. RaskarR.: Polarized 3d: High-quality depth sensing with polarization cues. In2015 IEEE International Conference on Computer Vision (ICCV)(2015) pp.3370\u20133378.","DOI":"10.1109\/ICCV.2015.385"},{"key":"e_1_2_10_21_2","first-page":"522","volume-title":"European Conference on Computer Vision","author":"Lattas A.","year":"2022"},{"key":"e_1_2_10_22_2","doi-asserted-by":"crossref","unstructured":"LiC. OnoT. UemoriT. MiharaH. GattoA. NagaharaH. MoriuchiY.: Neisf: Neural incident stokes field for geometry and material estimation. InProceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)(June2024) pp.21434\u201321445.","DOI":"10.1109\/CVPR52733.2024.02025"},{"key":"e_1_2_10_23_2","doi-asserted-by":"crossref","unstructured":"LeiC. QiC. XieJ. FanN. KoltunV. ChenQ.: Shape from polarization for complex scenes in the wild. In2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)(2022) pp.12622\u201312631.","DOI":"10.1109\/CVPR52688.2022.01230"},{"key":"e_1_2_10_24_2","unstructured":"LiY. WuR. LiJ. ChenY.-C.: Gnerp: Gaussian-guided neural reconstruction of reflective objects with noisy polarization priors.ICLR(2024)."},{"key":"e_1_2_10_25_2","doi-asserted-by":"crossref","unstructured":"LattasA. WangM. ZafeiriouS. GhoshA.: Multiview facial capture using binary spherical gradient illumination. InACM SIGGRAPH 2019 Posters.2019 pp.1\u20132.","DOI":"10.1145\/3306214.3338611"},{"key":"e_1_2_10_26_2","doi-asserted-by":"crossref","unstructured":"LiuS. ZhangY. PengS. ShiB. PollefeysM. CuiZ.: Dist: Rendering deep implicit signed distance function with differ-entiable sphere tracing. InProceedings of the IEEE\/CVF conference on computer vision and pattern recognition(2020) pp.2019\u20132028.","DOI":"10.1109\/CVPR42600.2020.00209"},{"key":"e_1_2_10_27_2","unstructured":"MingqiS. ChongkunX. ZhendongY. JunnanH. XueqianW.: Transparent shape from single polarization images.arXiv preprint arXiv:2204.06331(2022)."},{"key":"e_1_2_10_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530127"},{"key":"e_1_2_10_29_2","doi-asserted-by":"crossref","unstructured":"MildenhallB. HedmanP. Martin-BruallaR. SrinivasanP. P. BarronJ. T.: NeRF in the dark: High dynamic range view synthesis from noisy raw images.arXiv(2021).","DOI":"10.1109\/CVPR52688.2022.01571"},{"key":"e_1_2_10_30_2","unstructured":"MaW.-C. HawkinsT. PeersP. ChabertC.-F. WeissM. DebevecP.:Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. pp.183\u2013194."},{"key":"e_1_2_10_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.1261080"},{"key":"e_1_2_10_32_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18113688"},{"key":"e_1_2_10_33_2","doi-asserted-by":"crossref","unstructured":"MorelO. MeriaudeauF. StolzC. GorriaP.: Polarization imaging applied to 3d reconstruction of specular metallic surfaces.Proceedings of SPIE - The International Society for Optical Engineering 5679(022005).","DOI":"10.1117\/12.586815"},{"key":"e_1_2_10_34_2","doi-asserted-by":"crossref","unstructured":"MansonJ. SloanP.-P.: Fast Filtering of Reflection Probes.Computer Graphics Forum(2016).","DOI":"10.1111\/cgf.12955"},{"key":"e_1_2_10_35_2","doi-asserted-by":"crossref","unstructured":"MiyazakiD. ShigetomiT. BabaM. FurukawaR. HiuraS. AsadaN.: Polarization-based surface normal estimation of black specular objects from multiple viewpoints. In2012 Second International Conference on 3D Imaging Modeling Processing Visualization & Transmission(2012) pp.104\u2013111.","DOI":"10.1109\/3DIMPVT.2012.14"},{"key":"e_1_2_10_36_2","article-title":"Surface normal estimation of black specular objects from multiview polarization images","volume":"56","author":"Miyazaki D.","year":"2017","journal-title":"Optical Engineering"},{"key":"e_1_2_10_37_2","unstructured":"MildenhallB. SrinivasanP. P. TancikM. BarronJ. T. RamamoorthiR. NgR.: NeRF: Representing scenes as neural radiance fields for view synthesis. InECCV(2020)."},{"key":"e_1_2_10_38_2","doi-asserted-by":"crossref","unstructured":"Miyazaki Tan Hara Ikeuchi: Polarization-based inverse rendering from a single view. InProceedings Ninth IEEE International Conference on Computer Vision(2003) pp.982\u2013987vol.2.","DOI":"10.1109\/ICCV.2003.1238455"},{"key":"e_1_2_10_39_2","doi-asserted-by":"crossref","unstructured":"MallickS. P. ZicklerT. BelhumeurP. KriegmanD.: Dichromatic separation: specularity removal and editing. InACM SIGGRAPH 2006 Sketches(2006).","DOI":"10.1145\/1179849.1180057"},{"key":"e_1_2_10_40_2","volume-title":"Eurographics Symposium on Rendering","author":"Nogue E.","year":"2022"},{"key":"e_1_2_10_41_2","unstructured":"Sony's polarized sensor: beyond conventional imaging.https:\/\/thinklucid.com\/tech-briefs\/polarization-explained-sony-polarized-sensor\/. Accessed: 2022-11-11."},{"key":"e_1_2_10_42_2","unstructured":"RahmannS. CanterakisN.: Reconstruction of specular surfaces using polarization imaging. InProc. CVPR(2001)."},{"key":"e_1_2_10_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130894"},{"key":"e_1_2_10_44_2","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nbergerJ. L. FrahmJ.-M.: Structure-from-motion revisited. InConference on Computer Vision and Pattern Recognition (CVPR)(2016).","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_10_45_2","first-page":"43","volume-title":"Using Color to Separate Reflection Components","author":"Shafer S. A.","year":"1992"},{"key":"e_1_2_10_46_2","doi-asserted-by":"crossref","unstructured":"SouzaA. C. MacedoM. C. NascimentoV. P. OliveiraB. S.: Real-time high-quality specular highlight removal using efficient pixel clustering. In2018 31st SIBGRAPI Conference on Graphics Patterns and Images (SIBGRAPI)(2018) pp.56\u201363.","DOI":"10.1109\/SIBGRAPI.2018.00014"},{"key":"e_1_2_10_47_2","first-page":"109","volume":"9912","author":"Smith W.","year":"2016","journal-title":"Proc. ECCV"},{"key":"e_1_2_10_48_2","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nbergerJ. L. ZhengE. PollefeysM. FrahmJ.-M.: Pixelwise view selection for unstructured multi-view stereo. InEuropean Conference on Computer Vision (ECCV)(2016).","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"e_1_2_10_49_2","doi-asserted-by":"crossref","unstructured":"TanZ. JiY. KongW. TaoX. FanW. ZhaoJ. XuX. LuoM.: Shape recovery from polarization: A review. InProceedings of the 15th International Conference on Digital Image Processing(2023) ICDIP '23.","DOI":"10.1145\/3604078.3604138"},{"key":"e_1_2_10_50_2","article-title":"Shape from mixed polarization","volume":"42","author":"Taamazyan V.","year":"2016","journal-title":"Computer Optics"},{"key":"e_1_2_10_51_2","doi-asserted-by":"crossref","unstructured":"TianC. PanW. WangZ. MaoM. ZhangG. BaoH. TanP. CuiZ.: Dps-net: Deep polarimetric stereo depth estimation. InProceedings of the IEEE\/CVF International Conference on Computer Vision(2023) pp.3569\u20133579.","DOI":"10.1109\/ICCV51070.2023.00330"},{"key":"e_1_2_10_52_2","doi-asserted-by":"crossref","unstructured":"TancikM. WeberE. NgE. LiR. YiB. KerrJ. WangT. KristoffersenA. AustinJ. SalahiK. AhujaA. McAllisterD. KanazawaA.: Nerfstudio: A Modular Framework for Neural Radiance Field Development.arXiv preprint arXiv:2302.04264(2023).","DOI":"10.1145\/3588432.3591516"},{"key":"e_1_2_10_53_2","unstructured":"USC Institute for Creative Technologies:High-resolution light probe image gallery.https:\/\/vgl.ict.usc.edu\/Data\/HighResProbes\/. Accessed 5 Jun2025."},{"key":"e_1_2_10_54_2","doi-asserted-by":"crossref","unstructured":"VerbinD. HedmanP. MildenhallB. ZicklerT. BarronJ. T. SrinivasanP. P.: Ref-NeRF: Structured view-dependent appearance for neural radiance fields.CVPR(2022).","DOI":"10.1109\/CVPR52688.2022.00541"},{"key":"e_1_2_10_55_2","first-page":"27171","volume":"34","author":"Wang P.","year":"2021","journal-title":"Advances in Neural Information Processing Systems (NeurIPS"},{"key":"e_1_2_10_56_2","doi-asserted-by":"crossref","unstructured":"XieY. TakikawaT. SaitoS. LitanyO. YanS. KhanN. TombariF. TompkinJ. SitzmannV. SridharS.: Neural fields in visual computing and beyond.Computer Graphics Forum(2022).","DOI":"10.1111\/cgf.14505"},{"key":"e_1_2_10_57_2","unstructured":"YuZ. ChenA. AnticB. PengS. P. BhattacharyyaA. NiemeyerM. TangS. SattlerT. GeigerA.:SDFStudio: A Unified Framework for Surface Reconstruction 2022. URL:https:\/\/github.com\/autonomousvision\/sdfstudio."},{"key":"e_1_2_10_58_2","article-title":"Multiview neural surface reconstruction by disentangling geometry and appearance","volume":"33","author":"Yariv L.","year":"2020","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_10_59_2","doi-asserted-by":"crossref","unstructured":"ZhangK. LuanF. WangQ. BalaK. SnavelyN.: PhySG: Inverse rendering with spherical gaussians for physics-based material editing and relighting. InThe IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)(2021).","DOI":"10.1109\/CVPR46437.2021.00541"},{"key":"e_1_2_10_60_2","doi-asserted-by":"crossref","unstructured":"ZhaoJ. MonnoY. OkutomiM.: Polarimetric multi-view inverse rendering. InComputer Vision \u2013 ECCV 2020: 16th European Conference Glasgow UK August 23\u201328 2020 Proceedings Part XXIV(2020) p.85\u2013102.","DOI":"10.1007\/978-3-030-58586-0_6"},{"key":"e_1_2_10_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3232211"},{"key":"e_1_2_10_62_2","doi-asserted-by":"crossref","unstructured":"ZhaoJ. OishiJ. MonnoY. OkutomiM.: Polarimetric patchmatch multi-view stereo. In2024 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV)(2024) pp.3464\u20133472. doi:10.1109\/WACV57701.2024.00344.","DOI":"10.1109\/WACV57701.2024.00344"},{"key":"e_1_2_10_63_2","doi-asserted-by":"crossref","unstructured":"ZhuD. SmithW.: Depth from a polarisation + rgb stereo pair. In2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)(062019) pp.7578\u20137587.","DOI":"10.1109\/CVPR.2019.00777"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.70177","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T12:41:01Z","timestamp":1754311261000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.70177"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7]]},"references-count":62,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["10.1111\/cgf.70177"],"URL":"https:\/\/doi.org\/10.1111\/cgf.70177","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"value":"0167-7055","type":"print"},{"value":"1467-8659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7]]},"assertion":[{"value":"2025-07-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70177"}}