{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:47:55Z","timestamp":1760230075182,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T00:00:00Z","timestamp":1657152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2017YFB0503004","2017YFB0503003"],"award-info":[{"award-number":["2017YFB0503004","2017YFB0503003"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Polarization is an independent dimension of light wave information that has broad application prospects in machine vision and remote sensing tasks. Polarization imaging using a division-of-focal-plane (DoFP) polarimetric sensor can meet lightweight and real-time application requirements. Similar to Bayer filter-based color imaging, demosaicing is a basic and important processing step in DoFP polarization imaging. Due to the differences in the physical properties of polarization and the color of light waves, the widely studied color demosaicing method cannot be directly applied to polarization demosaicing. We propose a polarized intensity ratio constraint demosaicing model to efficiently account for the characteristics of polarization detection in this work. First, we discuss the special constraint relationship between the polarization channels. It can be simply described as: for a beam of light, the sum of the intensities detected by any two vertical ideal analyzers should be equal to the total light intensity. Then, based on this constraint relationship and drawing on the concept of guided filtering, a new polarization demosaicing method is developed. A method to directly use raw images captured by the DoFP detector as the ground truth for comparison experiments is then constructed to aid in the convenient collection of experimental data and extensive image scenarios. Results of both qualitative and quantitative experiments illustrate that our method is an effective and practical method to faithfully recover the full polarization information of each pixel from a single mosaic input image.<\/jats:p>","DOI":"10.3390\/rs14143268","type":"journal-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T07:51:56Z","timestamp":1657180316000},"page":"3268","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Polarized Intensity Ratio Constraint Demosaicing for the Division of a Focal-Plane Polarimetric Image"],"prefix":"10.3390","volume":"14","author":[{"given":"Lei","family":"Yan","sequence":"first","affiliation":[{"name":"Guangxi Key Lab of UAV Remote Sensing, Guilin University of Aerospace Technology, Guilin 541004, China"},{"name":"Spatial Information Integration and 3S Engineering Application Beijing Key Laboratory, Institute of Remote Sensing and Geographic Information System, Peking University, Beijing 100871, China"}]},{"given":"Kaiwen","family":"Jiang","sequence":"additional","affiliation":[{"name":"Spatial Information Integration and 3S Engineering Application Beijing Key Laboratory, Institute of Remote Sensing and Geographic Information System, Peking University, Beijing 100871, China"}]},{"given":"Yi","family":"Lin","sequence":"additional","affiliation":[{"name":"Spatial Information Integration and 3S Engineering Application Beijing Key Laboratory, Institute of Remote Sensing and Geographic Information System, Peking University, Beijing 100871, China"}]},{"given":"Hongying","family":"Zhao","sequence":"additional","affiliation":[{"name":"Spatial Information Integration and 3S Engineering Application Beijing Key Laboratory, Institute of Remote Sensing and Geographic Information System, Peking University, Beijing 100871, China"}]},{"given":"Ruihua","family":"Zhang","sequence":"additional","affiliation":[{"name":"Spatial Information Integration and 3S Engineering Application Beijing Key Laboratory, Institute of Remote Sensing and Geographic Information System, Peking University, Beijing 100871, China"}]},{"given":"Fangang","family":"Zeng","sequence":"additional","affiliation":[{"name":"School of Environment of Natural Resources, Renmin University of China, Beijing 100872, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gurton, K., Felton, M., Mack, R., LeMaster, D., Farlow, C., Kudenov, M., and Pezzaniti, L. (2010, January 5\u20139). MidIR and LWIR polarimetric sensor comparison study. Proceedings of the SPIE Defense, Security, and Sensing, Orlando, FL, USA.","DOI":"10.1117\/12.850341"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"15070","DOI":"10.1038\/s41598-018-33432-9","article-title":"High extinction ratio super pixel for long wavelength infrared polarization imaging detection based on plasmonic microcavity quantum well infrared photodetectors","volume":"8","author":"Zhou","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1364\/AO.42.000511","article-title":"Polarization-based vision through haze","volume":"42","author":"Schechner","year":"2003","journal-title":"Appl. Opt."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1016\/j.ijleo.2019.01.048","article-title":"Haze-removal polarimetric imaging schemes with the consideration of airlight\u2019s circular polarization effect","volume":"182","author":"Zhang","year":"2019","journal-title":"Optik"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4903","DOI":"10.1364\/OL.43.004903","article-title":"Deeply seeing through highly turbid water by active polarization imaging","volume":"43","author":"Liu","year":"2018","journal-title":"Opt. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6803016","DOI":"10.1109\/JPHOT.2017.2706748","article-title":"Polarization Guided Autoregressive Model for Depth Recovery","volume":"9","author":"Reda","year":"2017","journal-title":"IEEE Photon. J."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kadambi, A., Taamazyan, V., Shi, B., and Raskar, R. (2015, January 7\u201313). Polarized 3D: High-Quality Depth Sensing with Polarization Cues. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.385"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"19087","DOI":"10.1364\/OE.18.019087","article-title":"CCD polarization imaging sensor with aluminum nanowire optical filters","volume":"18","author":"Gruev","year":"2010","journal-title":"Opt. Express"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, X., Gunturk, B., and Zhang, L. (2008, January 27\u201331). Image demosaicing: A systematic survey. Proceedings of the Electronic Imaging, San Jose, CA, USA.","DOI":"10.1117\/12.766768"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kiku, D., Monno, Y., Tanaka, M., and Okutomi, M. (2014, January 2\u20136). Minimized-Laplacian Residual Interpolation for Color Image Demosaicking. Proceedings of the IS&T\/SPIE Electronic Imaging, San Francisco, CA, USA.","DOI":"10.1117\/12.2038425"},{"key":"ref_11","unstructured":"Bayer, B.E. (1975). Color Imaging Array. (3,971,065A), U.S. Patent."},{"key":"ref_12","unstructured":"Rust, D.M. (1995). Integrated Dual Imaging Detector. (5,438,414), U.S. Patent."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1049\/el:20093132","article-title":"Polarisation-analysing CMOS photosensor with monolithically embedded wire grid polariser","volume":"45","author":"Tokuda","year":"2009","journal-title":"Electron. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Brock, N.J., Crandall, C., and Millerd, J.E. (2014, January 5\u20139). Snap-shot Imaging Polarimeter: Performance and Applications. Proceedings of the SPIE Sensing Technology + Applications, Baltimore, MA, USA.","DOI":"10.1117\/12.2053917"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mihoubi, S., Lapray, P.-J., and Bigu\u00e9, L. (2018). Survey of Demosaicking Methods for Polarization Filter Array Images. Sensors, 18.","DOI":"10.3390\/s18113688"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1002\/ima.20109","article-title":"Spatially adaptive color filter array interpolation for noiseless and noisy data","volume":"17","author":"Paliy","year":"2007","journal-title":"Int. J. Imag. Syst. Tech."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/TIP.2012.2210726","article-title":"Multiscale Gradients-Based Color Filter Array Interpolation","volume":"22","author":"Pekkucuksen","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kiku, D., Monno, Y., Tanaka, M., and Okutomi, M. (2013, January 15\u201318). Residual Interpolation for Color Image Demosaicking. Proceedings of the 2013 20th IEEE International Conference on Image Processing (ICIP 2013), Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738475"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1109\/TIP.2004.841200","article-title":"Linear demosaicing inspired by the human visual system","volume":"14","author":"Alleysson","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/LSP.2005.859503","article-title":"Frequency-domain methods for demosaicking of Bayer-sampled color images","volume":"12","author":"Dubois","year":"2005","journal-title":"IEEE Signal Proc. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1885","DOI":"10.1109\/TIP.2011.2107524","article-title":"Least-Squares Luma-Chroma Demultiplexing Algorithm for Bayer Demosaicking","volume":"20","author":"Leung","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/TIP.2007.911828","article-title":"Sparse representation for color image restoration","volume":"17","author":"Mairal","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2356","DOI":"10.1109\/TIP.2013.2244215","article-title":"Compressive Framework for Demosaicing of Natural Images","volume":"22","author":"Moghadam","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kokkinos, F., and Lefkimmiatis, S. (2018, January 8\u201314). Deep Image Demosaicking Using a Cascade of Convolutional Residual Denoising Networks. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_19"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"26161","DOI":"10.1364\/OE.19.026161","article-title":"Bilinear and bicubic interpolation methods for division of focal plane polarimeters","volume":"19","author":"Gao","year":"2011","journal-title":"Opt. Express"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1364\/OE.21.001137","article-title":"Gradient-based interpolation method for division-of-focal-plane polarimeters","volume":"21","author":"Gao","year":"2013","journal-title":"Opt. Express"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"20799","DOI":"10.1364\/OE.24.020799","article-title":"Image interpolation for division of focal plane polarimeters with intensity correlation","volume":"24","author":"Zhang","year":"2016","journal-title":"Opt. Express"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"22066","DOI":"10.1364\/OE.424457","article-title":"Polarization image demosaicking using polarization channel difference prior","volume":"29","author":"Wu","year":"2021","journal-title":"Opt. Express"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Morimatsu, M., Monno, Y., Tanaka, M., and Okutomi, M. (2020, January 25\u201328). Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation. Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/ICIP40778.2020.9191085"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided Image Filtering","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"10651","DOI":"10.1364\/OE.25.010651","article-title":"Residual interpolation for division of focal plane polarization image sensors","volume":"25","author":"Ahmed","year":"2017","journal-title":"Opt. Express"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1376","DOI":"10.1364\/OE.27.001376","article-title":"Demosaicking DoFP images using Newton\u2019s polynomial interpolation and polarization difference model","volume":"27","author":"Li","year":"2019","journal-title":"Opt. Express"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7367","DOI":"10.1364\/AO.58.007367","article-title":"Minimized Laplacian residual interpolation for DoFP polarization image demosaicking","volume":"58","author":"Jiang","year":"2019","journal-title":"Appl. Opt."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"7076","DOI":"10.1109\/TIP.2020.2998281","article-title":"A New Polarization Image Demosaicking Algorithm by Exploiting Inter-Channel Correlations With Guided Filtering","volume":"29","author":"Liu","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4534","DOI":"10.1364\/OL.43.004534","article-title":"Learning a convolutional demosaicing network for microgrid polarimeter imagery","volume":"43","author":"Zhang","year":"2018","journal-title":"Opt. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5646","DOI":"10.1364\/OL.44.005646","article-title":"Convolutional demosaicing network for joint chromatic and polarimetric imagery","volume":"44","author":"Wen","year":"2019","journal-title":"Opt. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3736","DOI":"10.1109\/TIP.2006.881969","article-title":"Image denoising via sparse and redundant representations over learned dictionaries","volume":"15","author":"Elad","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","first-page":"66","article-title":"A Nonlocal Sparse Representation Method for Color Demosaicking","volume":"42","author":"Huang","year":"2014","journal-title":"Acta Electron. Sin."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lapray, P.J., Gendre, L., Foulonneau, A., and Bigue, L. (2018, January 22\u201326). A database of polarimetric and multispectral images in the visible and NIR regions. Proceedings of the SPIE Photonics Europe, Strasbourg, France.","DOI":"10.1117\/12.2306244"},{"key":"ref_40","unstructured":"Mahalanobis, A., Vijaya Kumar, B.V.K., and Juday, R.D. (2005). Correlation Pattern Recognition, Cambridge University Press."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4171","DOI":"10.1109\/TIP.2021.3069190","article-title":"A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor","volume":"30","author":"Wen","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1111\/cgf.14204","article-title":"Linear Polarization Demosaicking for Monochrome and Colour Polarization Focal Plane Arrays","volume":"40","author":"Qiu","year":"2021","journal-title":"Comput. Graph. Forum"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/14\/3268\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:43:52Z","timestamp":1760139832000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/14\/3268"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,7]]},"references-count":42,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["rs14143268"],"URL":"https:\/\/doi.org\/10.3390\/rs14143268","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,7,7]]}}}