{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T03:44:31Z","timestamp":1774064671959,"version":"3.50.1"},"reference-count":55,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,2,16]],"date-time":"2022-02-16T00:00:00Z","timestamp":1644969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62171024"],"award-info":[{"award-number":["62171024"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Residual interpolations are effective methods to reduce the instantaneous field-of-view error of division of focal plane (DoFP) polarimeters. However, their guide-image selection strategies are improper, and do not consider the DoFP polarimeters\u2019 spatial sampling modes. Thus, we propose a residual interpolation method with a new guide-image selection strategy based on the spatial layout of the pixeled polarizer array to improve the sampling rate of the guide image. The interpolation performance is also improved by the proposed pixel-by-pixel, adaptive iterative process and the weighted average fusion of the results of the minimized residual and minimized Laplacian energy guide filters. Visual and objective evaluations demonstrate the proposed method\u2019s superiority to the existing state-of-the-art methods. The proposed method proves that considering the spatial layout of the pixeled polarizer array on the physical level is vital to improving the performance of interpolation methods for DoFP polarimeters.<\/jats:p>","DOI":"10.3390\/s22041529","type":"journal-article","created":{"date-parts":[[2022,2,16]],"date-time":"2022-02-16T21:36:24Z","timestamp":1645047384000},"page":"1529","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Residual Interpolation Integrated Pixel-by-Pixel Adaptive Iterative Process for Division of Focal Plane Polarimeters"],"prefix":"10.3390","volume":"22","author":[{"given":"Jie","family":"Yang","sequence":"first","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiqi","family":"Jin","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Su","family":"Qiu","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fuduo","family":"Xue","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meishu","family":"Wang","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,16]]},"reference":[{"key":"ref_1","first-page":"767205","article-title":"MidIR and LWIR polarimetric sensor comparison study","volume":"7672","author":"Gurton","year":"2010","journal-title":"Int. Soc. Opt. Photonics"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hu, Y., Li, Y., and Pan, Z. (2021). A Dual-Polarimetric SAR Ship Detection Dataset and a Memory-Augmented Autoencoder-Based Detection Method. Sensors, 21.","DOI":"10.3390\/s21248478"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"15070","DOI":"10.1038\/s41598-018-33432-9","article-title":"High extinction ratio super pixel for long wavelength infrared polarization imaging detection based on plasmonic microcavity quantum well infrared photodetectors","volume":"8","author":"Zhou","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6803016","DOI":"10.1109\/JPHOT.2017.2706748","article-title":"Polarization Guided Auto-Regressive Model for Depth Recovery","volume":"9","author":"Reda","year":"2017","journal-title":"IEEE Photonics J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, S., Liu, B., Chen, Z., Li, H., and Jiang, S. (2020). The Segmentation Method of Target Point Cloud for Polarization-Modulated 3D Imaging. Sensors, 20.","DOI":"10.3390\/s20010179"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"041303","DOI":"10.1117\/1.OE.56.4.041303","article-title":"Surface normal estimation of black specular objects from multiview polarization images","volume":"56","author":"Miyazaki","year":"2016","journal-title":"Opt. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.isprsjprs.2021.06.001","article-title":"Polarized observations for advanced atmosphere-ocean algorithms using airborne multi-spectral hyper-angular polarimetric imager","volume":"178","author":"Xue","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"111894","DOI":"10.1016\/j.rse.2020.111894","article-title":"Airborne optical polarization imaging for observation of submarine Kelvin wakes on the sea surface: Imaging chain and simulation","volume":"247","author":"Ge","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ojha, N., Merlin, O., Amazirh, A., Ouaadi, N., Rivalland, V., Jarlan, L., Er-Raki, S., and Escorihuela, M. (2021). A Calibration\/Disaggregation Coupling Scheme for Retrieving Soil Moisture at High Spatio-Temporal Resolution: Synergy between SMAP Passive Microwave, MODIS\/Landsat Optical\/Thermal and Sentinel-1 Radar Data. Sensors, 21.","DOI":"10.3390\/s21217406"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, X., Shao, Y., Liu, L., Li, K., Wang, J., Li, S., Wang, J., and Wu, X. (2021). Effects of Plant Crown Shape on Microwave Backscattering Coefficients of Vegetation Canopy. Sensors, 21.","DOI":"10.3390\/s21227748"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2934","DOI":"10.1364\/BOE.6.002934","article-title":"Characterizing microstructures of cancerous tissues using multispectral transformed Mueller matrix polarization parameters","volume":"6","author":"He","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"19087","DOI":"10.1364\/OE.18.019087","article-title":"CCD polarization imaging sensor with aluminum nanowire optical filters","volume":"18","author":"Gruev","year":"2010","journal-title":"Opt. Express"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/JSEN.2003.807946","article-title":"Polarization imaging: Principles and integrated polarimeters","volume":"2","author":"Andreou","year":"2002","journal-title":"IEEE Sens. J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"17776","DOI":"10.1364\/OE.18.017776","article-title":"Liquid-crystal micropolarimeter array for full Stokes polarization imaging in visible spectrum","volume":"18","author":"Zhao","year":"2010","journal-title":"Opt. Express"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5453","DOI":"10.1364\/AO.45.005453","article-title":"Review of passive imaging polarimetry for remote sensing applications","volume":"45","author":"Tyo","year":"2006","journal-title":"Appl. Opt."},{"key":"ref_16","unstructured":"Lucid Vision TELEDYNE FLIR (2021, July 16). Blackfly S USB3. Available online: https:\/\/www.flir.cn\/products\/blackfly-s-usb3\/?model=BFS-U3-51S5P-C."},{"key":"ref_17","unstructured":"(2021, July 16). 4D Technology Imaging Polarimeters. Available online: https:\/\/www.4dtechnology.com\/products\/imaging-polarimeters."},{"key":"ref_18","unstructured":"(2021, July 16). Lucid Vision Labs Phoenix Network Camera Suitable for OEM Ultra-Small and Deformable. Available online: http:\/\/thinklucid.cn\/phoenix-machine-vision."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1109\/TASSP.1978.1163154","article-title":"Cubic splines for image interpolation and digital filtering","volume":"26","author":"Hou","year":"1978","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1109\/TIP.2008.924289","article-title":"Markov Random Field Model-Based Edge-Directed Image Interpolation","volume":"17","author":"Li","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/TIP.2012.2210726","article-title":"Multiscale Gradients-Based Color Filter Array Interpolation","volume":"22","author":"Pekkucuksen","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided Image Filtering","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kiku, D., Monno, Y., Tanaka, M., and Okutomi, M. (2013, January 15\u201318). Residual interpolation for color image demosaicking. Proceedings of the IEEE International Conference on Image Processing (ICIP), Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738475"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ye, W., and Ma, K. (2014, January 27\u201339). Image demosaicing by using iterative residual interpolation. Proceedings of the IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025373"},{"key":"ref_25","first-page":"90230L","article-title":"Minimized-Laplacian Residual Interpolation for Color Image Demosaicking","volume":"9023","author":"Kiku","year":"2014","journal-title":"Proc. SPIE-Int. Soc. Opt. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1288","DOI":"10.1109\/TIP.2016.2518082","article-title":"Beyond Color Difference: Residual Interpolation for Color Image Demosaicking","volume":"25","author":"Kiku","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2787","DOI":"10.3390\/s17122787","article-title":"Adaptive Residual Interpolation for Color and Multispectral Image Demosaicking","volume":"17","author":"Kiku","year":"2017","journal-title":"Sensors"},{"key":"ref_28","first-page":"139","article-title":"Image processing methods to compensate for IFOV errors in microgrid imaging polarimeters","volume":"6240","author":"Ratliff","year":"2006","journal-title":"Proc. SPIE"},{"key":"ref_29","first-page":"668209","article-title":"Mitigation of image artifacts in LWIR microgrid polarimeter images","volume":"6682","author":"Ratliff","year":"2007","journal-title":"Proc. SPIE-Int. Soc. Opt. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"9112","DOI":"10.1364\/OE.17.009112","article-title":"Interpolation strategies for reducing IFOV artifacts in microgrid polarimeter imagery","volume":"17","author":"Ratliff","year":"2009","journal-title":"Opt. Express"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"816004","DOI":"10.1117\/12.894633","article-title":"A comparison of polarization image processing across different platforms","volume":"8160","author":"York","year":"2011","journal-title":"Proc. SPIE"},{"key":"ref_32","first-page":"150","article-title":"Image interpolation methods evaluation for division of focal plane polarimeters","volume":"8012","author":"Gao","year":"2011","journal-title":"Proc. SPIE-Int. Soc. Opt. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"26161","DOI":"10.1364\/OE.19.026161","article-title":"Bilinear and bicubic interpolation methods for division of focal plane polarimeters","volume":"19","author":"Gao","year":"2011","journal-title":"Opt. Express"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Gao, S., and Gruev, V. (2012, January 20\u201323). Gradient based interpolation for division of focal plane polarization imaging sensor. Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Seoul, Korea.","DOI":"10.1109\/ISCAS.2012.6271631"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1364\/OE.21.001137","article-title":"Gradient-based interpolation method for division-of-focal-plane polarimeters","volume":"21","author":"Gao","year":"2013","journal-title":"Opt. Express"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, J., Ye, W., Ahmed, A., Qiu, Z., Cao, Y., and Zhao, X. (2017, January 28\u201331). A Novel Smoothness-Based Interpolation Algorithm for Division of Focal Plane Polarimeters. Proceedings of the IEEE International Symposium on Circuits & Systems (ISCAS), Baltimore, MD, USA.","DOI":"10.1109\/ISCAS.2017.8050355"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"83640L","DOI":"10.1117\/12.919196","article-title":"A correlation-based interpolation algorithm for division-of-focal-plane polarization sensors","volume":"8364","author":"Xu","year":"2012","journal-title":"Proc. SPIE"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"20799","DOI":"10.1364\/OE.24.020799","article-title":"Image interpolation for division of focal plane polarimeters with intensity correlation","volume":"24","author":"Zhang","year":"2016","journal-title":"Opt. Express"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1376","DOI":"10.1364\/OE.27.001376","article-title":"Demosaicking DoFP images using Newton\u2019s polynomial interpolation and polarization difference model","volume":"27","author":"Ning","year":"2019","journal-title":"Opt. Express"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"22066","DOI":"10.1364\/OE.424457","article-title":"Polarization image demosaicking using polarization channel difference prior","volume":"29","author":"Wu","year":"2021","journal-title":"Opt. Express"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"10651","DOI":"10.1364\/OE.25.010651","article-title":"Residual interpolation for division of focal plane polarization image sensors","volume":"25","author":"Ahmed","year":"2017","journal-title":"Opt. Express"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"7990","DOI":"10.1109\/JSEN.2018.2861825","article-title":"Four-Directional Adaptive Residual Interpolation Technique for DoFP Polarimeters with Different Micro-polarizer Patterns","volume":"18","author":"Ahmed","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"7367","DOI":"10.1364\/AO.58.007367","article-title":"Minimized Laplacian residual interpolation for DoFP polarization image demosaicking","volume":"58","author":"Jiang","year":"2019","journal-title":"Appl. Opt."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Morimatsu, M., Monno, Y., Tanaka, M., and Okutomi, M. (2020, January 25\u201328). Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation. Proceedings of the 27th IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/ICIP40778.2020.9191085"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"7076","DOI":"10.1109\/TIP.2020.2998281","article-title":"A New Polarization Image Demosaicking Algorithm by Exploiting Inter-Channel Correlations with Guided Filtering","volume":"29","author":"Liu","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"10787","DOI":"10.1007\/s00521-020-05046-8","article-title":"Neural image reconstruction using a heuristic validation mechanism","volume":"33","author":"Srivastava","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_47","unstructured":"Qiu, S., Fu, Q., Wang, C., and Heidrich, W. (2019, January 30). Polarization demosaicking for monochrome and color polarization focal plane arrays. Proceedings of the International Symposium on Vision, Modeling, and Visualization (VMV), Rostock, Germany."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3265","DOI":"10.1364\/OL.43.003265","article-title":"Sparse representation-based demosaicing method for microgrid polarimeter imagery","volume":"43","author":"Zhang","year":"2018","journal-title":"Opt. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4534","DOI":"10.1364\/OL.43.004534","article-title":"Learning a convolutional demosaicing network for microgrid polarimeter imagery","volume":"43","author":"Zhang","year":"2018","journal-title":"Opt. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"5646","DOI":"10.1364\/OL.44.005646","article-title":"Convolutional demosaicing network for joint chromatic and polarimetric imagery","volume":"44","author":"Wen","year":"2019","journal-title":"Opt. Lett."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"8566","DOI":"10.1364\/OE.27.008566","article-title":"An end-to-end fully-convolutional neural network for division of focal plane sensors to reconstruct S0, DoLP, and AoP","volume":"27","author":"Zeng","year":"2019","journal-title":"Opt. Express"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"20808","DOI":"10.1364\/OE.428202","article-title":"Temporal and spatial error model for estimating the measurement precision of the division of focal plane polarimeters","volume":"29","author":"Yang","year":"2021","journal-title":"Opt. Express"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Mihoubi, S., Lapray, P., and Bigu\u00e9, L. (2018). Survey of Demosaicking Methods for Polarization Filter Array Images. Sensors, 18.","DOI":"10.3390\/s18113688"},{"key":"ref_54","first-page":"399","article-title":"On the Composition and Resolution of Streams of Polarized Light from different Sources","volume":"9","author":"Stokes","year":"1852","journal-title":"Trans. Camb. Philos. Soc."},{"key":"ref_55","first-page":"1067738","article-title":"Database of polarimetric and multispectral images in the visible and NIR regions","volume":"10677","author":"Lapray","year":"2018","journal-title":"Proc. SPIE"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/4\/1529\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:20:58Z","timestamp":1760134858000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/4\/1529"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,16]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22041529"],"URL":"https:\/\/doi.org\/10.3390\/s22041529","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,16]]}}}