{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T20:54:02Z","timestamp":1774385642833,"version":"3.50.1"},"reference-count":30,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2016,5,18]],"date-time":"2016-05-18T00:00:00Z","timestamp":1463529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIP)","award":["2015R1A2A1A14000912"],"award-info":[{"award-number":["2015R1A2A1A14000912"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A multispectral filter array (MSFA) image sensor with red, green, blue and near-infrared (NIR) filters is useful for various imaging applications with the advantages that it obtains color information and NIR information simultaneously. Because the MSFA image sensor needs to acquire invisible band information, it is necessary to remove the IR cut-offfilter (IRCF). However, without the IRCF, the color of the image is desaturated by the interference of the additional NIR component of each RGB color channel. To overcome color degradation, a signal processing approach is required to restore natural color by removing the unwanted NIR contribution to the RGB color channels while the additional NIR information remains in the N channel. Thus, in this paper, we propose a color restoration method for an imaging system based on the MSFA image sensor with RGBN filters. To remove the unnecessary NIR component in each RGB color channel, spectral estimation and spectral decomposition are performed based on the spectral characteristics of the MSFA sensor. The proposed color restoration method estimates the spectral intensity in NIR band and recovers hue and color saturation by decomposing the visible band component and the NIR band component in each RGB color channel. The experimental results show that the proposed method effectively restores natural color and minimizes angular errors.<\/jats:p>","DOI":"10.3390\/s16050719","type":"journal-article","created":{"date-parts":[[2016,5,18]],"date-time":"2016-05-18T10:10:24Z","timestamp":1463566224000},"page":"719","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":35,"title":["Color Restoration of RGBN Multispectral Filter Array Sensor Images Based on Spectral Decomposition"],"prefix":"10.3390","volume":"16","author":[{"given":"Chulhee","family":"Park","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Moon","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,5,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Salamati, N., Fredembach, C., and S\u00fcsstrunk, S. (2009, January 9\u201313). Material classification using color and NIR images. Proceedings of the 17th Color and Imaging Conference, Albuquerque, NX, USA.","DOI":"10.2352\/CIC.2009.17.1.art00040"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/014311698215748","article-title":"Review article multisensor image fusion in remote sensing: concepts, methods and applications","volume":"19","author":"Pohl","year":"1998","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TGRS.2010.2051674","article-title":"A new adaptive component-substitution-based satellite image fusion by using partial replacement","volume":"49","author":"Choi","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hao, X., Chen, H., Yao, C., Yang, N., Bi, H., and Wang, C. (2010, January 23\u201325). A near-infrared imaging method for capturing the interior of a vehicle through windshield. Proceedings of the 2010 IEEE Southwest Symposium on Image Analysis & Interpretation (SSIAI), Austin, TX, USA.","DOI":"10.1109\/SSIAI.2010.5483907"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hertel, D., Marechal, H., Tefera, D.A., Fan, W., and Hicks, R. (2009, January 3\u20135). A low-cost VIS-NIR true color night vision video system based on a wide dynamic range CMOS imager. Proceedings of the 2009 IEEE Intelligent Vehicles Symposium, Xi\u2019an, China.","DOI":"10.1109\/IVS.2009.5164290"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1109\/TIP.2009.2023153","article-title":"Personal authentication using hand vein triangulation and knuckle shape","volume":"18","author":"Kumar","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1007\/978-3-540-74549-5_55","article-title":"Face Matching Between Near Infrared and Visible Light Images","volume":"4642","author":"Yi","year":"2007","journal-title":"Adv. Biometr."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1109\/TPAMI.2007.1014","article-title":"Illumination invariant face recognition using near-infrared images","volume":"29","author":"Li","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"72500E","DOI":"10.1117\/12.806431","article-title":"Illuminant estimation and detection using near-infrared","volume":"7250","author":"Fredembach","year":"2009","journal-title":"Proc. SPIE"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schaul, L., Fredembach, C., and S\u00fcsstrunk, S. (2009, January 7\u201310). Color image dehazing using the near-infrared. Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt. No. LCAV-CONF-2009-026.","DOI":"10.1109\/ICIP.2009.5413700"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.compag.2010.02.005","article-title":"Multispectral imaging system with interchangeable filter design","volume":"72","author":"Kise","year":"2010","journal-title":"Comput. Electron. Agric."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Matsui, S., Okabe, T., Shimano, M., and Sato, Y. (2009, January 23\u201327). Image Enhancement of Low-Light Scenes with Near-Infrared Flash Images. Proceedings of the 9th Asian Conference on Computer Vision (ACCV 2009), Xi\u2019an, China.","DOI":"10.1007\/978-3-642-12307-8_20"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fredembach, C., and S\u00fcsstrunk, S. (2008, January 10\u201314). Colouring the near-infrared. Proceedings of the 16th Color and Imaging Conference (CIC 2008), Portland, OR, USA.","DOI":"10.2352\/CIC.2008.16.1.art00034"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1109\/TED.2007.914828","article-title":"A day and night vision MOS imager with robust photonic-crystal-based RGB-and-IR","volume":"55","author":"Koyama","year":"2008","journal-title":"IEEE Trans. Electron Dev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4985","DOI":"10.1364\/OE.22.004985","article-title":"RGB-NIR multispectral camera","volume":"22","author":"Chen","year":"2014","journal-title":"Opt. Expr."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lu, Y.M., Fredembach, C., Vetterli, M., and S\u00fcsstrunk, S. (2009, January 7\u201310). Designing color filter arrays for the joint capture of visible and near-infrared images. Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.","DOI":"10.1109\/ICIP.2009.5414324"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kiku, D., Monno, Y., Tanaka, M., and Okutomi, M. (2014). Simultaneous capturing of RGB and additional band images using hybrid color filter array. Proc. SPIE, 9023.","DOI":"10.1117\/12.2039396"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sadeghipoor, Z., Lu, Y.M., and Susstrunk, S. (2013, January 26\u201331). A novel compressive sensing approach to simultaneously acquire color and near-infrared images on a single sensor. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6637931"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Martinello, M., Wajs, A., Quan, S., Lee, H., Lim, C., Woo, T., Lee, W., Kim, S.S., and Lee, D. (2015, January 24\u201326). Dual Aperture Photography: Image and Depth from a Mobile Camera. Proceedings of the 2015 IEEE International Conference on Computational Photography (ICCP), Houston, TX, USA.","DOI":"10.1109\/ICCPHOT.2015.7168366"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Park, C.H., Oh, H.M., and Kang, M.G. (2015, January 11\u201314). Color restoration for infrared cutoff filter removed RGB multispectral filter array image sensor. Proceedings of the 2015 International Conference on Computer Vision Theory and Applications (VISAPP 2015), Berlin, Germany.","DOI":"10.5220\/0005263600300037"},{"key":"ref_21","unstructured":"Kong, F., and Peng, Y. (2010, January 10\u201311). Color image watermarking algorithm based on HSI color space. Proceedings of the 2nd International Conference on Industrial and Information Systems (IIS), Dalian, China."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2108","DOI":"10.1364\/JOSAA.17.002108","article-title":"Diagonal versus affine transformations for color correction","volume":"17","author":"Funt","year":"2000","journal-title":"JOSA A"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color transfer between images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1774","DOI":"10.1109\/83.869188","article-title":"Improving gamut mapping color constancy","volume":"9","author":"Finlayson","year":"2000","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1109\/34.969113","article-title":"Color by correlation: A simple, unifying framework for color constancy","volume":"23","author":"Finlayson","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1109\/TIP.2002.802531","article-title":"A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data","volume":"11","author":"Barnard","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5491","DOI":"10.1080\/01431160412331270830","article-title":"Spatially adaptive multi-resolution multispectral image fusion","volume":"25","author":"Park","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kang, H.R. (2006). Computational Color Technology, Spie Press.","DOI":"10.1117\/3.660835"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1364\/JOSAA.14.001393","article-title":"Bayesian color constancy","volume":"14","author":"Brainard","year":"1997","journal-title":"JOSA A"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Monno, Y., Tanaka, M., and Okutomi, M. (2015, January 7\u201313). N-to-SRGB Mapping for Single-Sensor Multispectral Imaging. Proceedings of the 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.18"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/5\/719\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:24:06Z","timestamp":1760210646000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/5\/719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,18]]},"references-count":30,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2016,5]]}},"alternative-id":["s16050719"],"URL":"https:\/\/doi.org\/10.3390\/s16050719","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,5,18]]}}}