{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T17:51:50Z","timestamp":1772905910091,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["No. S20220156"],"award-info":[{"award-number":["No. S20220156"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Multispectral imaging is valuable in many vision-related fields as it provides an additional modality to observe the world. Cameras equipped with multispectral filter arrays (MSFAs) are typically impractical for everyday use due to their intractable demosaicking and chromatic reproduction processes, which restrict their applicability beyond academic research. In this work, a novel MSFA design is proposed to enable dual-mode imaging for multispectral cameras. In addition to a conventional multispectral image, the camera is also able to produce a Bayer-formed RGB image from a single shot by grouping and merging adjacent pixels in the proposed MSFA, making it suitable for scenarios where display-ready RGB images are required. Furthermore, a two-stage optimization scheme is implemented to jointly optimize objective functions for both imaging modes. The evaluation results on multiple datasets suggest that the proposed MSFA design is able to simultaneously achieve competitive spectral reconstruction accuracy compared to elaborate multispectral cameras and chromatic accuracy compared to commercial RGB cameras.<\/jats:p>","DOI":"10.3390\/s23156856","type":"journal-article","created":{"date-parts":[[2023,8,2]],"date-time":"2023-08-02T11:17:17Z","timestamp":1690975037000},"page":"6856","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Design of a Dual-Mode Multispectral Filter Array"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9214-8779","authenticated-orcid":false,"given":"Zhengnan","family":"Ye","sequence":"first","affiliation":[{"name":"State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6257-098X","authenticated-orcid":false,"given":"Haisong","family":"Xu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8259-1681","authenticated-orcid":false,"given":"Yiming","family":"Huang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Minhang","family":"Yang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, B., Song, S., Gong, W., Cao, X., He, D., Chen, Z., Lin, X., Li, F., and Sun, J. (2020). Color Restoration for Full-Waveform Multispectral LiDAR Data. Remote Sens., 12.","DOI":"10.3390\/rs12040593"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1080\/00387010.2021.1931788","article-title":"Color and Spectrum Dual-Fidelity Image Codec\u2014A New Multispectral Image Codec Based on Color Space Values, Visual Trigonometric Curves and Principal Component Analysis to Improve Colorimetric and Spectral Accuracy","volume":"54","author":"Liang","year":"2021","journal-title":"Spectrosc. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1080\/10739149.2022.2047061","article-title":"Inexpensive Multispectral Imaging Device","volume":"50","author":"Akkoyun","year":"2022","journal-title":"Instrum. Sci. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"104510","DOI":"10.1016\/j.infrared.2022.104510","article-title":"A Snapshot Near-Infrared Hyperspectral Demosaicing Method with Convolutional Neural Networks in Low Illumination Environment","volume":"129","author":"Ma","year":"2023","journal-title":"Infrared Phys. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mei, L., and Jung, C. (2022, January 21\u201325). Low Light Image Enhancement by Multispectral Fusion and Convolutional Neural Networks. Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR), Montreal, QC, Canada.","DOI":"10.1109\/ICPR56361.2022.9956545"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2747","DOI":"10.1007\/s10845-022-01947-8","article-title":"Automatic Color Pattern Recognition of Multispectral Printed Fabric Images","volume":"34","author":"Zhang","year":"2023","journal-title":"J. Intell. Manuf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"115764","DOI":"10.1016\/j.image.2019.115764","article-title":"Convolutional Neural Networks for Multispectral Pedestrian Detection","volume":"82","author":"Ding","year":"2020","journal-title":"Signal Process. Image Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.isprsjprs.2019.09.006","article-title":"Deep Learning Classifiers for Hyperspectral Imaging: A Review","volume":"158","author":"Paoletti","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3567","DOI":"10.1109\/TGRS.2020.3006577","article-title":"Using HSI Color Space to Improve the Multispectral Lidar Classification Error Caused by Measurement Geometry","volume":"59","author":"Chen","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Zhang, X., Feng, W., and Xu, J. (2022). Deep Learning Classification by ResNet-18 Based on the Real Spectral Dataset from Multispectral Remote Sensing Images. Remote Sens., 14.","DOI":"10.3390\/rs14194883"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"21626","DOI":"10.3390\/s141121626","article-title":"Multispectral Filter Arrays: Recent Advances and Practical Implementation","volume":"14","author":"Lapray","year":"2014","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1038\/s41377-023-01135-0","article-title":"Snapshot Multispectral Imaging Using a Diffractive Optical Network","volume":"12","author":"Mengu","year":"2023","journal-title":"Light. Sci. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ramanath, R., Snyder, W.E., and Qi, H. (2004, January 30). Mosaic Multispectral Focal Plane Array Cameras. Proceedings of the Infrared Technology and Applications XXX, SPIE, Orlando, FL, USA.","DOI":"10.1117\/12.543418"},{"key":"ref_14","unstructured":"Brauers, J., and Aach, T. (2023, July 17). A Color Filter Array Based Multispectral Camera. Available online: https:\/\/www.lfb.rwth-aachen.de\/bibtexupload\/pdf\/BRA06a.pdf."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, R., Li, Y., Xie, X., and Lin, Z. (2019). Optimized Multi-Spectral Filter Arrays for Spectral Reconstruction. Sensors, 19.","DOI":"10.3390\/s19132905"},{"key":"ref_16","unstructured":"Miao, L., Qi, H., and Snyder, W.E. (2004, January 24\u201327). A Generic Method for Generating Multispectral Filter Arrays. Proceedings of the 2004 International Conference on Image Processing, ICIP \u201904, Singapore."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2780","DOI":"10.1109\/TIP.2006.877315","article-title":"The Design and Evaluation of a Generic Method for Generating Mosaicked Multispectral Filter Arrays","volume":"15","author":"Miao","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106627","DOI":"10.1016\/j.ymssp.2020.106627","article-title":"Sparse Spectral Signal Reconstruction for One Proposed Nine-Band Multispectral Imaging System","volume":"141","author":"Sun","year":"2020","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"100088","DOI":"10.1016\/j.array.2021.100088","article-title":"Extension of Luminance Component Based Demosaicking Algorithm to 4- and 5-Band Multispectral Images","volume":"12","author":"Hounsou","year":"2021","journal-title":"Array"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3048","DOI":"10.1109\/TIP.2015.2436342","article-title":"A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor","volume":"24","author":"Monno","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Y., Majumder, A., Zhang, H., and Gopi, M. (2018). Optimized Multi-Spectral Filter Array Based Imaging of Natural Scenes. Sensors, 18.","DOI":"10.3390\/s18041172"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1002\/col.22630","article-title":"Superiority of Optimal Broadband Filter Sets under Lower Noise Levels in Multispectral Color Imaging","volume":"46","author":"Li","year":"2021","journal-title":"Color Res. Appl."},{"key":"ref_23","first-page":"44","article-title":"Multispectral Imaging: Narrow or Wide Band Filters?","volume":"12","author":"Wang","year":"2014","journal-title":"J. Int. Colour Assoc."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Park, C., and Kang, M.G. (2016). Color Restoration of RGBN Multispectral Filter Array Sensor Images Based on Spectral Decomposition. Sensors, 16.","DOI":"10.3390\/s16050719"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"23654","DOI":"10.1364\/OE.426940","article-title":"Data-Driven Framework for High-Accuracy Color Restoration of RGBN Multispectral Filter Array Sensors under Extremely Low-Light Conditions","volume":"29","author":"Cao","year":"2021","journal-title":"Opt. Express OE"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jee, S., and Kang, M.G. (2019). Sensitivity Improvement of Extremely Low Light Scenes with RGB-NIR Multispectral Filter Array Sensor. Sensors, 19.","DOI":"10.3390\/s19051256"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"7173","DOI":"10.1364\/OE.20.007173","article-title":"Hybrid-Resolution Multispectral Imaging Using Color Filter Array","volume":"20","author":"Murakami","year":"2012","journal-title":"Opt. Express OE"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Monno, Y., Tanaka, M., and Okutomi, M. (2012, January 24). Multispectral Demosaicking Using Guided Filter. Proceedings of the Digital Photography VIII, SPIE, Burlingame, CA, USA.","DOI":"10.1117\/12.906168"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Jiang, J., Liu, D., Gu, J., and Susstrunk, S. (2013, January 15\u201317). What Is the Space of Spectral Sensitivity Functions for Digital Color Cameras?. Proceedings of the 2013 IEEE Workshop on Applications of Computer Vision (WACV), Clearwater Beach, FL, USA.","DOI":"10.1109\/WACV.2013.6475015"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"6989","DOI":"10.1364\/AO.55.006989","article-title":"Camera Response Prediction for Various Capture Settings Using the Spectral Sensitivity and Crosstalk Model","volume":"55","author":"Qiu","year":"2016","journal-title":"Appl. Opt. AO"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016, January 11\u201314). Sparse Recovery of Hyperspectral Signal from Natural RGB Images. Proceedings of the Computer Vision\u2014ECCV 2016, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chakrabarti, A., and Zickler, T. (2011, January 20\u201325). Statistics of Real-World Hyperspectral Images. Proceedings of the CVPR 2011, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995660"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/15\/6856\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:24:04Z","timestamp":1760127844000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/15\/6856"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,1]]},"references-count":32,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23156856"],"URL":"https:\/\/doi.org\/10.3390\/s23156856","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,1]]}}}