{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T05:39:36Z","timestamp":1776404376101,"version":"3.51.2"},"reference-count":33,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T00:00:00Z","timestamp":1717804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Multispectral imaging technology has advanced significantly in recent years, allowing single-sensor cameras with multispectral filter arrays to be used in new scene acquisition applications. Our camera, developed as part of the European CAVIAR project, uses an eight-band MSFA to produce mosaic images that can be decomposed into eight sparse images. These sparse images contain only pixels with similar spectral properties and null pixels. A demosaicing process is then applied to obtain fully defined images. However, this process faces several challenges in rendering fine details, abrupt transitions, and textured regions due to the large number of null pixels in the sparse images. Therefore, we propose a sparse image composition method to overcome these challenges by reducing the number of null pixels in the sparse images. To achieve this, we increase the number of snapshots by simultaneously introducing a spatial displacement of the sensor by one to three pixels on the horizontal and\/or vertical axes. The set of snapshots acquired provides a multitude of mosaics representing the same scene with a redistribution of pixels. The sparse images from the different mosaics are added together to get new composite sparse images in which the number of null pixels is reduced. A bilinear demosaicing approach is applied to the composite sparse images to obtain fully defined images. Experimental results on images projected onto the response of our MSFA filter show that our composition method significantly improves image spatial resolution and minimizes reconstruction errors while preserving spectral fidelity.<\/jats:p>","DOI":"10.3390\/jimaging10060140","type":"journal-article","created":{"date-parts":[[2024,6,10]],"date-time":"2024-06-10T08:49:03Z","timestamp":1718009343000},"page":"140","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A Multi-Shot Approach for Spatial Resolution Improvement of Multispectral Images from an MSFA Sensor"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-5560-0732","authenticated-orcid":false,"given":"Jean Yves Aristide","family":"Yao","sequence":"first","affiliation":[{"name":"Laboratoire Imagerie et Vision Artificielle (ImVia), Universit\u00e9 de Bourgogne, 21000 Dijon, France"},{"name":"Unit\u00e9 de Recherche et d\u2019Expertise Num\u00e9rique (UREN), Universit\u00e9 Virtuelle de C\u00f4te d\u2019Ivoire, 28 BP 536, Abidjan 28, C\u00f4te d\u2019Ivoire"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1209-5874","authenticated-orcid":false,"given":"Kacoutchy Jean","family":"Ayikpa","sequence":"additional","affiliation":[{"name":"Laboratoire Imagerie et Vision Artificielle (ImVia), Universit\u00e9 de Bourgogne, 21000 Dijon, France"},{"name":"Unit\u00e9 de Recherche et d\u2019Expertise Num\u00e9rique (UREN), Universit\u00e9 Virtuelle de C\u00f4te d\u2019Ivoire, 28 BP 536, Abidjan 28, C\u00f4te d\u2019Ivoire"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pierre","family":"Gouton","sequence":"additional","affiliation":[{"name":"Laboratoire Imagerie et Vision Artificielle (ImVia), Universit\u00e9 de Bourgogne, 21000 Dijon, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1323-8578","authenticated-orcid":false,"given":"Tiemoman","family":"Kone","sequence":"additional","affiliation":[{"name":"Unit\u00e9 de Recherche et d\u2019Expertise Num\u00e9rique (UREN), Universit\u00e9 Virtuelle de C\u00f4te d\u2019Ivoire, 28 BP 536, Abidjan 28, C\u00f4te d\u2019Ivoire"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"207871","DOI":"10.1109\/ACCESS.2020.3037451","article-title":"Multispectral Facial Recognition: A Review","volume":"8","author":"Chambino","year":"2020","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.inffus.2022.12.026","article-title":"Panchromatic and Multispectral Image Fusion for Remote Sensing and Earth Observation: Concepts, Taxonomy, Literature Review, Evaluation Methodologies and Challenges Ahead","volume":"93","author":"Zhang","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1016\/j.survophthal.2023.06.004","article-title":"Multispectral Imaging: Review of Current Applications","volume":"68","author":"Ma","year":"2023","journal-title":"Surv. Ophthalmol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mohammadi, V., Gouton, P., Ross\u00e9, M., and Katakpe, K.K. (2023). Design and Development of Large-Band Dual-MSFA Sensor Camera for Precision Agriculture. Sensors, 24.","DOI":"10.3390\/s24010064"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1364\/AO.46.001896","article-title":"Liquid-Crystal Tunable Filter Spectral Imaging for Brain Tumor Demarcation","volume":"46","author":"Gebhart","year":"2007","journal-title":"Appl. Opt."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1364\/JOSA.59.000744","article-title":"Acousto-Optic Tunable Filter","volume":"59","author":"Harris","year":"1969","journal-title":"J. Opt. Soc. Am."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"21626","DOI":"10.3390\/s141121626","article-title":"Multispectral Filter Arrays: Recent Advances and Practical Implementation","volume":"14","author":"Lapray","year":"2014","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Monno, Y., Kitao, T., Tanaka, M., and Okutomi, M. (October, January 30). Optimal Spectral Sensitivity Functions for a Single-Camera One-Shot Multispectral Imaging System. Proceedings of the 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA.","DOI":"10.1109\/ICIP.2012.6467315"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"116893","DOI":"10.1016\/j.image.2022.116893","article-title":"Generic Multispectral Demosaicking Using Spectral Correlation between Spectral Bands and Pseudo-Panchromatic Image","volume":"110","author":"Rathi","year":"2023","journal-title":"Signal Process. Image Commun."},{"key":"ref_10","unstructured":"Widenhorn, R., and Nguyen, V. (2011). Spatial Arrangement of Color Filter Array for Multispectral Image Acquisition, San Francisco Airport."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3048","DOI":"10.1109\/TIP.2015.2436342","article-title":"A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor","volume":"24","author":"Monno","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mohammadi, V., Sodjinou, S.G., Katakpe, K.K., Ross\u00e9, M., and Gouton, P. (2022, January 17\u201320). Development of a Multi-Spectral Camera for Computer Vision Applications. Proceedings of the International Conference on Computer Graphics, Visualization and Computer Vision (WSCG 2022), Pilsen, Czech Republic.","DOI":"10.24132\/CSRN.3201.4"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Thomas, J.-B., Lapray, P.-J., Gouton, P., and Clerc, C. (2016). Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition. Sensors, 16.","DOI":"10.3390\/s16070993"},{"key":"ref_14","unstructured":"Battiato, S., Rodricks, B.G., Sampat, N., Imai, F.H., and Xiao, F. (2012). Multispectral Demosaicking Using Guided Filter, SPIE."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, G., and Hu, B. (2021, January 15\u201317). Generic Demosaicking Method for Multispectral Filter Arrays Based on Adaptive Frequency Domain Filtering. Proceedings of the 2021 4th International Conference on Sensors, Signal and Image Processing, Nanjing, China.","DOI":"10.1145\/3502814.3502825"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"64715","DOI":"10.1109\/ACCESS.2022.3182493","article-title":"Generic Multispectral Demosaicking Based on Directional Interpolation","volume":"10","author":"Rathi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, X., Dai, Y., Zhang, G., Zhang, X., and Hu, B. (2024). A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network. Sensors, 24.","DOI":"10.3390\/s24030943"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1109\/JSEN.2018.2876774","article-title":"Single-Sensor RGB-NIR Imaging: High-Quality System Design and Prototype Implementation","volume":"19","author":"Monno","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1109\/TCI.2017.2691553","article-title":"Multispectral Demosaicing Using Pseudo-Panchromatic Image","volume":"3","author":"Mihoubi","year":"2017","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mizutani, J., Ogawa, S., Shinoda, K., Hasegawa, M., and Kato, S. (2014, January 7\u201310). Multispectral Demosaicking Algorithm Based on Inter-Channel Correlation. Proceedings of the 2014 IEEE Visual Communications and Image Processing Conference, Valletta, Malta.","DOI":"10.1109\/VCIP.2014.7051609"},{"key":"ref_21","unstructured":"Brauers, J., and Aach, T. (2006, January 5\u20136). A Color Filter Array Based Multispectral Camera. Proceedings of the Workshop Farbbildverarbeitung, Ilmenau, Germany."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jeong, K., Kim, S., and Kang, M.G. (2024). Multispectral Demosaicing Based on Iterative-Linear-Regression Model for Estimating Pseudo-Panchromatic Image. Sensors, 24.","DOI":"10.3390\/s24030760"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3550","DOI":"10.1109\/TIP.2006.877476","article-title":"Binary Tree-Based Generic Demosaicking Algorithm for Multispectral Filter Arrays","volume":"15","author":"Miao","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rathi, V., and Goyal, P. (2021, January 8\u201310). Convolution Filter Based Efficient Multispectral Image Demosaicking for Compact MSFAs. Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, SCITEPRESS\u2014Science and Technology Publications, Virtual Event.","DOI":"10.5220\/0010249601120121"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1109\/JSTSP.2022.3172865","article-title":"A Deep Joint Network for Multispectral Demosaicking Based on Pseudo-Panchromatic Images","volume":"16","author":"Liu","year":"2022","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_26","first-page":"5405214","article-title":"PPI Edge Infused Spatial\u2013Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing","volume":"61","author":"Zhao","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2780","DOI":"10.1109\/TIP.2006.877315","article-title":"The Design and Evaluation of a Generic Method for Generating Mosaicked Multispectral Filter Arrays","volume":"15","author":"Miao","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/978-3-319-59129-2_34","article-title":"HDR Imaging Pipeline for Spectral Filter Array Cameras","volume":"10270","author":"Sharma","year":"2017","journal-title":"Image Analysis"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of Validity of PSNR in Image\/Video Quality Assessment","volume":"44","author":"Ghanbari","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0034-4257(93)90013-N","article-title":"The spectral image processing system (SIPS)\u2014interactive visualization and analysis of imaging spectrometer data","volume":"44","author":"Kruse","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5481","DOI":"10.5194\/gmd-15-5481-2022","article-title":"Root-Mean-Square Error (RMSE) or Mean Absolute Error (MAE): When to Use Them or Not","volume":"15","author":"Hodson","year":"2022","journal-title":"Geosci. Model Dev."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1515\/nanoph-2023-0867","article-title":"Snapshot Spectral Imaging: From Spatial-Spectral Mapping to Metasurface-Based Imaging","volume":"13","author":"Ding","year":"2024","journal-title":"Nanophotonics"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/6\/140\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:55:49Z","timestamp":1760108149000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/6\/140"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,8]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["jimaging10060140"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10060140","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,8]]}}}