{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T01:54:52Z","timestamp":1790474092259,"version":"4.1.0"},"reference-count":57,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2017,6,3]],"date-time":"2017-06-03T00:00:00Z","timestamp":1496448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Spectral filter arrays imaging exhibits a strong similarity with color filter arrays. This permits us to embed this technology in practical vision systems with little adaptation of the existing solutions. In this communication, we define an imaging pipeline that permits high dynamic range (HDR)-spectral imaging, which is extended from color filter arrays. We propose an implementation of this pipeline on a prototype sensor and evaluate the quality of our implementation results on real data with objective metrics and visual examples. We demonstrate that we reduce noise, and, in particular we solve the problem of noise generated by the lack of energy balance. Data are provided to the community in an image database for further research.<\/jats:p>","DOI":"10.3390\/s17061281","type":"journal-article","created":{"date-parts":[[2017,6,6]],"date-time":"2017-06-06T10:53:09Z","timestamp":1496746389000},"page":"1281","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["High Dynamic Range Spectral Imaging Pipeline For Multispectral Filter Array Cameras"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2230-0955","authenticated-orcid":false,"given":"Pierre-Jean","family":"Lapray","sequence":"first","affiliation":[{"name":"MIPS Laboratory, Universit\u00e9 de Haute Alsace, 68093 Mulhouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean-Baptiste","family":"Thomas","sequence":"additional","affiliation":[{"name":"The Norwegian Colour and Visual Computing Laboratory, NTNU - Norwegian University of Science and Technology, 2815 Gj\u00f8vik, Norway"},{"name":"Le2i Laboratory, FRE CNRS 2005, Universit\u00e9 de Bourgogne Franche-Comt\u00e9, 21000 Dijon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pierre","family":"Gouton","sequence":"additional","affiliation":[{"name":"Le2i Laboratory, FRE CNRS 2005, Universit\u00e9 de Bourgogne Franche-Comt\u00e9, 21000 Dijon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"21626","DOI":"10.3390\/s141121626","article-title":"Multispectral Filter Arrays: Recent Advances and Practical Implementation","volume":"14","author":"Lapray","year":"2014","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Park, H., Dan, Y., Seo, K., Yu, Y.J., Duane, P.K., Wober, M., and Crozier, K.B. (2013, January 9\u201314). Vertical Silicon Nanowire Photodetectors: Spectral Sensitivity via Nanowire Radius. Proceedings of the 2013 CLEO: Science and Innovations, San Jose, CA, USA.","DOI":"10.1364\/CLEO_SI.2013.CTh3L.5"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"792711","DOI":"10.1117\/12.875833","article-title":"Fabrication of multispectral imaging technology driven MEMS-based micro-arrayed multichannel optical filter mosaic","volume":"7927","author":"Yi","year":"2011","journal-title":"Proc. SPIE"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"721814","DOI":"10.1117\/12.809527","article-title":"Ultracompact fully integrated megapixel multispectral imager","volume":"7218","author":"Eichenholz","year":"2009","journal-title":"Proc. SPIE"},{"key":"ref_5","first-page":"90230V-9","article-title":"Simultaneous capturing of RGB and additional band images using hybrid color filter array","volume":"9023","author":"Kiku","year":"2014","journal-title":"Proc. SPIE"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"937414","DOI":"10.1117\/12.2077583","article-title":"A tiny VIS-NIR snapshot multispectral camera","volume":"9374","author":"Geelen","year":"2015","journal-title":"Proc. SPIE"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lapray, P.J., Thomas, J.B., and Gouton, P. (2014, January 3\u20137). A Multispectral Acquisition System using MSFAs. Proceedings of the Color and Imaging Conference, Boston, MA, USA.","DOI":"10.2352\/CIC.2014.22.1.art00016"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Thomas, J.B., Lapray, P.J., Gouton, P., and Clerc, C. (2016). Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition. Sensors, 16.","DOI":"10.3390\/s16070993"},{"key":"ref_9","unstructured":"IMEC (2017, May 05). Hyperspectral-Imaging. Available online: https:\/\/www.imec-int.com."},{"key":"ref_10","unstructured":"SILIOS Technologies (2017, May 05). MICRO-OPTICS Supplier. Available online: http:\/\/www.silios.com\/."},{"key":"ref_11","unstructured":"PIXELTEQ (2017, May 05). Micro-Patterned Optical Filters. Available online: https:\/\/pixelteq.com\/."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1530","DOI":"10.1109\/TIP.2016.2523683","article-title":"Fourier Spectral Filter Array for Optimal Multispectral Imaging","volume":"25","author":"Jia","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3048","DOI":"10.1109\/TIP.2015.2436342","article-title":"A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor","volume":"24","author":"Monno","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1006814","DOI":"10.1117\/12.2251928","article-title":"Spatial and temporal skin blood volume and saturation estimation using a multispectral snapshot imaging camera","volume":"10068","author":"Larsson","year":"2017","journal-title":"Proc. SPIE"},{"key":"ref_15","unstructured":"Constantin, D., Rehak, M., Akhtman, Y., and Liebisch, F. (2015, January 7). Detection of crop properties by means of hyperspectral remote sensing from a micro UAV. Proceedings of the 20. und 21. Workshop Computer-Bildanalyse in der Landwirtschaft - 3. Workshop Unbemannte autonom fliegende Systeme (UAS) in der Landwirtschaft, Braunschweig, Germany."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"P\u00e9guillet, H., Thomas, J.B., Gouton, P., and Ruichek, Y. (2013, January 5\u20136). Energy balance in single exposure multispectral sensors. Proceedings of the 2013 Colour and Visual Computing Symposium (CVCS), Gj\u00f8vik, Norway.","DOI":"10.1109\/CVCS.2013.6626277"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lapray, P.J., Thomas, J.B., Gouton, P., and Ruichek, Y. (2017). Energy balance in Spectral Filter Array camera design. J. Eur. Opt. Soc.","DOI":"10.1186\/s41476-016-0031-7"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Knickerbocker, J.U., Andry, P., Dang, B., Horton, R., Patel, C.S., Polastre, R., Sakuma, K., Sprogis, E., Tsang, C., and Webb, B. (2008, January 27\u201330). 3D silicon integration. Proceedings of the 58th Electronic Components and Technology Conference, Lake Buena Vista, FL, USA.","DOI":"10.1109\/ECTC.2008.4550025"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Brochard, N., Nebhen, J., and Ginhac, D. (2016, January 12\u201315). 3D-IC: New Perspectives for a Digital Pixel Sensor. Proceedings of the 10th International Conference on Distributed Smart Camera, (ICDSC \u201916), Paris, France.","DOI":"10.1145\/2967413.2967433"},{"key":"ref_20","unstructured":"Mann, S., and Picard, R. (1995). On Being \u2019undigital\u2019 with Digital Cameras: Extending Dynamic Range by Combining Differently Exposed Pictures, Massachusetts Institute of Technology."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Debevec, P.E., and Malik, J. (1997, January 3\u20138). Recovering High Dynamic Range Radiance Maps from Photographs. Proceedings of the 24th Annual Conference on Computer Graphics and (SIGGRAPH \u201997), Los Angeles, CA, USA.","DOI":"10.1145\/258734.258884"},{"key":"ref_22","unstructured":"Mitsunaga, T., and Nayar, S.K. (1999, January 23\u201325). Radiometric self calibration. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Fort Collins, CO, USA."},{"key":"ref_23","unstructured":"Robertson, M.A., Borman, S., and Stevenson, R.L. (1999, January 24\u201328). Dynamic range improvement through multiple exposures. Proceedings of the 1999 International Conference on Image Processing, (ICIP 99), Kobe, Japan."},{"key":"ref_24","unstructured":"Mann, S., Lo, R.C.H., Ovtcharov, K., Gu, S., Dai, D., Ngan, C., and Ai, T. (May, January 29). Realtime HDR (high dynamic range) video for eyetap wearable computers, FPGA-based seeing aids, and glasseyes (eyetaps). Proceedings of the 25th IEEE Canadian Conference on Electrical & Computer Engineering (CCECE), Montreal, QC, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1007\/s11554-013-0393-7","article-title":"HDR-ARtiSt: An adaptive real-time smart camera for high dynamic range imaging","volume":"12","author":"Lapray","year":"2014","journal-title":"J. Real Time Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"102110","DOI":"10.1117\/1.OE.53.10.102110","article-title":"Hardware-based smart camera for recovering high dynamic range video from multiple exposures","volume":"53","author":"Lapray","year":"2014","journal-title":"Opt. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/1687-5281-2014-42","article-title":"Probabilistic motion pixel detection for the reduction of ghost artifacts in high dynamic range images from multiple exposures","volume":"2014","author":"An","year":"2014","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bouderbane, M., Lapray, P.J., Dubois, J., Heyrman, B., and Ginhac, D. (2016, January 12\u201315). Real-time Ghost Free HDR Video Stream Generation Using Weight Adaptation Based Method. Proceedings of the 10th International Conference on Distributed Smart Camera, (ICDSC \u201916), Paris, France.","DOI":"10.1145\/2967413.2967439"},{"key":"ref_29","unstructured":"Brauers, J., Schulte, N., Bell, A., and Aach, T. (2008, January 1\u20132). Color Accuracy and Noise Analysis in Multispectral HDR Imaging. Proceedings of the 14th Workshop Farbbildverarbeitung 2008, Aachen, Germany."},{"key":"ref_30","unstructured":"Simon, P.M. (2011). Single Shot High Dynamic Range and Multispectral Imaging Based on Properties of Color Filter Arrays. [Ph.D. Thesis, University of Dayton]."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Thomas, J.B., Lapray, P.J., and Gouton, P. (2017, January 12\u201314). HDR imaging pipeline for spectral filter array cameras. Presented at the Scandinavian Conference on Image Analysis (SCIA), Troms\u00f8, Norway.","DOI":"10.1007\/978-3-319-59129-2_34"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lapray, P.J., Thomas, J.B., and Gouton, P. (2017, January 29\u201331). A Database of Spectral Filter Array Images that Combine Visible and NIR. Proceedings of the 6th International Workshop on Computational Color Imaging (CCIW 2017), Milan, Italy.","DOI":"10.1007\/978-3-319-56010-6_16"},{"key":"ref_33","unstructured":"Tsin, Y., Ramesh, V., and Kanade, T. (2001, January 7\u201314). Statistical calibration of CCD imaging process. Proceedings of the Eighth IEEE International Conference on Computer Vision, (ICCV 2001), Vancouver, BC, Canada."},{"key":"ref_34","unstructured":"Zhou, J. (2007). Getting the Most out of Your Image-Processing Pipeline, Texas Instruments. White Paper."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rani, K.S., and Hans, W.J. (2013, January 3\u20135). FPGA implementation of bilinear interpolation algorithm for CFA demosaicing. Proceedings of the 2013 International Conference on Communications and Signal Processing (ICCSP), Melmaruvathur, India.","DOI":"10.1109\/iccsp.2013.6577178"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1109\/83.597268","article-title":"Digital color imaging","volume":"6","author":"Sharma","year":"1997","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MSP.2005.1407713","article-title":"Color image processing pipeline","volume":"22","author":"Ramanath","year":"2005","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1109\/TCE.2006.273126","article-title":"Design considerations of color image processing pipeline for digital cameras","volume":"52","author":"Kao","year":"2006","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1145\/566654.566575","article-title":"Photographic tone reproduction for digital images","volume":"21","author":"Reinhard","year":"2002","journal-title":"ACM Trans. Graph."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"68170J","DOI":"10.1117\/12.767728","article-title":"Digital camera workflow for high dynamic range images using a model of retinal processing. In Proceedings of the Electronic Imaging 2008, International Society for Optics and Photonics","volume":"6817","author":"Tamburrino","year":"2008","journal-title":"Proc. SPIE"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Thomas, J.B. (2015, January 25\u201326). Illuminant estimation from uncalibrated multispectral images. Proceedings of the 2015 Colour and Visual Computing Symposium (CVCS), Gj\u00f8vik, Norway.","DOI":"10.1109\/CVCS.2015.7274900"},{"key":"ref_42","unstructured":"Ahmad, H., Thomas, J.B., and Hardeberg, J.Y. (2017, January 12\u201314). Multispectral constancy based on spectral adaptation transform. Presented at the Scandinavian Conference on Image Analysis (SCIA), Troms\u00f8, Norway."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3550","DOI":"10.1109\/TIP.2006.877476","article-title":"Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays","volume":"15","author":"Miao","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Banterle, F., Artusi, A., Debattista, K., and Chalmers, A. (2011). Advanced High Dynamic Range Imaging: Theory and Practice, AK Peters (CRC Press).","DOI":"10.1201\/b11373"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Khan, H.A., Thomas, J.B., Hardeberg, J.Y., and Laligant, O. (2017). Illuminant estimation in multispectral imaging. J. Opt. Soc. Am. A, 34, in press.","DOI":"10.1364\/JOSAA.34.001085"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"649212","DOI":"10.1117\/12.713526","article-title":"High dynamic range imaging pipeline: Perception-motivated representation of visual content","volume":"6492","author":"Mantiuk","year":"2007","journal-title":"Proc. SPIE"},{"key":"ref_47","unstructured":"CHIC website (2017, May 05). Website at Universit\u00e9 de Bourgogne. Available online: http:\/\/chic.u-bourgogne.fr."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1111\/j.1467-8659.2005.00888.x","article-title":"Lightness perception in tone reproduction for high dynamic range images","volume":"24","author":"Krawczyk","year":"2005","journal-title":"Comput. Graphics Forum"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Fattal, R., Lischinski, D., and Werman, M. (2002, January 23\u201326). Gradient Domain High Dynamic Range Compression. Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH \u201902), San Antonio, TX, USA.","DOI":"10.1145\/566570.566573"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Banterle, F., Artusi, A., Sikudova, E., Bashford-Rogers, T., Ledda, P., Bloj, M., and Chalmers, A. (2012, January 3\u20134). Dynamic Range Compression by Differential Zone Mapping Based on Psychophysical Experiments. Proceedings of the ACM Symposium on Applied Perception (SAP \u201912), Los Angeles, CA, USA.","DOI":"10.1145\/2338676.2338685"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-Reference Image Quality Assessment in the Spatial Domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201ccompletely blind\u201d image quality analyzer","volume":"20","author":"Mittal","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3339","DOI":"10.1109\/TIP.2012.2191563","article-title":"Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain","volume":"21","author":"Saad","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2957","DOI":"10.1109\/TIP.2017.2685941","article-title":"No-Reference Quality Assessment of Tone-Mapped HDR Pictures","volume":"26","author":"Kundu","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_55","unstructured":"Kundu, D., Ghadiyaram, D., Bovik, A.C., and Evans, B.L. (2017, May 01). ESPL-LIVE HDR Image Quality Database. Available online: http:\/\/live.ece.utexas.edu\/research\/HDRDB\/hdr_index.html."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Luthman, A.S., Dumitru, S., Quiros-Gonzalez, I., Joseph, J., and Bohndiek, S.E. (2017). Fluorescence hyperspectral imaging (fHSI) using a spectrally resolved detector array. J. Biophotonics.","DOI":"10.1002\/jbio.201600304"},{"key":"ref_57","unstructured":"Benezeth, Y., Sidib\u00e9, D., and Thomas, J.B. (June, January 31). Background subtraction with multispectral video sequences. Proceedings of the IEEE ICRA Workshops on Non-classical Cameras, Camera Networks and Omnidirectional Vision (OMNIVIS), Hong Kong, China."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/6\/1281\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:37:52Z","timestamp":1760207872000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/6\/1281"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,3]]},"references-count":57,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2017,6]]}},"alternative-id":["s17061281"],"URL":"https:\/\/doi.org\/10.3390\/s17061281","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,3]]}}}