{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T02:28:57Z","timestamp":1773023337431,"version":"3.50.1"},"reference-count":31,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T00:00:00Z","timestamp":1594166400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this study, the results from a round-robin test of hyperspectral imaging systems are presented and analyzed. Fourteen different pushbroom hyperspectral systems from eight different institutions were used to acquire spectral cubes from the visible, near infra-red and short-wave infra-red regions. Each system was used to acquire a common set of targets under their normal operating conditions with the data calibrated and processed using the standard processing pipeline for each system. The test targets consisted of a spectral wavelength standard and of a custom-made pigment panel featuring Renaissance-era pigments frequently found in paintings from that period. The quality and accuracy of the resulting data was assessed with quantitative analyses of the spectral, spatial and colorimetric accuracy of the data. The results provide a valuable insight into the accuracy, reproducibility and precision of hyperspectral imaging equipment when used under routine operating conditions. The distribution and type of error found within the data can provide useful information on the fundamental and practical limits of such equipment when used for applications such as spectral classification, change detection, colorimetry and others.<\/jats:p>","DOI":"10.3390\/s20143812","type":"journal-article","created":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T11:47:46Z","timestamp":1594208866000},"page":"3812","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Evaluation of the Data Quality from a Round-Robin Test of Hyperspectral Imaging Systems"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5398-1365","authenticated-orcid":false,"given":"Ruven","family":"Pillay","sequence":"first","affiliation":[{"name":"NTNU-Norwegian University of Science and Technology, Department of Computer Science, Teknologivegen 22, N-2815 Gj\u00f8vik, Norway"},{"name":"C2RMF-Centre de Restauration et Recherche des Mus\u00e9es de France, Porte des Lions-Palais du Louvre, 75001 Paris, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1012-6048","authenticated-orcid":false,"given":"Marcello","family":"Picollo","sequence":"additional","affiliation":[{"name":"IFAC-CNR-Istituto di Fisica Applicata \u201cNello Carrara\u201d del Consiglio Nazionale delle Ricerche, Via Madonna del Piano 10, 50019 Firenze, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1150-2498","authenticated-orcid":false,"given":"Jon Yngve","family":"Hardeberg","sequence":"additional","affiliation":[{"name":"NTNU-Norwegian University of Science and Technology, Department of Computer Science, Teknologivegen 22, N-2815 Gj\u00f8vik, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8436-3164","authenticated-orcid":false,"given":"Sony","family":"George","sequence":"additional","affiliation":[{"name":"NTNU-Norwegian University of Science and Technology, Department of Computer Science, Teknologivegen 22, N-2815 Gj\u00f8vik, Norway"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"S5","DOI":"10.1016\/j.rse.2007.12.014","article-title":"Three Decades of Hyperspectral Remote Sensing of the Earth: A Personal View","volume":"113","author":"Goetz","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ifset.2013.04.014","article-title":"Advanced Applications of Hyperspectral Imaging Technology for Food Quality and Safety Analysis and Assessment: A Review\u2014Part I: Fundamentals","volume":"19","author":"Wu","year":"2013","journal-title":"Innov. Food Sci. Emerg. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hege, E.K., O\u2019Connell, D., Johnson, W., Basty, S., and Dereniak, E.L. (2003, January 6\u20137). Hyperspectral Imaging for Astronomy and Space Surveillance. Proceedings of the Imaging Spectrometry IX. International Society for Optics and Photonics, San Diego, CA, USA.","DOI":"10.1117\/12.506426"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1109\/TGRS.2003.812908","article-title":"Comparison of Airborne Hyperspectral Data and EO-1 Hyperion for Mineral Mapping","volume":"41","author":"Kruse","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.rse.2003.12.013","article-title":"Hyperspectral Vegetation Indices and Novel Algorithms for Predicting Green LAI of Crop Canopies: Modeling and Validation in the Context of Precision Agriculture","volume":"90","author":"Haboudane","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"010901","DOI":"10.1117\/1.JBO.19.1.010901","article-title":"Medical Hyperspectral Imaging: A Review","volume":"19","author":"Lu","year":"2014","journal-title":"J. Biomed. Opt."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Casini, A., Bacci, M., Cucci, C., Lotti, F., Porcinai, S., Picollo, M., Radicati, B., Poggesi, M., and Stefani, L. (2005, January 13\u201314). Fiber Optic Reflectance Spectroscopy and Hyper-Spectral Image Spectroscopy: Two Integrated Techniques for the Study of the Madonna Dei Fusi. Proceedings of the Optical Methods for Arts and Archaeology, Munich, Germany.","DOI":"10.1117\/12.611500"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bentkowska-Kafel, A., and MacDonald, L. (2018). Digital Techniques for Documenting and Preserving Cultural Heritage, Arc Humanities Press.","DOI":"10.1515\/9781942401353"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1077","DOI":"10.1175\/1520-0426(2000)017<1077:BRRRIS>2.0.CO;2","article-title":"Bidirectional Reflectance Round-Robin in Support of the Earth Observing System Program","volume":"17","author":"Early","year":"2000","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_10","unstructured":"Hooker, S.B., Firestone, E.R., McLean, S., Sherman, J., Small, M., Lazin, G., Zibordi, G., Brown, J.W., and McClain, C.R. (2002). The Seventh SeaWiFS Intercalibration Round-Robin Experiment (SIRREX-7)."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1127\/1432-8364\/2012\/0129","article-title":"Overview of Experimental Setups in Spectroscopic Laboratory Measurements\u2013the SpecTour Project","volume":"2012","author":"Jung","year":"2012","journal-title":"Photogramm. Fernerkund. Geoinf."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/01971360.2018.1549919","article-title":"Hyperspectral Imaging of Art: Acquisition and Calibration Workflows","volume":"58","author":"Pillay","year":"2019","journal-title":"J. Am. Inst. Conserv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"George, S., Hardeberg, J., Linhares, J., MacDonald, L., Montagner, C., Nascimento, S., Picollo, M., Pillay, R., Vitorino, T., and Webb, E.K. (2018). A Study of Spectral Imaging Acquisition and Processing for Cultural Heritage. Digital Techniques for Documenting and Preserving Cultural Heritage, Arc Humanities Press.","DOI":"10.5040\/9781641899444.ch-008"},{"key":"ref_14","unstructured":"George, S., Ciortan, I., and Hardeberg, J.Y. (2015, January 19\u201322). Evaluation of Hyperspectral Imaging Systems for Cultural Heritage Applications Based on a Round Robin Test. Proceedings of the International Colour Association (AIC), Tokyo, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1186\/s40494-017-0154-1","article-title":"Assessment of Multispectral and Hyperspectral Imaging Systems for Digitisation of a Russian Icon","volume":"5","author":"MacDonald","year":"2017","journal-title":"Herit. Sci."},{"key":"ref_16","unstructured":"Cennini, C., and Thompson, D.V. (1936). Il Libro Dell\u2019Arte, Yale University Press."},{"key":"ref_17","unstructured":"Vitorino, T. (2014). Analysis of the Round Robin Test Data Acquired at IFAC-CNR, IFAC-CNR. STSM Report for IFAC-CNR."},{"key":"ref_18","first-page":"50","article-title":"Spectrophotometric Image Analysis of Fine Art Paintings","volume":"1996","author":"Schmitt","year":"1996","journal-title":"Color Imaging Conf."},{"key":"ref_19","unstructured":"Rabiner, L.R., and Gold, B. (1975). Theory and Application of Digital Signal Processing, Prentice-Hall."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Prasad, S., Bruce, L.M., and Chanussot, J. (2011). Recent Developments in Endmember Extraction and Spectral Unmixing. Optical Remote Sensing, Springer.","DOI":"10.1007\/978-3-642-14212-3"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Deborah, H., Richard, N., and Hardeberg, J. (2015). A Comprehensive Evaluation of Spectral Distance Functions and Metrics for Hyperspectral Image Processing. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 1\u201311.","DOI":"10.1109\/JSTARS.2015.2403257"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0034-4257(93)90013-N","article-title":"Airbone Imaging Spectrometry The Spectral Image Processing System (SIPS)\u2014Interactive Visualization and Analysis of Imaging Spectrometer Data","volume":"44","author":"Kruse","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1927","DOI":"10.1109\/18.857802","article-title":"An Information-Theoretic Approach to Spectral Variability, Similarity, and Discrimination for Hyperspectral Image Analysis","volume":"46","author":"Chang","year":"2000","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_24","unstructured":"De Carvalho, O.A., and Meneses, P.R. (2000, January 23\u201325). Spectral Correlation Mapper (SCM): An Improvement on the Spectral Angle Mapper (SAM). Proceedings of the Summaries of the 9th JPL Airborne Earth Science Workshop, JPL Publication 00-18, Pasadena, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Angelopoulou, E., Lee, S.W., and Bajcsy, R. (1999, January 20\u201327). Spectral Gradient: A Material Descriptor Invariant to Geometry and Incident Illumination. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790312"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bacci, M., Baronti, S., Casini, A., Lotti, F., Picollo, M., and Casazza, O. (1992). Non-Destructive Spectroscopic Investigations on Paintings Using Optical Fibers. Mrs Online Proc. Libr. Arch., 267.","DOI":"10.1557\/PROC-267-265"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/0034-4257(90)90055-Q","article-title":"High Resolution Derivative Spectra in Remote Sensing","volume":"33","author":"Steven","year":"1990","journal-title":"Remote Sens. Environ."},{"key":"ref_28","unstructured":"Duda, R.O., and Hart, P.E. (1971). Use of the Hough Transformation to Detect Lines and Curves in Pictures, Communications of the ACM. Technical Report SRI-TN-36."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1117\/12.144795","article-title":"High-Resolution Colorimetric Imaging of Paintings","volume":"1901","author":"Martinez","year":"1993","journal-title":"Proc. Spie"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"305","DOI":"10.2352\/J.ImagingSci.Technol.2001.45.4.art00002","article-title":"The Science of Digitizing Paintings for Color-Accurate Image Archives: A Review","volume":"45","author":"Berns","year":"2001","journal-title":"J. Imaging Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1002\/col.1049","article-title":"The Development of the CIE 2000 Colour-Difference Formula: CIEDE2000","volume":"26","author":"Luo","year":"2001","journal-title":"Color Res. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/3812\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:48:52Z","timestamp":1760176132000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/3812"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,8]]},"references-count":31,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["s20143812"],"URL":"https:\/\/doi.org\/10.3390\/s20143812","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,8]]}}}