{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T10:35:49Z","timestamp":1763202949908,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T00:00:00Z","timestamp":1725580800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2003740"],"award-info":[{"award-number":["2003740"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hyperspectral cameras collect detailed spectral information at each image pixel, contributing to the identification of image features. The rich spectral content of hyperspectral imagery has led to its application in diverse fields of study. This study focused on cloud classification using a dataset of hyperspectral sky images captured by a Resonon PIKA XC2 camera. The camera records images using 462 spectral bands, ranging from 400 to 1000 nm, with a spectral resolution of 1.9 nm. Our preliminary\/unlabeled dataset comprised 33 parent hyperspectral images (HSI), each a substantial unlabeled image measuring 4402-by-1600 pixels. With the meteorological expertise within our team, we manually labeled pixels by extracting 10 to 20 sample patches from each parent image, each patch consisting of a 50-by-50 pixel field. This process yielded a collection of 444 patches, each categorically labeled into one of seven cloud and sky condition categories. To embed the inherent data structure while classifying individual pixels, we introduced an innovative technique to boost classification accuracy by incorporating patch-specific information into each pixel\u2019s feature vector. The posterior probabilities generated by these classifiers, which capture the unique attributes of each patch, were subsequently concatenated with the pixel\u2019s original spectral data to form an augmented feature vector. We then applied a final classifier to map the augmented vectors to the seven cloud\/sky categories. The results compared favorably to the baseline model devoid of patch-origin embedding, showing that incorporating the spatial context along with the spectral information inherent in hyperspectral images enhances the classification accuracy in hyperspectral cloud classification. The dataset is available on IEEE DataPort.<\/jats:p>","DOI":"10.3390\/rs16173315","type":"journal-article","created":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T07:42:06Z","timestamp":1725608526000},"page":"3315","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Collection of a Hyperspectral Atmospheric Cloud Dataset and Enhancing Pixel Classification through Patch-Origin Embedding"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-8062-1639","authenticated-orcid":false,"given":"Hua","family":"Yan","sequence":"first","affiliation":[{"name":"Department of Computer Science and Computer Information Systems, Auburn University at Montgomery, Montgomery, AL 36117, USA"}]},{"given":"Rachel","family":"Zheng","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Computer Information Systems, Auburn University at Montgomery, Montgomery, AL 36117, USA"}]},{"given":"Shivaji","family":"Mallela","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Computer Information Systems, Auburn University at Montgomery, Montgomery, AL 36117, USA"}]},{"given":"Randy","family":"Russell","sequence":"additional","affiliation":[{"name":"Department of Chemistry, Auburn University at Montgomery, Montgomery, AL 36117, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7153-2061","authenticated-orcid":false,"given":"Olcay","family":"Kursun","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Computer Information Systems, Auburn University at Montgomery, Montgomery, AL 36117, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.eswa.2019.04.006","article-title":"Hyperspectral imagery classification based on semi-supervised 3-D deep neural network and adaptive band selection","volume":"129","author":"Sellami","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lu, B., Dao, P., Lui, J., and He, Y. (2020). Recent Advances of Hyperspectral Imaging Technology and Applications in Agriculture. Remote Sens., 12.","DOI":"10.3390\/rs12162659"},{"key":"ref_3","unstructured":"HySpex (2024, May 31). Understanding Forests from A Hyperspectral Glance. Available online: https:\/\/www.hyspex.com\/use-cases-application-notes\/forestry-management\/."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1080\/05704928.2020.1774381","article-title":"Application of airborne and spaceborne hyperspectral imaging techniques for atmospheric research: Past, present, and future","volume":"56","author":"Calin","year":"2021","journal-title":"Appl. Spectrosc. Rev."},{"key":"ref_5","first-page":"51","article-title":"The role of hyperspectral imaging: A literature review","volume":"9","author":"Mateen","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_6","first-page":"7277","article-title":"Determination of optical and microphysical properties of thin warm clouds using ground based hyper-spectral analysis","volume":"4","author":"Hirsch","year":"2011","journal-title":"Atmos. Meas. Tech. Discuss."},{"key":"ref_7","first-page":"1201","article-title":"Application of ground-based hyperspectral imaging to retrieve ice crystal shape and fields of cirrus optical thickness","volume":"6","author":"Bierwirth","year":"2013","journal-title":"Atmos. Meas. Tech. Discuss."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1175\/1520-0442(2000)013<0264:REOCTV>2.0.CO;2","article-title":"Radiative Effects of Cloud-Type Variations","volume":"13","author":"Chen","year":"2000","journal-title":"J. Clim."},{"key":"ref_9","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_10","unstructured":"Yan, H., Zheng, R., Boehm, B., Shaga, S., Black, D., Parra, L.C., Russell, R., and Kursun, O. CloudPatch-7 Hyperspectral Dataset, IEEE Dataport 2024."},{"key":"ref_11","unstructured":"Resonon (2024, May 31). Overview\u2014Working Principle. Available online: https:\/\/resonon.gitlab.io\/programming-docs\/content\/overview.html."},{"key":"ref_12","unstructured":"Nguyen, B. (2023). Impact of Feature Selection on Segmentation of Hyperspectral Images of Atmospheric Clouds. [Master\u2019s Thesis, Auburn University at Montgomery]."},{"key":"ref_13","unstructured":"Resonon (2024, May 31). Resonon Product, Pika XC2. Available online: https:\/\/resonon.com\/Pika-XC2."},{"key":"ref_14","unstructured":"Government of Canada (2024, July 03). Interactions with the Atmosphere, Available online: https:\/\/natural-resources.canada.ca\/maps-tools-and-publications\/satellite-imagery-elevation-data-and-air-photos\/tutorial-fundamentals-remote-sensing\/introduction\/interactions-the-atmosphere\/14635."},{"key":"ref_15","unstructured":"University of Illinois at Urbana-Champaign (2024, July 03). Scattering of Light. Available online: http:\/\/ww2010.atmos.uiuc.edu\/(Gh)\/guides\/mtr\/opt\/mch\/sct.rxml."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Andrews, L.C. (2019). Field Guide to Atmospheric Optics, SPIE Press. [2nd ed.].","DOI":"10.1117\/3.2318080"},{"key":"ref_17","unstructured":"NOAA (2024, July 03). The Color of Clouds, Available online: https:\/\/www.noaa.gov\/jetstream\/clouds."},{"key":"ref_18","unstructured":"University of Twente (2024, July 03). Atmospheric Scattering. Available online: https:\/\/ltb.itc.utwente.nl\/498\/concept\/81855."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kursun, O., Dinc, S., and Favorov, O.V. (2022, January 5\u20137). Contextually Guided Convolutional Neural Networks for Learning Most Transferable Representations. Proceedings of the 2022 IEEE International Symposium on Multimedia (ISM), Naples, Italy.","DOI":"10.1109\/ISM55400.2022.00047"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kursun, O., Sarsekeyev, B., Hasanzadeh, M., Patooghy, A., and Favorov, O.V. (2023, January 11\u201313). Tactile Sensing with Contextually Guided CNNs: A Semisupervised Approach for Texture Classification. Proceedings of the 2023 Seventh IEEE International Conference on Robotic Computing (IRC), Laguna Hills, CA, USA.","DOI":"10.1109\/IRC59093.2023.00011"},{"key":"ref_21","unstructured":"Russell, R., and Kursun, O. Cloud Radiance HSI Dataset, 2024, IEEE Dataport 2024."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3212","DOI":"10.1109\/TNNLS.2018.2876865","article-title":"Object detection with deep learning: A review","volume":"30","author":"Zhao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Iman, M., Arabnia, H.R., and Rasheed, K. (2023). A review of deep transfer learning and recent advancements. Technologies, 11.","DOI":"10.3390\/technologies11020040"},{"key":"ref_24","unstructured":"Dosovitskiy, A., Springenberg, J.T., Riedmiller, M., and Brox, T. (2014, January 8\u201313). Discriminative unsupervised feature learning with convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_25","first-page":"3133","article-title":"Do We Need Hundreds of Classifiers to Solve Real World Classification Problems?","volume":"15","author":"Cernadas","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_27","unstructured":"Alpaydin, E. (2014). Introduction to Machine Learning, The MIT Press. [3rd ed.]."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"97462","DOI":"10.1109\/ACCESS.2020.2996576","article-title":"An Embedded System for Collection and Real-Time Classification of a Tactile Dataset","volume":"8","author":"Kursun","year":"2020","journal-title":"IEEE Access"},{"key":"ref_29","unstructured":"Scikit-Learn (2024, May 31). Ensembles: Gradient Boosting, Random Forests, Bagging, Voting, Stacking. Available online: https:\/\/scikit-learn.org\/stable\/modules\/ensemble."},{"key":"ref_30","unstructured":"IBM (2024, May 31). What Is Random Forest?. Available online: https:\/\/www.ibm.com\/topics\/random-forest."},{"key":"ref_31","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014, January 8\u201313). How transferable are features in deep neural networks?. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_32","unstructured":"Scikit-Learn Contributors (2024, June 26). sklearn.Metrics.Matthews_Corrcoef. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.matthews_corrcoef.html."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3315\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:49:48Z","timestamp":1760111388000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,6]]},"references-count":32,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["rs16173315"],"URL":"https:\/\/doi.org\/10.3390\/rs16173315","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,9,6]]}}}