{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T09:52:55Z","timestamp":1766137975425,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the publication fund of UiT The Arctic University of Norway","award":["NFR 275503"],"award-info":[{"award-number":["NFR 275503"]}]},{"name":"the Research Council of Norway","award":["NFR 275503"],"award-info":[{"award-number":["NFR 275503"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Optically thin layers of tiny ice particles near the summer mesopause, known as noctilucent clouds, are of significant interest within the aeronomy and climate science communities. Ground-based optical cameras mounted at various locations in the arctic regions collect the dataset during favorable summer times. In this paper, first, we compare the performances of various deep learning-based image classifiers against a baseline machine learning model trained with support vector machine (SVM) algorithm to identify an effective and lightweight model for the classification of noctilucent clouds. The SVM classifier is trained with histogram of oriented gradient (HOG) features, and deep learning models such as SqueezeNet, ShuffleNet, MobileNet, and Resnet are fine-tuned based on the dataset. The dataset includes images observed from different locations in northern Europe with varied weather conditions. Second, we investigate the most informative pixels for the classification decision on test images. The pixel-level attributions calculated using the guide back-propagation algorithm are visualized as saliency maps. Our results indicate that the SqueezeNet model achieves an F1 score of 0.95. In addition, SqueezeNet is the lightest model used in our experiments, and the saliency maps obtained for a set of test images correspond better with relevant regions associated with noctilucent clouds.<\/jats:p>","DOI":"10.3390\/rs14102306","type":"journal-article","created":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T21:52:11Z","timestamp":1652219531000},"page":"2306","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Comparison of Deep Learning Models for the Classification of Noctilucent Cloud Images"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1570-9525","authenticated-orcid":false,"given":"Rajendra","family":"Sapkota","sequence":"first","affiliation":[{"name":"Department of Automation and Process Engineering, UiT The Arctic University of Norway, 9019 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Puneet","family":"Sharma","sequence":"additional","affiliation":[{"name":"Department of Automation and Process Engineering, UiT The Arctic University of Norway, 9019 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2805-3265","authenticated-orcid":false,"given":"Ingrid","family":"Mann","sequence":"additional","affiliation":[{"name":"Department of Physics and Technology, UiT The Arctic University of Norway, 9019 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"F72","DOI":"10.1364\/AO.50.000F72","article-title":"Noctilucent Clouds: Modern Ground-Based Photographic Observations by a Digital Camera Network","volume":"50","author":"Dubietis","year":"2011","journal-title":"Appl. Opt."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jastp.2016.09.004","article-title":"Mid-Latitude Mesospheric Clouds and Their Environment from SOFIE Observations","volume":"149","author":"Hervig","year":"2016","journal-title":"J. Atmos. Solar-Terr. Phys."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/s40645-015-0035-8","article-title":"The Dynamics of the Mesosphere and Lower Thermosphere: A Brief Review","volume":"2","author":"Vincent","year":"2011","journal-title":"Vincent Prog. Earth Planet. Sci."},{"key":"ref_4","first-page":"8440","article-title":"Influence of Planetary Waves on Noctilucent Cloud Occurrence over NW Europe","volume":"108","author":"Kirkwood","year":"2003","journal-title":"J. Geophys. Res"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1038\/338490a0","article-title":"Relation between Increasing Methane and the Presence of Ice Clouds at the Mesopause","volume":"338","author":"Thomas","year":"1989","journal-title":"Nature"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6681","DOI":"10.1029\/2018GL077719","article-title":"On the Anthropogenic Impact on Long-Term Evolution of Noctilucent Clouds","volume":"45","author":"Berger","year":"2018","journal-title":"Geophys. Res. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"AAC 1-1","DOI":"10.1029\/2001JD001345","article-title":"Noctilucent Clouds Getting Brighter","volume":"107","author":"Klostermeyer","year":"2002","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sharma, P., Dalin, P., and Mann, I. (2019). Towards a Framework for Noctilucent Cloud Analysis. Remote Sens., 11.","DOI":"10.20944\/preprints201910.0061.v1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2082","DOI":"10.1016\/j.jastp.2010.06.001","article-title":"Analysis of Gravity Waves Structures Visible in Noctilucent Cloud Images","volume":"73","author":"Pautet","year":"2011","journal-title":"J. Atmos. Sol. Terr. Phys."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1016\/j.jastp.2008.04.018","article-title":"Ground-Based Observations of Noctilucent Clouds with a Northern Hemisphere Network of Automatic Digital Cameras","volume":"70","author":"Dalin","year":"2008","journal-title":"J. Atmos. Solar-Terr. Phys."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"11271","DOI":"10.1002\/2016JA023080","article-title":"First Wind Shear Observation in PMSE with the Tristatic EISCAT VHF Radar","volume":"121","author":"Mann","year":"2016","journal-title":"J. Geophys. Res. Space Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2841","DOI":"10.5194\/angeo-24-2841-2006","article-title":"Comparison of Long-Term Moscow and Danish NLC Observations: Statistical Results","volume":"24","author":"Dalin","year":"2006","journal-title":"Ann. Geophys."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.jastp.2018.01.025","article-title":"Response of Noctilucent Cloud Brightness to Daily Solar Variations","volume":"169","author":"Dalin","year":"2018","journal-title":"J. Atmos. Solar-Terr. Phys."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"341","DOI":"10.3402\/tellusa.v9i3.9106","article-title":"Noctilucent Clouds","volume":"9","author":"Ludlam","year":"1957","journal-title":"Tellus"},{"key":"ref_15","unstructured":"Bengio, Y. (2022, March 27). Convolutional Networks for Images, Speech, and Time-Series. Oracle Performance for Visual Captioning View Project MoDeep View Project. Handbook of Brain Theory Neural Networks. Available online: http:\/\/www.iro.umontreal.ca\/~lisa\/pointeurs\/handbook-convo.pdf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation Applied to Handwritten Zip Code Recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_20","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012, Lake Tahoe, NV, USA, 3\u20136 December 2012, Curran Associates, Inc."},{"key":"ref_21","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015\u2014Conference Track Proceedings, San Diego, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_23","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50\u00d7 fewer parameters and <0.5 MB model size. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., and Lin, M. (2018, January 18\u201323). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_25","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_26","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q.V. (2020, January 13\u201319). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_28","unstructured":"Burkov, A. (2019). The Hundred-Page Machine Learning Book, Andriy Burkov."},{"key":"ref_29","unstructured":"Theodoridis, S., and Koutroumbas, K. (2009). Support Vector Machines. Pattern Recognition, Academic Press."},{"key":"ref_30","first-page":"37","article-title":"Evaluation: From Precision, Recall and F-Score to ROC, Informedness, Markedness & Correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"ref_31","unstructured":"Springenberg, J.T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (2015, January 7\u20139). Striving for Simplicity: The All Convolutional Net. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015\u2014Workshop Track Proceedings, San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.neucom.2018.05.083","article-title":"Deep Visual Domain Adaptation: A Survey","volume":"312","author":"Wang","year":"2018","journal-title":"Neurocomputing"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/10\/2306\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:08:53Z","timestamp":1760137733000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/10\/2306"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":32,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["rs14102306"],"URL":"https:\/\/doi.org\/10.3390\/rs14102306","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,5,10]]}}}