{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T12:13:30Z","timestamp":1769170410267,"version":"3.49.0"},"reference-count":43,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2019,6,27]],"date-time":"2019-06-27T00:00:00Z","timestamp":1561593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41831073;41874182"],"award-info":[{"award-number":["41831073;41874182"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Chinese Meridian Project"},{"name":"the Specialized Research Fund for State Key Laboratories"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the development of ground-based all-sky airglow imager (ASAI) technology, a large amount of airglow image data needs to be processed for studying atmospheric gravity waves. We developed a program to automatically extract gravity wave patterns in the ASAI images. The auto-extraction program includes a classification model based on convolutional neural network (CNN) and an object detection model based on faster region-based convolutional neural network (Faster R-CNN). The classification model selects the images of clear nights from all ASAI raw images. The object detection model locates the region of wave patterns. Then, the wave parameters (horizontal wavelength, period, direction, etc.) can be calculated within the region of the wave patterns. Besides auto-extraction, we applied a wavelength check to remove the interference of wavelike mist near the imager. To validate the auto-extraction program, a case study was conducted on the images captured in 2014 at Linqu (36.2\u00b0N, 118.7\u00b0E), China. Compared to the result of the manual check, the auto-extraction recognized less (28.9% of manual result) wave-containing images due to the strict threshold, but the result shows the same seasonal variation as the references. The auto-extraction program applies a uniform criterion to avoid the accidental error in manual distinction of gravity waves and offers a reliable method to process large ASAI images for efficiently studying the climatology of atmospheric gravity waves.<\/jats:p>","DOI":"10.3390\/rs11131516","type":"journal-article","created":{"date-parts":[[2019,6,27]],"date-time":"2019-06-27T07:59:57Z","timestamp":1561622397000},"page":"1516","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Automatic Extraction of Gravity Waves from All-Sky Airglow Image Based on Machine Learning"],"prefix":"10.3390","volume":"11","author":[{"given":"Chang","family":"Lai","sequence":"first","affiliation":[{"name":"School of Science, Chongqing University of Posts and Telecommunications, Chongqing 500000, China"},{"name":"State Key Laboratory of Space Weather, Center for Space Science and Applied Research, Chinese Academy of Sciences, Beijing 110000, China"}]},{"given":"Jiyao","family":"Xu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Space Weather, Center for Space Science and Applied Research, Chinese Academy of Sciences, Beijing 110000, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0577-5289","authenticated-orcid":false,"given":"Jia","family":"Yue","sequence":"additional","affiliation":[{"name":"Atmospheric and Planetary Science, Hampton University, Hampton, VA 23668, USA"}]},{"given":"Wei","family":"Yuan","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Space Weather, Center for Space Science and Applied Research, Chinese Academy of Sciences, Beijing 110000, China"}]},{"given":"Xiao","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Mathematics and Information Science, Henan Normal University, Xinxiang 453007, China"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[{"name":"School of Science, Chongqing University of Posts and Telecommunications, Chongqing 500000, China"}]},{"given":"Qinzeng","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Space Weather, Center for Space Science and Applied Research, Chinese Academy of Sciences, Beijing 110000, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3455","DOI":"10.1029\/JZ072i013p03455","article-title":"Generation of turbulence in the upper atmosphere by internal gravity waves","volume":"72","author":"Hodges","year":"1967","journal-title":"J. Geophys. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"12020","DOI":"10.1002\/2017GL075360","article-title":"Nonlinear gravity wave forcing as a source of acoustic waves in the mesosphere, thermosphere, and ionosphere","volume":"44","author":"Snively","year":"2017","journal-title":"Geophys. Res. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1029\/RG022i003p00275","article-title":"Gravity wave saturation in the middle atmosphere: A review of theory and observation","volume":"22","author":"Fritts","year":"1984","journal-title":"Rev. Geophys."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1029\/2001RG000106","article-title":"Gravity wave dynamics and effects in the middle atmosphere","volume":"41","author":"Fritts","year":"2003","journal-title":"Rev. Geophys."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1029\/2012JD018658","article-title":"A global view of stratospheric gravity wavehostspots located with Atmospheric Infrared Sounder observations","volume":"118","author":"Hoffmann","year":"2013","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2682","DOI":"10.1364\/AO.22.002682","article-title":"OH airglow phenomena during the 5\u20136 July 1982 total lunar eclipse","volume":"22","author":"Peterson","year":"1983","journal-title":"Appl. Opt."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1016\/S0273-1177(97)00161-0","article-title":"A review of advances in imaging techniques for measuring short period gravity waves in the mesosphere and lower thermosphere","volume":"19","author":"Taylor","year":"1997","journal-title":"Adv. Space Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1186\/BF03352703","article-title":"Gravity wave momentum flux in the upper mesosphere derived from OH airglow imaging measurements","volume":"59","author":"Suzuki","year":"2007","journal-title":"Earth Planets Space"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"D06104","DOI":"10.1029\/2008JD011244","article-title":"Concentric gravity waves in the mesosphere generated by deep convective plumes in the lower atmosphere near Fort Collins, Colorado","volume":"114","author":"Yue","year":"2009","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11058","DOI":"10.1002\/2015JD023786","article-title":"Concentric gravity waves over northern China observed by an airglow imager network and satellites","volume":"120","author":"Xu","year":"2015","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.jastp.2010.01.002","article-title":"Variability of gravity wave occurrence frequency and propagation direction in the upper mesosphere observed by the OH imager in Northern Colorado","volume":"72","author":"Dou","year":"2010","journal-title":"J. Atmos. Sol. Terr. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.5194\/angeo-29-1401-2011","article-title":"Statistical characteristics of gravity wave activities observed by an OH airglow imager at Xinglong, in northern China","volume":"29","author":"Li","year":"2011","journal-title":"Ann. Geophys."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1002\/2013JA018955","article-title":"Gravity wave characteristics in the mesopause region revealed from OH airglow imager observations over Northern Colorado","volume":"119","author":"Tang","year":"2014","journal-title":"J. Geophys. Res. Space"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"9204","DOI":"10.1002\/2016JA022823","article-title":"Characteristics of mesospheric gravity waves over the southeastern Tibetan Plateau region: Mesospheric Gravity waves","volume":"121","author":"Li","year":"2016","journal-title":"J. Geophys. Res. Space"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"640","DOI":"10.11728\/cjss2018.05.640","article-title":"Recent Advances in Observation and Research of the Chinese Meridian Project","volume":"38","author":"Wang","year":"2018","journal-title":"Chin. J. Space Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9707","DOI":"10.1002\/2014JD021543","article-title":"New statistical analysis of the horizontal phase velocity distribution of gravity waves observed by airglow imaging","volume":"119","author":"Matsuda","year":"2014","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"8969","DOI":"10.1002\/2016JD026217","article-title":"Characteristics of mesospheric gravity waves over Antarctica observed by Antarctica Gravity Wave Instrument Network imagers using 3-D spectral analyses","volume":"122","author":"Matsuda","year":"2017","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1175\/JTECH-D-18-0092.1","article-title":"Measuring gravity wave parameters from a nighttime satellite low-light image based on two-dimensional Stockwell transform","volume":"36","author":"Hu","year":"2019","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1113\/jphysiol.1959.sp006308","article-title":"Receptive fields of single neurones in the cat\u2019s striate cortex","volume":"148","author":"Hubel","year":"1959","journal-title":"J. Physiol."},{"key":"ref_20","unstructured":"Pfeifer, R., and Schreter, Z. (1989). Generalization and network design strategies. Connectionism in Perspective, Proceedings of the International Conference Connectionism in Perspective, University of Z\u00fcrich, Z\u00fcrich, Switzerland, 10\u201313 October 1988, Elsevier."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_22","first-page":"1106","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5640","DOI":"10.1029\/2018JA025274","article-title":"Automatic classification of auroral images from the Oslo Auroral THEMIS (OATH) data set using machine learning","volume":"123","author":"Clausen","year":"2018","journal-title":"J. Geophys. Res. Space"},{"key":"ref_25","first-page":"265","article-title":"TensorFlow: A system for large-scale machine learning","volume":"16","author":"Abadi","year":"2016","journal-title":"Oper. Syst. Des. Implement."},{"key":"ref_26","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press."},{"key":"ref_27","unstructured":"Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s10479-005-5724-z","article-title":"A tutorial on the cross-entropy method","volume":"134","author":"Kroese","year":"2005","journal-title":"Ann. Oper. Res."},{"key":"ref_29","unstructured":"Bharath, R. (2018, April 11). Data Augmentation|How to Use Deep Learning When You Have Limited Data. Available online: https:\/\/medium.com\/nanonets\/how-to-use-deep-learning-when-you-have-limited-data-part-2-data-augmentation-c26971dc8ced."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, M., Zhang, T., Chen, Y., and Smola, A.J. (2014, January 24\u201327). Efficient mini-batch training for stochastic optimization. Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, New York, NY, USA.","DOI":"10.1145\/2623330.2623612"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_33","unstructured":"Erhan, D., Bengio, Y., Courville, A., and Vincent, P. (2009). Visualizing Higher-Layer Features of a Deep Network, University of Montreal. Technical Report 1341."},{"key":"ref_34","unstructured":"Simonyan, K., Vedaldi, A., and Zisserman, A. (2014). Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., and Guadarrama, S. (2017, January 21\u201326). Speed\/accuracy trade-offs for modern convolutional object detectors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA. Available online: https:\/\/dblp.org\/rec\/conf\/cvpr\/HuangRSZKFFWSG017.","DOI":"10.1109\/CVPR.2017.351"},{"key":"ref_36","first-page":"D09S09","article-title":"Observational investigations of gravity waves momentum flux with spectroscopic imaging","volume":"110","author":"Tang","year":"2005","journal-title":"J. Geophys. Res. Atmo."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1088\/0031-8949\/37\/4\/021","article-title":"Rocket measurements of the altitude distributions of the hydroxyl airglow","volume":"37","author":"Baker","year":"1988","journal-title":"Phys. Scr."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA. Available online: https:\/\/www.onacademic.com\/detail\/journal_1000037205494010_96ad.html.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common objects in context. ECCV 2014, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_40","unstructured":"(2016, November 04). GitHub. Available online: https:\/\/github.com\/tensorflow\/models\/blob\/master\/research\/object_detection\/samples\/configs\/faster_rcnn_resnet101_voc07.config."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"7374","DOI":"10.1364\/AO.36.007374","article-title":"Two-dimensional spectral analysis of mesospheric airglow image data","volume":"36","author":"Garcia","year":"1997","journal-title":"Appl. Opt."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1029\/1999GL010738","article-title":"Dispersion imposed limits on atmospheric gravity waves in the mesosphere: Observations from OH airglow","volume":"27","author":"Swenson","year":"2000","journal-title":"Geophys. Res. Lett."},{"key":"ref_43","first-page":"1566","article-title":"Gravity wave characteristics from multi-stations observation with OH all-sky airglow imagers over mid-latitude regions of China","volume":"59","author":"Wang","year":"2016","journal-title":"Chin. J. Geophys."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/13\/1516\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:01:36Z","timestamp":1760187696000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/13\/1516"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,27]]},"references-count":43,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["rs11131516"],"URL":"https:\/\/doi.org\/10.3390\/rs11131516","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,27]]}}}