{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:27:26Z","timestamp":1772252846849,"version":"3.50.1"},"reference-count":35,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,4,10]],"date-time":"2019-04-10T00:00:00Z","timestamp":1554854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>We apply deep convolutional neural networks (CNNs) to estimate wave breaking type (e.g., non-breaking, spilling, plunging) from close-range monochrome infrared imagery of the surf zone. Image features are extracted using six popular CNN architectures developed for generic image feature extraction. Logistic regression on these features is then used to classify breaker type. The six CNN-based models are compared without and with augmentation, a process that creates larger training datasets using random image transformations. The simplest model performs optimally, achieving average classification accuracies of 89% and 93%, without and with image augmentation respectively. Without augmentation, average classification accuracies vary substantially with CNN model. With augmentation, sensitivity to model choice is minimized. A class activation analysis reveals the relative importance of image features to a given classification. During its passage, the front face and crest of a spilling breaker are more important than the back face. For a plunging breaker, the crest and back face of the wave are most important, which suggests that CNN-based models utilize the distinctive \u2018streak\u2019 temperature patterns observed on the back face of plunging breakers for classification.<\/jats:p>","DOI":"10.3390\/rs11070859","type":"journal-article","created":{"date-parts":[[2019,4,10]],"date-time":"2019-04-10T03:47:36Z","timestamp":1554868056000},"page":"859","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["A Data-Driven Approach to Classifying Wave Breaking in Infrared Imagery"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6217-5584","authenticated-orcid":false,"given":"Daniel","family":"Buscombe","sequence":"first","affiliation":[{"name":"School of Earth &amp; Sustainability, Northern Arizona University, Flagstaff, AZ 86011, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9682-890X","authenticated-orcid":false,"given":"Roxanne J.","family":"Carini","sequence":"additional","affiliation":[{"name":"Applied Physics Laboratory, University of Washington, Seattle, WA 98105, USA"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.coastaleng.2005.10.009","article-title":"Rip current review","volume":"53","author":"MacMahan","year":"2006","journal-title":"Coast. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ecss.2008.09.022","article-title":"Threats to sandy beach ecosystems: A review","volume":"81","author":"Defeo","year":"2009","journal-title":"Estuar. Coast. Shelf S"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"5925","DOI":"10.1029\/JC088iC10p05925","article-title":"Transformation of wave height distribution","volume":"88","author":"Thornton","year":"1983","journal-title":"J. Geophys. Res. Oceans"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1098\/rspa.1981.0127","article-title":"An experimental investigation of breaking waves produced by a towed hydrofoil","volume":"377","author":"Duncan","year":"1981","journal-title":"Proc. R. Soc. Lond. A"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1146\/annurev.fl.25.010193.002105","article-title":"Wave breaking in deep water","volume":"25","author":"Banner","year":"1993","journal-title":"Annu. Rev. Fluid Mech."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Filipot, J.F., Ardhuin, F., and Babanin, A.V. (2010). A unified deep-to-shallow water wave-breaking probability parameterization. J. Geophys. Res. Oceans, 115.","DOI":"10.1029\/2009JC005448"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1061\/(ASCE)0733-950X(1985)111:2(171)","article-title":"A qualitative description of wave breaking","volume":"111","author":"Basco","year":"1985","journal-title":"J. Waterw. Port Coast."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Iafrati, A. (2011). Energy dissipation mechanisms in wave breaking processes: Spilling and highly aerated plunging breaking events. J. Geophys. Res. Oceans, 116.","DOI":"10.1029\/2011JC007038"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1038\/385052a0","article-title":"Infrared remote sensing of breaking waves","volume":"385","author":"Jessup","year":"1997","journal-title":"Nature"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"23145","DOI":"10.1029\/97JC01449","article-title":"Defining and quantifying microscale wave breaking with infrared imagery","volume":"102","author":"Jessup","year":"1997","journal-title":"J. Geophys. Res. Oceans"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3937","DOI":"10.1002\/2014JC010561","article-title":"Estimating wave energy dissipation in the surf zone using thermal infrared imagery","volume":"120","author":"Carini","year":"2015","journal-title":"J. Geophys. Res. Oceans"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"C07015","DOI":"10.1029\/2006JC003950","article-title":"Infrared measurements of surface renewal and subsurface vortices in nearshore breaking waves","volume":"113","author":"Watanabe","year":"2008","journal-title":"J. Geophys. Res. Oceans"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.coastaleng.2014.12.005","article-title":"Measurements of surface thermal structure, kinematics, and turbulence of a large-scale solitary breaking wave using infrared imaging techniques","volume":"96","author":"Huang","year":"2015","journal-title":"Coast. Eng."},{"key":"ref_14","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1146\/annurev-marine-121211-172408","article-title":"Remote sensing of the nearshore","volume":"5","author":"Holman","year":"2013","journal-title":"Annu. Rev. Mar. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/MPOT.2016.2631018","article-title":"Video-Based Remote Sensing of Surf Zone Conditions","volume":"36","author":"Baldock","year":"2017","journal-title":"IEEE Potentials"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.coastaleng.2019.02.002","article-title":"A novel machine learning algorithm for tracking remotely sensed waves in the surf zone","volume":"147","author":"Stringari","year":"2019","journal-title":"Coast. Eng."},{"key":"ref_18","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_19","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very deep convolutional networks for large-scale image recognition, arXiv."},{"key":"ref_20","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (arXiv, 2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications, arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2017","journal-title":"Pattern Recogn."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Buscombe, D., and Ritchie, A. (2018). Landscape classification with deep neural networks. Geosciences, 8.","DOI":"10.31223\/OSF.IO\/5MX3C"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (arXiv, 2018). MobileNetV2: Inverted Residuals and Linear Bottlenecks, arXiv.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4\u20139). Inception-v4, Inception-ResNet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_30","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (arXiv, 2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems, arXiv."},{"key":"ref_31","unstructured":"Murphy, K. (2012). Machine Learning: A Probabilistic Perspective, MIT Press."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Fu, G., Liu, C., Zhou, R., Sun, T., and Zhang, Q. (2017). Classification for high resolution remote sensing imagery using a fully convolutional network. Remote Sens., 9.","DOI":"10.3390\/rs9050498"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/7\/859\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:44:09Z","timestamp":1760186649000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/7\/859"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,10]]},"references-count":35,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["rs11070859"],"URL":"https:\/\/doi.org\/10.3390\/rs11070859","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201903.0283.v1","asserted-by":"object"}]},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,10]]}}}