{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T14:51:54Z","timestamp":1784213514971,"version":"3.55.0"},"reference-count":51,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,20]],"date-time":"2022-07-20T00:00:00Z","timestamp":1658275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100016152","name":"Yayasan Universiti Teknologi PETRONAS","doi-asserted-by":"publisher","award":["YUTP-FRG-2019"],"award-info":[{"award-number":["YUTP-FRG-2019"]}],"id":[{"id":"10.13039\/501100016152","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100016152","name":"Yayasan Universiti Teknologi PETRONAS","doi-asserted-by":"publisher","award":["015LC0-158"],"award-info":[{"award-number":["015LC0-158"]}],"id":[{"id":"10.13039\/501100016152","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Wind-waves exhibit variations both in shape and steepness, and their asymmetrical nature is a well-known feature. One of the important characteristics of the sea surface is the front-back asymmetry of wind-wave crests. The wind-wave conditions on the surface of the sea constitute a sea state, which is listed as an essential climate variable by the Global Climate Observing System and is considered a critical factor for structural safety and optimal operations of offshore oil and gas platforms. Methods such as statistical representations of sensor-based wave parameters observations and numerical modeling are used to classify sea states. However, for offshore structures such as oil and gas platforms, these methods induce high capital expenditures (CAPEX) and operating expenses (OPEX), along with extensive computational power and time requirements. To address this issue, in this paper, we propose a novel, low-cost deep learning-based sea state classification model using visual-range sea images. Firstly, a novel visual-range sea state image dataset was designed and developed for this purpose. The dataset consists of 100,800 images covering four sea states. The dataset was then benchmarked on state-of-the-art deep learning image classification models. The highest classification accuracy of 81.8% was yielded by NASNet-Mobile. Secondly, a novel sea state classification model was proposed. The model took design inspiration from GoogLeNet, which was identified as the optimal reference model for sea state classification. Systematic changes in GoogLeNet\u2019s inception block were proposed, which resulted in an 8.5% overall classification accuracy improvement in comparison with NASNet-Mobile and a 7% improvement from the reference model (i.e., GoogLeNet). Additionally, the proposed model took 26% less training time, and its per-image classification time remains competitive.<\/jats:p>","DOI":"10.3390\/sym14071487","type":"journal-article","created":{"date-parts":[[2022,7,21]],"date-time":"2022-07-21T03:34:40Z","timestamp":1658374480000},"page":"1487","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Novel Deep Learning Model for Sea State Classification Using Visual-Range Sea Images"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6061-099X","authenticated-orcid":false,"given":"Muhammad","family":"Umair","sequence":"first","affiliation":[{"name":"Department of Computer and Information Sciences, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia"},{"name":"High Performance Cloud Computing Center, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6617-8149","authenticated-orcid":false,"given":"Manzoor Ahmed","family":"Hashmani","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Sciences, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia"},{"name":"High Performance Cloud Computing Center, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5677-9709","authenticated-orcid":false,"given":"Syed Sajjad","family":"Hussain Rizvi","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Shaheed Zulfiqar Ali Bhutto Institute of Science and Technology, Karachi 75600, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hasmi","family":"Taib","sequence":"additional","affiliation":[{"name":"Group Technical Solutions, PETRONAS, Kuala Lumpur 50450, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohd Nasir","family":"Abdullah","sequence":"additional","affiliation":[{"name":"Group Technical Solutions, PETRONAS, Kuala Lumpur 50450, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3921-0104","authenticated-orcid":false,"given":"Mehak Maqbool","family":"Memon","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Sciences, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia"},{"name":"High Performance Cloud Computing Center, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Perak, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,20]]},"reference":[{"key":"ref_1","unstructured":"Asariotis, R., Assaf, M., Benamara, H., Hoffmann, J., Premti, A., Rodr\u00edguez, L., Weller, M., and Youssef, F. (2018). Review of Maritime Transport 2018, United Nations Publications."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1093\/tas\/txz012","article-title":"Aquaculture Role in Global Food Security with Nutritional Value: A Review","volume":"3","author":"Pradeepkiran","year":"2019","journal-title":"Transl. Anim. Sci."},{"key":"ref_3","unstructured":"Legorburu, I., Johnson, K., and Kerr, S. (2018). Offshore Oil and Gas, Rivers Publishers. [1st ed.]."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1007\/s11625-020-00796-9","article-title":"Problematic Blue Growth: A Thematic Synthesis of Social Sustainability Problems Related to Growth in the Marine and Coastal Tourism","volume":"15","author":"Leposa","year":"2020","journal-title":"Sustain. Sci."},{"key":"ref_5","unstructured":"Laing, A.K., Gemmill, W., Magnusson, A.K., Burroughs, L., Reistad, M., Khandekar, M., Holthuijsen, L., Ewing, J.A., and Carter, D.J.T. (1998). Guide to Wave Analysis and Forecasting, World Meteorological Organization. [2nd ed.]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"280","DOI":"10.5194\/npg-2-280-1995","article-title":"Asymmetry of Wind Waves Studied in a Laboratory Tank","volume":"2","author":"Leykin","year":"1995","journal-title":"Nonlinear Process. Geophys."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Dosaev, A., Troitskaya, Y.I., and Shrira, V.I. (2021). On the Physical Mechanism of Front\u2013Back Asymmetry of Non-Breaking Gravity\u2013Capillary Waves. J. Fluid Mech., 906.","DOI":"10.1017\/jfm.2020.696"},{"key":"ref_8","first-page":"1727","article-title":"Automatic Sea State Calculator","volume":"3","author":"White","year":"2000","journal-title":"Ocean. Conf. Rec."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1929","DOI":"10.5194\/essd-12-1929-2020","article-title":"The Sea State CCI Dataset v1: Towards a Sea State Climate Data Record Based on Satellite Observations","volume":"12","author":"Dodet","year":"2020","journal-title":"Earth Syst. Sci. Data"},{"key":"ref_10","first-page":"549","article-title":"Time Domain and Frequency Domain Analyses of Measured Metocean Data for Malaysian Waters","volume":"7","author":"Vannak","year":"2013","journal-title":"Int. J. Geol. Environ. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Umair, M., Hashmani, M.A., and Hasan, M.H.B. (2019, January 19). Survey of Sea Wave Parameters Classification and Prediction Using Machine Learning Models. Proceedings of the 2019 1st International Conference on Artificial Intelligence and Data Sciences (AiDAS), Ipoh, Malaysia.","DOI":"10.1109\/AiDAS47888.2019.8970706"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.aqpro.2015.02.059","article-title":"Numerical Wave Modelling\u2014A Review","volume":"4","author":"Thomas","year":"2015","journal-title":"Aquat. Procedia"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"205003","DOI":"10.1088\/1361-6560\/aba410","article-title":"Automatic Multi-Needle Localization in Ultrasound Images Using Large Margin Mask RCNN for Ultrasound-Guided Prostate Brachytherapy","volume":"65","author":"Zhang","year":"2020","journal-title":"Phys. Med. Biol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.ascom.2018.09.004","article-title":"Galaxy Detection and Identification Using Deep Learning and Data Augmentation","volume":"25","year":"2018","journal-title":"Astron. Comput."},{"key":"ref_15","unstructured":"Zhang, Y., An, R., Liu, S., Cui, J., and Shang, X. (2021). Predicting and Understanding Student Learning Performance Using Multi-Source Sparse Attention Convolutional Neural Networks. IEEE Trans. Big Data, 1\u201314."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"32767","DOI":"10.1109\/ACCESS.2020.2973856","article-title":"Visual Recognition Based on Deep Learning for Navigation Mark Classification","volume":"8","author":"Pan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"107871","DOI":"10.1016\/j.compeleceng.2022.107871","article-title":"Intelligent Deep Learning-Enabled Autonomous Small Ship Detection and Classification Model","volume":"100","author":"Gamarra","year":"2022","journal-title":"Comput. Electr. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1002\/wea.153","article-title":"The Beaufort Scale of Winds - Its Relevance, and Its Use by Sailors","volume":"63","author":"Singleton","year":"2008","journal-title":"Weather"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41597-020-00601-3","article-title":"A Global Sea State Dataset from Spaceborne Synthetic Aperture Radar Wave Mode Data","volume":"7","author":"Li","year":"2020","journal-title":"Sci. Data"},{"key":"ref_20","first-page":"3513","article-title":"Estimating Pixel to Metre Scale and Sea State from Remote Observations of the Ocean Surface","volume":"2018","author":"Loizou","year":"2018","journal-title":"Int. Geosci. Remote Sens. Symp."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Cheng, X., Li, G., Skulstad, R., Chen, S., Hildre, H.P., and Zhang, H. (2019, January 20\u201324). Modeling and Analysis of Motion Data from Dynamically Positioned Vessels for Sea State Estimation. Proceedings of the IEEE International Conference on Robotics and Automation, Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794069"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1080\/14498596.2019.1601137","article-title":"Ocean Wave Height Inversion under Low Sea State from Horizontal Polarized X-Band Nautical Radar Images","volume":"66","author":"Wang","year":"2021","journal-title":"J. Spat. Sci."},{"key":"ref_23","unstructured":"Ampilova, N., Soloviev, I., Kotopoulis, A., Pouraimis, G., and Frangos, P. (2019, January 2\u20133). On the Application of Multifractal Methods for the Analysis of Sea Surface Images Related to Sea State Determination. Proceedings of the 14th International Conference onCommunications, Electromagnetics and Medical Applications, Florence, Italy."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Almar, R., Bergsma, E.W.J., Catalan, P.A., Cienfuegos, R., Suarez, L., Lucero, F., Lerma, A.N., Desmazes, F., Perugini, E., and Palmsten, M.L. (2021). Sea State from Single Optical Images: A Methodology to Derive Wind-Generated Ocean Waves from Cameras, Drones and Satellites. Remote Sens., 13.","DOI":"10.3390\/rs13040679"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rikka, S., Pleskachevsky, A., Uiboupin, R., and Jacobsen, S. (2017, January 23\u201328). Sea State Parameters in Highly Variable Environment of Baltic Sea from Satellite Radar Images. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127621"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Umair, M., and Hashmani, M.A. (2021, January 1\u20132). Towards Development of Visual-Range Sea State Image Dataset for Deep Learning Models. Proceedings of the 2021 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA), Bandung, Indonesia.","DOI":"10.1109\/ICICyTA53712.2021.9689093"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.oceaneng.2017.08.047","article-title":"Sea State Identification Based on Vessel Motion Response Learning via Multi-Layer Classifiers","volume":"147","author":"Tu","year":"2018","journal-title":"Ocean Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cheng, X., Li, G., Skulstad, R., Zhang, H., and Chen, S. (2020, January 18\u201321). SpectralSeaNet: Spectrogram and Convolutional Network-Based Sea State Estimation. Proceedings of the IECON 2020 the 46th Annual Conference of the IEEE Industrial Electronics Society, Singapore.","DOI":"10.1109\/IECON43393.2020.9254890"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, N., Jiang, X., Ding, H., Xu, Y., and Guan, J. (2021, January 14\u201317). Wave Height Inversion and Sea State Classification Based on Deep Learning of Radar Sea Clutter Data. Proceedings of the 10th International Conference on Control, Automation and Information Sciences, ICCAIS 2021, Xi\u2019an, China.","DOI":"10.1109\/ICCAIS52680.2021.9624529"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Johnson, J.M., and Khoshgoftaar, T.M. (2019). Survey on Deep Learning with Class Imbalance. J. Big Data, 6.","DOI":"10.1186\/s40537-019-0192-5"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, K., Yu, Z., and Qu, L. (2021, January 23\u201325). Application of Deep Learning in Sea States Images Classification. Proceedings of the 2021 7th Annual International Conference on Network and Information Systems for Computers, Guiyang, China.","DOI":"10.1109\/ICNISC54316.2021.00183"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Schwartz, M. (1984). Douglas Scale; Peterson Scale; Sea StateSea Conditions. Beaches and Coastal Geology, Springer.","DOI":"10.1007\/0-387-30843-1"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Patino, L., Cane, T., Vallee, A., and Ferryman, J. (2016, January 26\u20131). PETS 2016: Dataset and Challenge. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Las Vegas, NV, USA.","DOI":"10.1109\/CVPRW.2016.157"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hashmani, M.A., and Umair, M. (2022). A Novel Visual-Range Sea Image Dataset for Sea Horizon Line Detection in Changing Maritime Scenes. J. Mar. Sci. Eng., 10.","DOI":"10.3390\/jmse10020193"},{"key":"ref_35","first-page":"35","article-title":"Wind Sea and Swell Characteristics off East Coast of India during Southwest Monsoon","volume":"4","author":"Suresh","year":"2010","journal-title":"Int. J. Ocean. Oceanogr."},{"key":"ref_36","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet Classification with Deep Convolutional Neural Networks. Adv. Neural Inf. Process. Syst., 25."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Li, F.-F. (2009, January 20\u201325). Imagenet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1038\/s41598-018-38343-3","article-title":"DeepWeeds: A Multiclass Weed Species Image Dataset for Deep Learning","volume":"9","author":"Olsen","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A Survey on Image Data Augmentation for Deep Learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"125","DOI":"10.3390\/info11020125","article-title":"Albumentations: Fast and Flexible Image Augmentations","volume":"11","author":"Buslaev","year":"2020","journal-title":"Information"},{"key":"ref_41","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_44","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18\u201323). Learning Transferable Architectures for Scalable Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00907"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201323). Shufflenet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_50","unstructured":"Tan, M., and Le, Q.V. (2019, January 9\u201315). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/978-3-319-54184-6_12","article-title":"Analysis on the Dropout Effect in Convolutional Neural Networks","volume":"Volume 10112","author":"Park","year":"2017","journal-title":"Lecture Notes in Computer Science (LNCS)"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/7\/1487\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:54:48Z","timestamp":1760140488000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/7\/1487"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,20]]},"references-count":51,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["sym14071487"],"URL":"https:\/\/doi.org\/10.3390\/sym14071487","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,20]]}}}