{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:44:52Z","timestamp":1760060692811,"version":"build-2065373602"},"reference-count":86,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T00:00:00Z","timestamp":1758153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012190","name":"Ministry of Science and Higher Education of the Russian Federation","doi-asserted-by":"publisher","award":["075-15-2024-544"],"award-info":[{"award-number":["075-15-2024-544"]}],"id":[{"id":"10.13039\/501100012190","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>The paper presents a novel probability-informed approach to improving the accuracy of small object semantic segmentation in high-resolution imagery datasets with imbalanced classes and a limited volume of samples. Small objects imply having a small pixel footprint on the input image, for example, ships in the ocean. Informing in this context means using mathematical models to represent data in the layers of deep neural networks. Thus, the ensemble Quadtree-informed Graph Self-Attention Networks (QiGSANs) are proposed. New architectural blocks, informed by types of Markov random fields such as quadtrees, have been introduced to capture the interconnections between features in images at different spatial resolutions during the graph convolution of superpixel subregions. It has been analytically proven that quadtree-informed graph convolutional neural networks, a part of QiGSAN, tend to achieve faster loss reduction compared to convolutional architectures. This justifies the effectiveness of probability-informed modifications based on quadtrees. To empirically demonstrate the processing of real small data with imbalanced object classes using QiGSAN, two open datasets of synthetic aperture radar (SAR) imagery (up to 0.5 m per pixel) are used: the High Resolution SAR Images Dataset (HRSID) and the SAR Ship Detection Dataset (SSDD). The results of QiGSAN are compared to those of the transformers SegFormer and LWGANet, which constitute a new state-of-the-art model for UAV (Unmanned Aerial Vehicles) and SAR image processing. They are also compared to convolutional neural networks and several ensemble implementations using other graph neural networks. QiGSAN significantly increases the F1-score values by up to 63.93%, 48.57%, and 9.84% compared to transformers, convolutional neural networks, and other ensemble architectures, respectively. QiGSAN outperformed the base segmentors with the mIOU (mean intersection-over-union) metric too: the highest increase was 35.79%. Therefore, our approach to knowledge extraction using mathematical models allows us to significantly improve modern computer vision techniques for imbalanced data.<\/jats:p>","DOI":"10.3390\/bdcc9090239","type":"journal-article","created":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T12:24:25Z","timestamp":1758198265000},"page":"239","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["QiGSAN: A Novel Probability-Informed Approach for Small Object Segmentation in the Case of Limited Image Datasets"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8129-8985","authenticated-orcid":false,"given":"Andrey","family":"Gorshenin","sequence":"first","affiliation":[{"name":"Federal Research Center \u201cComputer Science and Control\u201d of the Russian Academy of Sciences, 119333 Moscow, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9420-4182","authenticated-orcid":false,"given":"Anastasia","family":"Dostovalova","sequence":"additional","affiliation":[{"name":"Federal Research Center \u201cComputer Science and Control\u201d of the Russian Academy of Sciences, 119333 Moscow, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2025,9,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102226","DOI":"10.1016\/j.jksuci.2024.102226","article-title":"Real-time semantic segmentation for autonomous driving: A review of CNNs, Transformers, and Beyond","volume":"36","author":"Elhassan","year":"2024","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_2","first-page":"475","article-title":"Navigation algorithm based on semantic segmentation in wheat fields using an RGB-D camera","volume":"10","author":"Song","year":"2023","journal-title":"Inf. Process. Agric."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"129110","DOI":"10.1016\/j.neucom.2024.129110","article-title":"Agricultural surface water extraction in environmental remote sensing: A novel semantic segmentation model emphasizing contextual information enhancement and foreground detail attention","volume":"617","author":"Lei","year":"2025","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kampffmeyer, M., Salberg, A.B., and Jenssen, R. (July, January 26). Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, NV, USA.","DOI":"10.1109\/CVPRW.2016.90"},{"key":"ref_5","first-page":"200505","article-title":"Deep learning for efficient high-resolution image processing: A systematic review","volume":"26","author":"Dede","year":"2025","journal-title":"Intell. Syst. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chen, P., Liu, Y., Ren, Y., Zhang, B., and Zhao, Y. (2025). A Deep Learning-Based Solution to the Class Imbalance Problem in High-Resolution Land Cover Classification. Remote Sens., 17.","DOI":"10.3390\/rs17111845"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"116988","DOI":"10.1016\/j.engstruct.2023.116988","article-title":"Crack segmentation of imbalanced data: The role of loss functions","volume":"297","author":"Nguyen","year":"2023","journal-title":"Eng. Struct."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Genc, A., Kovarik, L., and Fraser, H.L. (2022). A deep learning approach for semantic segmentation of unbalanced data in electron tomography of catalytic materials. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-16429-3"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.neucom.2021.07.055","article-title":"Dual Focal Loss to address class imbalance in semantic segmentation","volume":"462","author":"Hossain","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_10","unstructured":"Yang, X.S., Sherratt, S., Dey, N., and Joshi, A. (2024, January 19\u201322). Addressing Class Imbalance Problem in Semantic Segmentation Using Binary Focal Loss. Proceedings of the Ninth International Congress on Information and Communication Technology, London, UK."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"111966","DOI":"10.1016\/j.knosys.2024.111966","article-title":"A new optimization approach based on neural architecture search to enhance deep U-Net for efficient road segmentation","volume":"296","author":"Saeedizadeh","year":"2024","journal-title":"Knowl.-Based Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"129855","DOI":"10.1016\/j.neucom.2025.129855","article-title":"GSNet: A new small object attention based deep classifier for presence of gun in complex scenes","volume":"635","author":"Debnath","year":"2025","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3071","DOI":"10.1109\/TNNLS.2023.3338732","article-title":"SOSNet: Real-Time Small Object Segmentation via Hierarchical Decoding and Example Mining","volume":"36","author":"Liu","year":"2025","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6289","DOI":"10.1109\/TPAMI.2022.3211171","article-title":"Small-Object Sensitive Segmentation Using Across Feature Map Attention","volume":"45","author":"Sang","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"113003","DOI":"10.1016\/j.knosys.2025.113003","article-title":"A multi-scale semantically enriched feature pyramid network with enhanced focal loss for small-object detection","volume":"310","author":"Kiobya","year":"2025","journal-title":"Knowl.-Based Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"110281","DOI":"10.1016\/j.knosys.2023.110281","article-title":"Deep collaborative learning with class-rebalancing for semi-supervised change detection in SAR images","volume":"264","author":"Hou","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"111218","DOI":"10.1016\/j.patcog.2024.111218","article-title":"Cross-level interaction fusion network-based RGB-T semantic segmentation for distant targets","volume":"161","author":"Chen","year":"2025","journal-title":"Pattern Recognit."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106367","DOI":"10.1016\/j.neunet.2024.106367","article-title":"Segmenting medical images with limited data","volume":"177","author":"Liu","year":"2024","journal-title":"Neural Netw."},{"key":"ref_19","first-page":"4012505","article-title":"SAR Image Classification Using Contrastive Learning and Pseudo-Labels with Limited Data","volume":"19","author":"Wang","year":"2022","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/j.isprsjprs.2023.09.014","article-title":"Crucial feature capture and discrimination for limited training data SAR ATR","volume":"204","author":"Wang","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Dong, Y., Li, F., Hong, W., Zhou, X., and Ren, H. (2021, January 22\u201324). Land cover semantic segmentation of Port Area with High Resolution SAR Images Based on SegNet. Proceedings of the 2021 SAR in Big Data Era (BIGSARDATA), Nanjing, China.","DOI":"10.1109\/BIGSARDATA53212.2021.9574376"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wang, Z., Wang, R., Zhang, S., and Zhang, Y. (2024, January 12\u201314). Limited Data-Driven Multi-Task Deep Learning Approach for Target Classification in SAR Imagery. Proceedings of the 2024 5th International Conference on Geology, Mapping and Remote Sensing (ICGMRS), Wuhan, China.","DOI":"10.1109\/ICGMRS62107.2024.10581132"},{"key":"ref_23","unstructured":"Lyu, J., Zhou, K., and Zhong, Y. (2025). A statistical theory of overfitting for imbalanced classification. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1109\/TMI.2020.3046692","article-title":"Analyzing Overfitting Under Class Imbalance in Neural Networks for Image Segmentation","volume":"40","author":"Li","year":"2021","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"110433","DOI":"10.1016\/j.comnet.2024.110433","article-title":"Mobile network traffic analysis based on probability-informed machine learning approach","volume":"247","author":"Gorshenin","year":"2024","journal-title":"Comput. Netw."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1038\/s42254-021-00314-5","article-title":"Physics-Informed Machine Learning","volume":"3","author":"Karniadakis","year":"2021","journal-title":"Nat. Rev. Phys."},{"key":"ref_27","first-page":"77","article-title":"Neural Quadtree and its Applications for SAR Imagery Segmentations","volume":"18","author":"Dostovalova","year":"2024","journal-title":"Inform. Primen."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"8285","DOI":"10.1007\/s00521-025-10997-x","article-title":"Small sample learning based on probability-informed neural networks for SAR image segmentation","volume":"37","author":"Dostovalova","year":"2025","journal-title":"Neural Comput. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"5407116","DOI":"10.1109\/TGRS.2022.3141996","article-title":"Semantic Segmentation of Remote-Sensing Images Through Fully Convolutional Neural Networks and Hierarchical Probabilistic Graphical Models","volume":"60","author":"Pastorino","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Schmitt, M., Ahmadi, S., and Hansch, R. (2021, January 12\u201316). There is No Data Like More Data - Current Status of Machine Learning Datasets in Remote Sensing. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2021), Brussels, Belgium.","DOI":"10.1109\/IGARSS47720.2021.9555129"},{"key":"ref_31","first-page":"1833507","article-title":"A Review on Machine Learning Strategies for Real-World Engineering Applications","volume":"2022","author":"Jhaveri","year":"2022","journal-title":"Mob. Inf. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bae, J.H., Yu, G.H., Lee, J.H., Vu, D.T., Anh, L.H., Kim, H.G., and Kim, J.Y. (2022). Superpixel Image Classification with Graph Convolutional Neural Networks Based on Learnable Positional Embedding. Appl. Sci., 12.","DOI":"10.3390\/app12189176"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"120234","DOI":"10.1109\/ACCESS.2020.3005861","article-title":"HRSID: A High-Resolution SAR Images Dataset for Ship Detection and Instance Segmentation","volume":"8","author":"Wei","year":"2020","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, T., Zhang, X., Li, J., Xu, X., Wang, B., Zhan, X., Xu, Y., Ke, X., Zeng, T., and Su, H. (2021). SAR Ship Detection Dataset (SSDD): Official Release and Comprehensive Data Analysis. Remote Sens., 13.","DOI":"10.3390\/rs13183690"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Spasev, V., Dimitrovski, I., Chorbev, I., and Kitanovski, I. (2024, January 26\u201328). Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images Using SegFormer. Proceedings of the Intelligent Systems and Pattern Recognition. Communications in Computer and Information Science, Istanbul, Turkey.","DOI":"10.1007\/978-3-031-82156-1_9"},{"key":"ref_36","unstructured":"Lu, W., Chen, S.B., Ding, C.H.Q., Tang, J., and Luo, B. (2025). LWGANet: A Lightweight Group Attention Backbone for Remote Sensing Visual Tasks. arXiv."},{"key":"ref_37","unstructured":"Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). Enet: A deep neural network architecture for real-time semantic segmentation. arXiv."},{"key":"ref_38","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017, January 21\u201326). Rethinking Atrous Convolution for Semantic Image Segmentation. Proceedings of the 2017 Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"104884","DOI":"10.1016\/j.imavis.2023.104884","article-title":"Research on efficient detection network method for remote sensing images based on self attention mechanism","volume":"142","author":"Li","year":"2024","journal-title":"Image Vis. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Brigato, L., and Iocchi, L. (2021, January 10\u201315). A Close Look at Deep Learning with Small Data. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Virtual.","DOI":"10.1109\/ICPR48806.2021.9412492"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Huang, Z., Pan, Z., and Lei, B. (2017). Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data. Remote Sens., 9.","DOI":"10.3390\/rs9090907"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Jiang, X., Li, Z., and Liu, X. (October, January 26). SAR Target Classification with Limited Data via Data Driven Active Learning. Proceedings of the IGARSS 2020\u20132020 IEEE International Geoscience and Remote Sensing Symposium, Virtual.","DOI":"10.1109\/IGARSS39084.2020.9324364"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yu, J., Zhou, G., Zhou, S., and Yin, J. (2021). A Lightweight Fully Convolutional Neural Network for SAR Automatic Target Recognition. Remote Sens., 13.","DOI":"10.3390\/rs13153029"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1016\/j.procs.2022.10.028","article-title":"Explorations of Contrastive Learning in the Field of Small Sample SAR ATR","volume":"208","author":"Wang","year":"2022","journal-title":"Procedia Comput. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2254473","DOI":"10.1080\/22797254.2023.2254473","article-title":"Let the loss impartial: A hierarchical unbiased loss for small object segmentation in high-resolution remote sensing images","volume":"56","author":"Chong","year":"2023","journal-title":"Eur. J. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"107960","DOI":"10.1016\/j.engappai.2024.107960","article-title":"Pos-DANet: A dual-branch awareness network for small object segmentation within high-resolution remote sensing images","volume":"133","author":"Chong","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_47","first-page":"1","article-title":"Graph Neural Networks in Recommender Systems: A Survey","volume":"55","author":"Wu","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Vrahatis, A.G., Lazaros, K., and Kotsiantis, S. (2024). Graph Attention Networks: A Comprehensive Review of Methods and Applications. Future Internet, 16.","DOI":"10.3390\/fi16090318"},{"key":"ref_49","unstructured":"Tanis, J.H., Giannella, C., and Mariano, A.V. (2024). Introduction to Graph Neural Networks: A Starting Point for Machine Learning Engineers. arXiv."},{"key":"ref_50","first-page":"1025","article-title":"Inductive representation learning on large graphs","volume":"30","author":"Hamilton","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"110537","DOI":"10.1016\/j.patcog.2024.110537","article-title":"Self-attention empowered graph convolutional network for structure learning and node embedding","volume":"153","author":"Jiang","year":"2024","journal-title":"Pattern Recognit."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"2200164","DOI":"10.1002\/advs.202200164","article-title":"Formula Graph Self-Attention Network for Representation-Domain Independent Materials Discovery","volume":"9","author":"Ihalage","year":"2022","journal-title":"Adv. Sci."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Peng, Y., Xia, J., Liu, D., Liu, M., Xiao, L., and Shi, B. (2025). Unifying topological structure and self-attention mechanism for node classification in directed networks. Sci. Rep., 15.","DOI":"10.1038\/s41598-024-84816-z"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Ronen, T., Levy, O., and Golbert, A. (2023, January 17\u201324). Vision Transformers with Mixed-Resolution Tokenization. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada.","DOI":"10.1109\/CVPRW59228.2023.00486"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Ke, L., Danelljan, M., Li, X., Tai, Y.W., Tang, C.K., and Yu, F. (2022, January 18\u201324). Mask Transfiner for High-Quality Instance Segmentation. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00437"},{"key":"ref_56","unstructured":"Tang, S., Zhang, J., Zhu, S., and Tan, P. (2022, January 25\u201329). Quadtree Attention for Vision Transformers. Proceedings of the International Conference on Learning Representations, Virtual."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Chitta, K., \u00c1lvarez, J.M., and Hebert, M. (2019, January 1\u20135). Quadtree Generating Networks: Efficient Hierarchical Scene Parsing with Sparse Convolutions. Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093449"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"100096","DOI":"10.1016\/j.jnlest.2021.100096","article-title":"Image classification with superpixels and feature fusion method","volume":"19","author":"Yang","year":"2021","journal-title":"J. Electron. Sci. Technol."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Zi, W., Xiong, W., Chen, H., Li, J., and Jing, N. (2021). SGA-Net: Self-Constructing Graph Attention Neural Network for Semantic Segmentation of Remote Sensing Images. Remote Sens., 13.","DOI":"10.3390\/rs13214201"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1091","DOI":"10.1613\/jair.1.15698","article-title":"DIGCN: A Dynamic Interaction Graph Convolutional Network Based on Learnable Proposals for Object Detection","volume":"79","author":"Cao","year":"2024","journal-title":"J. Artif. Intell. Res."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Liu, X., Li, Y., Liu, X., and Zou, H. (2022). Dark Spot Detection from SAR Images Based on Superpixel Deeper Graph Convolutional Network. Remote Sens., 14.","DOI":"10.3390\/rs14215618"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Gorshenin, A., and Kuzmin, V. (2022). Statistical Feature Construction for Forecasting Accuracy Increase and Its Applications in Neural Network Based Analysis. Mathematics, 10.","DOI":"10.3390\/math10040589"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1134\/S1054661822040058","article-title":"Finite Normal Mixture Models for the Ensemble Learning of Recurrent Neural Networks with Applications to Currency Pairs","volume":"32","author":"Gorshenin","year":"2022","journal-title":"Pattern Recognit. Image Anal."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"1955","DOI":"10.3390\/ai5040097","article-title":"Machine Learning Models Informed by Connected Mixture Components for Short- and Medium-Term Time Series Forecasting","volume":"5","author":"Gorshenin","year":"2024","journal-title":"AI"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1007\/s10462-023-10698-8","article-title":"A review of predictive uncertainty estimation with machine learning","volume":"57","author":"Tyralis","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref_66","first-page":"358","article-title":"A Generalizable Physics-informed Learning Framework for Risk Probability Estimation","volume":"Volume 211","author":"Matni","year":"2023","journal-title":"Proceedings of the 5th Annual Learning for Dynamics and Control Conference"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"113561","DOI":"10.1016\/j.jcp.2024.113561","article-title":"Annealed adaptive importance sampling method in PINNs for solving high dimensional partial differential equations","volume":"521","author":"Zhang","year":"2025","journal-title":"J. Comput. Phys."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2020.01.109","article-title":"A spiking neural network with probability information transmission","volume":"408","author":"Zuo","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1134\/S2070048212010048","article-title":"The evolution of probability characteristics of low-frequency plasma turbulence","volume":"4","author":"Batanov","year":"2012","journal-title":"Math. Model. Comput. Simulations"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"075006","DOI":"10.1088\/1361-6587\/ab1117","article-title":"Evolution of statistical properties of microturbulence during transient process under electron cyclotron resonance heating of the L-2M stellarator plasma","volume":"61","author":"Batanov","year":"2019","journal-title":"Plasma Phys. Control. Fusion"},{"key":"ref_71","first-page":"72","article-title":"Concept of online service for stochastic modeling of real processes","volume":"10","author":"Gorshenin","year":"2016","journal-title":"Inform. Primen."},{"key":"ref_72","unstructured":"Hendrycks, D., and Gimpel, K. (2023). Gaussian Error Linear Units GELUs. arXiv."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Kang, J., Liu, R., Li, Y., Liu, Q., Wang, P., Zhang, Q., and Zhou, D. (2022, January 26\u201328). An Improved 3D Human Pose Estimation Model Based on Temporal Convolution with Gaussian Error Linear Units. Proceedings of the International Conference on Virtual Rehabilitation, ICVR, Nanjing, China.","DOI":"10.1109\/ICVR55215.2022.9848068"},{"key":"ref_74","first-page":"463","article-title":"Nonlinear Dynamic Weight-Salp Swarm Algorithm and Long Short-Term Memory with Gaussian Error Linear Units for Network Intrusion Detection System","volume":"17","author":"Satyanarayana","year":"2024","journal-title":"Int. J. Intell. Eng. Syst."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1134\/S0001433823120071","article-title":"Using a Model of a Spatial-Hierarchical Quadtree with Truncated Branches to Improve the Accuracy of Image Classification","volume":"59","author":"Dostovalova","year":"2023","journal-title":"Izv. Atmos. Ocean. Phys."},{"key":"ref_76","unstructured":"Xu, K., Zhang, M., Jegelka, S., and Kawaguchi, K. (2021, January 18\u201324). Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth. Proceedings of the 38th International Conference on Machine Learning, Virtual."},{"key":"ref_77","unstructured":"Veli\u010dkovi\u010d, P., Casanova, A., Li\u00f3, P., Cucurull, G., Romero, A., and Bengio, Y. (May, January 30). Graph attention networks. Proceedings of the 6th International Conference on Learning Representations, ICLR 2018\u2014Conference Track Proceedings, Vancouver, BC, Canada."},{"key":"ref_78","unstructured":"Wang, W. (2013, January 10\u201311). Blind Single-Image Super Resolution Reconstruction with Gaussian Blur. Proceedings of the Mechatronics and Automatic Control Systems, Hangzhou, China."},{"key":"ref_79","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015\u2014Conference Track Proceedings, San Diego, CA, USA."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"6486","DOI":"10.1109\/TPAMI.2024.3382294","article-title":"Towards Understanding Convergence and Generalization of AdamW","volume":"46","author":"Zhou","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Zou, F., Shen, L., Jie, Z., Zhang, W., and Liu, W. (2019, January 15\u201320). A sufficient condition for convergences of Adam and RMSProp. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01138"},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/JPROC.2024.3369017","article-title":"Trustworthy Graph Neural Networks: Aspects, Methods, and Trends","volume":"112","author":"Zhang","year":"2024","journal-title":"Proc. IEEE"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Chandan, G., Jain, A., Jain, H. (2018, January 11\u201312). Real Time Object Detection and Tracking Using Deep Learning and OpenCV. Proceedings of the International Conference on Inventive Research in Computing Applications, ICIRCA 2018, Coimbatore, India.","DOI":"10.1109\/ICIRCA.2018.8597266"},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/s12544-023-00581-6","article-title":"Smart port: A systematic literature review","volume":"15","author":"Belmoukari","year":"2023","journal-title":"Eur. Transp. Res. Rev."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/9\/239\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:47:57Z","timestamp":1760035677000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/9\/239"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,18]]},"references-count":86,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["bdcc9090239"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9090239","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2025,9,18]]}}}