{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T22:12:43Z","timestamp":1775254363343,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T00:00:00Z","timestamp":1726704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Nature Science Youth Foundation of China","award":["61907012"],"award-info":[{"award-number":["61907012"]}]},{"name":"National Nature Science Youth Foundation of China","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"National Nature Science Youth Foundation of China","award":["YCX23098"],"award-info":[{"award-number":["YCX23098"]}]},{"name":"National Nature Science Youth Foundation of China","award":["YCX23091"],"award-info":[{"award-number":["YCX23091"]}]},{"name":"National Nature Science Youth Foundation of China","award":["62366001"],"award-info":[{"award-number":["62366001"]}]},{"name":"National Nature Science Youth Foundation of China","award":["2024A2787"],"award-info":[{"award-number":["2024A2787"]}]},{"name":"Construction Project of First-Class Disciplines in Ningxia Higher Education","award":["61907012"],"award-info":[{"award-number":["61907012"]}]},{"name":"Construction Project of First-Class Disciplines in Ningxia Higher Education","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"Construction Project of First-Class Disciplines in Ningxia Higher Education","award":["YCX23098"],"award-info":[{"award-number":["YCX23098"]}]},{"name":"Construction Project of First-Class Disciplines in Ningxia Higher Education","award":["YCX23091"],"award-info":[{"award-number":["YCX23091"]}]},{"name":"Construction Project of First-Class Disciplines in Ningxia Higher Education","award":["62366001"],"award-info":[{"award-number":["62366001"]}]},{"name":"Construction Project of First-Class Disciplines in Ningxia Higher Education","award":["2024A2787"],"award-info":[{"award-number":["2024A2787"]}]},{"name":"Postgraduate Innovation Project of North Minzu University","award":["61907012"],"award-info":[{"award-number":["61907012"]}]},{"name":"Postgraduate Innovation Project of North Minzu University","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"Postgraduate Innovation Project of North Minzu University","award":["YCX23098"],"award-info":[{"award-number":["YCX23098"]}]},{"name":"Postgraduate Innovation Project of North Minzu University","award":["YCX23091"],"award-info":[{"award-number":["YCX23091"]}]},{"name":"Postgraduate Innovation Project of North Minzu University","award":["62366001"],"award-info":[{"award-number":["62366001"]}]},{"name":"Postgraduate Innovation Project of North Minzu University","award":["2024A2787"],"award-info":[{"award-number":["2024A2787"]}]},{"name":"National Nature Science Foundation of China","award":["61907012"],"award-info":[{"award-number":["61907012"]}]},{"name":"National Nature Science Foundation of China","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"National Nature Science Foundation of China","award":["YCX23098"],"award-info":[{"award-number":["YCX23098"]}]},{"name":"National Nature Science Foundation of China","award":["YCX23091"],"award-info":[{"award-number":["YCX23091"]}]},{"name":"National Nature Science Foundation of China","award":["62366001"],"award-info":[{"award-number":["62366001"]}]},{"name":"National Nature Science Foundation of China","award":["2024A2787"],"award-info":[{"award-number":["2024A2787"]}]},{"name":"Natural Science Foundation of Ningxia","award":["61907012"],"award-info":[{"award-number":["61907012"]}]},{"name":"Natural Science Foundation of Ningxia","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"Natural Science Foundation of Ningxia","award":["YCX23098"],"award-info":[{"award-number":["YCX23098"]}]},{"name":"Natural Science Foundation of Ningxia","award":["YCX23091"],"award-info":[{"award-number":["YCX23091"]}]},{"name":"Natural Science Foundation of Ningxia","award":["62366001"],"award-info":[{"award-number":["62366001"]}]},{"name":"Natural Science Foundation of Ningxia","award":["2024A2787"],"award-info":[{"award-number":["2024A2787"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>As a novel learning algorithm for feedforward neural networks, the twin extreme learning machine (TELM) boasts advantages such as simple structure, few parameters, low complexity, and excellent generalization performance. However, it employs the squared L2-norm metric and an unbounded hinge loss function, which tends to overstate the influence of outliers and subsequently diminishes the robustness of the model. To address this issue, scholars have proposed the bounded capped L2,p-norm metric, which can be flexibly adjusted by varying the p value to adapt to different data and reduce the impact of noise. Therefore, we substitute the metric in the TELM with the capped L2,p-norm metric in this paper. Furthermore, we propose a bounded, smooth, symmetric, and noise-insensitive squared fractional loss (SF-loss) function to replace the hinge loss function in the TELM. Additionally, the TELM neglects statistical information in the data; thus, we incorporate the Fisher regularization term into our model to fully exploit the statistical characteristics of the data. Drawing upon these merits, a squared fractional loss-based robust supervised twin extreme learning machine (SF-RSTELM) model is proposed by integrating the capped L2,p-norm metric, SF-loss, and Fisher regularization term. The model shows significant effectiveness in decreasing the impacts of noise and outliers. However, the proposed model\u2019s non-convexity poses a formidable challenge in the realm of optimization. We use an efficient iterative algorithm to solve it based on the concave-convex procedure (CCCP) algorithm and demonstrate the convergence of the proposed algorithm. Finally, to verify the algorithm\u2019s effectiveness, we conduct experiments on artificial datasets, UCI datasets, image datasets, and NDC large datasets. The experimental results show that our model is able to achieve higher ACC and F1 scores across most datasets, with improvements ranging from 0.28% to 4.5% compared to other state-of-the-art algorithms.<\/jats:p>","DOI":"10.3390\/sym16091230","type":"journal-article","created":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T08:12:27Z","timestamp":1726733547000},"page":"1230","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["The Robust Supervised Learning Framework: Harmonious Integration of Twin Extreme Learning Machine, Squared Fractional Loss, Capped L2,p-norm Metric, and Fisher Regularization"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1952-9513","authenticated-orcid":false,"given":"Zhenxia","family":"Xue","sequence":"first","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"},{"name":"The Key Laboratory of Intelligent Information and Big Data Processing of NingXia Province, North Minzu University, Yinchuan 750021, China"}]},{"given":"Yan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"}]},{"given":"Yuwen","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"}]},{"given":"Xinyuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"108834","DOI":"10.1016\/j.compchemeng.2024.108834","article-title":"Improved prediction of biomass gasification models through machine learning","volume":"191","author":"Sakheta","year":"2024","journal-title":"Comput. Chem. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"230","DOI":"10.31181\/jopi21202421","article-title":"A Comparative Analysis of the Machine Learning Methods for Predicting Diabetes","volume":"2","author":"Maydanchi","year":"2024","journal-title":"J. Oper. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"140931","DOI":"10.1016\/j.foodchem.2024.140931","article-title":"Integration of MALDI-TOF MS and machine learning to classify enterococci: A comparative analysis of supervised learning algorithms for species prediction","volume":"462","author":"Kim","year":"2024","journal-title":"Food Chem."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/s10462-013-9405-z","article-title":"Extreme learning machine: Algorithm, theory and applications","volume":"44","author":"Ding","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_5","first-page":"1","article-title":"Extreme learning machines: New trends and applications","volume":"2","author":"Deng","year":"2015","journal-title":"Sci. China Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","article-title":"Extreme learning machine: Theory and applications","volume":"70","author":"Huang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_7","unstructured":"Mirza, B., Kok, S., and Dong, F. (2015, January 15\u201317). Multi-layer online sequential extreme learning machine for image classification. Proceedings of the ELM-2015 Volume 1: Theory, Algorithms and Applications (I), Hangzhou, China."},{"key":"ref_8","first-page":"1","article-title":"Improved butterfly optimizer-configured extreme learning machine for fault diagnosis","volume":"2021","author":"Yu","year":"2021","journal-title":"Complexity"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"106272","DOI":"10.1016\/j.ymssp.2019.106272","article-title":"Mechanical fault diagnosis using convolutional neural networks and extreme learning machine","volume":"133","author":"Chen","year":"2019","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"105146","DOI":"10.1109\/ACCESS.2019.2892795","article-title":"Breast cancer detection using extreme learning machine based on feature fusion with CNN deep features","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.neucom.2013.05.052","article-title":"Vehicle detection in driving simulation using extreme learning machine","volume":"128","author":"Zhu","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"24529","DOI":"10.1007\/s11042-022-12498-8","article-title":"Human facial emotion recognition using improved black hole based extreme learning machine","volume":"81","author":"Deeb","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2021\/5871684","article-title":"Recognition of imbalanced epileptic EEG signals by a graph-based extreme learning machine","volume":"2021","author":"Zhou","year":"2021","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.knosys.2019.01.031","article-title":"An improved non-parallel universum support vector machine and its safe sample screening rule","volume":"170","author":"Zhao","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7759","DOI":"10.1109\/ACCESS.2023.3237641","article-title":"Deep Non-Parallel Hyperplane Support Vector Machine for Classification","volume":"11","author":"Sun","year":"2023","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"57349","DOI":"10.1109\/ACCESS.2019.2914022","article-title":"Weighted linear loss projection twin support vector machine for pattern classification","volume":"7","author":"Chen","year":"2019","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"16173","DOI":"10.1007\/s00521-022-07001-1","article-title":"Sparse discriminant twin support vector machine for binary classification","volume":"34","author":"Zheng","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5314","DOI":"10.1007\/s10489-020-01847-5","article-title":"Robust twin bounded support vector machines for outliers and imbalanced data","volume":"51","author":"Borah","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"10668","DOI":"10.1007\/s10489-022-03897-3","article-title":"A least squares twin support vector machine method with uncertain data","volume":"53","author":"Xiao","year":"2023","journal-title":"Appl. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.neucom.2017.04.036","article-title":"Twin extreme learning machines for pattern classification","volume":"260","author":"Wan","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.neunet.2019.01.016","article-title":"Robust capped L1-norm twin support vector machine","volume":"114","author":"Wang","year":"2019","journal-title":"Neural Netw."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, Y., Yu, G., and Ma, J. (2022). Capped linex metric twin support vector machine for robust classification. Sensors, 22.","DOI":"10.3390\/s22176583"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"106427","DOI":"10.1016\/j.engappai.2023.106427","article-title":"Universum twin support vector machine with truncated pinball loss","volume":"123","author":"Kumari","year":"2023","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"106536","DOI":"10.1016\/j.knosys.2020.106536","article-title":"Adaptive robust learning framework for twin support vector machine classification","volume":"211","author":"Ma","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3775","DOI":"10.1007\/s10489-020-01757-6","article-title":"Capped L1-norm distance metric-based fast robust twin extreme learning machine","volume":"50","author":"Ma","year":"2020","journal-title":"Appl. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/j.neucom.2022.09.156","article-title":"Robust projection twin extreme learning machines with capped L1-norm distance metric","volume":"517","author":"Yang","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107861","DOI":"10.1016\/j.sigpro.2020.107861","article-title":"Robust supervised and semi-supervised twin extreme learning machines for pattern classification","volume":"180","author":"Ma","year":"2021","journal-title":"Signal Process"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.neunet.2021.06.028","article-title":"Capped L2,P-norm metric based robust least squares twin support vector machine for pattern classification","volume":"142","author":"Yuan","year":"2021","journal-title":"Neural Netw."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, H., Yu, G., and Ma, J. (2023). Capped L2,P-Norm Metric Based on Robust Twin Support Vector Machine with Welsch Loss. Symmetry, 15.","DOI":"10.3390\/sym15051076"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jiang, Y., Yu, G., and Ma, J. (2023). Distance Metric Optimization-Driven Neural Network Learning Framework for Pattern Classification. Axioms, 12.","DOI":"10.3390\/axioms12080765"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3995","DOI":"10.1007\/s10115-020-01484-x","article-title":"Fisher-regularized supervised and semi-supervised extreme learning machine","volume":"62","author":"Ma","year":"2020","journal-title":"Knowl. Inf. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7352","DOI":"10.1007\/s10489-024-05528-5","article-title":"Robust Fisher-regularized extreme learning machine with asymmetric Welsch-induced loss function for classification","volume":"54","author":"Xue","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xue, Z., and Cai, L. (2023). Robust Fisher-Regularized Twin Extreme Learning Machine with Capped L1-Norm for Classification. Axioms, 12.","DOI":"10.3390\/axioms12070717"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Huber, P.J. (1992). Robust estimation of a location parameter. Breakthroughs in Statistics: Methodology and Distribution, Springer.","DOI":"10.1007\/978-1-4612-4380-9_35"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"106707","DOI":"10.1016\/j.knosys.2020.106707","article-title":"Robust twin extreme learning machines with correntropy-based metric","volume":"214","author":"Yuan","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1162\/08997660360581958","article-title":"The concave-convex procedure","volume":"15","author":"Yuille","year":"2003","journal-title":"Neural Comput."},{"key":"ref_37","first-page":"1081","article-title":"Analysis of multi-stage convex relaxation for sparse regularization","volume":"11","author":"Zhang","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","first-page":"326","article-title":"Convex Analysis","volume":"28","author":"Rockafellar","year":"1970","journal-title":"Princet. Math. Ser."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/9\/1230\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:59:25Z","timestamp":1760111965000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/9\/1230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,19]]},"references-count":38,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["sym16091230"],"URL":"https:\/\/doi.org\/10.3390\/sym16091230","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,19]]}}}