{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T22:12:42Z","timestamp":1775254362486,"version":"3.50.1"},"reference-count":59,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>We introduce a novel twin support vector machine with the generalized pinball loss function (GPin-TSVM) for solving data classification problems that are less sensitive to noise and preserve the sparsity of the solution. In addition, we use a symmetric kernel trick to enlarge GPin-TSVM to nonlinear classification problems. The developed approach is tested on numerous UCI benchmark datasets, as well as synthetic datasets in the experiments. The comparisons demonstrate that our proposed algorithm outperforms existing classifiers in terms of accuracy. Furthermore, this employed approach in handwritten digit recognition applications is examined, and the automatic feature extractor employs a convolution neural network.<\/jats:p>","DOI":"10.3390\/sym14020289","type":"journal-article","created":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T08:20:29Z","timestamp":1643617229000},"page":"289","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A Novel Twin Support Vector Machine with Generalized Pinball Loss Function for Pattern Classification"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9367-5204","authenticated-orcid":false,"given":"Wanida","family":"Panup","sequence":"first","affiliation":[{"name":"Department of Mathematics, Faculty of Science, Naresuan University, Phitsanulok 65000, Thailand"}]},{"given":"Wachirapong","family":"Ratipapongton","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of York, Heslington, York YO10 5DD, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5715-3804","authenticated-orcid":false,"given":"Rabian","family":"Wangkeeree","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Faculty of Science, Naresuan University, Phitsanulok 65000, Thailand"},{"name":"Research Center for Academic Excellence in Mathematics, Naresuan University, Phitsanulok 65000, Thailand"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,31]]},"reference":[{"key":"ref_1","first-page":"199","article-title":"On proximal bilateral-weighted fuzzy support vector machine classifiers","volume":"4","author":"Balasundaram","year":"2012","journal-title":"Int. J. Adv. Intell. Paradig."},{"key":"ref_2","first-page":"2935","article-title":"Tree decomposition for large-scale SVM problems","volume":"11","author":"Chang","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s11425-010-0018-6","article-title":"The new interpretation of support vector machines on statistical learning theory","volume":"53","author":"Zhang","year":"2010","journal-title":"Sci. China"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1023\/B:STCO.0000035301.49549.88","article-title":"A tutorial on support vector regression","volume":"14","author":"Smola","year":"2004","journal-title":"Stat. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.ins.2018.12.026","article-title":"A novel perspective on multiclass classification: Regular simplex support vector machine","volume":"480","author":"Tang","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"van de Wolfshaar, J., Karaaba, M.F., and Wiering, M.A. (2015, January 7\u201310). Deep Convolutional Neural Networks and Support Vector Machines for Gender Recognition. Proceedings of the IEEE Symposium Series on Computational Intelligence, Cape Town, South Africa.","DOI":"10.1109\/SSCI.2015.37"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lilleberg, J., Zhu, Y., and Zhang, Y. (2015, January 6\u20138). Support vector machines and Word2vec for text classification with semantic features. Proceedings of the IEEE 14th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC), Beijing, China.","DOI":"10.1109\/ICCI-CC.2015.7259377"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"108","DOI":"10.7603\/s40601-016-0016-9","article-title":"Arabic Text Categorization Using Support vector machine, Na\u00efve Bayes and Neural Network","volume":"5","author":"Mohammad","year":"2016","journal-title":"GSTF J. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1007\/s10489-017-0957-5","article-title":"Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine","volume":"48","author":"Mehmood","year":"2018","journal-title":"Appl. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.eswa.2018.03.053","article-title":"EEG signal classification using universum support vector machine","volume":"106","author":"Richhariya","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103468","DOI":"10.1016\/j.engappai.2019.103468","article-title":"A novel incremental Kernel Nonparametric SVM model (iKN-SVM) for data classification: An application to face detection","volume":"89","author":"Soula","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_12","first-page":"492","article-title":"A new training approach based on ECOC-SVM for SAR image retrieval","volume":"8","author":"Krishna","year":"2021","journal-title":"Int. J. Intell. Enterp."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Khemchandani, R., and Chandra, S. (2016). Twin Support Vector Machines: Models, Springer.","DOI":"10.1109\/ICAPR.2015.7050651"},{"key":"ref_14","first-page":"2230","article-title":"New Incremental Learning Algorithm With Support Vector Machines","volume":"49","author":"Xu","year":"2018","journal-title":"IEEE Trans. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2269","DOI":"10.1007\/s00500-015-1938-4","article-title":"Classification with boosting of extreme learning machine over arbitrarily partitioned data","volume":"21","author":"Catak","year":"2017","journal-title":"Soft Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1109\/TPAMI.2007.1068","article-title":"Twin support vector machines for pattern classification","volume":"29","author":"Jayadeva","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kumar, M., and Gopal, M. (2015, January 14\u201316). Least squares twin support vector machines for text categorization. Proceedings of the 39th National Systems Conference (NSC), Greater Noida, India.","DOI":"10.1109\/NATSYS.2015.7489094"},{"key":"ref_18","unstructured":"Francis, L.M., and Sreenath, N. (2019, February 02). Robust Scene Text Recognition: Using Manifold Regularized Twin-SupportVector Machine. J. King Saud Univ. Comput. Inf. Sci., Available online: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1319157818309509."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Agarwal, S., and Tomar, D. (2014, January 1\u20132). Siddhant Prediction of software defects using Twin Support Vector Machine. Proceedings of the International Conference on Information Systems and Computer Networks (ISCON), Mathura, India.","DOI":"10.1109\/ICISCON.2014.6965232"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1504\/IJBIC.2018.092808","article-title":"An improved twin support vector machine based on multi-objective cuckoo search for software defect prediction","volume":"11","author":"Cao","year":"2018","journal-title":"Int. J. Bio-Inspired Comput."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tomar, D., and Agarwal, S. (2016, January 12\u201313). A Multilabel Approach Using Binary Relevance and One-versus-Rest Least Squares Twin Support Vector Machine for Scene Classification. Proceedings of the Second International Conference on Computational Intelligence & Communication Technology (CICT), Ghaziabad, India.","DOI":"10.1109\/CICT.2016.17"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2016.10.008","article-title":"Robust image recognition by L1-norm twin-projection support vector machine","volume":"223","author":"Gu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cong, H., Yang, C., and Pu, X. (2008, January 21\u201324). Efficient Speaker Recognition based on Multi-class Twin Support Vector Machines and GMMs. Proceedings of the IEEE Conference on Robotics, Automation and Mechatronics, Chengdu, China.","DOI":"10.1109\/RAMECH.2008.4681433"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1590","DOI":"10.1109\/TASLP.2014.2341914","article-title":"Large-Scale Training of Pairwise Support Vector Machines for Speaker Recognition","volume":"22","author":"Cumani","year":"2014","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.sigpro.2014.04.010","article-title":"Energy-based model of least squares twin Support Vector Machines for human action recognition","volume":"104","author":"Nasiri","year":"2014","journal-title":"Signal Process."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sadewo, W., Rustam, Z., Hamidah, H., and Chusmarsyah, A.R. (2020). Pancreatic Cancer Early Detection Using Twin Support Vector Machine Based on Kernel. Symmetry, 12.","DOI":"10.3390\/sym12040667"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2678","DOI":"10.1016\/j.patcog.2011.03.031","article-title":"TPMSVM: A novel twin parametric-margin support vector machine for pattern recognition","volume":"44","author":"Peng","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1109\/TNN.2011.2130540","article-title":"Improvements on twin support vector machines","volume":"22","author":"Shao","year":"2011","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3158","DOI":"10.1016\/j.patcog.2014.03.008","article-title":"An efficient weighted lagrangian twin support vector machine for imbalanced data classification","volume":"47","author":"Shao","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.1016\/j.patrec.2008.05.016","article-title":"Application of smoothing technique on twin support vector machines","volume":"29","author":"Kumar","year":"2008","journal-title":"Pattern Recognit. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4606","DOI":"10.1016\/j.ins.2010.07.034","article-title":"Knowledge based least squares twin support vector machines","volume":"180","author":"Kumar","year":"2010","journal-title":"Inform. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"106305","DOI":"10.1016\/j.asoc.2020.106305","article-title":"LSTSVM classifier with enhanced features from pre-trained functional link network","volume":"93","author":"Ganaie","year":"2020","journal-title":"Appl. Soft Comput. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.neunet.2013.11.014","article-title":"Large-scale linear nonparallel support vector machine solver","volume":"50","author":"Tian","year":"2014","journal-title":"Neural Netw."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.asoc.2019.02.022","article-title":"Sparse pinball twin support vector machines","volume":"78","author":"Tanveer","year":"2019","journal-title":"Appl. Soft Comput. J."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1011215321374","article-title":"SSVM: A Smooth Support Vector Machine for Classification","volume":"20","author":"Lee","year":"2001","journal-title":"Comput. Optim. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1198\/016214507000000617","article-title":"Robust truncated hinge loss support vector machines","volume":"102","author":"Wu","year":"2007","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_37","first-page":"1","article-title":"Imbalanced data classification based on hybrid resampling and twin support vector machine","volume":"16","author":"Cao","year":"2017","journal-title":"Comput. Sci. Inf. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1080\/18756891.2015.1061395","article-title":"An effective Weighted Multi-class Least Squares Twin Support Vector Machine for Imbalanced data classification","volume":"8","author":"Tomar","year":"2015","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"984","DOI":"10.1109\/TPAMI.2013.178","article-title":"Support vector machine classifier with pinball loss","volume":"36","author":"Huang","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.neucom.2018.08.079","article-title":"Generalized pinball loss SVMs","volume":"322","author":"Rastogi","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Mangasarian, O.L. (1994). Nonlinear Programming, Society for Industrial and Applied Mathematics.","DOI":"10.1137\/1.9781611971255"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1109\/TNNLS.2015.2513006","article-title":"A novel twin support-vector machine with pinball loss","volume":"28","author":"Xu","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_43","unstructured":"Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning Theory Algorithms, Cambridge University Press."},{"key":"ref_44","unstructured":"Tikhonov, A.N., and Arsenin, V.Y. (1977). Solution of Ill Posed Problems, John Wiley and Sons."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1007\/s11590-008-0092-7","article-title":"Optimal kernel selection in twin support vector machines","volume":"3","author":"Khemchandani","year":"2009","journal-title":"Optim. Lett."},{"key":"ref_46","unstructured":"Dua, D., and Taniskidou, E.K. (2019). UCI Machine Learning Repository, University of California, School ofInformation and Computer Science. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.knosys.2011.06.013","article-title":"On the effectiveness of preprocessing methods when dealing with different levels of class imbalance","volume":"25","author":"Sanche","year":"2012","journal-title":"Knowl. Based Syst."},{"key":"ref_48","first-page":"1","article-title":"A Practical Guide to Support Vector Classification","volume":"25","author":"Hsu","year":"2012","journal-title":"Nat. Taiwan Univ. Taipei Taiwa"},{"key":"ref_49","unstructured":"Hamid, N.A., and Sjarif, N.N.A. (2017). Handwritten Recognition Using SVM, KNN and Neural Network. arXiv."},{"key":"ref_50","unstructured":"Agarap, A.F.M. (2019). An Architecture Combining Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for Image Classification. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2554","DOI":"10.1016\/j.procs.2020.03.309","article-title":"Hybrid CNN-SVM Classifier for Handwritten Digit Recognition","volume":"167","author":"Ahlawata","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Aliab, A.A.A., and Mallaiah, S. (2021). Intelligent handwritten recognition using hybrid CNN architectures based-SVM classifier with dropout. Comput. Inf. Sci.","DOI":"10.1016\/j.jksuci.2021.01.012"},{"key":"ref_53","unstructured":"Remaida, A., Moumen, A., Idrissi, Y., El, B., and Sabri, Z. (April, January 31). Handwriting Recognition with Artificial Neural Networks a Decade Literature Review. Proceedings of the 3rd International Conference on Networking, Information Systems & Security, Marrakech, Morocco."},{"key":"ref_54","first-page":"137","article-title":"Handwriting Recognition using Artificial Intelligence Neural Network and Image Processing","volume":"11","author":"Aqab","year":"2020","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Mawaddah, A.H., Sari, C.A., Setiadi, D.R.I.M., and Rachmawanto, E.H. (2020, January 19\u201320). Handwriting Recognition of Hiragana Characters using Convolutional Neural Network. Proceedings of the International Seminar on Application for Technology of Information and Communication (iSemantic), Semarang, Indonesia.","DOI":"10.1109\/iSemantic50169.2020.9234211"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2249","DOI":"10.1007\/s00521-020-05070-8","article-title":"Arabic handwriting recognition system using convolutional neural network","volume":"33","author":"Altwaijry","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Alshazly, H., Linse, C., Barth, E., and Martinetz, T. (2019). Handcrafted versus CNN Features for Ear Recognition. Symmetry, 11.","DOI":"10.3390\/sym11121493"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1166\/jmihi.2021.3259","article-title":"Epilepsy EEG classification based on convolution support vector machine","volume":"11","author":"Xin","year":"2021","journal-title":"J. Med. Imaging Health Inf."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2044","DOI":"10.1016\/j.ins.2009.12.010","article-title":"Advanced non-parametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining experimental analysis of power","volume":"180","author":"Garcia","year":"2010","journal-title":"Inf. Sci."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/2\/289\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:11:57Z","timestamp":1760134317000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/2\/289"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,31]]},"references-count":59,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["sym14020289"],"URL":"https:\/\/doi.org\/10.3390\/sym14020289","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,31]]}}}