{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T13:19:56Z","timestamp":1753881596222,"version":"3.41.2"},"reference-count":47,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Artif. Intell. Tools"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:p> In this paper, we propose a new technique for handling a class of sparse supervised learning problems, specifically focusing on regression, binary, and multi-class classification problems. Sparse regression problems are associated with datasets including both arithmetic and categorical features and by encoding the dataset leads to an underdetermined sparse linear system. Furthermore, logistic regression can be used for both sparse binary and multi-class classification problems, solving an underdetermined sparse linear system. A new technique called Sparse Approximate Pseudoinverse Preconditioning (SAPP), namely the Explicit Preconditioned Conjugate Gradient for Normal Equations (EPCGNE) method based on Generic Approximate Sparse Pseudoinverse matrices is introduced for solving underdetermined sparse least square problems. Numerical experiments were carried out demonstrating a significant improvement of the performance metrics for the proposed SAPP scheme compared to other learners. <\/jats:p>","DOI":"10.1142\/s0218213024500118","type":"journal-article","created":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T08:10:31Z","timestamp":1708675831000},"source":"Crossref","is-referenced-by-count":0,"title":["Sparse Approximate Pseudoinverse Preconditioning for Sparse Supervised Learning Problems with More Features than Samples"],"prefix":"10.1142","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5058-5463","authenticated-orcid":false,"given":"Anastasia-Dimitra E.","family":"Lipitakis","sequence":"first","affiliation":[{"name":"Department of Informatics and Telematics, Harokopio University of Athens, GR 17778 Athens, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1562-3633","authenticated-orcid":false,"given":"George A.","family":"Gravvanis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, School of Engineering, Democritus University of Thrace, University Campus, Kimmeria, GR 67100 Xanthi, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6591-970X","authenticated-orcid":false,"given":"Christos K.","family":"Filelis-Papadopoulos","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, School of Engineering, Democritus University of Thrace, University Campus, Kimmeria, GR 67100 Xanthi, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2247-3082","authenticated-orcid":false,"given":"Sotiris","family":"Kotsiantis","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Patras, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0747-4252","authenticated-orcid":false,"given":"Dimosthenis","family":"Anagnostopoulos","sequence":"additional","affiliation":[{"name":"Department of Informatics and Telematics, Harokopio University of Athens, GR 17778 Athens, Greece"}]}],"member":"219","published-online":{"date-parts":[[2024,5,20]]},"reference":[{"key":"S0218213024500118BIB001","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"S0218213024500118BIB002","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"},{"key":"S0218213024500118BIB003","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1970.10488634"},{"key":"S0218213024500118BIB004","doi-asserted-by":"publisher","DOI":"10.1214\/009053604000000067"},{"key":"S0218213024500118BIB005","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v033.i01"},{"key":"S0218213024500118BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2012.2218810"},{"volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","year":"2009","author":"R T.","key":"S0218213024500118BIB007"},{"key":"S0218213024500118BIB008","first-page":"37","volume-title":"Data Class: Algorithms and Applications","author":"Tang J.","year":"2014"},{"key":"S0218213024500118BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/89.817452"},{"key":"S0218213024500118BIB010","series-title":"Translation Editor Fritz John","volume-title":"Solutions of Ill-posed Problems","author":"Tikhonov A. N.","year":"1977"},{"key":"S0218213024500118BIB011","first-page":"229","volume-title":"Handbook of Statistics","volume":"38","author":"Fathi E.","year":"2018"},{"key":"S0218213024500118BIB012","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827593252672"},{"volume-title":"Signal Processing Handbook","year":"1988","author":"Chen C.-H.","key":"S0218213024500118BIB014"},{"key":"S0218213024500118BIB015","doi-asserted-by":"publisher","DOI":"10.1190\/1.1440921"},{"key":"S0218213024500118BIB016","doi-asserted-by":"publisher","DOI":"10.1002\/cpa.20042"},{"key":"S0218213024500118BIB017","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/32\/10\/104001"},{"key":"S0218213024500118BIB018","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6420\/33\/6\/060301"},{"key":"S0218213024500118BIB019","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/32\/9\/094001"},{"key":"S0218213024500118BIB021","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009744630224"},{"volume-title":"The Nature of Statistical Learning Theory","year":"1999","author":"Vapnik V.","key":"S0218213024500118BIB022"},{"key":"S0218213024500118BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/5326.897072"},{"key":"S0218213024500118BIB024","first-page":"31","volume-title":"Proc. of EWSL","volume":"87","author":"Cestnik B.","year":"1987"},{"key":"S0218213024500118BIB025","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007607513941"},{"volume-title":"Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms","year":"1962","author":"Rosenblatt F.","key":"S0218213024500118BIB026"},{"key":"S0218213024500118BIB027","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-016-5555-y"},{"key":"S0218213024500118BIB029","doi-asserted-by":"publisher","DOI":"10.5120\/ijca2017915495"},{"first-page":"4917","volume-title":"Int. Conf. on Machine Learning (PMLR, 2021)","author":"Jia B.-B.","key":"S0218213024500118BIB030"},{"key":"S0218213024500118BIB031","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1959.tb01583.x"},{"key":"S0218213024500118BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2016.45"},{"key":"S0218213024500118BIB033","first-page":"2825","volume":"12","author":"Pedregosa F.","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"S0218213024500118BIB035","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"volume-title":"Introduction to Information Retrieval","year":"2008","author":"Schutze H.","key":"S0218213024500118BIB037"},{"key":"S0218213024500118BIB038","doi-asserted-by":"publisher","DOI":"10.1137\/0709016"},{"key":"S0218213024500118BIB039","doi-asserted-by":"publisher","DOI":"10.1109\/CSCI51800.2020.00250"},{"key":"S0218213024500118BIB040","doi-asserted-by":"publisher","DOI":"10.1137\/S106482759833913X"},{"key":"S0218213024500118BIB041","doi-asserted-by":"publisher","DOI":"10.1177\/109434200101500106"},{"volume-title":"20 Newsgroups Dataset","year":"1997","author":"Rennie J.","key":"S0218213024500118BIB042"},{"key":"S0218213024500118BIB043","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.764"},{"key":"S0218213024500118BIB044","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-021-00637-x"},{"key":"S0218213024500118BIB045","doi-asserted-by":"publisher","DOI":"10.3390\/info10040150"},{"key":"S0218213024500118BIB048","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0026683"},{"key":"S0218213024500118BIB049","doi-asserted-by":"publisher","DOI":"10.1002\/9781118644478"},{"key":"S0218213024500118BIB050","doi-asserted-by":"publisher","DOI":"10.1201\/b18401"},{"key":"S0218213024500118BIB051","volume-title":"Introduction to Information Retrieval","author":"Christopher P. R.","year":"2008","edition":"1"},{"issue":"4","key":"S0218213024500118BIB052","doi-asserted-by":"crossref","first-page":"836","DOI":"10.1109\/TNNLS.2013.2281839","volume":"25","author":"Luo J.","year":"2013","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"S0218213024500118BIB053","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-29659-3_4"},{"volume-title":"Search Engines: Information Retrieval in Practice","year":"2010","author":"Croft W. B.","key":"S0218213024500118BIB054"}],"container-title":["International Journal on Artificial Intelligence Tools"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218213024500118","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,2]],"date-time":"2024-07-02T03:03:23Z","timestamp":1719889403000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218213024500118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,20]]},"references-count":47,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1142\/S0218213024500118"],"URL":"https:\/\/doi.org\/10.1142\/s0218213024500118","relation":{},"ISSN":["0218-2130","1793-6349"],"issn-type":[{"type":"print","value":"0218-2130"},{"type":"electronic","value":"1793-6349"}],"subject":[],"published":{"date-parts":[[2024,5,20]]},"article-number":"2450011"}}