{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T05:28:39Z","timestamp":1774934919210,"version":"3.50.1"},"reference-count":40,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","funder":[{"name":"National Funds through FCT Fundao para a Cincia e Tecnologia through Projects","award":["UIDB\/04728\/2020"],"award-info":[{"award-number":["UIDB\/04728\/2020"]}]},{"name":"National Funds through FCT Fundao para a Cincia e Tecnologia through Projects","award":["EXPL\/CCI-COM\/0706\/2021"],"award-info":[{"award-number":["EXPL\/CCI-COM\/0706\/2021"]}]},{"name":"FCT Fundao para a Cincia e Tecnologia within the R&D Units Project","award":["UIDB\/00319\/2020"],"award-info":[{"award-number":["UIDB\/00319\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:p> In the last years, the number of machine learning algorithms and their parameters has increased significantly. On the one hand, this increases the chances of finding better models. On the other hand, it increases the complexity of the task of training a model, as the search space expands significantly. As the size of datasets also grows, traditional approaches based on extensive search start to become prohibitively expensive in terms of computational resources and time, especially in data streaming scenarios. This paper describes an approach based on meta-learning that tackles two main challenges. The first is to predict key performance indicators of machine learning models. The second is to recommend the best algorithm\/configuration for training a model for a given machine learning problem. When compared to a state-of-the-art method (AutoML), the proposed approach is up to 130x faster and only 4% worse in terms of average model quality. Hence, it is especially suited for scenarios in which models need to be updated regularly, such as in streaming scenarios with big data, in which some accuracy can be traded for a much shorter model training time. <\/jats:p>","DOI":"10.1142\/s0129065723500119","type":"journal-article","created":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T14:54:47Z","timestamp":1671202487000},"source":"Crossref","is-referenced-by-count":13,"title":["Algorithm Recommendation and Performance Prediction Using Meta-Learning"],"prefix":"10.1142","volume":"33","author":[{"given":"Guilherme","family":"Palumbo","sequence":"first","affiliation":[{"name":"CIICESI, Escola Superior de Tecnologia e Gest\u00a0ao, Polit\u00e9cnico do Porto, Portugal"}]},{"given":"Davide","family":"Carneiro","sequence":"additional","affiliation":[{"name":"CIICESI, Escola Superior de Tecnologia e Gest\u00a0ao, Polit\u00e9cnico do Porto, Portugal"}]},{"given":"Miguel","family":"Guimares","sequence":"additional","affiliation":[{"name":"CIICESI, Escola Superior de Tecnologia e Gest\u00a0ao, Polit\u00e9cnico do Porto, Portugal"}]},{"given":"Victor","family":"Alves","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Centre\/LASI, University of Minho, Braga, Portugal"}]},{"given":"Paulo","family":"Novais","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Centre\/LASI, University of Minho, Braga, Portugal"}]}],"member":"219","published-online":{"date-parts":[[2023,2,1]]},"reference":[{"issue":"2","key":"S0129065723500119BIB001","doi-asserted-by":"crossref","first-page":"191","DOI":"10.3233\/ICA-200640","volume":"28","author":"Macias-Garcia E.","year":"2021","journal-title":"Integr. Comput.-Aided Eng."},{"issue":"3","key":"S0129065723500119BIB002","doi-asserted-by":"crossref","first-page":"221","DOI":"10.3233\/ICA-210649","volume":"28","author":"Gasienica-Jozkowy J.","year":"2021","journal-title":"Integr. Comput.-Aided Eng."},{"key":"S0129065723500119BIB003","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500052"},{"issue":"1","key":"S0129065723500119BIB004","doi-asserted-by":"crossref","first-page":"2150055","DOI":"10.1142\/S0129065721500556","volume":"32","author":"Hu T.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"2","key":"S0129065723500119BIB005","doi-asserted-by":"crossref","first-page":"04015066","DOI":"10.1061\/(ASCE)CO.1943-7862.0001047","volume":"142","author":"Rafiei M. H.","year":"2016","journal-title":"J. Constr. Eng. Manag."},{"key":"S0129065723500119BIB006","first-page":"1","author":"Liu J.","year":"2022","journal-title":"Knowl. Inf. Syst."},{"key":"S0129065723500119BIB007","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2021.103293"},{"key":"S0129065723500119BIB008","doi-asserted-by":"crossref","first-page":"106622","DOI":"10.1016\/j.knosys.2020.106622","volume":"212","author":"He X.","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"S0129065723500119BIB009","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1109\/CEC45853.2021.9504761","volume-title":"2021 IEEE Congress on Evolutionary Computation (CEC)","author":"Alibrahim H.","year":"2021"},{"key":"S0129065723500119BIB010","series-title":"The Springer Series on Challenges in Machine Learning","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/978-3-030-05318-5_2","volume-title":"Automated Mac hine Learning","author":"Vanschoren J.","year":"2019"},{"key":"S0129065723500119BIB011","first-page":"1173","volume-title":"2nd Workshop on Meta-Learning at NeurIPS","author":"Yang C.","year":"2018"},{"key":"S0129065723500119BIB012","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500124"},{"key":"S0129065723500119BIB013","doi-asserted-by":"publisher","DOI":"10.1613\/jair.614"},{"key":"S0129065723500119BIB014","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.cobeha.2021.01.002","volume":"38","author":"Wang J. X.","year":"2021","journal-title":"Curr. Opin. Behav. Sci."},{"issue":"1","key":"S0129065723500119BIB017","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"32","author":"Li D."},{"key":"S0129065723500119BIB018","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1145\/3366423.3379999","volume-title":"Proc. Web Conf. 2020","author":"Luo M.","year":"2020"},{"key":"S0129065723500119BIB020","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.2307\/41703508","volume":"36","author":"Abbasi A.","year":"2012","journal-title":"MIS Q."},{"key":"S0129065723500119BIB021","volume-title":"International Conference on Learning Representations","author":"Ravi S.","year":"2017"},{"key":"S0129065723500119BIB022","first-page":"300","volume-title":"2019 Int. Conf. Computational Science and Computational Intelligence (CSCI)","author":"Ghareh Mohammadi F.","year":"2019"},{"key":"S0129065723500119BIB023","first-page":"6430","volume-title":"Proc. IEEE\/CVF Int. Conf. Computer Vision (ICCV)","author":"Achille A.","year":"2019"},{"issue":"11","key":"S0129065723500119BIB024","doi-asserted-by":"crossref","first-page":"4427","DOI":"10.1016\/j.eswa.2013.01.047","volume":"40","author":"Matijas M.","year":"2013","journal-title":"Expert Syst. Appl."},{"issue":"6","key":"S0129065723500119BIB025","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1007\/BF00881449","volume":"13","author":"Trevino L. K.","year":"1994","journal-title":"J. Bus. Ethics"},{"key":"S0129065723500119BIB026","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.neucom.2021.07.100","volume":"484","author":"Carneiro D.","year":"2022","journal-title":"Neurocomputing"},{"key":"S0129065723500119BIB027","first-page":"65","volume-title":"Advances in Computers","volume":"15","author":"Rice J. R.","year":"1976"},{"issue":"12","key":"S0129065723500119BIB032","doi-asserted-by":"crossref","first-page":"2250049","DOI":"10.1142\/S0129065722500496","volume":"32","author":"Nandi A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"4","key":"S0129065723500119BIB033","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1007\/s10618-015-0448-4","volume":"30","author":"Webb G. I.","year":"2016","journal-title":"Data Min. Knowl. Discov."},{"issue":"12","key":"S0129065723500119BIB034","first-page":"2346","volume":"31","author":"Lu J.","year":"2018","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"S0129065723500119BIB035","first-page":"137","volume-title":"2018 IEEE 30th Int. Conf. Tools with Artificial Intelligence (ICTAI)","author":"Bauder R. A.","year":"2018"},{"key":"S0129065723500119BIB036","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"issue":"1","key":"S0129065723500119BIB037","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-018-0138-3","volume":"5","author":"Herland M.","year":"2018","journal-title":"J. Big Data"},{"issue":"1","key":"S0129065723500119BIB038","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13634-015-0293-z","volume":"2016","author":"Qiu J.","year":"2016","journal-title":"EURASIP J. Adv. Signal Process."},{"issue":"2","key":"S0129065723500119BIB039","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3377454","volume":"53","author":"Verbraeken J.","year":"2020","journal-title":"ACM Comput. Surv. (CSUR)"},{"issue":"11","key":"S0129065723500119BIB040","doi-asserted-by":"crossref","first-page":"6240","DOI":"10.1002\/int.22549","volume":"36","author":"Monteiro J. P.","year":"2021","journal-title":"Int. J. Intell. Syst."},{"key":"S0129065723500119BIB041","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"S0129065723500119BIB042","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-016-0043-6"},{"key":"S0129065723500119BIB043","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.accinf.2018.03.004","volume":"31","author":"Baader G.","year":"2018","journal-title":"Int. J. Account. Inf. Syst."},{"issue":"111","key":"S0129065723500119BIB045","first-page":"1","volume":"21","author":"Alcobaaa E.","year":"2020","journal-title":"J. Mach. Learn. Res."},{"issue":"1","key":"S0129065723500119BIB046","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2288-14-1","volume":"14","author":"Wan X.","year":"2014","journal-title":"BMC Med. Res. Methodol."},{"key":"S0129065723500119BIB047","first-page":"101","volume":"5","author":"Rifkin R.","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"S0129065723500119BIB048","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1007\/3-540-45372-5_32","volume-title":"European Conf. Principles of Data Mining and Knowledge Discovery","author":"Bensusan H.","year":"2000"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065723500119","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,3]],"date-time":"2023-03-03T07:20:49Z","timestamp":1677828049000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065723500119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,1]]},"references-count":40,"journal-issue":{"issue":"03","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["10.1142\/S0129065723500119"],"URL":"https:\/\/doi.org\/10.1142\/s0129065723500119","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,1]]},"article-number":"2350011"}}