{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T03:24:15Z","timestamp":1770175455674,"version":"3.49.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"DOI":"10.13039\/501100000038","name":"National Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","award":["RGPIN-2025-06332"],"award-info":[{"award-number":["RGPIN-2025-06332"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Evol. Learn. Optim."],"published-print":{"date-parts":[[2026,3,31]]},"abstract":"<jats:p>\n                    Gradient boosting represents an effective approach for constructing ensembles. We demonstrate how genetic programming can take advantage of the method for a wide range of\n                    <jats:italic toggle=\"yes\">classification<\/jats:italic>\n                    tasks. The resulting Gradient Boosted Programming approach assumes two phases. Phase 1 develops a diverse set of base learners (programs). Phase 2 applies a gradient boosting approach specific to the program representation. The resulting ensemble is additively constructed and a class probability distribution is learnt for each program. An extensive benchmarking study is conducted across 21 classification datasets that include requirements for operation under class imbalance, tens of classes, and feature identification. The proposed approach is significantly better under the 11 low cardinality classification tasks and generally identifies simpler models than other ensemble methods such as Random Forests and XGBoost.\n                  <\/jats:p>","DOI":"10.1145\/3742796","type":"journal-article","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T11:39:33Z","timestamp":1749037173000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Gradient Boosted Programming for Low Cardinality Classification"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-2451-8804","authenticated-orcid":false,"given":"Zhilei","family":"Zhou","sequence":"first","affiliation":[{"name":"Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1521-0671","authenticated-orcid":false,"given":"Malcolm I.","family":"Heywood","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada"}]}],"member":"320","published-online":{"date-parts":[[2026,2,3]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2019.2900916"},{"key":"e_1_3_2_3_1","first-page":"879","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference","author":"Arnaldo Ignacio","year":"2014","unstructured":"Ignacio Arnaldo, Krzysztof Krawiec, and Una-May O\u2019Reilly. 2014. Multiple regression genetic programming. In Proceedings of the Genetic and Evolutionary Computation Conference. Dirk V. Arnold (Ed.), ACM, 879\u2013886."},{"issue":"2","key":"e_1_3_2_4_1","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1007\/s42979-021-01006-8","article-title":"Exploring genetic programming in TensorFlow with TensorGP","volume":"3","author":"Baeta Francisco","year":"2022","unstructured":"Francisco Baeta, Jo\u00e3o Correia, Tiago Martins, and Penousal Machado. 2022. Exploring genetic programming in TensorFlow with TensorGP. SN Computer Science 3, 2 (2022), 154.","journal-title":"SN Computer Science"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2021.100913"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2021.3053165"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_2_9_1","first-page":"1562","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference, Companion Volume (GECCO \u201920)","author":"Burlacu Bogdan","year":"2020","unstructured":"Bogdan Burlacu, Gabriel Kronberger, and Michael Kommenda. 2020. Operon C++: An efficient genetic programming framework for symbolic regression. In Proceedings of the Genetic and Evolutionary Computation Conference, Companion Volume (GECCO \u201920). Carlos Artemio Coello Coello (Ed.), ACM, 1562\u20131570."},{"key":"e_1_3_2_10_1","doi-asserted-by":"crossref","first-page":"2438","DOI":"10.1145\/3583133.3595046","volume-title":"Companion Proceedings of the Conference on Genetic and Evolutionary Computation","author":"C\u00e1ceres Leslie P\u00e9rez","year":"2023","unstructured":"Leslie P\u00e9rez C\u00e1ceres, Manuel L\u00f3pez-Ib\u00e1\u00f1ez, and Thomas St\u00fctzle. 2023. Automated algorithm configuration and design. In Companion Proceedings of the Conference on Genetic and Evolutionary Computation. ACM, 2438\u20132463."},{"key":"e_1_3_2_11_1","volume-title":"Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks","author":"Cava William G. La","year":"2021","unstructured":"William G. La Cava, Patryk Orzechowski, Bogdan Burlacu, Fabr\u00edcio Olivetti de Fran\u00e7a, Marco Virgolin, Ying Jin, Michael Kommenda, and Jason H. Moore. 2021. Contemporary symbolic regression methods and their relative performance. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks. Joaquin Vanschoren and Sai-Kit Yeung (Eds.), arXiv."},{"key":"e_1_3_2_12_1","first-page":"785","volume-title":"Proceedings of the SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Chen Tianqi","year":"2016","unstructured":"Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A scalable tree boosting system. In Proceedings of the SIGKDD International Conference on Knowledge Discovery and Data Mining. Balaji Krishnapuram, Mohak Shah, Alexander J. Smola, Charu C. Aggarwal, Dou Shen, and Rajeev Rastogi (Eds.), ACM, 785\u2013794."},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248548"},{"issue":"1","key":"e_1_3_2_14_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s10710-024-09482-6","article-title":"An ensemble learning interpretation of geometric semantic genetic programming","volume":"25","author":"Dick Grant","year":"2024","unstructured":"Grant Dick. 2024. An ensemble learning interpretation of geometric semantic genetic programming. Genetic Programming and Evolvable Machines 25, 1 (2024), 9.","journal-title":"Genetic Programming and Evolvable Machines"},{"key":"e_1_3_2_15_1","first-page":"261:1","article-title":"Auto-Sklearn 2.0: Hands-free AutoML via meta-learning","volume":"23","author":"Feurer Matthias","year":"2022","unstructured":"Matthias Feurer, Katharina Eggensperger, Stefan Falkner, Marius Lindauer, and Frank Hutter. 2022. Auto-Sklearn 2.0: Hands-free AutoML via meta-learning. Journal of Machine Learning Research 23 (2022), 261:1\u2013261:61.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_16_1","first-page":"1515","volume-title":"Advances in Neural Information Processing Systems","author":"Fink Michael","year":"2003","unstructured":"Michael Fink and Pietro Perona. 2003. Mutual boosting for contextual inference. In Advances in Neural Information Processing Systems. Sebastian Thrun, Lawrence K. Saul, and Bernhard Sch\u00f6lkopf (Eds.), Vol. 16, MIT Press, 1515\u20131522."},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9473(01)00065-2"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"e_1_3_2_20_1","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/978-981-99-3814-8_8","volume-title":"Handbook of Evolutionary Machine Learning","author":"Heywood Malcolm I.","year":"2024","unstructured":"Malcolm I. Heywood. 2024. Evolutionary ensemble learning. In Handbook of Evolutionary Machine Learning. Wolfgang Banzhaf, Penousal Machado, and Mengjie Zhang (Eds.), Springer Nature, 205\u2013243."},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.709601"},{"key":"e_1_3_2_22_1","first-page":"1053","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference","author":"Iba Hitoshi","year":"1999","unstructured":"Hitoshi Iba. 1999. Bagging, boosting, and bloating in genetic programming. In Proceedings of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann, 1053\u20131060."},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025124423708"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511921803"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/646808.703946"},{"key":"e_1_3_2_26_1","unstructured":"Markelle Kelly Rachel Longjohn and Kolby Nottingham. 2023. The UCI Machine Learning Repository. Retrieved from https:\/\/archive.ics.uci.edu"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-019-09371-3"},{"key":"e_1_3_2_28_1","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/978-3-030-05318-5_4","volume-title":"Automated Machine Learning\u2014Methods, Systems, Challenges","author":"Kotthoff Lars","year":"2019","unstructured":"Lars Kotthoff, Chris Thornton, Holger H. Hoos, Frank Hutter, and Kevin Leyton-Brown. 2019. Auto-WEKA: Automatic model selection and hyperparameter optimization in WEKA. In Automated Machine Learning\u2014Methods, Systems, Challenges. Frank Hutter, Lars Kotthoff, and Joaquin Vanschoren (Eds.), Springer, 81\u201395."},{"key":"e_1_3_2_29_1","volume-title":"Genetic Programming\u2014On the Programming of Computers by Means of Natural Selection","author":"Koza John R.","year":"1993","unstructured":"John R. Koza. 1993. Genetic Programming\u2014On the Programming of Computers by Means of Natural Selection. MIT Press."},{"key":"e_1_3_2_30_1","volume-title":"Proceedings of the ICML Workshop on Automated Machine Learning","author":"LeDell Erin","year":"2020","unstructured":"Erin LeDell and Sebastien Poirier. 2020. H2O AutoML: Scalable automatic machine learning. In Proceedings of the ICML Workshop on Automated Machine Learning. K. Eggensperger, M. Feurer, C. Weill, M. Lindauer, F. Hutter, and J. Vanschoren (Eds.), PLMR."},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744378"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/14738716241260745"},{"key":"e_1_3_2_33_1","unstructured":"Jean-Baptiste Mouret and Jeff Clune. 2015. Illuminating search spaces by mapping elites. arXiv:1504.04909. Retrieved from https:\/\/arxiv.org\/abs\/1504.04909"},{"key":"e_1_3_2_34_1","first-page":"485","volume-title":"Proceedings of the on Genetic and Evolutionary Computation Conference","author":"Olson Randal S.","year":"2016","unstructured":"Randal S. Olson, Nathan Bartley, Ryan J. Urbanowicz, and Jason H. Moore. 2016. Evaluation of a tree-based pipeline optimization tool for automating data science. In Proceedings of the on Genetic and Evolutionary Computation Conference. ACM, 485\u2013492."},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2020.2990626"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco_a_00321"},{"key":"e_1_3_2_37_1","doi-asserted-by":"crossref","unstructured":"Joseph D. Romano Trang T. Le William La Cava John T. Gregg Daniel J. Goldberg Praneel Chakraborty Natasha L. Ray Daniel Himmelstein Weixuan Fu and Jason H. Moore. 2021. PMLB v1.0: An open source dataset collection for benchmarking machine learning methods. arXiv:2012.00058v2. Retrieved from https:\/\/arxiv.org\/abs\/2012.00058v2","DOI":"10.1093\/bioinformatics\/btab727"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022648800760"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mlwa.2021.100243"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3067695.3084216"},{"key":"e_1_3_2_41_1","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/3-540-48219-9_2","volume-title":"Proceedings of the International Workshop on Multiple Classifier Systems","author":"Wickramaratna Jeevani","year":"2001","unstructured":"Jeevani Wickramaratna, Sean B. Holden, and Bernard F. Buxton. 2001. Performance degradation in boosting. In Proceedings of the International Workshop on Multiple Classifier Systems. Josef Kittler and Fabio Roli (Eds.), LNCS, Vol. 2096, Springer, 11\u201321."},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(05)80023-1"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2023.3243172"},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2021.3136667"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/tvcg.2018.2864475"},{"key":"e_1_3_2_46_1","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/978-3-031-29573-7_9","volume-title":"Proceedings of the European Conference on Genetic Programming","volume":"13986","author":"Zhou Zhilei","year":"2023","unstructured":"Zhilei Zhou, Ziyu Qiu, Brad Niblett, Andrew Johnston, Jeffrey Schwartzentruber, Nur Zincir-Heywood, and Malcolm I. Heywood. 2023. A boosting approach to constructing an ensemble stack. In Proceedings of the European Conference on Genetic Programming. Gisele L. Pappa, Mario Giacobini, and Zdenek Vas\u00edcek (Eds.), LNCS, Vol. 13986, Springer, 133\u2013148."}],"container-title":["ACM Transactions on Evolutionary Learning and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3742796","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T13:35:43Z","timestamp":1770125743000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3742796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,3]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,3,31]]}},"alternative-id":["10.1145\/3742796"],"URL":"https:\/\/doi.org\/10.1145\/3742796","relation":{},"ISSN":["2688-299X","2688-3007"],"issn-type":[{"value":"2688-299X","type":"print"},{"value":"2688-3007","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,3]]},"assertion":[{"value":"2024-10-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}