{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T19:58:54Z","timestamp":1760385534485},"reference-count":44,"publisher":"MIT Press - Journals","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Evolutionary Computation"],"published-print":{"date-parts":[[2018,3]]},"abstract":"<jats:p> Many real-world problems involve massive amounts of data. Under these circumstances learning algorithms often become prohibitively expensive, making scalability a pressing issue to be addressed. A common approach is to perform sampling to reduce the size of the dataset and enable efficient learning. Alternatively, one customizes learning algorithms to achieve scalability. In either case, the key challenge is to obtain algorithmic efficiency without compromising the quality of the results. In this article we discuss a meta-learning algorithm (PSBML) that combines concepts from spatially structured evolutionary algorithms (SSEAs) with concepts from ensemble and boosting methodologies to achieve the desired scalability property. We present both theoretical and empirical analyses which show that PSBML preserves a critical property of boosting, specifically, convergence to a distribution centered around the margin. We then present additional empirical analyses showing that this meta-level algorithm provides a general and effective framework that can be used in combination with a variety of learning classifiers. We perform extensive experiments to investigate the trade-off achieved between scalability and accuracy, and robustness to noise, on both synthetic and real-world data. These empirical results corroborate our theoretical analysis, and demonstrate the potential of PSBML in achieving scalability without sacrificing accuracy. <\/jats:p>","DOI":"10.1162\/evco_a_00202","type":"journal-article","created":{"date-parts":[[2016,12,16]],"date-time":"2016-12-16T17:30:16Z","timestamp":1481909416000},"page":"43-66","source":"Crossref","is-referenced-by-count":1,"title":["Theoretical and Empirical Analysis of a Spatial EA Parallel Boosting Algorithm"],"prefix":"10.1162","volume":"26","author":[{"given":"Uday","family":"Kamath","sequence":"first","affiliation":[{"name":"Computer Science Department, George Mason University, Fairfax, Virginia, 22030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlotta","family":"Domeniconi","sequence":"additional","affiliation":[{"name":"Computer Science Department, George Mason University, Fairfax, Virginia, 22030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kenneth","family":"De Jong","sequence":"additional","affiliation":[{"name":"Computer Science Department, George Mason University, Fairfax, Virginia, 22030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24854-5_88"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775090"},{"key":"B3","first-page":"161","volume-title":"Advances in neural information processing systems","author":"Bottou L.","year":"2008"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"B5","volume-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence","volume":"29","author":"Carreira-Perpi\u00f1\u00e1n M.","year":"2005"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44935-3_44"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25324-9_16"},{"key":"B8","first-page":"521","volume-title":"Neural Information Processing Systems","volume":"17","author":"Chang E. Y.","year":"2007"},{"key":"B9","first-page":"281","volume-title":"Advances in neural information processing systems","author":"Chu C. T.","year":"2007"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143874"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.03.043"},{"key":"B12","unstructured":"Drost, I., Dunning, T., Eastman, J., Gospodnetic, O., Ingersoll, G., Mannix, J., Owen, S., and Wettin, K. (2010). Apache Mahout. Apache Software Foundation. Retrieved from http:\/\/mloss.org\/software\/view\/144\/."},{"key":"B13","first-page":"125","volume-title":"Proceedings of Knowledge Discovery and Data Mining","author":"Elkan C","year":"1997"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2011.2160459"},{"key":"B15","first-page":"1871","volume-title":"Journal of Machine Learning Research","volume":"9","author":"Fan R.-E.","year":"2008"},{"issue":"1532","key":"B16","first-page":"1889","volume":"6","author":"Fan R.-E.","year":"2005","journal-title":"Journal of Machine Learning Research"},{"key":"B17","unstructured":"Favre, B., Hakkani-T\u00fcr, D., and Cuendet, S. (2007). icsiboost. Retrieved from http:\/\/code.google.come\/p\/icsiboost."},{"key":"B18","unstructured":"Frank, A., and Asuncion, A. (2010). UCI machine learning repository. Retrieved from http:\/\/archive.ics.uci.edu\/ml."},{"key":"B19","first-page":"148","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Freund Y.","year":"1996"},{"key":"B20","unstructured":"Fung, G., and Mangasarian, O. L. (2002). A feature selection Newton method for support vector machine classification. Technical Report 02-03, Data Mining Institute, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin."},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1109\/72.80230"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2005.850298"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"B24","first-page":"169","volume-title":"Advances in kernel methods","author":"Joachims T.","year":"1999"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1145\/2463372.2463503"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32937-1_21"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390233"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-25966-4_29"},{"key":"B29","first-page":"554","volume-title":"Advances in neural information processing systems","author":"Rasmussen C. E.","year":"2000"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-61723-X_988"},{"key":"B31","first-page":"181","volume-title":"Proceedings of the International Computer Games Association","author":"Sarma J.","year":"1997"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1024691352"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007614523901"},{"key":"B34","first-page":"544","volume-title":"Proceedings of the 22nd International Conference on Very Large Databases","author":"Shafer J.","year":"1996"},{"key":"B35","volume-title":"Workshop on High Performance Analytics\u2014Algorithms, Implementations, and Applications, Siam Conference on Data Mining","author":"Srinivasan B. V.","year":"2010"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2005.251"},{"issue":"3","key":"B37","first-page":"66","volume":"12","author":"Stone J. E.","year":"2010","journal-title":"IEEE Design & Test of Computers"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139042918.009"},{"key":"B39","volume-title":"Spatially structured evolutionary algorithms: Artificial evolution in space and time","author":"Tomassini M","year":"2005"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273611"},{"key":"B41","first-page":"363","volume-title":"Journal of Machine Learning Research","volume":"6","author":"Tsang I. W.","year":"2005"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2440-0"},{"key":"B43","first-page":"1937","volume-title":"Journal of Machine Learning Research","volume":"10","author":"Woodsend K.","year":"2009"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1145\/956750.956786"}],"container-title":["Evolutionary Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/evco_a_00202","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:58:54Z","timestamp":1615586334000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/evco\/article\/26\/1\/43-66\/1059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,3]]}},"alternative-id":["10.1162\/evco_a_00202"],"URL":"https:\/\/doi.org\/10.1162\/evco_a_00202","relation":{},"ISSN":["1063-6560","1530-9304"],"issn-type":[{"value":"1063-6560","type":"print"},{"value":"1530-9304","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3]]}}}