{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:16:46Z","timestamp":1760710606393,"version":"3.37.3"},"reference-count":90,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,2]],"date-time":"2021-06-02T00:00:00Z","timestamp":1622592000000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Automation of machine learning model development is increasingly becoming an established research area. While automated model selection and automated data pre-processing have been studied in depth, there is, however, a gap concerning automated model adaptation strategies when multiple strategies are available. Manually developing an adaptation strategy can be time consuming and costly. In this paper we address this issue by proposing the use of flexible adaptive mechanism deployment for automated development of adaptation strategies. Experimental results after using the proposed strategies with five adaptive algorithms on 36 datasets confirm their viability. These strategies achieve better or comparable performance to the custom adaptation strategies and the repeated deployment of any single adaptive mechanism.<\/jats:p>","DOI":"10.1007\/s10994-021-05992-x","type":"journal-article","created":{"date-parts":[[2021,6,2]],"date-time":"2021-06-02T20:03:22Z","timestamp":1622664202000},"page":"1429-1462","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Automated adaptation strategies for stream learning"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2809-9626","authenticated-orcid":false,"given":"Rashid","family":"Bakirov","sequence":"first","affiliation":[]},{"given":"Damien","family":"Fay","sequence":"additional","affiliation":[]},{"given":"Bogdan","family":"Gabrys","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,6,2]]},"reference":[{"key":"5992_CR1","unstructured":"Alcob\u00e9, J. R. (2004). Incremental Hill-Climbing Search Applied to Bayesian Network Structure Learning. In Proceedings of the 18th European conference on principles and practice of knowledge discovery in databases, Volume 3202 of Lecture notes in computer science. Springer."},{"key":"5992_CR2","doi-asserted-by":"crossref","unstructured":"Alippi, C., Boracchi, G., & Roveri, M. (2012). Just-in-time ensemble of classifiers. In The 2012 international joint conference on neural networks (IJCNN) (pp 1\u20138). IEEE.","DOI":"10.1109\/IJCNN.2012.6252540"},{"issue":"3","key":"5992_CR3","doi-asserted-by":"crossref","first-page":"457","DOI":"10.2307\/2394164","volume":"23","author":"E Anderson","year":"1936","unstructured":"Anderson, E. (1936). The species problem in iris. Annals of the Missouri Botanical Garden, 23(3), 457.","journal-title":"Annals of the Missouri Botanical Garden"},{"key":"5992_CR4","unstructured":"Ba, J., & Frey, B. (2013). Adaptive dropout for training deep neural networks. In NIPS\u201913 Proceedings of the 26th international conference on neural information processing systems (pp. 3084\u20133092)."},{"key":"5992_CR5","unstructured":"Bach, S., & Maloof, M. (2010). A Bayesian approach to concept drift. In Advances in neural information (pp. 127\u2013135)."},{"key":"5992_CR6","doi-asserted-by":"crossref","unstructured":"Bakirov, R. (2017). Multiple adaptive mechanisms for predictive models on streaming data. Ph.D. thesis, Bournemouth University","DOI":"10.1016\/j.compchemeng.2016.08.017"},{"key":"5992_CR7","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1007\/978-3-642-41142-7_65","volume-title":"Artificial Intelligence Applications and Innovations","author":"R Bakirov","year":"2013","unstructured":"Bakirov, R., & Gabrys, B. (2013). Investigation of expert addition criteria for dynamically changing online ensemble classifiers with multiple adaptive mechanisms. In H. Papadopoulos, A. Andreou, L. Iliadis, & I. Maglogiannis (Eds.), Artificial Intelligence Applications and Innovations (Vol. 412, pp. 646\u2013656). Berlin: Springer."},{"key":"5992_CR8","doi-asserted-by":"crossref","unstructured":"Bakirov, R., Gabrys, B., & Fay, D. (2015). On sequences of different adaptive mechanisms in non-stationary regression problems. In 2015 international joint conference on neural networks (IJCNN) (pp. 1\u20138).","DOI":"10.1109\/IJCNN.2015.7280779"},{"key":"5992_CR9","doi-asserted-by":"crossref","unstructured":"Bakirov, R., Gabrys, B., & Fay, D. (2016). Augmenting adaptation with retrospective model correction for non-stationary regression problems. In 2016 international joint conference on neural networks (IJCNN) (pp. 771\u2013779). IEEE.","DOI":"10.1109\/IJCNN.2016.7727278"},{"key":"5992_CR10","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.compchemeng.2016.08.017","volume":"96","author":"R Bakirov","year":"2017","unstructured":"Bakirov, R., Gabrys, B., & Fay, D. (2017). Multiple adaptive mechanisms for data-driven soft sensors. Computers & Chemical Engineering, 96, 42\u201354.","journal-title":"Computers & Chemical Engineering"},{"key":"5992_CR11","first-page":"443","volume":"7","author":"A Bifet","year":"2007","unstructured":"Bifet, A., & Gavald\u00e0, R. (2007). Learning from time-changing data with adaptive windowing. SIAM International Conference on Data Mining, 7, 443\u2013448.","journal-title":"SIAM International Conference on Data Mining"},{"key":"5992_CR12","doi-asserted-by":"crossref","unstructured":"Bifet, A., Holmes, G., Gavald\u00e0, R., Pfahringer, B., & Kirkby, R. (2009). New ensemble methods for evolving data streams. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining\u2014KDD \u201909 (pp. 139\u2013147).","DOI":"10.1145\/1557019.1557041"},{"issue":"52","key":"5992_CR13","first-page":"1601","volume":"11","author":"A Bifet","year":"2010","unstructured":"Bifet, A., Holmes, G., Kirkby, R., & Pfahringer, B. (2010a). MOA: Massive online analysis. Journal of Machine Learning Research, 11(52), 1601\u20131604.","journal-title":"Journal of Machine Learning Research"},{"key":"5992_CR14","doi-asserted-by":"crossref","unstructured":"Bifet, A., Holmes, G., & Pfahringer, B. (2010b). Leveraging bagging for evolving data streams. In Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 6321 LNAI (pp. 135\u2013150).","DOI":"10.1007\/978-3-642-15880-3_15"},{"key":"5992_CR15","unstructured":"Cardillo, G. (2009). MYFRIEDMAN: Friedman test for non parametric two way ANalysis Of VAriance. Retrieved April 24, 2019, from https:\/\/www.mathworks.com\/matlabcentral\/fileexchange\/25882-myfriedman"},{"key":"5992_CR16","doi-asserted-by":"crossref","unstructured":"Carnein, M., Trautmann, H., Bifet, A., & Pfahringer, B. (2020). Towards automated configuration of stream clustering algorithms. In Communications in computer and information science, vol 1167 CCIS (pp. 137\u2013143). Springer.","DOI":"10.1007\/978-3-030-43823-4_12"},{"key":"5992_CR17","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1016\/0893-6080(91)90012-T","volume":"4","author":"G Carpenter","year":"1991","unstructured":"Carpenter, G., Grossberg, S., & Reynolds, J. (1991). ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks, 4, 565\u2013588.","journal-title":"Neural Networks"},{"key":"5992_CR18","doi-asserted-by":"crossref","unstructured":"Castillo, G., & Gama, J. (2006). An Adaptive prequential learning framework for Bayesian network classifiers. In J. F\u00fcrnkranz, T. Scheffer, M. Spiliopoulou (Eds.) Knowledge Discovery in Databases: PKDD 2006. Springer, Berlin, Heidelberg, Lecture Notes in Computer Science (Vol. 4213, pp. 67\u201378).","DOI":"10.1007\/11871637_11"},{"key":"5992_CR19","doi-asserted-by":"publisher","unstructured":"Celik, B., & Vanschoren, J. (2021). Adaptation strategies for automated machine learning on evolving data. Transactions on Pattern Analysis and Machine Intelligence. https:\/\/doi.org\/10.1109\/TPAMI.2021.3062900","DOI":"10.1109\/TPAMI.2021.3062900"},{"key":"5992_CR20","unstructured":"Chen, Y., Keogh, E., Hu, B., Begum, N., Bagnall, A., Mueen, A., & Batista, G. (2015). The UCR time series classification archive."},{"key":"5992_CR21","doi-asserted-by":"crossref","DOI":"10.1201\/9780203911358","volume-title":"Batch fermentation: Modeling: Monitoring, and control","author":"A Cinar","year":"2003","unstructured":"Cinar, A., Parulekar, S. J., Undey, C., & Birol, G. (2003). Batch fermentation: Modeling: Monitoring, and control. Boca Raton: CRC Press."},{"issue":"2","key":"5992_CR22","doi-asserted-by":"crossref","first-page":"278","DOI":"10.2307\/2981683","volume":"147","author":"AP Dawid","year":"1984","unstructured":"Dawid, A. P. (1984). Present position and potential developments: some personal views: Statistical theory: The prequential approach. Journal of the Royal Statistical Society Series A (General), 147(2), 278.","journal-title":"Journal of the Royal Statistical Society Series A (General)"},{"key":"5992_CR23","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7, 1\u201330.","journal-title":"Journal of Machine Learning Research"},{"key":"5992_CR24","doi-asserted-by":"crossref","unstructured":"Domingos, P., & Hulten, G. (2000). Mining high-speed data streams. In Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining\u2014KDD \u201900 (pp. 71\u201380).","DOI":"10.1145\/347090.347107"},{"key":"5992_CR25","unstructured":"drawNemenyi. (2019). Retrieved April 24, 2019, from https:\/\/github.com\/sepehrband\/drawNemenyi"},{"key":"5992_CR26","unstructured":"Duin, R. P. W., Juszczak, P., Paclik, P., Pekalska, E., de\u00a0Ridder, D., Tax, D. M. J., & Verzakov, S. (2007). PRTools4.1, A Matlab toolbox for pattern recognition."},{"issue":"10","key":"5992_CR27","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1109\/TNN.2011.2160459","volume":"22","author":"R Elwell","year":"2011","unstructured":"Elwell, R., & Polikar, R. (2011). Incremental learning of concept drift in nonstationary environments. IEEE Transactions on Neural Networks\/A Publication of the IEEE Neural Networks Council, 22(10), 1517\u201331.","journal-title":"IEEE Transactions on Neural Networks\/A Publication of the IEEE Neural Networks Council"},{"key":"5992_CR28","unstructured":"Fern, A., & Givan, R. (2000). Dynamic feature selection for hardware prediction. Technical report, Purdue University."},{"key":"5992_CR29","unstructured":"Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., Blum, M., & Hutter, F. (2015). Efficient and robust automated machine learning. In Advances in neural information processing systems 28 (NIPS 2015) (pp. 2962\u20132970)."},{"issue":"2","key":"5992_CR30","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","volume":"7","author":"RA Fisher","year":"1936","unstructured":"Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(2), 179\u2013188.","journal-title":"Annals of Eugenics"},{"issue":"12","key":"5992_CR31","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1016\/S0967-0661(03)00079-0","volume":"11","author":"L Fortuna","year":"2003","unstructured":"Fortuna, L., Rizzo, A., Sinatra, M., & Xibilia, M. (2003). Soft analyzers for a sulfur recovery unit. Control Engineering Practice, 11(12), 1491\u20131500.","journal-title":"Control Engineering Practice"},{"issue":"4","key":"5992_CR32","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1016\/j.conengprac.2004.04.013","volume":"13","author":"L Fortuna","year":"2005","unstructured":"Fortuna, L., Graziani, S., & Xibilia, M. (2005). Soft sensors for product quality monitoring in debutanizer distillation columns. Control Engineering Practice, 13(4), 499\u2013508.","journal-title":"Control Engineering Practice"},{"key":"5992_CR33","unstructured":"Friedman, N., & Goldszmidt, M. (1997). Sequential update of Bayesian network structure. In Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence (pp. 165\u2013174)."},{"issue":"1","key":"5992_CR34","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.fss.2003.11.010","volume":"147","author":"B Gabrys","year":"2004","unstructured":"Gabrys, B. (2004). Learning hybrid neuro-fuzzy classifier models from data: To combine or not to combine? Fuzzy Sets and Systems, 147(1), 39\u201356.","journal-title":"Fuzzy Sets and Systems"},{"issue":"5","key":"5992_CR35","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1061\/(ASCE)0733-9496(1999)125:5(272)","volume":"125","author":"B Gabrys","year":"1999","unstructured":"Gabrys, B., & Bargiela, A. (1999). Neural networks based decision support in presence of uncertainties. Journal of Water Resources Planning and Management, 125(5), 272\u2013280.","journal-title":"Journal of Water Resources Planning and Management"},{"issue":"4","key":"5992_CR36","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.asoc.2005.11.001","volume":"6","author":"B Gabrys","year":"2006","unstructured":"Gabrys, B., & Ruta, D. (2006). Genetic algorithms in classifier fusion. Applied Soft Computing, 6(4), 337\u2013347.","journal-title":"Applied Soft Computing"},{"key":"5992_CR37","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1016\/j.engappai.2014.10.003","volume":"37","author":"S Gomes Soares","year":"2015","unstructured":"Gomes Soares, S., & Ara\u00fajo, R. (2015). An on-line weighted ensemble of regressor models to handle concept drifts. Engineering Applications of Artificial Intelligence, 37, 392\u2013406.","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"1","key":"5992_CR38","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","volume":"11","author":"M Hall","year":"2009","unstructured":"Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009). The WEKA data mining software: An update. ACM SIGKDD Explorations Newsletter, 11(1), 10.","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"5992_CR39","unstructured":"Harries, M. (1999). Splice-2 comparative evaluation: Electricity pricing. Technical report. The University of South Wales."},{"key":"5992_CR40","doi-asserted-by":"crossref","unstructured":"Hazan, E., & Seshadhri, C. (2009). Efficient learning algorithms for changing environments. In ICML\u201909 Proceedings of the 26th annual international conference on machine learning (pp. 393\u2013400).","DOI":"10.1145\/1553374.1553425"},{"key":"5992_CR41","first-page":"1","volume":"29","author":"M Herbster","year":"1998","unstructured":"Herbster, M., & Warmuth, M. (1998). Tracking the best expert. Machine Learning, 29, 1\u201329.","journal-title":"Machine Learning"},{"key":"5992_CR42","doi-asserted-by":"crossref","unstructured":"Hulten, G., Spencer, L., & Domingos, P. (2001). Mining time-changing data streams. In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining\u2014KDD \u201901 (pp. 97\u2013106). ACM Press.","DOI":"10.1145\/502512.502529"},{"key":"5992_CR43","doi-asserted-by":"crossref","unstructured":"Hutter, F,. Hoos, H. H., & Leyton-Brown, K. (2011). Sequential model-based optimization for general algorithm configuration. In LION\u201905 Proceedings of the 5th international conference on Learning and Intelligent Optimization (pp. 507\u2013523). Springer.","DOI":"10.1007\/978-3-642-25566-3_40"},{"issue":"1","key":"5992_CR44","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1007\/s10618-010-0201-y","volume":"23","author":"E Ikonomovska","year":"2010","unstructured":"Ikonomovska, E., Gama, J., & D\u017eeroski, S. (2010). Learning model trees from evolving data streams. Data Mining and Knowledge Discovery, 23(1), 128\u2013168.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"5992_CR45","volume-title":"Neuro-fuzzy and soft computing: A computational approach to learning and machine intelligence","author":"JSR Jang","year":"1997","unstructured":"Jang, J. S. R., Sun, C. T., & Mizutani, E. (1997). Neuro-fuzzy and soft computing: A computational approach to learning and machine intelligence. Upper Saddle River: Prentice Hall."},{"issue":"4\u20135","key":"5992_CR46","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1016\/S0098-1354(97)00262-7","volume":"22","author":"S Joe Qin","year":"1998","unstructured":"Joe Qin, S. (1998). Recursive PLS algorithms for adaptive data modeling. Computers & Chemical Engineering, 22(4\u20135), 503\u2013514.","journal-title":"Computers & Chemical Engineering"},{"issue":"4","key":"5992_CR47","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/s12293-009-0017-8","volume":"1","author":"P Kadlec","year":"2009","unstructured":"Kadlec, P., & Gabrys, B. (2009). Architecture for development of adaptive on-line prediction models. Memetic Computing, 1(4), 241\u2013269.","journal-title":"Memetic Computing"},{"key":"5992_CR48","doi-asserted-by":"crossref","unstructured":"Kadlec, P., & Gabrys, B. (2010). Adaptive on-line prediction soft sensing without historical data. In The 2010 international joint conference on neural networks (IJCNN) (pp. 1\u20138). IEEE.","DOI":"10.1109\/IJCNN.2010.5596965"},{"issue":"5","key":"5992_CR49","doi-asserted-by":"crossref","first-page":"1288","DOI":"10.1002\/aic.12346","volume":"57","author":"P Kadlec","year":"2011","unstructured":"Kadlec, P., & Gabrys, B. (2011). Local learning-based adaptive soft sensor for catalyst activation prediction. AIChE Journal, 57(5), 1288\u20131301.","journal-title":"AIChE Journal"},{"key":"5992_CR50","unstructured":"Kedziora, D. J., Musial, K., & Gabrys, B. (2012). Autonoml: Towards an integrated framework for autonomous machine learning. 2020.12600."},{"issue":"3","key":"5992_CR51","doi-asserted-by":"crossref","first-page":"281","DOI":"10.3233\/IDA-2004-8305","volume":"8","author":"R Klinkenberg","year":"2004","unstructured":"Klinkenberg, R. (2004). Learning drifting concepts: Example selection vs. example weighting. Intelligent Data Analysis, 8(3), 281\u2013300.","journal-title":"Intelligent Data Analysis"},{"key":"5992_CR52","unstructured":"Klinkenberg, R., & Joachims, T. (2000). Detecting concept drift with support vector machines. In Proceedings of the 7th international conference on machine learning (ICML) (pp. 487\u2013494)."},{"key":"5992_CR53","first-page":"2755","volume":"8","author":"JZ Kolter","year":"2007","unstructured":"Kolter, J. Z., & Maloof, M. A. (2007). Dynamic weighted majority: An ensemble method for drifting concepts. The Journal of Machine Learning Research, 8, 2755\u20132790.","journal-title":"The Journal of Machine Learning Research"},{"issue":"25","key":"5992_CR54","first-page":"1","volume":"18","author":"L Kotthoff","year":"2017","unstructured":"Kotthoff, L., Thornton, C., Hoos, H. H., Hutter, F., & Leyton-Brown, K. (2017). Auto-WEKA 2.0: Automatic model selection and hyperparameter optimization in WEKA. Journal of Machine Learning Research, 18(25), 1\u20135.","journal-title":"Journal of Machine Learning Research"},{"key":"5992_CR55","doi-asserted-by":"crossref","DOI":"10.1002\/0471660264","volume-title":"Combining pattern classifiers: Methods and algorithms","author":"LI Kuncheva","year":"2004","unstructured":"Kuncheva, L. I. (2004). Combining pattern classifiers: Methods and algorithms. New York: Wiley-Blackwell."},{"issue":"10","key":"5992_CR56","doi-asserted-by":"crossref","first-page":"2006","DOI":"10.1016\/j.neucom.2009.09.020","volume":"73","author":"C Lemke","year":"2010","unstructured":"Lemke, C., & Gabrys, B. (2010). Meta-learning for time series forecasting and forecast combination. Neurocomputing, 73(10), 2006\u20132016.","journal-title":"Neurocomputing"},{"key":"5992_CR57","doi-asserted-by":"crossref","unstructured":"Lemke, C., Riedel, S., & Gabrys, B. (2009). Dynamic combination of forecasts generated by diversification procedures applied to forecasting of airline cancellations. In 2009 IEEE symposium on computational intelligence for financial engineering (pp. 85\u201391). IEEE.","DOI":"10.1109\/CIFER.2009.4937507"},{"issue":"2","key":"5992_CR58","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1006\/inco.1994.1009","volume":"108","author":"N Littlestone","year":"1994","unstructured":"Littlestone, N., & Warmuth, M. (1994). The weighted majority algorithm. Information and Computation, 108(2), 212\u2013261.","journal-title":"Information and Computation"},{"key":"5992_CR59","doi-asserted-by":"crossref","unstructured":"Lloyd, J. R., Duvenaud, D., Grosse, R., Tenenbaum, J. B., & Ghahramani, Z. (2014). Automatic construction and natural-language description of nonparametric regression models. In Proceedings of the 28th AAAI conference on artificial intelligence (pp. 1242\u20131250). AAAI Press.","DOI":"10.1609\/aaai.v28i1.8904"},{"key":"5992_CR60","unstructured":"Madrid, J. G., Escalante, H. J., Morales, E. F., Tu, W. W., Yu, Y., Sun-Hosoya, L., Guyon, I., & Sebag, M. (2019). Towards AutoML in the presence of Drift: first results. 1907.10772"},{"key":"5992_CR61","unstructured":"Mart\u00edn Salvador, M., Budka, M., & Gabrys, B. (2016). Adapting multicomponent predictive systems using hybrid adaptation strategies with Auto-WEKA in process industry. In AutoML at ICML 2016, 2011 (pp. 1\u20138)."},{"issue":"2","key":"5992_CR62","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1109\/TASE.2018.2876430","volume":"16","author":"M Martin Salvador","year":"2019","unstructured":"Martin Salvador, M., Budka, M., & Gabrys, B. (2019). Automatic composition and optimization of multicomponent predictive systems with an extended auto-WEKA. IEEE Transactions on Automation Science and Engineering, 16(2), 946\u2013959.","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"issue":"5","key":"5992_CR63","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1109\/TKDE.2009.156","volume":"22","author":"L Minku","year":"2010","unstructured":"Minku, L., White, A., & Yao, Xin. (2010). The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Transactions on Knowledge and Data Engineering, 22(5), 730\u2013742.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"8\u201310","key":"5992_CR64","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1007\/s10994-018-5735-z","volume":"107","author":"F Mohr","year":"2018","unstructured":"Mohr, F., Wever, M., & H\u00fcllermeier, E. (2018). ML-Plan: Automated machine learning via hierarchical planning. Machine Learning, 107(8\u201310), 1495\u20131515.","journal-title":"Machine Learning"},{"issue":"72","key":"5992_CR65","first-page":"1","volume":"19","author":"J Montiel","year":"2018","unstructured":"Montiel, J., Read, J., Bifet, A., & Kegl, B. (2018). Scikit-Multiflow: A multi-output streaming framework. Journal of Machine Learning Research, 19(72), 1\u20135.","journal-title":"Journal of Machine Learning Research"},{"key":"5992_CR66","unstructured":"Newman, D., Hettich, S., Blake, C., & Merz, C. (1998). UCI repository of machine learning databases."},{"key":"5992_CR67","doi-asserted-by":"crossref","unstructured":"Nguyen, H., Woon, Y., Ng, W., & Wan, L. (2012). Heterogeneous ensemble for feature drifts in data streams. In Advances in knowledge discovery and data mining (pp. 1\u201312). Springer.","DOI":"10.1007\/978-3-642-30220-6_1"},{"key":"5992_CR68","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1007\/978-3-030-44584-3_28","volume-title":"Advances in Intelligent Data Analysis XVIII","author":"TD Nguyen","year":"2020","unstructured":"Nguyen, T. D., Maszczyk, T., Musial, K., Z\u00f6ller, M. A., & Gabrys, B. (2020). Avatar\u2014Machine learning pipeline evaluation using surrogate model. In M. R. Berthold, A. Feelders, & G. Krempl (Eds.), Advances in Intelligent Data Analysis XVIII (pp. 352\u2013365). Cham: Springer International Publishing."},{"key":"5992_CR69","first-page":"151","volume-title":"TPOT: A tree-based pipeline optimization tool for automating machine learning","author":"RS Olson","year":"2019","unstructured":"Olson, R. S., & Moore, J. H. (2019). TPOT: A tree-based pipeline optimization tool for automating machine learning (pp. 151\u2013160). Cham: Springer."},{"key":"5992_CR70","first-page":"105","volume":"2001","author":"NC Oza","year":"2001","unstructured":"Oza, N. C., & Russell, S. (2001). Online bagging and boosting. Artificial Intelligence and Statistics, 2001, 105\u2013112.","journal-title":"Artificial Intelligence and Statistics"},{"key":"5992_CR71","doi-asserted-by":"crossref","unstructured":"van Rijn, J. N., Holmes, G., Pfahringer, B., & Vanschoren, J. (2015). Having a blast: Meta-learning and heterogeneous ensembles for data streams. In: 2015 IEEE international conference on data mining (ICDM) (pp. 1003\u20131008). IEEE.","DOI":"10.1109\/ICDM.2015.55"},{"key":"5992_CR72","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.neucom.2013.05.048","volume":"127","author":"ALD Rossi","year":"2014","unstructured":"Rossi, A. L. D., de Leon Ferreira, A. C. P., Soares, C., & De Souza, B. F. (2014). MetaStream: A meta-learning based method for periodic algorithm selection in time-changing data. Neurocomputing, 127, 52\u201364.","journal-title":"Neurocomputing"},{"issue":"3","key":"5992_CR73","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1109\/TKDE.2010.137","volume":"23","author":"D Ruta","year":"2011","unstructured":"Ruta, D., Gabrys, B., & Lemke, C. (2011). A Generic Multilevel Architecture for Time Series Prediction. IEEE Transactions on Knowledge and Data Engineering, 23(3), 350\u2013359.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"5992_CR74","doi-asserted-by":"crossref","unstructured":"Sahel, Z., Bouchachia, A., Gabrys, B., & Rogers, P. (2007). Adaptive mechanisms for classification problems with drifting data. In Proceeding of the 11th international conference on knowledge-based intelligent engineering systems (KES\u20192007) (pp. 419\u2013426). Springer.","DOI":"10.1007\/978-3-540-74827-4_53"},{"key":"5992_CR75","unstructured":"Schlimmer, J. C., & Granger, R. H. (1986). Beyond incremental processing: Tracking Concept Drift. In AAAI-86 Proceedings (pp. 502\u2013507)."},{"key":"5992_CR76","doi-asserted-by":"crossref","unstructured":"Schmidt, M., & Lipson, H. (2007). Learning noise. In Proceedings of the 9th annual conference on Genetic and evolutionary computation\u2014GECCO \u201907 (pp. 1680\u20131685).","DOI":"10.1145\/1276958.1277289"},{"issue":"1","key":"5992_CR77","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3233\/IDA-2007-11102","volume":"11","author":"M Scholz","year":"2007","unstructured":"Scholz, M., & Klinkenberg, R. (2007). Boosting classifiers for drifting concepts. Intelligent Data Analysis, 11(1), 1\u201340.","journal-title":"Intelligent Data Analysis"},{"key":"5992_CR78","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TII.2013.2283147","volume":"10","author":"F Souza","year":"2014","unstructured":"Souza, F., & Ara\u00fajo, R. (2014). Online mixture of univariate linear regression models for adaptive soft sensors. IEEE Transactions on Industrial Informatics, 10, 937\u2013945.","journal-title":"IEEE Transactions on Industrial Informatics"},{"issue":"2","key":"5992_CR79","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1162\/106365602320169811","volume":"10","author":"KO Stanley","year":"2002","unstructured":"Stanley, K. O. (2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2), 99\u2013127.","journal-title":"Evolutionary Computation"},{"key":"5992_CR80","unstructured":"Strackeljan, J. (2006). NiSIS Competition 2006-Soft Sensor for the adaptive Catalyst Monitoring of a Multi-Tube Reactor. Technical report, Universit\u00e4t Magdeburg."},{"key":"5992_CR81","doi-asserted-by":"crossref","unstructured":"Street, W. N., & Kim, Y. S. (2001). A streaming ensemble algorithm (SEA) for large-scale classification. In Proceedings of the 7th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 377\u2013382).","DOI":"10.1145\/502512.502568"},{"issue":"3","key":"5992_CR82","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1023\/A:1026004816362","volume":"17","author":"MT Vakil-Baghmisheh","year":"2003","unstructured":"Vakil-Baghmisheh, M. T., & Pave\u0161i\u0107, N. (2003). A fast simplified fuzzy ARTMAP network. Neural Processing Letters, 17(3), 273\u2013316.","journal-title":"Neural Processing Letters"},{"key":"5992_CR83","doi-asserted-by":"crossref","unstructured":"Veloso, B., Gama, J., & Malheiro, B. (2018). Self hyper-parameter tuning for data streams. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol 11198 LNAI (pp. 241\u2013255). Springer.","DOI":"10.1007\/978-3-030-01771-2_16"},{"key":"5992_CR84","doi-asserted-by":"crossref","unstructured":"Wang, H., Fan, W., Yu, P. S., & Han, J. (2003). Mining concept-drifting data streams using ensemble classifiers. In Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining\u2014KDD \u201903 (pp. 226\u2013235). ACM Press.","DOI":"10.1145\/956750.956778"},{"issue":"1","key":"5992_CR85","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1006\/jmps.1999.1278","volume":"44","author":"L Wasserman","year":"2000","unstructured":"Wasserman, L. (2000). Bayesian model selection and model averaging. Journal of Mathematical Psychology, 44(1), 92\u2013107.","journal-title":"Journal of Mathematical Psychology"},{"issue":"1","key":"5992_CR86","first-page":"69","volume":"23","author":"G Widmer","year":"1996","unstructured":"Widmer, G., & Kubat, M. (1996). Learning in the presence of concept drift and hidden contexts. Machine Learning, 23(1), 69\u2013101.","journal-title":"Machine Learning"},{"issue":"6","key":"5992_CR87","doi-asserted-by":"publisher","first-page":"80","DOI":"10.2307\/3001968","volume":"1","author":"F Wilcoxon","year":"1945","unstructured":"Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin, 1(6), 80. https:\/\/doi.org\/10.2307\/3001968.","journal-title":"Biometrics Bulletin"},{"key":"5992_CR88","unstructured":"Zhu, X. (2010). Stream Data Mining Repository. Retrieved April 19, 2013, from http:\/\/www.cse.fau.edu\/~xqzhu\/stream.html"},{"issue":"4","key":"5992_CR89","doi-asserted-by":"crossref","first-page":"589","DOI":"10.3233\/IDA-2011-0484","volume":"15","author":"I Zliobaite","year":"2011","unstructured":"Zliobaite, I. (2011). Combining similarity in time and space for training set formation under concept drift. Intelligent Data Analysis, 15(4), 589\u2013611.","journal-title":"Intelligent Data Analysis"},{"key":"5992_CR90","unstructured":"Zliobaite, I., & Kuncheva, L. I. (2010). Theoretical window size for classification in the presence of sudden concept drift. Technical report, CS-TR-001-2010, Bangor University, UK."}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05992-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-021-05992-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05992-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T13:38:34Z","timestamp":1672321114000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-021-05992-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6]]},"references-count":90,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["5992"],"URL":"https:\/\/doi.org\/10.1007\/s10994-021-05992-x","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"type":"print","value":"0885-6125"},{"type":"electronic","value":"1573-0565"}],"subject":[],"published":{"date-parts":[[2021,6]]},"assertion":[{"value":"7 October 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}