{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T11:40:12Z","timestamp":1680262812224},"reference-count":46,"publisher":"Walter de Gruyter GmbH","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,10,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The accuracy of many regression models suffers from inhomogeneous data coverage. Models loose accuracy because they are unable to locally adapt the model complexity. This article develops and evaluates an automated design process for the generation of hybrid regression models from arbitrary submodels. For the first time, these submodels are weighted by a One-Class Support Vector Machine, taking local data coverage into account. Compared to reference regression models, the newly developed hybrid models achieve significant better results in nine out of ten benchmark datasets. To enable straightforward usage in data science, an implementation is integrated in the open source MATLAB toolbox SciXMiner.<\/jats:p>","DOI":"10.1515\/auto-2019-0013","type":"journal-article","created":{"date-parts":[[2019,9,27]],"date-time":"2019-09-27T09:03:01Z","timestamp":1569574981000},"page":"843-852","source":"Crossref","is-referenced-by-count":5,"title":["Automated design process for hybrid regression modeling with a one-class SVM"],"prefix":"10.1515","volume":"67","author":[{"given":"Moritz","family":"B\u00f6hland","sequence":"first","affiliation":[{"name":"Institute for Automation and Applied Informatics (IAI) , Karlsruhe Institute of Technology (KIT) , Eggenstein-Leopoldshafen , Germany"}]},{"given":"Wolfgang","family":"Doneit","sequence":"additional","affiliation":[{"name":"Dr. Wieselhuber & Partner GmbH , M\u00fcnchen , Germany"}]},{"given":"Lutz","family":"Gr\u00f6ll","sequence":"additional","affiliation":[{"name":"Institute for Automation and Applied Informatics (IAI) , Karlsruhe Institute of Technology (KIT) , Eggenstein-Leopoldshafen , Germany"}]},{"given":"Ralf","family":"Mikut","sequence":"additional","affiliation":[{"name":"Institute for Automation and Applied Informatics (IAI) , Karlsruhe Institute of Technology (KIT) , Eggenstein-Leopoldshafen , Germany"}]},{"given":"Markus","family":"Reischl","sequence":"additional","affiliation":[{"name":"Institute for Automation and Applied Informatics (IAI) , Karlsruhe Institute of Technology (KIT) , Eggenstein-Leopoldshafen , Germany"}]}],"member":"374","published-online":{"date-parts":[[2019,9,27]]},"reference":[{"key":"2023033110060393927_j_auto-2019-0013_ref_001_w2aab3b7b1b1b6b1ab1b6b1Aa","doi-asserted-by":"crossref","unstructured":"Avnimelech, R.; Intrator, N.: Boosting Regression Estimators. Neural Computation 11 (1999) 2, pp.\u2009499\u2013520.10.1162\/089976699300016746","DOI":"10.1162\/089976699300016746"},{"key":"2023033110060393927_j_auto-2019-0013_ref_002_w2aab3b7b1b1b6b1ab1b6b2Aa","doi-asserted-by":"crossref","unstructured":"Babu\u0161ka, R.: Fuzzy Modeling for Control. Boston: Kluwer, 1998.","DOI":"10.1007\/978-94-011-4868-9"},{"key":"2023033110060393927_j_auto-2019-0013_ref_003_w2aab3b7b1b1b6b1ab1b6b3Aa","doi-asserted-by":"crossref","unstructured":"Babyak, M.\u2009A.: What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type Models. Psychosomatic Medicine 66 (2004) p.\u20093.","DOI":"10.1097\/00006842-200405000-00021"},{"key":"2023033110060393927_j_auto-2019-0013_ref_004_w2aab3b7b1b1b6b1ab1b6b4Aa","doi-asserted-by":"crossref","unstructured":"B\u00e4nfer, O.; Hartmann, B.; Nelles, O.: POLYMOT versus HILOMOT \u2013 A Comparison of Two Different Training Algorithms for Local Model Networks. IFAC Proceedings Volumes 45 (2012) 16, pp.\u20091569\u20131574.10.3182\/20120711-3-BE-2027.00354","DOI":"10.3182\/20120711-3-BE-2027.00354"},{"key":"2023033110060393927_j_auto-2019-0013_ref_005_w2aab3b7b1b1b6b1ab1b6b5Aa","doi-asserted-by":"crossref","unstructured":"Bishop, C.\u2009M.: Novelty Detection and Neural Network Validation. IEE Proceedings \u2013 Vision, Image and Signal Processing 141 (1994) 4, pp.\u2009217\u2013222.10.1049\/ip-vis:19941330","DOI":"10.1049\/ip-vis:19941330"},{"key":"2023033110060393927_j_auto-2019-0013_ref_006_w2aab3b7b1b1b6b1ab1b6b6Aa","unstructured":"Bishop, C.\u2009M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Secaucus, NJ, USA: Springer, 2006."},{"key":"2023033110060393927_j_auto-2019-0013_ref_007_w2aab3b7b1b1b6b1ab1b6b7Aa","doi-asserted-by":"crossref","unstructured":"Breiman, L.: Bagging Predictors. Machine Learning 24 (1996) 2, pp.\u2009123\u2013140.10.1007\/BF00058655","DOI":"10.1007\/BF00058655"},{"key":"2023033110060393927_j_auto-2019-0013_ref_008_w2aab3b7b1b1b6b1ab1b6b8Aa","doi-asserted-by":"crossref","unstructured":"B\u00fchlmann, P.; Hothorn, T.: Boosting Algorithms: Regularization, Prediction and Model Fitting. Statistical Science 22 (2007) 4, pp.\u2009477\u2013505.10.1214\/07-STS242","DOI":"10.1214\/07-STS242"},{"key":"2023033110060393927_j_auto-2019-0013_ref_009_w2aab3b7b1b1b6b1ab1b6b9Aa","doi-asserted-by":"crossref","unstructured":"Chang, C.-C.; Lin, C.-J.: LIBSVM: A Library for Support Vector Machines. ACM Transactions on Intelligent Systems and Technology 2 (2011), pp.\u200927:1\u201327:27, software available at http:\/\/www.csie.ntu.edu.tw\/~cjlin\/libsvm.","DOI":"10.1145\/1961189.1961199"},{"key":"2023033110060393927_j_auto-2019-0013_ref_010_w2aab3b7b1b1b6b1ab1b6c10Aa","doi-asserted-by":"crossref","unstructured":"Dannecker, L.: Energy Time Series Forecasting: Efficient and Accurate Forecasting of Evolving Time Series from the Energy Domain. Springer Vieweg, 1st ed. 2015 Aufl., 2015.","DOI":"10.1007\/978-3-658-11039-0_1"},{"key":"2023033110060393927_j_auto-2019-0013_ref_011_w2aab3b7b1b1b6b1ab1b6c11Aa","unstructured":"Dheeru, D.; Karra Taniskidou, E.: {UCI} Machine Learning Repository. 2017."},{"key":"2023033110060393927_j_auto-2019-0013_ref_012_w2aab3b7b1b1b6b1ab1b6c12Aa","unstructured":"Doneit, W.: Eine neue Methode zum robusten Entwurf von Regressionsmodellen bei beschr\u00e4nkter Rohdatenqualit\u00e4t. Dissertation, Karlsruher Institut f\u00fcr Technologie (KIT), 2018."},{"key":"2023033110060393927_j_auto-2019-0013_ref_013_w2aab3b7b1b1b6b1ab1b6c13Aa","doi-asserted-by":"crossref","unstructured":"Doneit, W.; Mikut, R.; Gr\u00f6ll, L.; Pychynski, T.; Reischl, M.: DaMoQ: Eine Open-Source-MATLAB-Toolbox zur Bewertung von Daten- und Modellqualit\u00e4t in Regressionen. at \u2013 Automatisierungstechnik 65 (2017) 3, pp.\u2009207\u2013218.","DOI":"10.1515\/auto-2016-0128"},{"key":"2023033110060393927_j_auto-2019-0013_ref_014_w2aab3b7b1b1b6b1ab1b6c14Aa","unstructured":"Ebert, T.; Belz, J.; Nelles, O.: Detektion von Extrapolation. In: Proceedings of the 24. Workshop on Computational Intelligence, Dortmund, Germany, Bd. 50, pp.\u200917\u201332, 2014."},{"key":"2023033110060393927_j_auto-2019-0013_ref_015_w2aab3b7b1b1b6b1ab1b6c15Aa","unstructured":"Falkner, S.; Klein, A.; Hutter, F.: BOHB: Robust and Efficient Hyperparameter Optimization at Scale. In: Proceedings of the 35th International Conference on Machine Learning (Dy, J.; Krause, A., Hg.), Bd. 80 von Proceedings of Machine Learning Research, pp.\u20091437\u20131446, Stockholmsm\u00e4ssan, Stockholm Sweden: PMLR, 2018."},{"key":"2023033110060393927_j_auto-2019-0013_ref_016_w2aab3b7b1b1b6b1ab1b6c16Aa","doi-asserted-by":"crossref","unstructured":"Forrester, A.; Sobester, A.; Keane, A.: Engineering Design via Surrogate Modelling: A Practical Guide. John Wiley & Sons, 2008.","DOI":"10.1002\/9780470770801"},{"key":"2023033110060393927_j_auto-2019-0013_ref_017_w2aab3b7b1b1b6b1ab1b6c17Aa","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez Ordiano, J.\u2009\u00c1.; Waczowicz, S.; Hagenmeyer, V.; Mikut, R.: Energy Forecasting Tools and Services. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 8 (2018) 2, p.\u2009e1235.","DOI":"10.1002\/widm.1235"},{"key":"2023033110060393927_j_auto-2019-0013_ref_018_w2aab3b7b1b1b6b1ab1b6c18Aa","doi-asserted-by":"crossref","unstructured":"Goodband, J.; Haas, O.; Mills, J.: A Mixture of Experts Committee Machine to Design Compensators for Intensity Modulated Radiation Therapy. Pattern Recognition 39 (2006) 9, pp.\u20091704\u20131714.10.1016\/j.patcog.2006.03.018","DOI":"10.1016\/j.patcog.2006.03.018"},{"key":"2023033110060393927_j_auto-2019-0013_ref_019_w2aab3b7b1b1b6b1ab1b6c19Aa","unstructured":"Hartmann, B.; Ebert, T.; Fischer, T.; Belz, J.; Kampmann, G.; Nelles, O.: LMNTOOL\u2013Toolbox zum Automatischen Trainieren Lokaler Modellnetze. In: Proceedings of the 22. Workshop Computational Intelligence (Hoffmann, F.; H\u00fcllermeier, E., Hg.), pp.\u2009341\u2013355, 2014."},{"key":"2023033110060393927_j_auto-2019-0013_ref_020_w2aab3b7b1b1b6b1ab1b6c20Aa","doi-asserted-by":"crossref","unstructured":"Hoffmann, F.; Bertram, T.; Mikut, R.; Reischl, M.; Nelles, O.: Benchmarking in classification and regression. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 9 (2019) 5, e1318. doi:10.1002\/widm.1318.","DOI":"10.1002\/widm.1318"},{"key":"2023033110060393927_j_auto-2019-0013_ref_021_w2aab3b7b1b1b6b1ab1b6c21Aa","doi-asserted-by":"crossref","unstructured":"Khan, S.\u2009S.; Madden, M.\u2009G.: One-Class Classification: Taxonomy of Study and Review of Techniques. The Knowledge Engineering Review 29 (2014) 03, pp.\u2009345\u2013374.10.1017\/S026988891300043X","DOI":"10.1017\/S026988891300043X"},{"key":"2023033110060393927_j_auto-2019-0013_ref_022_w2aab3b7b1b1b6b1ab1b6c22Aa","doi-asserted-by":"crossref","unstructured":"Kroll, A.: Computational Intelligence: Eine Einf\u00fchrung in Probleme, Methoden und technische Anwendungen. Oldenbourg, M\u00fcnchen, Germany, 2013.","DOI":"10.1524\/9783486737424"},{"key":"2023033110060393927_j_auto-2019-0013_ref_023_w2aab3b7b1b1b6b1ab1b6c23Aa","doi-asserted-by":"crossref","unstructured":"Kroll, A.; Abel, D.: Modellbasierte Pr\u00e4diktive Regelung (Model Predictive Control). at \u2013 Automatisierungstechnik 54 (2006) 12, pp.\u2009587\u2013589.","DOI":"10.1524\/auto.2006.54.12.587"},{"key":"2023033110060393927_j_auto-2019-0013_ref_024_w2aab3b7b1b1b6b1ab1b6c24Aa","doi-asserted-by":"crossref","unstructured":"Leonard, J.; Kramer, M.\u2009A.; Ungar, L.: A Neural Network Architecture that Computes its Own Reliability. Computers & Chemical Engineering 16 (1992) 9, pp.\u2009819\u2013835.10.1016\/0098-1354(92)80035-8","DOI":"10.1016\/0098-1354(92)80035-8"},{"key":"2023033110060393927_j_auto-2019-0013_ref_025_w2aab3b7b1b1b6b1ab1b6c25Aa","doi-asserted-by":"crossref","unstructured":"Leonard, J.\u2009A.; Kramer, M.\u2009A.; Ungar, L.\u2009H.: Using Radial Basis Functions to Approximate a Function and its Error Bounds. IEEE Transactions on Neural Networks 3 (1992) 4, pp.\u2009624\u2013627.10.1109\/72.143377","DOI":"10.1109\/72.143377"},{"key":"2023033110060393927_j_auto-2019-0013_ref_026_w2aab3b7b1b1b6b1ab1b6c26Aa","doi-asserted-by":"crossref","unstructured":"Matalas, N.; Bier, V.: B. Extremes, Extrapolation, And Surprise. Risk Analysis 19 (1999) 1, pp.\u200949\u201354.10.1111\/j.1539-6924.1999.tb00387.x","DOI":"10.1111\/j.1539-6924.1999.tb00387.x"},{"key":"2023033110060393927_j_auto-2019-0013_ref_027_w2aab3b7b1b1b6b1ab1b6c27Aa","unstructured":"Mikut, R.; Bartschat, A.; Doneit, W.; Ordiano, J.\u2009\u00c1.\u2009G.; Schott, B.; Stegmaier, J.; Waczowicz, S.; Reischl, M.: The MATLAB Toolbox SciXMiner: User\u2019s Manual and Programmer\u2019s Guide. Techn. Ber., arXiv:1704.03298, 2017."},{"key":"2023033110060393927_j_auto-2019-0013_ref_028_w2aab3b7b1b1b6b1ab1b6c28Aa","doi-asserted-by":"crossref","unstructured":"Moretti, F.; Pizzuti, S.; Panzieri, S.; Annunziato, M.: Urban Traffic Flow Forecasting Through Statistical and Neural Network Bagging Ensemble Hybrid Modeling. Neurocomputing 167 (2015), pp.\u20093\u20137.","DOI":"10.1016\/j.neucom.2014.08.100"},{"key":"2023033110060393927_j_auto-2019-0013_ref_029_w2aab3b7b1b1b6b1ab1b6c29Aa","unstructured":"Murray-Smith, R.: Local Model Networks and Local Learning. In: Fuzzy Duisburg, \u201994, 1994."},{"key":"2023033110060393927_j_auto-2019-0013_ref_030_w2aab3b7b1b1b6b1ab1b6c30Aa","unstructured":"Murray-Smith, R.; Johansen, T.: Multiple Model Approaches to Nonlinear Modelling and Control. CRC press, 1997."},{"key":"2023033110060393927_j_auto-2019-0013_ref_031_w2aab3b7b1b1b6b1ab1b6c31Aa","doi-asserted-by":"crossref","unstructured":"Nelles, O.: LOLIMOT \u2013 Lokale, lineare Modelle zur Identifikation nichtlinearer, dynamischer Systeme. at \u2013 Automatisierungstechnik 45 (1997) 4, pp.\u2009163\u2013174.","DOI":"10.1524\/auto.1997.45.4.163"},{"key":"2023033110060393927_j_auto-2019-0013_ref_032_w2aab3b7b1b1b6b1ab1b6c32Aa","doi-asserted-by":"crossref","unstructured":"Nelles, O.; Fink, A.; Isermann, R.: Local Linear Model Trees (LOLIMOT) Toolbox for Nonlinear System Identification. IFAC Proceedings Volumes 33 (2000) 15, pp.\u2009845\u2013850.10.1016\/S1474-6670(17)39858-0","DOI":"10.1016\/S1474-6670(17)39858-0"},{"key":"2023033110060393927_j_auto-2019-0013_ref_033_w2aab3b7b1b1b6b1ab1b6c33Aa","unstructured":"Nelles, O.; Fischer, M.: Local Linear Model Trees (LOLIMOT) for Nonlinear System Identification of a Cooling Blast. In: Proc., 4th European Congress on Intelligent Techniques and Soft Computing EUFIT\u201996, pp.\u20091187\u20131191, Aachen, 1996."},{"key":"2023033110060393927_j_auto-2019-0013_ref_034_w2aab3b7b1b1b6b1ab1b6c34Aa","doi-asserted-by":"crossref","unstructured":"Parzen, E.: On Estimation of a Probability Density Function and Mode. The Annals of Mathematical Statistics (1962), pp.\u20091065\u20131076.","DOI":"10.1214\/aoms\/1177704472"},{"key":"2023033110060393927_j_auto-2019-0013_ref_035_w2aab3b7b1b1b6b1ab1b6c35Aa","doi-asserted-by":"crossref","unstructured":"Pimentel, M.\u2009A.; Clifton, D.\u2009A.; Clifton, L.; Tarassenko, L.: A Review of Novelty Detection. Signal Processing 99 (2014), pp.\u2009215\u2013249.","DOI":"10.1016\/j.sigpro.2013.12.026"},{"key":"2023033110060393927_j_auto-2019-0013_ref_036_w2aab3b7b1b1b6b1ab1b6c36Aa","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B.; Platt, J.\u2009C.; Shawe-Taylor, J.; Smola, A.\u2009J.; Williamson, R.\u2009C.: Estimating the Support of a High-Dimensional Distribution. Neural Computation 13 (2001) 7, pp.\u20091443\u20131471.10.1162\/089976601750264965","DOI":"10.1162\/089976601750264965"},{"key":"2023033110060393927_j_auto-2019-0013_ref_037_w2aab3b7b1b1b6b1ab1b6c37Aa","doi-asserted-by":"crossref","unstructured":"Shin, H.\u2009J.; Eom, D.-H.; Kim, S.-S.: One-Class Support Vector Machines \u2013 an Application in Machine Fault Detection and Classification. Computers & Industrial Engineering 48 (2005) 2, pp.\u2009395\u2013408.10.1016\/j.cie.2005.01.009","DOI":"10.1016\/j.cie.2005.01.009"},{"key":"2023033110060393927_j_auto-2019-0013_ref_038_w2aab3b7b1b1b6b1ab1b6c38Aa","unstructured":"Tagscherer, D.-I.\u2009M.; Lewandowski, A.: Absch\u00e4tzung der Vertrauensw\u00fcrdigkeit von Neuronalen Netzprognosen bei der Prozessoptimierung. In: VDI-Berichte, Bd. 1626, pp.\u2009335\u2013339, 2000."},{"key":"2023033110060393927_j_auto-2019-0013_ref_039_w2aab3b7b1b1b6b1ab1b6c39Aa","unstructured":"Tax, D.\u2009M.\u2009J.: One-Class Classification. Dissertation, Technische Universit\u00e4t Delft, 2001."},{"key":"2023033110060393927_j_auto-2019-0013_ref_040_w2aab3b7b1b1b6b1ab1b6c40Aa","unstructured":"Tresp, V.: Committee Machines, pp.\u20091\u201318. Boca Raton, FL: CRC Press, 2001."},{"key":"2023033110060393927_j_auto-2019-0013_ref_041_w2aab3b7b1b1b6b1ab1b6c41Aa","unstructured":"Vapnik, V.\u2009N.: Statistical Learning Theory. John Wiley, 1998."},{"key":"2023033110060393927_j_auto-2019-0013_ref_042_w2aab3b7b1b1b6b1ab1b6c42Aa","doi-asserted-by":"crossref","unstructured":"Wang, W.; Xu, Z.; Lu, W.; Zhang, X.: Determination of the Spread Parameter in the Gaussian Kernel for Classification and Regression. Neurocomputing 55 (2003) 3\u20134, pp.\u2009643\u2013663.10.1016\/S0925-2312(02)00632-X","DOI":"10.1016\/S0925-2312(02)00632-X"},{"key":"2023033110060393927_j_auto-2019-0013_ref_043_w2aab3b7b1b1b6b1ab1b6c43Aa","unstructured":"Waterhouse, S.\u2009R.: Classification and Regression Using Mixtures of Experts. Dissertation, University of Cambridge, 1998."},{"key":"2023033110060393927_j_auto-2019-0013_ref_044_w2aab3b7b1b1b6b1ab1b6c44Aa","doi-asserted-by":"crossref","unstructured":"Yuksel, S.\u2009E.; Wilson, J.\u2009N.; Gader, P.\u2009D.: Twenty Years of Mixture of Experts. IEEE Transactions on Neural Networks and Learning Systems 23 (2012) 8, pp.\u20091177\u20131193.10.1109\/TNNLS.2012.2200299","DOI":"10.1109\/TNNLS.2012.2200299"},{"key":"2023033110060393927_j_auto-2019-0013_ref_045_w2aab3b7b1b1b6b1ab1b6c45Aa","doi-asserted-by":"crossref","unstructured":"Zhang, Y.; Haghani, A.: A Gradient Boosting Method to Improve Travel Time Prediction. Transportation Research Part C: Emerging Technologies 58 (2015), pp.\u2009308\u2013324.10.1016\/j.trc.2015.02.019","DOI":"10.1016\/j.trc.2015.02.019"},{"key":"2023033110060393927_j_auto-2019-0013_ref_046_w2aab3b7b1b1b6b1ab1b6c46Aa","doi-asserted-by":"crossref","unstructured":"Zhou, Z.-H.: Ensemble Methods: Foundations and Algorithms. Chapman and Hall\/CRC, 2012.","DOI":"10.1201\/b12207"}],"container-title":["at - Automatisierungstechnik"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.degruyter.com\/view\/j\/auto.2019.67.issue-10\/auto-2019-0013\/auto-2019-0013.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/auto-2019-0013\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/auto-2019-0013\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T11:05:51Z","timestamp":1680260751000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/auto-2019-0013\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,27]]},"references-count":46,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,9,27]]},"published-print":{"date-parts":[[2019,10,25]]}},"alternative-id":["10.1515\/auto-2019-0013"],"URL":"https:\/\/doi.org\/10.1515\/auto-2019-0013","relation":{},"ISSN":["2196-677X","0178-2312"],"issn-type":[{"value":"2196-677X","type":"electronic"},{"value":"0178-2312","type":"print"}],"subject":[],"published":{"date-parts":[[2019,9,27]]}}}