{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T22:09:51Z","timestamp":1781042991074,"version":"3.54.1"},"reference-count":28,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2021,12,17]],"date-time":"2021-12-17T00:00:00Z","timestamp":1639699200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Software sensors are playing an increasingly important role in current vehicle development. Such soft sensors can be based on both physical modeling and data-based modeling. Data-driven modeling is based on building a model purely on captured data which means that no system knowledge is required for the application. At the same time, hyperparameters have a particularly large influence on the quality of the model. These parameters influence the architecture and the training process of the machine learning algorithm. This paper deals with the comparison of different hyperparameter optimization methods for the design of a roll angle estimator based on an artificial neural network. The comparison is drawn based on a pre-generated simulation data set created with ISO standard driving maneuvers. Four different optimization methods are used for the comparison. Random Search and Hyperband are two similar methods based purely on randomness, whereas Bayesian Optimization and the genetic algorithm are knowledge-based methods, i.e., they process information from previous iterations. The objective function for all optimization methods consists of the root mean square error of the training process and the reference data generated in the simulation. To guarantee a meaningful result, k-fold cross-validation is integrated for the training process. Finally, all methods are applied to the predefined parameter space. It is shown that the knowledge-based methods lead to better results. In particular, the Genetic Algorithm leads to promising solutions in this application.<\/jats:p>","DOI":"10.3390\/s21248435","type":"journal-article","created":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T02:40:32Z","timestamp":1639968032000},"page":"8435","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Hyperparameter Optimization Techniques for Designing Software Sensors Based on Artificial Neural Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6504-0343","authenticated-orcid":false,"given":"Sebastian","family":"Blume","sequence":"first","affiliation":[{"name":"Department of Mechanical and Process Engineering, Institute for Mechatronics and System Dynamics, University of Duisburg-Essen, 47057 Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5048-8150","authenticated-orcid":false,"given":"Tim","family":"Benedens","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Process Engineering, Institute for Mechatronics and System Dynamics, University of Duisburg-Essen, 47057 Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7945-1853","authenticated-orcid":false,"given":"Dieter","family":"Schramm","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Process Engineering, Institute for Mechatronics and System Dynamics, University of Duisburg-Essen, 47057 Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MCE.2018.2828440","article-title":"Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles","volume":"7","author":"Kukkala","year":"2018","journal-title":"IEEE Consum. Electron. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1080\/00423114.2010.527994","article-title":"Unscented Kalman filter for vehicle state estimation","volume":"49","author":"Antonov","year":"2011","journal-title":"Veh. Syst. Dyn."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2651","DOI":"10.1109\/TVT.2008.2008811","article-title":"Vehicle Full-State Estimation and Prediction System Using State Observers","volume":"58","author":"Hsu","year":"2009","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1558","DOI":"10.1109\/TITS.2011.2164246","article-title":"Parameter and State Estimation in Vehicle Roll Dynamics","volume":"12","author":"Rajamani","year":"2011","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_5","unstructured":"Claesen, M., and Moor, B. (2015). Hyperparameter Search in Machine Learning. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez, L.P., S\u00e1nchez, S.S., Garcia-Guzman, J., Boada, M.J.L., and Boada, B.L. (2020). Simultaneous Estimation of Vehicle Roll and Sideslip Angles through a Deep Learning Approach. Sensors, 20.","DOI":"10.3390\/s20133679"},{"key":"ref_7","unstructured":"Xu, N., Askari, H., Huang, Y., Zhou, J., and Khajepour, A. (2020). Tire Force Estimation in Intelligent Tires Using Machine Learning. IEEE Trans. Intell. Transp. Syst., 1\u201310."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TIV.2018.2886687","article-title":"A Hybrid Approach to Side-Slip Angle Estimation with Recurrent Neural Networks and Kinematic Vehicle Models","volume":"4","author":"Graeber","year":"2019","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"H\u00fcgle, M., Kalweit, G., Mirchevska, B., Werling, M., and Boedecker, J. (2019, January 3\u20138). Dynamic Input for Deep Reinforcement Learning in Autonomous Driving. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8968560"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schramm, D., Hiller, M., and Bardini, R. (2018). Vehicle Dynamics, Springer.","DOI":"10.1007\/978-3-662-54483-9"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ryu, J., and Gerdes, J.C. (July, January 30). Estimation of vehicle roll and road bank angle. Proceedings of the 2004 American Control Conference, Boston, MA, USA.","DOI":"10.23919\/ACC.2004.1383772"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rajamani, R., Piyabongkarn, D., Tsourapas, V., and Lew, J.Y. (2009, January 10\u201312). Real-time estimation of roll angle and CG height for active rollover prevention applications. Proceedings of the 2009 American Control Conference, Louis, MO, USA.","DOI":"10.1109\/ACC.2009.5160045"},{"key":"ref_13","first-page":"1026","article-title":"A Side-Slip Angle Estimation Using Neural Network for a Wheeled Vehicle","volume":"109","author":"Sasaki","year":"2000","journal-title":"SAE Trans."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Blume, S., Sieberg, P.M., Maas, N., and Schramm, D. (2019, January 27\u201330). Neural Roll Angle Estimation in a Model Predictive Control System. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917106"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sieberg, P.M., Blume, S., Harnack, N., Maas, N., and Schramm, D. (2019, January 27\u201330). Hybrid State Estimation Combining Artificial Neural Network and Physical Model. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8916954"},{"key":"ref_16","unstructured":"Yu, T., and Zhu, H. (2020). Hyper-Parameter Optimization: A Review of Algorithms and Applications. arXiv."},{"key":"ref_17","first-page":"1337","article-title":"he Convergence of the Random Search Method in the Extremal Control of Many-Parameter System","volume":"24","author":"Rastrigin","year":"1963","journal-title":"Autom. Remote Control"},{"key":"ref_18","first-page":"6765","article-title":"Hyperband: A novel bandit-based approach to hyperparameter optimization","volume":"18","author":"Li","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_19","unstructured":"Jamieson, K., and Talwalkar, A. (2019, January 3\u20136). Non-stochastic Best Arm Identification and Hyperparameter Optimization. Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, Cadiz, Spain."},{"key":"ref_20","unstructured":"Mockus, J. (1974, January 1\u20137). On Bayesian Methods for Seeking the Extremum. Proceedings of the IFIP Technical Conference, Novosibirsk."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Blume, S., Reicherts, S., Koegeler, H., Didcock, N., and Henn, T. (2016, January 13\u201316). Geostatistical Meta-Modeling for a Model-Based Calibration of an Adaptive Shock Absorber. Proceedings of the 13th International Symposium on Advanced Vehicle Control (AVEC 2016), Munich, Germany.","DOI":"10.1201\/9781315265285-75"},{"key":"ref_22","unstructured":"Bergstra, J., Bardenet, R., Bengio, Y., and K\u00e9gl, B. (2011, January 12). Algorithms for hyper-parameter optimization. Proceedings of the 24th International Conference on Neural Information Processing Systems, Granada, Spain."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/s13218-015-0381-0","article-title":"Beyond Manual Tuning of Hyperparameters","volume":"29","author":"Hutter","year":"2015","journal-title":"KI -K\u00fcnstliche Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hutter, F., Kotthoff, L., and Vanschoren, J. (2019). Automated Machine Learning: Methods, Systems, Challenges. Autom. Mach. Learn.","DOI":"10.1007\/978-3-030-05318-5"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Holland, J.H. (1992). Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence, MIT Press.","DOI":"10.7551\/mitpress\/1090.001.0001"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gerdes, I., Klawonn, F., and Kruse, R. (2004). Evolution\u00e4re Algorithmen-Genetische Algorithmen, Strategien und Optimierungsverfahren, Beispielanwendungen, Springer.","DOI":"10.1007\/978-3-322-86839-8"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cho, K., Van Merri\u00ebnboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25\u201329). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1179"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8435\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:50:46Z","timestamp":1760169046000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,17]]},"references-count":28,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21248435"],"URL":"https:\/\/doi.org\/10.3390\/s21248435","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,17]]}}}