{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T06:46:52Z","timestamp":1771483612833,"version":"3.50.1"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Johannes Kepler University Linz"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Softw Syst Model"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Model-driven optimization allows to directly apply domain-specific modeling languages to define models which are subsequently optimized by applying a predefined set of model transformation rules. Objectives guide the optimization processes which can range from one single objective formulation resulting in one single solution to a set of objectives that necessitates the identification of a Pareto-optimal set of solutions. In recent years, a multitude of reinforcement learning approaches has been proposed that support both optimization cases and competitive results for various problem instances have been reported. However, their application to the field of model-driven optimization has not gained much attention yet, especially when compared to the extensive application of meta-heuristic search approaches such as genetic algorithms. Thus, there is a lack of knowledge about the applicability and performance of reinforcement learning for model-driven optimization. We therefore present in this paper a general framework for applying reinforcement learning to model-driven optimization problems. In particular, we show how a catalog of different reinforcement learning algorithms can be integrated with existing model-driven optimization approaches that use a transformation rule application encoding. We exemplify this integration by presenting a dedicated reinforcement learning extension for MOMoT. We build on this tool support and investigate several case studies for validating the applicability of reinforcement learning for model-driven optimization and compare the performance against a genetic algorithm. The results show clear advantages of using RL for single-objective problems, especially for cases where the transformation steps are highly dependent on each other. For multi-objective problems, the results are more diverse and case-specific, which further motivates the usage of model-driven optimization to utilize different approaches to find the best solutions.<\/jats:p>","DOI":"10.1007\/s10270-024-01233-6","type":"journal-article","created":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T05:08:55Z","timestamp":1731992935000},"page":"891-921","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["From single-objective to multi-objective reinforcement learning-based model transformation"],"prefix":"10.1007","volume":"24","author":[{"given":"Martin","family":"Eisenberg","sequence":"first","affiliation":[]},{"given":"Manuel","family":"Wimmer","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,19]]},"reference":[{"key":"1233_CR1","doi-asserted-by":"publisher","unstructured":"Burdusel, A., Zschaler, S., Str\u00fcber, D.: Mdeoptimiser: a search based model engineering tool. In: Babur, \u00d6., Str\u00fcber, D., Abrah\u00e3o, S., Burgue\u00f1o, L., Gogolla, M., Greenyer, J., Kokaly, S., Kolovos, D.S., Mayerhofer, T., Zahedi, M. (eds.) Proceedings of the 21st ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings, MODELS 2018, Copenhagen, Denmark, October 14-19, 2018, pp. 12\u201316. ACM, (2018). https:\/\/doi.org\/10.1145\/3270112.3270130","DOI":"10.1145\/3270112.3270130"},{"key":"1233_CR2","doi-asserted-by":"publisher","unstructured":"Abdeen, H., Varr\u00f3, D., Sahraoui, H.A., Nagy, A.S., Debreceni, C., Heged\u00fcs, \u00c1., Horv\u00e1th, \u00c1.: Multi-objective optimization in rule-based design space exploration. In: Crnkovic, I., Chechik, M., Gr\u00fcnbacher, P. (eds.) ACM\/IEEE International Conference on Automated Software Engineering, ASE \u201914, Vasteras, Sweden - September 15 - 19, 2014, pp. 289\u2013300. ACM, (2014). https:\/\/doi.org\/10.1145\/2642937.2643005","DOI":"10.1145\/2642937.2643005"},{"issue":"2","key":"1233_CR3","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1007\/s10270-017-0644-3","volume":"18","author":"R Bill","year":"2019","unstructured":"Bill, R., Fleck, M., Troya, J., Mayerhofer, T., Wimmer, M.: A local and global tour on MOMoT. Softw. Syst. Model. 18(2), 1017\u20131046 (2019). https:\/\/doi.org\/10.1007\/s10270-017-0644-3","journal-title":"Softw. Syst. Model."},{"issue":"4","key":"1233_CR4","doi-asserted-by":"publisher","first-page":"1281","DOI":"10.1007\/S10270-022-01078-X","volume":"22","author":"S John","year":"2023","unstructured":"John, S., Kosiol, J., Lambers, L., Taentzer, G.: A graph-based framework for model-driven optimization facilitating impact analysis of mutation operator properties. Softw. Syst. Model. 22(4), 1281\u20131318 (2023). https:\/\/doi.org\/10.1007\/S10270-022-01078-X","journal-title":"Softw. Syst. Model."},{"issue":"3","key":"1233_CR5","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1109\/TSMC.2014.2358639","volume":"45","author":"C Liu","year":"2015","unstructured":"Liu, C., Xu, X., Hu, D.: Multiobjective reinforcement learning: A comprehensive overview. IEEE Trans. Syst. Man Cybern. Syst. 45(3), 385\u2013398 (2015). https:\/\/doi.org\/10.1109\/TSMC.2014.2358639","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"issue":"1","key":"1233_CR6","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1007\/S10458-022-09552-Y","volume":"36","author":"CF Hayes","year":"2022","unstructured":"Hayes, C.F., Radulescu, R., Bargiacchi, E., K\u00e4llstr\u00f6m, J., Macfarlane, M., Reymond, M., Verstraeten, T., Zintgraf, L.M., Dazeley, R., Heintz, F., Howley, E., Irissappane, A.A., Mannion, P., Now\u00e9, A., Oliveira Ramos, G., Restelli, M., Vamplew, P., Roijers, D.M.: A practical guide to multi-objective reinforcement learning and planning. Auton. Agents Multi Agent Syst. 36(1), 26 (2022). https:\/\/doi.org\/10.1007\/S10458-022-09552-Y","journal-title":"Auton. Agents Multi Agent Syst."},{"key":"1233_CR7","doi-asserted-by":"crossref","unstructured":"Barrett, T.D., Clements, W.R., Foerster, J.N., Lvovsky, A.I.: Exploratory combinatorial optimization with reinforcement learning. In: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, pp. 3243\u20133250. AAAI Press, (2020). https:\/\/aaai.org\/ojs\/index.php\/AAAI\/article\/view\/5723","DOI":"10.1609\/aaai.v34i04.5723"},{"issue":"3","key":"1233_CR8","doi-asserted-by":"publisher","first-page":"6","DOI":"10.5381\/jot.2019.18.3.a6","volume":"18","author":"S John","year":"2019","unstructured":"John, S., Burdusel, A., Bill, R., Str\u00fcber, D., Taentzer, G., Zschaler, S., Wimmer, M.: Searching for optimal models: comparing two encoding approaches. J. Object Technol. 18(3), 6\u2013122 (2019). https:\/\/doi.org\/10.5381\/jot.2019.18.3.a6","journal-title":"J. Object Technol."},{"key":"1233_CR9","doi-asserted-by":"publisher","unstructured":"Eisenberg, M., Pichler, H., Garmendia, A., Wimmer, M.: Towards reinforcement learning for in-place model transformations. In: 24th International Conference on Model Driven Engineering Languages and Systems, MODELS 2021, Fukuoka, Japan, October 10-15, 2021, pp. 82\u201388. IEEE, (2021). https:\/\/doi.org\/10.1109\/MODELS50736.2021.00017","DOI":"10.1109\/MODELS50736.2021.00017"},{"key":"1233_CR10","unstructured":"JKU-WIN-SE: MOMoT-RL. https:\/\/github.com\/jku-win-se\/MOMoT-RL (2024)"},{"issue":"2","key":"1233_CR11","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1109\/MC.2006.58","volume":"39","author":"DC Schmidt","year":"2006","unstructured":"Schmidt, D.C.: Guest editor\u2019s introduction: model-driven engineering. Computer 39(2), 25\u201331 (2006). https:\/\/doi.org\/10.1109\/MC.2006.58","journal-title":"Computer"},{"key":"1233_CR12","doi-asserted-by":"publisher","unstructured":"Brambilla, M., Cabot, J., Wimmer, M.: Model-Driven Software Engineering in Practice, Second Edition. Synthesis Lectures on Software Engineering. Morgan & Claypool Publishers, (2017). https:\/\/doi.org\/10.2200\/S00751ED2V01Y201701SWE004","DOI":"10.2200\/S00751ED2V01Y201701SWE004"},{"issue":"14","key":"1233_CR13","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1016\/S0950-5849(01)00189-6","volume":"43","author":"M Harman","year":"2001","unstructured":"Harman, M., Jones, B.F.: Search-based software engineering. Inf. Softw. Technol. 43(14), 833\u2013839 (2001). https:\/\/doi.org\/10.1016\/S0950-5849(01)00189-6","journal-title":"Inf. Softw. Technol."},{"key":"1233_CR14","doi-asserted-by":"publisher","unstructured":"Kessentini, M., Langer, P., Wimmer, M.: Searching models, modeling search: On the synergies of SBSE and MDE. In: Paige, R.F., Harman, M., Williams, J.R. (eds.) 1st International Workshop on Combining Modelling and Search-Based Software Engineering, CMSBSE@ICSE 2013, San Francisco, CA, USA, May 20, 2013, pp. 51\u201354. IEEE Computer Society, (2013). https:\/\/doi.org\/10.1109\/CMSBSE.2013.6604438","DOI":"10.1109\/CMSBSE.2013.6604438"},{"key":"1233_CR15","doi-asserted-by":"publisher","DOI":"10.1145\/2379776.2379787","author":"M Harman","year":"2012","unstructured":"Harman, M., Mansouri, S.A., Zhang, Y.: Search-based software engineering: trends, techniques and applications. ACM Comput. Surv. (2012). https:\/\/doi.org\/10.1145\/2379776.2379787","journal-title":"ACM Comput. Surv."},{"key":"1233_CR16","doi-asserted-by":"publisher","unstructured":"Zschaler, S., Mandow, L.: Towards model-based optimisation: Using domain knowledge explicitly. In: Milazzo, P., Varr\u00f3, D., Wimmer, M. (eds.) Software Technologies: Applications and Foundations - STAF 2016 Collocated Workshops: DataMod, GCM, HOFM, MELO, SEMS, VeryComp, Vienna, Austria, July 4-8, 2016, Revised Selected Papers. Lecture Notes in Computer Science, vol. 9946, pp. 317\u2013329. Springer, (2016). https:\/\/doi.org\/10.1007\/978-3-319-50230-4_24","DOI":"10.1007\/978-3-319-50230-4_24"},{"key":"1233_CR17","doi-asserted-by":"publisher","unstructured":"Str\u00fcber, D.: Generating efficient mutation operators for search-based model-driven engineering. In: Guerra, E., Brand, M. (eds.) Theory and Practice of Model Transformation - 10th International Conference, ICMT@STAF 2017, Marburg, Germany, July 17-18, 2017, Proceedings. Lecture Notes in Computer Science, vol. 10374, pp. 121\u2013137. Springer, (2017). https:\/\/doi.org\/10.1007\/978-3-319-61473-1_9","DOI":"10.1007\/978-3-319-61473-1_9"},{"key":"1233_CR18","doi-asserted-by":"publisher","unstructured":"Burdusel, A., Zschaler, S., John, S.: Automatic generation of atomic consistency preserving search operators for search-based model engineering. In: Kessentini, M., Yue, T., Pretschner, A., Voss, S., Burgue\u00f1o, L. (eds.) 22nd ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2019, Munich, Germany, September 15-20, 2019, pp. 106\u2013116. IEEE, (2019). https:\/\/doi.org\/10.1109\/MODELS.2019.00-10","DOI":"10.1109\/MODELS.2019.00-10"},{"issue":"3","key":"1233_CR19","doi-asserted-by":"publisher","first-page":"1102","DOI":"10.1109\/TSE.2022.3171404","volume":"49","author":"JM Horcas","year":"2023","unstructured":"Horcas, J.M., Str\u00fcber, D., Burdusel, A., Martinez, J., Zschaler, S.: We\u2019re not gonna break it! consistency-preserving operators for efficient product line configuration. IEEE Trans. Software Eng. 49(3), 1102\u20131117 (2023). https:\/\/doi.org\/10.1109\/TSE.2022.3171404","journal-title":"IEEE Trans. Software Eng."},{"issue":"3","key":"1233_CR20","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1147\/SJ.453.0621","volume":"45","author":"K Czarnecki","year":"2006","unstructured":"Czarnecki, K., Helsen, S.: Feature-based survey of model transformation approaches. IBM Syst. J. 45(3), 621\u2013646 (2006). https:\/\/doi.org\/10.1147\/SJ.453.0621","journal-title":"IBM Syst. J."},{"issue":"3","key":"1233_CR21","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1007\/s10270-014-0429-x","volume":"15","author":"L L\u00facio","year":"2016","unstructured":"L\u00facio, L., Amrani, M., Dingel, J., Lambers, L., Salay, R., Selim, G.M.K., Syriani, E., Wimmer, M.: Model transformation intents and their properties. Softw. Syst. Model. 15(3), 647\u2013684 (2016). https:\/\/doi.org\/10.1007\/s10270-014-0429-x","journal-title":"Softw. Syst. Model."},{"key":"1233_CR22","volume-title":"Nature-Inspired Optimization Algorithms","author":"X-S Yang","year":"2014","unstructured":"Yang, X.-S.: Nature-Inspired Optimization Algorithms, 1st edn. Elsevier Science Publishers B. V, NLD (2014)","edition":"1"},{"issue":"5","key":"1233_CR23","doi-asserted-by":"publisher","first-page":"1771","DOI":"10.1109\/TSE.2020.3036108","volume":"48","author":"M Li","year":"2022","unstructured":"Li, M., Chen, T., Yao, X.: How to evaluate solutions in pareto-based search-based software engineering: a critical review and methodological guidance. IEEE Trans. Softw. Eng. 48(5), 1771\u20131799 (2022). https:\/\/doi.org\/10.1109\/TSE.2020.3036108","journal-title":"IEEE Trans. Softw. Eng."},{"issue":"2","key":"1233_CR24","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1109\/TEVC.2003.810758","volume":"7","author":"E Zitzler","year":"2003","unstructured":"Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C.M., Fonseca, V.G.: Performance assessment of multiobjective optimizers: an analysis and review. IEEE Trans. Evol. Comput. 7(2), 117\u2013132 (2003). https:\/\/doi.org\/10.1109\/TEVC.2003.810758","journal-title":"IEEE Trans. Evol. Comput."},{"key":"1233_CR25","unstructured":"Steinberg, D., Budinsky, F., Merks, E., Paternostro, M.: EMF: Eclipse Modeling Framework. Addison Wesley, (2008)"},{"key":"1233_CR26","doi-asserted-by":"publisher","unstructured":"Arendt, T., Biermann, E., Jurack, S., Krause, C., Taentzer, G.: Henshin: Advanced concepts and tools for in-place EMF model transformations. In: Petriu, D.C., Rouquette, N., Haugen, \u00d8. (eds.) Model Driven Engineering Languages and Systems - 13th International Conference, MODELS 2010, Oslo, Norway, October 3-8, 2010, Proceedings, Part I. Lecture Notes in Computer Science, vol. 6394, pp. 121\u2013135. Springer, (2010). https:\/\/doi.org\/10.1007\/978-3-642-16145-2_9","DOI":"10.1007\/978-3-642-16145-2_9"},{"key":"1233_CR27","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-44874-8","author":"AE Eiben","year":"2015","unstructured":"Eiben, A.E., Smith, J.E.: introduction to evolutionary computing Second Edition. Nat. Comput. Series (2015). https:\/\/doi.org\/10.1007\/978-3-662-44874-8","journal-title":"Nat. Comput. Series"},{"issue":"2","key":"1233_CR28","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/j.ejor.2014.03.011","volume":"239","author":"J Lehnfeld","year":"2014","unstructured":"Lehnfeld, J., Knust, S.: Loading, unloading and premarshalling of stacks in storage areas: survey and classification. Eur. J. Oper. Res. 239(2), 297\u2013312 (2014). https:\/\/doi.org\/10.1016\/j.ejor.2014.03.011","journal-title":"Eur. J. Oper. Res."},{"key":"1233_CR29","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.cor.2017.08.010","volume":"89","author":"F Tricoire","year":"2018","unstructured":"Tricoire, F., Scagnetti, J., Beham, A.: New insights on the block relocation problem. Comput. Oper. Res. 89, 127\u2013139 (2018). https:\/\/doi.org\/10.1016\/j.cor.2017.08.010","journal-title":"Comput. Oper. Res."},{"issue":"1","key":"1233_CR30","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/J.EJOR.2011.12.039","volume":"219","author":"M Caserta","year":"2012","unstructured":"Caserta, M., Schwarze, S., Vo\u00df, S.: A mathematical formulation and complexity considerations for the blocks relocation problem. Eur. J. Oper. Res. 219(1), 96\u2013104 (2012). https:\/\/doi.org\/10.1016\/J.EJOR.2011.12.039","journal-title":"Eur. J. Oper. Res."},{"key":"1233_CR31","unstructured":"Sutton, R.S., Barto, A.G.: Reinforcement Learning - an Introduction. Adaptive computation and machine learning. MIT Press, (1998). https:\/\/www.worldcat.org\/oclc\/37293240"},{"key":"1233_CR32","doi-asserted-by":"crossref","unstructured":"Otterlo, M., Wiering, M.A.: Reinforcement learning and markov decision processes. In: Reinforcement Learning. Adaptation, Learning, and Optimization, vol. 12, pp. 3\u201342. Springer, (2012)","DOI":"10.1007\/978-3-642-27645-3_1"},{"key":"1233_CR33","doi-asserted-by":"crossref","unstructured":"Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3\u20134), 279\u2013292 (1992)","DOI":"10.1007\/BF00992698"},{"key":"1233_CR34","unstructured":"Yang, R., Sun, X., Narasimhan, K.: A generalized algorithm for multi-objective reinforcement learning and policy adaptation. In: Wallach, H.M., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E.B., Garnett, R. (eds.) Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, pp. 14610\u201314621 (2019). https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/4a46fbfca3f1465a27b210f4bdfe6ab3-Abstract.html"},{"key":"1233_CR35","unstructured":"Li, K., Zhang, T., Wang, R.: Deep reinforcement learning for multi-objective optimization. CoRR abs\/1906.02386 (2019) URL:1906.02386"},{"key":"1233_CR36","doi-asserted-by":"publisher","unstructured":"Zhang, H., Yu, T.: Taxonomy of reinforcement learning algorithms. In: Dong, H., Ding, Z., Zhang, S. (eds.) Deep Reinforcement Learning: Fundamentals, Research and Applications, pp. 125\u2013133. Springer, Singapore (2020). https:\/\/doi.org\/10.1007\/978-981-15-4095-0_3","DOI":"10.1007\/978-981-15-4095-0_3"},{"key":"1233_CR37","doi-asserted-by":"publisher","unstructured":"AlMahamid, F., Grolinger, K.: Reinforcement learning algorithms: An overview and classification. CoRR abs\/2209.14940 (2022)https:\/\/doi.org\/10.48550\/ARXIV.2209.14940 URL:2209.14940","DOI":"10.48550\/ARXIV.2209.14940"},{"key":"1233_CR38","doi-asserted-by":"publisher","unstructured":"Watkins, C.J.C.H., Dayan, P.: Technical note q-learning. Mach. Learn. 8, 279\u2013292 (1992) https:\/\/doi.org\/10.1007\/BF00992698","DOI":"10.1007\/BF00992698"},{"key":"1233_CR39","doi-asserted-by":"publisher","unstructured":"Moffaert, K.V., Drugan, M.M., Now\u00e9, A.: Scalarized multi-objective reinforcement learning: Novel design techniques. In: Proceedings of the 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL 2013, IEEE Symposium Series on Computational Intelligence (SSCI), 16-19 April 2013, Singapore, pp. 191\u2013199. IEEE, (2013). https:\/\/doi.org\/10.1109\/ADPRL.2013.6615007","DOI":"10.1109\/ADPRL.2013.6615007"},{"key":"1233_CR40","unstructured":"Humphreys, M.: Action selection methods using reinforcement learning. PhD thesis, University of Cambridge, UK (1997). https:\/\/ethos.bl.uk\/OrderDetails.do?uin=uk.bl.ethos.604775"},{"issue":"1","key":"1233_CR41","first-page":"3483","volume":"15","author":"KV Moffaert","year":"2014","unstructured":"Moffaert, K.V., Now\u00e9, A.: Multi-objective reinforcement learning using sets of pareto dominating policies. J. Mach. Learn. Res. 15(1), 3483\u20133512 (2014)","journal-title":"J. Mach. Learn. Res."},{"key":"1233_CR42","unstructured":"Rummery, G., Niranjan, M.: On-line q-learning using connectionist systems. Technical Report CUED\/F-INFENG\/TR 166 (1994)"},{"key":"1233_CR43","doi-asserted-by":"publisher","unstructured":"Marler, R., Arora, J.: The weighted sum method for multi-objective optimization: New insights. Structural and Multidisciplinary Optimization 41, 853\u2013862 (2010) https:\/\/doi.org\/10.1007\/s00158-009-0460-7","DOI":"10.1007\/s00158-009-0460-7"},{"key":"1233_CR44","unstructured":"Karlsson, J.: Learning to solve multiple goals. PhD thesis, USA (1997). UMI Order No. GAX97-28447"},{"issue":"3","key":"1233_CR45","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1007\/S11047-018-9685-Y","volume":"17","author":"MTM Emmerich","year":"2018","unstructured":"Emmerich, M.T.M., Deutz, A.H.: A tutorial on multiobjective optimization: fundamentals and evolutionary methods. Nat. Comput. 17(3), 585\u2013609 (2018). https:\/\/doi.org\/10.1007\/S11047-018-9685-Y","journal-title":"Nat. Comput."},{"issue":"7553","key":"1233_CR46","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1038\/NATURE14422","volume":"521","author":"A Cully","year":"2015","unstructured":"Cully, A., Clune, J., Tarapore, D., Mouret, J.: Robots that can adapt like animals. Nat. 521(7553), 503\u2013507 (2015). https:\/\/doi.org\/10.1038\/NATURE14422","journal-title":"Nat."},{"key":"1233_CR47","doi-asserted-by":"publisher","unstructured":"Tan, J., Zhang, T., Coumans, E., Iscen, A., Bai, Y., Hafner, D., Bohez, S., Vanhoucke, V.: Sim-to-real: Learning agile locomotion for quadruped robots. In: Kress-Gazit, H., Srinivasa, S.S., Howard, T., Atanasov, N. (eds.) Robotics: Science and Systems XIV, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA, June 26-30, 2018 (2018). https:\/\/doi.org\/10.15607\/RSS.2018.XIV.010 . http:\/\/www.roboticsproceedings.org\/rss14\/p10.html","DOI":"10.15607\/RSS.2018.XIV.010"},{"key":"1233_CR48","doi-asserted-by":"publisher","unstructured":"Peng, X.B., Andrychowicz, M., Zaremba, W., Abbeel, P.: Sim-to-real transfer of robotic control with dynamics randomization. In: 2018 IEEE International Conference on Robotics and Automation, ICRA 2018, Brisbane, Australia, May 21-25, 2018, pp. 1\u20138. IEEE, (2018). https:\/\/doi.org\/10.1109\/ICRA.2018.8460528","DOI":"10.1109\/ICRA.2018.8460528"},{"key":"1233_CR49","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919887447","author":"M Andrychowicz","year":"2020","unstructured":"Andrychowicz, M., Baker, B., Chociej, M., J\u00f3zefowicz, R., McGrew, B., Pachocki, J., Petron, A., Plappert, M., Powell, G., Ray, A., Schneider, J., Sidor, S., Tobin, J., Welinder, P., Weng, L., Zaremba, W.: Learning dexterous in-hand manipulation. Int. J. Robot. Res. (2020). https:\/\/doi.org\/10.1177\/0278364919887447","journal-title":"Int. J. Robot. Res."},{"issue":"2","key":"1233_CR50","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/S10664-008-9102-8","volume":"14","author":"P Runeson","year":"2009","unstructured":"Runeson, P., H\u00f6st, M.: Guidelines for conducting and reporting case study research in software engineering. Empir. Softw. Eng. 14(2), 131\u2013164 (2009). https:\/\/doi.org\/10.1007\/S10664-008-9102-8","journal-title":"Empir. Softw. Eng."},{"key":"1233_CR51","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/j.entcs.2005.10.021","volume":"152","author":"T Mens","year":"2006","unstructured":"Mens, T., Gorp, P.V.: A taxonomy of model transformation. Electron. Notes Theor. Comput. Sci. 152, 125\u2013142 (2006). https:\/\/doi.org\/10.1016\/j.entcs.2005.10.021","journal-title":"Electron. Notes Theor. Comput. Sci."},{"key":"1233_CR52","doi-asserted-by":"publisher","unstructured":"Eisenberg, M., Lehner, D., Sindel\u00e1r, R., Wimmer, M.: Towards reactive planning with digital twins and model-driven optimization. In: Margaria, T., Steffen, B. (eds.) Leveraging Applications of Formal Methods, Verification and Validation. Practice - 11th International Symposium, ISoLA 2022, Rhodes, Greece, October 22-30, 2022, Proceedings, Part IV. Lecture Notes in Computer Science, vol. 13704, pp. 54\u201370. Springer, (2022). https:\/\/doi.org\/10.1007\/978-3-031-19762-8_5","DOI":"10.1007\/978-3-031-19762-8_5"},{"issue":"6","key":"1233_CR53","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1109\/TSE.2010.70","volume":"36","author":"M Bowman","year":"2010","unstructured":"Bowman, M., Briand, L.C., Labiche, Y.: Solving the class responsibility assignment problem in object-oriented analysis with multi-objective genetic algorithms. IEEE Trans. Softw. Eng. 36(6), 817\u2013837 (2010). https:\/\/doi.org\/10.1109\/TSE.2010.70","journal-title":"IEEE Trans. Softw. Eng."},{"key":"1233_CR54","unstructured":"Fleck, M., Troya, J., Wimmer, M.: The class responsibility assignment case. In: Garc\u00eda-Dom\u00ednguez, A., Krikava, F., Rose, L.M. (eds.) Proceedings of the 9th Transformation Tool Contest, Co-located with the 2016 Software Technologies: Applications and Foundations (STAF 2016), Vienna, Austria, July 8, 2016. CEUR Workshop Proceedings, vol. 1758, pp. 1\u20138. CEUR-WS.org, (2016). https:\/\/ceur-ws.org\/Vol-1758\/paper1.pdf"},{"key":"1233_CR55","doi-asserted-by":"publisher","unstructured":"Lano, K., Rahimi, S.K.: Case study: Class diagram restructuring. In: Gorp, P.V., Rose, L.M., Krause, C. (eds.) Proceedings Sixth Transformation Tool Contest, TTC 2013, Budapest, Hungary, 19-20 June, 2013. EPTCS, vol. 135, pp. 8\u201315 (2013). https:\/\/doi.org\/10.4204\/EPTCS.135.2","DOI":"10.4204\/EPTCS.135.2"},{"issue":"2","key":"1233_CR56","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evolut. Comput. 6(2), 182\u2013197 (2002). https:\/\/doi.org\/10.1109\/4235.996017","journal-title":"IEEE Trans. Evolut. Comput."},{"issue":"2","key":"1233_CR57","first-page":"101","volume":"25","author":"A Vargha","year":"2000","unstructured":"Vargha, A., Delaney, H.D.: A critique and improvement of the \u201cCL\u2019\u2019 common language effect size statistics of McGraw and Wong. J. Educ. Behav. Stat. 25(2), 101\u2013132 (2000)","journal-title":"J. Educ. Behav. Stat."},{"issue":"4","key":"1233_CR58","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.3758\/s13428-015-0667-z","volume":"48","author":"JC Li","year":"2016","unstructured":"Li, J.C.: Effect size measures in a two-independent-samples case with nonnormal and nonhomogeneous data. Behav. Res. Methods 48(4), 1560\u20131574 (2016). https:\/\/doi.org\/10.3758\/s13428-015-0667-z","journal-title":"Behav. Res. Methods"},{"issue":"1","key":"1233_CR59","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1214\/aoms\/1177730491","volume":"18","author":"HB Mann","year":"2024","unstructured":"Mann, H.B., Whitney, D.R.: On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 18(1), 50\u201360 (2024)","journal-title":"Ann. Math. Stat."},{"key":"1233_CR60","doi-asserted-by":"publisher","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M.C., Regnell, B.: Experimentation in Software Engineering. Springer (2012). https:\/\/doi.org\/10.1007\/978-3-642-29044-2","DOI":"10.1007\/978-3-642-29044-2"},{"key":"1233_CR61","doi-asserted-by":"publisher","unstructured":"Kessentini, M., Sahraoui, H.A., Boukadoum, M.: Model transformation as an optimization problem. In: Czarnecki, K., Ober, I., Bruel, J., Uhl, A., V\u00f6lter, M. (eds.) Model Driven Engineering Languages and Systems, 11th International Conference, MoDELS 2008, Toulouse, France, September 28 - October 3, 2008. Proceedings. Lecture Notes in Computer Science, vol. 5301, pp. 159\u2013173. Springer, (2008). https:\/\/doi.org\/10.1007\/978-3-540-87875-9_12","DOI":"10.1007\/978-3-540-87875-9_12"},{"key":"1233_CR62","unstructured":"Williams, J.R.: A novel representation for search-based model-driven engineering. PhD thesis, University of York, UK (2013). http:\/\/etheses.whiterose.ac.uk\/5155\/"},{"key":"1233_CR63","unstructured":"Efstathiou, D., Williams, J.R., Zschaler, S.: Crepe complete: Multi-objective optimization for your models. In: Paige, R.F., Kessentini, M., Langer, P., Wimmer, M. (eds.) Proceedings of the First International Workshop on Combining Modelling with Search- and Example-Based Approaches Co-located with 17th International Conference on Model Driven Engineering Languages and Systems (MODELS 2014), Valencia, Spain, September 28, 2014. CEUR Workshop Proceedings, vol. 1340, pp. 25\u201334. CEUR-WS.org, (2014). http:\/\/ceur-ws.org\/Vol-1340\/paper4.pdf"},{"key":"1233_CR64","unstructured":"Garc\u00eda-Dom\u00ednguez, A., Krikava, F., Rose, L.M. (eds.): Proceedings of the 9th Transformation Tool Contest, Co-located with the 2016 Software Technologies: Applications and Foundations (STAF 2016), Vienna, Austria, July 8, 2016. CEUR Workshop Proceedings, vol. 1758. CEUR-WS.org, (2016). http:\/\/ceur-ws.org\/Vol-1758"},{"key":"1233_CR65","unstructured":"Lano, K., Tehrani, S.Y., Rahimi, S.K.: Solving the class responsibility assignment case with UML-RSDS. In: Garc\u00eda-Dom\u00ednguez, A., Krikava, F., Rose, L.M. (eds.) Proceedings of the 9th Transformation Tool Contest, Co-located with the 2016 Software Technologies: Applications and Foundations (STAF 2016), Vienna, Austria, July 8, 2016. CEUR Workshop Proceedings, vol. 1758, pp. 9\u201314. CEUR-WS.org, (2016). http:\/\/ceur-ws.org\/Vol-1758\/paper2.pdf"},{"key":"1233_CR66","unstructured":"Born, K., Schulz, S., Str\u00fcber, D., John, S.: Solving the class responsibility assignment case with henshin and a genetic algorithm. In: Garc\u00eda-Dom\u00ednguez, A., Krikava, F., Rose, L.M. (eds.) Proceedings of the 9th Transformation Tool Contest, Co-located with the 2016 Software Technologies: Applications and Foundations (STAF 2016), Vienna, Austria, July 8, 2016. CEUR Workshop Proceedings, vol. 1758, pp. 45\u201354. CEUR-WS.org, (2016). http:\/\/ceur-ws.org\/Vol-1758\/paper8.pdf"},{"key":"1233_CR67","unstructured":"Eickhoff, C., Raesch, L., Z\u00fcndorf, A.: The SDMLib solution to the class responsibility assignment case for TTC2016. In: Garc\u00eda-Dom\u00ednguez, A., Krikava, F., Rose, L.M. (eds.) Proceedings of the 9th Transformation Tool Contest, Co-located with the 2016 Software Technologies: Applications and Foundations (STAF 2016), Vienna, Austria, July 8, 2016. CEUR Workshop Proceedings, vol. 1758, pp. 27\u201332. CEUR-WS.org, (2016). http:\/\/ceur-ws.org\/Vol-1758\/paper5.pdf"},{"key":"1233_CR68","unstructured":"Krikava, F.: Solving the TTC\u201916 class responsibility assignment case study with SIGMA and multi-objective genetic algorithms. In: Garc\u00eda-Dom\u00ednguez, A., Krikava, F., Rose, L.M. (eds.) Proceedings of the 9th Transformation Tool Contest, Co-located with the 2016 Software Technologies: Applications and Foundations (STAF 2016), Vienna, Austria, July 8, 2016. CEUR Workshop Proceedings, vol. 1758, pp. 55\u201360. CEUR-WS.org, (2016). http:\/\/ceur-ws.org\/Vol-1758\/paper9.pdf"},{"key":"1233_CR69","doi-asserted-by":"publisher","unstructured":"Fatiregun, D., Harman, M., Hierons, R.M.: Search based transformations. In: Cant\u00fa-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O\u2019Reilly, U., Beyer, H., Standish, R.K., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A.C., Dowsland, K.A., Jonoska, N., Miller, J.F. (eds.) Genetic and Evolutionary Computation - GECCO 2003, Genetic and Evolutionary Computation Conference, Chicago, IL, USA, July 12-16, 2003. Proceedings, Part II. Lecture Notes in Computer Science, vol. 2724, pp. 2511\u20132512. Springer, (2003). https:\/\/doi.org\/10.1007\/3-540-45110-2_154","DOI":"10.1007\/3-540-45110-2_154"},{"key":"1233_CR70","doi-asserted-by":"publisher","unstructured":"Fatiregun, D., Harman, M., Hierons, R.M.: Evolving transformation sequences using genetic algorithms. In: 4th IEEE International Workshop on Source Code Analysis and Manipulation (SCAM 2004), 15-16 September 2004, Chicago, IL, USA, pp. 66\u201375. IEEE Computer Society, (2004). https:\/\/doi.org\/10.1109\/SCAM.2004.11","DOI":"10.1109\/SCAM.2004.11"},{"issue":"1","key":"1233_CR71","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1007\/S10270-021-00893-Y","volume":"21","author":"L Burgue\u00f1o","year":"2022","unstructured":"Burgue\u00f1o, L., Cabot, J., Li, S., G\u00e9rard, S.: A generic LSTM neural network architecture to infer heterogeneous model transformations. Softw. Syst. Model. 21(1), 139\u2013156 (2022). https:\/\/doi.org\/10.1007\/S10270-021-00893-Y","journal-title":"Softw. Syst. Model."},{"key":"1233_CR72","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1007\/978-3-031-15928-2_39","volume-title":"Advances on Mechanics, Design Engineering and Manufacturing IV","author":"Q Brilhault","year":"2023","unstructured":"Brilhault, Q., Yahia, E., Roucoules, L.: Digital continuity based on reinforcement learning model transformations. In: Gerbino, S., Lanzotti, A., Martorelli, M., Mir\u00e1lbes Buil, R., Rizzi, C., Roucoules, L. (eds.) Advances on Mechanics, Design Engineering and Manufacturing IV, pp. 442\u2013453. Springer, Cham (2023)"},{"issue":"2","key":"1233_CR73","doi-asserted-by":"publisher","first-page":"17","DOI":"10.5381\/jot.2020.19.2.a17","volume":"19","author":"L Iovino","year":"2020","unstructured":"Iovino, L., Barriga, A., Rutle, A., Heldal, R.: Model repair with quality-based reinforcement learning. J. Object Technol. 19(2), 17\u2013121 (2020). https:\/\/doi.org\/10.5381\/jot.2020.19.2.a17","journal-title":"J. Object Technol."},{"key":"1233_CR74","doi-asserted-by":"publisher","unstructured":"Barriga, A., Mandow, L., P\u00e9rez-de-la-Cruz, J., Rutle, A., Heldal, R., Iovino, L.: A comparative study of reinforcement learning techniques to repair models. In: Guerra, E., Iovino, L. (eds.) MODELS \u201920: ACM\/IEEE 23rd International Conference on Model Driven Engineering Languages and Systems, Virtual Event, Canada, 18-23 October, 2020, Companion Proceedings, pp. 47\u20131479. ACM, (2020). https:\/\/doi.org\/10.1145\/3417990.3421395","DOI":"10.1145\/3417990.3421395"},{"issue":"3","key":"1233_CR75","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1007\/s10270-022-00983-5","volume":"21","author":"A Barriga","year":"2022","unstructured":"Barriga, A., Rutle, A., Heldal, R.: AI-powered model repair: an experience report - lessons learned, challenges, and opportunities. Softw. Syst. Model. 21(3), 1135\u20131157 (2022). https:\/\/doi.org\/10.1007\/s10270-022-00983-5","journal-title":"Softw. Syst. Model."},{"key":"1233_CR76","doi-asserted-by":"publisher","unstructured":"Rocco, J.D., Sipio, C.D., Ruscio, D.D., Nguyen, P.T.: A GNN-based recommender system to assist the specification of metamodels and models. In: 24th International Conference on Model Driven Engineering Languages and Systems, MODELS 2021, Fukuoka, Japan, October 10-15, 2021, pp. 70\u201381. IEEE, (2021). https:\/\/doi.org\/10.1109\/MODELS50736.2021.00016","DOI":"10.1109\/MODELS50736.2021.00016"},{"key":"1233_CR77","doi-asserted-by":"publisher","unstructured":"Burgue\u00f1o, L., Claris\u00f3, R., G\u00e9rard, S., Li, S., Cabot, J.: An NLP-based architecture for the autocompletion of partial domain models. In: Rosa, M.L., Sadiq, S.W., Teniente, E. (eds.) Advanced Information Systems Engineering - 33rd International Conference, CAiSE 2021, Melbourne, VIC, Australia, June 28 - July 2, 2021, Proceedings. Lecture Notes in Computer Science, vol. 12751, pp. 91\u2013106. Springer, (2021). https:\/\/doi.org\/10.1007\/978-3-030-79382-1_6","DOI":"10.1007\/978-3-030-79382-1_6"},{"issue":"3","key":"1233_CR78","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1007\/s10270-021-00929-3","volume":"21","author":"JAH L\u00f3pez","year":"2022","unstructured":"L\u00f3pez, J.A.H., Izquierdo, J.L.C., Cuadrado, J.S.: Modelset: a dataset for machine learning in model-driven engineering. Softw. Syst. Model. 21(3), 967\u2013986 (2022). https:\/\/doi.org\/10.1007\/s10270-021-00929-3","journal-title":"Softw. Syst. Model."},{"issue":"6","key":"1233_CR79","doi-asserted-by":"publisher","first-page":"1797","DOI":"10.1007\/s10270-021-00913-x","volume":"20","author":"PT Nguyen","year":"2021","unstructured":"Nguyen, P.T., Rocco, J.D., Iovino, L., Ruscio, D.D., Pierantonio, A.: Evaluation of a machine learning classifier for metamodels. Softw. Syst. Model. 20(6), 1797\u20131821 (2021). https:\/\/doi.org\/10.1007\/s10270-021-00913-x","journal-title":"Softw. Syst. Model."},{"issue":"3","key":"1233_CR80","doi-asserted-by":"publisher","first-page":"1115","DOI":"10.1007\/S10270-022-00977-3","volume":"21","author":"M Dehghani","year":"2022","unstructured":"Dehghani, M., Rahimi, S.K., Tisi, M., Tamzalit, D.: Facilitating the migration to the microservice architecture via model-driven reverse engineering and reinforcement learning. Softw. Syst. Model. 21(3), 1115\u20131133 (2022). https:\/\/doi.org\/10.1007\/S10270-022-00977-3","journal-title":"Softw. Syst. Model."},{"key":"1233_CR81","doi-asserted-by":"publisher","unstructured":"Groner, R., Bellmann, P., H\u00f6ppner, S., Thiam, P., Schwenker, F., Tichy, M.: Predicting the Performance of ATL Model Transformations. In: Proceedings of the 2023 ACM\/SPEC International Conference on Performance Engineering. ICPE \u201923, pp. 77\u201389. Association for Computing Machinery, New York, NY, USA (2023). https:\/\/doi.org\/10.1145\/3578244.3583727","DOI":"10.1145\/3578244.3583727"},{"key":"1233_CR82","doi-asserted-by":"publisher","unstructured":"Vo\u00df, T., Beume, N., Rudolph, G., Igel, C.: Scalarization versus indicator-based selection in multi-objective CMA evolution strategies. In: Proceedings of the IEEE Congress on Evolutionary Computation, CEC 2008, June 1-6, 2008, Hong Kong, China, pp. 3036\u20133043. IEEE, (2008). https:\/\/doi.org\/10.1109\/CEC.2008.4631208","DOI":"10.1109\/CEC.2008.4631208"},{"key":"1233_CR83","doi-asserted-by":"publisher","unstructured":"Vamplew, P., Yearwood, J., Dazeley, R., Berry, A.: On the limitations of scalarisation for multi-objective reinforcement learning of pareto fronts. In: Wobcke, W., Zhang, M. (eds.) AI 2008: Advances in Artificial Intelligence, 21st Australasian Joint Conference on Artificial Intelligence, Auckland, New Zealand, December 1-5, 2008. Proceedings. Lecture Notes in Computer Science, vol. 5360, pp. 372\u2013378. Springer, (2008). https:\/\/doi.org\/10.1007\/978-3-540-89378-3_37","DOI":"10.1007\/978-3-540-89378-3_37"}],"container-title":["Software and Systems Modeling"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10270-024-01233-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10270-024-01233-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10270-024-01233-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T06:28:41Z","timestamp":1749018521000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10270-024-01233-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,19]]},"references-count":83,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["1233"],"URL":"https:\/\/doi.org\/10.1007\/s10270-024-01233-6","relation":{},"ISSN":["1619-1366","1619-1374"],"issn-type":[{"value":"1619-1366","type":"print"},{"value":"1619-1374","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,19]]},"assertion":[{"value":"24 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 July 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 October 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 November 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}