{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,28]],"date-time":"2025-09-28T04:20:39Z","timestamp":1759033239858,"version":"3.37.3"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,4,3]],"date-time":"2021-04-03T00:00:00Z","timestamp":1617408000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2021,4,3]],"date-time":"2021-04-03T00:00:00Z","timestamp":1617408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Software Qual J"],"published-print":{"date-parts":[[2021,6]]},"DOI":"10.1007\/s11219-021-09554-1","type":"journal-article","created":{"date-parts":[[2021,4,3]],"date-time":"2021-04-03T05:02:46Z","timestamp":1617426166000},"page":"275-307","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Empirical validation of a quality framework for evaluating modelling languages in MDE environments"],"prefix":"10.1007","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6111-3055","authenticated-orcid":false,"given":"F\u00e1ber D.","family":"Giraldo","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2706-6504","authenticated-orcid":false,"given":"\u00c1ngela J.","family":"Chicaiza","sequence":"additional","affiliation":[]},{"given":"Sergio","family":"Espa\u00f1a","sequence":"additional","affiliation":[]},{"given":"\u00d3scar","family":"Pastor","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,4,3]]},"reference":[{"key":"9554_CR1","doi-asserted-by":"publisher","first-page":"103513","DOI":"10.1016\/j.csi.2021.103513","volume":"76","author":"OF Alaca","year":"2021","unstructured":"Alaca, O. F., Tezel, B. T., Challenger, M., Goulo, M., Amaral, V., & Kardas, G. (2021). Agentdsm-eval: A framework for the evaluation of domain-specific modeling languages for multi-agent systems. Computer Standards & Interfaces,\u00a076, 103513.","journal-title":"Computer Standards & Interfaces"},{"key":"9554_CR2","doi-asserted-by":"publisher","first-page":"103179","DOI":"10.1016\/j.compind.2019.103179","volume":"115","author":"S Arslan","year":"2020","unstructured":"Arslan, S., & Kardas, G. (2020). Dsml4dt: A domain-specific modeling language for device tree software. Computers in Industry, 115, 103179.","journal-title":"Computers in Industry"},{"key":"9554_CR3","doi-asserted-by":"publisher","first-page":"101020","DOI":"10.1016\/j.cola.2020.101020","volume":"62","author":"TZ Asici","year":"2021","unstructured":"Asici, T. Z., Tezel, B. T., & Kardas, G. (2021). On the use of the analytic hierarchy process in the evaluation of domain-specific modeling languages for multi-agent systems. Journal of Computer Languages, 62, 101020.","journal-title":"Journal of Computer Languages"},{"issue":"2","key":"9554_CR4","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s10270-005-0079-0","volume":"4","author":"J B\u00e9zivin","year":"2005","unstructured":"B\u00e9zivin, J. (2005). On the unification power of models. Software & Systems Modeling, 4(2), 171\u2013188.","journal-title":"Software & Systems Modeling"},{"key":"9554_CR5","doi-asserted-by":"crossref","unstructured":"Challenger, M., Kardas, G.,\u00a0& Tekinerdogan, B. (2015). A systematic approach to evaluating domain-specific modeling language environments for multi-agent systems. Software Quality Journal, pages 1\u201341.","DOI":"10.1007\/s11219-015-9291-5"},{"key":"9554_CR6","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/j.cl.2015.06.001","volume":"43","author":"AR da Silva","year":"2015","unstructured":"da Silva, A. R. (2015). Model-driven engineering: A survey supported by the unified conceptual model. Computer Languages, Systems & Structures, 43, 139\u2013155.","journal-title":"Computer Languages, Systems & Structures"},{"key":"9554_CR7","doi-asserted-by":"crossref","unstructured":"da\u00a0Silva\u00a0Teixeira, G.\u00a0M., Quirino, G.\u00a0K., Gailly, F., de\u00a0Almeida\u00a0Falbo, R., Guizzardi, G., Perini\u00a0Barcellos, M. (2016). PoN-S: A Systematic Approach for Applying the Physics of Notation (PoN), pages 432\u2013447. Springer International Publishing, Cham.","DOI":"10.1007\/978-3-319-39429-9_27"},{"key":"9554_CR8","doi-asserted-by":"crossref","unstructured":"Espinilla, M., Dom\u00ednguez-Mayo, F.\u00a0J.,  Escalona, M.\u00a0J.,\u00a0Mejas, M.,\u00a0Ross, M., &\u00a0Staples, G. (2011).\u00a0A Method Based on AHP to Define the Quality Model of QuEF, volume 123, pages 685\u2013694. Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-25661-5_85"},{"key":"9554_CR9","unstructured":"Fischer, M., & Strecker, S. (2018). A bibliography on: Evaluating conceptual models and modeling languages the quest for sensible evaluation criteria and methodic guidance (google docs). https:\/\/cutt.ly\/Hf5gGTP"},{"key":"9554_CR10","first-page":"1","volume":"2014","author":"F Giraldo","year":"2014","unstructured":"Giraldo, F., Espa\u00f1a, S., & Pastor, O. (2014). Analysing the concept of quality in model-driven engineering literature: A systematic review. IEEE Eighth International Conference on Research Challenges in Information Science (RCIS), 2014, 1\u201312.","journal-title":"IEEE Eighth International Conference on Research Challenges in Information Science (RCIS)"},{"issue":"2","key":"9554_CR11","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1007\/s11219-016-9350-6","volume":"26","author":"FD Giraldo","year":"2018","unstructured":"Giraldo, F. D., Espa\u00f1a, S., Pastor, O., & Giraldo, W. J. (2018). Considerations about quality in model-driven engineering. Software Quality Journal, 26(2), 685\u2013750.","journal-title":"Software Quality Journal"},{"key":"9554_CR12","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.is.2018.06.002","volume":"77","author":"FD Giraldo","year":"2018","unstructured":"Giraldo, F. D., Espa\u00f1a, S., Pastor, O., & Giraldo, W. J. (2018). Evaluating the quality of a set of modelling languages used in combination: A method and a tool. Information Systems, 77, 48\u201370.","journal-title":"Information Systems"},{"issue":"3","key":"9554_CR13","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1007\/s11219-018-9434-6","volume":"27","author":"FD Giraldo","year":"2019","unstructured":"Giraldo, F. D., Espa\u00f1a, S., Giraldo, W. J., Pastor, \u00d3., & Krogstie, J. (2019). A method to evaluate quality of modelling languages based on the Zachman reference taxonomy. Software Quality Journal, 27(3), 1239\u20131269.","journal-title":"Software Quality Journal"},{"issue":"3","key":"9554_CR14","doi-asserted-by":"publisher","first-page":"611","DOI":"10.2307\/25148742","volume":"30","author":"S Gregor","year":"2006","unstructured":"Gregor, S. (2006). The nature of theory in information systems. MIS Q., 30(3), 611\u2013642.","journal-title":"MIS Q."},{"issue":"3","key":"9554_CR15","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1002\/sys.20181","volume":"14","author":"Y Grobshtein","year":"2011","unstructured":"Grobshtein, Y., & Dori, D. (2011). Generating sysml views from an opm model: Design and evaluation. Systems Engineering, 14(3), 327\u2013340.","journal-title":"Systems Engineering"},{"key":"9554_CR16","first-page":"1","volume":"5","author":"M Heggset","year":"2015","unstructured":"Heggset, M., Krogstie, J., & Wesenberg, H. (2015). The influence of syntactic quality on pragmatic quality of enterprise process models. Complex Systems Informatics and Modeling Quarterly Journal (CSIMQ), 5, 1\u201313.","journal-title":"Complex Systems Informatics and Modeling Quarterly Journal (CSIMQ)"},{"key":"9554_CR17","doi-asserted-by":"crossref","unstructured":"Hindawi, M., Morel, L., Aubry, R., & Sourrouille, J. L. (2009). Description and implementation of a uml style guide. In M.\u00a0R.\u00a0V. Chaudron, editor, Mo-dels in Software Engineering, pages 291\u2013302, Berlin, Heidelberg,\u00a0Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-01648-6_31"},{"key":"9554_CR18","unstructured":"ISO\/IEC\/(IEEE). ISO\/IEC 42010:2011 : Systems and software engineering Architecture description, 12 2011."},{"key":"9554_CR19","doi-asserted-by":"crossref","unstructured":"Jedlitschka, A., Ciolkowski, M., & Pfahl, D. (2008). Reporting Experiments in Software Engineering, pages 201\u2013228. Springer London, London.","DOI":"10.1007\/978-1-84800-044-5_8"},{"key":"9554_CR20","doi-asserted-by":"publisher","first-page":"100964","DOI":"10.1016\/j.cola.2020.100964","volume":"58","author":"H Khalajzadeh","year":"2020","unstructured":"Khalajzadeh, H., Simmons, A. J., Abdelrazek, M., Grundy, J., Hosking, J., & He, Q. (2020). An end-to-end model-based approach to support big data analytics development. Journal of Computer Languages, 58, 100964.","journal-title":"Journal of Computer Languages"},{"key":"9554_CR21","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2936-3","volume-title":"Model-Based Development and Evolution of Information Systems: A Quality Approach","author":"J Krogstie","year":"2012","unstructured":"Krogstie, J. (2012). Model-Based Development and Evolution of Information Systems: A Quality Approach. Incorporated: Springer Publishing Company."},{"key":"9554_CR22","doi-asserted-by":"crossref","unstructured":"Krogstie J. (2012). Model-Based Development and Evolution of Information Systems: A Quality Approach, chapter Quality of Models, pages 205\u2013247. Springer London, London.","DOI":"10.1007\/978-1-4471-2936-3_4"},{"key":"9554_CR23","doi-asserted-by":"crossref","unstructured":"Krogstie, J. (2012). Model-Based Development and Evolution of Information Systems: A Quality Approach, chapter Quality of Modelling Languages, pages 249\u2013280. Springer London, London.","DOI":"10.1007\/978-1-4471-2936-3_5"},{"key":"9554_CR24","doi-asserted-by":"crossref","unstructured":"Lange, C., & Chaudron, M. (2005). Managing Model Quality in UML-Based Software Development. In Software Technology and Engineering Practice, 2005. 13th IEEE International Workshop on, pages 7\u201316.","DOI":"10.1109\/STEP.2005.16"},{"key":"9554_CR25","doi-asserted-by":"crossref","unstructured":"Le\u00a0Pallec,\u00a0X.,\u00a0& Dupuy-Chessa, S. (2013). Support for quality metrics in metamodelling. In Proceedings of the Second Workshop on Graphical Modeling Language Development, GMLD \u201913, pages 23\u201331. ACM.","DOI":"10.1145\/2489820.2489825"},{"key":"9554_CR26","unstructured":"L\u00f3pez-Fern\u00e1ndez, J.\u00a0J., Guerra, E., & de\u00a0Lara, J. (2014). Assessing the quality of meta-models. 11th Workshop on Model Driven Engineering, Verification and Validation MoDeVVa 2014, page\u00a010."},{"issue":"3","key":"9554_CR27","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1016\/j.datak.2007.04.008","volume":"63","author":"A Maes","year":"2007","unstructured":"Maes, A., & Poels, G. (2007). Evaluating quality of conceptual modelling scripts based on user perceptions. Data & Knowledge Engineering, 63(3), 701\u2013724.","journal-title":"Data & Knowledge Engineering"},{"key":"9554_CR28","unstructured":"Merilinna, J. (2005). A Tool for Quality-Driven Architecture Model Transformation. PhD thesis, VTT Technical Research Centre of Finland."},{"issue":"4","key":"9554_CR29","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1145\/1118890.1118892","volume":"37","author":"M Mernik","year":"2005","unstructured":"Mernik, M., Heering, J., & Sloane, A. M. (2005). When and how to develop domain-specific languages. ACM Computing Surveys, 37(4), 316\u2013344.","journal-title":"ACM Computing Surveys"},{"key":"9554_CR30","doi-asserted-by":"crossref","unstructured":"Miranda, T., Challenger, M., Tezel, B. T., Alaca, O. F., Bari\u0161i\u0107, A., Amaral, V., et\u00a0al. (2019). Improving the usability of a mas dsml. In D. Weyns, V. Mascardi, & A. Ricci (Eds.), Engineering Multi-Agent Systems (pp. 55\u201375)., pp Cham: Springer International Publishing.","DOI":"10.1007\/978-3-030-25693-7_4"},{"key":"9554_CR31","doi-asserted-by":"crossref","unstructured":"Mohagheghi, P., Dehlen, V., & Neple, T. (2009). Definitions and approaches to model quality in model-based software development a review of literature. Information and Software Technology, 51(12):1646 \u2013 1669. Quality of UML Models.","DOI":"10.1016\/j.infsof.2009.04.004"},{"key":"9554_CR32","doi-asserted-by":"crossref","unstructured":"Moody, D. (2009). The \u201cphysics\u201d of notations: Toward a scientific basis for constructing visual notations in software engineering. IEEE Trans. Softw. Eng.\u00a035(6), 756\u2013779.","DOI":"10.1109\/TSE.2009.67"},{"key":"9554_CR33","unstructured":"Moody, D. L. (2003). The method evaluation model: a theoretical model for validating information systems design methods. In Proceedings of the 11th European Conference on Information Systems, ECIS 2003, Naples, Italy 16-21 June 2003, pages 1327\u20131336."},{"key":"9554_CR34","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.infsof.2015.02.012","volume":"62","author":"JI Panach","year":"2015","unstructured":"Panach, J. I., Espa\u00f1a, S., Dieste, \u00d3., Pastor, \u00d3., & Juristo, N. (2015). In search of evidence for model-driven development claims: An experiment on quality, effort, productivity and satisfaction. Information and Software Technology, 62, 164\u2013186.","journal-title":"Information and Software Technology"},{"key":"9554_CR35","doi-asserted-by":"publisher","first-page":"102126","DOI":"10.1016\/j.simpat.2020.102126","volume":"104","author":"F Santos","year":"2020","unstructured":"Santos, F., Nunes, I., & Bazzan, A. L. (2020). Quantitatively assessing the benefits of model-driven development in agent-based modeling and simulation. Simulation Modelling Practice and Theory, 104, 102126.","journal-title":"Simulation Modelling Practice and Theory"},{"issue":"5","key":"9554_CR36","doi-asserted-by":"publisher","first-page":"3083","DOI":"10.1007\/s10270-018-00711-y","volume":"18","author":"SS Shin","year":"2019","unstructured":"Shin, S. S. (2019). Empirical study on the effectiveness and efficiency of model-driven architecture techniques. Software & Systems Modeling, 18(5), 3083\u20133096.","journal-title":"Software & Systems Modeling"},{"key":"9554_CR37","unstructured":"Siau, K., & Rossi, M. (1998). Evaluation of information modeling methods-a review. In System Sciences, 1998., Proceedings of the Thirty-First Hawaii International Conference on, volume\u00a05, pages 314\u2013322 vol. 5."},{"issue":"3","key":"9554_CR38","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1147\/sj.313.0590","volume":"31","author":"JF Sowa","year":"1992","unstructured":"Sowa, J. F., & Zachman, J. A. (1992). Extending and formalizing the framework for information systems architecture. IBM Systems Journal, 31(3), 590\u2013616.","journal-title":"IBM Systems Journal"},{"key":"9554_CR39","doi-asserted-by":"crossref","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M. C., & Regnell, B. (2012). Experimentation in Software Engineering. Springer.","DOI":"10.1007\/978-3-642-29044-2"},{"key":"9554_CR40","doi-asserted-by":"crossref","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson,\u00a0M.\u00a0C., Regnell, B., & Wessl\u00e9n, A. (2012). Operation, pages 117\u2013122. Springer Berlin Heidelberg, Berlin, Heidelberg.","DOI":"10.1007\/978-3-642-29044-2_9"},{"key":"9554_CR41","doi-asserted-by":"crossref","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M.\u00a0C., Regnell, B., & Wessl\u00e9n, A. (2012). Planning, pages 89\u2013116. Springer Berlin Heidelberg, Berlin, Heidelberg.","DOI":"10.1007\/978-3-642-29044-2_8"},{"key":"9554_CR42","doi-asserted-by":"crossref","unstructured":"Wortmann, A., Barais, O., Combemale, B., & Wimmer, M. (2019). Modeling languages in industry 4.0: an extended systematic mapping study. Software and Systems Modeling.","DOI":"10.1007\/s10270-019-00757-6"},{"issue":"3","key":"9554_CR43","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1147\/sj.263.0276","volume":"26","author":"JA Zachman","year":"1987","unstructured":"Zachman, J. A. (1987). A framework for information systems architecture. IBM Systems Journal, 26(3), 276\u2013292.","journal-title":"IBM Systems Journal"}],"container-title":["Software Quality Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-021-09554-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11219-021-09554-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-021-09554-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,5]],"date-time":"2021-06-05T01:11:24Z","timestamp":1622855484000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11219-021-09554-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,3]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["9554"],"URL":"https:\/\/doi.org\/10.1007\/s11219-021-09554-1","relation":{},"ISSN":["0963-9314","1573-1367"],"issn-type":[{"type":"print","value":"0963-9314"},{"type":"electronic","value":"1573-1367"}],"subject":[],"published":{"date-parts":[[2021,4,3]]},"assertion":[{"value":"15 March 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 April 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}