{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T22:45:51Z","timestamp":1769726751444,"version":"3.49.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,10,26]],"date-time":"2021-10-26T00:00:00Z","timestamp":1635206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministry of Economy and Competitiveness","doi-asserted-by":"crossref","award":["RTI2018-096411-B-I00"],"award-info":[{"award-number":["RTI2018-096411-B-I00"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2022,1,31]]},"abstract":"<jats:p>The companies that have adopted the Model-Driven Engineering (MDE) paradigm have the advantage of working at a high level of abstraction. Nevertheless, they have the disadvantage of the lack of tools available to perform bug localization at the model level. In addition, in an MDE context, a bug can be related to different MDE artefacts, such as design-time models, model transformations, or run-time models. Starting the bug localization in the wrong place or with the wrong tool can lead to a result that is unsatisfactory. We evaluate how to apply the existing model-based approaches in order to mitigate the effect of starting the localization in the wrong place. We also take into account that software engineers can refine the results at different stages. In our evaluation, we compare different combinations of the application of bug localization approaches and human refinement. The combination of our approaches plus manual refinement obtains the best results. We performed a statistical analysis to provide evidence of the significance of the results. The conclusions obtained from this evaluation are: humans have to be involved at the right time in the process (or results can even get worse), and artefact-independence can be achieved without worsening the results.<\/jats:p>","DOI":"10.1145\/3472616","type":"journal-article","created":{"date-parts":[[2021,10,26]],"date-time":"2021-10-26T13:51:28Z","timestamp":1635256288000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Bug Localization in Model-Based Systems in the Wild"],"prefix":"10.1145","volume":"31","author":[{"given":"Lorena","family":"Arcega","sequence":"first","affiliation":[{"name":"Escuela de Arquitectura y Tecnolog\u00eda, Universidad San Jorge, Zaragoza, Spain"}]},{"given":"Jaime","family":"Font","sequence":"additional","affiliation":[{"name":"Escuela de Arquitectura y Tecnolog\u00eda, Universidad San Jorge, Zaragoza, Spain"}]},{"given":"\u00d8ystein","family":"Haugen","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science, \u00d8stfold University College, Halden, Norway"}]},{"given":"Carlos","family":"Cetina","sequence":"additional","affiliation":[{"name":"Escuela de Arquitectura y Tecnolog\u00eda, Universidad San Jorge, Zaragoza, Spain"}]}],"member":"320","published-online":{"date-parts":[[2021,10,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1610451"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239372.3239392"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-019-00727-y"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1486"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-013-9249-9"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/42512.42515"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-018-00712-x"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.326"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110804"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0177678"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39742-4_6"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2375201"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSICC49403.2020.9050064"},{"key":"e_1_2_1_15_1","volume-title":"Practical Nonparametric Statistics (3rd. ed.)","author":"Conover W. J.","unstructured":"W. J. Conover . 1999. Practical Nonparametric Statistics (3rd. ed.) . Wiley . W. J. Conover. 1999. Practical Nonparametric Statistics (3rd. ed.). Wiley."},{"key":"e_1_2_1_16_1","unstructured":"M\u00e1rcio de Oliveira Barros and Arilo Cl\u00e1udio Dias-Neto. 2011. 0006\/2011-Threats to Validity in Search-Based Software Engineering Empirical Studies. Technical Report 1. Universidade Federal do Estado do Rio de Janeiro.  M\u00e1rcio de Oliveira Barros and Arilo Cl\u00e1udio Dias-Neto. 2011. 0006\/2011-Threats to Validity in Search-Based Software Engineering Empirical Studies. Technical Report 1. Universidade Federal do Estado do Rio de Janeiro."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/smr.567"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2017.2751100"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2010.5609691"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2009.12.010"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2012.6405255"},{"key":"e_1_2_1_24_1","unstructured":"R. J. Grissom and J. J. Kim. 2005. Effect Sizes for Research: A BroadPractical Approach. Lawrence Erlbaum Associates Publishers New Jersey NJ.  R. J. Grissom and J. J. Kim. 2005. Effect Sizes for Research: A BroadPractical Approach. Lawrence Erlbaum Associates Publishers New Jersey NJ."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2005.91"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/SPLC.2008.25"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2810892"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2006.1688438"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00054"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.24"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2017.24"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/01638539809545028"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786880"},{"key":"e_1_2_1_34_1","unstructured":"Sean Luke. 2012. Essentials of Metaheuristics (2nd. ed.). Lulu.  Sean Luke. 2012. Essentials of Metaheuristics (2nd. ed.). Lulu."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.11.043"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.08.031"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2017.2767023"},{"key":"e_1_2_1_38_1","volume-title":"Transformed Vargha-Delaney Effect Size","author":"Neumann Geoffrey","unstructured":"Geoffrey Neumann , Mark Harman , and Simon Poulding . 2015. Transformed Vargha-Delaney Effect Size . Springer International Publishing , Cham , 318\u2013324. DOI:http:\/\/dx.doi.org\/10.1007\/978-3-319-22183-0_29 Geoffrey Neumann, Mark Harman, and Simon Poulding. 2015. Transformed Vargha-Delaney Effect Size. Springer International Publishing, Cham, 318\u2013324. DOI:http:\/\/dx.doi.org\/10.1007\/978-3-319-22183-0_29"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering","volume":"1","author":"Panichella A.","year":"2016","unstructured":"A. Panichella , B. Dit , R. Oliveto , M. Di Penta , D. Poshyvanyk , and A. De Lucia . 2016. Parameterizing and assembling ir-based solutions for SE tasks using genetic algorithms . In Proceedings of the 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering , Vol. 1 , 314\u2013325. DOI:https:\/\/doi.org\/10.1109\/SANER. 2016 .97 A. Panichella, B. Dit, R. Oliveto, M. Di Penta, D. Poshyvanyk, and A. De Lucia. 2016. Parameterizing and assembling ir-based solutions for SE tasks using genetic algorithms. In Proceedings of the 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering, Vol. 1, 314\u2013325. DOI:https:\/\/doi.org\/10.1109\/SANER.2016.97"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.62"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-011-0012-5"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1997.5.1.1"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2635137"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-016-0541-1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12261-3_2"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/2664446.2664454"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1885639.1885650"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241744"},{"key":"e_1_2_1_49_1","first-page":"101","article-title":"A critique and improvement of the CL common language effect size statistics of McGraw and Wong","volume":"25","author":"Vargha Andr\u00e1s","year":"2000","unstructured":"Andr\u00e1s Vargha and Harold D. Delaney . 2000 . A critique and improvement of the CL common language effect size statistics of McGraw and Wong . Journal of Educational and Behavioral Statistics 25 , 2 (2000), 101 \u2013 132 . DOI:https:\/\/doi.org\/10.3102\/10769986025002101 Andr\u00e1s Vargha and Harold D. Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 25, 2 (2000), 101\u2013132. DOI:https:\/\/doi.org\/10.3102\/10769986025002101","journal-title":"Journal of Educational and Behavioral Statistics"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771797"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1002\/smr.1801"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2009.99"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2521368"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2014.03.007"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.5555\/998675.999460"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2892102"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472616","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472616","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:24Z","timestamp":1750191444000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472616"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,26]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1,31]]}},"alternative-id":["10.1145\/3472616"],"URL":"https:\/\/doi.org\/10.1145\/3472616","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,26]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}