{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T20:38:21Z","timestamp":1770237501924,"version":"3.49.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T00:00:00Z","timestamp":1720742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2024,7,12]]},"abstract":"<jats:p>\n                    Metamorphic testing is a valuable technique that helps in dealing with the oracle problem. It involves testing software against specifications of its intended behavior given in terms of so called\n                    <jats:italic toggle=\"yes\">metamorphic relations<\/jats:italic>\n                    , statements that express properties relating different software elements (e.g., different inputs, methods, etc). The effective application of metamorphic testing strongly depends on identifying suitable domain-specific metamorphic relations, a challenging task, that is typically manually performed.\n                  <\/jats:p>\n                  <jats:p>\n                    This paper introduces\n                    <jats:sc>MemoRIA<\/jats:sc>\n                    , a novel approach that aims at automatically identifying metamorphic relations. The technique focuses on a particular kind of metamorphic relation, which asserts equivalences between methods and method sequences.\n                    <jats:sc>MemoRIA<\/jats:sc>\n                    works by first generating an object-protocol abstraction of the software being tested, then using fuzzing to produce candidate relations from the abstraction, and finally validating the candidate relations through run-time analysis. A SAT-based analysis is used to eliminate redundant relations, resulting in a concise set of metamorphic relations for the software under test. We evaluate our technique on a benchmark consisting of 22 Java subjects taken from the literature, and compare\n                    <jats:sc>MemoRIA<\/jats:sc>\n                    with the metamorphic relation inference technique SBES. Our results show that by incorporating the object protocol abstraction information,\n                    <jats:sc>MemoRIA<\/jats:sc>\n                    is able to more effectively infer meaningful metamorphic relations, that are also more precise, compared to SBES, measured in terms of mutation analysis. Also, the SAT-based reduction allows us to significantly reduce the number of reported metamorphic relations, while in general having a small impact in the bug finding ability of the corresponding obtained relations.\n                  <\/jats:p>\n                  <jats:p>\n                    CCS Concepts: \u2022\n                    <jats:bold>Theory of computation \u2192 Program specifications<\/jats:bold>\n                    ; \u2022\n                    <jats:bold>Software and its engineering \u2192 Software testing and debugging<\/jats:bold>\n                    ;\n                    <jats:bold>Dynamic analysis<\/jats:bold>\n                    .\n                  <\/jats:p>","DOI":"10.1145\/3643747","type":"journal-article","created":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T10:22:09Z","timestamp":1720779729000},"page":"450-472","source":"Crossref","is-referenced-by-count":3,"title":["Abstraction-Aware Inference of Metamorphic Relations"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2748-2467","authenticated-orcid":false,"given":"Agust\u00edn","family":"Nolasco","sequence":"first","affiliation":[{"name":"University of Rio Cuarto, Rio Cuarto, Argentina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2441-1555","authenticated-orcid":false,"given":"Facundo","family":"Molina","sequence":"additional","affiliation":[{"name":"IMDEA Software Institute, Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1611-3969","authenticated-orcid":false,"given":"Renzo","family":"Degiovanni","sequence":"additional","affiliation":[{"name":"Luxembourg Institute of Science and Technology, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6711-3080","authenticated-orcid":false,"given":"Alessandra","family":"Gorla","sequence":"additional","affiliation":[{"name":"IMDEA Software Institute, Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4180-7196","authenticated-orcid":false,"given":"Diego","family":"Garbervetsky","sequence":"additional","affiliation":[{"name":"University of Buenos Aires and ICC\/CONICET, Buenos Aires, Argentina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1852-2547","authenticated-orcid":false,"given":"Mike","family":"Papadakis","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9352-1478","authenticated-orcid":false,"given":"Sebastian","family":"Uchitel","sequence":"additional","affiliation":[{"name":"Imperial College, London, United Kingdom"},{"name":"University of Buenos Aires and ICC\/CONICET, Buenos Aires, Argentina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0532-5296","authenticated-orcid":false,"given":"Nazareno","family":"Aguirre","sequence":"additional","affiliation":[{"name":"University of Rio Cuarto, Rio Cuarto, Argentina"},{"name":"CONICET, Buenos Aires, Argentina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5592-1355","authenticated-orcid":false,"given":"Marcelo F.","family":"Frias","sequence":"additional","affiliation":[{"name":"The University of Texas at El Paso, El Paso, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,7,12]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2023. Fuzzing Research Tools and their Relatedness. https:\/\/fuzzing-survey.org\/."},{"key":"e_1_3_1_3_2","unstructured":"2024. MemoRIA implementation and replication package. https:\/\/zenodo.org\/records\/10683011. https:\/\/zenodo.org\/records\/10683011"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP52600.2021.00023"},{"key":"e_1_3_1_5_2","unstructured":"Apache. 2023. Apache Commons site. https:\/\/commons.apache.org\/."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22655-7_2"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3213846.3213872"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111041"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568287"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606624"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3143561"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2015.07.037"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985846"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.98"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2491509.2491519"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/2491509.2491519"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2007.01.015"},{"key":"e_1_3_1_19_2","unstructured":"Javier Godoy et al. 2023. EPA benchmark repository. https:\/\/github.com\/j-godoy\/epa-benchmark."},{"key":"e_1_3_1_20_2","first-page":"416","volume-title":"SIGSOFTFSE","author":"Fraser Gordon","year":"2011","unstructured":"Gordon Fraser and Andrea Arcuri. 2011. EvoSuite: automatic test suite generation for object-oriented software. In SIGSOFTFSE. ACM, 416\u2013419."},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3415153"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635888"},{"key":"e_1_3_1_23_2","unstructured":"Google. 2021. Google\u2019s ClusterFuzz. https:\/\/github.com\/google\/clusterfuzz."},{"key":"e_1_3_1_24_2","unstructured":"Google. 2023. Google\u2019s AFL. https:\/\/github.com\/google\/AFL."},{"key":"e_1_3_1_25_2","unstructured":"Google. 2023. >Google\u2019s OSS-Fuzz. https:\/\/github.com\/google\/oss-fuzz."},{"key":"e_1_3_1_26_2","volume-title":"Software Abstractions - Logic, Language, and Analysis","author":"Jackson Daniel","year":"2006","unstructured":"Daniel Jackson. 2006. Software Abstractions - Logic, Language, and Analysis. MIT Press. http:\/\/mitpress.mit.edu\/catalog\/item\/default.asp?ttype=2&tid=10928"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33019478"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2628055"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100138"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931049"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106309"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3255177"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.46"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2946563"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510082"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510120"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00084"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00112"},{"key":"e_1_3_1_39_2","unstructured":"Oracle. 2023. Documentation of List Iterator implementation from java.util. https:\/\/docs.oracle.com\/javase\/8\/docs\/api\/java\/util\/ListIterator.html."},{"key":"e_1_3_1_40_2","unstructured":"Oracle. 2023. Documentation of Stack implementation from java.util. https:\/\/docs.oracle.com\/javase\/7\/docs\/api\/java\/util\/Stack.html."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2312918"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2384616.2384624"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524846.3527338"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2018.2875968"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-007-0015-3"},{"key":"e_1_3_1_47_2","unstructured":"Graphstream Team. 2023. Graphstream project site. https:\/\/graphstream-project.org\/."},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409758"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2017.05.043"},{"key":"e_1_3_1_50_2","volume-title":"The Fuzzing Book","author":"Zeller Andreas","year":"2019","unstructured":"Andreas Zeller, Rahul Gopinath, Marcel B\u00f6hme, Gordon Fraser, and Christian Holler. 2019. The Fuzzing Book. In The Fuzzing Book. Saarland University. https:\/\/www.fuzzingbook.org\/ Retrieved 2019-09-09 16:42:54+02:00."},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2019.00035"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642994"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643747","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3643747","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T08:04:30Z","timestamp":1770192270000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643747"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,12]]},"references-count":51,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2024,7,12]]}},"alternative-id":["10.1145\/3643747"],"URL":"https:\/\/doi.org\/10.1145\/3643747","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,12]]}}}