{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T18:30:54Z","timestamp":1770748254641,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,9]],"date-time":"2022-05-09T00:00:00Z","timestamp":1652054400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Spanish Ministry of Science","award":["RTI2018-095255-B-I00"],"award-info":[{"award-number":["RTI2018-095255-B-I00"]}]},{"name":"Madrid region","award":["P2018\/TCS-4314"],"award-info":[{"award-number":["P2018\/TCS-4314"]}]},{"name":"European Union and Comunidad de Madrid","award":["S2018\/TCS-4339"],"award-info":[{"award-number":["S2018\/TCS-4339"]}]},{"name":"Madrid Government - Complutense University","award":["PR65\/19-22452"],"award-info":[{"award-number":["PR65\/19-22452"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,9]]},"DOI":"10.1145\/3524846.3527342","type":"proceedings-article","created":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T23:08:56Z","timestamp":1674860936000},"page":"34-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Analyzing the reliability of simulated distributed systems using metamorphic testing"],"prefix":"10.1145","author":[{"given":"Alberto","family":"N\u00fa\u00f1ez","sequence":"first","affiliation":[{"name":"Universidad Complutense de Madrid"}]},{"given":"Pablo C.","family":"Ca\u00f1izares","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid"}]},{"given":"Pablo","family":"G\u00f3mez-Abajo","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid"}]},{"given":"Esther","family":"Guerra","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid"}]},{"given":"Juan","family":"de Lara","sequence":"additional","affiliation":[{"name":"Universidad Aut\u00f3noma de Madrid"}]}],"member":"320","published-online":{"date-parts":[[2023,1,27]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"2021 IEEE\/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP'21)","author":"Ahlgren J.","unstructured":"J. Ahlgren , M. Berezin , K. Bojarczuk , E. Dulskyte , I. Dvortsova , J. George , N. Gucevska , M. Harman , M. Lomeli , E. Meijer , S. Sapora , and J. Spahr-Summers . 2021. Testing web enabled simulation at scale using metamorphic testing . In 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP'21) . 140--149. J. Ahlgren, M. Berezin, K. Bojarczuk, E. Dulskyte, I. Dvortsova, J. George, N. Gucevska, M. Harman, M. Lomeli, E. Meijer, S. Sapora, and J. Spahr-Summers. 2021. Testing web enabled simulation at scale using metamorphic testing. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP'21). 140--149."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"P. Ammann and J. Offutt. 2017. Introduction to Software Testing (2nd ed.). Cambridge University Press.  P. Ammann and J. Offutt. 2017. Introduction to Software Testing (2nd ed.). Cambridge University Press.","DOI":"10.1017\/9781316771273"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.04.070"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110522"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.05.010"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"T.Y. Chen F.C. Kuo H. Liu P.L. Poon D. Towey T.H. Tse and Z.Q. Zhou. 2018. Metamorphic testing: A review of challenges and opportunities. ACM Computing Surveys (CSUR) 51 1 (2018) 4:1--4:27.  T.Y. Chen F.C. Kuo H. Liu P.L. Poon D. Towey T.H. Tse and Z.Q. Zhou. 2018. Metamorphic testing: A review of challenges and opportunities. ACM Computing Surveys (CSUR) 51 1 (2018) 4:1--4:27.","DOI":"10.1145\/3143561"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1260\/1748-3018.5.2.221"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.728"},{"key":"e_1_3_2_1_9_1","volume-title":"IEEE 8th International Conference on Software Testing, Verification and Validation (ICST'15)","author":"Harman M.","unstructured":"M. Harman , Y. Jia , and Y. Zhang . 2015. Achievements, open problems and challenges for search based software testing . In IEEE 8th International Conference on Software Testing, Verification and Validation (ICST'15) . 1--12. M. Harman, Y. Jia, and Y. Zhang. 2015. Achievements, open problems and challenges for search based software testing. In IEEE 8th International Conference on Software Testing, Verification and Validation (ICST'15). 1--12."},{"key":"e_1_3_2_1_10_1","volume-title":"2021 IEEE\/ACM 6th International Workshop on Metamorphic Testing (MET'21)","author":"Iqbal M.","unstructured":"M. Iqbal , J. C. Han , Z. Q. Zhou , and D. Towey . 2021. Enhancing Euro NCAP standards with metamorphic testing for verification of advanced driver-assistance systems . In 2021 IEEE\/ACM 6th International Workshop on Metamorphic Testing (MET'21) . 37--41. M. Iqbal, J. C. Han, Z. Q. Zhou, and D. Towey. 2021. Enhancing Euro NCAP standards with metamorphic testing for verification of advanced driver-assistance systems. In 2021 IEEE\/ACM 6th International Workshop on Metamorphic Testing (MET'21). 37--41."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"A. Kostin and L. Ilushechkina. 2010. Modeling and simulation of distributed systems. World Scientific Publishing. 1--440 pages.  A. Kostin and L. Ilushechkina. 2010. Modeling and simulation of distributed systems. World Scientific Publishing. 1--440 pages.","DOI":"10.1142\/7562"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2018.2880577"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"G. J. Myers C. Sandler and T. Badgett. 2011. The Art of Software Testing (3rd ed.). John Wiley & Sons.  G. J. Myers C. Sandler and T. Badgett. 2011. The Art of Software Testing (3rd ed.). John Wiley & Sons.","DOI":"10.1002\/9781119202486"},{"key":"e_1_3_2_1_14_1","volume-title":"International Conference on Computational Science, ICCS'12 (Procedia Computer Science)","volume":"9","author":"Nu\u00f1ez A.","unstructured":"A. Nu\u00f1ez , C. Andr\u00e9s , and M. G. Merayo . 2012. Optimizing the trade-offs between cost and performance in scientific computing . In International Conference on Computational Science, ICCS'12 (Procedia Computer Science) , Vol. 9 . Elsevier, 498--507. A. Nu\u00f1ez, C. Andr\u00e9s, and M. G. Merayo. 2012. Optimizing the trade-offs between cost and performance in scientific computing. In International Conference on Computational Science, ICCS'12 (Procedia Computer Science), Vol. 9. Elsevier, 498--507."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115955"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2020.3011512"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2011.08.009"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12243-014-0442-7"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/cae.22141"},{"key":"e_1_3_2_1_20_1","volume-title":"Winter Simulation Conference. 4089--4090","author":"Olsen M.","unstructured":"M. Olsen and M. Raunak . 2014. A survey of validation in health care simulation studies . In Winter Simulation Conference. 4089--4090 . M. Olsen and M. Raunak. 2014. A survey of validation in health care simulation studies. In Winter Simulation Conference. 4089--4090."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2850315"},{"key":"e_1_3_2_1_22_1","first-page":"39","article-title":"Performance evaluation on journaling file systems using Iozone tool in the Linux: Focus on read, write","volume":"17","author":"Park H.J.","year":"2013","unstructured":"H.J. Park . 2013 . Performance evaluation on journaling file systems using Iozone tool in the Linux: Focus on read, write . The Journal of Korea Navigation Institute 17 (2013), 39 -- 46 . H.J. Park. 2013. Performance evaluation on journaling file systems using Iozone tool in the Linux: Focus on read, write. The Journal of Korea Navigation Institute 17 (2013), 39--46.","journal-title":"The Journal of Korea Navigation Institute"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/293172.293175"},{"key":"e_1_3_2_1_25_1","unstructured":"E. Strohmaier J. Dongarra H. Simon and M. Meuer. 2021. TOP500 Supercomputer site. http:\/\/www.top500.org  E. Strohmaier J. Dongarra H. Simon and M. Meuer. 2021. TOP500 Supercomputer site. http:\/\/www.top500.org"},{"key":"e_1_3_2_1_26_1","volume-title":"INET framework for the OMNeT++ discrete event simulator. https:\/\/github.com\/inet-framework\/inet. [Online","author":"Szaszko G.","year":"2017","unstructured":"G. Szaszko . 2017. INET framework for the OMNeT++ discrete event simulator. https:\/\/github.com\/inet-framework\/inet. [Online ; Latest commit on Oct 2, 2017 . Accessed on Oct 15, 2017]. G. Szaszko. 2017. INET framework for the OMNeT++ discrete event simulator. https:\/\/github.com\/inet-framework\/inet. [Online; Latest commit on Oct 2, 2017. Accessed on Oct 15, 2017]."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion52605.2021.00048"},{"key":"e_1_3_2_1_28_1","unstructured":"A. Varga. 2001. The OMNeT++ discrete event simulation system . In European Simulation Multiconference.  A. Varga. 2001. The OMNeT++ discrete event simulation system . In European Simulation Multiconference."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/25.4.465"}],"event":{"name":"ICSE '22: 44th International Conference on Software Engineering","location":"Pittsburgh Pennsylvania","acronym":"ICSE '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"]},"container-title":["Proceedings of the 7th International Workshop on Metamorphic Testing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524846.3527342","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3524846.3527342","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:36Z","timestamp":1750183776000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524846.3527342"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,9]]},"references-count":29,"alternative-id":["10.1145\/3524846.3527342","10.1145\/3524846"],"URL":"https:\/\/doi.org\/10.1145\/3524846.3527342","relation":{},"subject":[],"published":{"date-parts":[[2022,5,9]]},"assertion":[{"value":"2023-01-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}