{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:25:25Z","timestamp":1750220725387,"version":"3.41.0"},"reference-count":6,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,1,16]],"date-time":"2020-01-16T00:00:00Z","timestamp":1579132800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2020,1,16]]},"abstract":"<jats:p>Trends such as globalisation, standardisation and shorter life-cycles place great demands on the flexibility of the software industry. In order to compete and cooperate on an international scale, a constantly decreasing time to market and an increasing level of quality are essential. Testing is at the moment the most important and mostly used quality assurance technique applied in industry. However, the complexity of software and hence of their development amount is increasing. Modern systems get larger and more complex, as they connect large amounts of components that interact in many different ways and have constantly changing and different types of requirements (functionality, dependability, usability, performance etc.). Data processing that impacts all aspects of our life is increasingly distributed over clouds and devices. This leads to new concerns, such as availability, security, and privacy, which are aspects that also needs to be tested. Consequently, the development of cost-effective and high-quality systems opens new challenges that cannot be faced only with traditional testing approaches, and specifically manual testing is simply insufficient and unreliable to manage the speed needed, and ensure the coverage of ever-changing systems. New techniques for systematization and automation of testing throughout the software and system life-cycle are required.<\/jats:p>","DOI":"10.1145\/3375572.3375578","type":"journal-article","created":{"date-parts":[[2020,1,23]],"date-time":"2020-01-23T03:05:08Z","timestamp":1579748708000},"page":"21-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Automating TEST Case Design, Selection and Evaluation Report on 10 Editions of A-TESTWorkshop"],"prefix":"10.1145","volume":"45","author":[{"given":"Tanja E. J.","family":"Vos","sequence":"first","affiliation":[{"name":"Universidad Polit\u00e9cnica de Valencia, Valencia , Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"I. S. W. B.","family":"Prasetya","sequence":"additional","affiliation":[{"name":"Utrecht University, Utrecht, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sigrid","family":"Eldh","sequence":"additional","affiliation":[{"name":"Ericsson, Stockholm, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sinem","family":"Getir","sequence":"additional","affiliation":[{"name":"Humboldt-Universit\u00e4t zu Berlin, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ali","family":"Parsai","sequence":"additional","affiliation":[{"name":"Universiteit van Antwerpen, Antwerpen, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pekka","family":"Aho","sequence":"additional","affiliation":[{"name":"Open Universiteit, , Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,1,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Mar","author":"Personal","year":"2019","unstructured":"Personal computing device shipments forecast to continue their slow decline with a five-year compound annual growth rate of -1.2% , according to idc , Mar 2019 . https:\/\/www.idc.com\/getdoc.jsp?containerId=prUS44908319. Personal computing device shipments forecast to continue their slow decline with a five-year compound annual growth rate of -1.2%, according to idc, Mar 2019. https:\/\/www.idc.com\/getdoc.jsp?containerId=prUS44908319."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2652524.2652588"},{"key":"e_1_2_1_3_1","volume-title":"Enabling visual design verification analytics - from prototype visualizations to an analytics tool using the unity game engine. CoRR, abs\/1808.09767","author":"Borg Markus","year":"2018","unstructured":"Markus Borg , Daniel Brytting , and Daniel Hansson . Enabling visual design verification analytics - from prototype visualizations to an analytics tool using the unity game engine. CoRR, abs\/1808.09767 , 2018 . Markus Borg, Daniel Brytting, and Daniel Hansson. Enabling visual design verification analytics - from prototype visualizations to an analytics tool using the unity game engine. CoRR, abs\/1808.09767, 2018."},{"key":"e_1_2_1_4_1","volume-title":"Model-based software testing. Encyclopedia of Software Engineering","author":"El-Far Ibrahim K","year":"2002","unstructured":"Ibrahim K El-Far and James A Whittaker . Model-based software testing. Encyclopedia of Software Engineering , 2002 . Ibrahim K El-Far and James A Whittaker. Model-based software testing. Encyclopedia of Software Engineering, 2002."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPRIME.2013.6496451"},{"key":"e_1_2_1_6_1","first-page":"148","volume-title":"LittleDarwin: A Feature-Rich and Extensible Mutation Testing Framework for Large and Complex Java Systems","author":"Parsai Ali","year":"2017","unstructured":"Ali Parsai , Alessandro Murgia , and Serge Demeyer . LittleDarwin: A Feature-Rich and Extensible Mutation Testing Framework for Large and Complex Java Systems , pages 148 -- 163 . Springer International Publishing , Cham , 2017 . Ali Parsai, Alessandro Murgia, and Serge Demeyer. LittleDarwin: A Feature-Rich and Extensible Mutation Testing Framework for Large and Complex Java Systems, pages 148--163. Springer International Publishing, Cham, 2017."}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375572.3375578","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375572.3375578","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:14Z","timestamp":1750199894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375572.3375578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,16]]},"references-count":6,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,1,16]]}},"alternative-id":["10.1145\/3375572.3375578"],"URL":"https:\/\/doi.org\/10.1145\/3375572.3375578","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2020,1,16]]},"assertion":[{"value":"2020-01-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}