{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,4]],"date-time":"2026-10-04T15:35:54Z","timestamp":1791128154473,"version":"4.1.0"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2014,8,25]],"date-time":"2014-08-25T00:00:00Z","timestamp":1408924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["60973149"],"award-info":[{"award-number":["60973149"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002949","name":"Government of Jiangsu Province","doi-asserted-by":"publisher","award":["JHB2011-3"],"award-info":[{"award-number":["JHB2011-3"]}],"id":[{"id":"10.13039\/501100002949","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002338","name":"Ministry of Education of the People's Republic of China","doi-asserted-by":"publisher","award":["2.01E+13"],"award-info":[{"award-number":["2.01E+13"]}],"id":[{"id":"10.13039\/501100002338","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Scientific Research Foundation of the Graduate School of Southeast University No. YBJJ1313"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2015,1,8]]},"abstract":"<jats:p>Web service is a widely used implementation technique under the paradigm of Service-Oriented Architecture (SOA). A service-based system is subjected to continuous evolution and regression testing is required to check whether new faults have been introduced. Based on the current scientific work of web service regression testing, this survey aims to identify gaps in current research and suggests some promising areas for further study. To this end, we performed a broad automatic search on publications in the selected electronic databases published from 2000 to 2013. Through our careful review and manual screening, a total of 30 papers have been selected as primary studies for answering our research questions. We presented a qualitative analysis of the findings, including stakeholders, challenges, standards, techniques, and validations employed in these primary studies. Our main results include the following: (1) Service integrator is the key stakeholder that largely impacts how regression testing is performed. (2) Challenges of cost and autonomy issues have been studied heavily. However, more emphasis should be put on the other challenges, such as test timing, dynamics, privacy, quota constraints, and concurrency issues. (3) Orchestration-based services have been largely studied, while little attention has been paid to either choreography-based services or semantic-based services. (4) An appreciable amount of web service regression testing techniques have been proposed, including 48 test case prioritization techniques, 10 test selection techniques, two test suite minimization techniques, and another collaborative technique. (5) Many regression test techniques have not been theoretically proven or experimentally analyzed, which limits their application in large-scale systems. We believe that our survey has identified gaps in current research work and reveals new insights for the future work.<\/jats:p>","DOI":"10.1145\/2631685","type":"journal-article","created":{"date-parts":[[2014,8,26]],"date-time":"2014-08-26T12:08:55Z","timestamp":1409054935000},"page":"1-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Regression Testing of Web Service: A Systematic Mapping Study"],"prefix":"10.1145","volume":"47","author":[{"given":"Dong","family":"Qiu","sequence":"first","affiliation":[{"name":"Southeast University, Nanjing, Jiangsu, P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bixin","family":"Li","sequence":"additional","affiliation":[{"name":"Southeast University, Nanjing, Jiangsu, P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shunhui","family":"Ji","sequence":"additional","affiliation":[{"name":"Southeast University, Nanjing, Jiangsu, P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hareton","family":"Leung","sequence":"additional","affiliation":[{"name":"Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2014,8,25]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/356876.356879"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.12.005"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 2010 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC'10)","author":"Askarunisa A."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 2011 International Conference on Recent Trends in Information Technology (ICRTIT'11)","author":"Askarunisa A."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM'10)","author":"Athira B."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2009.180"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89652-4_41"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the International Conference on Software Maintenance (ICSM'88)","author":"Benedusi P."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463372.2463551"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1470"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2006.51"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-95888-8_4"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2010.27"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1941487.1941515"},{"key":"e_1_2_1_15_1","volume-title":"Test and Analysis of Web Services","author":"Penta Massimiliano Di"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/1444446.1444780"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988497"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2009.07.001"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/367008.367020"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/504282.504305"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 24th IEEE International Conference on Software Maintenance (ICSM'08)","author":"Hou Shan Shan","year":"2008"},{"key":"e_1_2_1_22_1","first-page":"1462","article-title":"Test case prioritization for regression testing based on severity of fault. Int","volume":"2","author":"Kavitha R.","year":"2010","journal-title":"J. Comput. Sci. Engin.g"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAICPART.2009.23"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1987434.1987466"},{"key":"e_1_2_1_25_1","volume-title":"Technical Report EBSE-2007-01. Keele University.","author":"Kitchenham Barbara A.","year":"2007"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2010.5609541"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2012.01.036"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2007.38"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1147\/sj.473.0457"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74974-5_13"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2013.29"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.4018\/jwsr.2013010104"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2008.22"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2009.12"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2010.11.905"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2012.17"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526830"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/2004685.2005524"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2011.75"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/274946.274960"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.11.014"},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","volume-title":"Systematic Reviews in the Social Sciences: A Practical Guide","author":"Petticrew Mark","DOI":"10.1002\/9780470754887"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.536955"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/248233.248262"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.256"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.962562"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2007.65"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIW.2007.8"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341811.1341820"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2011.84"},{"key":"e_1_2_1_51_1","first-page":"1","article-title":"Applying safe regression test selection techniques to java web services","volume":"2","author":"Ruth Michael E.","year":"2006","journal-title":"Int. J. Web Service Pract."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2007.219"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 2011 4th International Conference on the Applications of Digital Information and Web Technologies (ICADIWT'11)","author":"Michael"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242799"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390832.1390834"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/776816.776925"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/AICCSA.2006.205085"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2005.40"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC'04)","author":"Tsai W. T."},{"key":"e_1_2_1_60_1","volume-title":"High Assurance Services Computing","author":"Tsai Wei Tek"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.5555\/1333877.1334412"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/SERVICES-2.2008.28"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.86"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1002\/stv.430"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC.2009.72"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2010.63"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2012.40"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2010.98"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486814"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2631685","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2631685","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:55:48Z","timestamp":1750272948000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2631685"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,8,25]]},"references-count":69,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2015,1,8]]}},"alternative-id":["10.1145\/2631685"],"URL":"https:\/\/doi.org\/10.1145\/2631685","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,8,25]]},"assertion":[{"value":"2013-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-08-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}