{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T07:56:14Z","timestamp":1778054174925,"version":"3.51.4"},"reference-count":35,"publisher":"IGI Global","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2012,1,1]]},"abstract":"<p>Service Oriented Architecture (SOA) has become a major application development paradigm. As a basic unit of SOA applications, Web services significantly affect the quality of the applications constructed from them. In the context of SOA, the specification and implementation of Web services are completely separated. The lack of source code and the restricted control of Web services limit the testability of Web services, and make the oracle problem prominent. In this context, can one alleviate the test oracle problem, or effectively and efficiently test such Web services even without oracles? It is an important issue which has not been yet adequately addressed. To address the challenge of testing Web services, the authors propose a metamorphic relation-based approach to testing Web services without oracles. The proposed approach leverages so-called metamorphic relations to generate test cases and evaluate test results. To make the proposed approach practical and effective, the authors proposed a framework taking into account the unique features of SOA, and developed a prototype which partially automates the framework. Three case studies are conducted to validate the feasibility and effectiveness of the proposed approach. The work presented in the paper not only alleviates the test oracle problem of testing Web services, but also delivers an effective and efficient test technique without oracles.<\/p>","DOI":"10.4018\/jwsr.2012010103","type":"journal-article","created":{"date-parts":[[2012,4,3]],"date-time":"2012-04-03T15:26:42Z","timestamp":1333466802000},"page":"51-73","source":"Crossref","is-referenced-by-count":32,"title":["A Metamorphic Relation-Based Approach to Testing Web Services Without Oracles"],"prefix":"10.4018","volume":"9","author":[{"given":"Chang-ai","family":"Sun","sequence":"first","affiliation":[{"name":"University of Science and Technology Beijing and Chinese Academy of Science, China"}]},{"given":"Guan","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Science and Technology Beijing, China"}]},{"given":"Baohong","family":"Mu","sequence":"additional","affiliation":[{"name":"University of Science and Technology Beijing, China"}]},{"given":"Huai","family":"Liu","sequence":"additional","affiliation":[{"name":"Swinburne University of Technology, Australia"}]},{"given":"ZhaoShun","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Science and Technology Beijing, China"}]},{"given":"T. Y.","family":"Chen","sequence":"additional","affiliation":[{"name":"Swinburne University of Technology, Australia"}]}],"member":"2432","reference":[{"key":"jwsr.2012010103-0","doi-asserted-by":"crossref","unstructured":"Andrews, J. H., Briand, L. C., & Labiche, Y. (2005). Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering, St. Louis, MO (pp. 402-411).","DOI":"10.1145\/1062455.1062530"},{"key":"jwsr.2012010103-1","doi-asserted-by":"crossref","unstructured":"Bai, X., Lee, S., Tsai, W.-T., & Chen, Y. (2008). Ontology-based test modelling and partitioning testing of web services. In Proceedings of the 6th International Conference on Web Services, Beijing, China (pp. 465-472).","DOI":"10.1109\/ICWS.2008.111"},{"key":"jwsr.2012010103-2","doi-asserted-by":"crossref","unstructured":"Bartolini, C., Bertolino, A., Elbaum, S., & Marchetti, E. (2009). Whitening SOA testing. In Proceedings of the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, Amsterdam, The Netherlands (pp. 161-170).","DOI":"10.1145\/1595696.1595721"},{"key":"jwsr.2012010103-3","doi-asserted-by":"crossref","unstructured":"Bartolini, C., Bertolino, A., Marchetti, E., & Polini, A. (2009). WS-TAXI: A WSDL-based testing tool of web services. In Proceedings of the 2nd International Conference on Software Testing Verification and Validation, Denver, CO (pp. 326-335).","DOI":"10.1109\/ICST.2009.28"},{"key":"jwsr.2012010103-4","doi-asserted-by":"crossref","unstructured":"Canfora, G., & Di Penta, M. (2009). Service Oriented Architecture testing: A survey. In A. De Lucia & F. Ferrucci (Eds.), Proceedings of the International Summer Schools Lectures on Software Engineering (LNCS 5413, pp. 78-105).","DOI":"10.1007\/978-3-540-95888-8_4"},{"key":"jwsr.2012010103-5","doi-asserted-by":"publisher","DOI":"10.4018\/jwsr.2007040103"},{"key":"jwsr.2012010103-6","doi-asserted-by":"crossref","unstructured":"Chen, T. Y. (2010). Metamorphic testing: A simple approach to alleviate the oracle problem. In Proceedings of the 5th IEEE International Symposium on Service Oriented System Engineering, Nanjing, China (pp. 1-2).","DOI":"10.1109\/SOSE.2010.31"},{"key":"jwsr.2012010103-7","unstructured":"Chen, T. Y., Cheung, S. C., & Yiu, S. M. (1998). Metamorphic testing: A new approach for generating next test cases (Tech. Rep. No. HKUST-CS98-01). Clear Water Bay, NT, Hong Kong: Hong Kong University of Science and Technology."},{"key":"jwsr.2012010103-8","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-10-24"},{"key":"jwsr.2012010103-9","unstructured":"Chen, T. Y., Huang, D. H., Tse, T. H., & Zhou, Z. Q. (2004). Case studies on the selection of useful relations in metamorphic testing. In Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering, Madrid, Spain (pp. 569-583)."},{"key":"jwsr.2012010103-10","unstructured":"Chen, T. Y., Kuo, F. C., Liu, Y., & Tang, A. (2004). Metamorphic testing and testing with special values. In Proceedings of the 5th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing, Beijing, China (pp. 128-134)."},{"key":"jwsr.2012010103-11","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(02)00129-5"},{"key":"jwsr.2012010103-12","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.23"},{"issue":"4","key":"jwsr.2012010103-13","first-page":"31","article-title":"Hints on test data selection: Help for the practicing programmer.","volume":"1","author":"R. A.DeMillo","year":"1978","journal-title":"IEEE Computer"},{"issue":"2","key":"jwsr.2012010103-14","first-page":"130","article-title":"Survey of metamorphic testing.","volume":"3","author":"G. W.Dong","year":"2009","journal-title":"Journal of Frontiers of Computer Science and Technology"},{"key":"jwsr.2012010103-15","doi-asserted-by":"crossref","unstructured":"Farooq, A., Georgieva, K., & Dumke, R. R. (2008). Challenges in evaluating SOA test processes. In R. R. Dumke, R. Braungarten, G. B\u00fcren, A. Abran, & J. J. Cuadrado-Gallego (Eds.), Proceedings of the International Conferences IWSM, Metrikon and Mensura on Software Process and Product Measurement (LNCS 5338, pp. 107-113).","DOI":"10.1007\/978-3-540-89403-2_10"},{"key":"jwsr.2012010103-16","unstructured":"Haas, H., & Brown, A. (2004). Web services glossary. Retrieved from http:\/\/www.w3.org\/TR\/ws-gloss\/"},{"key":"jwsr.2012010103-17","doi-asserted-by":"crossref","unstructured":"Heckel, R., & Lohmann, M. (2004). Towards contract-based testing of web services. In Proceedings of the International Workshop on Test and Analysis of Component Based Systems, Barcelona, Spain (pp. 145-456).","DOI":"10.1016\/j.entcs.2004.02.073"},{"issue":"1","key":"jwsr.2012010103-18","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/TSE.1986.6312924","article-title":"An experimental evaluation of the assumption of independence in multi-version programmings.","volume":"12","author":"J. C.Knight","year":"1986","journal-title":"IEEE Transactions on Software Engineering"},{"key":"jwsr.2012010103-19","unstructured":"Lenz, C., Chimiak-Opoka, J., & Breu, R. (2007). Model driven testing of SOA-based software. In Proceedings of the Workshop on Software Engineering Methods for Service-Oriented Architecture, Hannover, Germany (pp. 99-110)."},{"key":"jwsr.2012010103-20","unstructured":"Murphy, C., Kaiser, G., Hu, L., & Wu, L. (2008). Properties of machine learning applications for use in metamorphic testing. In Proceedings of the 20th International Conference on Software Engineering and Knowledge Engineering, San Francisco Bay, CA (pp. 867-872)."},{"key":"jwsr.2012010103-21","doi-asserted-by":"publisher","DOI":"10.1145\/1022494.1022537"},{"key":"jwsr.2012010103-22","doi-asserted-by":"publisher","DOI":"10.1145\/1022494.1022529"},{"key":"jwsr.2012010103-23","doi-asserted-by":"publisher","DOI":"10.1142\/S0218843008001816"},{"key":"jwsr.2012010103-24","unstructured":"Peltz, C. (2003). Web services orchestration: A review of emerging technologies, tools, and standards (Tech. Rep.). Palo Alto, CA: Hewlett-Packard Company. Retrieved from http:\/\/devresource.hp.com\/drc\/"},{"key":"jwsr.2012010103-25","doi-asserted-by":"crossref","unstructured":"Ruth, M., & Tu, S. (2007). A safe regression test selection technique for web services. In Proceedings of the 2nd International Conference on Internet and Web Application and Services, Mauritius, R\u00e9publique de Maurice (p. 47).","DOI":"10.1109\/ICIW.2007.8"},{"key":"jwsr.2012010103-26","unstructured":"Sosnoski, D. (2009). Electronic source with authors and publication time. Retrieved from http:\/\/www.ibm.com\/developerworks\/java\/library\/j-jws6\/index.html"},{"key":"jwsr.2012010103-27","unstructured":"Sun, C. (2011). On open issues on SOA-based software development. Journal of China Science Paper Online. Retrieved from http:\/\/www.paper.edu.cn\/index.php\/default\/releasepaper\/content\/201107-461"},{"key":"jwsr.2012010103-28","doi-asserted-by":"crossref","unstructured":"Sun, C., Khoury, E., & Aiello, M. (2011). Transaction management in service-oriented systems: Requirements and a proposal. IEEE Transactions on Services Computing, 4(2), 167-180.","DOI":"10.1109\/TSC.2010.50"},{"key":"jwsr.2012010103-29","unstructured":"Sun, C., Wang, G., & Zhao, Y. (2011). Web service development: A process framework and case study. Journal of China Science Paper Online. Retrieved from http:\/\/www.paper.edu.cn\/index.php\/default\/releasepaper\/content\/201104-18"},{"key":"jwsr.2012010103-30","unstructured":"Tsai, W. T., Chen, Y., Paul, R., Huang, H., Zhou, X., & Wei, X. (2005). Adaptive testing, oracle generation, and test case generation for web services. In Proceedings of the 29th International Computer Software and Applications Conference, Edinburgh, UK (Vol. 2, pp. 101-106)."},{"issue":"4","key":"jwsr.2012010103-31","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1093\/comjnl\/25.4.465","article-title":"On testing non-testable programs.","volume":"25","author":"E. J.Weyuker","year":"1982","journal-title":"The Computer Journal"},{"key":"jwsr.2012010103-32","doi-asserted-by":"publisher","DOI":"10.1360\/jos161210"},{"issue":"1","key":"jwsr.2012010103-33","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s11277-009-9879-9","article-title":"A Mobile Agent-Based Tool Supporting Web Services Testing","volume":"56","author":"J.Zhang","year":"2011","journal-title":"Wireless Personal Communications"},{"key":"jwsr.2012010103-34","doi-asserted-by":"crossref","unstructured":"Zhang, J., & Qiu, R. G. (2006). \u201cFault Injection-based Test Case Generation for SOA-oriented Software\u201d,Proceedings 2006 IEEE International Conference on Service Operations and Logistics, and Informatics, Shanghai, China, pp1070-1078.","DOI":"10.1109\/SOLI.2006.328900"}],"container-title":["International Journal of Web Services Research"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=64223","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T23:31:52Z","timestamp":1654126312000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jwsr.2012010103"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2012,1,1]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,1]]}},"URL":"https:\/\/doi.org\/10.4018\/jwsr.2012010103","relation":{},"ISSN":["1545-7362","1546-5004"],"issn-type":[{"value":"1545-7362","type":"print"},{"value":"1546-5004","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,1,1]]}}}