{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:07:07Z","timestamp":1753884427765,"version":"3.41.2"},"reference-count":30,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2018,11,8]],"date-time":"2018-11-08T00:00:00Z","timestamp":1541635200000},"content-version":"vor","delay-in-days":311,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["107-2623-E-009-006-D"],"award-info":[{"award-number":["107-2623-E-009-006-D"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003392","name":"Natural Science Foundation of Fujian Province","doi-asserted-by":"publisher","award":["2018J05100"],"award-info":[{"award-number":["2018J05100"]}],"id":[{"id":"10.13039\/501100003392","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61702100","61702102"],"award-info":[{"award-number":["61702100","61702102"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:p>To appropriately realize the performance of a web service, it is essential to give it a comprehensive testing. Although an elastic test could be guaranteed in traditional cloud testing systems, the geographical test that supports real user behavior simulation remains a problem. In this paper, we propose a testing system based on a crowdsourcing model to carry out the distributed test on a target web server automatically. The proposed crowdsourcing\u2010based testing system (CTS) provides a reliable testing model to simulate real user web browsing behaviors with the help of web browsers scattered all around the world. In order to make the entire test process the same as the real situation, two test modes are proposed to simulate real user activity. By evaluating every single resource of web service automatically, a tester can not only find out internal problems but also understand the performance of the web service. In addition, the complete geographical test is available with the performance measurements coming from different regions in the world. Several experiments are performed to validate the functionality and usability of CTS. It demonstrates that CTS is a complete and reliable web service testing system, which provides unique functions and satisfies different requirements.<\/jats:p>","DOI":"10.1155\/2018\/2170585","type":"journal-article","created":{"date-parts":[[2018,11,8]],"date-time":"2018-11-08T23:31:54Z","timestamp":1541719914000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Distributed Testing System for Web Service Based on Crowdsourcing"],"prefix":"10.1155","volume":"2018","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7772-9607","authenticated-orcid":false,"given":"Xiaolong","family":"Liu","sequence":"first","affiliation":[]},{"given":"Yun-Ju","family":"Hsieh","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7828-550X","authenticated-orcid":false,"given":"Riqing","family":"Chen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3621-9528","authenticated-orcid":false,"given":"Shyan-Ming","family":"Yuan","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2018,11,8]]},"reference":[{"key":"e_1_2_10_1_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2011.6094008"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/tsc.2015.2415807"},{"key":"e_1_2_10_3_2","first-page":"641","article-title":"Web service testing tools: a comparative study","volume":"10","author":"Hussain S.","year":"2013","journal-title":"International Journal of Computer Science Issues"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2018.06.012"},{"key":"e_1_2_10_5_2","doi-asserted-by":"crossref","unstructured":"ChiangC. Y. ChangC. P. ChenH. Y. ChenY. L. YuanS. M. andWangC. ATP: a browser-based distributed testing service platform 2016 International Computer Symposium (ICS) 2016 Chiayi Taiwan 192\u2013197 https:\/\/doi.org\/10.1109\/ICS.2016.0046 2-s2.0-85015267895.","DOI":"10.1109\/ICS.2016.0046"},{"key":"e_1_2_10_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/1924421.1924442"},{"key":"e_1_2_10_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.2016.7721739"},{"key":"e_1_2_10_8_2","doi-asserted-by":"crossref","unstructured":"de VreedeT. NguyenC. de VreedeG.-J. BoughzalaI. OhO. andReiter-PalmonR. A theoretical model of user engagement in crowdsourcing International Conference on Collaboration and Technology 2013 Springer Berlin Heidelberg 94\u2013109 https:\/\/doi.org\/10.1007\/978-3-642-41347-6_8 2-s2.0-84892922154.","DOI":"10.1007\/978-3-642-41347-6_8"},{"key":"e_1_2_10_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1325555.1325568"},{"key":"e_1_2_10_10_2","doi-asserted-by":"publisher","DOI":"10.1080\/00207721.2012.669861"},{"volume-title":"Apache Jmeter: A Practical Beginner\u2019s Guide to Automated Testing and Performance Measurement for Your Websites","year":"2008","author":"Halili E. H.","key":"e_1_2_10_11_2"},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/306225.306235"},{"key":"e_1_2_10_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-014-9256-0"},{"key":"e_1_2_10_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10845-015-1080-2"},{"key":"e_1_2_10_15_2","unstructured":"SOASTA 2018 http:\/\/www.soasta.com."},{"key":"e_1_2_10_16_2","unstructured":"LoadStorm 2018 http:\/\/loadstorm.com\/."},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2010.54"},{"key":"e_1_2_10_18_2","doi-asserted-by":"crossref","unstructured":"ShojaeeA. AgheliN. andHosseiniB. Cloud-based load testing method for web services with VMs management 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI) 2016 Tehran Iran 170\u2013176 https:\/\/doi.org\/10.1109\/kbei.2015.7436040 2-s2.0-84971455351.","DOI":"10.1109\/KBEI.2015.7436040"},{"key":"e_1_2_10_19_2","doi-asserted-by":"crossref","unstructured":"YanM. SunH. WangX. andLiuX. Building a TaaS platform for web service load testing 2012 IEEE International Conference on Cluster Computing 2012 Beijing China 576\u2013579 https:\/\/doi.org\/10.1109\/cluster.2012.20 2-s2.0-84870701782.","DOI":"10.1109\/CLUSTER.2012.20"},{"key":"e_1_2_10_20_2","doi-asserted-by":"crossref","unstructured":"LoW. T. LiuX. SheuR. K. YuanS. M. andChangC. Y. An architecture for cloud service testing and real time management 2015 IEEE 39th Annual Computer Software and Applications Conference 2015 Taichung Taiwan 598\u2013603 https:\/\/doi.org\/10.1109\/compsac.2015.271 2-s2.0-84962050522.","DOI":"10.1109\/COMPSAC.2015.271"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2865754"},{"key":"e_1_2_10_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/tetci.2017.2755692"},{"key":"e_1_2_10_23_2","unstructured":"PincaL. The fastest RFC-6455 WebSocket implementation for Node.js 2018 https:\/\/github.com\/websockets\/ws."},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2018.03.005"},{"key":"e_1_2_10_25_2","doi-asserted-by":"crossref","unstructured":"HeinrichM.andGaedkeM. WebSoDa: a tailored data binding framework for web programmers leveraging the WebSocket protocol and HTML5 Microdata International Conference on Web Engineering 2011 Springer Berlin Heidelberg 387\u2013390.","DOI":"10.1007\/978-3-642-22233-7_32"},{"key":"e_1_2_10_26_2","doi-asserted-by":"crossref","unstructured":"HarjonoJ. NgG. KongD. andLoJ. Building smarter web applications with HTML5 Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research 2010 Toronto Ontario Canada USA 402\u2013403 https:\/\/doi.org\/10.1145\/1923947.1924015 2-s2.0-79951903726.","DOI":"10.1145\/1923947.1924015"},{"volume-title":"World Wide Web Consortium, Working Draft WD-XMLHttpRequest-20070618","year":"2007","author":"Van K. A.","key":"e_1_2_10_27_2"},{"volume-title":"W3C Working Draft WD-cors-20100727","year":"2010","author":"Van K. A.","key":"e_1_2_10_28_2"},{"key":"e_1_2_10_29_2","unstructured":"NCTU Museum 2018 http:\/\/museum.lib.nctu.edu.tw\/."},{"key":"e_1_2_10_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ypmed.2004.05.002"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2018\/2170585.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2018\/2170585.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2018\/2170585","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,8]],"date-time":"2024-08-08T22:50:14Z","timestamp":1723157414000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2018\/2170585"}},"subtitle":[],"editor":[{"given":"Zhihan","family":"Lv","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2018,1]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1155\/2018\/2170585"],"URL":"https:\/\/doi.org\/10.1155\/2018\/2170585","archive":["Portico"],"relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"type":"print","value":"1076-2787"},{"type":"electronic","value":"1099-0526"}],"subject":[],"published":{"date-parts":[[2018,1]]},"assertion":[{"value":"2018-06-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-16","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2170585"}}