{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:56:31Z","timestamp":1772139391713,"version":"3.50.1"},"reference-count":11,"publisher":"World Scientific Pub Co Pte Lt","issue":"06","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2018,6]]},"abstract":"<jats:p> Crowdsourcing carried out by cyber citizens instead of hired consultants and professionals has become increasingly an appealing solution to test the feature rich and interactive web. Despite having various online crowdsourcing testing services, the benefits of exposure to a wider audience and harnessing the collective efforts of individuals remain uncertain, especially when the quality control is problematic in an open environment. The objective of this paper is to propose a real-time collaborative testing approach (RCTA) to create a productive crowdsourced testing on a dynamic Internet. We implemented a prototype crowdsourcing system XTurk, and carried out a case study, to understand the crowdsourced testers behavior, the trustworthiness, the execution time of test cases and accuracy of feedback. Several experiments are carried out and experimental results validate the quality, efficiency and reliability of the present approach and the positive testing feedback is are shown to outperform the previous methods. <\/jats:p>","DOI":"10.1142\/s0218194018500213","type":"journal-article","created":{"date-parts":[[2018,6,13]],"date-time":"2018-06-13T09:01:31Z","timestamp":1528880491000},"page":"751-779","source":"Crossref","is-referenced-by-count":9,"title":["Crowdsourced Web Application Testing Under Real-Time Constraints"],"prefix":"10.1142","volume":"28","author":[{"given":"Shikai","family":"Guo","sequence":"first","affiliation":[{"name":"College of Information Science and Technology, Dalian Maritime University, Dalian 116026, P. R. China"}]},{"given":"Rong","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Dalian Maritime University, Dalian 116026, P. R. China"}]},{"given":"Hui","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Dalian Maritime University, Dalian 116026, P. R. China"}]},{"given":"Jian","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Dalian Maritime University, Dalian 116026, P. R. China"}]},{"given":"Yaqing","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Dalian Maritime University, Dalian 116026, P. R. China"},{"name":"Artificial Intelligence Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Zigong 643000, P. R. China"}]}],"member":"219","published-online":{"date-parts":[[2018,6,13]]},"reference":[{"key":"S0218194018500213BIB001","doi-asserted-by":"publisher","DOI":"10.1504\/IJWET.2007.012055"},{"key":"S0218194018500213BIB003","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2013.02.006"},{"key":"S0218194018500213BIB004","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2006.06.006"},{"key":"S0218194018500213BIB018","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2013.67"},{"key":"S0218194018500213BIB021","first-page":"85","author":"Bertolino A.","year":"2017","journal-title":"Fut. Softw. Eng"},{"key":"S0218194018500213BIB022","doi-asserted-by":"publisher","DOI":"10.4067\/S0718-18762015000100002"},{"key":"S0218194018500213BIB023","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.03.079"},{"key":"S0218194018500213BIB027","doi-asserted-by":"publisher","DOI":"10.1145\/24039.24041"},{"key":"S0218194018500213BIB035","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73551-9_18"},{"issue":"1","key":"S0218194018500213BIB039","first-page":"575","volume":"5","author":"Gomide V. H. M.","year":"2014","journal-title":"Int. J. Comput. Sci. Inf. Technol"},{"issue":"1","key":"S0218194018500213BIB041","first-page":"1","volume":"49","author":"Liu D.","year":"2012","journal-title":"Proc. Am. Soc. Inf. Sci. Technol"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194018500213","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T19:12:09Z","timestamp":1565118729000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218194018500213"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6]]},"references-count":11,"journal-issue":{"issue":"06","published-online":{"date-parts":[[2018,6,13]]},"published-print":{"date-parts":[[2018,6]]}},"alternative-id":["10.1142\/S0218194018500213"],"URL":"https:\/\/doi.org\/10.1142\/s0218194018500213","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6]]}}}