{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:04:32Z","timestamp":1754157872358,"version":"3.41.2"},"reference-count":20,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2006,5,1]],"date-time":"2006-05-01T00:00:00Z","timestamp":1146441600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2006,5,1]]},"abstract":"<jats:p>Tools for the assessment of the quality and reliability of Web applications are based on the possibility of downloading the target of the analysis. This is achieved through Web crawlers, which can automatically navigate within a Web site and perform proper actions (such as download) during the visit. The most important performance indicators for a Web crawler are its completeness and robustness, measuring respectively the ability to visit the Web site entirely and without errors. The variety of implementation languages and technologies used for Web site development makes these two indicators hard to maximize. We conducted an evaluation study, in which we tested several of the available Web crawlers.<\/jats:p>","DOI":"10.1108\/17440080680000104","type":"journal-article","created":{"date-parts":[[2010,6,5]],"date-time":"2010-06-05T07:14:13Z","timestamp":1275722053000},"page":"85-94","source":"Crossref","is-referenced-by-count":17,"title":["Web crawlers compared"],"prefix":"10.1108","volume":"2","author":[{"given":"Christian","family":"Girardi","sequence":"first","affiliation":[]},{"given":"Filippo","family":"Ricca","sequence":"additional","affiliation":[]},{"given":"Paolo","family":"Tonella","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"key":"p_2","doi-asserted-by":"publisher","DOI":"10.1108\/17440080580000083"},{"volume-title":"Site-Specific Web Crawlers. In the International World Wide Web Conference (WWW), Brisbane Australia.","author":"Miller R. C.","key":"p_4"},{"volume-title":"Analysis and Testing of Web Applications. In the International Conference on Software Engineering (ICSE)","author":"Ricca F.","key":"p_5"},{"journal-title":"IEEE Transactions on Software Engineering.","year":"2005","author":"Elbaum S.","key":"p_6"},{"volume-title":"Proc. ICSM 2002, International Conference on Software Maintenance","author":"Di Lucca G. A.","key":"p_7"},{"first-page":"357","volume-title":"Proc. of the 18th International Conference on Data Engineering (ICDE)","author":"Shkapenyuk V.","key":"p_10"},{"volume-title":"International Workshop on Program Comprehension.","author":"Warren P.","key":"p_11"},{"volume-title":"International Journal of Web Information Systems, 1(3).","year":"2005","author":"Rajugan R.","key":"p_14"},{"volume-title":"Morgan Kaufmann","year":"2002","author":"Ceri S.","key":"p_15"},{"volume-title":"Building Web Applications with UML","year":"2000","author":"Conallen J.","key":"p_16"},{"key":"p_17","doi-asserted-by":"publisher","DOI":"10.1108\/17440080580000082"},{"key":"p_18","volume-title":"Mercator: A scalable, extensible web crawler World Wide Web","volume":"2","author":"Heydon A.","year":"1999"},{"volume-title":"Proc. AusWeb02","author":"Boldi P.","key":"p_19"},{"volume-title":"Proc. of the 11th International World-Wide Web Conference.","author":"Cho J.","key":"p_20"},{"key":"p_21","volume-title":"Web Techniques","volume":"2","author":"Burner M.","year":"1997"},{"volume-title":"Crawling the Hidden Web. Proc. of the Twenty-seventh International Conference on Very Large Databases.","author":"Raghavan S.","key":"p_22"},{"key":"p_23","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(99)00052-3"},{"key":"p_24","doi-asserted-by":"publisher","DOI":"10.1504\/IJBIDM.2005.008361"},{"key":"p_25","volume-title":"Discovery of Concept Entities from Web Sites using Web Unit Mining International Journal of Web Information Systems","volume":"1","author":"Yin M.","year":"2005"},{"key":"p_26","first-page":"204","volume-title":"Bari, Italy","author":"Ricca F.","year":"2004"}],"container-title":["International Journal of Web Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/17440080680000104\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/17440080680000104\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:24:50Z","timestamp":1753403090000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijwis\/article\/2\/2\/85-94\/165706"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,5,1]]},"references-count":20,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2006,5,1]]}},"alternative-id":["10.1108\/17440080680000104"],"URL":"https:\/\/doi.org\/10.1108\/17440080680000104","relation":{},"ISSN":["1744-0084"],"issn-type":[{"type":"print","value":"1744-0084"}],"subject":[],"published":{"date-parts":[[2006,5,1]]}}}