{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T04:23:24Z","timestamp":1784262204793,"version":"3.55.0"},"reference-count":68,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T00:00:00Z","timestamp":1678838400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2025,10]]},"abstract":"<jats:p>\n                    The year 2020 brought a big concern for the global community because of COVID-19, which affected every sector of society, and tourism is no exception. Researchers across the globe are publishing their studies related to different dimensions of tourism in the context of COVID-19, and images have formed an essential component of their research. In tourism, images related to COVID-19 can open new dimensions for scholars. The main aim of the research is to measure the retrieval effectiveness of three image search engines (ISEs), that is, Bing Images, Google Images and Yahoo Image Search, concerning images related to COVID-19 and tourism. The study attempts to identify the capability of the ISEs to retrieve the desired and actual images related to COVID-19 and tourism. The\n                    <jats:italic>PubMed Central (PMC) Database<\/jats:italic>\n                    was consulted to retrieve the desired images and develop a testbed. The advanced search feature of\n                    <jats:italic>PMC Database<\/jats:italic>\n                    was explored by typing the search terms\n                    <jats:italic>\u2018COVID-19\u2019<\/jats:italic>\n                    and\n                    <jats:italic>\u2018Tourism\u2019<\/jats:italic>\n                    using\n                    <jats:italic>\u2018AND\u2019<\/jats:italic>\n                    operator to make the search more comprehensive. Both the terms were searched against the\n                    <jats:italic>\u2018Figure\/Table\u2019<\/jats:italic>\n                    caption to retrieve papers carrying images related to COVID-19 and tourism. Queries were executed across the select ISEs, that is, Bing Images, Google Images and Yahoo Image Search. Retrieved images were individually analysed against the original image from the articles to determine the Precision, Relative Recall,\n                    <jats:italic>F<\/jats:italic>\n                    -Measure and Fallout Ratio. The format of the images in JPG\/JPEG, besides checking the original image rank in the retrieved lot, was also ascertained. Bing Images scores more in terms of Mean Precision, followed by Google Images and Yahoo Image Search. For the Relative Recall measure, Google Images scores high, followed by Bing Images and Yahoo Image Search, respectively. Regarding\n                    <jats:italic>F<\/jats:italic>\n                    -Measure and Fallout Ratio, Bing Images outperforms Google Images and Yahoo Image Search. In retrieving the sought format of JPG\/JPEG, Google Images performs best, followed by Yahoo Image Search and Bing Images. Google Images produces the original image at the first rank on more than one occasion. In contrast, Bing Images retrieves the original image at the first rank in two instances. Yahoo Images performs poorly over this metric as it does not retrieve any original image at the first rank on any other instance. The study cannot be generalised as the scope is only limited to the images indexed by\n                    <jats:italic>PMC<\/jats:italic>\n                    . Furthermore, the retrieval effectiveness of only three ISEs is measured. The study is the first to measure the retrieval effectiveness of ISEs in retrieving images related to the COVID-19 pandemic and tourism. The study can be extended across other image-indexing databases pertinent to tourism studies, and the retrieval effectiveness of other ISEs can also be considered.\n                  <\/jats:p>","DOI":"10.1177\/01655515231161560","type":"journal-article","created":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T01:13:50Z","timestamp":1678929230000},"page":"1132-1141","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Image retrieval effectiveness of Bing Images, Google Images and Yahoo Image Search in the scientific field of tourism and COVID-19"],"prefix":"10.1177","volume":"51","author":[{"given":"Aabid","family":"Hussain","sequence":"first","affiliation":[{"name":"Directorate of Information and Public Relations Jammu and Kashmir, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0258-1182","authenticated-orcid":false,"given":"Sumeer","family":"Gul","sequence":"additional","affiliation":[{"name":"University of Kashmir, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nahida Tun","family":"Nisa","sequence":"additional","affiliation":[{"name":"Amar Singh College, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4323-4363","authenticated-orcid":false,"given":"Sheikh","family":"Shueb","sequence":"additional","affiliation":[{"name":"Islamic University of Science and Technology, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Farzana","family":"Gulzar","sequence":"additional","affiliation":[{"name":"University of Kashmir, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shohar","family":"Bano","sequence":"additional","affiliation":[{"name":"University of Kashmir, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2023,3,15]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Lyman P Varian HR. How much information? 2003 https:\/\/groups.ischool.berkeley.edu\/archive\/how-much-info-2003\/"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1108\/OIR-01-2017-0007"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1108\/14684520710764087"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1108\/EL-12-2019-0287"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13735-020-00193-z"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1177\/0165551516642929"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1177\/02666669211010211"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICOMET.2018.8346343"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42452-020-1941-y"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-6759-4"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2562624"},{"issue":"2","key":"e_1_3_3_13_2","first-page":"215","article-title":"An overview of content-based image retrieval techniques","volume":"84","author":"Alomairi AEAM","year":"2016","unstructured":"Alomairi AEAM, Sulong G. An overview of content-based image retrieval techniques. J Theor Appl Inf Technol 2016; 84(2): 215\u2013223.","journal-title":"J Theor Appl Inf Technol"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-6247-3"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJCVR.2019.098004"},{"key":"e_1_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Li A Sun J Ng JY et al. Generating holistic 3D scene abstractions for text-based image retrieval. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition (CVPR) https:\/\/arxiv.org\/pdf\/1611.09392.pdf (2017 accessed 2 October 2020).","DOI":"10.1109\/CVPR.2017.210"},{"issue":"6","key":"e_1_3_3_17_2","first-page":"1915","article-title":"Content based image retrieval systems: a review","volume":"7","author":"Manjula K","year":"2016","unstructured":"Manjula K, Monisha A, Reshma K et al. Content based image retrieval systems: a review. Res J Pharm Biol Chem Sci 2016; 7(6): 1915\u20131921.","journal-title":"Res J Pharm Biol Chem Sci"},{"issue":"13","key":"e_1_3_3_18_2","first-page":"22","article-title":"A review on content based image retrieval","volume":"132","author":"Patel T","year":"2015","unstructured":"Patel T, Kapadia M, Maisuria J. A review on content based image retrieval. Int J Comput Appl 2015; 132(13): 22\u201325.","journal-title":"Int J Comput Appl"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2016.04.001"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1108\/14684520110390042"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1177\/1354816620933712"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.annals.2020.102951"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1080\/09669582.2020.1773476"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph17103747"},{"key":"e_1_3_3_25_2","first-page":"1","article-title":"Tourism after corona: impacts of COVID 19 pandemic and way forward for tourism, hotel and mice industry in Sri Lanka","volume":"2020","author":"Ranasinghe R","year":"2020","unstructured":"Ranasinghe R, Damunupola A, Wijesundara S et al. Tourism after corona: impacts of COVID 19 pandemic and way forward for tourism, hotel and mice industry in Sri Lanka. SSRN 2020; 2020: 1\u201319.","journal-title":"SSRN"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.3897\/popecon.4.e53574"},{"issue":"4","key":"e_1_3_3_27_2","article-title":"Contagion effect of COVID-19 outbreak: another recipe for disaster on Indian economy","volume":"20","author":"Singh MK","year":"2020","unstructured":"Singh MK, Neog Y. Contagion effect of COVID-19 outbreak: another recipe for disaster on Indian economy. Public Aff 2020; 20(4): e2171.","journal-title":"Public Aff"},{"issue":"3","key":"e_1_3_3_28_2","first-page":"117","article-title":"Evaluation of web search engines based on ranking of results and features","volume":"4","author":"Balabantaray RC","year":"2013","unstructured":"Balabantaray RC, Swain M, Sahoo B. Evaluation of web search engines based on ranking of results and features. Int J Hum Comput Interact 2013; 4(3): 117\u2013127.","journal-title":"Int J Hum Comput Interact"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(03)00040-2"},{"key":"e_1_3_3_30_2","first-page":"127","article-title":"Search engines for the World Wide Web: a comparative study and evaluation methodology","volume":"33","author":"Chu H","year":"1996","unstructured":"Chu H, Rosenthal M. Search engines for the World Wide Web: a comparative study and evaluation methodology. Proc Ann Meet Am Soc Inf Sci 1996; 33: 127\u2013135.","journal-title":"Proc Ann Meet Am Soc Inf Sci"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1108\/14684521011084609"},{"key":"e_1_3_3_32_2","first-page":"136","article-title":"A comparative study of web search service performance","volume":"33","author":"Ding W","year":"1996","unstructured":"Ding W, Marchionini GJ. A comparative study of web search service performance. Proc ASIST Ann Meet 1996; 33: 136\u2013140.","journal-title":"Proc ASIST Ann Meet"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/944012.944015"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(98)00041-7"},{"issue":"4","key":"e_1_3_3_35_2","first-page":"437","article-title":"Performance evaluation of search engines via user efforts measures","volume":"9","author":"Goutam RK","year":"2012","unstructured":"Goutam RK, Dwivedi SK. Performance evaluation of search engines via user efforts measures. Int J Comput Sci Iss 2012; 9(4): 437\u2013442.","journal-title":"Int J Comput Sci Iss"},{"issue":"4","key":"e_1_3_3_36_2","first-page":"1","article-title":"Evaluation of three German search engines: Altavista.de, Google.de and Lycos.de","volume":"9","author":"Griesbaum J","year":"2004","unstructured":"Griesbaum J. Evaluation of three German search engines: Altavista.de, Google.de and Lycos.de. Inf Res 2004; 9(4): 1\u201335.","journal-title":"Inf Res"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1108\/DTA-05-2019-0083"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(99)00024-9"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1108\/EL-07-2018-0142"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/281250.281253"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(99)00056-4"},{"issue":"2","key":"e_1_3_3_42_2","first-page":"87","article-title":"Evaluating the searching capabilities of search engines and metasearch engines: a comparative study","volume":"57","author":"Kumar BT","year":"2010","unstructured":"Kumar BT, Pavithra SM. Evaluating the searching capabilities of search engines and metasearch engines: a comparative study. Ann Libr Inf Stud 2010; 57(2): 87\u201397.","journal-title":"Ann Libr Inf Stud"},{"issue":"10","key":"e_1_3_3_43_2","first-page":"870","article-title":"First 20 precision among World Wide Web search services (search engines)","volume":"50","author":"Leighton HV","year":"1999","unstructured":"Leighton HV, Srivastava J. First 20 precision among World Wide Web search services (search engines). J Assoc Inf Sci Technol 1999; 50(10): 870\u2013881.","journal-title":"J Assoc Inf Sci Technol"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1108\/14684520810914034"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23304"},{"key":"e_1_3_3_46_2","unstructured":"Liu B. User personal evaluation of search engines-Google Bing and Blekko University of Illinois at Chicago https:\/\/www.cs.uic.edu\/~liub\/searchEval\/Search-Engine-Evaluation-2011.pdf (2011 accessed 29 September 2020)."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/WICOM.2007.1504"},{"issue":"4","key":"e_1_3_3_48_2","first-page":"48","article-title":"Searching the Worldwide Web: Lycos, WebCrawler and more","volume":"19","author":"Notess GR.","year":"1995","unstructured":"Notess GR. Searching the Worldwide Web: Lycos, WebCrawler and more. Online 1995; 19(4): 48\u201353.","journal-title":"Online"},{"issue":"2","key":"e_1_3_3_49_2","first-page":"165","article-title":"Precision and recall of five search engines for retrieval of scholarly information in the field of biotechnology","volume":"2","author":"Shafi SM","year":"2005","unstructured":"Shafi SM, Rather RA. Precision and recall of five search engines for retrieval of scholarly information in the field of biotechnology. Webology 2005; 2(2): 165.","journal-title":"Webology"},{"key":"e_1_3_3_50_2","first-page":"221","article-title":"Evaluation of five web search engines in Arabic language","volume":"2010","author":"Tawileh W","year":"2010","unstructured":"Tawileh W, Mandl T, Griesbaum J et al. Evaluation of five web search engines in Arabic language. Proc LWA Worksh 2010; 2010: 221\u2013228.","journal-title":"Proc LWA Worksh"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1177\/0165551511415183"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1177\/0165551509103598"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1108\/14684521111193201"},{"key":"e_1_3_3_54_2","unstructured":"V\u00e9ronis J. A comparative study of six search engines https:\/\/www.researchgate.net\/publication\/265028347_A_comparative_study_of_six_search_engines (2006 accessed 12 September 2020)."},{"issue":"1","key":"e_1_3_3_55_2","first-page":"5","article-title":"Precision among Internet search engines: an earth sciences case study","volume":"18","author":"Wishard L.","year":"1998","unstructured":"Wishard L. Precision among Internet search engines: an earth sciences case study. Issue Sci Technol Librariansh 1998; 18(1): 5.","journal-title":"Issue Sci Technol Librariansh"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-27772-9_31"},{"key":"e_1_3_3_57_2","unstructured":"Wu S Zhang Z Xu C. Evaluating the effectiveness of web search engines on results diversification. Inf Res 2019; 24(1): 811 http:\/\/InformationR.net\/ir\/24-1\/paper811.html (accessed 15 August 2020)"},{"key":"e_1_3_3_58_2","unstructured":"Fendley R Kidambi P. Benchmarking web-based image retrieval. In: Proceedings of the 16th Americas conference on information systems Lima Peru 12\u201315 August2010 https:\/\/www.researchgate.net\/publication\/220892023_Benchmarking_Web-Based_Image_Retrieval (2010 accessed 5 February 2023)."},{"issue":"3","key":"e_1_3_3_59_2","first-page":"41","article-title":"Search by image: a novel approach to content based image retrieval system","volume":"14","author":"Adrakatti AF","year":"2016","unstructured":"Adrakatti AF, Wodeyar RS, Mulla KR. Search by image: a novel approach to content based image retrieval system. Int J Libr Sci 2016; 14(3): 41\u201347.","journal-title":"Int J Libr Sci"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1108\/EL-06-2016-0127"},{"issue":"1","key":"e_1_3_3_61_2","first-page":"611","article-title":"Implementation and comparison of text-based image retrieval schemes","volume":"10","author":"Zaidi SAJ","year":"2019","unstructured":"Zaidi SAJ, Buriro A, Riaz M et al. Implementation and comparison of text-based image retrieval schemes. Int J Adv Comput Sci Appl 2019; 10(1): 611\u2013618.","journal-title":"Int J Adv Comput Sci Appl"},{"issue":"2","key":"e_1_3_3_62_2","first-page":"305","article-title":"Measuring the relevance of retrieved images in search engines based on Persian language writing styles","volume":"38","author":"Norouzi Y","year":"2022","unstructured":"Norouzi Y, Homavandi H, Khabbazan B. Measuring the relevance of retrieved images in search engines based on Persian language writing styles. Iran J Inform Process Manage 2022; 38(2): 305\u2013335.","journal-title":"Iran J Inform Process Manage"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb051463"},{"key":"e_1_3_3_64_2","unstructured":"Brownlee J. How to calculate precision recall and F-measure for imbalanced classification Machine Learning Mastery https:\/\/machinelearningmastery.com\/precision-recall-and-f-measure-for-imbalanced-classification\/ (2020 accessed 16 July 2022)."},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781118646106"},{"key":"e_1_3_3_66_2","volume-title":"Information retrieval","author":"Van Rijsbergen CJ","year":"1979","unstructured":"Van Rijsbergen CJ. Information retrieval. 2nd ed. London: Butterworths, 1979.","edition":"2"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1177\/0165551508091311"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2009.01.028"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1108\/00330330710724908"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515231161560","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01655515231161560","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515231161560","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:10:04Z","timestamp":1777504204000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01655515231161560"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":68,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,10]]}},"alternative-id":["10.1177\/01655515231161560"],"URL":"https:\/\/doi.org\/10.1177\/01655515231161560","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,15]]}}}