{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T02:00:27Z","timestamp":1773972027520,"version":"3.50.1"},"reference-count":40,"publisher":"Emerald","issue":"5-6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,11,4]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>This study investigates the functionality of electronic databases in supporting systematic reviews within computing. It aims to identify essential features that facilitate the systematic review workflows and to highlight limitations that hinder the effective use of databases during the review process.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design\/methodology\/approach<\/jats:title>\n                    <jats:p>The study employs a qualitative approach, utilising a checklist-based evaluation methodology. Data were collected through direct interaction with 14 electronic databases selected based on their frequency of use in systematic reviews in computing and their growing prominence as tools for accessing scholarly content. Each database was evaluated against a predefined set of 13 functionalities considered essential to support systematic review workflows. Observations and usability issues encountered during the evaluation were systematically documented.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>The study identified several limitations in the functionality of the evaluated databases, including difficulties in identifying existing systematic reviews, lack of support for \u201csearch within results\u201d, limited export capabilities, incomplete metadata in exported records, and the absence of functionality for comparing search queries. These findings provide evidence that, while databases serve a central role in the systematic review process, their current functionalities are not fully aligned with the practical requirements of systematic review workflows.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Originality\/value<\/jats:title>\n                    <jats:p>Unlike prior research that has primarily focused on database coverage or general usability, this study provides valuable insights into the extent to which existing electronic databases support systematic review workflows. The findings contribute to the advancement of evidence-based research in computing by identifying critical functional gaps and highlighting practical areas for improvement. These insights are valuable for both database providers, who can use them to prioritise feature development, and researchers, who can use the findings to make more informed decisions when selecting databases, designing search strategies, managing references, and planning screening and synthesis activities. Moreover, the study highlights directions for future research and has the potential to inform the design of more effective tools for supporting systematic review processes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1108\/jd-05-2025-0128","type":"journal-article","created":{"date-parts":[[2025,9,12]],"date-time":"2025-09-12T01:45:38Z","timestamp":1757641538000},"page":"1431-1455","source":"Crossref","is-referenced-by-count":3,"title":["Supporting systematic review workflows in computing: a functional evaluation of electronic databases"],"prefix":"10.1108","volume":"81","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1745-5581","authenticated-orcid":true,"given":"Ghader","family":"Kurdi","sequence":"first","affiliation":[{"name":"Umm Al-Qura University Department of Data Science, College of Computing, , ,","place":["Makkah, Saudi Arabia"]}]}],"member":"140","published-online":{"date-parts":[[2025,9,12]]},"reference":[{"key":"2025110221321425600_ref001","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.infsof.2018.02.002","article-title":"Reliability of search in systematic reviews: towards a quality assessment framework for the automated-search strategy","volume":"99","author":"Ali","year":"2018","journal-title":"Information and Software Technology"},{"issue":"1","key":"2025110221321425600_ref002","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1108\/JD-09-2016-0112","article-title":"Identifying \u2018best bets\u2019 for searching in chemical engineering: comparing database content and performance for information retrieval","volume":"74","author":"Badia","year":"2018","journal-title":"Journal of Documentation"},{"key":"2025110221321425600_ref003","article-title":"\u201cEvaluating sources: a guide for students\u201d, Research Tutorial","author":"Binghamton University Libraries","year":".."},{"key":"2025110221321425600_ref005","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13643-017-0644-y","article-title":"Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study","volume":"6","author":"Bramer","year":"2017","journal-title":"Systematic Reviews"},{"key":"2025110221321425600_ref006","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.infsof.2017.10.017","article-title":"Reporting systematic reviews: some lessons from a tertiary study","volume":"95","author":"Budgen","year":"2018","journal-title":"Information and Software Technology"},{"issue":"1","key":"2025110221321425600_ref007","doi-asserted-by":"publisher","first-page":"7","DOI":"10.37190\/e-Inf200101","article-title":"What support do systematic reviews provide for evidence-informed teaching about software engineering practice?","volume":"14","author":"Budgen","year":"2020","journal-title":"E-Informatica Software Engineering Journal"},{"issue":"2","key":"2025110221321425600_ref008","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1108\/07378830220432534","article-title":"Accessibility and usability of web-based library databases for non-visual users","volume":"20","author":"Byerley","year":"2002","journal-title":"Library Hi Tech"},{"issue":"3","key":"2025110221321425600_ref009","doi-asserted-by":"publisher","first-page":"2059","DOI":"10.1007\/s11192-014-1506-1","article-title":"What is the best database for computer science journal articles?","volume":"102","author":"Cavacini","year":"2015","journal-title":"Scientometrics"},{"key":"2025110221321425600_ref010","unstructured":"Clarivate Analytics\n           (n.d.), \u201cINSPEC\u00ae help\u201d, available at:\u00a0https:\/\/images.webofknowledge.com\/images\/help\/INSPEC\/hs_controlled_index.html (accessed\u00a06 July 2025)."},{"key":"2025110221321425600_ref011","unstructured":"Clarivate Support\n           (n.d.), \u201cKeywords plus \u2013 generation, creation and changes\u201d, available at:\u00a0https:\/\/support.clarivate.com\/ScientificandAcademicResearch\/s\/article\/KeyWords-Plus-generation-creation-and-changes?language=en_US (accessed\u00a06 July 2025)."},{"issue":"3","key":"2025110221321425600_ref012","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/S0099-1333(02)00279-3","article-title":"How do I find an article? Insights from a web usability study","volume":"28","author":"Cockrell","year":"2002","journal-title":"The Journal of Academic Librarianship"},{"key":"2025110221321425600_ref013","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3475716.3484190","article-title":"Inclusion and exclusion criteria in software engineering tertiary studies: a systematic mapping and emerging framework","author":"Costal","year":"2021"},{"issue":"5","key":"2025110221321425600_ref014","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1016\/j.infsof.2011.01.004","article-title":"Research synthesis in software engineering: a tertiary study","volume":"53","author":"Cruzes","year":"2011","journal-title":"Information and Software Technology"},{"key":"2025110221321425600_ref015","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1109\/ICSSP.2019.00027","article-title":"The quest for productivity in software engineering: a practitioners systematic literature review","author":"Duarte","year":"2019"},{"key":"2025110221321425600_ref016","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1109\/COMPSAC48688.2020.0-122","article-title":"Google Scholar vs dblp vs microsoft academic search: an indexing comparison for software engineering literature","author":"Fatima","year":"2020"},{"key":"2025110221321425600_ref017","unstructured":"Google Scholar\n           (2024), \u201cGoogle scholar help: searching\u201d, available at:\u00a0https:\/\/scholar.google.com\/intl\/en\/scholar\/help.html#searching (accessed\u00a07 May 2025)."},{"issue":"5","key":"2025110221321425600_ref018","doi-asserted-by":"publisher","first-page":"2683","DOI":"10.1007\/s11192-022-04289-7","article-title":"Search where you will find most: comparing the disciplinary coverage of 56 bibliographic databases","volume":"127","author":"Gusenbauer","year":"2022","journal-title":"Scientometrics"},{"issue":"2","key":"2025110221321425600_ref019","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1002\/jrsm.1378","article-title":"Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources","volume":"11","author":"Gusenbauer","year":"2020","journal-title":"Research Synthesis Methods"},{"key":"2025110221321425600_ref020","unstructured":"IEEE Xplore Digital Library\n           (n.d.), \u201cWorking with documents\u201d, available at:\u00a0https:\/\/ieeexplore.ieee.org\/Xplorehelp\/ieee-xplore-training\/working-with-documents (accessed\u00a06 July 2025)."},{"key":"2025110221321425600_ref021","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1145\/2460999.2461025","article-title":"A tertiary study: experiences of conducting systematic literature reviews in software engineering","author":"Imtiaz","year":"2013"},{"issue":"12","key":"2025110221321425600_ref022","doi-asserted-by":"publisher","first-page":"2049","DOI":"10.1016\/j.infsof.2013.07.010","article-title":"A systematic review of systematic review process research in software engineering","volume":"55","author":"Kitchenham","year":"2013","journal-title":"Information and Software Technology"},{"key":"2025110221321425600_ref023","article-title":"Guidelines for performing systematic literature reviews in software engineering","author":"Kitchenham","year":"2007"},{"issue":"1","key":"2025110221321425600_ref024","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1007\/s10664-019-09763-0","article-title":"Search. Review. Repeat? An empirical study of threats to replicating SLR searches","volume":"25","author":"Kr\u00fcger","year":"2020","journal-title":"Empirical Software Engineering"},{"key":"2025110221321425600_ref025","doi-asserted-by":"publisher","DOI":"10.1109\/ICOCO59262.2023.10397762","article-title":"Building an electronic resource of systematic reviews in computing","author":"Kurdi","year":"2023"},{"key":"2025110221321425600_ref026","unstructured":"Kurdi, G.\n           (2025), \u201cReviewIT: a corpus of systematic reviews in IT and computing\u201d, available at:\u00a0https:\/\/www.kaggle.com\/datasets\/ghaderkurdi\/reviewit (accessed\u00a06 July 2025)."},{"issue":"1","key":"2025110221321425600_ref027","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/s40593-019-00186-y","article-title":"A systematic review of automatic question generation for educational purposes","volume":"30","author":"Kurdi","year":"2020","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"2025110221321425600_ref028","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2288-13-141","article-title":"Reference management software for systematic reviews and meta-analyses: an exploration of usage and usability","volume":"13","author":"Lorenzetti","year":"2013","journal-title":"BMC Medical Research Methodology"},{"key":"2025110221321425600_ref029","unstructured":"National Library of Medicine\n           (2023), \u201cFrequently asked questions about indexing for MEDLINE: how is MEDLINE\u00ae indexing accomplished?\u201d, Last reviewed February 24, 2023. U.S. National Library of Medicine, available at:\u00a0https:\/\/www.nlm.nih.gov\/bsd\/indexfaq.html#How%20is%20MEDLINE%20indexing%20accomplished (accessed\u00a010 July 2025)."},{"key":"2025110221321425600_ref004","unstructured":"National Center for Biotechnology Information (NCBI)\n           (2025), \u201cPubMed help: computation of similar articles\u201d, available at:\u00a0https:\/\/pubmed.ncbi.nlm.nih.gov\/help\/ (accessed\u00a08 July 2025)."},{"issue":"1","key":"2025110221321425600_ref030","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10664-024-10545-6","article-title":"Using rapid reviews to support software engineering practice: a systematic review and a replication study","volume":"30","author":"Pizard","year":"2025","journal-title":"Empirical Software Engineering"},{"key":"2025110221321425600_ref031","unstructured":"Pontika, N., Anastasiou, L. and Knoth, P. (2016), \u201cCORE recommender\u201d, CORE Blog, available at:\u00a0https:\/\/blog.core.ac.uk\/2016\/10\/04\/core-recommender\/ (accessed\u00a09 July 2025)."},{"issue":"3","key":"2025110221321425600_ref032","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1109\/MC.2022.3181977","article-title":"Is DBLP a good computer science journals database?","volume":"56","author":"Rosenfeld","year":"2023","journal-title":"Computer"},{"key":"2025110221321425600_ref033","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1145\/3210459.3210474","article-title":"How do secondary studies in software engineering report automated searches? A preliminary analysis","author":"Singh","year":"2018"},{"issue":"6","key":"2025110221321425600_ref034","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1177\/104973150730440","article-title":"Systematically retrieving research: a case study evaluating seven databases","volume":"17","author":"Taylor","year":"2007","journal-title":"Research on Social Work Practice"},{"issue":"3","key":"2025110221321425600_ref035","doi-asserted-by":"publisher","first-page":"1234","DOI":"10.1016\/j.ipm.2007.07.008","article-title":"Exploring usefulness and usability in the evaluation of open access digital libraries","volume":"44","author":"Tsakonas","year":"2008","journal-title":"Information Processing and Management"},{"key":"2025110221321425600_ref036","unstructured":"U.S. National Library of Medicine\n           (n.d.), \u201cMedical subject headings (MeSH)\u201d, available at:\u00a0https:\/\/www.ncbi.nlm.nih.gov\/mesh\/ (accessed\u00a08 July 2025)."},{"key":"2025110221321425600_ref037","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/FIE56618.2022.9962393","article-title":"Analysis of academic databases for literature review in the computer science education field","author":"Valente","year":"2022"},{"issue":"4","key":"2025110221321425600_ref038","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1353\/pla.2011.0042","article-title":"Comparative recall and precision of simple and expert searches in Google Scholar and eight other databases","volume":"11","author":"Walters","year":"2011","journal-title":"Portal: Libraries and the Academy"},{"key":"2025110221321425600_ref039","doi-asserted-by":"publisher","first-page":"36226","DOI":"10.1109\/ACCESS.2020.2971712","article-title":"On using grey literature and google scholar in systematic literature reviews in software engineering","volume":"8","author":"Yasin","year":"2020","journal-title":"IEEE Access"},{"key":"2025110221321425600_ref040","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1109\/APSEC.2016.031","article-title":"A map of threats to validity of systematic literature reviews in software engineering","author":"Zhou","year":"2016"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/jd\/article-pdf\/81\/5-6\/1431\/10280437\/jd-05-2025-0128en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/jd\/article-pdf\/81\/5-6\/1431\/10280437\/jd-05-2025-0128en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T02:32:19Z","timestamp":1762137139000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/jd\/article\/81\/5-6\/1431\/1297467\/Supporting-systematic-review-workflows-in"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,12]]},"references-count":40,"journal-issue":{"issue":"5-6","published-print":{"date-parts":[[2025,11,4]]}},"URL":"https:\/\/doi.org\/10.1108\/jd-05-2025-0128","relation":{},"ISSN":["0022-0418","1758-7379"],"issn-type":[{"value":"0022-0418","type":"print"},{"value":"1758-7379","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,12]]}}}