{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T17:49:16Z","timestamp":1791827356857,"version":"4.3.4"},"publisher-location":"New York, NY, USA","reference-count":56,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T00:00:00Z","timestamp":1734307200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"DFG","award":["2535"],"award-info":[{"award-number":["2535"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,12,16]]},"DOI":"10.1145\/3677389.3702558","type":"proceedings-article","created":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T16:53:52Z","timestamp":1741884832000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Enhancing Biomedical Literature Retrieval with Level of Evidence and Bio-Concepts: A Comparative User Study"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0302-3227","authenticated-orcid":false,"given":"Sameh","family":"Frihat","sequence":"first","affiliation":[{"name":"Information Systems, Duisburg-Essen University, Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8532-1297","authenticated-orcid":false,"given":"Andrea","family":"Papenmeier","sequence":"additional","affiliation":[{"name":"HMI, University of Twente, Enschede, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0441-6949","authenticated-orcid":false,"given":"Norbert","family":"Fuhr","sequence":"additional","affiliation":[{"name":"Duisburg-Essen University, Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,3,13]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Wael Abdelkader Tamara Navarro Rick Parrish Chris Cotoi Federico Germini Lori-Ann Linkins Alfonso Iorio R Brian Haynes Sophia Ananiadou Lingyang Chu et al. 2021. A deep learning approach to refine the identification of high-quality clinical research articles from the biomedical literature: Protocol for algorithm development and validation. JMIR research protocols 10 11 (2021) e29398.","DOI":"10.2196\/29398"},{"key":"e_1_3_2_1_2_1","volume-title":"Evaluation of e-health (Seha) application: a cross-sectional study in Saudi Arabia. BMC medical informatics and decision making 21","author":"Alharbi Abeer","year":"2021","unstructured":"Abeer Alharbi, Joharah Alzuwaed, and Hind Qasem. 2021. Evaluation of e-health (Seha) application: a cross-sectional study in Saudi Arabia. BMC medical informatics and decision making 21 (2021), 1--9."},{"key":"e_1_3_2_1_3_1","volume-title":"Self-rag: Learning to retrieve, generate, and critique through self-reflection. arXiv preprint arXiv:2310.11511","author":"Asai Akari","year":"2023","unstructured":"Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2023. Self-rag: Learning to retrieve, generate, and critique through self-reflection. arXiv preprint arXiv:2310.11511 (2023)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5195\/jmla.2021.1219"},{"key":"e_1_3_2_1_5_1","volume-title":"A review of the PubMed PICO tool: using evidence-based practice in health education. Health promotion practice 21, 4","author":"Brown David","year":"2020","unstructured":"David Brown. 2020. A review of the PubMed PICO tool: using evidence-based practice in health education. Health promotion practice 21, 4 (2020), 496--498."},{"key":"e_1_3_2_1_6_1","volume-title":"The levels of evidence and their role in evidence-based medicine. Plastic and reconstructive surgery 128, 1","author":"Burns Patricia B","year":"2011","unstructured":"Patricia B Burns, Rod J Rohrich, and Kevin C Chung. 2011. The levels of evidence and their role in evidence-based medicine. Plastic and reconstructive surgery 128, 1 (2011), 305--310."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32327-1_2"},{"key":"e_1_3_2_1_8_1","volume-title":"A modular framework for biomedical concept recognition. BMC bioinformatics 14","author":"Campos David","year":"2013","unstructured":"David Campos, S\u00e9rgio Matos, and Jos\u00e9 Lu\u00eds Oliveira. 2013. A modular framework for biomedical concept recognition. BMC bioinformatics 14 (2013), 1--21."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2013.10103"},{"key":"e_1_3_2_1_10_1","first-page":"370","article-title":"In search of evidence: family practitioners' use of the Internet for clinical information","volume":"90","author":"Cullen Rowena J","year":"2002","unstructured":"Rowena J Cullen. 2002. In search of evidence: family practitioners' use of the Internet for clinical information. Journal of the Medical Library Association 90, 4 (2002), 370.","journal-title":"Journal of the Medical Library Association"},{"key":"e_1_3_2_1_11_1","volume-title":"Hasan Ashrafi-Rizi, Ali Zargham-Boroujeni, and Roya Kelishadi.","author":"Daei Azra","year":"2020","unstructured":"Azra Daei, Mohammad Reza Soleymani, Hasan Ashrafi-Rizi, Ali Zargham-Boroujeni, and Roya Kelishadi. 2020. Clinical information seeking behavior of physicians: A systematic review. International journal of medical informatics 139 (2020), 104144."},{"key":"e_1_3_2_1_12_1","volume-title":"A Novel Approach to Enhance the Performance of Semantic Search in Bengali using Neural Net and Other Classification Techniques. arXiv preprint arXiv:1911.01256","author":"Das Arijit","year":"2019","unstructured":"Arijit Das and Diganta Saha. 2019. A Novel Approach to Enhance the Performance of Semantic Search in Bengali using Neural Net and Other Classification Techniques. arXiv preprint arXiv:1911.01256 (2019)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/hir.12001"},{"key":"e_1_3_2_1_14_1","unstructured":"Sameh Frihat and Norbert Fuhr. 2024. Enhancing Medical Literature Retrieval with Bio-Concepts. (2024). Submitted for publication."},{"key":"e_1_3_2_1_15_1","volume-title":"Supporting Evidence-Based Medicine by Finding Both Relevant and Significant Works. arXiv preprint arXiv:2407.18383","author":"Frihat Sameh","year":"2024","unstructured":"Sameh Frihat and Norbert Fuhr. 2024. Supporting Evidence-Based Medicine by Finding Both Relevant and Significant Works. arXiv preprint arXiv:2407.18383 (2024)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5195\/jmla.2020.912"},{"key":"e_1_3_2_1_17_1","volume-title":"W1","author":"Gobeill Julien","year":"2020","unstructured":"Julien Gobeill, D\u00e9borah Caucheteur, Pierre-Andr\u00e9 Michel, Luc Mottin, Emilie Pasche, and Patrick Ruch. 2020. SIB Literature Services: RESTful customizable search engines in biomedical literature, enriched with automatically mapped biomedical concepts. Nucleic acids research 48, W1 (2020), W12--W16."},{"key":"e_1_3_2_1_18_1","volume-title":"Medical information extraction in the age of deep learning. Yearbook of medical informatics 29, 01","author":"Hahn Udo","year":"2020","unstructured":"Udo Hahn and Michel Oleynik. 2020. Medical information extraction in the age of deep learning. Yearbook of medical informatics 29, 01 (2020), 208--220."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.05.003"},{"key":"e_1_3_2_1_20_1","unstructured":"Serge Hercberg Mathilde Touvier and Jordi Salas-Salvado. 2021. The nutri-score nutrition label."},{"key":"e_1_3_2_1_21_1","volume-title":"Tjeerd Van Staa, and Liam Smeeth","author":"Herrett Emily","year":"2015","unstructured":"Emily Herrett, Arlene M Gallagher, Krishnan Bhaskaran, Harriet Forbes, Rohini Mathur, Tjeerd Van Staa, and Liam Smeeth. 2015. Data resource profile: clinical practice research datalink (CPRD). International journal of epidemiology 44, 3 (2015), 827--836."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295750.3298943"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3163\/1536-5050.97.3.007"},{"key":"e_1_3_2_1_24_1","volume-title":"Oxford Centre for Evidence-Based Medicine: Levels of Evidence. https:\/\/www.cebm.ox.ac.uk\/resources\/levels-of-evidence\/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009","author":"Howick Jeremy","year":"2009","unstructured":"Jeremy Howick. 2009. Oxford Centre for Evidence-Based Medicine: Levels of Evidence. https:\/\/www.cebm.ox.ac.uk\/resources\/levels-of-evidence\/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009 (2009)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.25046\/aj050114"},{"key":"e_1_3_2_1_26_1","volume-title":"PubMed and beyond: biomedical literature search in the age of artificial intelligence. Ebiomedicine 100","author":"Jin Qiao","year":"2024","unstructured":"Qiao Jin, Robert Leaman, and Zhiyong Lu. 2024. PubMed and beyond: biomedical literature search in the age of artificial intelligence. Ebiomedicine 100 (2024)."},{"key":"e_1_3_2_1_27_1","volume-title":"Spring","author":"Joshi Ashish","year":"2011","unstructured":"Ashish Joshi and Elicia Preslan. 2011. Risk factors for bladder cancer: challenges of conducting a literature search using PubMed. Perspectives in Health Information Management 8, Spring (2011)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401075"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00799-016-0170-x"},{"key":"e_1_3_2_1_30_1","volume-title":"Towards evidence based emergency medicine: best BETs from the Manchester Royal Infirmary. Emergency medicine journal 20, 4","author":"Mackway-Jones K","year":"2003","unstructured":"K Mackway-Jones. 2003. Towards evidence based emergency medicine: best BETs from the Manchester Royal Infirmary. Emergency medicine journal 20, 4 (2003), 362--362."},{"key":"e_1_3_2_1_31_1","volume-title":"CLEF 2014, Sheffield, UK, September 15--18, 2014. Proceedings 5. Springer, 74--85","author":"McCreadie Richard","year":"2014","unstructured":"Richard McCreadie, Craig Macdonald, Iadh Ounis, and Jon Brassey. 2014. A study of personalised medical literature search. In Information Access Evaluation. Multilinguality, Multimodality, and Interaction: 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15--18, 2014. Proceedings 5. Springer, 74--85."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1471-1842.2008.00827.x"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052579"},{"key":"e_1_3_2_1_34_1","unstructured":"National library of medicine (NLM). [n.d.]. LitVar. https:\/\/www.ncbi.nlm.nih.gov\/research\/litvar2\/."},{"key":"e_1_3_2_1_35_1","unstructured":"National library of medicine (NLM). [n.d.]. Medline. https:\/\/www.nlm.nih.gov\/medline\/medline_overview.html."},{"key":"e_1_3_2_1_36_1","unstructured":"National library of medicine (NLM). [n.d.]. PubMed. http:\/\/www.ncbi.nlm.nih.gov."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1134\/S0361768819070089"},{"key":"e_1_3_2_1_38_1","unstructured":"Office des Leitlinienprogrammes Onkologie. [n.d.]. Oncology Guidelines. https:\/\/www.leitlinienprogramm-onkologie.de\/leitlinien\/uebersicht."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btu524"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-01352-2"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/1742-6723.12404"},{"key":"e_1_3_2_1_42_1","volume-title":"Overview of the TREC 2017 precision medicine track. In The... text REtrieval conference: TREC. Text REtrieval Conference","volume":"26","author":"Roberts Kirk","year":"2017","unstructured":"Kirk Roberts, Dina Demner-Fushman, Ellen M Voorhees, William R Hersh, Steven Bedrick, Alexander J Lazar, and Shubham Pant. 2017. Overview of the TREC 2017 precision medicine track. In The... text REtrieval conference: TREC. Text REtrieval Conference, Vol. 26. NIH Public Access."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1089\/tmj.2020.0492"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2016.02.003"},{"key":"e_1_3_2_1_45_1","first-page":"76","article-title":"Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise","volume":"163","author":"Sch\u00fcnemann Finn","year":"2021","unstructured":"Finn Sch\u00fcnemann, J\u00f6rg J Meerpohl, Lukas Schwingshackl, Ina B Kopp, and Holger J Sch\u00fcnemann. 2021. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen 163 (2021), 76--84.","journal-title":"Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3406522.3446037"},{"key":"e_1_3_2_1_47_1","volume-title":"Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the PubMed interface. BMC medical research methodology 10","author":"Simon Michael","year":"2010","unstructured":"Michael Simon, Elke Hausner, Susan F Klaus, and Nancy E Dunton. 2010. Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the PubMed interface. BMC medical research methodology 10 (2010), 1--8."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr214"},{"key":"e_1_3_2_1_49_1","volume-title":"Natural language processing accurately categorizes indications, findings and pathology reports from multicenter colonoscopy. arXiv preprint arXiv:2108.11034","author":"Vadyala Shashank Reddy","year":"2021","unstructured":"Shashank Reddy Vadyala and Eric A Sherer. 2021. Natural language processing accurately categorizes indications, findings and pathology reports from multicenter colonoscopy. arXiv preprint arXiv:2108.11034 (2021)."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2698142"},{"key":"e_1_3_2_1_51_1","volume-title":"W1","author":"Wei Chih-Hsuan","year":"2019","unstructured":"Chih-Hsuan Wei, Alexis Allot, Robert Leaman, and Zhiyong Lu. 2019. PubTator central: automated concept annotation for biomedical full text articles. Nucleic acids research 47, W1 (2019), W587--W593."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btac537"},{"key":"e_1_3_2_1_53_1","volume-title":"W1","author":"Wei Chih-Hsuan","year":"2013","unstructured":"Chih-Hsuan Wei, Hung-Yu Kao, and Zhiyong Lu. 2013. PubTator: a web-based text mining tool for assisting biocuration. Nucleic acids research 41, W1 (2013), W518--W522."},{"key":"e_1_3_2_1_54_1","volume-title":"Carolyn J Mattingly, Jiao Li, Thomas C Wiegers, and Zhiyong Lu.","author":"Wei Chih-Hsuan","year":"2016","unstructured":"Chih-Hsuan Wei, Yifan Peng, Robert Leaman, Allan Peter Davis, Carolyn J Mattingly, Jiao Li, Thomas C Wiegers, and Zhiyong Lu. 2016. Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task. Database 2016 (2016), baw032."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Oded Yitschaky Michael Yitschaky and Yehuda Zadik. 2011. Case report on trial: Do you Doctor swear to tell the truth the whole truth and nothing but the truth? 3 pages.","DOI":"10.1186\/1752-1947-5-179"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/6028693"}],"event":{"name":"JCDL '24: 24th ACM\/IEEE Joint Conference on Digital Libraries","location":"Hong Kong China","acronym":"JCDL '24","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","IEEE TCDL"]},"container-title":["Proceedings of the 24th ACM\/IEEE Joint Conference on Digital Libraries"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677389.3702558","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3677389.3702558","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:19:07Z","timestamp":1750295947000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677389.3702558"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,16]]},"references-count":56,"alternative-id":["10.1145\/3677389.3702558","10.1145\/3677389"],"URL":"https:\/\/doi.org\/10.1145\/3677389.3702558","relation":{},"subject":[],"published":{"date-parts":[[2024,12,16]]},"assertion":[{"value":"2025-03-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}