{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T17:22:07Z","timestamp":1778347327408,"version":"3.51.4"},"reference-count":36,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T00:00:00Z","timestamp":1616544000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"MRC Heath Data Research UK","award":["HDRUK\/ CFC\/01"],"award-info":[{"award-number":["HDRUK\/ CFC\/01"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The objective of systematic reviews is to address a research question by summarizing relevant studies following a detailed, comprehensive, and transparent plan and search protocol to reduce bias. Systematic reviews are very useful in the biomedical and healthcare domain; however, the data extraction phase of the systematic review process necessitates substantive expertise and is labour-intensive and time-consuming. The aim of this work is to partially automate the process of building systematic radiotherapy treatment literature reviews by summarizing the required data elements of geometric errors of radiotherapy from relevant literature using machine learning and natural language processing (NLP) approaches. A framework is developed in this study that initially builds a training corpus by extracting sentences containing different types of geometric errors of radiotherapy from relevant publications. The publications are retrieved from PubMed following a given set of rules defined by a domain expert. Subsequently, the method develops a training corpus by extracting relevant sentences using a sentence similarity measure. A support vector machine (SVM) classifier is then trained on this training corpus to extract the sentences from new publications which contain relevant geometric errors. To demonstrate the proposed approach, we have used 60 publications containing geometric errors in radiotherapy to automatically extract the sentences stating the mean and standard deviation of different types of errors between planned and executed radiotherapy. The experimental results show that the recall and precision of the proposed framework are, respectively, 97% and 72%. The results clearly show that the framework is able to extract almost all sentences containing required data of geometric errors.<\/jats:p>","DOI":"10.3390\/info12040139","type":"journal-article","created":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T15:42:19Z","timestamp":1616600539000},"page":"139","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Sentence Classification Framework to Identify Geometric Errors in Radiation Therapy from Relevant Literature"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9536-8075","authenticated-orcid":false,"given":"Tanmay","family":"Basu","sequence":"first","affiliation":[{"name":"Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham B15 2TT, UK"},{"name":"University Hospitals Birmingham NHS Foundation Trust, Birmingham B15 2TH, UK"},{"name":"Institute of Translational Medicine, University Hospitals Birmingham, Birmingham B15 2TH, UK"},{"name":"MRC Health Data Research UK (HDR UK), Midlands Site, Birmingham B15 2TT, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1189-9897","authenticated-orcid":false,"given":"Simon","family":"Goldsworthy","sequence":"additional","affiliation":[{"name":"Department of Radiotherapy, Somerset NHS Foundation Trust, Somerset TA1 5DA, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2061-091X","authenticated-orcid":false,"given":"Georgios V.","family":"Gkoutos","sequence":"additional","affiliation":[{"name":"Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham B15 2TT, UK"},{"name":"University Hospitals Birmingham NHS Foundation Trust, Birmingham B15 2TH, UK"},{"name":"MRC Health Data Research UK (HDR UK), Midlands Site, Birmingham B15 2TT, UK"},{"name":"Department of Radiotherapy, Somerset NHS Foundation Trust, Somerset TA1 5DA, UK"},{"name":"NIHR Experimental Cancer Medicine Centre, Birmingham B15 2TT, UK"},{"name":"NIHR Surgical Reconstruction and Microbiology Research Centre, Birmingham B15 2TT, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1186\/s13643-015-0066-7","article-title":"Automating data extraction in systematic reviews: A systematic review","volume":"4","author":"Jonnalagadda","year":"2015","journal-title":"Syst. Rev."},{"key":"ref_2","unstructured":"Basu, T., Kumar, S., Kalyan, A., Jayaswal, P., Goyal, P., Pettifer, S., and Jonnalagadda, S.R. (2016). A Novel Framework to Expedite Systematic Reviews by Automatically Building Information Extraction Training Corpora. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Goldsworthy, S., Palmer, S., Latour, J., McNair, H., and Cramp, M. (2020). A systematic review of effectiveness of interventions applicable to radiotherapy that are administered to improve patient comfort, increase patient compliance, and reduce patient distress or anxiety. Radiography.","DOI":"10.1016\/j.radi.2020.03.002"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1053\/j.semradonc.2003.10.003","article-title":"Errors and margins in radiotherapy","volume":"14","year":"2004","journal-title":"Semin. Radiat. Oncol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.jmir.2017.09.004","article-title":"A pilot study evaluating the effectiveness of dual-registration image-guided radiotherapy in patients with oropharyngeal cancer","volume":"48","author":"Goldsworthy","year":"2017","journal-title":"J. Med. Imaging Radiat. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4749","DOI":"10.1002\/mp.13810","article-title":"Rotational positional error corrected intrafraction set-up margins in stereotactic radiotherapy: A spatial assessment for coplanar and noncoplanar geometry","volume":"46","author":"Sarkar","year":"2019","journal-title":"Med. Phys."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"235040","DOI":"10.1088\/1361-6560\/abb0c6","article-title":"Geometric uncertainty analysis of MLC tracking for lung SABR","volume":"65","author":"Caillet","year":"2020","journal-title":"Phys. Med. Biol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"22TR02","DOI":"10.1088\/1361-6560\/aae659","article-title":"Robust radiotherapy planning","volume":"63","author":"Unkelbach","year":"2018","journal-title":"Phys. Med. Biol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"S162","DOI":"10.1016\/j.ijrobp.2007.05.090","article-title":"Errors in radiotherapy: Motivation for development of new radiotherapy quality assurance paradigms","volume":"71","author":"Fraass","year":"2008","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mi\u0161i\u0107, V.V., and Chan, T.C. (2015). The perils of adapting to dose errors in radiation therapy. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0125335"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Goswami, S., Pal, S., Goldsworthy, S., and Basu, T. (2019, January 26\u201328). An effective machine learning framework for data elements extraction from the literature of anxiety outcome measures to build systematic review. Proceedings of the International Conference on Business Information Systems, Seville, Spain.","DOI":"10.1007\/978-3-030-20485-3_19"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.cobeha.2017.07.005","article-title":"Detecting depression and mental illness on social media: An integrative review","volume":"18","author":"Guntuku","year":"2017","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Shen, G., Jia, J., Nie, L., Feng, F., Zhang, C., Hu, T., Chua, T.S., and Zhu, W. (2017, January 19\u201325). Depression detection via harvesting social media: A multimodal dictionary learning solution. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI-17), Melbourne, Australia.","DOI":"10.24963\/ijcai.2017\/536"},{"key":"ref_14","unstructured":"Marshall, I.J., Kuiper, J., Banner, E., and Wallace, B.C. (August, January 30). Automating biomedical evidence synthesis: RobotReviewer. Proceedings of the Conference Association for Computational Linguistics, Vancouver, BC, Canada."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103321","DOI":"10.1016\/j.jbi.2019.103321","article-title":"Quantifying semantic similarity of clinical evidence in the biomedical literature to facilitate related evidence synthesis","volume":"100","author":"Hassanzadeh","year":"2019","journal-title":"J. Biomed. Inform."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1197\/jamia.M2444","article-title":"Evaluating the state-of-the-art in automatic de-identification","volume":"14","author":"Uzuner","year":"2007","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1136\/jamia.2010.003947","article-title":"Extracting medication information from clinical text","volume":"17","author":"Uzuner","year":"2010","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"S2","DOI":"10.1186\/2041-1480-2-S3-S2","article-title":"A cascade of classifiers for extracting medication information from discharge summaries","volume":"2","author":"Halgrim","year":"2011","journal-title":"J. Biomed. Semant. Biomed. Cent."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"S11","DOI":"10.1016\/j.jbi.2015.06.007","article-title":"Automated systems for the de-identification of longitudinal clinical narratives: Overview of 2014 i2b2\/UTHealth shared task Track 1","volume":"58","author":"Stubbs","year":"2015","journal-title":"J. Biomed. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"S4","DOI":"10.1016\/j.jbi.2017.06.011","article-title":"De-identification of psychiatric intake records: Overview of 2016 CEGS N-GRID Shared Tasks Track 1","volume":"75","author":"Stubbs","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_21","unstructured":"Yim, W.W., Denman, T., Kwan, S.W., and Yetisgen, M. (2016, January 21\u201324). Tumor information extraction in radiology reports for hepatocellular carcinoma patients. Proceedings of the AMIA Summits on Translational Science Proceedings, San Francisco, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jbi.2017.11.011","article-title":"Clinical information extraction applications: A literature review","volume":"77","author":"Wang","year":"2018","journal-title":"J. Biomed. Inform."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lee, L. (1999, January 20\u201326). Measures of distributional similarity. Proceedings of the 37th Annual Meeting of the ACL, College Park, MD, USA.","DOI":"10.3115\/1034678.1034693"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Raghavan, P., and Schutze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1007\/s13042-015-0421-y","article-title":"A supervised term selection technique for effective text categorization","volume":"7","author":"Basu","year":"2016","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42452-020-2738-8","article-title":"A medoid-based weighting scheme for nearest-neighbor decision rule toward effective text categorization","volume":"2","author":"Mukherjee","year":"2020","journal-title":"SN Appl. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.ins.2003.03.003","article-title":"Web page feature selection and classification using neural networks","volume":"158","author":"Selamat","year":"2004","journal-title":"Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.asoc.2017.04.069","article-title":"Modified frequency-based term weighting schemes for text classification","volume":"58","author":"Sabbah","year":"2017","journal-title":"Appl. Soft Comput."},{"key":"ref_29","unstructured":"Hsu, C.W., Chang, C.C., and Lin, C.J. (2021, March 17). A Practical Guide to Support Vector Classification; 2010. Available online: https:\/\/www.csie.ntu.edu.tw\/~cjlin\/papers\/guide\/guide.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Joachims, T. (1998, January 21\u201323). Text categorization with support vector machines: Learning with many relevant features. Proceedings of the European Conference on Machine Learning, Chemnitz, Germany.","DOI":"10.1007\/BFb0026683"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Basu, T., and Murthy, C.A. (2012, January 15\u201318). A Feature Selection Method for Improved Document Classification. Proceedings of the International Conference on Advanced Data Mining and Applications, Nanjing, China.","DOI":"10.1007\/978-3-642-35527-1_25"},{"key":"ref_32","unstructured":"Paul, S., Jandhyala, S.K., and Basu, T. (2018, January 10\u201314). Early Detection of Signs of Anorexia and Depression Over Social Media using Effective Machine Learning Frameworks. Proceedings of the CLEF (Working Notes), Avignon, France."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s41060-018-0096-z","article-title":"Automatic emotion detection in text streams by analyzing twitter data","volume":"7","author":"Hasan","year":"2019","journal-title":"Int. J. Data Sci. Anal."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1016\/j.ijrobp.2005.11.038","article-title":"Uncertainty in treatment of head-and-neck tumors by use of intraoral mouthpiece and embedded fiducials","volume":"64","author":"Oita","year":"2006","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: A pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2019","journal-title":"Bioinformatics"},{"key":"ref_36","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, Minneapolis, MN, USA."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/4\/139\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:40:23Z","timestamp":1760161223000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/4\/139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,24]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["info12040139"],"URL":"https:\/\/doi.org\/10.3390\/info12040139","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,24]]}}}