{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T03:57:20Z","timestamp":1777521440577,"version":"3.51.4"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,6,18]],"date-time":"2022-06-18T00:00:00Z","timestamp":1655510400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,18]],"date-time":"2022-06-18T00:00:00Z","timestamp":1655510400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Meta-analyses aggregate results of different clinical studies to assess the effectiveness of a treatment. Despite their importance, meta-analyses are time-consuming and labor-intensive as they involve reading hundreds of research articles and extracting data. The number of research articles is increasing rapidly and most meta-analyses are outdated shortly after publication as new evidence has not been included. Automatic extraction of data from research articles can expedite the meta-analysis process and allow for automatic updates when new results become available. In this study, we propose a system for automatically extracting data from research abstracts and performing statistical analysis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>Our corpus consists of 1011 PubMed abstracts of breast cancer randomized controlled trials annotated with the core elements of clinical trials: Participants, Intervention, Control, and Outcomes (PICO). We proposed a BERT-based named entity recognition (NER) model to identify PICO information from research abstracts. After extracting the PICO information, we parse numeric outcomes to identify the number of patients having certain outcomes for statistical analysis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The NER model extracted PICO elements with relatively high accuracy, achieving F1-scores greater than 0.80 in most entities. We assessed the performance of the proposed system by reproducing the results of an existing meta-analysis. The data extraction step achieved high accuracy, however the statistical analysis step achieved low performance because abstracts sometimes lack all the required information.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>We proposed a system for automatically extracting data from research abstracts and performing statistical analysis. We evaluated the performance of the system by reproducing an existing meta-analysis and the system achieved a relatively good performance, though more substantiation is required.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-022-01897-4","type":"journal-article","created":{"date-parts":[[2022,6,18]],"date-time":"2022-06-18T09:02:54Z","timestamp":1655542974000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Automatic data extraction to support meta-analysis statistical analysis: a case study on breast cancer"],"prefix":"10.1186","volume":"22","author":[{"given":"Faith Wavinya","family":"Mutinda","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kongmeng","family":"Liew","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuntaro","family":"Yada","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shoko","family":"Wakamiya","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eiji","family":"Aramaki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,6,18]]},"reference":[{"issue":"1","key":"1897_CR1","doi-asserted-by":"publisher","first-page":"9","DOI":"10.4103\/2249-4863.109934","volume":"2","author":"S Gopalakrishnan","year":"2013","unstructured":"Gopalakrishnan S, Ganeshkumar P. Systematic reviews and meta-analysis: understanding the best evidence in primary healthcare. J Fam Med Primary Care. 2013;2(1):9.","journal-title":"J Fam Med Primary Care"},{"issue":"9","key":"1897_CR2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000326","volume":"7","author":"H Bastian","year":"2010","unstructured":"Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: How will we ever keep up? PLoS Med. 2010;7(9): e1000326.","journal-title":"PLoS Med"},{"issue":"2","key":"1897_CR3","doi-asserted-by":"publisher","first-page":"781","DOI":"10.1093\/bib\/bbaa296","volume":"22","author":"LL Wang","year":"2021","unstructured":"Wang LL, Lo K. Text mining approaches for dealing with the rapidly expanding literature on COVID-19. Brief Bioinform. 2021;22(2):781\u201399.","journal-title":"Brief Bioinform"},{"issue":"2","key":"1897_CR4","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2016-012545","volume":"7","author":"R Borah","year":"2017","unstructured":"Borah R, Brown AW, Capers PL, Kaiser KA. Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open. 2017;7(2): e012545.","journal-title":"BMJ Open"},{"issue":"4","key":"1897_CR5","doi-asserted-by":"publisher","first-page":"224","DOI":"10.7326\/0003-4819-147-4-200708210-00179","volume":"147","author":"KG Shojania","year":"2007","unstructured":"Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147(4):224\u201333.","journal-title":"Ann Intern Med"},{"issue":"1","key":"1897_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13643-015-0066-7","volume":"4","author":"SR Jonnalagadda","year":"2015","unstructured":"Jonnalagadda SR, Goyal P, Huffman MD. Automating data extraction in systematic reviews: a systematic review. Syst Rev. 2015;4(1):1\u201316.","journal-title":"Syst Rev"},{"issue":"1","key":"1897_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13643-018-0916-1","volume":"8","author":"IJ Marshall","year":"2019","unstructured":"Marshall IJ, Wallace BC. Toward systematic review automation: a practical guide to using machine learning tools in research synthesis. Syst Rev. 2019;8(1):1\u201310.","journal-title":"Syst Rev"},{"key":"1897_CR8","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1016\/j.jclinepi.2018.08.023","volume":"105","author":"R Pradhan","year":"2019","unstructured":"Pradhan R, Hoaglin DC, Cornell M, Liu W, Wang V, Yu H. Automatic extraction of quantitative data from ClinicalTrials.gov to conduct meta-analyses. J Clin Epidemiol. 2019;105:92\u2013100.","journal-title":"J Clin Epidemiol"},{"key":"1897_CR9","doi-asserted-by":"crossref","unstructured":"Summerscales RL, Argamon S, Bai S, Hupert J, Schwartz A. Automatic summarization of results from clinical trials. In: 2011 IEEE international conference on bioinformatics and biomedicine. IEEE; 2011. p. 372\u20137.","DOI":"10.1109\/BIBM.2011.72"},{"key":"1897_CR10","unstructured":"Pouran Ben\u00a0Veyseh A, Dernoncourt F, Nguyen TH, Chang W, Celi LA. Acronym identification and disambiguation shared tasks for scientific document understanding. arXiv e-prints. 2020;p. arXiv-2012."},{"key":"1897_CR11","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. 2018."},{"issue":"4","key":"1897_CR12","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","volume":"36","author":"J Lee","year":"2020","unstructured":"Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, et al. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2020;36(4):1234\u201340.","journal-title":"Bioinformatics"},{"key":"1897_CR13","doi-asserted-by":"crossref","unstructured":"Peng Y, Yan S, Lu Z. Transfer learning in biomedical natural language processing: an evaluation of BERT and ELMo on ten benchmarking datasets. arXiv preprint arXiv:1906.05474. 2019.","DOI":"10.18653\/v1\/W19-5006"},{"key":"1897_CR14","unstructured":"Beltagy I, Peters ME, Cohan A. Longformer: the long-document transformer. arXiv preprint arXiv:2004.05150. 2020."},{"issue":"1","key":"1897_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"AE Johnson","year":"2016","unstructured":"Johnson AE, Pollard TJ, Shen L, Li-Wei HL, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3(1):1\u20139.","journal-title":"Sci Data"},{"key":"1897_CR16","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et\u00a0al. Roberta: a robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692. 2019."},{"key":"1897_CR17","unstructured":"Aronson AR. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In: Proceedings of the AMIA symposium. American Medical Informatics Association; 2001. p.\u00a017."},{"issue":"3","key":"1897_CR18","first-page":"40","volume":"7","author":"G Schwarzer","year":"2007","unstructured":"Schwarzer G, et al. meta: an R package for meta-analysis. R News. 2007;7(3):40\u20135.","journal-title":"R News"},{"issue":"1","key":"1897_CR19","doi-asserted-by":"publisher","first-page":"e52","DOI":"10.1097\/CAD.0000000000001196","volume":"33","author":"W Feng","year":"2022","unstructured":"Feng W, He Y, Zhang H, Si Y, Xu J, Xu J, et al. A meta-analysis of the effect and safety of platinum-based neoadjuvant chemotherapy in treatment of resectable triple-negative breast cancer. Anti-cancer Drugs. 2022;33(1):e52\u201360.","journal-title":"Anti-cancer Drugs"},{"issue":"2","key":"1897_CR20","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1007\/s10549-012-2100-y","volume":"136","author":"E Alba","year":"2012","unstructured":"Alba E, Chacon J, Lluch A, Anton A, Estevez L, Cirauqui B, et al. A randomized phase II trial of platinum salts in basal-like breast cancer patients in the neoadjuvant setting. Results from the GEICAM\/2006-03, multicenter study. Breast Cancer Res Treat. 2012;136(2):487\u201393.","journal-title":"Breast Cancer Res Treat"},{"issue":"2","key":"1897_CR21","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1007\/s10549-014-2947-1","volume":"145","author":"M Ando","year":"2014","unstructured":"Ando M, Yamauchi H, Aogi K, Shimizu S, Iwata H, Masuda N, et al. Randomized phase II study of weekly paclitaxel with and without carboplatin followed by cyclophosphamide\/epirubicin\/5-fluorouracil as neoadjuvant chemotherapy for stage II\/IIIA breast cancer without HER2 overexpression. Breast Cancer Res Treat. 2014;145(2):401\u20139.","journal-title":"Breast Cancer Res Treat"},{"issue":"6","key":"1897_CR22","doi-asserted-by":"publisher","first-page":"628","DOI":"10.1093\/jnci\/djx258","volume":"110","author":"O Gluz","year":"2018","unstructured":"Gluz O, Nitz U, Liedtke C, Christgen M, Grischke EM, Forstbauer H, et al. Comparison of neoadjuvant nab-paclitaxel+ carboplatin vs nab-paclitaxel+ gemcitabine in triple-negative breast cancer: randomized WSG-ADAPT-TN trial results. J Natl Cancer Inst. 2018;110(6):628\u201337.","journal-title":"J Natl Cancer Inst"},{"issue":"4","key":"1897_CR23","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1016\/S1470-2045(18)30111-6","volume":"19","author":"S Loibl","year":"2018","unstructured":"Loibl S, O\u2019Shaughnessy J, Untch M, Sikov WM, Rugo HS, McKee MD, et al. Addition of the PARP inhibitor veliparib plus carboplatin or carboplatin alone to standard neoadjuvant chemotherapy in triple-negative breast cancer (BrighTNess): a randomised, phase 3 trial. Lancet Oncol. 2018;19(4):497\u2013509.","journal-title":"Lancet Oncol"},{"issue":"1","key":"1897_CR24","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1200\/JCO.2014.57.0572","volume":"33","author":"WM Sikov","year":"2015","unstructured":"Sikov WM, Berry DA, Perou CM, Singh B, Cirrincione CT, Tolaney SM, et al. Impact of the addition of carboplatin and\/or bevacizumab to neoadjuvant once-per-week paclitaxel followed by dose-dense doxorubicin and cyclophosphamide on pathologic complete response rates in stage II to III triple-negative breast cancer: CALGB 40603 (Alliance). J Clin Oncol. 2015;33(1):13.","journal-title":"J Clin Oncol"},{"issue":"14","key":"1897_CR25","doi-asserted-by":"publisher","first-page":"1539","DOI":"10.1200\/JCO.19.03292","volume":"38","author":"N Tung","year":"2020","unstructured":"Tung N, Arun B, Hacker MR, Hofstatter E, Toppmeyer DL, Isakoff SJ, et al. TBCRC 031: randomized phase II study of neoadjuvant cisplatin versus doxorubicin-cyclophosphamide in germline BRCA carriers with HER2-negative breast cancer (the INFORM trial). J Clin Oncol. 2020;38(14):1539.","journal-title":"J Clin Oncol"},{"issue":"7","key":"1897_CR26","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1016\/S1470-2045(14)70160-3","volume":"15","author":"G Von Minckwitz","year":"2014","unstructured":"Von Minckwitz G, Schneeweiss A, Loibl S, Salat C, Denkert C, Rezai M, et al. Neoadjuvant carboplatin in patients with triple-negative and HER2-positive early breast cancer (GeparSixto; GBG 66): a randomised phase 2 trial. Lancet Oncol. 2014;15(7):747\u201356.","journal-title":"Lancet Oncol"},{"issue":"1","key":"1897_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-017-02088-w","volume":"9","author":"X Wu","year":"2018","unstructured":"Wu X, Tang P, Li S, Wang S, Liang Y, Zhong L, et al. A randomized and open-label phase II trial reports the efficacy of neoadjuvant lobaplatin in breast cancer. Nat Commun. 2018;9(1):1\u20138.","journal-title":"Nat Commun"},{"issue":"37","key":"1897_CR28","doi-asserted-by":"publisher","first-page":"60647","DOI":"10.18632\/oncotarget.10607","volume":"7","author":"P Zhang","year":"2016","unstructured":"Zhang P, Yin Y, Mo H, Zhang B, Wang X, Li Q, et al. Better pathologic complete response and relapse-free survival after carboplatin plus paclitaxel compared with epirubicin plus paclitaxel as neoadjuvant chemotherapy for locally advanced triple-negative breast cancer: a randomized phase 2 trial. Oncotarget. 2016;7(37):60647.","journal-title":"Oncotarget"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01897-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01897-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01897-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T19:25:29Z","timestamp":1675884329000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01897-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,18]]},"references-count":28,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1897"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01897-4","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,18]]},"assertion":[{"value":"22 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All experiments were performed in accordance with relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors have no competing interests to declare.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"158"}}