{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:39:59Z","timestamp":1761395999264,"version":"3.37.3"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003180","name":"Academisch Medisch Centrum","doi-asserted-by":"publisher","award":["2019-AMC-JK-7"],"award-info":[{"award-number":["2019-AMC-JK-7"]}],"id":[{"id":"10.13039\/501100003180","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Accurate, coded problem lists are valuable for data reuse, including clinical decision support and research. However, healthcare providers frequently modify coded diagnoses by including or removing common contextual properties in free-text diagnosis descriptions: uncertainty (<jats:italic>suspected glaucoma<\/jats:italic>), laterality (<jats:italic>left glaucoma<\/jats:italic>) and temporality (<jats:italic>glaucoma 2002<\/jats:italic>). These contextual properties could cause a difference in meaning between underlying diagnosis codes and modified descriptions, inhibiting data reuse. We therefore aimed to develop and evaluate an algorithm to identify these contextual properties.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A rule-based algorithm called UnLaTem (Uncertainty, Laterality, Temporality) was developed using a single-center dataset, including 288,935 diagnosis descriptions, of which 73,280 (25.4%) were modified by healthcare providers. Internal validation of the algorithm was conducted with an independent sample of 980 unique records. A second validation of the algorithm was conducted with 996 records from a Dutch multicenter dataset including 175,210 modified descriptions of five hospitals. Two researchers independently annotated the two validation samples. Performance of the algorithm was determined using means of the recall and precision of the validation samples. The algorithm was applied to the multicenter dataset to determine the actual prevalence of the contextual properties within the modified descriptions per specialty.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>For the single-center dataset recall (and precision) for removal of uncertainty, uncertainty, laterality and temporality respectively were 100 (60.0), 99.1 (89.9), 100 (97.3) and 97.6 (97.6). For the multicenter dataset for removal of uncertainty, uncertainty, laterality and temporality it was 57.1 (88.9), 86.3 (88.9), 99.7 (93.5) and 96.8 (90.1). Within the modified descriptions of the multicenter dataset, 1.3% contained removal of uncertainty, 9.9% uncertainty, 31.4% laterality and 9.8% temporality.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>We successfully developed a rule-based algorithm named UnLaTem to identify contextual properties in Dutch modified diagnosis descriptions. UnLaTem could be extended with more trigger terms, new rules and the recognition of term order to increase the performance even further. The algorithm\u2019s rules are available as additional file 2. Implementing UnLaTem in Dutch hospital systems can improve precision of information retrieval and extraction from diagnosis descriptions, which can be used for data reuse purposes such as decision support and research.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-021-01477-y","type":"journal-article","created":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T12:03:19Z","timestamp":1617796999000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality"],"prefix":"10.1186","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0451-7034","authenticated-orcid":false,"given":"Eva S.","family":"Klappe","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florentien J. P.","family":"van Putten","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicolette F.","family":"de Keizer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ronald","family":"Cornet","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,4,7]]},"reference":[{"issue":"2","key":"1477_CR1","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1111\/j.1525-1497.2005.40206.x","volume":"20","author":"DM Hartung","year":"2005","unstructured":"Hartung DM, Hunt J, Siemienczuk J, Miller H, Touchette DR. Clinical implications of an accurate problem list on heart failure treatment. J Gen Intern Med. 2005;20(2):143\u20137.","journal-title":"J Gen Intern Med"},{"issue":"102","key":"1477_CR2","first-page":"1","volume":"16","author":"SM Simons","year":"2016","unstructured":"Simons SM, Cillessen FH, Hazelzet JA. Determinants of a successful problem list to support the implementation of the problem-oriented medical record according to recent literature. BMC Med Inform Decis Mak. 2016;16(102):1\u20139.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1477_CR3","unstructured":"Salmon P, Rappaport A, Bainbridge M, Hayes G, Williams J, editors. Taking the problem oriented medical record forward. In: AMIA Annual Symposium Proceedings; 1996."},{"issue":"10","key":"1477_CR4","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1016\/j.ijmedinf.2015.06.011","volume":"84","author":"A Wright","year":"2015","unstructured":"Wright A, McCoy AB, Hickman T-TT, Hilaire DS, Borbolla D, Bowes WA III, et al. Problem list completeness in electronic health records: a multi-site study and assessment of success factors. Int J Med Inform. 2015;84(10):784\u201390.","journal-title":"Int J Med Inform"},{"issue":"4","key":"1477_CR5","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1136\/amiajnl-2011-000521","volume":"19","author":"A Wright","year":"2012","unstructured":"Wright A, Pang J, Feblowitz JC, Maloney FL, Wilcox AR, McLoughlin KS, et al. Improving completeness of electronic problem lists through clinical decision support: a randomized, controlled trial. J Am Med Inform Assoc. 2012;19(4):555\u201361.","journal-title":"J Am Med Inform Assoc"},{"key":"1477_CR6","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1186\/1472-6947-5-30","volume":"5","author":"S Meystre","year":"2005","unstructured":"Meystre S, Haug PJ. Automation of a problem list using natural language processing. BMC Med Inform Decis Mak. 2005;5:30.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1477_CR7","doi-asserted-by":"crossref","unstructured":"Meystre S, Haug P, editors. Improving the sensitivity of the problem list in an intensive care unit by using natural language processing. In: AMIA annual symposium proceedings; 2006.","DOI":"10.1186\/1472-6947-5-30"},{"issue":"01","key":"1477_CR8","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1055\/s-0039-1677737","volume":"10","author":"B-Z Hose","year":"2019","unstructured":"Hose B-Z, Hoonakker PL, Wooldridge AR, Brazelton TB III, Dean SM, Eithun B, et al. Physician perceptions of the electronic problem list in pediatric trauma care. Appl Clin Inform. 2019;10(01):113\u201322.","journal-title":"Appl Clin Inform"},{"issue":"36","key":"1477_CR9","first-page":"1","volume":"11","author":"A Wright","year":"2011","unstructured":"Wright A, Maloney FL, Feblowitz JC. Clinician attitudes toward and use of electronic problem lists: a thematic analysis. BMC Med Inform Decis Mak. 2011;11(36):1\u201310.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"04","key":"1477_CR10","doi-asserted-by":"publisher","first-page":"930","DOI":"10.4338\/ACI-2014-07-RA-0057","volume":"5","author":"A Wright","year":"2014","unstructured":"Wright A, Feblowitz J, Maloney F, Henkin S, Ramelson H, Feltman J, et al. Increasing patient engagement: patients\u2019 responses to viewing problem lists online. Appl Clin Inform. 2014;5(04):930\u201342.","journal-title":"Appl Clin Inform"},{"issue":"6","key":"1477_CR11","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1136\/amiajnl-2011-000121","volume":"18","author":"A Wright","year":"2011","unstructured":"Wright A, Pang J, Feblowitz JC, Maloney FL, Wilcox AR, Ramelson HZ, et al. A method and knowledge base for automated inference of patient problems from structured data in an electronic medical record. J Am Med Inform Assoc. 2011;18(6):859\u201367.","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"1477_CR12","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1002\/jhm.242","volume":"2","author":"DM Kaplan","year":"2007","unstructured":"Kaplan DM. Clear writing, clear thinking and the disappearing art of the problem list. J Hosp Med. 2007;2(4):199\u2013202.","journal-title":"J Hosp Med"},{"issue":"3","key":"1477_CR13","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1136\/jamia.1999.0060245","volume":"6","author":"PC Tang","year":"1999","unstructured":"Tang PC, LaRosa MP, Gorden SM. Use of computer-based records, completeness of documentation, and appropriateness of documented clinical decisions. J Am Med Inform Assoc. 1999;6(3):245\u201351.","journal-title":"J Am Med Inform Assoc"},{"key":"1477_CR14","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1093\/jamia\/ocaa040","volume":"27","author":"AS Porter","year":"2020","unstructured":"Porter AS, O\u2019Callaghan J, Englund KA, Lorenz RR, Kodish E. Problems with the problem list: challenges of transparency in an era of patient curation. J Am Med Inform Assoc. 2020;27:981\u20134.","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"1477_CR15","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.ijmedinf.2013.11.006","volume":"83","author":"H Hypp\u00f6nen","year":"2014","unstructured":"Hypp\u00f6nen H, Saranto K, Vuokko R, M\u00e4kel\u00e4-Bengs P, Doupi P, Lindqvist M, et al. Impacts of structuring the electronic health record: a systematic review protocol and results of previous reviews. Int J Med Inform. 2014;83(3):159\u201369.","journal-title":"Int J Med Inform"},{"issue":"03","key":"1477_CR16","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1055\/s-0040-1712466","volume":"11","author":"ES Klappe","year":"2020","unstructured":"Klappe ES, de Keizer NF, Cornet R. Factors influencing problem list use in electronic health records\u2014application of the unified theory of acceptance and use of technology. Appl Clin Inform. 2020;11(03):415\u201326.","journal-title":"Appl Clin Inform"},{"issue":"5","key":"1477_CR17","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1016\/j.jbi.2009.05.002","volume":"42","author":"H Harkema","year":"2009","unstructured":"Harkema H, Dowling JN, Thornblade T, Chapman WW. ConText: an algorithm for determining negation, experiencer, and temporal status from clinical reports. J Biomed Inform. 2009;42(5):839\u201351.","journal-title":"J Biomed Inform"},{"issue":"1","key":"1477_CR18","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/1472-6947-5-13","volume":"5","author":"PL Elkin","year":"2005","unstructured":"Elkin PL, Brown SH, Bauer BA, Husser CS, Carruth W, Bergstrom LR, et al. A controlled trial of automated classification of negation from clinical notes. BMC Med Inform Decis Mak. 2005;5(1):13.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1477_CR19","doi-asserted-by":"crossref","unstructured":"Morante R, Daelemans W, editors. A metalearning approach to processing the scope of negation. In: Proceedings of conference on CoNLL-2009; 2009.","DOI":"10.3115\/1596374.1596381"},{"key":"1477_CR20","unstructured":"Velupillai S, editor. Automatic classification of factuality levels: A case study on Swedish diagnoses and the impact of local context. In: 4th international symposium on languages in biology and medicine, LBM 2011; 2011."},{"issue":"5","key":"1477_CR21","doi-asserted-by":"publisher","first-page":"728","DOI":"10.1016\/j.jbi.2011.03.011","volume":"44","author":"BE Chapman","year":"2011","unstructured":"Chapman BE, Lee S, Kang HP, Chapman WW. Document-level classification of CT pulmonary angiography reports based on an extension of the ConText algorithm. J Biomed Inform. 2011;44(5):728\u201337.","journal-title":"J Biomed Inform"},{"issue":"3","key":"1477_CR22","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/s10579-009-9089-9","volume":"43","author":"R Saur\u00ed","year":"2009","unstructured":"Saur\u00ed R, Pustejovsky J. FactBank: a corpus annotated with event factuality. Lang Resour Eval. 2009;43(3):227.","journal-title":"Lang Resour Eval"},{"key":"1477_CR23","unstructured":"Dalianis H. Semantic analysis and concept extraction."},{"key":"1477_CR24","unstructured":"Light M, Qiu XY, Srinivasan P, editors. The language of bioscience: Facts, speculations, and statements in between. In: HLT-NAACL 2004 workshop: linking biological literature, ontologies and databases; 2004."},{"issue":"9","key":"1477_CR25","doi-asserted-by":"publisher","first-page":"931","DOI":"10.1001\/archsurg.141.9.931","volume":"141","author":"SC Seiden","year":"2006","unstructured":"Seiden SC, Barach P. Wrong-side\/wrong-site, wrong-procedure, and wrong-patient adverse events: are they preventable? AMA Arch Surg. 2006;141(9):931\u20139.","journal-title":"AMA Arch Surg"},{"key":"1477_CR26","unstructured":"Stearns M. Value of ICD-10 at the Point of Care. Journal of AHIMA website. 2015."},{"key":"1477_CR27","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1186\/s12859-014-0373-3","volume":"15","author":"Z Afzal","year":"2014","unstructured":"Afzal Z, Pons E, Kang N, Sturkenboom MC, Schuemie MJ, Kors JA. ContextD: an algorithm to identify contextual properties of medical terms in a Dutch clinical corpus. BMC Bioinform. 2014;15:373.","journal-title":"BMC Bioinform"},{"key":"1477_CR28","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1186\/1472-6947-12-127","volume":"12","author":"C Holmes","year":"2012","unstructured":"Holmes C, Brown M, St Hilaire D, Wright A. Healthcare provider attitudes towards the problem list in an electronic health record: a mixed-methods qualitative study. BMC Med Inform Decis Mak. 2012;12:127.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"5","key":"1477_CR29","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1197\/jamia.M1552","volume":"11","author":"C Friedman","year":"2004","unstructured":"Friedman C, Shagina L, Lussier Y, Hripcsak G. Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc. 2004;11(5):392\u2013402.","journal-title":"J Am Med Inform Assoc"},{"key":"1477_CR30","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1016\/j.jbi.2015.02.010","volume":"54","author":"S Mehrabi","year":"2015","unstructured":"Mehrabi S, Krishnan A, Sohn S, Roch AM, Schmidt H, Kesterson J, et al. DEEPEN: a negation detection system for clinical text incorporating dependency relation into NegEx. J Biomed Inform. 2015;54:213\u20139.","journal-title":"J Biomed Inform"},{"key":"1477_CR31","unstructured":"Horsky J, Drucker EA, Ramelson HZ, editors. Accuracy and completeness of clinical coding using ICD-10 for ambulatory visits. In: AMIA annual symposium proceedings; 2017."},{"issue":"5","key":"1477_CR32","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1006\/jbin.2001.1029","volume":"34","author":"WW Chapman","year":"2001","unstructured":"Chapman WW, Bridewell W, Hanbury P, Cooper GF, Buchanan BG. A simple algorithm for identifying negated findings and diseases in discharge summaries. J Biomed Inform. 2001;34(5):301\u201310.","journal-title":"J Biomed Inform"},{"key":"1477_CR33","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1093\/jamiaopen\/ooz020","volume":"2","author":"J-F Diaz-Garelli","year":"2019","unstructured":"Diaz-Garelli J-F, Strowd R, Ahmed T, Wells BJ, Merrill R, Laurini J, et al. A tale of three subspecialties: diagnosis recording patterns are internally consistent but specialty-dependent. JAMIA Open. 2019;2:369\u201377.","journal-title":"JAMIA Open."},{"key":"1477_CR34","first-page":"1","volume":"2010","author":"T Botsis","year":"2010","unstructured":"Botsis T, Hartvigsen G, Chen F, Weng C. Secondary use of EHR: data quality issues and informatics opportunities. Summit Translat Bioinform. 2010;2010:1\u20135.","journal-title":"Summit Translat Bioinform"},{"key":"1477_CR35","first-page":"661","volume":"180","author":"R Rinott","year":"2012","unstructured":"Rinott R, Torresani M, Bertulli R, Goldsteen A, Casali P, Carmeli B, et al. Automatic detection of inconsistencies between free text and coded data in Sarcoma discharge letters. Stud Health Technol Inform. 2012;180:661\u20136.","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"1477_CR36","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1136\/jamia.2000.0070042","volume":"7","author":"HD Stein","year":"2000","unstructured":"Stein HD, Nadkarni P, Erdos J, Miller PL. Exploring the degree of concordance of coded and textual data in answering clinical queries from a clinical data repository. J Am Med Inform Assoc. 2000;7(1):42\u201354.","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"1477_CR37","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1001\/archinternmed.2009.102","volume":"169","author":"H Singh","year":"2009","unstructured":"Singh H, Mani S, Espadas D, Petersen N, Franklin V, Petersen LA. Prescription errors and outcomes related to inconsistent information transmitted through computerized order entry: a prospective study. Arch Intern Med. 2009;169(10):982\u20139.","journal-title":"Arch Intern Med"},{"issue":"3","key":"1477_CR38","doi-asserted-by":"publisher","first-page":"1898","DOI":"10.1177\/1460458219895184","volume":"26","author":"PM Martin","year":"2020","unstructured":"Martin PM, Sbaffi L. Electronic Health Record and Problem Lists in Leeds, United Kingdom: variability of general practitioners\u2019 views. Health Informatics J. 2020;26(3):1898\u2013911.","journal-title":"Health Informatics J"},{"key":"1477_CR39","first-page":"38","volume":"2","author":"IM Soriano","year":"2017","unstructured":"Soriano IM, Pena JLC. Automatic medical concept extraction from free text clinical reports, a new named entity recognition approach. Int J Comput Appl. 2017;2:38\u201346.","journal-title":"Int J Comput Appl"},{"key":"1477_CR40","unstructured":"Aronson AR, editor. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. In: AMIA annual symposium proceedings; 2001: American Medical Informatics Association."},{"key":"1477_CR41","unstructured":"Zou Q, Chu WW, Morioka C, Leazer GH, Kangarloo H, editors. IndexFinder: a method of extracting key concepts from clinical texts for indexing. In: AMIA annual symposium proceedings; 2003: American Medical Informatics Association."},{"issue":"1","key":"1477_CR42","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1186\/1472-6947-14-32","volume":"14","author":"K Dentler","year":"2014","unstructured":"Dentler K, Cornet R, ten Teije A, Tanis P, Klinkenbijl J, Tytgat K, et al. Influence of data quality on computed Dutch hospital quality indicators: a case study in colorectal cancer surgery. BMC Med Inform Decis Mak. 2014;14(1):32.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1477_CR43","unstructured":"Dutch Hospital Data. Diagnosethesaurus. 2020. https:\/\/www.dhd.nl\/producten-diensten\/diagnosethesaurus\/Paginas\/Diagnosethesaurus.aspx. Accessed 17 Dec 2020."},{"key":"1477_CR44","unstructured":"Amsterdam UMC. Specialismen. 2020. https:\/\/www.amc.nl\/web\/specialismen.htm. Accessed 9 July 2020."},{"issue":"3","key":"1477_CR45","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276\u201382.","journal-title":"Biochem Med"},{"issue":"1","key":"1477_CR46","doi-asserted-by":"publisher","first-page":"45","DOI":"10.4103\/0301-4738.37595","volume":"56","author":"R Parikh","year":"2008","unstructured":"Parikh R, Mathai A, Parikh S, Sekhar GC, Thomas R. Understanding and using sensitivity, specificity and predictive values. Indian J ophthalmol. 2008;56(1):45.","journal-title":"Indian J ophthalmol"},{"issue":"4","key":"1477_CR47","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1177\/201010581102000411","volume":"20","author":"HB Wong","year":"2011","unstructured":"Wong HB, Lim GH. Measures of diagnostic accuracy: sensitivity, specificity. PPV NPV Proc Singap Healthc. 2011;20(4):316\u20138.","journal-title":"PPV NPV Proc Singap Healthc"},{"issue":"4","key":"1477_CR48","doi-asserted-by":"publisher","first-page":"173","DOI":"10.5808\/GI.2016.14.4.173","volume":"14","author":"CH Lee","year":"2016","unstructured":"Lee CH, Cook S, Lee JS, Han B. Comparison of two meta-analysis methods: inverse-variance-weighted average and weighted sum of Z-scores. Genomics inform. 2016;14(4):173.","journal-title":"Genomics inform"},{"issue":"2","key":"1477_CR49","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1177\/0013164498058002005","volume":"58","author":"J S\u00e1nchez-Meca","year":"1998","unstructured":"S\u00e1nchez-Meca J, Marin-Martinez F. Weighting by inverse variance or by sample size in meta-analysis: a simulation study. Educ Psychol Meas. 1998;58(2):211\u201320.","journal-title":"Educ Psychol Meas"},{"issue":"4","key":"1477_CR50","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1177\/0272989X9301300408","volume":"13","author":"B Littenberg","year":"1993","unstructured":"Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making. 1993;13(4):313\u201321.","journal-title":"Med Decis Making"},{"issue":"4","key":"1477_CR51","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1111\/j.1469-1809.1955.tb01285.x","volume":"20","author":"B Haldanse","year":"1956","unstructured":"Haldanse B. The estimation and significance of the logarithm of a ratio of frequencies. Ann Hum Genet. 1956;20(4):309\u201311.","journal-title":"Ann Hum Genet"},{"issue":"11","key":"1477_CR52","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1016\/S0895-4356(03)00177-X","volume":"56","author":"AS Glas","year":"2003","unstructured":"Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129\u201335.","journal-title":"J Clin Epidemiol"},{"key":"1477_CR53","unstructured":"Zwinderman AH, Cleophas TF. Statistics applied to clinical trials"},{"issue":"1","key":"1477_CR54","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1093\/oxfordjournals.aje.a112510","volume":"107","author":"WJ Rogan","year":"1978","unstructured":"Rogan WJ, Gladen B. Estimating prevalence from the results of a screening test. Am J Epidemiol. 1978;107(1):71\u20136.","journal-title":"Am J Epidemiol"},{"issue":"6","key":"1477_CR55","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1038\/nrg3208","volume":"13","author":"PB Jensen","year":"2012","unstructured":"Jensen PB, Jensen LJ, Brunak S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet. 2012;13(6):395\u2013405.","journal-title":"Nat Rev Genet"},{"issue":"2","key":"1477_CR56","doi-asserted-by":"publisher","first-page":"e12239","DOI":"10.2196\/12239","volume":"7","author":"S Sheikhalishahi","year":"2019","unstructured":"Sheikhalishahi S, Miotto R, Dudley JT, Lavelli A, Rinaldi F, Osmani V. Natural language processing of clinical notes on chronic diseases: systematic review. JMIR med inform. 2019;7(2):e12239.","journal-title":"JMIR med inform"},{"key":"1477_CR57","doi-asserted-by":"crossref","unstructured":"Fivez P, \u0160uster S, Daelemans W. Unsupervised context-sensitive spelling correction of English and Dutch clinical free-text with word and character n-gram embeddings. arXiv preprint arXiv:1710.07045. 2017.","DOI":"10.18653\/v1\/W17-2317"},{"key":"1477_CR58","first-page":"10","volume-title":"Caveats for the use of the active problem list as ground truth for decision support","author":"W Ceusters","year":"2018","unstructured":"Ceusters W, Blaisure J. Caveats for the use of the active problem list as ground truth for decision support. Decis Support Sys Educ: Help Support Healthc; 2018. p. 10\u20134."},{"issue":"1","key":"1477_CR59","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1186\/1471-2288-13-105","volume":"13","author":"E Ford","year":"2013","unstructured":"Ford E, Nicholson A, Koeling R, Tate AR, Carroll J, Axelrod L, et al. Optimising the use of electronic health records to estimate the incidence of rheumatoid arthritis in primary care: what information is hidden in free text? BMC Med Res Methodol. 2013;13(1):105.","journal-title":"BMC Med Res Methodol"},{"key":"1477_CR60","first-page":"325","volume":"2019","author":"J-F Diaz-Garelli","year":"2019","unstructured":"Diaz-Garelli J-F, Strowd R, Wells BJ, Ahmed T, Merrill R, Topaloglu U. Lost in translation: diagnosis records show more inaccuracies after biopsy in oncology care EHRs. AMIA Jt Summits Transl Sci Proc. 2019;2019:325.","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"1477_CR61","unstructured":"Chapman WW, Bridewell W, Hanbury P, Cooper GF, Buchanan BG, editors. Evaluation of negation phrases in narrative clinical reports. In: AMIA annual symposium proceedings; 2001. American Medical Informatics Association."},{"issue":"3","key":"1477_CR62","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1093\/jamia\/ocw144","volume":"24","author":"N Garcelon","year":"2017","unstructured":"Garcelon N, Neuraz A, Benoit V, Salomon R, Burgun A. Improving a full-text search engine: the importance of negation detection and family history context to identify cases in a biomedical data warehouse. J Am Med Inform Assoc. 2017;24(3):607\u201313.","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"1477_CR63","doi-asserted-by":"publisher","first-page":"576","DOI":"10.1197\/jamia.M1757","volume":"12","author":"H Ao","year":"2005","unstructured":"Ao H, Takagi T. ALICE: an algorithm to extract abbreviations from MEDLINE. J Am Med Inform Assoc. 2005;12(5):576\u201386.","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"1477_CR64","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.1007\/s11096-014-9987-9","volume":"36","author":"NR Samaranayake","year":"2014","unstructured":"Samaranayake NR, Cheung DS, Lam MP, Cheung TT, Chui WC, Wong IC, et al. The effectiveness of a \u2018Do Not Use\u2019 list and perceptions of healthcare professionals on error-prone abbreviations. Int J Clin Pharm-Net. 2014;36(5):1000\u20136.","journal-title":"Int J Clin Pharm-Net"},{"issue":"3","key":"1477_CR65","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.artmed.2014.01.001","volume":"61","author":"S Velupillai","year":"2014","unstructured":"Velupillai S, Skeppstedt M, Kvist M, Mowery D, Chapman BE, Dalianis H, et al. Cue-based assertion classification for Swedish clinical text\u2014developing a lexicon for pyConTextSwe. Artif Intell Med. 2014;61(3):137\u201344.","journal-title":"Artif Intell Med"},{"key":"1477_CR66","unstructured":"Klappe ES. UnLaTem. Github; 2021. https:\/\/github.com\/evaklappe\/UnLaTem. Accessed 25 Feb 2021."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01477-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-021-01477-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01477-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T12:20:07Z","timestamp":1617798007000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01477-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,7]]},"references-count":66,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1477"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01477-y","relation":{},"ISSN":["1472-6947"],"issn-type":[{"type":"electronic","value":"1472-6947"}],"subject":[],"published":{"date-parts":[[2021,4,7]]},"assertion":[{"value":"10 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The need for ethical approval was waived by the Medical Ethical Testing Committee (METC) of Amsterdam UMC (W19_300 # 19.357) because the study did not fall under the scope of the Medical Research Involving Human Subjects Act and data was anonymized.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"120"}}