{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T00:47:36Z","timestamp":1792716456231,"version":"4.5.0"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T00:00:00Z","timestamp":1571356800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T00:00:00Z","timestamp":1571356800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Validation studies on an ICD-10-based algorithm to identify major bleeding events are scarce, and mostly focused on positive predictive values.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To evaluate the sensitivity and specificity of an ICD-10-based algorithm in adult patients referred to hospital.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This was a cross-sectional, retrospective analysis. Among all hospital stays of adult patients referred to Rennes University Hospital, France, through the emergency ward in 2014, we identified major bleeding events according to an index test based on a list of ICD-10 diagnoses. As a reference, a two-step process was applied: firstly, a computerized request for electronic health records from the emergency ward, using several hemorrhage-related diagnostic codes and specific emergency therapies so as to discard stays with a very low probability of bleeding; secondly, a chart review of selected records was conducted by a medical expert blinded to the index test results and each hospital stay was classified into one of two exclusive categories: major bleeding or no major bleeding, according to pre-specified criteria.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Out of 16,012 hospital stays, the reference identified 736 major bleeding events and left 15,276 stays considered as without the target condition. The index test identified 637 bleeding events: 293 intracranial hemorrhages, 197 gastrointestinal hemorrhages and 147 other bleeding events. Overall, sensitivity was 65% (95%CI, 62 to 69), and specificity was 99.0%. We observed differential sensitivity and specificity across bleeding types, with the highest values for intracranial hemorrhage. Positive predictive values ranged from 59% for \u201cother\u201d bleeding events, to 71% (95%CI, 65 to 78) for gastrointestinal hemorrhage, and 96% for intracranial hemorrhage.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Low sensitivity and differential measures of accuracy across bleeding types support the need for specific data collection and medical validation rather than using an ICD-10-based algorithm for assessing the incidence of major bleeding.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-019-0841-6","type":"journal-article","created":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T08:04:10Z","timestamp":1571385850000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Sensitivity and specificity of an algorithm based on medico-administrative data to identify hospitalized patients with major bleeding presenting to an emergency department"],"prefix":"10.1186","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9837-2977","authenticated-orcid":false,"given":"Emmanuel","family":"Oger","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marie-Anne","family":"Botrel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catherine","family":"Juchault","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacques","family":"Bouget","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,10,18]]},"reference":[{"key":"841_CR1","doi-asserted-by":"publisher","first-page":"1620","DOI":"10.1111\/j.1475-6773.2005.00444.x","volume":"40","author":"KJ O\u2019Malley","year":"2005","unstructured":"O\u2019Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM. Measuring diagnoses: ICD code accuracy. Health Serv Res. 2005;40:1620\u201339.","journal-title":"Health Serv Res"},{"key":"841_CR2","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1136\/jech-2013-202744","volume":"68","author":"N Gavrielov-Yusim","year":"2014","unstructured":"Gavrielov-Yusim N, Friger M. Use of administrative medical databases in population-based research. J Epidemiol Community Health. 2014;68:283\u20137.","journal-title":"J Epidemiol Community Health"},{"key":"841_CR3","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.acvd.2014.01.012","volume":"107","author":"P Tuppin","year":"2014","unstructured":"Tuppin P, Cuerq A, de Peretti C, Fagot-Campagna A, Danchin N, Juilli\u00e8re Y, et al. Two-year outcome of patients after a first hospitalization for heart failure: a national observational study. Arch Cardiovasc Dis. 2014;107:158\u201368.","journal-title":"Arch Cardiovasc Dis"},{"key":"841_CR4","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1002\/pds.3544","volume":"23","author":"A Neumann","year":"2014","unstructured":"Neumann A, Maura G, Weill A, Ricordeau P, Alla F, Allemand H. Comparative effectiveness of rosuvastatin versus simvastatin in primary prevention among new users: a cohort study in the French national health insurance database: comparative effectiveness of rosuvastatine versus simvastatine. Pharmacoepidemiol Drug Saf. 2014;23:240\u201350.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"841_CR5","doi-asserted-by":"publisher","first-page":"1252","DOI":"10.1161\/CIRCULATIONAHA.115.015710","volume":"132","author":"G Maura","year":"2015","unstructured":"Maura G, Bloti\u00e8re P-O, Bouillon K, Billionnet C, Ricordeau P, Alla F, et al. Comparison of the short-term risk of bleeding and arterial thromboembolic events in nonvalvular atrial fibrillation patients newly treated with dabigatran or rivaroxaban versus vitamin K antagonists: a French nationwide propensity-matched cohort study. Circulation. 2015;132:1252\u201360.","journal-title":"Circulation"},{"issue":"4","key":"841_CR6","doi-asserted-by":"publisher","first-page":"e150","DOI":"10.1016\/S2352-3026(15)00027-7","volume":"2","author":"K Bouillon","year":"2015","unstructured":"Bouillon K, Bertrand M, Maura G, Bloti\u00e8re P-O, Ricordeau P, Zureik M. Risk of bleeding and arterial thromboembolism in patients with non-valvular atrial fibrillation either maintained on a vitamin K antagonist or switched to a non-vitamin K-antagonist oral anticoagulant: a retrospective, matched-cohort study. Lancet Haematol. 2015;2(4):e150\u20139.","journal-title":"Lancet Haematol"},{"key":"841_CR7","doi-asserted-by":"crossref","unstructured":"Bouillon K, Bertrand M, Boudali L, Ducimeti\u00e8re P, Dray-Spira R, Zureik M. Short-term risk of bleeding during heparin bridging at initiation of vitamin k antagonist therapy in more than 90 000 patients with nonvalvular atrial fibrillation managed in outpatient care. J Am Heart Assoc. 2016;5(11).","DOI":"10.1161\/JAHA.116.004065"},{"key":"841_CR8","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1093\/aje\/kwq433","volume":"173","author":"H Quan","year":"2011","unstructured":"Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676\u201382.","journal-title":"Am J Epidemiol"},{"key":"841_CR9","doi-asserted-by":"publisher","first-page":"1195","DOI":"10.1016\/j.thromres.2015.10.035","volume":"136","author":"F Al-Ani","year":"2015","unstructured":"Al-Ani F, Shariff S, Siqueira L, Seyam A, Lazo-Langner A. Identifying venous thromboembolism and major bleeding in emergency room discharges using administrative data. Thromb Res. 2015;136:1195\u20138.","journal-title":"Thromb Res"},{"key":"841_CR10","doi-asserted-by":"publisher","first-page":"1776","DOI":"10.1161\/01.STR.0000174293.17959.a1","volume":"36","author":"RA Kokotailo","year":"2005","unstructured":"Kokotailo RA, Hill MD. Coding of stroke and stroke risk factors using international classification of diseases, revisions 9 and 10. Stroke. 2005;36:1776\u201381.","journal-title":"Stroke"},{"issue":"6","key":"841_CR11","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1002\/pds.2109","volume":"20","author":"A Cunningham","year":"2011","unstructured":"Cunningham A, Stein CM, Chung CP, Daugherty JR, Smalley WE, Ray WA. An automated database case definition for serious bleeding related to oral anticoagulant use. Pharmacoepidemiol Drug Saf. 2011;20(6):560\u20136.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"841_CR12","doi-asserted-by":"publisher","first-page":"921","DOI":"10.1016\/j.jclinepi.2014.02.020","volume":"67","author":"VE Valkhoff","year":"2014","unstructured":"Valkhoff VE, Coloma PM, Masclee GM, Gini R, Innocenti F, Lapi F, on behalf of the EU-ADR consortium, et al. Validation study in four health-care databases: upper gastrointestinal bleeding misclassification affects precision but not magnitude of drug-related upper gastrointestinal bleeding risk. J Clin Epidemiol. 2014;67:921\u201331.","journal-title":"J Clin Epidemiol"},{"key":"841_CR13","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.thromres.2017.10.004","volume":"159","author":"T Delate","year":"2017","unstructured":"Delate T, Jones AE, Clark NP, Witt DM. Assessment of the coding accuracy of warfarin-related bleeding events. Thromb Res. 2017;159:86\u201390.","journal-title":"Thromb Res"},{"issue":"2","key":"841_CR14","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1002\/pds.4580","volume":"28","author":"A Ruig\u00f3mez","year":"2019","unstructured":"Ruig\u00f3mez A, Brobert G, Suzart-Woischnik K, Garc\u00eda-Rodr\u00edguez LA. Ascertainment and validation of major bleeding events in a primary care database. Pharmacoepidemiol Drug Saf. 2019;28(2):148\u201355.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"841_CR15","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1016\/j.thromres.2005.06.015","volume":"118","author":"T Arnason","year":"2006","unstructured":"Arnason T, Wells PS, Van WC, Forster AJ. Accuracy of coding for possible warfarin complications in hospital discharge abstracts. Thromb Res. 2006;118:253\u201362.","journal-title":"Thromb Res"},{"issue":"4","key":"841_CR16","doi-asserted-by":"publisher","first-page":"692","DOI":"10.1111\/j.1538-7836.2005.01204.x","volume":"3","author":"S Schulman","year":"2005","unstructured":"Schulman S, Kearon C, for the Subcommittee on Control of Anticoagulation of the Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Definition of major bleeding in clinical investigations of antihemostatic medicinal products in non-surgical patients. J Thromb Haemost. 2005;3(4):692\u20134.","journal-title":"J Thromb Haemost"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-019-0841-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12874-019-0841-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-019-0841-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T19:08:15Z","timestamp":1602875295000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-019-0841-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,18]]},"references-count":16,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["841"],"URL":"https:\/\/doi.org\/10.1186\/s12874-019-0841-6","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,18]]},"assertion":[{"value":"30 April 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 September 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 October 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was authorized by the local ethics committee, named <i>Comit\u00e9 d\u2019\u00e9thique du CHU de Rennes<\/i> (Rennes University Hospital), committee\u2019s reference number 13.06. Data used in this study was anonymised before its use.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"194"}}