{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:35:19Z","timestamp":1787016919044,"version":"build-2736575974"},"reference-count":40,"publisher":"BMJ","issue":"2","license":[{"start":{"date-parts":[[2020,2,13]],"date-time":"2020-02-13T00:00:00Z","timestamp":1581552000000},"content-version":"unspecified","delay-in-days":12,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000269","name":"Economic and Social Research Council","doi-asserted-by":"publisher","award":["ES\/P008321\/1"],"award-info":[{"award-number":["ES\/P008321\/1"]}],"id":[{"id":"10.13039\/501100000269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017642","name":"Spanish National Plan for Scientific and Technical Research and Innovation","doi-asserted-by":"crossref","award":["DPI2016-80054-R"],"award-info":[{"award-number":["DPI2016-80054-R"]}],"id":[{"id":"10.13039\/501100017642","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["206602\/Z\/17\/Z"],"award-info":[{"award-number":["206602\/Z\/17\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010677","name":"H2020 Health","doi-asserted-by":"publisher","award":["727560"],"award-info":[{"award-number":["727560"]}],"id":[{"id":"10.13039\/100010677","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010677","name":"H2020 Health","doi-asserted-by":"publisher","award":["825750"],"award-info":[{"award-number":["825750"]}],"id":[{"id":"10.13039\/100010677","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2020,1,17]]},"published-print":{"date-parts":[[2020,2]]},"abstract":"<jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>To demonstrate how data-driven variability methods can be used to identify changes in disease recording in two English electronic health records databases between 2001 and 2015.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>Repeated cross-sectional analysis that applied data-driven temporal variability methods to assess month-by-month changes in routinely collected medical data. A measure of difference between months was calculated based on joint distributions of age, gender, socioeconomic status and recorded cardiovascular diseases. Distances between months were used to identify temporal trends in data recording.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Setting<\/jats:title>\n                    <jats:p>400 English primary care practices from the Clinical Practice Research Datalink (CPRD GOLD) and 451 hospital providers from the Hospital Episode Statistics (HES).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main outcomes<\/jats:title>\n                    <jats:p>The proportion of patients (CPRD GOLD) and hospital admissions (HES) with a recorded cardiovascular disease (CPRD GOLD: coronary heart disease, heart failure, peripheral arterial disease, stroke; HES: International Classification of Disease codes I20-I69\/G45).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Both databases showed gradual changes in cardiovascular disease recording between 2001 and 2008. The recorded prevalence of included cardiovascular diseases in CPRD GOLD increased by 47%\u201362%, which partially reversed after 2008. For hospital records in HES, there was a relative decrease in angina pectoris (\u221234.4%) and unspecified stroke (\u221242.3%) over the same time period, with a concomitant increase in chronic coronary heart disease (+14.3%). Multiple abrupt changes in the use of myocardial infarction codes in hospital were found in March\/April 2010, 2012 and 2014, possibly linked to updates of clinical coding guidelines.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Identified temporal variability could be related to potentially non-medical causes such as updated coding guidelines. These artificial changes may introduce temporal correlation among diagnoses inferred from routine data, violating the assumptions of frequently used statistical methods. Temporal variability measures provide an objective and robust technique to identify, and subsequently account for, those changes in electronic health records studies without any prior knowledge of the data collection process.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjopen-2019-034396","type":"journal-article","created":{"date-parts":[[2020,2,14]],"date-time":"2020-02-14T04:25:28Z","timestamp":1581654328000},"page":"e034396","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":13,"title":["Data-driven discovery of changes in clinical code usage over time: a case-study on changes in cardiovascular disease recording in two English electronic health records databases (2001\u20132015)"],"prefix":"10.1136","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6499-7933","authenticated-orcid":false,"given":"Patrick","family":"Rockenschaub","sequence":"first","affiliation":[{"name":"Institute of Health Informatics, University College London, London, UK"},{"name":"Health Data Research UK, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Institute of Health Informatics, University College London, London, UK"},{"name":"Health Data Research UK, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0542-0816","authenticated-orcid":false,"given":"Robert W","family":"Aldridge","sequence":"additional","affiliation":[{"name":"Institute of Health Informatics, University College London, London, UK"},{"name":"Health Data Research UK, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2817-0178","authenticated-orcid":false,"given":"Dionisio","family":"Acosta","sequence":"additional","affiliation":[{"name":"Institute of Health Informatics, University College London, London, UK"},{"name":"Health Data Research UK, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Miguel","family":"Garc\u00eda-G\u00f3mez","sequence":"additional","affiliation":[{"name":"Instituto de Aplicaciones de las Tecnolog\u00edas de la Informaci\u00f3n y de las Comunicaciones Avanzadas (ITACA), Universitat Polit\u00e8cnica de Val\u00e8ncia, Valencia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"S\u00e1ez","sequence":"additional","affiliation":[{"name":"Instituto de Aplicaciones de las Tecnolog\u00edas de la Informaci\u00f3n y de las Comunicaciones Avanzadas (ITACA), Universitat Polit\u00e8cnica de Val\u00e8ncia, Valencia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2020,2,13]]},"reference":[{"key":"2025101812173693000_10.2.e034396.1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2012-001145"},{"key":"2025101812173693000_10.2.e034396.2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btv279"},{"key":"2025101812173693000_10.2.e034396.3","doi-asserted-by":"crossref","unstructured":"Cruz-Correia R , Rodrigues P , Freitas A . Chapter: 4, Data quality and integration issues in electronic health records. In: Information discovery on electronic health records. CRC Press, 2009: 55\u201395.","DOI":"10.1201\/9781420090413-c4"},{"key":"2025101812173693000_10.2.e034396.4","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000507"},{"key":"2025101812173693000_10.2.e034396.5","doi-asserted-by":"crossref","first-page":"68","DOI":"10.15265\/IY-2017-032","article-title":"Secondary use of patient data: review of the literature published in 2016","volume":"26","author":"Schlegel","year":"2017","journal-title":"Yearb Med Inform"},{"key":"2025101812173693000_10.2.e034396.6","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000681"},{"key":"2025101812173693000_10.2.e034396.7","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2125.2009.03537.x"},{"key":"2025101812173693000_10.2.e034396.8","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocw010"},{"key":"2025101812173693000_10.2.e034396.9","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2016-012905","article-title":"Quality of recording of diabetes in the UK: how does the GP's method of coding clinical data affect incidence estimates? cross-sectional study using the CPRD database","volume":"7","author":"Tate","year":"2017","journal-title":"BMJ Open"},{"key":"2025101812173693000_10.2.e034396.10","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.b1870","article-title":"Effect of the quality and outcomes framework on diabetes care in the United Kingdom: retrospective cohort study","volume":"338","author":"Calvert","year":"2009","journal-title":"BMJ"},{"key":"2025101812173693000_10.2.e034396.11","doi-asserted-by":"publisher","DOI":"10.1177\/0962280214545122"},{"key":"2025101812173693000_10.2.e034396.12","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyv098"},{"key":"2025101812173693000_10.2.e034396.13","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyx015"},{"key":"2025101812173693000_10.2.e034396.14","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.300.6732.1092","article-title":"The read clinical classification","volume":"300","author":"Chisholm","year":"1990","journal-title":"BMJ"},{"key":"2025101812173693000_10.2.e034396.15","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1093\/jamia\/ocz105","article-title":"UK phenomics platform for developing and validating electronic health record phenotypes: caliber","volume":"26","author":"Denaxas","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2025101812173693000_10.2.e034396.16","unstructured":"Department for Communities and Local Government . The English Index of Multiple Deprivation (IMD) 2015 - Guidance. Available: https:\/\/assets.publishing.service.gov.uk\/government\/uploads\/system\/uploads\/attachment_data\/file\/464430\/English_Index_of_Multiple_Deprivation_2015_-_Guidance.pdf [Accessed 8 Dec 2019]."},{"key":"2025101812173693000_10.2.e034396.17","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-014-0378-6"},{"key":"2025101812173693000_10.2.e034396.18","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1111\/j.1745-3984.2003.tb01108.x","article-title":"Modern multidimensional scaling: theory and applications","volume":"40","author":"Borg","year":"2003","journal-title":"J Educational Measurement"},{"key":"2025101812173693000_10.2.e034396.19","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.ijmedinf.2018.09.015","article-title":"Kinematics of big biomedical data to characterize temporal variability and seasonality of data repositories: functional data analysis of data temporal evolution over non-parametric statistical manifolds","volume":"119","author":"S\u00e1ez","year":"2018","journal-title":"Int J Med Inform"},{"key":"2025101812173693000_10.2.e034396.20","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(17)32520-5"},{"key":"2025101812173693000_10.2.e034396.21","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.f2350","article-title":"Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records: cohort study","volume":"346","author":"Herrett","year":"2013","journal-title":"BMJ"},{"key":"2025101812173693000_10.2.e034396.22","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0104671","article-title":"Socioeconomic deprivation and the incidence of 12 cardiovascular diseases in 1.9 million women and men: implications for risk prediction and prevention","volume":"9","author":"Pujades-Rodriguez","year":"2014","journal-title":"PLoS One"},{"key":"2025101812173693000_10.2.e034396.23","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2011-000269","article-title":"Uk stroke incidence, mortality and cardiovascular risk management 1999-2008: time-trend analysis from the general practice research database","volume":"1","author":"Lee","year":"2011","journal-title":"BMJ Open"},{"key":"2025101812173693000_10.2.e034396.24","doi-asserted-by":"publisher","DOI":"10.1136\/heartjnl-2015-307516"},{"key":"2025101812173693000_10.2.e034396.25","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.l223"},{"key":"2025101812173693000_10.2.e034396.26","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2017-018331","article-title":"An electronic health records cohort study on heart failure following myocardial infarction in England: incidence and predictors","volume":"8","author":"Gho","year":"2018","journal-title":"BMJ Open"},{"key":"2025101812173693000_10.2.e034396.27","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2014-005540","article-title":"Validation of chronic obstructive pulmonary disease recording in the clinical practice research Datalink (CPRD-GOLD)","volume":"4","author":"Quint","year":"2014","journal-title":"BMJ Open"},{"key":"2025101812173693000_10.2.e034396.28","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2013-003389","article-title":"Representativeness and optimal use of body mass index (BMI) in the UK clinical practice research Datalink (CPRD)","volume":"3","author":"Bhaskaran","year":"2013","journal-title":"BMJ Open"},{"key":"2025101812173693000_10.2.e034396.29","doi-asserted-by":"publisher","DOI":"10.1002\/pds.3537"},{"key":"2025101812173693000_10.2.e034396.30","unstructured":"Booth H , Dedman D , Wolf A . CPRD aurum frequently asked questions (FAQs). CPRD 2019."},{"key":"2025101812173693000_10.2.e034396.31","doi-asserted-by":"publisher","DOI":"10.1093\/pubmed\/fdr054"},{"key":"2025101812173693000_10.2.e034396.32","doi-asserted-by":"publisher","DOI":"10.1016\/0140-6736(91)93068-K"},{"key":"2025101812173693000_10.2.e034396.33","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1097\/EDE.0000000000000688","article-title":"Validity of cardiovascular disease event ascertainment using linkage to UK Hospital records","volume":"28","author":"Kivim\u00e4ki","year":"2017","journal-title":"Epidemiology"},{"key":"2025101812173693000_10.2.e034396.34","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.maturitas.2003.09.002","article-title":"Breast cancer and hormone-replacement therapy in the Million women study","volume":"46","author":"Crosignani","year":"2003","journal-title":"Maturitas"},{"key":"2025101812173693000_10.2.e034396.35","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2288-12-161","article-title":"Vascular disease in women: comparison of diagnoses in hospital episode statistics and general practice records in England","volume":"12","author":"Wright","year":"2012","journal-title":"BMC Med Res Methodol"},{"key":"2025101812173693000_10.2.e034396.36","doi-asserted-by":"publisher","DOI":"10.1136\/hrt.2009.192328"},{"key":"2025101812173693000_10.2.e034396.37","unstructured":"Silver LE , Heneghan C , Mehta Z , et al . Substantial underestimation of incidence of acute myocardial infarction by hospital discharge diagnostic coding data: a prospective population-based study. Heart 2009;95."},{"key":"2025101812173693000_10.2.e034396.38","unstructured":"Health and Social Care Information Centre . Coding clinic guidance. 5th edn, 2010."},{"key":"2025101812173693000_10.2.e034396.39","unstructured":"Health & Social Care Information Centre . National Clinical Coding Standards - ICD-10. 4th edn, 2013. https:\/\/hscic.kahootz.com\/connect.ti\/t_c_home\/view?objectId=31445829"},{"key":"2025101812173693000_10.2.e034396.40","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1996.11518099"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2019-034396","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T19:17:44Z","timestamp":1760815064000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2019-034396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,2,13]]},"published-print":{"date-parts":[[2020,2]]}},"alternative-id":["10.1136\/bmjopen-2019-034396"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2019-034396","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/19006098","asserted-by":"object"}]},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2]]}}}