{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T18:29:49Z","timestamp":1784312989400,"version":"3.55.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,12,9]],"date-time":"2019-12-09T00:00:00Z","timestamp":1575849600000},"content-version":"vor","delay-in-days":8,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U10AG029824"],"award-info":[{"award-number":["U10AG029824"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007316","name":"Division of Cancer Prevention, National Cancer Institute","doi-asserted-by":"publisher","award":["U10AG029824"],"award-info":[{"award-number":["U10AG029824"]}],"id":[{"id":"10.13039\/100007316","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Health and Medical Research Council of Australia","award":["334047"],"award-info":[{"award-number":["334047"]}]},{"name":"National Health and Medical Research Council of Australia","award":["1127060"],"award-info":[{"award-number":["1127060"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Trials"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Aspirin in reducing events in the elderly (ASPREE) trial developed a data suite that was specifically designed to support data collectors: the ASPREE Web Accessible Relational Database (<jats:italic>AWARD<\/jats:italic>). This paper describes<jats:italic>AWARD<\/jats:italic>and the impact of system design on data quality.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p><jats:italic>AWARD<\/jats:italic>\u2019s operational requirements, conceptual design, key challenges and design solutions for data quality are presented. Impact of design features is assessed through comparison of baseline data collected prior to implementation of key functionality (<jats:italic>n<\/jats:italic>\u2009=\u20091000) with data collected post implementation (<jats:italic>n<\/jats:italic>\u2009=\u200918,114). Overall data quality is assessed according to data category.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>At baseline, implementation of user-driven functionality reduced staff error (from 0.3% to 0.01%), out-of-range data entry (from 0.14% to 0.04%) and protocol deviations (from 0.4% to 0.08%). In the longitudinal data set, which contained more than 39 million data values collected within<jats:italic>AWARD<\/jats:italic>, 96.6% of data values were entered within specified query range or found to be accurate upon querying. The remaining data were missing (3.4%). Participant non-attendance at scheduled study activity was the most common cause of missing data. Costs associated with cleaning data in ASPREE were lower than expected compared with reports from other trials.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Clinical trials undertake complex operational activity in order to collect data, but technology rarely provides sufficient support. We find the<jats:italic>AWARD<\/jats:italic>suite provides proof of principle that designing technology to support data collectors can mitigate known causes of poor data quality and produce higher-quality data. Health information technology (IT) products that support the conduct of scheduled activity in addition to traditional data entry will enhance community-based clinical trials. A standardised framework for reporting data quality would aid comparisons across clinical trials.<\/jats:p><\/jats:sec><jats:sec><jats:title>Trial registration<\/jats:title><jats:p>International Standard Randomized Controlled Trial Number Register,<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/www.isrctn.com\/ISRCTN83772183\">ISRCTN83772183<\/jats:ext-link>. Registered on 3 March 2005.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s13063-019-3789-2","type":"journal-article","created":{"date-parts":[[2019,12,9]],"date-time":"2019-12-09T14:03:00Z","timestamp":1575900180000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Overcoming challenges to data quality in the ASPREE clinical trial"],"prefix":"10.1186","volume":"20","author":[{"name":"on behalf of the ASPREE Investigator Group","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6664-1239","authenticated-orcid":false,"given":"Jessica E.","family":"Lockery","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taya A.","family":"Collyer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher M.","family":"Reid","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael E.","family":"Ernst","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Gilbertson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nino","family":"Hay","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brenda","family":"Kirpach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John J.","family":"McNeil","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark R.","family":"Nelson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suzanne G.","family":"Orchard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kunnapoj","family":"Pruksawongsin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raj C.","family":"Shah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rory","family":"Wolfe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robyn L.","family":"Woods","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,12,9]]},"reference":[{"key":"3789_CR1","unstructured":"Gerritsen MG, Sartorius OE, vd Veen FM, Meester GT. Data management in multi-center clinical trials and the role of a nation-wide computer network. A 5 year evaluation. Proc Annu Symp Comput Appl Med Care. 1993;659-62. PubMed PMID: 8130557; PubMed Central PMCID: PMC2850658."},{"issue":"5","key":"3789_CR2","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1016\/S0197-2456(98)00033-6","volume":"19","author":"GL Knatterud","year":"1998","unstructured":"Knatterud GL, Rockhold FW, George SL, Barton FB, Davis CE, Fairweather WR, et al. Guidelines for quality assurance in multicenter trials: a position paper. Control Clin Trials. 1998;19(5):477\u201393.","journal-title":"Control Clin Trials"},{"issue":"4","key":"3789_CR3","doi-asserted-by":"publisher","first-page":"124","DOI":"10.4103\/2229-3485.86880","volume":"2","author":"A Bhatt","year":"2011","unstructured":"Bhatt A. Quality of clinical trials: a moving target. Perspect Clin Res. 2011;2(4):124\u20138.","journal-title":"Perspect Clin Res"},{"issue":"9","key":"3789_CR4","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1093\/eurheartj\/eht535","volume":"35","author":"G Calvo","year":"2014","unstructured":"Calvo G, McMurray JJV, Granger CB, Alonso-Garc\u00eda \u00c1, Armstrong P, Flather M, et al. Large streamlined trials in cardiovascular disease. Eur Heart J. 2014;35(9):544\u20138.","journal-title":"Eur Heart J"},{"key":"3789_CR5","doi-asserted-by":"publisher","first-page":"1190","DOI":"10.1109\/EMBC.2017.8037043","volume-title":"2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)","author":"GM Zaccaria","year":"2017","unstructured":"Zaccaria GM, Rosati S, Castagneri C, Ferrero S, Ladetto M, Boccadoro M, et al. Data quality improvement of a multicenter clinical trial dataset. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); 2017. p. 1190\u20133."},{"issue":"3","key":"3789_CR6","doi-asserted-by":"publisher","first-page":"482","DOI":"10.1016\/j.ahj.2004.04.049","volume":"149","author":"EL Eisenstein","year":"2005","unstructured":"Eisenstein EL, Lemons PW, Tardiff BE, Schulman KA, Jolly MK, Califf RM. Reducing the costs of phase III cardiovascular clinical trials. Am Heart J. 2005;149(3):482\u20138.","journal-title":"Am Heart J"},{"issue":"25","key":"3789_CR7","doi-asserted-by":"publisher","first-page":"2662","DOI":"10.1161\/CIRCULATIONAHA.115.020723","volume":"133","author":"SD Solomon","year":"2016","unstructured":"Solomon SD, Pfeffer MA. The future of clinical trials in cardiovascular medicine. Circulation. 2016;133(25):2662\u201370.","journal-title":"Circulation"},{"issue":"8","key":"3789_CR8","doi-asserted-by":"publisher","first-page":"e3049","DOI":"10.1371\/journal.pone.0003049","volume":"3","author":"ML Nahm","year":"2008","unstructured":"Nahm ML, Pieper CF, Cunningham MM. Quantifying data quality for clinical trials using electronic data capture. PLoS One. 2008;3(8):e3049.","journal-title":"PLoS One"},{"issue":"10","key":"3789_CR9","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1046\/j.1365-2044.1998.00534.x","volume":"53","author":"DR Goldhill","year":"1998","unstructured":"Goldhill DR, Sumner A. APACHE II, data accuracy and outcome prediction. Anaesthesia. 1998;53(10):937\u201343.","journal-title":"Anaesthesia"},{"issue":"S2","key":"3789_CR10","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1017\/S1047951108002862","volume":"18","author":"DR Clarke","year":"2008","unstructured":"Clarke DR, Breen LS, Jacobs ML, Franklin RCG, Tobota Z, Maruszewski B, et al. Verification of data in congenital cardiac surgery. Cardiol Young. 2008;18(S2):177.","journal-title":"Cardiol Young"},{"issue":"2","key":"3789_CR11","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/0197-2456(87)90034-1","volume":"8","author":"E van der Putten","year":"1987","unstructured":"van der Putten E, van der Velden JW, Siers A, Hamersma EAM. A pilot study on the quality of data management in a cancer clinical trial. Control Clin Trials. 1987;8(2):96\u2013100.","journal-title":"Control Clin Trials"},{"issue":"6","key":"3789_CR12","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1197\/jamia.M1087","volume":"9","author":"DGT Arts","year":"2002","unstructured":"Arts DGT, de Keizer NF, Scheffer G-J. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc. 2002;9(6):600\u201311.","journal-title":"J Am Med Inform Assoc"},{"issue":"9","key":"3789_CR13","doi-asserted-by":"publisher","first-page":"e25348","DOI":"10.1371\/journal.pone.0025348","volume":"6","author":"B Walther","year":"2011","unstructured":"Walther B, Hossin S, Townend J, Abernethy N, Parker D, Jeffries D. Comparison of electronic data capture (EDC) with the standard data capture method for clinical trial data. PLoS One. 2011;6(9):e25348.","journal-title":"PLoS One"},{"issue":"9","key":"3789_CR14","doi-asserted-by":"publisher","first-page":"1197","DOI":"10.1093\/jamia\/ocy088","volume":"25","author":"RM Ratwani","year":"2018","unstructured":"Ratwani RM, Savage E, Will A, Arnold R, Khairat S, Miller K, et al. A usability and safety analysis of electronic health records: a multi-center study. J Am Med Inform Assoc. 2018;25(9):1197\u2013201.","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"3789_CR15","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.4338\/ACI-2016-06-R-0105","volume":"7","author":"R Ratwani","year":"2016","unstructured":"Ratwani R, Fairbanks T, Savage E, Adams K, Wittie M, Boone E, et al. Mind the Gap. Appl Clin Inform. 2016;7(4):1069\u201387.","journal-title":"Appl Clin Inform"},{"issue":"Suppl 1","key":"3789_CR16","doi-asserted-by":"publisher","first-page":"i76","DOI":"10.1136\/qshc.2005.016105","volume":"15","author":"CW Johnson","year":"2006","unstructured":"Johnson CW. Why did that happen? Exploring the proliferation of barely usable software in healthcare systems. Qual Saf Health Care. 2006;15(Suppl 1):i76\u201381.","journal-title":"Qual Saf Health Care"},{"issue":"e1","key":"3789_CR17","doi-asserted-by":"publisher","first-page":"e2","DOI":"10.1136\/amiajnl-2012-001458","volume":"20","author":"B Middleton","year":"2013","unstructured":"Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM, et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc. 2013;20(e1):e2\u20138.","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"3789_CR18","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1145\/2029976.2029992","volume":"18","author":"B Shneiderman","year":"2011","unstructured":"Shneiderman B. Tragic errors: usability and electronic health records. Interactions. 2011;18(6):60.","journal-title":"Interactions"},{"issue":"2","key":"3789_CR19","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1016\/j.cct.2013.09.014","volume":"36","author":"Study design of aspirin in reducing events in the elderly (ASPREE)","year":"2013","unstructured":"Study design of aspirin in reducing events in the elderly (ASPREE). a randomized, controlled trial. Contemp Clin Trials. 2013;36(2):555\u201364.","journal-title":"Contemp Clin Trials"},{"issue":"11","key":"3789_CR20","doi-asserted-by":"publisher","first-page":"1586","DOI":"10.1093\/gerona\/glw342","volume":"72","author":"JJ McNeil","year":"2017","unstructured":"McNeil JJ, Woods RL, Nelson MR, Murray AM, Reid CM, Kirpach B, et al. Baseline characteristics of participants in the ASPREE (Aspirin in reducing events in the elderly) Study. J Gerontol A Biol Sci Med Sci. 2017;72(11):1586\u201393.","journal-title":"J Gerontol A Biol Sci Med Sci"},{"issue":"2","key":"3789_CR21","doi-asserted-by":"publisher","first-page":"105","DOI":"10.5694\/j.1326-5377.2008.tb01932.x","volume":"189","author":"MR Nelson","year":"2008","unstructured":"Nelson MR, Reid CM, Ames D, Beilin LJ, Donnan GA, Gibbs P, et al. Feasibility of conducting a primary prevention trial of low-dose aspirin for major adverse cardiovascular events in older people in Australia: results from the Aspirin in reducing events in the elderly (ASPREE) pilot study. Med J Aust. 2008;189(2):105\u20139.","journal-title":"Med J Aust"},{"key":"3789_CR22","doi-asserted-by":"crossref","unstructured":"Lockery JE, Collyer TA, Abhayaratna WP, Fitzgerald SM, McNeil JJ, Nelson MR, et al. Recruiting general practice patients for large clinical trials: lessons from the Aspirin in reducing events in the elderly (ASPREE) study. Med J Aust. 2018; Available from: https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.5694\/mja2.12060. Cited 27 Jan 2019.","DOI":"10.5694\/mja2.12060"},{"issue":"8","key":"3789_CR23","doi-asserted-by":"publisher","first-page":"1241","DOI":"10.1016\/0277-5379(89)90421-5","volume":"25","author":"K Vantongelen","year":"1989","unstructured":"Vantongelen K, Rotmensz N, van der Schueren E. Quality control of validity of data collected in clinical trials. EORTC Study Group on Data Management (SGDM). Eur J Cancer Clin Oncol. 1989 Aug;25(8):1241\u20137.","journal-title":"Eur J Cancer Clin Oncol"},{"issue":"1","key":"3789_CR24","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1177\/009286159903300113","volume":"33","author":"DJ McEntegart","year":"1999","unstructured":"McEntegart DJ, Jadhav SP, Brown T, Channon EJ. Checks of case record forms versus the database for efficacy variables when validation programs exist. Drug Inf J. 1999;33(1):101\u20137.","journal-title":"Drug Inf J"},{"issue":"18","key":"3789_CR25","doi-asserted-by":"publisher","first-page":"2134","DOI":"10.1001\/jama.2008.623","volume":"300","author":"H Ogawa","year":"2008","unstructured":"Ogawa H, Nakayama M, Morimoto T, Uemura S, Kanauchi M, Doi N, et al. Low-dose aspirin for primary prevention of atherosclerotic events in patients with type 2 diabetes: a randomized controlled trial. JAMA. 2008;300(18):2134\u201341.","journal-title":"JAMA"},{"key":"3789_CR26","doi-asserted-by":"crossref","unstructured":"Thrombosis prevention trial: randomised trial of low-intensity oral anticoagulation with warfarin and low-dose aspirin in the primary prevention of ischaemic heart disease in men at increased risk. The Medical Research Council's General Practice Research Framework. Lancet. 1998;351(9098):233-41. PubMed PMID: 9457092.","DOI":"10.1016\/S0140-6736(97)11475-1"},{"key":"3789_CR27","unstructured":"Belch J, MacCuish A, Campbell I, Cobbe S, Taylor R, Prescott R, et al. The prevention of progression of arterial disease and diabetes (POPADAD) trial: factorial randomised placebo controlled trial of aspirin and antioxidants in patients with diabetes and asymptomatic peripheral arterial disease. BMJ. 2008;337 Available from: https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2658865\/. Cited 1 Jan 2019."},{"issue":"9118","key":"3789_CR28","doi-asserted-by":"publisher","first-page":"1755","DOI":"10.1016\/S0140-6736(98)04311-6","volume":"351","author":"L Hansson","year":"1998","unstructured":"Hansson L, Zanchetti A, Carruthers SG, Dahl\u00f6f B, Elmfeldt D, Julius S, et al. Effects of intensive blood-pressure lowering and low-dose aspirin in patients with hypertension: principal results of the Hypertension optimal treatment (HOT) randomised trial. HOT Study Group. Lancet Lond Engl. 1998;351(9118):1755\u201362.","journal-title":"Lancet Lond Engl"},{"issue":"6618","key":"3789_CR29","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1136\/bmj.296.6618.313","volume":"296","author":"R Peto","year":"1988","unstructured":"Peto R, Gray R, Collins R, Wheatley K, Hennekens C, Jamrozik K, Warlow C, Hafner B, Thompson E, Norton S, et al. Randomised trial of prophylactic daily aspirin in British male doctors. Br Med J (Clin Res Ed). 1988;296(6618):313-6. PubMed PMID: 3125882; PubMed Central PMCID: PMC2544821.","journal-title":"BMJ"},{"key":"3789_CR30","unstructured":"Fowkes FGR. Aspirin for prevention of cardiovascular events in a general population screened for a low ankle brachial index: a randomized controlled trial. JAMA. Anticoagulation | JAMA Network. Available from: https:\/\/jamanetwork.com\/journals\/jama\/fullarticle\/185471. Cited 28 Dec 2018."},{"key":"3789_CR31","doi-asserted-by":"crossref","unstructured":"Nourani A, Ayatollahi H, Dodaran MS. A review of clinical data management systems used in clinical trials. Rev Recent Clin Trials. 2019; Available from: http:\/\/www.eurekaselect.com\/165619\/article. Cited 1 Aug 2019.","DOI":"10.2174\/1574887113666180924165230"}],"container-title":["Trials"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13063-019-3789-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13063-019-3789-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13063-019-3789-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,8]],"date-time":"2022-10-08T00:42:57Z","timestamp":1665189777000},"score":1,"resource":{"primary":{"URL":"https:\/\/trialsjournal.biomedcentral.com\/articles\/10.1186\/s13063-019-3789-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["3789"],"URL":"https:\/\/doi.org\/10.1186\/s13063-019-3789-2","relation":{},"ISSN":["1745-6215"],"issn-type":[{"value":"1745-6215","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"4 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 December 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Ethics approval was obtained for all study sites. In the USA, ethics approval was granted by the relevant Institutional Review Board at study sites. In Australia, primary ethics approval was granted by Monash University Human Research Ethics Committee (CF07\/3730\u20132006\/745MC). All participants provided informed consent.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"686"}}