{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,29]],"date-time":"2025-11-29T07:59:43Z","timestamp":1764403183680,"version":"3.37.3"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T00:00:00Z","timestamp":1664409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["1U01TR002062-01"],"award-info":[{"award-number":["1U01TR002062-01"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institute of Health\u2019s All of Us Research Program","award":["1U2COD023196-01"],"award-info":[{"award-number":["1U2COD023196-01"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,11,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To design and evaluate an interactive data quality (DQ) characterization tool focused on fitness-for-use completeness measures to support researchers\u2019 assessment of a dataset.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Design requirements were identified through a conceptual framework on DQ, literature review, and interviews. The prototype of the tool was developed based on the requirements gathered and was further refined by domain experts. The Fitness-for-Use Tool was evaluated through a within-subjects controlled experiment comparing it with a baseline tool that provides information on missing data based on intrinsic DQ measures. The tools were evaluated on task performance and perceived usability.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The Fitness-for-Use Tool allows users to define data completeness by customizing the measures and its thresholds to fit their research task and provides a data summary based on the customized definition. Using the Fitness-for-Use Tool, study participants were able to accurately complete fitness-for-use assessment in less time than when using the Intrinsic DQ Tool. The study participants perceived that the Fitness-for-Use Tool was more useful in determining the fitness-for-use of a dataset than the Intrinsic DQ Tool.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Incorporating fitness-for-use measures in a DQ characterization tool could provide data summary that meets researchers needs. The design features identified in this study has potential to be applied to other biomedical data types.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>A tool that summarizes a dataset in terms of fitness-for-use dimensions and measures specific to a research question supports dataset assessment better than a tool that only presents information on intrinsic DQ measures.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocac166","type":"journal-article","created":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T14:38:02Z","timestamp":1664462282000},"page":"2032-2040","source":"Crossref","is-referenced-by-count":4,"title":["An interactive fitness-for-use data completeness tool to assess activity tracker data"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0263-0343","authenticated-orcid":false,"given":"Sylvia","family":"Cho","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7745-8501","authenticated-orcid":false,"given":"Ipek","family":"Ensari","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence and Human Health, Icahn School of Medicine , New York, New York, USA"},{"name":"Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai , New York, New York, USA"}]},{"given":"No\u00e9mie","family":"Elhadad","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, New York, USA"},{"name":"Data Science Institute, Columbia University , New York, New York, USA"}]},{"given":"Chunhua","family":"Weng","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, New York, USA"},{"name":"Data Science Institute, Columbia University , New York, New York, USA"}]},{"given":"Jennifer M","family":"Radin","sequence":"additional","affiliation":[{"name":"Scripps Research Translational Institute , La Jolla, California, USA"}]},{"given":"Brinnae","family":"Bent","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Duke University , Durham, North Carolina, USA"}]},{"given":"Pooja","family":"Desai","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9066-9431","authenticated-orcid":false,"given":"Karthik","family":"Natarajan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, New York, USA"},{"name":"Data Science Institute, Columbia University , New York, New York, USA"}]}],"member":"286","published-online":{"date-parts":[[2022,9,29]]},"reference":[{"year":"2020","author":"Vogels","key":"2022111608001666400_ocac166-B1"},{"issue":"1","key":"2022111608001666400_ocac166-B2","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1038\/s41591-020-1123-x","article-title":"Wearable sensor data and self-reported symptoms for COVID-19 detection","volume":"27","author":"Quer","year":"2021","journal-title":"Nat Med"},{"issue":"2","key":"2022111608001666400_ocac166-B3","doi-asserted-by":"crossref","first-page":"e85","DOI":"10.1016\/S2589-7500(19)30222-5","article-title":"Harnessing wearable device data to improve state-level real-time surveillance of influenza-like illness in the USA: a population-based study","volume":"2","author":"Radin","year":"2020","journal-title":"Lancet Digit Health"},{"issue":"4","key":"2022111608001666400_ocac166-B4","doi-asserted-by":"crossref","first-page":"190","DOI":"10.15171\/hpp.2017.34","article-title":"Cross-sectional and longitudinal associations of objectively-measured physical activity on blood pressure: evaluation in 37 countries","volume":"7","author":"Menai","year":"2017","journal-title":"Health Promot Perspect"},{"issue":"5","key":"2022111608001666400_ocac166-B5","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1093\/ajh\/hpx221","article-title":"Real world home blood pressure variability in over 56,000 individuals with nearly 17 million measurements","volume":"31","author":"Kim","year":"2018","journal-title":"Am J Hypertens"},{"issue":"3","key":"2022111608001666400_ocac166-B6","doi-asserted-by":"crossref","first-page":"e20738","DOI":"10.2196\/20738","article-title":"Factors affecting the quality of person-generated wearable device data and associated challenges: rapid systematic review","volume":"9","author":"Cho","year":"2021","journal-title":"JMIR Mhealth Uhealth"},{"key":"2022111608001666400_ocac166-B7","first-page":"1080","article-title":"A framework for data quality assessment in clinical research datasets","volume":"2017","author":"Lee","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2022111608001666400_ocac166-B8","first-page":"16","article-title":"Reporting data quality assessment results: identifying individual and organizational barriers and solutions","volume":"5","author":"Callahan","year":"2017","journal-title":"EGEMS (Washington, DC)"},{"key":"2022111608001666400_ocac166-B9","first-page":"574","article-title":"Observational Health Data Sciences and Informatics (OHDSI): opportunities for observational researchers","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2022111608001666400_ocac166-B10","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2022111608001666400_ocac166-B11","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1145\/253769.253804","article-title":"Data quality in context","volume":"40","author":"Strong","year":"1997","journal-title":"Commun ACM"},{"key":"2022111608001666400_ocac166-B12","first-page":"776","article-title":"Coordinating computer-supported cooperative work: a review of research issues and strategies","volume":"49","author":"Kies","year":"1998","journal-title":"J Am Soc Inf Sci"},{"issue":"4","key":"2022111608001666400_ocac166-B13","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1207\/S15327590IJHC1304_03","article-title":"Criteria for evaluating usability evaluation methods","volume":"13","author":"Hartson","year":"2001","journal-title":"Int J Hum Comput Interact"},{"key":"2022111608001666400_ocac166-B14","doi-asserted-by":"crossref","first-page":"e31618","DOI":"10.2196\/31618","article-title":"Identifying data quality dimensions for person-generated wearable device data: a multi-method study","volume":"9","author":"Cho","year":"2021","journal-title":"JMIR Mhealth Uhealth"},{"issue":"2","key":"2022111608001666400_ocac166-B15","doi-asserted-by":"crossref","first-page":"e2004285","DOI":"10.1371\/journal.pbio.2004285","article-title":"Beyond fitness tracking: the use of consumer-grade wearable data from normal volunteers in cardiovascular and lipidomics research","volume":"16","author":"Lim","year":"2018","journal-title":"PLoS Biol"},{"key":"2022111608001666400_ocac166-B16","first-page":"917","article-title":"Development of a customizable health IT usability evaluation scale","volume":"2010","author":"Yen","year":"2010","journal-title":"AMIA Annu Symp Proc"},{"volume-title":"Usability Evaluation in Industry","year":"1996","author":"Brooke","key":"2022111608001666400_ocac166-B17"},{"author":"Fay","key":"2022111608001666400_ocac166-B18"},{"issue":"1","key":"2022111608001666400_ocac166-B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3191769","article-title":"Defining adherence: making sense of physical activity tracker data","volume":"2","author":"Tang","year":"2018","journal-title":"Proc ACM Interact Mob Wearable Ubiquitous Technol"},{"key":"2022111608001666400_ocac166-B20","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1186\/1479-5868-10-140","article-title":"Accelerometer data reduction in adolescents: effects on sample retention and bias","volume":"10","author":"Toftager","year":"2013","journal-title":"Int J Behav Nutr Phys Act"},{"issue":"6","key":"2022111608001666400_ocac166-B21","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","year":"2008","journal-title":"Int J Hum\u2013Comput Interact"},{"volume-title":"Examining the Impact of Real-World Evidence on Medical Product Development: Proceedings of a Workshop Series","year":"2019","author":"Shore","key":"2022111608001666400_ocac166-B22"},{"year":"2020","author":"Reich","key":"2022111608001666400_ocac166-B23"},{"key":"2022111608001666400_ocac166-B24","doi-asserted-by":"crossref","first-page":"160018","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR Guiding Principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Sci Data"},{"key":"2022111608001666400_ocac166-B25","first-page":"168","article-title":"Examining researcher needs and barriers for using electronic health data for translational research","volume":"2015","author":"Stephens","year":"2015","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"2022111608001666400_ocac166-B26","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1056\/NEJMsr1809937","article-title":"The \u2018All of Us\u2019 research program","volume":"381","author":"All of Us Research Program Investigators","year":"2019","journal-title":"N Engl J Med"},{"year":"2021","author":"National Insitutes of Health","key":"2022111608001666400_ocac166-B27"},{"year":"2022","author":"National Insitutes of Health","key":"2022111608001666400_ocac166-B28"},{"issue":"3","key":"2022111608001666400_ocac166-B29","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1093\/jamia\/ocx134","article-title":"User needs analysis and usability assessment of DataMed\u2014a biomedical data discovery index","volume":"25","author":"Dixit","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2022111608001666400_ocac166-B30","first-page":"1318","article-title":"Quantifying the longitudinal value of healthcare record collections for pharmacoepidemiology","volume":"2011","author":"Sperrin","year":"2011","journal-title":"AMIA Annu Symp Proc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/12\/2032\/47027845\/ocac166.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/12\/2032\/47027845\/ocac166.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,16]],"date-time":"2022-11-16T08:01:36Z","timestamp":1668585696000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/12\/2032\/6730805"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,29]]},"references-count":30,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,9,29]]},"published-print":{"date-parts":[[2022,11,14]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac166","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2022,12,1]]},"published":{"date-parts":[[2022,9,29]]}}}