{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T17:00:30Z","timestamp":1777741230488,"version":"3.51.4"},"reference-count":38,"publisher":"Georg Thieme Verlag KG","issue":"02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2021,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Background\u2003In the United States, all 50 state governments deployed publicly viewable dashboards regarding the novel coronavirus disease 2019 (COVID-19) to track and respond to the pandemic. States dashboards, however, reflect idiosyncratic design practices based on their content, function, and visual design and platform. There has been little guidance for what state dashboards should look like or contain, leading to significant variation.<\/jats:p><jats:p>Objectives\u2003The primary objective of our study was to catalog how information, system function, and user interface were deployed across the COVID-19 state dashboards. Our secondary objective was to group and characterize the dashboards based on the information we collected using clustering analysis.<\/jats:p><jats:p>Methods\u2003For preliminary data collection, we developed a framework to first analyze two dashboards as a group and reach agreement on coding. We subsequently doubled coded the remaining 48 dashboards using the framework and reviewed the coding to reach total consensus.<\/jats:p><jats:p>Results\u2003All state dashboards included maps and graphs, most frequently line charts, bar charts, and histograms. The most represented metrics were total deaths, total cases, new cases, laboratory tests, and hospitalization. Decisions on how metrics were aggregated and stratified greatly varied across dashboards. Overall, the dashboards were very interactive with 96% having at least some functionality including tooltips, zooming, or exporting capabilities. For visual design and platform, we noted that the software was dominated by a few major organizations. Our cluster analysis yielded a six-cluster solution, and each cluster provided additional insights about how groups of states engaged in specific practices in dashboard design.<\/jats:p><jats:p>Conclusion\u2003Our study indicates that states engaged in dashboard practices that generally aligned with many of the goals set forth by the Centers for Disease Control and Prevention, Essential Public Health Services. We highlight areas where states fall short of these expectations and provide specific design recommendations to address these gaps.<\/jats:p>","DOI":"10.1055\/s-0041-1723989","type":"journal-article","created":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T00:03:19Z","timestamp":1618444999000},"page":"208-221","source":"Crossref","is-referenced-by-count":43,"title":["U.S. COVID-19 State Government Public Dashboards: An Expert Review"],"prefix":"10.1055","volume":"12","author":[{"given":"Naleef","family":"Fareed","sequence":"additional","affiliation":[{"name":"CATALYST\u2014The Center for the Advancement of Team Science, Analytics, and Systems Thinking, College of Medicine, The Ohio State University, Columbus, Ohio, United States"},{"name":"Department of Biomedical Informatics, College of Medicine, Institute for Behavioral Medicine Research, The Ohio State University, Columbus, Ohio, United States"}]},{"given":"Christine M.","family":"Swoboda","sequence":"additional","affiliation":[{"name":"CATALYST\u2014The Center for the Advancement of Team Science, Analytics, and Systems Thinking, College of Medicine, The Ohio State University, Columbus, Ohio, United States"}]},{"given":"Sarah","family":"Chen","sequence":"additional","affiliation":[{"name":"CATALYST\u2014The Center for the Advancement of Team Science, Analytics, and Systems Thinking, College of Medicine, The Ohio State University, Columbus, Ohio, United States"}]},{"given":"Evelyn","family":"Potter","sequence":"additional","affiliation":[{"name":"Department of Biochemistry, Ohio University, Athens, Ohio, United States"}]},{"given":"Danny T. Y.","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, College of Medicine, University of Cincinnati, Cincinnati, Ohio, United States"}]},{"given":"Cynthia J.","family":"Sieck","sequence":"additional","affiliation":[{"name":"CATALYST\u2014The Center for the Advancement of Team Science, Analytics, and Systems Thinking, College of Medicine, The Ohio State University, Columbus, Ohio, United States"},{"name":"Department of Family and Community Medicine, College of Medicine, Institute for Behavioral Medicine Research, The Ohio State University, Columbus, Ohio, United States"}]}],"member":"194","published-online":{"date-parts":[[2021,4,14]]},"reference":[{"issue":"04","key":"ref1","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1093\/jamia\/ocy190","article-title":"Evaluating visual analytics for health informatics applications: a systematic review from the American Medical Informatics Association Visual Analytics Working Group Task Force on Evaluation","volume":"26","author":"D TY Wu","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref3","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1055\/s-0039-1693649","article-title":"Visualizing infection surveillance data for policymaking using open source dashboarding","volume":"10","author":"M M Wahi","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"01","key":"ref4","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1055\/s-0039-1679868","article-title":"Timely data for targeted quality improvement interventions: Use of a visual analytics dashboard for bronchiolitis","volume":"10","author":"G Hester","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"05","key":"ref5","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1055\/s-0039-1698465","article-title":"Neurological dashboards and consultation turnaround time at an academic medical center","volume":"10","author":"B R Kummer","year":"2019","journal-title":"Appl Clin Inform"},{"key":"ref6","volume-title":"Designing the User Interface: Strategies for Effective Human-Computer Interaction","author":"B Shneiderman","year":"2016","edition":"6th ed."},{"key":"ref7","volume-title":"Information visualization: Perception for design","author":"C Ware","year":"2013","edition":"3rd ed."},{"issue":"08","key":"ref8","doi-asserted-by":"crossref","first-page":"1246","DOI":"10.1016\/j.socscimed.2009.07.046","article-title":"Crediting his critics' concerns: remaking John Snow's map of Broad Street cholera, 1854","volume":"69","author":"T Koch","year":"2009","journal-title":"Soc Sci Med"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1186\/1471-2458-9-339","article-title":"A profile of the online dissemination of national influenza surveillance data","volume":"9","author":"C K Cheng","year":"2009","journal-title":"BMC Public Health"},{"issue":"04","key":"ref11","doi-asserted-by":"crossref","first-page":"e85","DOI":"10.2196\/jmir.1658","article-title":"Digital dashboard design using multiple data streams for disease surveillance with influenza surveillance as an example","volume":"13","author":"C K Cheng","year":"2011","journal-title":"J Med Internet Res"},{"issue":"01","key":"ref14","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/s12942-020-00202-8","article-title":"Geographical tracking and mapping of coronavirus disease COVID-19\/severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) epidemic and associated events around the world: how 21st century GIS technologies are supporting the global fight against outbreaks and epidemics","volume":"19","author":"M N Kamel Boulos","year":"2020","journal-title":"Int J Health Geogr"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthplace.2020.102389","article-title":"The need for giscience in mapping covid-19","author":"L Rosenkrantz","year":"2020","journal-title":"Health Place"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(20)30693-0","article-title":"Tracking COVID-19 responsibly","author":"R Muhareb","year":"2020","journal-title":"Lancet"},{"key":"ref17","first-page":"463","article-title":"Convergence of web design and spatial, statistical, genomic and epidemiological information: the case of geo-dashboards in the covid-19 crisis","volume":"1","author":"S Grandi","year":"2020","journal-title":"Doc Geogr"},{"issue":"03","key":"ref18","doi-asserted-by":"crossref","first-page":"101284","DOI":"10.1016\/j.giq.2018.01.006","article-title":"Data science empowering the public: Data-driven dashboards for transparent and accountable decision-making in smart cities","volume":"37","author":"R Matheus","year":"2018","journal-title":"Gov Inf Q"},{"issue":"04","key":"ref19","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1145\/384189.384190","article-title":"Designing data marts for data warehouses","volume":"10","author":"A Bonifati","year":"2001","journal-title":"ACM Trans Softw Eng Methodol"},{"issue":"05","key":"ref21","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/S1473-3099(20)30120-1","article-title":"An interactive web-based dashboard to track COVID-19 in real time","volume":"20","author":"E Dong","year":"2020","journal-title":"Lancet Infect Dis"},{"issue":"07","key":"ref23","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1093\/jamia\/ocaa071","article-title":"An interactive online dashboard for tracking COVID-19 in U.S. counties, cities, and states in real time","volume":"27","author":"B D Wissel","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"02","key":"ref31","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1177\/2043820620935355","article-title":"The dashboard pandemic","volume":"10","author":"J Everts","year":"2020","journal-title":"Dialogues Hum Geogr"},{"key":"ref33","first-page":"241","article-title":"Distribution de la flore alpine dans le bassin des dranses et dans quelques regions voisines","volume":"37","author":"P Jaccard","year":"1901","journal-title":"Bullet Soci Vaudoise Sci Naturelles"},{"issue":"01","key":"ref34","doi-asserted-by":"crossref","first-page":"85","DOI":"10.6339\/JDS.2005.03(1).192","article-title":"Comparison of distance measures in cluster analysis with dichotomous data","volume":"3","author":"H Finch","year":"2005","journal-title":"J Data Sci"},{"key":"ref35","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1080\/01621459.1963.10500845","article-title":"Hierarchical grouping to optimize an objective function","volume":"58","author":"J Ward","year":"1963","journal-title":"J Am Stat Assoc"},{"issue":"03","key":"ref36","doi-asserted-by":"crossref","first-page":"777","DOI":"10.2307\/2529565","article-title":"391: A Monte Carlo comparison of six clustering procedures","volume":"31","author":"F K Kulper","year":"1975","journal-title":"Biometrics"},{"issue":"04","key":"ref37","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1002\/1097-4679(199307)49:4<459::AID-JCLP2270490402>3.0.CO;2-P","article-title":"Population recovery capabilities of 35 cluster analysis methods","volume":"49","author":"J E Overall","year":"1993","journal-title":"J Clin Psychol"},{"issue":"02","key":"ref38","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1207\/s15327906mbr2202_6","article-title":"A Monte Carlo study of the recovery of cluster structure in binary data by hierarchical clustering techniques","volume":"22","author":"S Hands","year":"1987","journal-title":"Multivariate Behav Res"},{"issue":"01","key":"ref39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/03610927408827101","article-title":"A dendrite method for cluster analysis","volume":"3","author":"T Cali\u0144ski","year":"1973","journal-title":"Commun Stat Theory Methods"},{"key":"ref40","volume-title":"Pattern Classification","author":"R O Duda","year":"2000","edition":"2nd ed."},{"issue":"04","key":"ref41","first-page":"e101","article-title":"Benchmarking: a method for continuous quality improvement in health","volume":"7","author":"A Ettorchi-Tardy","year":"2012","journal-title":"Healthc Policy"},{"issue":"04","key":"ref46","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/j.giq.2014.08.002","article-title":"participation, and accountability practices in open government: A comparative study","volume":"31","author":"T MS Harrison","year":"2014","journal-title":"Gov Inf Q"},{"issue":"04","key":"ref47","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.giq.2013.10.010","article-title":"Transparency of transparency: The pro-active disclosure of the rules governing access to information as a gauge of organisational cultural transformation. The case of the swiss transparency regime","volume":"31","author":"J P Villeneuve","year":"2014","journal-title":"Gov Inf Q"},{"issue":"02","key":"ref48","first-page":"1","article-title":"At the epicenter of the covid-19 pandemic and humanitarian crises in Italy: changing perspectives on preparation and mitigation","volume":"1","author":"M Nacoti","year":"2020","journal-title":"NEJM Catal"},{"issue":"21","key":"ref49","doi-asserted-by":"crossref","first-page":"2192","DOI":"10.1001\/jama.2020.7197","article-title":"Variation in COVID-19 hospitalizations and deaths across New York City boroughs","volume":"323","author":"R K Wadhera","year":"2020","journal-title":"JAMA"},{"key":"ref50","doi-asserted-by":"crossref","first-page":"m1548","DOI":"10.1136\/bmj.m1548","article-title":"Is ethnicity linked to incidence or outcomes of covid-19?","volume":"369","author":"K Khunti","year":"2020","journal-title":"BMJ"},{"key":"ref51","doi-asserted-by":"crossref","first-page":"138605","DOI":"10.1016\/j.scitotenv.2020.138605","article-title":"Assessing nitrogen dioxide (NO2) levels as a contributing factor to coronavirus (COVID-19) fatality","volume":"726","author":"Y Ogen","year":"2020","journal-title":"Sci Total Environ"},{"issue":"05","key":"ref52","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1108\/10878571211257159","article-title":"Strategic dashboards: Designing and deploying them to improve implementation","volume":"40","author":"M K Allio","year":"2012","journal-title":"Strategy Leadersh"},{"key":"ref53","first-page":"180","volume-title":"Designing and evaluating dashboards for multi-agency crisis preparation: A living lab","author":"N Bharosa"},{"key":"ref54","first-page":"3","article-title":"From data to wisdom","volume":"16","author":"R L Ackoff","year":"1989","journal-title":"J Appl Syst Anal"},{"key":"ref55","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195138276.003.0007","volume-title":"Communicating information for action within the public health system","author":"R A Goodman","year":"2000"},{"key":"ref56","first-page":"1","article-title":"Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group","volume":"50","author":"R R German","year":"2001","journal-title":"MMWR Recomm Rep"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0041-1723989.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T10:06:24Z","timestamp":1724839584000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0041-1723989"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3]]},"references-count":38,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2021,3,17]]},"published-print":{"date-parts":[[2021,3]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0041-1723989","relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3]]}}}