{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:16:42Z","timestamp":1777778202450,"version":"3.51.4"},"reference-count":31,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2018,7,25]],"date-time":"2018-07-25T00:00:00Z","timestamp":1532476800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2019,4]]},"abstract":"<jats:p>While missing data is a commonly occurring issue in many domains, it is a topic that has been greatly overlooked by visualization scientists. Missing data values reduce the reliability of analysis results. A range of methods exist to replace the missing values with estimated values, but their appropriateness often depend on the patterns of missingness. Increased understanding of the missingness patterns and the distribution of missing values in data may greatly improve reliability, as well as provide valuable insight into potential problems in data gathering and analyses processes, and better understanding of the data as a whole. Visualization methods have a unique possibility to support investigation and understanding of missingness patterns by making the missing values and their relationship to recorded values visible. This article provides an overview of visualization of missing data values and defines a set of three missingness patterns of relevance for understanding missingness in data. It also contributes a usability evaluation which compares visualization methods representing missing values and how well they help users identify missingness patterns. The results indicate differences in performance depending on the visualization method as well as missingness pattern. Recommendations for future design of missing data visualization are provided based on the outcome of the study.<\/jats:p>","DOI":"10.1177\/1473871618785387","type":"journal-article","created":{"date-parts":[[2018,7,25]],"date-time":"2018-07-25T10:38:22Z","timestamp":1532515102000},"page":"230-250","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":20,"title":["To identify what is not there: A definition of missingness patterns and evaluation of missing value visualization"],"prefix":"10.1177","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4518-5144","authenticated-orcid":false,"given":"Sara Johansson","family":"Fernstad","sequence":"first","affiliation":[{"name":"School of Computing, Digital Institute, Newcastle University, Newcastle upon Tyne, UK"}]}],"member":"179","published-online":{"date-parts":[[2018,7,25]]},"reference":[{"key":"bibr1-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1177\/1473871611415994"},{"key":"bibr2-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1177\/1071181312561067"},{"key":"bibr3-1473871618785387","volume-title":"Proceedings of the 2014 IEEE conference on visual analytics science and technology (VAST)","author":"Johansson Fernstad S"},{"key":"bibr4-1473871618785387","unstructured":"Kirk A. Visualizing zero: how to show something with nothing, 2014, http:\/\/blogs.hbr.org\/2014\/05\/visualizing-zero-how-to-show-something-with-nothing\/"},{"key":"bibr5-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/63.3.581"},{"key":"bibr6-1473871618785387","unstructured":"Bache K, Lichman M. UCI machine learning repository, 2013, http:\/\/archive.ics.uci.edu\/ml"},{"key":"bibr7-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1186\/1477-7525-7-57"},{"key":"bibr8-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1109\/38.865880"},{"key":"bibr9-1473871618785387","first-page":"212","volume-title":"Proceedings of the conference on visualization\u201994","author":"Twiddy R"},{"issue":"2","key":"bibr10-1473871618785387","first-page":"113","volume":"5","author":"Unwin A","year":"1996","journal-title":"J Comput Graph Stat"},{"key":"bibr11-1473871618785387","first-page":"247","volume-title":"Eurostat (ed.) New techniques and technologies for statistics II","author":"Theus M","year":"1997"},{"key":"bibr12-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1007\/s11634-011-0102-y"},{"key":"bibr13-1473871618785387","unstructured":"Brix P. miP: multiple imputation plots, 2011, https:\/\/mran.microsoft.com\/snapshot\/2014-11-03\/web\/packages\/miP\/miP.pdf"},{"key":"bibr14-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1177\/1473871616667767"},{"key":"bibr15-1473871618785387","unstructured":"Carpenter B, Goodrich B, Su YS. migui: graphical user interface to the \u2018mi\u2019 package, 2015, https:\/\/cran.r-project.org\/web\/packages\/migui\/migui.pdf"},{"key":"bibr16-1473871618785387","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v045.i02"},{"key":"bibr17-1473871618785387","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v045.i07"},{"issue":"1","key":"bibr18-1473871618785387","first-page":"15","volume":"13","author":"Swayne DF","year":"1998","journal-title":"Computation Stat"},{"key":"bibr19-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9473(02)00286-4"},{"key":"bibr20-1473871618785387","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v068.i06"},{"key":"bibr21-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.2000.885679"},{"key":"bibr22-1473871618785387","first-page":"183","volume-title":"Proceedings of the 2006 IEEE symposium on visual analytics science and technology","author":"Xie Z"},{"key":"bibr23-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598592"},{"key":"bibr24-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76414-4_27"},{"key":"bibr25-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(98)00030-7"},{"key":"bibr26-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1007\/11555261_68"},{"key":"bibr27-1473871618785387","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-60566-010-3.ch082"},{"key":"bibr28-1473871618785387","volume-title":"Visualization of missing values using the R-package VIM","author":"Templ M","year":"2008"},{"key":"bibr29-1473871618785387","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0075129"},{"key":"bibr30-1473871618785387","volume-title":"Research methods: a process of inquiry","author":"Graziano AM","year":"1993"},{"key":"bibr31-1473871618785387","unstructured":"BOS Online Survey tool, 2016, https:\/\/www.onlinesurveys.ac.uk\/"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871618785387","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1473871618785387","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1473871618785387","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:18:55Z","timestamp":1777490335000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1473871618785387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,25]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,4]]}},"alternative-id":["10.1177\/1473871618785387"],"URL":"https:\/\/doi.org\/10.1177\/1473871618785387","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,25]]}}}