{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T16:41:01Z","timestamp":1781887261743,"version":"3.54.5"},"reference-count":64,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T00:00:00Z","timestamp":1706572800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"crossref","award":["251654672 - TRR 161"],"award-info":[{"award-number":["251654672 - TRR 161"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Information Visualization"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:p>Visual quality measures (VQMs) are designed to support analysts by automatically detecting and quantifying patterns in visualizations. We propose a new VQM for visual grouping patterns in scatterplots, called ClustML, which is trained on previously collected human subject judgments. Our model encodes scatterplots in the parametric space of a Gaussian Mixture Model and uses a classifier trained on human judgment data to estimate the perceptual complexity of grouping patterns. The numbers of initial mixture components and final combined groups quantify visual cluster patterns in scatterplots. It improves on existing VQMs, first, by better estimating human judgments on two-Gaussian cluster patterns and, second, by giving higher accuracy when ranking general cluster patterns in scatterplots. We use it to analyze kinship data for genome-wide association studies, in which experts rely on the visual analysis of large sets of scatterplots. We make the benchmark datasets and the new VQM available for practical use and further improvements.<\/jats:p>","DOI":"10.1177\/14738716231220536","type":"journal-article","created":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T06:58:13Z","timestamp":1706597893000},"page":"105-122","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["ClustML: A measure of cluster pattern complexity in scatterplots learnt from human-labeled groupings"],"prefix":"10.1177","volume":"23","author":[{"given":"Mostafa M","family":"Hamza","sequence":"first","affiliation":[{"name":"Geisinger Health System, Danville, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ehsan","family":"Ullah","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, HBKU, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abdelkader","family":"Baggag","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, HBKU, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Halima","family":"Bensmail","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, HBKU, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Sedlmair","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Stuttgart, Baden-W\u00fcrttemberg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6321-5242","authenticated-orcid":false,"given":"Michael","family":"Aupetit","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, HBKU, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,1,30]]},"reference":[{"key":"bibr1-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864477"},{"key":"bibr2-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858155."},{"key":"bibr3-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.153"},{"key":"bibr4-14738716231220536","first-page":"141","volume-title":"2019 IEEE visualization conference, VIS 2019","author":"Aupetit M"},{"key":"bibr5-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1145\/2669557.2669559"},{"key":"bibr6-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745258"},{"key":"bibr7-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2846735"},{"key":"bibr8-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1145\/331770.331775"},{"key":"bibr9-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467324"},{"key":"bibr10-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2012.6400488."},{"key":"bibr11-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-14395-4"},{"key":"bibr12-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01475.x."},{"key":"bibr13-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.09.062"},{"key":"bibr14-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2672987"},{"key":"bibr15-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1974.224051"},{"key":"bibr16-14738716231220536","unstructured":"Buja A, Cook D, Asimov D, et al. Theory of dynamic projections in high-dimensional data visualization, http:\/\/stat.wharton.upenn.edu\/\u223cbuja\/PAPERS\/paper-dyn-proj-math.pdf (2004, accessed 9 January 2024)"},{"key":"bibr17-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1145\/1168149.1168159."},{"key":"bibr18-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/INFOVIS.2005.14."},{"key":"bibr19-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744339"},{"key":"bibr20-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.229"},{"key":"bibr21-14738716231220536","first-page":"73","volume-title":"Proc. IEEE Paci\ufb01c visualization symp. (Paci\ufb01cVis)","author":"Dang TN","year":"2014"},{"key":"bibr22-14738716231220536","first-page":"773","volume-title":"Proc. the sixth annual conference and exposition: computer graphics, Vol. III, technical sessions","author":"Tukey JW","year":"1985"},{"key":"bibr23-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.153"},{"key":"bibr24-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13684"},{"key":"bibr25-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1198\/016214502760047131"},{"key":"bibr26-14738716231220536","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.10208143."},{"key":"bibr27-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03125.x"},{"key":"bibr28-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2875702"},{"key":"bibr29-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2011.6102437."},{"key":"bibr30-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12632"},{"key":"bibr31-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2016.7465244"},{"key":"bibr32-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2701829"},{"key":"bibr33-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864912"},{"key":"bibr34-14738716231220536","first-page":"727","volume-title":"Proc. int. conf. on machine learning (ICML)","author":"Pelleg D","year":"2000"},{"key":"bibr35-14738716231220536","first-page":"226","volume-title":"KDD\u201996: Proceedings of the second international conference on knowledge discovery and data mining","author":"Ester M","year":"1996"},{"key":"bibr36-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1145\/276304.276314"},{"key":"bibr37-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9574.2008.00412.x"},{"key":"bibr38-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018510926151"},{"key":"bibr39-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1007\/s11634-010-0058-3"},{"key":"bibr40-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2023.3327201"},{"key":"bibr41-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176344136"},{"key":"bibr42-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0197-0"},{"key":"bibr43-14738716231220536","unstructured":"Kuhn M. caret: Classi\ufb01cation and regression training. R package version 60-82. 2019, https:\/\/CRAN.R-project.org\/package=caret"},{"key":"bibr44-14738716231220536","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v028.i05"},{"key":"bibr45-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-012-0295-5"},{"key":"bibr46-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"issue":"10","key":"bibr47-14738716231220536","first-page":"27","volume":"3","author":"Bekkar M","year":"2013","journal-title":"J Inf Eng Appl"},{"key":"bibr48-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0177678"},{"key":"bibr49-14738716231220536","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"bibr50-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"bibr51-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1038\/s41576-018-0088-9"},{"key":"bibr52-14738716231220536","doi-asserted-by":"publisher","DOI":"10.3390\/ijms21062181"},{"key":"bibr53-14738716231220536","first-page":"9","volume":"2017","author":"Han Z","year":"2017","journal-title":"Biomed Res Int"},{"key":"bibr54-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2016.7465281."},{"key":"bibr55-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bty1028"},{"key":"bibr56-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1038\/nature15393"},{"key":"bibr57-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3030365"},{"key":"bibr58-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3189883"},{"key":"bibr59-14738716231220536","first-page":"294","author":"Irshad H","year":"2015","journal-title":"Pac Symp Biocomput"},{"key":"bibr60-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.184"},{"key":"bibr61-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.111"},{"key":"bibr62-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1145\/2442576.2442587"},{"key":"bibr63-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2003.1201189."},{"key":"bibr64-14738716231220536","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2944182"}],"container-title":["Information Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14738716231220536","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/14738716231220536","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14738716231220536","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:19:19Z","timestamp":1777490359000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/14738716231220536"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":64,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["10.1177\/14738716231220536"],"URL":"https:\/\/doi.org\/10.1177\/14738716231220536","relation":{},"ISSN":["1473-8716","1473-8724"],"issn-type":[{"value":"1473-8716","type":"print"},{"value":"1473-8724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]}}}