{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T02:29:35Z","timestamp":1772591375516,"version":"3.50.1"},"reference-count":78,"publisher":"Oxford University Press (OUP)","issue":"5-6","license":[{"start":{"date-parts":[[2020,9,1]],"date-time":"2020-09-01T00:00:00Z","timestamp":1598918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"publisher","award":["291556"],"award-info":[{"award-number":["291556"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"publisher","award":["310947"],"award-info":[{"award-number":["310947"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,9,29]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Designers are increasingly using online resources for inspiration. How to best support design exploration without compromising creativity? We introduce and study Design Maps, a class of point-cloud visualizations that makes large user interface datasets explorable. Design Maps are computed using dimensionality reduction and clustering techniques, which we analyze thoroughly in this paper. We present concepts for integrating Design Maps into design tools, including interactive visualization, local neighborhood exploration and functionality to integrate existing solutions to the design at hand. These concepts were implemented in a wireframing tool for mobile apps, which was evaluated with actual designers performing realistic tasks. Overall, designers find Design Maps supporting their creativity (avg. CSI score of 74\/100) and indicate that the maps producing consistent whitespacing within cloud points are the most informative ones.<\/jats:p>","DOI":"10.1093\/iwcomp\/iwab006","type":"journal-article","created":{"date-parts":[[2021,3,29]],"date-time":"2021-03-29T15:06:23Z","timestamp":1617030383000},"page":"490-509","source":"Crossref","is-referenced-by-count":7,"title":["Interactive Exploration of Large-Scale UI Datasets with Design Maps"],"prefix":"10.1093","volume":"32","author":[{"given":"Luis A","family":"Leiva","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Luxembourg, 6, avenue de la Fonte, L-4365 Esch-sur-Alzette, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Asutosh","family":"Hota","sequence":"additional","affiliation":[{"name":"Department of Communications and Networking, Aalto University, Konemiehentie 2, FI-00076 Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antti","family":"Oulasvirta","sequence":"additional","affiliation":[{"name":"Department of Communications and Networking, Aalto University, Konemiehentie 2, FI-00076 Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,3,26]]},"reference":[{"key":"2021070808095767900_ref1","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"WIREs Comput. Stat."},{"key":"2021070808095767900_ref2","article-title":"ISODATA, A Novel Method of Data Analysis and Pattern Classification","author":"Ball","year":"1965"},{"key":"2021070808095767900_ref3","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1145\/3197231.3197244","article-title":"GUIfetch: Supporting app design and development through GUI search","volume-title":"Proc. MOBILESoft","author":"Behrang","year":"2018"},{"key":"2021070808095767900_ref4","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1080\/10463281003765323","article-title":"The dual pathway to creativity model: Creative ideation as a function of flexibility and persistence","volume":"21","author":"Nijstad","year":"2010","journal-title":"Eur. Rev. Soc. Psychol."},{"key":"2021070808095767900_ref5","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-77525-8_109","volume-title":"Big Data Visualization Tools","author":"Bikakis","year":"2019"},{"key":"2021070808095767900_ref6","volume-title":"Pattern Recognition and Machine Learning","author":"Bishop","year":"2006"},{"key":"2021070808095767900_ref7","first-page":"92","article-title":"The structure of the information visualization design space","volume-title":"Proc. InfoVis","author":"Card","year":"1997"},{"key":"2021070808095767900_ref8","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.destud.2014.08.001","article-title":"Do the best design ideas (really) come from conceptually distant sources of inspiration?","volume":"36","author":"Chan","year":"2015","journal-title":"Design Stud."},{"key":"2021070808095767900_ref9","first-page":"93","article-title":"Semantically far inspirations considered harmful?: Accounting for cognitive states in collaborative ideation","volume-title":"Proc. C&C","author":"Chan","year":"2017"},{"key":"2021070808095767900_ref10","doi-asserted-by":"crossref","first-page":"21:1","DOI":"10.1145\/2617588","article-title":"Quantifying the creativity support of digital tools through the creativity support index","volume":"21","author":"Cherry","year":"2014","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"2021070808095767900_ref11","volume-title":"Early and Repeated Exposure to Examples Improves Creative Work","author":"Chinmay Kulkarni","year":"2010"},{"key":"2021070808095767900_ref12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.destud.2017.02.001","article-title":"Where next for research on fixation, inspiration and creativity in design?","volume":"50","author":"Crilly","year":"2017","journal-title":"Design Stud."},{"key":"2021070808095767900_ref13","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","article-title":"A cluster separation measure","volume":"1","author":"Davies","year":"1979","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2021070808095767900_ref14","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.destud.2017.04.002","article-title":"Novice designers\u2019 use of prototypes in engineering design","volume":"51","author":"Deininger","year":"2017","journal-title":"Design Stud."},{"key":"2021070808095767900_ref15","first-page":"845","article-title":"Rico: A mobile app dataset for building data-driven design applications","volume-title":"Proc. UIST","author":"Deka","year":"2017"},{"key":"2021070808095767900_ref16","volume-title":"Pattern Classification and Scene Analysis","author":"Duda","year":"1973"},{"key":"2021070808095767900_ref17","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1016\/S0142-694X(00)00022-3","article-title":"Sources of inspiration: A language of design","volume":"21","author":"Eckert","year":"2000","journal-title":"Design Stud."},{"key":"2021070808095767900_ref18","first-page":"899","article-title":"Visualization of multidimensional design and optimization data using cloud visualization","volume-title":"Proc. DAC","author":"Eddy","year":"2002"},{"key":"2021070808095767900_ref19","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.destud.2016.09.001","article-title":"Dynagrams: Enhancing design thinking through dynamic diagrams","volume":"47","author":"Eppler","year":"2016","journal-title":"Design Stud."},{"key":"2021070808095767900_ref20","first-page":"57","article-title":"Problem interpretation and resolution via visual stimuli: The use of \u2018mood boards\u2019 in design education","volume":"20","author":"Garner","year":"2001","journal-title":"Int. J. Art Des. Educ."},{"key":"2021070808095767900_ref21","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-03129-8_3","volume-title":"Analogical Processes in Human Thinking and Learning","author":"Gentner","year":"2010"},{"key":"2021070808095767900_ref22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0010-0285(83)90002-6","article-title":"Schema induction and analogical transfer","volume":"15","author":"Gick","year":"1983","journal-title":"Cogn. Psychol."},{"key":"2021070808095767900_ref23","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1016\/j.knosys.2006.04.006","article-title":"The importance of retrieval in creative design analogies","volume":"19","author":"Gomes","year":"2006","journal-title":"Knowl.-Based Syst."},{"key":"2021070808095767900_ref24","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.destud.2013.09.001","article-title":"What inspires designers? Preferences on inspirational approaches during idea generation","volume":"35","author":"Gon\u00e7alves","year":"2014","journal-title":"Design Stud."},{"key":"2021070808095767900_ref25","volume-title":"Clustering Algorithms","author":"Hartigan","year":"1975"},{"key":"2021070808095767900_ref26","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1145\/1449715.1449732","article-title":"Design as exploration: Creating interface alternatives through parallel authoring and runtime tuning","volume-title":"Proc. UIST","author":"Hartmann","year":"2008"},{"key":"2021070808095767900_ref27","first-page":"87","article-title":"Getting inspired!: Understanding how and why examples are used in creative design practice","volume-title":"Proc. CHI","author":"Herring","year":"2009"},{"key":"2021070808095767900_ref28","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1037\/0022-0663.71.2.191","article-title":"Ideational fluency as a confounding factor in the measurement of originality","volume":"71","author":"Hocevar","year":"1979","journal-title":"J. Educ. Psychol."},{"key":"2021070808095767900_ref29","first-page":"53","article-title":"A taxonomy and critique of measurements used in the study of creativity. Handbook of Creativity","author":"Hocevar","year":"1989"},{"key":"2021070808095767900_ref30","first-page":"1","article-title":"Swire: Sketch-based user interface retrieval","volume-title":"Proc. CHI","author":"Huang","year":"2019"},{"key":"2021070808095767900_ref31","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1145\/1719970.1719982","article-title":"Tell me more, not just more of the same","volume-title":"Proc. IUI","author":"Iacobelli","year":"2010"},{"key":"2021070808095767900_ref32","first-page":"352","article-title":"Designing interactive spatiotemporal visualizations to enhance movie browsing","volume-title":"Proc. INTERACT","author":"Jorge","year":"2017"},{"key":"2021070808095767900_ref33","first-page":"606:1","article-title":"Paragon: An online gallery for enhancing design feedback with visual examples","volume-title":"Proc. CHI","author":"Kang","year":"2018"},{"key":"2021070808095767900_ref34","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.destud.2008.06.001","article-title":"Collecting with cabinet: Or how designers organise visual material, researched through an experiential prototype","volume":"30","author":"Keller","year":"2009","journal-title":"Design Stud."},{"key":"2021070808095767900_ref35","first-page":"292","article-title":"Music mood classification model based on arousal-valence values","volume-title":"Proc. ICACT","author":"Kim","year":"2011"},{"key":"2021070808095767900_ref36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1115\/1.4033987","article-title":"Cityplot: Visualization of high-dimensional design spaces with multiple criteria","volume":"138","author":"Knerr","year":"2016","journal-title":"J. Mech. Des."},{"key":"2021070808095767900_ref37","first-page":"1247","article-title":"Surfing for Inspiration: Digital Inspirational Material in Design Practice","volume-title":"Design Research Society 2018 Catalyst (DRS2018)","author":"Koch","year":"2018"},{"key":"2021070808095767900_ref38","first-page":"3083","article-title":"Webzeitgeist: Design mining the web","volume-title":"Proc. CHI","author":"Kumar","year":"2013"},{"key":"2021070808095767900_ref39","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.destud.2004.05.001","article-title":"Schemata, gambits and precedent: Some factors in design expertise","volume":"25","author":"Lawson","year":"2004","journal-title":"Design Stud."},{"key":"2021070808095767900_ref40","first-page":"2257","article-title":"Designing with interactive example galleries","volume-title":"Proc. CHI","author":"Lee","year":"2010"},{"key":"2021070808095767900_ref41","first-page":"1","article-title":"GUIComp: A GUI design assistant with real-time, multi-faceted feedback","volume-title":"Proc. CHI","author":"Lee","year":"2020"},{"key":"2021070808095767900_ref42","article-title":"Enrico: A high-quality dataset for topic modeling of mobile UI designs","volume-title":"Proc. MobileHCI extended abstracts","author":"Leiva","year":"2020"},{"key":"2021070808095767900_ref43","first-page":"277","article-title":"Assessing users\u2019 interactions for clustering web documents: A pragmatic approach","volume-title":"Proc. HT","author":"Leiva","year":"2010"},{"key":"2021070808095767900_ref44","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1177\/0013916584142006","article-title":"You-are-here maps: Psychological considerations","volume":"14","author":"Levine","year":"1982","journal-title":"Environ. Behav."},{"key":"2021070808095767900_ref45","first-page":"569","article-title":"Learning design semantics for mobile apps","volume-title":"Proc. UIST","author":"Liu","year":"2018"},{"key":"2021070808095767900_ref46","first-page":"911","article-title":"Understanding of internal clustering validation measures","volume-title":"Proc. ICDM","author":"Liu","year":"2010"},{"key":"2021070808095767900_ref47","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"2021070808095767900_ref48","first-page":"195","article-title":"Adaptive multimodal exploration of music collections","volume-title":"Proc. ISMIR","author":"L\u00fcbbers","year":"2009"},{"key":"2021070808095767900_ref49","first-page":"389","article-title":"Design galleries: A general approach to setting parameters for computer graphics and animation","volume-title":"Proc. SIGGRAPH","author":"Marks","year":"1997"},{"key":"2021070808095767900_ref50","first-page":"133","article-title":"MovieClouds: Content-based overviews and exploratory browsing of movies","volume-title":"Proc. MindTrek","author":"Martins","year":"2011"},{"key":"2021070808095767900_ref51","first-page":"369:1","article-title":"Dream Lens: Exploration and visualization of large-scale generative design datasets","volume-title":"Proc. CHI","author":"Matejka","year":"2018"},{"key":"2021070808095767900_ref52","article-title":"UMAP: Uniform manifold approximation and projection for dimension reduction","volume-title":"J. Open Source Softw","author":"McInnes","year":"2018"},{"key":"2021070808095767900_ref53","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1177\/0018720814541145","article-title":"Display clutter: A review of definitions and measurement techniques","author":"Moacdieh","year":"2015","journal-title":"Hum. Factors 57"},{"key":"2021070808095767900_ref54","volume-title":"Designing Interactions","author":"Moggridge","year":"2006"},{"key":"2021070808095767900_ref55","first-page":"2904","article-title":"Trust, but verify: Optimistic visualizations of approximate queries for exploring big data","volume-title":"Proc. CHI","author":"Moritz","year":"2017"},{"key":"2021070808095767900_ref56","first-page":"1221","article-title":"DesignScape: Design with interactive layout suggestions","volume-title":"Proc. CHI","author":"O\u2019Donovan","year":"2015"},{"key":"2021070808095767900_ref57","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780195066661.001.0001","volume-title":"Mental Representations: A Dual Coding Approach","author":"Paivio","year":"1990"},{"key":"2021070808095767900_ref58","first-page":"570","article-title":"Content-based organization and visualization of music archives","volume-title":"Proc. MM","author":"Pampalk","year":"2002"},{"key":"2021070808095767900_ref59","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1080\/09544820600679679","article-title":"The idea exposure paradigm in design idea generation","volume":"18","author":"Perttula","year":"2007","journal-title":"J. Eng. Design"},{"key":"2021070808095767900_ref60","first-page":"857","article-title":"Visually exploring a design space through the use of multiple contextual self-organizing maps","volume-title":"Proc. DAC","author":"Richardson","year":"2011"},{"key":"2021070808095767900_ref61","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"2021070808095767900_ref62","first-page":"2367","article-title":"Understanding knowledge management practices for early design activity and its implications for reuse","volume-title":"Proc. CHI","author":"Sharmin","year":"2009"},{"key":"2021070808095767900_ref63","first-page":"336","article-title":"The eyes have it: A task by data type taxonomy for information visualizations","volume-title":"Proc. IEEE symposium on visual languages","author":"Shneiderman","year":"1996"},{"key":"2021070808095767900_ref64","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1145\/2757226.2757230","article-title":"Providing timely examples improves the quantity and quality of generated ideas","volume-title":"Proc. C&C","author":"Siangliulue","year":"2015"},{"key":"2021070808095767900_ref65","first-page":"55","article-title":"The nature of design practice and implications for interaction design research","volume":"2","author":"Stolterman","year":"2008","journal-title":"Int. J. Des."},{"key":"2021070808095767900_ref66","first-page":"504:1","article-title":"Rewire: Interface design assistance from examples","volume-title":"Proc. CHI","author":"Swearngin","year":"2018"},{"key":"2021070808095767900_ref67","first-page":"134","article-title":"Scout: Mixed-initiative exploration of design variations through high-level design constraints","volume-title":"Adj. Proc. UIST","author":"Swearngin","year":"2018"},{"key":"2021070808095767900_ref68","first-page":"1243","article-title":"Getting the right design and the design right","volume-title":"Proc. CHI","author":"Tohidi","year":"2006"},{"key":"2021070808095767900_ref69","first-page":"134","article-title":"Design and evaluation of a probabilistic music projection interface","volume-title":"Proc. ISMIR (International Society for Music Information Retrieval)","author":"Vad","year":"2015"},{"key":"2021070808095767900_ref70","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"van der Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"2021070808095767900_ref71","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.destud.2015.11.001","article-title":"Inspiration and fixation: Questions, methods, findings, and challenges","volume":"42","author":"Vasconcelos","year":"2016","journal-title":"Design Stud."},{"key":"2021070808095767900_ref72","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1109\/TPAMI.2002.1033218","article-title":"A maximum variance cluster algorithm","volume":"24","author":"Veenman","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2021070808095767900_ref73","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1080\/1470329032000103816","article-title":"Enhancing scientific essay writing using peer assessment","volume":"40","author":"Venables","year":"2003","journal-title":"Innov. Educ. Teach. Int."},{"key":"2021070808095767900_ref74","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3415243","article-title":"Sketchy: Drawing inspiration from the crowd","volume":"4","author":"Wallace","year":"2020","journal-title":"Proc. ACM Hum.-Comput. Interact"},{"key":"2021070808095767900_ref75","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.destud.2017.05.001","article-title":"Interactive design galleries: A general approach to interacting with design alternatives","volume":"52","author":"Woodbury","year":"2017","journal-title":"Design Stud."},{"key":"2021070808095767900_ref76","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/09544828.2010.487260","article-title":"Supporting knowledge exploration and discovery in multi-dimensional data with interactive multiscale visualisation","volume":"23","author":"Zhang","year":"2012","journal-title":"J. Eng. Des."},{"key":"2021070808095767900_ref77","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.datak.2014.07.008","article-title":"WB-index: A sum-of-squares based index for cluster validity","volume":"92","author":"Zhao","year":"2014","journal-title":"Data Knowl. Eng."},{"key":"2021070808095767900_ref78","first-page":"1058","article-title":"Perceptual visualization of a music collection","volume-title":"Proc. ICME","author":"Zhu","year":"2005"}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/32\/5-6\/490\/38856879\/iwab006.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/32\/5-6\/490\/38856879\/iwab006.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,27]],"date-time":"2024-08-27T01:43:28Z","timestamp":1724723008000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article\/32\/5-6\/490\/6190179"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9]]},"references-count":78,"journal-issue":{"issue":"5-6","published-online":{"date-parts":[[2021,3,26]]},"published-print":{"date-parts":[[2020,9,29]]}},"URL":"https:\/\/doi.org\/10.1093\/iwcomp\/iwab006","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"value":"0953-5438","type":"print"},{"value":"1873-7951","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,9]]},"published":{"date-parts":[[2020,9]]}}}