{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T14:24:36Z","timestamp":1781619876704,"version":"3.54.5"},"reference-count":99,"publisher":"Association for Computing Machinery (ACM)","issue":"EICS","license":[{"start":{"date-parts":[[2021,5,27]],"date-time":"2021-05-27T00:00:00Z","timestamp":1622073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Tutk.ryhm\u00e4 Oulasvirta","award":["9170320"],"award-info":[{"award-number":["9170320"]}]},{"DOI":"10.13039\/501100002666","name":"Aalto University","doi-asserted-by":"crossref","award":["FI22283574"],"award-info":[{"award-number":["FI22283574"]}],"id":[{"id":"10.13039\/501100002666","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,5,27]]},"abstract":"<jats:p>Graphical user interfaces (GUIs) have gained primacy among the means of interacting with computing systems, thanks to the way they leverage human perceptual and motor capabilities. However, the design of GUIs has mostly been a manual activity. To design a GUI, the designer must select its visual, spatial, textual, and interaction properties such that the combination strikes a balance among the relevant human factors. While emerging computational-design techniques have addressed some problems related to grid layouts, no general approach has been proposed that can also produce good and complete results covering color-related decisions and other nonlinear design objectives. Evolutionary algorithms are promising and demonstrate good handling of similar problems in other conditions, genetic operators, depending on how they are designed. But even these approaches struggle with elements' overlap and hence produce too many infeasible candidate solutions. This paper presents a new approach based on grid-based genetic operators demonstrated in a non-dominated sorting genetic algorithm (NSGA-III) setting. The operators use grid lines for element positions in a novel manner to satisfy overlap-related constraints and intrinsically improve the alignment of elements. This approach can be used for crossovers and mutations. Its core benefit is that all the solutions generated satisfy the no-overlap requirement and represent well-formed layouts. The new operators permit using genetic algorithms for increasingly realistic task instances, responding to more design objectives than could be considered before. Specifically, we address grid quality, alignment, selection time, clutter minimization, saliency control, color harmony, and grouping of elements.<\/jats:p>","DOI":"10.1145\/3461730","type":"journal-article","created":{"date-parts":[[2021,5,30]],"date-time":"2021-05-30T01:12:52Z","timestamp":1622337172000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Grid-based Genetic Operators for Graphical Layout Generation"],"prefix":"10.1145","volume":"5","author":[{"given":"Morteza","family":"Shiripour","sequence":"first","affiliation":[{"name":"Aalto university, Helsinki, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niraj Ramesh","family":"Dayama","sequence":"additional","affiliation":[{"name":"Aalto University, Helsinki, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antti","family":"Oulasvirta","sequence":"additional","affiliation":[{"name":"Aalto University, Helsinki, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,5,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2010.07.006"},{"key":"e_1_2_1_2_1","volume-title":"Multiple objective ant colony optimisation. Swarm intelligence 3, 1","author":"Angus Daniel","year":"2009"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985795"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.9.2.294"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","volume-title":"Recent Advances in Evolutionary Multi-objective Optimization","author":"Bechikh Slim","DOI":"10.1007\/978-3-319-42978-6"},{"key":"e_1_2_1_6_1","volume-title":"Machine learning for combinatorial optimization: a methodological tour d'horizon. European Journal of Operational Research","author":"Bengio Yoshua","year":"2020"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/15922.15912"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2933242.2935874"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compchemeng.2005.07.012"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2016.10.016"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-017-0039-7"},{"key":"e_1_2_1_13_1","volume-title":"Principles of colour and appearance measurement: Object appearance, colour perception and instrumental measurement","author":"Roy Choudhury Asim Kumar"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-017-2965-0"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-005-6164-x"},{"key":"e_1_2_1_16_1","volume-title":"Handbook of combinatorial optimization","author":"Coffman Edward G"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141933"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","volume-title":"Multiobjective optimization: principles and case studies","author":"Collette Yann","DOI":"10.1007\/978-3-662-08883-8"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/2835567.2835569"},{"key":"e_1_2_1_20_1","volume-title":"Expertise in design: an overview. Design studies 25, 5","author":"Cross Nigel","year":"2004"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.08.005"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2021.102624"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376553"},{"key":"e_1_2_1_24_1","volume-title":"Search methodologies","author":"Deb Kalyanmoy"},{"key":"e_1_2_1_25_1","volume-title":"An evolutionary many-objective optimization algorithm using referencepoint- based nondominated sorting approach, part I: solving problems with box constraints","author":"Deb Kalyanmoy","year":"2013"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_1_27_1","first-page":"124","article-title":"Method and system for computer screen layout based on a recombinant geometric modular structure","volume":"7","author":"Drenttel William","year":"2006","journal-title":"US Patent"},{"key":"e_1_2_1_28_1","volume-title":"Lamjed Ben Said, and Rituparna Datta","author":"Elarbi Maha","year":"2017"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_2"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"David B Fogel. 1997. The Advantages of Evolutionary Computation.  David B Fogel. 1997. The Advantages of Evolutionary Computation.","DOI":"10.1201\/9781420050387"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2503311"},{"key":"e_1_2_1_32_1","volume-title":"ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference","author":"Foster Garrett"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979177"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/964442.964461"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/800119.803884"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2933242.2935875"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822018.1822030"},{"key":"e_1_2_1_38_1","volume-title":"The psychology of perception: A philosophical examination of Gestalt theory and derivative theories of perception","author":"Hamlyn David Walter"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/1007746"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/int.10091"},{"key":"e_1_2_1_41_1","volume-title":"Genetic algorithms. Scientific american 267, 1","author":"Holland John H","year":"1992"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-017-0895-8"},{"key":"e_1_2_1_43_1","unstructured":"Allen Hurlburt. 1978. The grid: A modular system for the design and production of newspapers magazines.  Allen Hurlburt. 1978. The grid: A modular system for the design and production of newspapers magazines."},{"key":"e_1_2_1_44_1","volume-title":"Trade-off between exploration and exploitation with genetic algorithm using a novel selection operator. Complex & Intelligent Systems","author":"Hussain Abid","year":"2019"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2008.4631121"},{"key":"e_1_2_1_46_1","volume-title":"A saliency-based search mechanism for overt and covert shifts of visual attention. Vision research 40, 10--12","author":"Itti Laurent","year":"2000"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281534"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376610"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2007.02.015"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.02.047"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-7177(03)90129-4"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2010.01.008"},{"key":"e_1_2_1_53_1","volume-title":"Multi-objective optimization in theory and practice i: classical methods","author":"Keller Andr\u00e9 A"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/1760102.1760134"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","volume-title":"Principles of Gestalt psychology","author":"Koffka Kurt","DOI":"10.4324\/9781315009292"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1080\/00207541003614371"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.9.4.586"},{"key":"e_1_2_1_58_1","volume-title":"Neural Design Network: Graphic Layout Generation with Constraints. arXiv preprint arXiv:1912.09421","author":"Lee Hsin-Ying","year":"2019"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2792984"},{"key":"e_1_2_1_60_1","volume-title":"Layoutgan: Generating graphic layouts with wireframe discriminators. arXiv preprint arXiv:1901.06767","author":"Li Jianan","year":"2019"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.2999335"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/964442.964462"},{"key":"e_1_2_1_63_1","volume-title":"Thinking with type: A critical guide for designers, writers","author":"Lupton Ellen"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0701_3"},{"key":"e_1_2_1_65_1","volume-title":"Handbook of human-computer interaction","author":"Marcus Aaron"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822018.1822032"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025718"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576768.2598366"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.1999.823287"},{"key":"e_1_2_1_70_1","unstructured":"Douglas C Montgomery. 2017. Design and analysis of experiments. John wiley & sons.  Douglas C Montgomery. 2017. Design and analysis of experiments. John wiley & sons."},{"key":"e_1_2_1_71_1","volume-title":"I De La Iglesia, and A Perallos","author":"Osaba E","year":"2014"},{"key":"e_1_2_1_72_1","volume-title":"Morteza Shiripour, Maximilian John, and Andreas Karrenbauer.","author":"Oulasvirta Antti","year":"2020"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481383"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2016.07.022"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbef.2017.12.004"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.10.004"},{"key":"e_1_2_1_77_1","volume-title":"Multiobjective programming and goal programming","author":"Poles Silvia"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.12.015"},{"key":"e_1_2_1_79_1","volume-title":"CA Coello Coello, et al","author":"Reyes-Sierra Margarita","year":"2006"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLEI.2015.7360024"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican1290-84"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1167\/7.2.17"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/800256.810696"},{"key":"e_1_2_1_84_1","volume-title":"Advances in Stochastic and Deterministic Global Optimization","author":"Ingrida"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/59.982197"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376593"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.11.007"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901817"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1080\/0740817X.2015.1019161"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0167.51.4.473"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.123.4.394"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647398"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/1570433.1570481"},{"key":"e_1_2_1_94_1","volume-title":"Nature-inspired optimization algorithms","author":"Yang Xin-She"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enconman.2015.03.009"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI172&3_4"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322971"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2011.03.001"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.10.030"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.797969"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461730","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461730","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:06Z","timestamp":1750191426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461730"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,27]]},"references-count":99,"journal-issue":{"issue":"EICS","published-print":{"date-parts":[[2021,5,27]]}},"alternative-id":["10.1145\/3461730"],"URL":"https:\/\/doi.org\/10.1145\/3461730","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,27]]},"assertion":[{"value":"2021-05-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}