{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:29:21Z","timestamp":1780054161243,"version":"3.54.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Guangdong Laboratory of Artificial Intelligence and Digital Economy"},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62072316, 62161146005, U2001206"],"award-info":[{"award-number":["62072316, 62161146005, U2001206"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shenzhen Science and Technology Program","award":["20200812104508001, RCJC20200714114435012, JCYJ20210324120213036"],"award-info":[{"award-number":["20200812104508001, RCJC20200714114435012, JCYJ20210324120213036"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:p>We present a novel method for blending hierarchical layouts with semantic labels. The core of our method is a hierarchical structure correspondence algorithm, which recursively finds optimal substructure correspondences, achieving a globally optimal correspondence between a pair of hierarchical layouts. This correspondence is consistent with the structures of both layouts, allowing us to define the union of the layouts' structures. The resulting compound structure helps extract intermediate layout structures, from which blended layouts can be generated via an optimization approach. The correspondence also defines a similarity measure between layouts in a hierarchically structured view. Our method provides a new way for novel layout creation. The introduced structural similarity measure regularizes the layouts in a hyperspace. We demonstrate two applications in this paper, i.e., exploratory design of novel layouts and sketch-based layout retrieval, and test them on a magazine layout dataset. The effectiveness and feasibility of these two applications are confirmed by the user feedback and the extensive results. The code is available at https:\/\/github.com\/lyf7115\/LayoutBlending.<\/jats:p>","DOI":"10.1145\/3550454.3555446","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T21:19:07Z","timestamp":1669843147000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Hierarchical Layout Blending with Recursive Optimal Correspondence"],"prefix":"10.1145","volume":"41","author":[{"given":"Pengfei","family":"Xu","sequence":"first","affiliation":[{"name":"Shenzhen University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yifan","family":"Li","sequence":"additional","affiliation":[{"name":"Shenzhen University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhijin","family":"Yang","sequence":"additional","affiliation":[{"name":"Shenzhen University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiran","family":"Shi","sequence":"additional","affiliation":[{"name":"Shenzhen University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbo","family":"Fu","sequence":"additional","affiliation":[{"name":"City University of Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Huang","sequence":"additional","affiliation":[{"name":"Shenzhen University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,11,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601102"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818088"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13081"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Diego Martin Arroyo Janis Postels and Federico Tombari. 2021. Variational Transformer Networks for Layout Generation. In CVPR. 13642--13652.","DOI":"10.1109\/CVPR46437.2021.01343"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/504704.504705"},{"key":"e_1_2_2_6_1","first-page":"1","article-title":"Generating and exploring good building layouts","volume":"32","author":"Bao Fan","year":"2013","unstructured":"Fan Bao, Dong-Ming Yan, Niloy J Mitra, and Peter Wonka. 2013. Generating and exploring good building layouts. ACM Trans. Graph. 32, 4 (2013), 1--10.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/235815.235821"},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Patrick Baudisch Edward Cutrell Ken Hinckley and Adam Eversole. 2005. Snap-and-go: helping users align objects without the modality of traditional snapping. In CHI. 301--310.","DOI":"10.1145\/1054972.1055014"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/15886.15912"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Alan Borning Kim Marriott Peter Stuckey and Yi Xiao. 1997. Solving linear arithmetic constraints for user interface applications. In UIST. 87--96.","DOI":"10.1145\/263407.263518"},{"key":"e_1_2_2_11_1","volume-title":"VINS: Visual Search for Mobile User Interface Design. In CHI. 1--14.","author":"Bunian Sara","year":"2021","unstructured":"Sara Bunian, Kai Li, Chaima Jemmali, Casper Harteveld, Yun Fu, and Magy Seif Seif El-Nasr. 2021. VINS: Visual Search for Mobile User Interface Design. In CHI. 1--14."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778832"},{"key":"e_1_2_2_14_1","unstructured":"Ga\u00ebl Guennebaud Beno\u00eet Jacob et al. 2010. Eigen v3. http:\/\/eigen.tuxfamily.org."},{"key":"e_1_2_2_15_1","volume-title":"Layouttransformer: Layout generation and completion with self-attention. In ICCV. 1004--1014.","author":"Gupta Kamal","year":"2021","unstructured":"Kamal Gupta, Justin Lazarow, Alessandro Achille, Larry S Davis, Vijay Mahadevan, and Abhinav Shrivastava. 2021. Layouttransformer: Layout generation and completion with self-attention. In ICCV. 1004--1014."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392391"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300334"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1731309.1731330"},{"key":"e_1_2_2_19_1","volume-title":"Exploring shape variations by 3d-model decomposition and part-based recombination. Comput. Graph. Forum 31, 2pt3","author":"Jain Arjun","year":"2012","unstructured":"Arjun Jain, Thorsten Thorm\u00e4hlen, Tobias Ritschel, and Hans-Peter Seidel. 2012. Exploring shape variations by 3d-model decomposition and part-based recombination. Comput. Graph. Forum 31, 2pt3 (2012), 631--640."},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Yue Jiang Ruofei Du Christof Lutteroth and Wolfgang Stuerzlinger. 2019. ORC layout: Adaptive GUI layout with OR-constraints. In CHI. 1--12.","DOI":"10.1145\/3290605.3300643"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Yue Jiang Wolfgang Stuerzlinger and Christof Lutteroth. 2021. ReverseORC: Reverse Engineering of Resizable User Interface Layouts with OR-Constraints. In CHI. 1--18.","DOI":"10.1145\/3411764.3445043"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Yue Jiang Wolfgang Stuerzlinger Matthias Zwicker and Christof Lutteroth. 2020. ORCSolver: An Efficient Solver for Adaptive GUI Layout with OR-Constraints. In CHI. 1--14.","DOI":"10.1145\/3313831.3376610"},{"key":"e_1_2_2_23_1","volume-title":"Layoutvae: Stochastic scene layout generation from a label set. In ICCV. 9895--9904.","author":"Jyothi Akash Abdu","year":"2019","unstructured":"Akash Abdu Jyothi, Thibaut Durand, Jiawei He, Leonid Sigal, and Greg Mori. 2019. Layoutvae: Stochastic scene layout generation from a label set. In ICCV. 9895--9904."},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2185520.2185551","article-title":"A probabilistic model for component-based shape synthesis","volume":"31","author":"Kalogerakis Evangelos","year":"2012","unstructured":"Evangelos Kalogerakis, Siddhartha Chaudhuri, Daphne Koller, and Vladlen Koltun. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. 31, 4 (2012), 1--11.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Youwen Kang Zhida Sun Sitong Wang Zeyu Huang Ziming Wu and Xiaojuan Ma. 2021. MetaMap: Supporting Visual Metaphor Ideation through Multi-dimensional Example-based Exploration. In CHI. 1--15.","DOI":"10.1145\/3411764.3445325"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475497"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818116"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Janin Koch and Antti Oulasvirta. 2016. Computational layout perception using gestalt laws. In CHI Extended Abstracts. 1423--1429.","DOI":"10.1145\/2851581.2892537"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/nav.3800020109"},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Ranjitha Kumar Jerry O Talton Salman Ahmad and Scott R Klemmer. 2011. Bricolage: example-based retargeting for web design. In CHI. 2197--2206.","DOI":"10.1145\/1978942.1979262"},{"key":"e_1_2_2_31_1","volume-title":"Neural design network: Graphic layout generation with constraints","author":"Lee Hsin-Ying","unstructured":"Hsin-Ying Lee, Lu Jiang, Irfan Essa, Phuong B Le, Haifeng Gong, Ming-Hsuan Yang, and Weilong Yang. 2020. Neural design network: Graphic layout generation with constraints. In ECCV. Springer, 491--506."},{"key":"e_1_2_2_32_1","volume-title":"Layout-GAN: Generating Graphic Layouts with Wireframe Discriminators. In International Conference on Learning Representations.","author":"Li Jianan","year":"2019","unstructured":"Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, and Tingfa Xu. 2019b. Layout-GAN: Generating Graphic Layouts with Wireframe Discriminators. In International Conference on Learning Representations."},{"key":"e_1_2_2_33_1","first-page":"1","article-title":"Grains: Generative recursive autoencoders for indoor scenes","volume":"38","author":"Li Manyi","year":"2019","unstructured":"Manyi Li, Akshay Gadi Patil, Kai Xu, Siddhartha Chaudhuri, Owais Khan, Ariel Shamir, Changhe Tu, Baoquan Chen, Daniel Cohen-Or, and Hao Zhang. 2019a. Grains: Generative recursive autoencoders for indoor scenes. ACM Trans. Graph. 38, 2 (2019), 1--16.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_2_35_1","volume-title":"Learning structural similarity of user interface layouts using graph networks","author":"Manandhar Dipu","unstructured":"Dipu Manandhar, Dan Ruta, and John Collomosse. 2020. Learning structural similarity of user interface layouts using graph networks. In ECCV. Springer, 730--746."},{"key":"e_1_2_2_36_1","volume-title":"Read: Recursive autoencoders for document layout generation. In CVPR. 544--545.","author":"Patil Akshay Gadi","year":"2020","unstructured":"Akshay Gadi Patil, Omri Ben-Eliezer, Or Perel, and Hadar Averbuch-Elor. 2020. Read: Recursive autoencoders for document layout generation. In CVPR. 544--545."},{"key":"e_1_2_2_37_1","unstructured":"Akshay Gadi Patil Manyi Li Matthew Fisher Manolis Savva and Hao Zhang. 2021. LayoutGMN: Neural Graph Matching for Structural Layout Similarity. In CVPR. 11048--11057."},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Roope Raisamo and Kari-Jouko R\u00e4ih\u00e4. 1996. A new direct manipulation technique for aligning objects in drawing programs. In UIST. 157--164.","DOI":"10.1145\/237091.237113"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/965161.806814"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1778765.1778796","article-title":"2.5 D cartoon models","volume":"29","author":"Rivers Alec","year":"2010","unstructured":"Alec Rivers, Takeo Igarashi, and Fr\u00e9do Durand. 2010. 2.5 D cartoon models. ACM Trans. Graph. 29, 4 (2010), 1--7.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2008.2005605"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68474-1_11"},{"key":"e_1_2_2_43_1","doi-asserted-by":"crossref","unstructured":"Wolfgang Stuerzlinger Olivier Chapuis Dusty Phillips and Nicolas Roussel. 2006. User interface fa\u00e7ades: towards fully adaptable user interfaces. In UIST. 309--318.","DOI":"10.1145\/1166253.1166301"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306214.3338574"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073209"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559755.1559760"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356556"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702198"},{"key":"e_1_2_2_49_1","volume-title":"Global Beautification of 2D and 3D Layouts with Interactive Ambiguity Resolution","author":"Xu Pengfei","year":"2019","unstructured":"Pengfei Xu, Guohang Yan, Hongbo Fu, Takeo Igarashi, Chiew-Lan Tai, and Hui Huang. 2019. Global Beautification of 2D and 3D Layouts with Interactive Ambiguity Resolution. IEEE TVCG (2019)."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1137\/0218082"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322971"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2019.00166"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3095815"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555446","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550454.3555446","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:11Z","timestamp":1750182551000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":53,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1145\/3550454.3555446"],"URL":"https:\/\/doi.org\/10.1145\/3550454.3555446","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,30]]},"assertion":[{"value":"2022-11-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}