{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T14:44:27Z","timestamp":1775054667767,"version":"3.50.1"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA","license":[{"start":{"date-parts":[[2018,10,24]],"date-time":"2018-10-24T00:00:00Z","timestamp":1540339200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2018,10,24]]},"abstract":"<jats:p>We present a novel approach for synthesizing robust relational layouts from examples. Given an application design consisting of a set of views and their location on the screen, we synthesize a relational layout that when rendered, places the components at that same location.<\/jats:p>\n          <jats:p>We present an end-to-end system, called InferUI, that addresses the above challenge in the context of Android. The system is based on the following technical contributions: (i) a formalization of the latest and most efficient ConstraintLayout class, capturing a rich set of relational constraints, (ii) a set of robustness properties designed to prevent common layout generalization errors, (iii) a synthesis algorithm that produces relational layouts that generalize across multiple screen sizes and resolutions, and (iv) a probabilistic model of constraints that guides the synthesizer towards layouts preferred by developers.<\/jats:p>\n          <jats:p>Our evaluation shows that InferUI is practically effective: it successfully synthesizes real world complex layouts obtained from top 500 GitHub and top 500 Google Play Store applications, succeeds in 100% of the cases when synthesizing layouts for a single device, and correctly generalizes 92% of the views across multiple devices, all without requiring additional specifications.<\/jats:p>","DOI":"10.1145\/3276526","type":"journal-article","created":{"date-parts":[[2018,10,24]],"date-time":"2018-10-24T11:57:18Z","timestamp":1540382238000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Robust relational layout synthesis from examples for Android"],"prefix":"10.1145","volume":"2","author":[{"given":"Pavol","family":"Bielik","sequence":"first","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Fischer","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Vechev","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,10,24]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786849"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3212695"},{"key":"e_1_2_2_3_1","unstructured":"Amigo. 2018. Amigo. https:\/\/play.google.com\/store\/apps\/details?id=com.amigotrip.android  Amigo. 2018. Amigo. https:\/\/play.google.com\/store\/apps\/details?id=com.amigotrip.android"},{"key":"e_1_2_2_4_1","unstructured":"Asobimasu. 2018. Asobimasu. https:\/\/github.com\/DipanshKhandelwal\/Asobimasu  Asobimasu. 2018. Asobimasu. https:\/\/github.com\/DipanshKhandelwal\/Asobimasu"},{"key":"e_1_2_2_5_1","volume-title":"5th International Conference on Learning Representations (ICLR \u201917)","author":"Balog Matej","year":"2017","unstructured":"Matej Balog , Alexander L Gaunt , Marc Brockschmidt , Sebastian Nowozin , and Daniel Tarlow . 2017 . DeepCoder: Learning to write programs . In 5th International Conference on Learning Representations (ICLR \u201917) . Matej Balog, Alexander L Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2017. DeepCoder: Learning to write programs. In 5th International Conference on Learning Representations (ICLR \u201917)."},{"key":"e_1_2_2_6_1","volume-title":"pix2code: Generating Code from a Graphical User Interface Screenshot. CoRR abs\/1705.07962","author":"Beltramelli Tony","year":"2017","unstructured":"Tony Beltramelli . 2017. pix2code: Generating Code from a Graphical User Interface Screenshot. CoRR abs\/1705.07962 ( 2017 ). arXiv: 1705.07962 http:\/\/arxiv.org\/abs\/1705.07962 Tony Beltramelli. 2017. pix2code: Generating Code from a Graphical User Interface Screenshot. CoRR abs\/1705.07962 (2017). arXiv: 1705.07962 http:\/\/arxiv.org\/abs\/1705.07962"},{"key":"e_1_2_2_7_1","volume-title":"Proceedings of The 33rd International Conference on Machine Learning (ICML \u201916)","volume":"48","author":"Bielik Pavol","year":"2016","unstructured":"Pavol Bielik , Veselin Raychev , and Martin Vechev . 2016 . PHOG: Probabilistic Model for Code . In Proceedings of The 33rd International Conference on Machine Learning (ICML \u201916) , Vol. 48 . PMLR, New York, NY, USA, 2933\u20132942. Pavol Bielik, Veselin Raychev, and Martin Vechev. 2016. PHOG: Probabilistic Model for Code. In Proceedings of The 33rd International Conference on Machine Learning (ICML \u201916) , Vol. 48. PMLR, New York, NY, USA, 2933\u20132942."},{"key":"e_1_2_2_8_1","unstructured":"Candid. 2018. Candid. https:\/\/play.google.com\/store\/apps\/details?id=in.voiceme.app.voiceme  Candid. 2018. Candid. https:\/\/play.google.com\/store\/apps\/details?id=in.voiceme.app.voiceme"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180240"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2012.97"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908080.2908103"},{"key":"e_1_2_2_12_1","unstructured":"Alex Corrado Avery Lamp Brendan Walsh Edward Aryee Erica Yuen George Matthews Jen Madiedo Jeremie Laval Luis Torres Maddy Leger Paris Hsu Patrick Chen Tim Rait Seth Chong Wjdan Alharthi and Xiao Tu. 2018. Ink To Code. https:\/\/www.microsoft.com\/en-us\/garage\/profiles\/ink-to-code\/  Alex Corrado Avery Lamp Brendan Walsh Edward Aryee Erica Yuen George Matthews Jen Madiedo Jeremie Laval Luis Torres Maddy Leger Paris Hsu Patrick Chen Tim Rait Seth Chong Wjdan Alharthi and Xiao Tu. 2018. Ink To Code. https:\/\/www.microsoft.com\/en-us\/garage\/profiles\/ink-to-code\/"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792734.1792766"},{"key":"e_1_2_2_14_1","volume-title":"Tenenbaum","author":"Ellis Kevin","year":"2017","unstructured":"Kevin Ellis , Daniel Ritchie , Armando Solar-Lezama , and Joshua B . Tenenbaum . 2017 . Learning to Infer Graphics Programs from Hand-Drawn Images. CoRR abs\/1707.09627 (2017). arXiv: 1707.09627 http:\/\/arxiv.org\/abs\/1707.09627 Kevin Ellis, Daniel Ritchie, Armando Solar-Lezama, and Joshua B. Tenenbaum. 2017. Learning to Infer Graphics Programs from Hand-Drawn Images. CoRR abs\/1707.09627 (2017). arXiv: 1707.09627 http:\/\/arxiv.org\/abs\/1707.09627"},{"key":"e_1_2_2_15_1","volume-title":"Tenenbaum","author":"Ellis Kevin","year":"2016","unstructured":"Kevin Ellis , Armando Solar-Lezama , and Joshua B . Tenenbaum . 2016 . Sampling for Bayesian Program Learning. In Advances in Neural Information Processing Systems 29 . Curran Associates, Inc., Barcelona, Spain , 1297\u20131305. http: \/\/papers.nips.cc\/paper\/6082-sampling-for-bayesian-program-learning.pdf Kevin Ellis, Armando Solar-Lezama, and Joshua B. Tenenbaum. 2016. Sampling for Bayesian Program Learning. In Advances in Neural Information Processing Systems 29 . Curran Associates, Inc., Barcelona, Spain, 1297\u20131305. http: \/\/papers.nips.cc\/paper\/6082-sampling-for-bayesian-program-learning.pdf"},{"key":"e_1_2_2_16_1","unstructured":"FBook. 2018. FBook. https:\/\/play.google.com\/store\/apps\/details?id=com.framgia.book  FBook. 2018. FBook. https:\/\/play.google.com\/store\/apps\/details?id=com.framgia.book"},{"key":"e_1_2_2_17_1","volume-title":"Automatically Generating Web Page From A Mockup. In The 28th International Conference on Software Engineering and Knowledge Engineering (SEKE \u201916)","author":"Huang Ruozi","year":"2016","unstructured":"Ruozi Huang , Yonghao Long , and Xiangping Chen . 2016 . Automatically Generating Web Page From A Mockup. In The 28th International Conference on Software Engineering and Knowledge Engineering (SEKE \u201916) . KSI Research Inc. and Knowledge Systems Institute Graduate School, Redwood City, San Francisco Bay, USA, 589\u2013594. Ruozi Huang, Yonghao Long, and Xiangping Chen. 2016. Automatically Generating Web Page From A Mockup. In The 28th International Conference on Software Engineering and Knowledge Engineering (SEKE \u201916) . KSI Research Inc. and Knowledge Systems Institute Graduate School, Redwood City, San Francisco Bay, USA, 589\u2013594."},{"key":"e_1_2_2_18_1","volume-title":"Advances in Neural Information Processing Systems 29. Curran Associates","author":"Irving Geoffrey","unstructured":"Geoffrey Irving , Christian Szegedy , Alexander A Alemi , Niklas Een , Francois Chollet , and Josef Urban . 2016. DeepMath - Deep Sequence Models for Premise Selection . In Advances in Neural Information Processing Systems 29. Curran Associates , Inc., Barcelona, Spain , 2235\u20132243. http:\/\/papers.nips.cc\/paper\/6280-deepmath-deep-sequence-models-for-premise-selection. pdf Geoffrey Irving, Christian Szegedy, Alexander A Alemi, Niklas Een, Francois Chollet, and Josef Urban. 2016. DeepMath - Deep Sequence Models for Premise Selection. In Advances in Neural Information Processing Systems 29. Curran Associates, Inc., Barcelona, Spain, 2235\u20132243. http:\/\/papers.nips.cc\/paper\/6280-deepmath-deep-sequence-models-for-premise-selection. pdf"},{"key":"e_1_2_2_19_1","first-page":"409","article-title":"Probability","volume":"41","author":"Johnson W. E.","year":"1932","unstructured":"W. E. Johnson . 1932 . Probability : The Deductive and Inductive Problems. Mind 41 , 164 (1932), 409 \u2013 423 . http:\/\/www.jstor. org\/stable\/2250183 W. E. Johnson. 1932. Probability: The Deductive and Inductive Problems. Mind 41, 164 (1932), 409\u2013423. http:\/\/www.jstor. org\/stable\/2250183","journal-title":"The Deductive and Inductive Problems. Mind"},{"key":"e_1_2_2_20_1","volume-title":"6th International Conference on Learning Representations (ICLR \u201918)","author":"Kalyan Ashwin","year":"2018","unstructured":"Ashwin Kalyan , Abhishek Mohta , Oleksandr Polozov , Dhruv Batra , Prateek Jain , and Sumit Gulwani . 2018 . NeuralGuided Deductive Search for Real-Time Program Synthesis from Examples . In 6th International Conference on Learning Representations (ICLR \u201918) . Ashwin Kalyan, Abhishek Mohta, Oleksandr Polozov, Dhruv Batra, Prateek Jain, and Sumit Gulwani. 2018. NeuralGuided Deductive Search for Real-Time Program Synthesis from Examples. In 6th International Conference on Learning Representations (ICLR \u201918) ."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2837614.2837674"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3192366.3192410"},{"key":"e_1_2_2_23_1","first-page":"182","article-title":"Note on the general case of the bayes-laplace formula for inductive or a posteriori probabilities","volume":"8","author":"Lidstone George James","year":"1920","unstructured":"George James Lidstone . 1920 . Note on the general case of the bayes-laplace formula for inductive or a posteriori probabilities . Transactions of the Faculty of Actuaries 8 (1920), 182 \u2013 192 . George James Lidstone. 1920. Note on the general case of the bayes-laplace formula for inductive or a posteriori probabilities. Transactions of the Faculty of Actuaries 8 (1920), 182\u2013192.","journal-title":"Transactions of the Faculty of Actuaries"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2837614.2837617"},{"key":"e_1_2_2_25_1","volume-title":"Proceedings of the 31st International Conference on Machine Learning (ICML \u201914)","volume":"657","author":"Maddison Chris","year":"2014","unstructured":"Chris Maddison and Daniel Tarlow . 2014 . Structured Generative Models of Natural Source Code . In Proceedings of the 31st International Conference on Machine Learning (ICML \u201914) , Vol. 32-II. PMLR, New York, NY, USA, 649\u2013 657 . http: \/\/dl.acm.org\/citation.cfm?id=3044805.3044965 Chris Maddison and Daniel Tarlow. 2014. Structured Generative Models of Natural Source Code. In Proceedings of the 31st International Conference on Machine Learning (ICML \u201914) , Vol. 32-II. PMLR, New York, NY, USA, 649\u2013657. http: \/\/dl.acm.org\/citation.cfm?id=3044805.3044965"},{"key":"e_1_2_2_26_1","volume-title":"Proceedings of the IEEE 9th International Conference on Software Testing, Verification and Validation (ICST \u201916)","author":"Mahajan Sonal","unstructured":"Sonal Mahajan , Bailan Li , Pooyan Behnamghader , and William G. J. Halfond . 2016. Using Visual Symptoms for Debugging Presentation Failures in Web Applications . In Proceedings of the IEEE 9th International Conference on Software Testing, Verification and Validation (ICST \u201916) . IEEE Computer Society, Washington, DC, USA, 191\u2013201. Sonal Mahajan, Bailan Li, Pooyan Behnamghader, and William G. J. Halfond. 2016. Using Visual Symptoms for Debugging Presentation Failures in Web Applications. In Proceedings of the IEEE 9th International Conference on Software Testing, Verification and Validation (ICST \u201916) . IEEE Computer Society, Washington, DC, USA, 191\u2013201."},{"key":"e_1_2_2_27_1","volume-title":"Proceedings of The 30rd International Conference on Machine Learning (ICML \u201913)","volume":"195","author":"Menon Aditya","year":"2013","unstructured":"Aditya Menon , Omer Tamuz , Sumit Gulwani , Butler Lampson , and Adam Kalai . 2013 . A Machine Learning Framework for Programming by Example . In Proceedings of The 30rd International Conference on Machine Learning (ICML \u201913) , Vol. 28-I. PMLR, New York, NY, USA, 187\u2013 195 . Aditya Menon, Omer Tamuz, Sumit Gulwani, Butler Lampson, and Adam Kalai. 2013. A Machine Learning Framework for Programming by Example. In Proceedings of The 30rd International Conference on Machine Learning (ICML \u201913), Vol. 28-I. PMLR, New York, NY, USA, 187\u2013195."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180246"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.32"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3192366.3192407"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676726.2677009"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642976"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486881"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174078"},{"key":"e_1_2_2_35_1","volume-title":"Evaluating Direct Manipulation Operations for Constraint-Based Layout. In 14th IFIP Conference on Human-Computer Interaction (INTERACT \u201913)","author":"Zeidler Clemens","year":"2013","unstructured":"Clemens Zeidler , Christof Lutteroth , Wolfgang Stuerzlinger , and Gerald Weber . 2013 a. Evaluating Direct Manipulation Operations for Constraint-Based Layout. In 14th IFIP Conference on Human-Computer Interaction (INTERACT \u201913) . Springer, Berlin, Heidelberg, 513\u2013529. Clemens Zeidler, Christof Lutteroth, Wolfgang Stuerzlinger, and Gerald Weber. 2013a. Evaluating Direct Manipulation Operations for Constraint-Based Layout. In 14th IFIP Conference on Human-Computer Interaction (INTERACT \u201913). Springer, Berlin, Heidelberg, 513\u2013529."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502007"},{"key":"e_1_2_2_37_1","volume-title":"Automatic Generation of User Interface Layouts for Alternative Screen Orientations. In 16th IFIP Conference on Human-Computer Interaction (INTERACT \u201917)","author":"Zeidler Clemens","year":"2017","unstructured":"Clemens Zeidler , Gerald Weber , Wolfgang Stuerzlinger , and Christof Lutteroth . 2017 . Automatic Generation of User Interface Layouts for Alternative Screen Orientations. In 16th IFIP Conference on Human-Computer Interaction (INTERACT \u201917) . Springer, Berlin, Heidelberg, 13\u201335. Clemens Zeidler, Gerald Weber, Wolfgang Stuerzlinger, and Christof Lutteroth. 2017. Automatic Generation of User Interface Layouts for Alternative Screen Orientations. In 16th IFIP Conference on Human-Computer Interaction (INTERACT \u201917). Springer, Berlin, Heidelberg, 13\u201335."}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3276526","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3276526","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:03:39Z","timestamp":1750273419000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3276526"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,24]]},"references-count":37,"journal-issue":{"issue":"OOPSLA","published-print":{"date-parts":[[2018,10,24]]}},"alternative-id":["10.1145\/3276526"],"URL":"https:\/\/doi.org\/10.1145\/3276526","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,24]]},"assertion":[{"value":"2018-10-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}