{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,9]],"date-time":"2025-09-09T20:41:17Z","timestamp":1757450477991,"version":"3.41.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"ISS","license":[{"start":{"date-parts":[[2020,11,4]],"date-time":"2020-11-04T00:00:00Z","timestamp":1604448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2020,11,4]]},"abstract":"<jats:p>Whilst new patents and announcements advertise the technical availability of foldable displays, which are capable to be folded to some extent, there is still a lack of fundamental and applied understanding of how to model, to design, and to prototype graphical user interfaces for these devices before actually implementing them. Without waiting for their off-the-shelf availability and without being tied to any physical foldable mechanism, Flecto defines a model, an associated notation, and a supporting software for prototyping graphical user interfaces running on foldable displays, such as foldable smartphone or assemblies of foldable surfaces. For this purpose, we use an extended notation of the Yoshizawa-Randlett diagramming system, used to describe the folds of origami models, to characterize a foldable display and define possible interactive actions based on its folding operations. A guiding method for rapidly prototyping foldable user interfaces is devised and supported by Flecto, a design environment where foldable user interfaces are simulated in 3D environment instead of in physical reality. We report on a case study to demonstrate Flecto in action and we gather the feedback from users on Flecto, using Microsoft Product Reaction Cards.<\/jats:p>","DOI":"10.1145\/3427322","type":"journal-article","created":{"date-parts":[[2020,11,5]],"date-time":"2020-11-05T00:44:02Z","timestamp":1604537042000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Towards Rapid Prototyping of Foldable Graphical User Interfaces with Flecto"],"prefix":"10.1145","volume":"4","author":[{"given":"Iyad","family":"Khaddam","sequence":"first","affiliation":[{"name":"Universit\u00e9 catholique de Louvain &amp; University of Damascus, 1348 Louvain-la-Neuve, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean","family":"Vanderdonckt","sequence":"additional","affiliation":[{"name":"Universit\u00e9 catholique de Louvain, Louvain-la-Neuve, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Salah","family":"Dowaji","sequence":"additional","affiliation":[{"name":"Damascus University, Damascus, Syria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donatien","family":"Grolaux","sequence":"additional","affiliation":[{"name":"ICHEC Brussels Management School, Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,11,4]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of UPA 2002 Conference","author":"Benedek Joey","year":"2002","unstructured":"Joey Benedek and Trish Miner . 2002 . Measuring Desirability: New methods for evaluating desirability in a usability lab setting . In Proceedings of UPA 2002 Conference ( Orlando, FL, USA). Joey Benedek and Trish Miner. 2002. Measuring Desirability: New methods for evaluating desirability in a usability lab setting. In Proceedings of UPA 2002 Conference (Orlando, FL, USA)."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460625.2460655"},{"key":"e_1_2_2_3_1","volume-title":"A Unifying Reference Framework for multi-target user interfaces. Interacting with Computers 15, 3 (06","author":"Calvary Ga\u00eblle","year":"2003","unstructured":"Ga\u00eblle Calvary , Jo\u00eblle Coutaz , David Thevenin , Quentin Limbourg , Laurent Bouillon , and Jean Vanderdonckt . 2003. A Unifying Reference Framework for multi-target user interfaces. Interacting with Computers 15, 3 (06 2003 ), 289--308. https:\/\/doi.org\/10.1016\/S0953--5438(03)00010--9 arXiv:http:\/\/oup.prod.sis.lan\/iwc\/article-pdf\/15\/3\/289\/7800242\/iwc15- 0289.pdf Ga\u00eblle Calvary, Jo\u00eblle Coutaz, David Thevenin, Quentin Limbourg, Laurent Bouillon, and Jean Vanderdonckt. 2003. A Unifying Reference Framework for multi-target user interfaces. Interacting with Computers 15, 3 (06 2003), 289--308. https:\/\/doi.org\/10.1016\/S0953--5438(03)00010--9 arXiv:http:\/\/oup.prod.sis.lan\/iwc\/article-pdf\/15\/3\/289\/7800242\/iwc15- 0289.pdf"},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of the Symposium on Graph Drawing. 127--139","author":"Carpendale M.","year":"1995","unstructured":"M. Sheelagh T. Carpendale , David J. Cowperthwaite , F. David Fracchia , and Thomas Shermer . 1995 . Graph Folding: Extending Detail and Context Viewing into a Tool for Subgraph Comparisons . In Proceedings of the Symposium on Graph Drawing. 127--139 . M.Sheelagh T. Carpendale, David J. Cowperthwaite, F.David Fracchia, and Thomas Shermer. 1995. Graph Folding: Extending Detail and Context Viewing into a Tool for Subgraph Comparisons. In Proceedings of the Symposium on Graph Drawing. 127--139."},{"key":"e_1_2_2_5_1","volume-title":"Proceedings of 7th IFIP TC13 International Conference on Human-Computer Interaction","author":"Coutaz Jo\u00eblle","year":"2003","unstructured":"Jo\u00eblle Coutaz , Christophe Lachenal , and Sophie Dupuy-Chessa . 2003 . Ontology for Multi-surface Interaction . In Proceedings of 7th IFIP TC13 International Conference on Human-Computer Interaction ( Zurich, Switzerland, September 1--5 , 2003) (INTERACT'03), Matthias Rauterberg, Marino Menozzi, and Janet Wesson (Eds.). IOS Press, Amsterdam, 447--454. Jo\u00eblle Coutaz, Christophe Lachenal, and Sophie Dupuy-Chessa. 2003. Ontology for Multi-surface Interaction. In Proceedings of 7th IFIP TC13 International Conference on Human-Computer Interaction (Zurich, Switzerland, September 1--5, 2003) (INTERACT'03), Matthias Rauterberg, Marino Menozzi, and Janet Wesson (Eds.). IOS Press, Amsterdam, 447--454."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029632.1029667"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240167.3240173"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1449715.1449762"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2559206.2574770"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2677199.2680572"},{"key":"e_1_2_2_11_1","volume-title":"ACM Hum.-Comput. Interact.","volume":"4","author":"Hidaka Yukinori","year":"2018","unstructured":"Yukinori Hidaka , Ken Ootsuka , and Naoto Kinoshita . 2018 . DISPLAY DEVICE AND ELECTRONIC APPARATUS. http:\/\/www.freepatentsonline.com\/y2018\/0336851.html Proc . ACM Hum.-Comput. Interact. , Vol. 4 , No. ISS, Article 194. Publication date : November 2020. Towards Rapid Prototyping of Foldable Graphical User Interfaces with Flecto 194:21 Yukinori Hidaka, Ken Ootsuka, and Naoto Kinoshita. 2018. DISPLAY DEVICE AND ELECTRONIC APPARATUS. http:\/\/www.freepatentsonline.com\/y2018\/0336851.html Proc. ACM Hum.-Comput. Interact., Vol. 4, No. ISS, Article 194. Publication date: November 2020. Towards Rapid Prototyping of Foldable Graphical User Interfaces with Flecto 194:21"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508468.2514934"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1349026.1349037"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055054"},{"key":"e_1_2_2_15_1","volume-title":"Enactment of User Interface Development Methods in Software Life Cycles. In 13th International Conference on Human Computer Interaction, RoCHI 2016","author":"Khaddam Iyad","year":"2016","unstructured":"Iyad Khaddam , Hanaa Barakat , and Jean Vanderdonckt . 2016 . Enactment of User Interface Development Methods in Software Life Cycles. In 13th International Conference on Human Computer Interaction, RoCHI 2016 , Iasi, Romania, September 8--9 , 2016, Adrian Iftene and Jean Vanderdonckt (Eds.). Matrix Rom, 26--35. Iyad Khaddam, Hanaa Barakat, and Jean Vanderdonckt. 2016. Enactment of User Interface Development Methods in Software Life Cycles. In 13th International Conference on Human Computer Interaction, RoCHI 2016, Iasi, Romania, September 8--9, 2016, Adrian Iftene and Jean Vanderdonckt (Eds.). Matrix Rom, 26--35."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSWAN.2015.7209080"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2820619.2820636"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2148131.2148142"},{"key":"e_1_2_2_19_1","volume-title":"Young Do Kim, and Suk Choi","author":"Kim Hoonsik","year":"2018","unstructured":"Hoonsik Kim , Young Do Kim, and Suk Choi . 2018 . Foldable display. http:\/\/www.freepatentsonline.com\/9891670.html Hoonsik Kim, Young Do Kim, and Suk Choi. 2018. Foldable display. http:\/\/www.freepatentsonline.com\/9891670.html"},{"key":"e_1_2_2_20_1","volume-title":"CHI '14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA '14)","author":"Kinoshita Yuichiro","year":"1837","unstructured":"Yuichiro Kinoshita , Kentaro Go , Reiji Kozono , and Kohei Kaneko . 2014. Origami Tessellation Display: Interaction Techniques Using Origami-Based Deformable Surfaces . In CHI '14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA '14) . Association for Computing Machinery , New York, NY, USA , 1837 --1842. https:\/\/doi.org\/10.1145\/2559206.2581172 Yuichiro Kinoshita, Kentaro Go, Reiji Kozono, and Kohei Kaneko. 2014. Origami Tessellation Display: Interaction Techniques Using Origami-Based Deformable Surfaces. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA '14). Association for Computing Machinery, New York, NY, USA, 1837--1842. https:\/\/doi.org\/10.1145\/2559206.2581172"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.3576906"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979136"},{"key":"e_1_2_2_23_1","volume-title":"Origami Diagramming Conventions - Diagramming, Part 1. Web site. Retrieved","author":"Lang Robert J.","year":"2011","unstructured":"Robert J. Lang . 2011 . Origami Diagramming Conventions - Diagramming, Part 1. Web site. Retrieved December 12, 2019 from http:\/\/langorigami.com\/article\/origami-diagramming-conventions\/. Robert J. Lang. 2011. Origami Diagramming Conventions - Diagramming, Part 1. Web site. Retrieved December 12, 2019 from http:\/\/langorigami.com\/article\/origami-diagramming-conventions\/."},{"key":"e_1_2_2_24_1","unstructured":"Haklim Lee Hanseok Chae and Wonseok Joo. 2018. MOBILE TERMINAL. http:\/\/www.freepatentsonline.com\/y2018\/ 0183911.html  Haklim Lee Hanseok Chae and Wonseok Joo. 2018. MOBILE TERMINAL. http:\/\/www.freepatentsonline.com\/y2018\/ 0183911.html"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1449715.1449763"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3024969.3024970"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173928"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1111449.1111483"},{"key":"e_1_2_2_29_1","volume-title":"Klaus Hildebrandt, and J\u00fcrgen Steimle.","author":"Olberding Simon","year":"2015","unstructured":"Simon Olberding , Sergio Soto Ortega , Klaus Hildebrandt, and J\u00fcrgen Steimle. 2015 . Foldio : Digital Fabrication of Interactive and Shape-Changing Objects With Foldable Printed Electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). ACM, New York, NY, USA, 223--232. https:\/\/doi.org\/10.1145\/2807442.2807494 See video at https:\/\/www.youtube.com\/watch?v=gA17s9MyfiM. Proc. ACM Hum.-Comput. Interact., Vol. 4 , No. ISS, Article 194. Publication date: November 2020. 194:22 Iyad Khaddam et al. Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and J\u00fcrgen Steimle. 2015. Foldio: Digital Fabrication of Interactive and Shape-Changing Objects With Foldable Printed Electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). ACM, New York, NY, USA, 223--232. https:\/\/doi.org\/10.1145\/2807442.2807494 See video at https:\/\/www.youtube.com\/watch?v=gA17s9MyfiM. Proc. ACM Hum.-Comput. Interact., Vol. 4, No. ISS, Article 194. Publication date: November 2020. 194:22 Iyad Khaddam et al."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343055.3359703"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098279.3098533"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2914920.2915006"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470688"},{"key":"e_1_2_2_34_1","volume-title":"Article 2 (Jan.","author":"Sturdee Miriam","year":"2018","unstructured":"Miriam Sturdee and Jason Alexander . 2018. Analysis and Classification of Shape-Changing Interfaces for Design and Application-Based Research. ACM Comput. Surv. 51, 1 , Article 2 (Jan. 2018 ), 32 pages. https:\/\/doi.org\/10.1145\/3143559 Miriam Sturdee and Jason Alexander. 2018. Analysis and Classification of Shape-Changing Interfaces for Design and Application-Based Research. ACM Comput. Surv. 51, 1, Article 2 (Jan. 2018), 32 pages. https:\/\/doi.org\/10.1145\/3143559"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702613.2732801"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1979742.1979701"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3393672.3398490"},{"key":"e_1_2_2_38_1","volume-title":"Proceedings of the 10th International Conference on Ubiquitous Computing","author":"Mochizuki Arito","year":"2008","unstructured":"Jun-ichiro Watanabe, Arito Mochizuki , and Youichi Horry . 2008 . Bookisheet: Bendable Device for Browsing Content Using the Metaphor of Leafing Through the Pages . In Proceedings of the 10th International Conference on Ubiquitous Computing ( Seoul, Korea) (UbiComp '08). ACM, New York, NY, USA, 360--369. https:\/\/doi.org\/10.1145\/1409635.1409684 See video at http:\/\/mobblog.cs.ucl.ac.uk\/category\/ubicomp 2008\/. Jun-ichiro Watanabe, Arito Mochizuki, and Youichi Horry. 2008. Bookisheet: Bendable Device for Browsing Content Using the Metaphor of Leafing Through the Pages. In Proceedings of the 10th International Conference on Ubiquitous Computing (Seoul, Korea) (UbiComp '08). ACM, New York, NY, USA, 360--369. https:\/\/doi.org\/10.1145\/1409635.1409684 See video at http:\/\/mobblog.cs.ucl.ac.uk\/category\/ubicomp2008\/."},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of 31st Annual ACM Symposium on User Interface Software and Technology, Adjunct Proceedings","author":"Morenko Nadiya","year":"2018","unstructured":"MichaelWessely, Nadiya Morenko , J\u00fcrgen Steimle , and Michael Schmitz . 2018 . Interactive Tangrami: Rapid Prototyping with Modular Paper-folded Electronics . In Proceedings of 31st Annual ACM Symposium on User Interface Software and Technology, Adjunct Proceedings ( Berlin, Germany) (UIST '18). ACM, New York, NY, USA, 143--145. https: \/\/doi.org\/10.1145\/3266037.3271630 See video at https:\/\/www.youtube.com\/watch?v=A8VCApp_R6M. MichaelWessely, Nadiya Morenko, J\u00fcrgen Steimle, and Michael Schmitz. 2018. Interactive Tangrami: Rapid Prototyping with Modular Paper-folded Electronics. In Proceedings of 31st Annual ACM Symposium on User Interface Software and Technology, Adjunct Proceedings (Berlin, Germany) (UIST '18). ACM, New York, NY, USA, 143--145. https: \/\/doi.org\/10.1145\/3266037.3271630 See video at https:\/\/www.youtube.com\/watch?v=A8VCApp_R6M."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1754154"},{"key":"e_1_2_2_41_1","volume-title":"Zhong","author":"Zhang Zhen","year":"2017","unstructured":"Zhen Zhang , Victor H. Yin , Cyrus Y. Liu , Paul S. Drzaic , Sungwon Bae , Chun-hao Tung, Kiarash Vakhshouri , Sunggu Kang , and John Z . Zhong . 2017 . Electronic Devices With Flexible Displays . http:\/\/www.freepatentsonline.com\/y2017\/ 0336831.html Zhen Zhang, Victor H. Yin, Cyrus Y. Liu, Paul S. Drzaic, Sungwon Bae, Chun-hao Tung, Kiarash Vakhshouri, Sunggu Kang, and John Z. Zhong. 2017. Electronic Devices With Flexible Displays. http:\/\/www.freepatentsonline.com\/y2017\/ 0336831.html"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196713"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427322","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3427322","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:25Z","timestamp":1750197745000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427322"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,4]]},"references-count":42,"journal-issue":{"issue":"ISS","published-print":{"date-parts":[[2020,11,4]]}},"alternative-id":["10.1145\/3427322"],"URL":"https:\/\/doi.org\/10.1145\/3427322","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2020,11,4]]},"assertion":[{"value":"2020-11-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}