{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T16:31:41Z","timestamp":1776097901171,"version":"3.50.1"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,3,26]],"date-time":"2018-03-26T00:00:00Z","timestamp":1522022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"BMBF","award":["01IS12054, 01IS17050"],"award-info":[{"award-number":["01IS12054, 01IS17050"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,3,26]]},"abstract":"<jats:p>Tangible interaction has shown to be beneficial in a wide variety of scenarios since it provides more direct manipulation and haptic feedback. Further, inherently three-dimensional information is represented more naturally by a 3D object than by a flat picture on a screen. Yet, today's tangibles have often pre-defined form factors and limited input and output facilities. To overcome this issue, the combination of projection and depth cameras is used as a fast and flexible way of non-intrusively adding input and output to tangibles. However, tangibles are often quite small and hence the space for output and interaction on their surface is limited. Therefore, we propose FlowPut: an environment-aware framework that utilizes the space available on and around a tangible object for projected visual output. By means of an optimization-based layout approach, FlowPut considers the environment of the objects to avoid interference between projection and real-world objects. Moreover, we contribute an occlusion resilient object recognition and tracking for tangible objects based on their 3D model and a point-cloud based multi-touch detection, that allows sensing touches also on the side of a tangible. Flowput is validated through a series of technical experiments, a user study, and two example applications.<\/jats:p>","DOI":"10.1145\/3191763","type":"journal-article","created":{"date-parts":[[2018,3,27]],"date-time":"2018-03-27T12:06:45Z","timestamp":1522152405000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["FlowPut"],"prefix":"10.1145","volume":"2","author":[{"given":"Jan","family":"Riemann","sequence":"first","affiliation":[{"name":"TU Darmstadt, Darmstadt, Hessen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Schmitz","sequence":"additional","affiliation":[{"name":"TU Darmstadt, Darmstadt, Hessen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Hendrich","sequence":"additional","affiliation":[{"name":"TU Darmstadt, Darmstadt, Hessen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Max","family":"M\u00fchlh\u00e4user","sequence":"additional","affiliation":[{"name":"TU Darmstadt, Darmstadt, Hessen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,3,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/582828.881324"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/502348.502363"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/354401.354790"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502027"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1166253.1166291"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.1613673"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2788940.2788954"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2559206.2581142"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396636.2396666"},{"key":"e_1_2_2_10_1","volume-title":"2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 207--212","author":"Gal R.","unstructured":"R. Gal, L. Shapira, E. Ofek, and P. Kohli. 2014. FLARE: Fast layout for augmented reality applications. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 207--212."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557173"},{"key":"e_1_2_2_12_1","volume-title":"2014 IEEE International Conference on Image Processing (ICIP). 5861--5865","author":"Gottfried J. M.","unstructured":"J. M. Gottfried, R. Nair, S. Meister, C. S. Garbe, and D. Kondermann. 2014. Time of flight motion compensation revisited. In 2014 IEEE International Conference on Image Processing (ICIP). 5861--5865."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2012.6402555"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2406367.2406419"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718989"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258715"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037826.2037857"},{"key":"e_1_2_2_18_1","volume-title":"Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on. IEEE Computer Society","author":"Jones B.R.","unstructured":"B.R. Jones, R. Sodhi, R.H. Campbell, G. Garnett, and B.P. Bailey. 2010. Build your world and play in it: Interacting with surface particles on complex objects. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on. IEEE Computer Society, Washington, DC, USA, 165--174."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208333"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493486"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2148131.2148142"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2512349.2512806"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858180"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2148131.2148179"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2614217.2614226"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/504704.504706"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CW.2015.42"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394622.1394633"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"D. Leithinger and M. Haller. 2007. Improving Menu Interaction for Cluttered Tabletop Setups with User-Drawn Path Menus. In Horizontal Interactive Human-Computer Systems 2007. TABLETOP '07. Second Annual IEEE International Workshop on. IEEE Computer Society Washington DC USA 121--128.","DOI":"10.1109\/TABLETOP.2007.24"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874001"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866218.1866237"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025795"},{"key":"e_1_2_2_33_1","volume-title":"Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on. IEEE Computer Society","author":"Mitsuhara H.","unstructured":"H. Mitsuhara, Y. Yano, and T. Moriyama. 2010. Paper-top interface for supporting note-taking and its preliminary experiment. In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on. IEEE Computer Society, Washington, DC, USA, 3456--3462."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2592910"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502048"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647413"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2501989"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2449396.2449443"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/647653.732300"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702613.2732742"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-22698-9_18"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892321"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/1703435.1703733"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2015.43"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2014.10.030"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207743"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647374"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380189"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807503"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1450579.1450633"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470688"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/2525493.2525508"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303114"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/159544.159630"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380190"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1095034.1095047"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TABLETOP.2007.35"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1936652.1936665"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466113"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2992154.2992173"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01427149"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858329"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3191763","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3191763","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:42Z","timestamp":1750213602000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3191763"}},"subtitle":["Environment-Aware Interactivity for Tangible 3D Objects"],"short-title":[],"issued":{"date-parts":[[2018,3,26]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,3,26]]}},"alternative-id":["10.1145\/3191763"],"URL":"https:\/\/doi.org\/10.1145\/3191763","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3,26]]},"assertion":[{"value":"2017-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-03-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}