{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T19:32:48Z","timestamp":1790796768715,"version":"4.1.0"},"reference-count":28,"publisher":"Walter de Gruyter GmbH","issue":"4-5","license":[{"start":{"date-parts":[[2022,8,1]],"date-time":"2022-08-01T00:00:00Z","timestamp":1659312000000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["251654672"],"award-info":[{"award-number":["251654672"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,8,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>With increasing complexity in visual computing tasks, a single device may not be sufficient to adequately support the user\u2019s workflow. Here, we can employ multi-device ecologies such as cross-device interaction, where a workflow can be split across multiple devices, each dedicated to a specific role. But what makes these multi-device ecologies compelling? Based on insights from our research, each device or interface component must contribute a complementary characteristic to increase the quality of interaction and further support users in their current activity. We establish the term <jats:italic>complementary interfaces<\/jats:italic> for such meaningful combinations of devices and modalities and provide an initial set of challenges. In addition, we demonstrate the value of complementarity with examples from within our own research.<\/jats:p>","DOI":"10.1515\/itit-2022-0031","type":"journal-article","created":{"date-parts":[[2022,9,2]],"date-time":"2022-09-02T08:32:30Z","timestamp":1662107550000},"page":"145-154","source":"Crossref","is-referenced-by-count":22,"title":["Complementary interfaces for visual computing"],"prefix":"10.1515","volume":"64","author":[{"given":"Johannes","family":"Zagermann","sequence":"first","affiliation":[{"name":"University of Konstanz , Konstanz , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Hubenschmid","sequence":"additional","affiliation":[{"name":"University of Konstanz , Konstanz , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Priscilla","family":"Balestrucci","sequence":"additional","affiliation":[{"name":"University of Ulm , Ulm , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tiare","family":"Feuchtner","sequence":"additional","affiliation":[{"name":"University of Konstanz , Konstanz , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sven","family":"Mayer","sequence":"additional","affiliation":[{"name":"Ludwig-Maximilians-Universit\u00e4t in Munich , Munich , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc O.","family":"Ernst","sequence":"additional","affiliation":[{"name":"University of Ulm , Ulm , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albrecht","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Ludwig-Maximilians-Universit\u00e4t in Munich , Munich , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harald","family":"Reiterer","sequence":"additional","affiliation":[{"name":"University of Konstanz , Konstanz , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","published-online":{"date-parts":[[2022,9,3]]},"reference":[{"key":"2024072609174312439_j_itit-2022-0031_ref_001","doi-asserted-by":"crossref","unstructured":"Priscilla Balestrucci and Marc O Ernst. Visuo-motor adaptation during interaction with a user-adaptive system. Journal of Vision, 19:187a, 2019.","DOI":"10.1167\/19.10.187a"},{"key":"2024072609174312439_j_itit-2022-0031_ref_002","doi-asserted-by":"crossref","unstructured":"Stefan Bruckner, Tobias Isenberg, Timo Ropinski, and Alexander Wiebel. A Model of Spatial Directness in Interactive Visualization. IEEE Transactions on Visualization and Computer Graphics, 25(8):2514\u20132528, 2019.","DOI":"10.1109\/TVCG.2018.2848906"},{"key":"2024072609174312439_j_itit-2022-0031_ref_003","doi-asserted-by":"crossref","unstructured":"Frederik Brudy, Christian Holz, Roman R\u00e4dle, Chi-Jui Wu, Steven Houben, Clemens N Klokmose, and Nicolai Marquardt. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems \u2013 CHI \u201919, pages 1\u201328, Glasgow, Scotland Uk, 2019. ACM.","DOI":"10.1145\/3290605.3300792"},{"key":"2024072609174312439_j_itit-2022-0031_ref_004","doi-asserted-by":"crossref","unstructured":"Marc O Ernst. Learning to integrate arbitrary signals from vision and touch. Journal of vision, 7(5):7, 2007.","DOI":"10.1167\/7.5.7"},{"key":"2024072609174312439_j_itit-2022-0031_ref_005","doi-asserted-by":"crossref","unstructured":"Steven Feiner and Ari Shamash. Hybrid user interfaces: Breeding virtually bigger interfaces for physically smaller computers. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology, UIST\u201991, pages 9\u201317, Hilton Head, South Carolina, USA, November 1991. ACM.","DOI":"10.1145\/120782.120783"},{"key":"2024072609174312439_j_itit-2022-0031_ref_006","doi-asserted-by":"crossref","unstructured":"Jochen G\u00f6rtler, Christoph Schulz, Daniel Weiskopf, and Oliver Deussen. Bubble treemaps for uncertainty visualization. IEEE transactions on visualization and computer graphics, 24(1):719\u2013728, 2017.","DOI":"10.1109\/TVCG.2017.2743959"},{"key":"2024072609174312439_j_itit-2022-0031_ref_007","doi-asserted-by":"crossref","unstructured":"Steven Houben, Nicolai Marquardt, Jo Vermeulen, Clemens N Klokmose, Johannes Sch\u00f6ning, Harald Reiterer, and Christian Holz. Opportunities and challenges for cross-device interactions in the wild. interactions, 24(5):58\u201363, August 2017.","DOI":"10.1145\/3121348"},{"key":"2024072609174312439_j_itit-2022-0031_ref_008","doi-asserted-by":"crossref","unstructured":"Sebastian Hubenschmid, Jonathan Wieland, Daniel Immanuel Fink, Andrea Batch, Johannes Zagermann, Niklas Elmqvist, and Harald Reiterer. ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User Studies. In CHI Conference on Human Factors in Computing Systems, pages 1\u201320, New Orleans LA USA, April 2022. ACM.","DOI":"10.1145\/3491102.3517550"},{"key":"2024072609174312439_j_itit-2022-0031_ref_009","doi-asserted-by":"crossref","unstructured":"Sebastian Hubenschmid, Johannes Zagermann, Simon Butscher, and Harald Reiterer. STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI \u201921, pages 1\u201314, New York, NY, USA, May 2021. ACM.","DOI":"10.1145\/3411764.3445298"},{"key":"2024072609174312439_j_itit-2022-0031_ref_010","unstructured":"Sebastian Hubenschmid, Johannes Zagermann, Daniel Fink, Jonathan Wieland, Tiare Feuchtner, and Harald Reiterer. Towards asynchronous hybrid user interfaces for cross-reality interaction. In ISS\u201921 Workshop Proceedings: \u201cTransitional Interfaces in Mixed and Cross-Reality: A new frontier?\u201d, 2021."},{"key":"2024072609174312439_j_itit-2022-0031_ref_011","doi-asserted-by":"crossref","unstructured":"Jakob Karolus and Albrecht Schmidt. Proficiency-aware systems: Adapting to the user\u2019s skills and expertise. In Proceedings of the 7th ACM International Symposium on Pervasive Displays, pages 1\u20132, 2018.","DOI":"10.1145\/3205873.3210708"},{"key":"2024072609174312439_j_itit-2022-0031_ref_012","doi-asserted-by":"crossref","unstructured":"Jakob Karolus, Pawe\u0142 W Wozniak, Lewis L Chuang, and Albrecht Schmidt. Robust gaze features for enabling language proficiency awareness. In Proceedings of the 2017 CHI conference on human factors in computing systems, pages 2998\u20133010, 2017.","DOI":"10.1145\/3025453.3025601"},{"key":"2024072609174312439_j_itit-2022-0031_ref_013","doi-asserted-by":"crossref","unstructured":"Thomas Kosch, Albrecht Schmidt, Simon Thanheiser, and Lewis L Chuang. One does not simply rsvp: mental workload to select speed reading parameters using electroencephalography. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1\u201313, 2020.","DOI":"10.1145\/3313831.3376766"},{"key":"2024072609174312439_j_itit-2022-0031_ref_014","doi-asserted-by":"crossref","unstructured":"Jens M\u00fcller, Roman R\u00e4dle, and Harald Reiterer. Remote collaboration with mixed reality displays: How shared virtual landmarks facilitate spatial referencing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI \u201917, pages 6481\u20136486, New York, NY, USA, 2017. ACM.","DOI":"10.1145\/3025453.3025717"},{"key":"2024072609174312439_j_itit-2022-0031_ref_015","unstructured":"Patrick Aggergaard Olin, Ahmad Mohammad Issa, Tiare Feuchtner, and Kaj Gr\u00f8nb\u00e6k. Designing for Heterogeneous Cross-Device Collaboration and Social Interaction in Virtual Reality. In 32nd Australian Conference on Human-Computer Interaction, pages 112\u2013127, Sydney NSW Australia, December 2020. ACM."},{"key":"2024072609174312439_j_itit-2022-0031_ref_016","doi-asserted-by":"crossref","unstructured":"Thomas Plank, Hans-Christian Jetter, Roman R\u00e4dle, Clemens N Klokmose, Thomas Luger, and Harald Reiterer. Is Two Enough?! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems \u2013 CHI \u201917, pages 4548\u20134560, New York, New York, USA, 2017. ACM.","DOI":"10.1145\/3025453.3025537"},{"key":"2024072609174312439_j_itit-2022-0031_ref_017","doi-asserted-by":"crossref","unstructured":"Roman R\u00e4dle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. Spatially-aware or spatially-agnostic? elicitation and evaluation of user-defined cross-device interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI \u201915, pages 3913\u20133922, New York, NY, USA, 2015. ACM.","DOI":"10.1145\/2702123.2702287"},{"key":"2024072609174312439_j_itit-2022-0031_ref_018","doi-asserted-by":"crossref","unstructured":"Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. Factors influencing visual attention switch in multi-display user interfaces: A survey. In Proceedings of the 2012 International Symposium on Pervasive Displays \u2013 PerDis \u201912, pages 1\u20136, Porto, Portugal, 2012. ACM.","DOI":"10.1145\/2307798.2307799"},{"key":"2024072609174312439_j_itit-2022-0031_ref_019","doi-asserted-by":"crossref","unstructured":"Albrecht Schmidt. Implicit human computer interaction through context. Personal technologies, 4(2):191\u2013199, 2000.","DOI":"10.1007\/BF01324126"},{"key":"2024072609174312439_j_itit-2022-0031_ref_020","doi-asserted-by":"crossref","unstructured":"Sofia Seinfeld, Tiare Feuchtner, Antonella Maselli, and J\u00f6rg M\u00fcller. User representations in human-computer interaction. Human\u2013Computer Interaction, 36(5\u20136):400\u2013438, 2021.","DOI":"10.1080\/07370024.2020.1724790"},{"key":"2024072609174312439_j_itit-2022-0031_ref_021","doi-asserted-by":"crossref","unstructured":"Irene Senna, Cesare V Parise, and Marc O Ernst. Modulation frequency as a cue for auditory speed perception. Proceedings of the Royal Society B: Biological Sciences, 284(1858):20170673, 2017.","DOI":"10.1098\/rspb.2017.0673"},{"key":"2024072609174312439_j_itit-2022-0031_ref_022","doi-asserted-by":"crossref","unstructured":"Matthew Turk. Multimodal Interaction: A Review. Pattern Recognition Letters, 36(1):189\u2013195, 2014.","DOI":"10.1016\/j.patrec.2013.07.003"},{"key":"2024072609174312439_j_itit-2022-0031_ref_023","doi-asserted-by":"crossref","unstructured":"Andries van Dam. Post-wimp user interfaces. Commun. ACM, 40(2):63\u201367, feb 1997.","DOI":"10.1145\/253671.253708"},{"key":"2024072609174312439_j_itit-2022-0031_ref_024","doi-asserted-by":"crossref","unstructured":"Mark Weiser. The computer for the 21 st century. Scientific american, 265(3):94\u2013105, 1991.","DOI":"10.1038\/scientificamerican0991-94"},{"key":"2024072609174312439_j_itit-2022-0031_ref_025","doi-asserted-by":"crossref","unstructured":"Johannes Zagermann, Ulrike Pfeil, Daniel Fink, Philipp von Bauer, and Harald Reiterer. Memory in Motion: The Influence of Gesture- and Touch-Based Input Modalities on Spatial Memory. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 1899\u20131910, Denver Colorado USA, May 2017. ACM.","DOI":"10.1145\/3025453.3026001"},{"key":"2024072609174312439_j_itit-2022-0031_ref_026","doi-asserted-by":"crossref","unstructured":"Johannes Zagermann, Ulrike Pfeil, Roman R\u00e4dle, Hans-Christian Jetter, Clemens Klokmose, and Harald Reiterer. When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 5470\u20135481, San Jose California USA, May 2016. ACM.","DOI":"10.1145\/2858036.2858224"},{"key":"2024072609174312439_j_itit-2022-0031_ref_027","doi-asserted-by":"crossref","unstructured":"Johannes Zagermann, Ulrike Pfeil, Philipp von Bauer, Daniel Fink, and Harald Reiterer. \u201cit\u2019s in my other hand\u201d \u2013 studying the interplay of interaction techniques and multi-tablet activities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1\u201313, New York, NY, USA, 2020. ACM.","DOI":"10.1145\/3313831.3376540"},{"key":"2024072609174312439_j_itit-2022-0031_ref_028","doi-asserted-by":"crossref","unstructured":"Chris Zimmerer, Philipp Krop, Martin Fischbach, and Marc Erich Latoschik. Reducing the Cognitive Load of Playing a Digital Tabletop Game with a Multimodal Interface. In CHI Conference on Human Factors in Computing Systems, pages 1\u201313, New Orleans LA USA, 2022. ACM.","DOI":"10.1145\/3491102.3502062"}],"container-title":["it - Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2022-0031\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2022-0031\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,26]],"date-time":"2024-07-26T09:18:09Z","timestamp":1721985489000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2022-0031\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,1]]},"references-count":28,"journal-issue":{"issue":"4-5","published-online":{"date-parts":[[2022,9,3]]},"published-print":{"date-parts":[[2022,8,26]]}},"alternative-id":["10.1515\/itit-2022-0031"],"URL":"https:\/\/doi.org\/10.1515\/itit-2022-0031","relation":{},"ISSN":["2196-7032","1611-2776"],"issn-type":[{"value":"2196-7032","type":"electronic"},{"value":"1611-2776","type":"print"}],"subject":[],"published":{"date-parts":[[2022,8,1]]}}}