{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T18:02:44Z","timestamp":1778954564108,"version":"3.51.4"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"ISS","license":[{"start":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T00:00:00Z","timestamp":1729728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,10,24]]},"abstract":"<jats:p>Augmented video presentation tools provide a natural way for presenters to interact with their content, resulting in engaging experiences for remote audiences, such as when a presenter uses hand gestures to manipulate and direct attention to visual aids overlaid on their webcam feed. However, authoring and customizing these presentations can be challenging, particularly when presenting dynamic data visualization (i.e., animated charts). To this end, we introduce VisConductor, an authoring and presentation tool that equips presenters with the ability to configure gestures that control affect-varying visualization animation, foreshadow visualization transitions, direct attention to notable data points, and animate the disclosure of annotations. These gestures are integrated into configurable widgets, allowing presenters to trigger content transformations by executing gestures within widget boundaries, with feedback visible only to them. Altogether, our palette of widgets provides a level of flexibility appropriate for improvisational presentations and ad-hoc content transformations, such as when responding to audience engagement. To evaluate VisConductor, we conducted two studies focusing on presenters (\ud835\udc41=11) and audience members (\ud835\udc41=11). Our findings indicate that our approach taken with VisConductor can facilitate interactive and engaging remote presentations with dynamic visual aids. Reflecting on our findings, we also offer insights to inform the future of augmented video presentation tools.<\/jats:p>","DOI":"10.1145\/3698131","type":"journal-article","created":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T19:23:51Z","timestamp":1729797831000},"page":"133-154","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["VisConductor: Affect-Varying Widgets for Animated Data Storytelling in Gesture-Aware Augmented Video Presentation"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-7157-8157","authenticated-orcid":false,"given":"Temiloluwa Paul","family":"Femi-Gege","sequence":"first","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5524-2291","authenticated-orcid":false,"given":"Matthew","family":"Brehmer","sequence":"additional","affiliation":[{"name":"Tableau Research, Seattle, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5008-4319","authenticated-orcid":false,"given":"Jian","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,10,24]]},"reference":[{"key":"e_1_2_1_2_1","unstructured":"All Turtles. 2021. mmhmm. https:\/\/www.mmhmm.app\/"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3206505.3206552"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598647"},{"key":"e_1_2_1_5_1","unstructured":"ANONYMOUS. [n. d.]. personal communication."},{"key":"e_1_2_1_6_1","unstructured":"Apple. 2023. Use reactions presenter overlay and other effects when videoconferencing on Mac. https:\/\/support.apple.com\/en-us\/HT212950"},{"key":"e_1_2_1_7_1","volume-title":"The evolution of working from home. https:\/\/siepr.stanford.edu\/publications\/working-paper\/evolution-working-home Working paper","author":"Barrero Jose Maria","unstructured":"Jose Maria Barrero, Nicholas Bloom, and Steven J Davis. 2023. The evolution of working from home. https:\/\/siepr.stanford.edu\/publications\/working-paper\/evolution-working-home Working paper. The Stanford Institute for Economic Policy Research (SIEPR)"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/159544.159562"},{"key":"e_1_2_1_9_1","unstructured":"BBC. 2010. Hans Rosling\u2019s 200 Countries 200 Years 4 Minutes - The Joy of Stats. https:\/\/www.youtube.com\/watch?v=jbkSRLYSojo"},{"key":"e_1_2_1_10_1","volume-title":"What makes a visualization memorable? IEEE Transactions on Visualization and Computer Graphics (Proceedings of InfoVis), 19, 12","author":"Borkin Michelle A","year":"2013","unstructured":"Michelle A Borkin, Azalea A Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, and Hanspeter Pfister. 2013. What makes a visualization memorable? IEEE Transactions on Visualization and Computer Graphics (Proceedings of InfoVis), 19, 12 (2013)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114760"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1056888"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","unstructured":"Zhe Cao Gines Hidalgo Tomas Simon Shih-En Wei and Yaser Sheikh. 2019. OpenPose: Realtime multi-person 2D pose estimation using part affinity fields. https:\/\/doi.org\/10.48550\/arXiv.1812.08008 arXiv preprint 10.48550\/arXiv.1812.08008","DOI":"10.48550\/arXiv.1812.08008"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","unstructured":"Adelia Carstens. 2019. Advice on the use of gestures in presentation skills manuals: alignment between theory research and instruction. Image & Text https:\/\/doi.org\/10.17159\/2617-3255\/2018\/n33a8 10.17159\/2617-3255\/2018\/n33a8","DOI":"10.17159\/2617-3255"},{"key":"e_1_2_1_15_1","unstructured":"Tony Chu. 2016. Animation pacing and exposition. Presented at OpenVisConf. https:\/\/youtu.be\/Z4tB6qyxHJA"},{"key":"e_1_2_1_16_1","unstructured":"Cisco Systems. 2021. Webex. https:\/\/www.webex.com\/"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2254556.2254584"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbr.2021.100119"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70956-5_1"},{"key":"e_1_2_1_20_1","unstructured":"Danyel Fisher. 2010. Animation for visualization: Opportunities and drawbacks. In Beautiful Visualization: Looking at Data through the Eyes of Experts Julie Steele and Noah Iliinsky (Eds.). O\u2019Reilly."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/HCI2010.29"},{"key":"e_1_2_1_22_1","volume-title":"Thinking with Your Hands: The Surprising Science Behind How Gestures Shape Our Thoughts","author":"Goldin-Meadow Susan","year":"2022","unstructured":"Susan Goldin-Meadow. 2023. Thinking with Your Hands: The Surprising Science Behind How Gestures Shape Our Thoughts. Basic Books. isbn:9781541600652 lccn:2022041572 https:\/\/books.google.ca\/books?id=4XKSEAAAQBAJ"},{"key":"e_1_2_1_23_1","volume-title":"GSAP: JavaScript HTML5 animation. https:\/\/greensock.com\/gsap\/","year":"2023","unstructured":"GreenSock. 2023. GSAP: JavaScript HTML5 animation. https:\/\/greensock.com\/gsap\/"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSCWD.2011.5960054"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3526113.3545614"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180937"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70539"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2133806.2133821"},{"key":"e_1_2_1_29_1","unstructured":"Adobe Systems Incorporated. 2023. Adobe After Effects. https:\/\/www.adobe.com\/products\/aftereffects.html Accessed: 2023-04-23"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1186\/s41235-016-0004-9"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511807572"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.36"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CW.2010.17"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114775"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3209500"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/VIS47514.2020.00035"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3526113.3545702"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581566"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029632.1029642"},{"key":"e_1_2_1_40_1","unstructured":"2022. OBS Studio. https:\/\/obsproject.com\/"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.01.004"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2017.8031599"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/BELIV.2018.8634297"},{"key":"e_1_2_1_44_1","unstructured":"2018. Data-Driven Storytelling Nathalie Henry Riche Christophe Hurter Nicholas Diakopoulos and Sheelagh Carpendale (Eds.). A K Peters\/CRC Press. isbn:978-1-315-28155-1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.125"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300852"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12392"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934281"},{"key":"e_1_2_1_49_1","unstructured":"Andreas Schallwig. 2023. Fingerpose. https:\/\/github.com\/andypotato\/fingerpose"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.179"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3146329"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2398356.2398381"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029632.1029641"},{"key":"e_1_2_1_54_1","volume-title":"Nathalie Henry Riche, and John Stasko","author":"Stolper Charles D","year":"2018","unstructured":"Charles D Stolper, Bongshin Lee, Nathalie Henry Riche, and John Stasko. 2018. Emerging and recurring data-driven storytelling techniques: Analysis of a curated collection of recent stories. In Data-Driven Storytelling, Nathalie Henry Riche, Christophe Hurter, Nicholas Diakopoulos, and Sheelagh Carpendale (Eds.). A K Peters\/CRC Press."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2865231"},{"key":"e_1_2_1_56_1","unstructured":"Thomas Lin Pedersen. 2023. gganimate. https:\/\/gganimate.com\/"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445747"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5334\/gjgl.334"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","unstructured":"Julien Valentin Adarsh Kowdle Suhil Nassar Ameesh Makadia Angjoo Kanazawa Michael Ratasich and Caroline Pantofaru. 2020. MediaPipe: A framework for building perception pipelines. https:\/\/doi.org\/10.48550\/arXiv.1906.08172 arXiv preprint 10.48550\/arXiv.1906.08172","DOI":"10.48550\/arXiv.1906.08172"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/QOMEX.2010.5518040"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025664"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-021-01196-4"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3169175"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647393"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3698131","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3698131","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:17Z","timestamp":1750295837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3698131"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,24]]},"references-count":63,"journal-issue":{"issue":"ISS","published-print":{"date-parts":[[2024,10,24]]}},"alternative-id":["10.1145\/3698131"],"URL":"https:\/\/doi.org\/10.1145\/3698131","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,24]]},"assertion":[{"value":"2024-10-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}