{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T12:27:54Z","timestamp":1765369674402,"version":"3.40.3"},"publisher-location":"Cham","reference-count":35,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030588045"},{"type":"electronic","value":"9783030588052"}],"license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":247,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In recent years, assistive technology and digital accessibility for blind and visually impaired people (BVIP) has been significantly improved. Yet, group discussions, especially in a business context, are still challenging as non-verbal communication (NVC) is often depicted on digital whiteboards, including deictic gestures paired with visual artifacts. However, as NVC heavily relies on the visual perception, whichrepresents a large amount of detail, an adaptive approach is required that identifies the most relevant information for BVIP. Additionally, visual artifacts usually rely on spatial properties such as position, orientation, and dimensions to convey essential information such as hierarchy, cohesion, and importance that is often not accessible to the BVIP. In this paper, we investigate the requirements of BVIP during brainstorming sessions and, based on our findings, provide an accessible multimodal tool that uses non-verbal and spatial cues as an additional layer of information. Further, we contribute by presenting a set of input and output modalities that encode and decode information with respect to the individual demands of BVIP and the requirements of different use cases.<\/jats:p>","DOI":"10.1007\/978-3-030-58805-2_2","type":"book-chapter","created":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T12:02:54Z","timestamp":1599739374000},"page":"11-20","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Accessible Multimodal Tool Support for Brainstorming Meetings"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0888-917X","authenticated-orcid":false,"given":"Reinhard","family":"Koutny","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1281-2180","authenticated-orcid":false,"given":"Sebastian","family":"G\u00fcnther","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7546-1213","authenticated-orcid":false,"given":"Naina","family":"Dhingra","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6495-4327","authenticated-orcid":false,"given":"Andreas","family":"Kunz","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0072-7157","authenticated-orcid":false,"given":"Klaus","family":"Miesenberger","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4713-5327","authenticated-orcid":false,"given":"Max","family":"M\u00fchlh\u00e4user","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"issue":"4","key":"2_CR1","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1207\/s15427633scc0504_2","volume":"5","author":"MW Alibali","year":"2005","unstructured":"Alibali, M.W.: Gesture in spatial cognition: expressing, communicating, and thinking about spatial information. Spat. Cogn. Comput. 5(4), 307\u2013331 (2005). https:\/\/doi.org\/10.1207\/s15427633scc0504_2","journal-title":"Spat. Cogn. Comput."},{"key":"2_CR2","doi-asserted-by":"publisher","unstructured":"Baldwin, M.S., Hayes, G.R., Haimson, O.L., Mankoff, J., Hudson, S.E.: The tangible desktop: a multimodal approach to nonvisual computing. ACM Trans. Access. Comput. 10(3) (2017). https:\/\/doi.org\/10.1145\/3075222","DOI":"10.1145\/3075222"},{"issue":"1","key":"2_CR3","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1075\/gest.6.1.05ban","volume":"6","author":"A Bangerter","year":"2006","unstructured":"Bangerter, A., Oppenheimer, D.M.: Accuracy in detecting referents of pointing gestures unaccompanied by language. Gesture 6(1), 85\u2013102 (2006). https:\/\/doi.org\/10.1075\/gest.6.1.05ban","journal-title":"Gesture"},{"key":"2_CR4","unstructured":"Bates, E.: The Emergence of Symbols: Cognition and Communication in Infancy. Language, Thought, and Culture: Advances in the Study of Cognition. Academic Press, New York (1979). https:\/\/books.google.de\/books?id=_45-AAAAMAAJ"},{"key":"2_CR5","doi-asserted-by":"publisher","unstructured":"Bolt, R.A.: Put-that-there: voice and gesture at the graphics interface. In: Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1980, pp. 262\u2013270. ACM, New York (1980). https:\/\/doi.org\/10.1145\/800250.807503","DOI":"10.1145\/800250.807503"},{"key":"2_CR6","unstructured":"Brannigan, C.R., Humphries, D.A., Jones, B.: Ethological studies of child behaviour, pp. 37\u201364. Cambridge University Press, Cambridge (1972)"},{"issue":"1","key":"2_CR7","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1111\/j.2044-835X.1991.tb00862.x","volume":"9","author":"G Butterworth","year":"1991","unstructured":"Butterworth, G., Jarrett, N.: What minds have in common is space: spatial mechanisms serving joint visual attention in infancy. Br. J. Dev. Psychol. 9(1), 55\u201372 (1991). https:\/\/doi.org\/10.1111\/j.2044-835X.1991.tb00862.x","journal-title":"Br. J. Dev. Psychol."},{"key":"2_CR8","doi-asserted-by":"crossref","unstructured":"Dhingra, N., Kunz, A.: Res3ATN-deep 3D residual attention network for hand gesture recognition in videos. In: 2019 International Conference on 3D Vision (3DV), pp. 491\u2013501. IEEE (2019)","DOI":"10.1109\/3DV.2019.00061"},{"key":"2_CR9","doi-asserted-by":"crossref","unstructured":"Dhingra, N., Valli, E., Kunz, A.: Recognition and localisation of pointing gestures using a RGB-D camera. arXiv preprint arXiv:2001.03687 (2020)","DOI":"10.1007\/978-3-030-50726-8_27"},{"key":"2_CR10","doi-asserted-by":"publisher","unstructured":"Geronazzo, M., Bedin, A., Brayda, L., Campus, C., Avanzini, F.: Interactive spatial sonification for non-visual exploration of virtual maps. Int. J. Hum.-Comput. Stud. 85, 4\u201315 (2016). https:\/\/doi.org\/10.1016\/j.ijhcs.2015.08.004. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1071581915001287. Data Sonification and Sound Design in Interactive Systems","DOI":"10.1016\/j.ijhcs.2015.08.004"},{"key":"2_CR11","unstructured":"Goffman, E.: Encounters: Two Studies in the Sociology of Interaction. Ravenio Books (1961)"},{"key":"2_CR12","unstructured":"Groupmap - collaborative brainstorming & group decision-making (1442020). https:\/\/www.groupmap.com\/"},{"key":"2_CR13","doi-asserted-by":"publisher","unstructured":"G\u00fcnther, S., et al.: MAPVI: meeting accessibility for persons with visual impairments. In: Proceedings of the 12th PErvasive Technologies Related to Assistive Environments Conference, PETRA 2019, pp. 343\u2013353. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3316782.3322747","DOI":"10.1145\/3316782.3322747"},{"key":"2_CR14","doi-asserted-by":"publisher","unstructured":"G\u00fcnther, S., Schmitz, M., M\u00fcller, F., Riemann, J., M\u00fchlh\u00e4user, M.: BYO*: utilizing 3D printed tangible tools for interaction on interactive surfaces. In: Proceedings of the 2017 ACM Workshop on Interacting with Smart Objects, SmartObject 2017, pp. 21\u201326. ACM, New York (2017). https:\/\/doi.org\/10.1145\/3038450.3038456","DOI":"10.1145\/3038450.3038456"},{"key":"2_CR15","doi-asserted-by":"publisher","unstructured":"Guo, A., et al.: VizLens: a robust and interactive screen reader for interfaces in the real world. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST 2016, pp. 651\u2013664. ACM, New York (2016). https:\/\/doi.org\/10.1145\/2984511.2984518","DOI":"10.1145\/2984511.2984518"},{"key":"2_CR16","unstructured":"Ideaflip - realtime brainstorming and collaboration (1442020). https:\/\/ideaflip.com\/"},{"key":"2_CR17","doi-asserted-by":"publisher","unstructured":"Iranzo Bartolome, J., Cavazos Quero, L., Kim, S., Um, M.Y., Cho, J.: Exploring art with a voice controlled multimodal guide for blind people. In: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2019, pp. 383\u2013390. Association for Computing Machinery, New York (2019). https:\/\/doi.org\/10.1145\/3294109.3300994","DOI":"10.1145\/3294109.3300994"},{"key":"2_CR18","doi-asserted-by":"publisher","unstructured":"Ishii, H.: Tangible bits: beyond pixels. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, TEI 2008, pp. xv\u2013xxv. Association for Computing Machinery, New York (2008). https:\/\/doi.org\/10.1145\/1347390.1347392","DOI":"10.1145\/1347390.1347392"},{"key":"2_CR19","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/978-3-319-08596-8_38","volume-title":"Computers Helping People with Special Needs","author":"A Kunz","year":"2014","unstructured":"Kunz, A., et al.: Accessibility of brainstorming sessions for blind people. In: Miesenberger, K., Fels, D., Archambault, D., Pe\u0148\u00e1z, P., Zagler, W. (eds.) ICCHP 2014. LNCS, vol. 8547, pp. 237\u2013244. Springer, Cham (2014). https:\/\/doi.org\/10.1007\/978-3-319-08596-8_38"},{"key":"2_CR20","doi-asserted-by":"publisher","unstructured":"Lee, J., Post, R., Ishii, H.: ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 327\u2013336. Association for Computing Machinery, New York (2011). https:\/\/doi.org\/10.1145\/2047196.2047239","DOI":"10.1145\/2047196.2047239"},{"key":"2_CR21","unstructured":"Miro - mind map software built with teams in mind (1442020). https:\/\/miro.com\/"},{"key":"2_CR22","unstructured":"M\u00fcller, C., Cienki, A., Fricke, E., Ladewig, S., Mcneill, D., Tessendorf, S.: Body - Language - Communication: An International Handbook on Multimodality in Human Interaction, vol. Bd. 38.1. De Gruyter Inc., Berlin\/Boston (2013)"},{"key":"2_CR23","doi-asserted-by":"publisher","unstructured":"Pedersen, E.W., Hornb\u00e6k, K.: Tangible bots: interaction with active tangibles in tabletop interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 2975\u20132984. Association for Computing Machinery, New York (2011). https:\/\/doi.org\/10.1145\/1978942.1979384","DOI":"10.1145\/1978942.1979384"},{"key":"2_CR24","doi-asserted-by":"publisher","unstructured":"Pires, A.C., et al.: A tangible math game for visually impaired children. In: The 21st International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2019, pp. 670\u2013672. Association for Computing Machinery, New York (2019). https:\/\/doi.org\/10.1145\/3308561.3354596","DOI":"10.1145\/3308561.3354596"},{"key":"2_CR25","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1007\/978-3-319-08596-8_35","volume-title":"Computers Helping People with Special Needs","author":"S P\u00f6lzer","year":"2014","unstructured":"P\u00f6lzer, S., Miesenberger, K.: Presenting non-verbal communication to blind users in brainstorming sessions. In: Miesenberger, K., Fels, D., Archambault, D., Pe\u0148\u00e1z, P., Zagler, W. (eds.) ICCHP 2014. LNCS, vol. 8547, pp. 220\u2013225. Springer, Cham (2014). https:\/\/doi.org\/10.1007\/978-3-319-08596-8_35"},{"key":"2_CR26","unstructured":"P\u00f6lzer, S., Miesenberger, K.: A tactile presentation method of mind maps in co-located meetings. In: Proceedings of the International Workshop on Tactile\/Haptic User Interfaces for Tabletops and Tablets, Held in Conjunction with ACM ITS 2014. ACM, New York (2014)"},{"key":"2_CR27","doi-asserted-by":"publisher","unstructured":"Regal, G., Mattheiss, E., Sellitsch, D., Tscheligi, M.: TalkingCards: using tactile NFC cards for accessible brainstorming. In: Proceedings of the 7th Augmented Human International Conference 2016, AH 2016. Association for Computing Machinery, New York (2016). https:\/\/doi.org\/10.1145\/2875194.2875240","DOI":"10.1145\/2875194.2875240"},{"key":"2_CR28","doi-asserted-by":"publisher","unstructured":"Shi, L., Zhao, Y., Gonzalez Penuela, R., Kupferstein, E., Azenkot, S.: Molder: an accessible design tool for tactile maps. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI 2020, pp. 1\u201314. Association for Computing Machinery, New York (2020). https:\/\/doi.org\/10.1145\/3313831.3376431","DOI":"10.1145\/3313831.3376431"},{"issue":"1","key":"2_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0166-4328(88)90046-0","volume":"29","author":"JL Taylor","year":"1988","unstructured":"Taylor, J.L., McCloskey, D.I.: Pointing. Behav. Brain Res. 29(1), 1\u20135 (1988). https:\/\/doi.org\/10.1016\/0166-4328(88)90046-0","journal-title":"Behav. Brain Res."},{"key":"2_CR30","doi-asserted-by":"publisher","unstructured":"Thieme, A., Morrison, C., Villar, N., Grayson, M., Lindley, S.: Enabling collaboration in learning computer programing inclusive of children with vision impairments. In: Proceedings of the 2017 Conference on Designing Interactive Systems, DIS 2017, pp. 739\u2013752. Association for Computing Machinery, New York (2017). https:\/\/doi.org\/10.1145\/3064663.3064689","DOI":"10.1145\/3064663.3064689"},{"key":"2_CR31","unstructured":"Yu, W., Kangas, K., Brewster, S.: Web-based haptic applications for blind people to create virtual graphs. In: 2003 Proceedings of the 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS 2003, pp. 318\u2013325 (2003)"},{"key":"2_CR32","doi-asserted-by":"publisher","unstructured":"Weiss, M., Remy, C., Borchers, J.: Rendering physical effects in tabletop controls. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 3009\u20133012. Association for Computing Machinery, New York (2011). https:\/\/doi.org\/10.1145\/1978942.1979388","DOI":"10.1145\/1978942.1979388"},{"key":"2_CR33","doi-asserted-by":"publisher","unstructured":"Weiss, M., Schwarz, F., Jakubowski, S., Borchers, J.: Madgets: actuating widgets on interactive tabletops. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 293\u2013302. Association for Computing Machinery, New York (2010). https:\/\/doi.org\/10.1145\/1866029.1866075","DOI":"10.1145\/1866029.1866075"},{"key":"2_CR34","doi-asserted-by":"publisher","unstructured":"Willis, S., Helal, S.: RFID information grid for blind navigation and wayfinding. In: Ninth IEEE International Symposium on Wearable Computers (ISWC 2005), pp. 34\u201337. IEEE, New York (2005). https:\/\/doi.org\/10.1109\/ISWC.2005.46","DOI":"10.1109\/ISWC.2005.46"},{"key":"2_CR35","doi-asserted-by":"publisher","unstructured":"Zhai, S., Morimoto, C., Ihde, S.: Manual and gaze input cascaded (magic) pointing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1999, pp. 246\u2013253. ACM, New York (1999). https:\/\/doi.org\/10.1145\/302979.303053","DOI":"10.1145\/302979.303053"}],"container-title":["Lecture Notes in Computer Science","Computers Helping People with Special Needs"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-58805-2_2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T09:04:16Z","timestamp":1670231056000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-58805-2_2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"ISBN":["9783030588045","9783030588052"],"references-count":35,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-58805-2_2","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2020]]},"assertion":[{"value":"4 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ICCHP","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Computers Helping People with Special Needs","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Lecco","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Italy","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"9 September 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 September 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"17","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"icchp2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/www.icchp.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Self-developed management system","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"206","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"107","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"52% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"8","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"No","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Only 104 papers of the 107 are included in the ICCHP 2020 proceedings. 13 introductory papers are included. The conference was held virtually due to the COVID-19 pandemic.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}