{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:00:22Z","timestamp":1777888822535,"version":"3.51.4"},"reference-count":63,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SCS"],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:p>Billions of people live with visual and\/or hearing impairments. Regrettably, their access to systems remains delayed, leaving them socially excluded. The need for universal access of next-generation systems and users\u2019 inclusion is paramount. We pose that a smart society should respond to this crucial need. Following ability-based design principles, we introduce a simulated social robot that adapts to users\u2019 sensory abilities. Its working was assessed via a Rock\u2013Paper\u2013Scissors game in an Intelligent Environment (IE), using three modes: where the user is able to see and hear, only see, or only hear. With this game, two user-studies were conducted using the UMUX-LITE usability score, an expectation rating, and the gap between experience and expectation, complemented with two open questions. A repeated measures Multivariate ANalysis Of VAriance (MANOVA) on the data from study 1 unveiled an overall difference between the three modes, F ( 6 , 6 ) = 6.823, \u03b7 p 2 = .872, p = .017. Users expected applications to be harder to use with a disability, especially a visual impairment. All modes were considered accessible, with the experience exceeding expectations for the mode with a hearing impairment. In parallel, substantial variance was observed across participants and the results from the open questions suggested improvements. To reduce this variance and increase system stability, study 2 was run with an enhanced design. A repeated measures MANOVA on the data from study 2 confirmed study 1\u2019s findings, F ( 6 , 6 ) = 12.801, \u03b7 p 2 = .928, p = .003. Moreover, experiences exceeded expectations in all modes and the variance among participants was substantially decreased. We conclude that IE applications managed by a social robot can be adapted to user\u2019s sensory abilities, improving smart society\u2019s accessibility, and, hence, reducing social exclusion.<\/jats:p>","DOI":"10.3233\/scs-230019","type":"journal-article","created":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T11:17:38Z","timestamp":1709291858000},"page":"3-21","source":"Crossref","is-referenced-by-count":2,"title":["Handling sensory disabilities in a smart society"],"prefix":"10.1177","volume":"3","author":[{"given":"Julie","family":"Pivin-Bachler","sequence":"first","affiliation":[{"name":"Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands"}]},{"given":"Egon L.","family":"van den Broek","sequence":"additional","affiliation":[{"name":"Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands"}]},{"given":"Randy","family":"Gomez","sequence":"additional","affiliation":[{"name":"Honda Research Institute, Honda, Japan"}]}],"member":"179","reference":[{"key":"10.3233\/SCS-230019_ref1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40250-5_13"},{"key":"10.3233\/SCS-230019_ref2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-22009-9_480"},{"issue":"2","key":"10.3233\/SCS-230019_ref3","doi-asserted-by":"publisher","first-page":"1614","DOI":"10.1007\/s10015-011-0895-y","article-title":"A playmate robot system for playing the rock-paper-scissors game with humans","volume":"16","author":"Ahn","year":"2011","journal-title":"Artificial Life and Robotics"},{"key":"10.3233\/SCS-230019_ref4","unstructured":"W.\u00a0Albert and E.\u00a0Dixon, Is this what you expected? The use of expectation measures in usability testing, in: Proceedings of UPA 2003: 12th Annual UPA Conference, Usability Professionals Association, Scottsdale, AZ, USA, 2003, p.\u00a010."},{"key":"10.3233\/SCS-230019_ref5","doi-asserted-by":"publisher","DOI":"10.1186\/2192-1962-3-12"},{"issue":"6","key":"10.3233\/SCS-230019_ref6","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","year":"2008","journal-title":"International Journal of Human\u2013Computer Interaction"},{"issue":"3","key":"10.3233\/SCS-230019_ref7","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1145\/3519032","article-title":"\u201cEvery website is a puzzle!\u201d: Facilitating access to common website features for people with visual impairments","volume":"15","author":"Barbosa","year":"2022","journal-title":"ACM Transactions on Accessible Computing"},{"issue":"1","key":"10.3233\/SCS-230019_ref8","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1109\/TASLP.2019.2957871","article-title":"Subjective and objective assessment of full bandwidth speech quality","volume":"28","author":"Beerends","year":"2020","journal-title":"IEEE\/ACM Transactions on Audio, Speech and Language Processing"},{"key":"10.3233\/SCS-230019_ref9","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1080\/10400435.2021.1945705","article-title":"Accessibility to digital technology: Virtual barriers, real opportunities","volume":"33","author":"Botelho","year":"2021","journal-title":"Assistive Technology"},{"key":"10.3233\/SCS-230019_ref10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-48843-6_3"},{"key":"10.3233\/SCS-230019_ref11","doi-asserted-by":"publisher","DOI":"10.1145\/3434074.3447177"},{"key":"10.3233\/SCS-230019_ref12","doi-asserted-by":"publisher","DOI":"10.1186\/s12955-019-1096-y"},{"issue":"2","key":"10.3233\/SCS-230019_ref13","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1007\/s10209-021-00797-0","article-title":"Intelligent Environments for all: A path towards technology-enhanced human well-being","volume":"21","author":"Burzagli","year":"2022","journal-title":"Universal Access in the Information Society"},{"issue":"1","key":"10.3233\/SCS-230019_ref14","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1007\/s10209-006-0027-y","article-title":"Ambient multimodality: Towards advancing computer accessibility and assisted living","volume":"5","author":"Carbonell","year":"2006","journal-title":"Universal Access in the Information Society"},{"issue":"2","key":"10.3233\/SCS-230019_ref15","doi-asserted-by":"publisher","first-page":"135","DOI":"10.3233\/SCS-210123","article-title":"Understanding social sustainability for smart cities: The importance of inclusion, equity, and citizen participation as both inputs and long-term outcomes","volume":"1","author":"Chen","year":"2022","journal-title":"Journal of Smart Cities and Society"},{"key":"10.3233\/SCS-230019_ref16","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-023-00969-0"},{"issue":"2","key":"10.3233\/SCS-230019_ref17","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1007\/s40860-020-00119-w","article-title":"Apollo SignSound: An intelligent system applied to ubiquitous healthcare of deaf people","volume":"7","author":"da Rosa Tavares","year":"2021","journal-title":"Journal of Reliable Intelligent Environments"},{"key":"10.3233\/SCS-230019_ref18","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2005.1545189"},{"issue":"12","key":"10.3233\/SCS-230019_ref19","doi-asserted-by":"publisher","first-page":"1476","DOI":"10.1016\/j.robot.2013.07.007","article-title":"Exploring influencing variables for the acceptance of social robots","volume":"61","author":"de\u00a0Graaf","year":"2013","journal-title":"Robotics and Autonomous Systems"},{"key":"10.3233\/SCS-230019_ref20","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-444-82332-8.X5000-8"},{"issue":"4","key":"10.3233\/SCS-230019_ref21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3447242","article-title":"A survey of ambient intelligence","volume":"54","author":"Dunne","year":"2022","journal-title":"ACM Computing Surveys"},{"issue":"3","key":"10.3233\/SCS-230019_ref22","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1147\/sj.443.0605","article-title":"Universal access to ambient intelligence environments: Opportunities and challenges for people with disabilities","volume":"44","author":"Emiliani","year":"2005","journal-title":"IBM Systems Journal"},{"key":"10.3233\/SCS-230019_ref23","doi-asserted-by":"publisher","DOI":"10.3390\/s23062968"},{"issue":"4","key":"10.3233\/SCS-230019_ref24","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1111\/j.1471-3802.2011.01230.x","article-title":"Technology for people, not disabilities: Ensuring access and inclusion","volume":"12","author":"Foley","year":"2012","journal-title":"Journal of Research in Special Educational Needs"},{"key":"10.3233\/SCS-230019_ref25","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171288"},{"issue":"2","key":"10.3233\/SCS-230019_ref26","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1007\/s10209-018-0642-4","article-title":"The use and acceptance of ICT by senior citizens: A comparison of technology acceptance model (TAM) for elderly and young adults","volume":"19","author":"Guner","year":"2020","journal-title":"Universal Access in the Information Society"},{"key":"10.3233\/SCS-230019_ref27","doi-asserted-by":"publisher","DOI":"10.1109\/ISIE.2007.4374926"},{"issue":"2","key":"10.3233\/SCS-230019_ref28","doi-asserted-by":"publisher","first-page":"189","DOI":"10.31887\/DCNS.2020.22.2\/mhilbert","article-title":"Digital technology and social change: The digital transformation of society from a historical perspective","volume":"22","author":"Hilbert","year":"2020","journal-title":"Dialogues in Clinical Neuroscience"},{"issue":"1","key":"10.3233\/SCS-230019_ref29","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1007\/s10209-020-00714-x","article-title":"Disability digital divide: The use of the Internet, smartphones, computers and tablets among people with disabilities in Sweden","volume":"20","author":"Johansson","year":"2021","journal-title":"Universal Access in the Information Society"},{"key":"10.3233\/SCS-230019_ref30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-16450-8_9"},{"issue":"4","key":"10.3233\/SCS-230019_ref31","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1016\/j.compind.2009.12.002","article-title":"A design-and-play approach to accessible user interface development in ambient intelligence environments","volume":"61","author":"Kartakis","year":"2010","journal-title":"Computers in Industry"},{"key":"10.3233\/SCS-230019_ref32","doi-asserted-by":"publisher","DOI":"10.1177\/02646196231158919"},{"key":"10.3233\/SCS-230019_ref33","doi-asserted-by":"publisher","DOI":"10.1080\/07434618.2018.1556730"},{"issue":"4","key":"10.3233\/SCS-230019_ref34","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1145\/3636513","article-title":"Measuring the accuracy of automatic speech recognition solutions","volume":"16","author":"Kuhn","year":"2024","journal-title":"ACM Transactions on Accessible Computing"},{"issue":"3","key":"10.3233\/SCS-230019_ref35","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1163\/156855302760121936","article-title":"Intelligent space\u00a0\u2013 concept and contents","volume":"16","author":"Lee","year":"2002","journal-title":"Advanced Robotics"},{"key":"10.3233\/SCS-230019_ref36","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481287"},{"issue":"15\u201316","key":"10.3233\/SCS-230019_ref37","doi-asserted-by":"publisher","first-page":"4454","DOI":"10.1111\/jocn.16572","article-title":"Individuals with hearing impairment\/deafness during the COVID-19 pandemic: A rapid review on communication challenges and strategies","volume":"32","author":"Mansutti","year":"2023","journal-title":"Journal of Clinical Nursing"},{"key":"10.3233\/SCS-230019_ref38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10209-014-0348-1","article-title":"Universal access in the information society international journal technology acceptance model: A literature review from 1986 to 2013","volume":"14","author":"Maranguni\u0107","year":"2014","journal-title":"Universal Access in the Information Society"},{"key":"10.3233\/SCS-230019_ref39","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376270"},{"key":"10.3233\/SCS-230019_ref40","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-10780-1_25"},{"issue":"5","key":"10.3233\/SCS-230019_ref41","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1145\/1230819.1241668","article-title":"Universal accessibility as a multimodal design issue","volume":"50","author":"Obrenovi\u0107","year":"2007","journal-title":"Communications of the ACM"},{"issue":"3","key":"10.3233\/SCS-230019_ref42","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1080\/10447318.2022.2153320","article-title":"Six human-centered artificial intelligence grand challenges","volume":"39","author":"Ozmen Garibay","year":"2023","journal-title":"International Journal of Human\u2013Computer Interaction"},{"issue":"3","key":"10.3233\/SCS-230019_ref43","doi-asserted-by":"publisher","first-page":"1059","DOI":"10.1007\/s10209-022-00867-x","article-title":"Research on vulnerable people and digital inclusion: Toward a consolidated taxonomical framework","volume":"22","author":"P\u00e9rez-Escolar","year":"2023","journal-title":"Universal Access in the Information Society"},{"issue":"1","key":"10.3233\/SCS-230019_ref44","doi-asserted-by":"publisher","first-page":"1471","DOI":"10.1186\/s12889-023-15094-z","article-title":"Disability digital divide: Survey of accessibility of eHealth services as perceived by people with and without impairment","volume":"23","author":"Pettersson","year":"2023","journal-title":"BMC Public Health"},{"key":"10.3233\/SCS-230019_ref45","doi-asserted-by":"publisher","DOI":"10.3233\/AISE230031"},{"issue":"1","key":"10.3233\/SCS-230019_ref46","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1145\/3575662","article-title":"\u201cIt could be better. It could be much worse\u201d: Understanding accessibility in user experience practice with implications for industry and education","volume":"16","author":"Putnam","year":"2023","journal-title":"ACM Transactions on Accessible Computing"},{"key":"10.3233\/SCS-230019_ref47","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-24667-8_16"},{"issue":"5","key":"10.3233\/SCS-230019_ref48","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1177\/0194599820910377","article-title":"Hearing loss, loneliness, and social isolation: A systematic review, otolaryngology\u2013head and neck surgery","volume":"162","author":"Shukla","year":"2020","journal-title":"Official journal of American Academy of Otolaryngology-Head and Neck Surgery"},{"key":"10.3233\/SCS-230019_ref49","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1080\/10447310902865032","article-title":"Designing for all in ambient intelligence environments: The interplay of user, context, and technology","volume":"25","author":"Stephanidis","year":"2009","journal-title":"Int. J. Hum. Comput. Interaction"},{"issue":"14","key":"10.3233\/SCS-230019_ref50","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1080\/10447318.2019.1619259","article-title":"Seven HCI grand challenges","volume":"35","author":"Stephanidis","year":"2019","journal-title":"International Journal of Human\u2013Computer Interaction"},{"key":"10.3233\/SCS-230019_ref51","unstructured":"K.\u00a0Tuinenbreijer, Selfish agents and the butler paradigm, in: Social Intelligence Design 2004, A.\u00a0Nijholt and T.\u00a0Nishida, eds, 2004, pp.\u00a0197\u2013199, ISSN 0929\u20130672. ISBN 90-75296-12-6."},{"issue":"2","key":"10.3233\/SCS-230019_ref52","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1075\/is.11.2.16van","article-title":"Robot nannies: Future or fiction?","volume":"11","author":"van den Broek","year":"2010","journal-title":"Interaction Studies"},{"key":"10.3233\/SCS-230019_ref53","doi-asserted-by":"publisher","DOI":"10.5220\/0006345506110616"},{"issue":"3","key":"10.3233\/SCS-230019_ref55","doi-asserted-by":"publisher","first-page":"287","DOI":"10.3233\/AIS-2009-0034","article-title":"Unobtrusive Sensing of Emotions (USE)","volume":"1","author":"van den Broek","year":"2009","journal-title":"Journal of Ambient Intelligence and Smart Environments"},{"issue":"2","key":"10.3233\/SCS-230019_ref56","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1007\/s00779-011-0468-z","article-title":"Cross-validation of bi-modal health-related stress assessment","volume":"17","author":"van den Broek","year":"2013","journal-title":"Personal and Ubiquitous Computing"},{"issue":"6","key":"10.3233\/SCS-230019_ref57","doi-asserted-by":"publisher","first-page":"1055","DOI":"10.1016\/j.apergo.2009.04.012","article-title":"Considerations for emotion-aware consumer products","volume":"40","author":"van den Broek","year":"2009","journal-title":"Applied Ergonomics"},{"issue":"1","key":"10.3233\/SCS-230019_ref58","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1002\/asi.24657","article-title":"Feedback beyond accuracy: Using eye-tracking to detect comprehensibility and interest during reading","volume":"74","author":"van der Sluis","year":"2023","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"9","key":"10.3233\/SCS-230019_ref59","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1080\/0144929X.2018.1505954","article-title":"Enhancing the quality of service of mobile video technology by increasing multimodal synergy","volume":"37","author":"van der Sluis","year":"2018","journal-title":"Behaviour & Information Technology"},{"issue":"6","key":"10.3233\/SCS-230019_ref60","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1145\/3148051","article-title":"Ability-based design","volume":"61","author":"Wobbrock","year":"2018","journal-title":"Communications of the ACM"},{"issue":"3","key":"10.3233\/SCS-230019_ref61","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1145\/1952383.1952384","article-title":"Ability-based design: Concept, principles and examples","volume":"3","author":"Wobbrock","year":"2011","journal-title":"ACM Transactions on Accessible Computing"},{"key":"10.3233\/SCS-230019_ref62","unstructured":"World Health Organization, World Report on Vision, World Health Organization, Geneva, 2019, ISBN 978-92-4-151657-0. Available online, https:\/\/apps.who.int\/iris\/handle\/10665\/328717 (last accessed on 25\/09\/2023)."},{"key":"10.3233\/SCS-230019_ref63","unstructured":"World Health Organization, World Report on Hearing, World Health Organization, Geneva, 2021, ISBN 978-92-4-002049-8. Available online, https:\/\/www.who.int\/publications\/i\/item\/9789240020481 (last accessed on 25\/09\/2023)."},{"issue":"2","key":"10.3233\/SCS-230019_ref64","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s10209-003-0045-y","article-title":"Multimodality and interactional differences in older adults","volume":"2","author":"Zajicek","year":"2003","journal-title":"Universal Access in the Information Society"}],"container-title":["Journal of Smart Cities and Society"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SCS-230019","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T04:58:55Z","timestamp":1777611535000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SCS-230019"}},"subtitle":["The case of a simulated social robot"],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":63,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/scs-230019","relation":{},"ISSN":["2772-3585","2772-3577"],"issn-type":[{"value":"2772-3585","type":"electronic"},{"value":"2772-3577","type":"print"}],"subject":[],"published":{"date-parts":[[2024,3,1]]}}}