{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T01:29:27Z","timestamp":1772846967009,"version":"3.50.1"},"reference-count":69,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T00:00:00Z","timestamp":1677628800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,8,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Accessibility--&amp;gt; inspection methods provide an important complement to user evaluations in the development of interactive systems. However, many inspection methods tend to focus on violations of guidelines and are limited in conveying the impact of such problems when delivering their results. Drawing from the theoretical framework of Semiotic Engineering of Human\u2013Computer Interaction, this paper presents SIM-SR\u2014Semiotic Inspection Method Mediated by Screen Reader and an investigation to collect indicators about the method\u2019s applicability and insights it can generate. In order to assess its applicability, we conducted three case studies employing the method, analysing how aspects of accessibility and communicability were approached and results generated. Regarding SIM-SR insights, we used WCAG 2.1 criteria to discuss how communicative breakdowns relate to accessibility guidelines and their impact. Our results show that SIM-SR went beyond identifying guidelines violations and led evaluators to consider the impact of accessibility issues on the system\u2019s communicability and different levels of communicative breakdowns that users with visual disabilities could experience during interaction.<\/jats:p>","DOI":"10.1093\/iwc\/iwad023","type":"journal-article","created":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T21:21:27Z","timestamp":1675372887000},"page":"276-300","source":"Crossref","is-referenced-by-count":3,"title":["SIM-SR\u2014Semiotic Inspection Method Mediated by Screen Reader: Analysing the Benefits of Bringing Communicability to the Accessibility Evaluation Table"],"prefix":"10.1093","volume":"35","author":[{"given":"Lucas","family":"Pedroso Carvalho","sequence":"first","affiliation":[{"name":"Computer Science Department , Federal University of Minas Gerais, Belo Horizonte, MG, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joana Gabriela","family":"Ribeiro de Souza","sequence":"additional","affiliation":[{"name":"Computer Science Department , Federal University of Minas Gerais, Belo Horizonte, MG, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raquel","family":"Oliveira Prates","sequence":"additional","affiliation":[{"name":"Computer Science Department , Federal University of Minas Gerais, Belo Horizonte, MG, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andr\u00e9","family":"Pimenta Freire","sequence":"additional","affiliation":[{"name":"Computer Science Department , Federal University of Lavras, Lavras, MG 37203-202, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,3,4]]},"reference":[{"key":"2023091910475314800_ref1","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/978-1-4471-7440-0_26","article-title":"Tools for web accessibility evaluation","volume-title":"Web Accessibility: A Foundation for Research","author":"Abascal","year":"2019"},{"key":"2023091910475314800_ref2","first-page":"172","article-title":"Web accessibility challenges","volume":"7","author":"Abuaddous","year":"2016","journal-title":"Int. J. Adv. Comput. Sci. Appl. (IJACSA)"},{"key":"2023091910475314800_ref3","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1109\/ICEDEG.2018.8372368","article-title":"Framework for accessibility evaluation of hospital websites","volume-title":"2018 International Conference on eDemocracy & eGovernment (ICEDEG)","author":"Acosta-Vargas","year":"2018"},{"key":"2023091910475314800_ref4","doi-asserted-by":"crossref","first-page":"125634","DOI":"10.1109\/ACCESS.2019.2939068","article-title":"A heuristic method to evaluate web accessibility for users with low vision","volume":"7","author":"Acosta-Vargas","year":"2019","journal-title":"IEEE Access"},{"key":"2023091910475314800_ref5","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1007\/978-3-319-73450-7_57","article-title":"Toward a combined method for evaluation of web accessibility","volume-title":"Proceedings of the International Conference on Information Technology & Systems (ICITS 2018)","author":"Acosta-Vargas","year":"2018"},{"key":"2023091910475314800_ref6","first-page":"632","article-title":"Combined method for accessibility evaluation in tele-rehabilitation platforms for low vision users","volume-title":"International Conference on Intelligent Human Systems Integration 2021","author":"Acosta-Vargas","year":"2021"},{"key":"2023091910475314800_ref7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1805986.1806000","article-title":"On the testability of WCAG 2.0 for beginners","volume-title":"Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), W4A \u201910","author":"Alonso","year":"2010"},{"key":"2023091910475314800_ref8","first-page":"71","article-title":"A survey on accessibility awareness of brazilian web developers","volume-title":"Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion, DSAI 2018","author":"Antonelli","year":"2018"},{"key":"2023091910475314800_ref9","volume-title":"Human\u2013Computer Interaction (in Portuguese: Intera\u00e7\u00e3o Humano-Computador)","author":"Barbosa","year":"2010"},{"key":"2023091910475314800_ref10","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1109\/LA-WEB.2009.26","article-title":"Using semiotic inspection method to evaluate a human-robot interface","volume-title":"In 2009 Latin American Web Congress","author":"Bento","year":"2009"},{"key":"2023091910475314800_ref11","first-page":"113","article-title":"A comparative test of web accessibility evaluation methods","author":"Brajnik","year":"2008","journal-title":"Proceedings Of The 10th International ACM SIGACCESS Conference On Computers And Accessibility"},{"key":"2023091910475314800_ref12","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/978-3-540-85200-1_9","article-title":"Beyond conformance: the role of accessibility evaluation methods","volume-title":"Web Information Systems Engineering\u2014WISE 2008 Workshops","author":"Brajnik","year":"2008"},{"key":"2023091910475314800_ref13","article-title":"Barrier Walkthrough: heuristic evaluation guided by accessibility barriers","author":"Brajnik","year":"2009"},{"key":"2023091910475314800_ref14","first-page":"246","article-title":"The expertise effect on web accessibility evaluation methods","volume":"26","author":"Brajnik","year":"2011","journal-title":"Hum.\u2013Comput. Interact."},{"key":"2023091910475314800_ref15","article-title":"Web accessibility initiative: ageing education and harmonisation (WAI-AGE)","author":"Brewer","year":"2010"},{"key":"2023091910475314800_ref16","article-title":"Web content accessibility guidelines (WCAG) 2.0","author":"Caldwell","year":"2008"},{"key":"2023091910475314800_ref17","first-page":"77","article-title":"Beyond web content accessibility guidelines: expert accessibility reviews","author":"Calvo","year":"2016","journal-title":"Proceedings of the 7th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion"},{"key":"2023091910475314800_ref18","doi-asserted-by":"crossref","first-page":"91676","DOI":"10.1109\/ACCESS.2020.2994288","article-title":"Empirical studies on web accessibility of educational websites: a systematic literature review","volume":"8","author":"Campoverde-Molina","year":"2020","journal-title":"IEEE Access"},{"key":"2023091910475314800_ref19","doi-asserted-by":"crossref","first-page":"17:1","DOI":"10.1145\/3033701.3033718","article-title":"Accessible smart cities? Inspecting the accessibility of Brazilian municipalities\u2019 mobile applications","volume-title":"Proceedings of the 15th Brazilian Symposium on Human Factors in Computer Systems, IHC\u201916","author":"Carvalho","year":"2016"},{"key":"2023091910475314800_ref20","doi-asserted-by":"crossref","DOI":"10.1145\/3357155.3358455","article-title":"A proposal to adapt the semiotic inspection method to analyze screen reader mediated interaction","volume-title":"Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC\u201919","author":"Carvalho","year":"2019"},{"key":"2023091910475314800_ref21","volume-title":"Use of the Semiotic Inspection Method Mediated by Screen Readers in the TudoGostoso website (in Portuguese\u2014Aplica\u00e7\u00e3o do M\u00e9todo de Inspe\u00e7\u00e3o Semi\u00f3tica Mediado por Leitores de Tela ao Site TudoGostoso)","author":"Carvalho","year":"2021"},{"key":"2023091910475314800_ref22","first-page":"1","article-title":"Beyond barriers: a practical analysis of the SIM-SR method to inspect the communicability of interactive systems for visually impaired users","volume-title":"Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems","author":"Carvalho","year":"2021"},{"key":"2023091910475314800_ref23","first-page":"1","article-title":"A challenge to web accessibility metrics and guidelines: putting people and processes first","author":"Cooper","year":"2012","journal-title":"Proceedings of the International Cross-Disciplinary Conference on Web Accessibility"},{"key":"2023091910475314800_ref24","first-page":"47","article-title":"Using SIM to evaluate sound signs: when a communicability problem becomes an accessibility problem (in Portuguese: Uso do MIS Para Avaliar Signos Sonoros: Quando um Problema de Comunicabilidade se Torna um Problema de Acessibilidade)","author":"Corr\u00eaa","year":"2012","journal-title":"Proceedings of The 11th Brazilian Symposium on Human Factors In Computing Systems"},{"key":"2023091910475314800_ref25","volume-title":"Evaluating and Investigating Game Accessibility for Deaf Players with the Semiotic Inspection Method","author":"Coutinho","year":"2012"},{"key":"2023091910475314800_ref26","volume-title":"Research Design: Qualitative, Quantitative, and Mixed Methods Approaches","author":"Creswell","year":"2009"},{"key":"2023091910475314800_ref27","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1590\/S0104-65002000000200004","article-title":"Missing and declining affordances: are these appropriate concepts?","volume":"7","author":"de Souza","year":"2000","journal-title":"J. Braz. Comput. Soc."},{"key":"2023091910475314800_ref28","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/6175.001.0001","volume-title":"The Semiotic Engineering of Human\u2013Computer Interaction","author":"de Souza","year":"2005"},{"key":"2023091910475314800_ref29","first-page":"148","article-title":"The semiotic inspection method","volume-title":"In Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems, IHC \u201906","author":"de Souza","year":"2006"},{"key":"2023091910475314800_ref30","first-page":"1","article-title":"Semiotic engineering methods for scientific research in HCI synthesis lectures on human-centered informatics","author":"de Souza","year":"2009"},{"key":"2023091910475314800_ref31","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.ijhcs.2009.08.006","article-title":"Can inspection methods generate valid new knowledge in HCI? The case of semiotic inspection","volume":"68","author":"de Souza","year":"2010","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"2023091910475314800_ref32","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-42831-4","volume-title":"Software Developers as Users","author":"de Souza","year":"2016"},{"key":"2023091910475314800_ref33","article-title":"Second Brazilian Survey on the Use of Screen Readers (in Portuguese)","author":"Everis","year":"2020"},{"key":"2023091910475314800_ref34","doi-asserted-by":"crossref","DOI":"10.4135\/9781526441867","volume-title":"Analyzing Qualitative Data","author":"Gibbs","year":"2018"},{"key":"2023091910475314800_ref35","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1145\/1061811.1061824","article-title":"Platform-independent accessibility API: accessible document object model","volume-title":"Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A), W4A \u201905","author":"Gonzalez","year":"2005"},{"key":"2023091910475314800_ref36","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1207\/S15327590IJHC1501_13","article-title":"Criteria for evaluating usability evaluation methods","volume":"15","author":"Hartson","year":"2003","journal-title":"Int. J. Hum.\u2013Comput. Interact."},{"key":"2023091910475314800_ref37","first-page":"105","article-title":"Accessibility in practice: a process-driven approach to accessibility","volume-title":"In 7th Cambridge Workshop on Universal Access and Assistive Technology (CWUAAT \u201914)","author":"Horton","year":"2014"},{"key":"2023091910475314800_ref38","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvpwhg1z","volume-title":"The Essential Peirce, Volume 1 & 2","author":"Houser","year":"1992-1998"},{"key":"2023091910475314800_ref39","first-page":"268","article-title":"Accessibility of Indian universities\u2019 homepages: an exploratory study","volume":"30","author":"Ismail","year":"2018","journal-title":"J. King Saudi Univ. Comput. Inf. Sci."},{"key":"2023091910475314800_ref40","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1007\/s10209-017-0541-0","article-title":"Accessibility evaluation of top university websites: a comparative study of Kyrgyzstan, Azerbaijan, Kazakhstan and Turkey","volume":"17","author":"Ismailova","year":"2018","journal-title":"Univ. Access Inf. Soc."},{"key":"2023091910475314800_ref41","article-title":"ISO 9241-171:2008\u2014ergonomics of human\u2013system interaction","volume-title":"Part 171: Guidance on software accessibility","author":"ISO","year":"2008"},{"key":"2023091910475314800_ref42","article-title":"Web Content Accessibility Guidelines (WCAG) 2.1","volume-title":"World Wide Web Consortium (W3C) Recommendation","author":"Kirkpatrick","year":"2018"},{"key":"2023091910475314800_ref43","volume-title":"Ensuring Digital Accessibility Through Process and Policy","author":"Lazar","year":"2015"},{"key":"2023091910475314800_ref44","first-page":"43","article-title":"The use of qualitative methods in computing (in Portuguese\u2014a Aplica\u00e7\u00e3o de M\u00e9todos Qualitativos em Computa\u00e7\u00e3o)","volume":"2017","author":"Leit\u00e3o","year":"2017","journal-title":"J. Atualiz. Inform."},{"key":"2023091910475314800_ref45","doi-asserted-by":"crossref","DOI":"10.1016\/j.jss.2021.110942","article-title":"Accessibility in the mobile development industry in Brazil: awareness, knowledge, adoption, motivations and barriers","volume":"177","author":"Leite","year":"2021","journal-title":"J. Syst. Softw."},{"key":"2023091910475314800_ref46","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1145\/1054972.1054979","article-title":"Is your web page accessible? A comparative study of methods for assessing web page accessibility for the blind","volume-title":"Proceedings of the SIGCHI Conference on Human factors in Computing Systems","author":"Mankoff","year":"2005"},{"key":"2023091910475314800_ref47","first-page":"53","article-title":"Investigating the applicability of the semiotic inspection method to collaborative systems","volume-title":"2009 Brazilian Symposium of Collaborative Systems","author":"Mattos","year":"2009"},{"key":"2023091910475314800_ref48","article-title":"An extension of the communicability evaluation method for collaborative systems (in Portuguese\u2014Uma extens\u00e3o do m\u00e9todo de avalia\u00e7\u00e3o de comunicabilidade para sistemas colaborativos)","author":"Mattos","year":"2010"},{"key":"2023091910475314800_ref49","doi-asserted-by":"crossref","DOI":"10.1145\/259963.260531","volume-title":"Usability Inspection Methods","author":"Nielsen","year":"1994"},{"key":"2023091910475314800_ref50","first-page":"226","article-title":"Web accessibility evaluation methods: a systematic review","volume-title":"International Conference on Human\u2013Computer Interaction","author":"Nu\u00f1ez","year":"2019"},{"key":"2023091910475314800_ref51","volume-title":"The Essential Peirce: Selected Philosophical Writings","author":"Peirce","year":"1992"},{"key":"2023091910475314800_ref52","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1145\/1124772.1124942","article-title":"Remote usability evaluations with disabled people","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Petrie","year":"2006"},{"key":"2023091910475314800_ref53","doi-asserted-by":"crossref","DOI":"10.1145\/2745555.2746653","article-title":"Towards a unified definition of web accessibility","volume-title":"Proceedings of the 12th International Web for All Conference, W4A \u201915","author":"Petrie","year":"2015"},{"key":"2023091910475314800_ref54","first-page":"433","article-title":"Guidelines are only half of the story: accessibility problems encountered by blind users on the web","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI \u201912","author":"Power","year":"2012"},{"key":"2023091910475314800_ref55","first-page":"667","article-title":"Navigating, discovering and exploring the web: strategies used by people with print disabilities on interactive websites","volume-title":"IFIP Conference on Human\u2013Computer Interaction","author":"Power","year":"2013"},{"key":"2023091910475314800_ref56","first-page":"263","article-title":"Introduction to the theory and practice of human\u2013computer interaction based on semiotic engineering (in Portuguese\u2014Introdu\u00e7\u00e3o \u00e0 Teoria e Pr\u00e1tica da Intera\u00e7\u00e3o Humano Computador Fundamentada na Engenharia Semi\u00f3tica)","volume":"1","author":"Prates","year":"2007","journal-title":"Atualiz. Inform."},{"key":"2023091910475314800_ref57","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/328595.328608","article-title":"Methods and tools: a method for evaluating the communicability of user interfaces","volume":"7","author":"Prates","year":"2000","journal-title":"Interactions"},{"key":"2023091910475314800_ref58","first-page":"177","article-title":"Applicability of the semiotic inspection method: a systematic literature review","author":"Reis","year":"2011","journal-title":"Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human\u2013Computer Interaction"},{"key":"2023091910475314800_ref59","article-title":"Evaluation of the semiotic inspection method (in Portuguese\u2014Avalia\u00e7\u00e3o do M\u00e9todo de Inspe\u00e7\u00e3o Semi\u00f3tica)","author":"Reis","year":"2012"},{"key":"2023091910475314800_ref60","doi-asserted-by":"crossref","first-page":"155","DOI":"10.22456\/2175-2745.40202","article-title":"Assessing the semiotic inspection method\u2014the evaluators\u2019 perspective","volume":"20","author":"Reis","year":"2013","journal-title":"Rev. Inform. Te\u00f3r. Apl."},{"key":"2023091910475314800_ref61","first-page":"1","article-title":"Accessibility and communicability on Facebook: a case study with Brazilian elderly","volume":"24","author":"Sacramento","year":"2019","journal-title":"First Monday"},{"key":"2023091910475314800_ref62","first-page":"213","article-title":"Heuristic walkthroughs: finding the problems without the noise","volume-title":"Int. J. Hum.\u2013Comput. Interact.","author":"Sears","year":"1997"},{"key":"2023091910475314800_ref63","volume-title":"Interaction Design: Beyond Human\u2013Computer Interaction","author":"Sharp","year":"2019"},{"key":"2023091910475314800_ref64","article-title":"Heuristic based method to evaluate information systems\u2019 accessibility (in Portuguese\u2014M\u00e9todo baseado em heur\u00edsticas para avalia\u00e7\u00e3o de acessibilidade em sistemas de informa\u00e7\u00e3o)","author":"Tanaka","year":"2009"},{"key":"2023091910475314800_ref65","first-page":"1","article-title":"Here\u2019s what I can do: Chatbots\u2019 strategies to convey their features to users","author":"Val\u00e9rio","year":"2017","journal-title":"Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems"},{"key":"2023091910475314800_ref66","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1016\/j.ijhcs.2013.08.002","article-title":"Coping tactics employed by visually disabled users on the web","volume":"71","author":"Vigo","year":"2013","journal-title":"Int. J. Hum.\u2013Comput. Stud."},{"key":"2023091910475314800_ref67","article-title":"Safe cooking techniques for cooks who are blind or have low vision","author":"VisionAware","year":"2021"},{"key":"2023091910475314800_ref68","article-title":"Template for accessibility evaluation reports","author":"Web Accessibility Initiative","year":"2022"},{"key":"2023091910475314800_ref69","article-title":"Cook blind: enhancing cooking experiences for visually-impaired people","author":"Zhang","year":"2016"}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/iwc\/article-pdf\/35\/2\/276\/51667499\/iwad023.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/iwc\/article-pdf\/35\/2\/276\/51667499\/iwad023.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,19]],"date-time":"2023-09-19T10:49:14Z","timestamp":1695120554000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article\/35\/2\/276\/7069380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3]]},"references-count":69,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,3,4]]},"published-print":{"date-parts":[[2023,8,14]]}},"URL":"https:\/\/doi.org\/10.1093\/iwc\/iwad023","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"value":"0953-5438","type":"print"},{"value":"1873-7951","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,3]]},"published":{"date-parts":[[2023,3]]}}}