{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T19:17:12Z","timestamp":1785266232174,"version":"3.55.0"},"reference-count":124,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T00:00:00Z","timestamp":1674777600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T00:00:00Z","timestamp":1674777600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100020998","name":"University of Pannonia","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100020998","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Univ Access Inf Soc"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Several works of literature contributed to the web evaluation process in recent years to promote digital inclusion by addressing several accessibility guidelines, methods, processes, and techniques. Researchers have investigated how the web evaluation process could be facilitated by including accessibility issues to obtain an inclusive and accessible solution to improve the user experience and increase user satisfaction. Three systematic literature reviews (SLRs) have been conducted in the context of past research, considering such research focuses. This paper presents a new SLR approach concerning accessibility in the web evaluation process, considering the period from 2010 to 2021. The review of 92 primary studies showed the contribution of publications on different phases of the web evaluation process mainly by highlighting the significant studies in the framework design and testing process. To the best of our knowledge, this is the first study focused on the web accessibility literature reporting the engineering assets for evaluation of new accessible and inclusive web-based solutions (e.g., websites). Besides, in this study, we aim to provide a new direction to the web designers and developers with an updated view of process, methods, techniques, tools, and other crucial aspects to contribute to the accessible process enrichment, as well as depict the gaps and challenges that may be worthy to be investigated in the future. The findings of this SLR introduce a new dimension in web accessibility research on determining and mitigating the research gap of web accessibility issues for web designers, developers, and other practitioners.<\/jats:p>","DOI":"10.1007\/s10209-023-00967-2","type":"journal-article","created":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T12:04:40Z","timestamp":1674821080000},"page":"653-686","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Accessibility engineering in web evaluation process: a systematic literature review"],"prefix":"10.1007","volume":"23","author":[{"given":"Jinat","family":"Ara","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cecilia","family":"Sik-Lanyi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arpad","family":"Kelemen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,27]]},"reference":[{"issue":"2","key":"967_CR1","first-page":"239","volume":"45","author":"Y Nagano","year":"2009","unstructured":"Nagano, Y., Suginome, K., Yoshimoto, K., Tsuchiya, Y.: Activities for improving web accessibility. Fujitsu Sci. Tech. J. 45(2), 239\u2013246 (2009)","journal-title":"Fujitsu Sci. Tech. J."},{"issue":"2","key":"967_CR2","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s10209-009-0166-z","volume":"9","author":"I Basdekis","year":"2010","unstructured":"Basdekis, I., Klironomos, I., Metaxas, I., Stephanidis, C.: An overview of web accessibility in Greece: a comparative study 2004\u20132008. Univ. Access Inf. Soc. 9(2), 185\u2013190 (2010)","journal-title":"Univ. Access Inf. Soc."},{"key":"967_CR3","unstructured":"World Wide Web Consortium.: 2022a: W3C\u2014Web Accessibility Initiative (WAI), Making the Web Accessible. http:\/\/www.w3.org\/WAI\/"},{"key":"967_CR4","unstructured":"World Wide Web Consortium.: 2022b: About w3C, Groups. https:\/\/www.w3.org\/Consortium\/activities"},{"key":"967_CR5","unstructured":"World Wide Web Consortium.: 2022c. Web content accessibility guidelines (WCAG). https:\/\/www.w3.org\/standards\/"},{"key":"967_CR6","unstructured":"World Wide Web Consortium.: 2018. Web content accessibility guidelines (WCAG) 2.1. https:\/\/www.w3.org\/TR\/WCAG22\/"},{"key":"967_CR7","unstructured":"Koga, T.: Policy issues regarding electronic government and Web accessibility in Japan (2006)"},{"key":"967_CR8","doi-asserted-by":"crossref","unstructured":"Wentzel, J., Velleman, E., Geest, T.V.D.: Developing accessibility design guidelines for wearables: Accessibility standards for multimodal wearable devices. In: International Conference on Universal Access in Human-Computer Interaction, pp. 109\u2013119. Springer, Cham (2016)","DOI":"10.1007\/978-3-319-40250-5_11"},{"key":"967_CR9","doi-asserted-by":"crossref","unstructured":"Reichling, M., Cherfi, S.S.S.: Integrating accessibility as a quality property in web developments. In: IEEE 7th International Conference on Research Challenges in Information Science (RCIS), pp. 1\u201312). IEEE (2013)","DOI":"10.1109\/RCIS.2013.6577698"},{"key":"967_CR10","doi-asserted-by":"crossref","unstructured":"Horton, S., Sloan, D.: Accessibility in practice: a process-driven approach to accessibility. In: Inclusive Designing, pp. 105\u2013115. Springer, Cham (2014)","DOI":"10.1007\/978-3-319-05095-9_10"},{"key":"967_CR11","doi-asserted-by":"crossref","unstructured":"Moreno, L., Mart\u00ednez, P.: A review of accessibility requirements in elderly users\u2019 interactions with web applications. In: Proceedings of the 13th International Conference on Interacci\u00f3n Persona-Ordenador, pp. 1\u20132 (2012)","DOI":"10.1145\/2379636.2379682"},{"key":"967_CR12","doi-asserted-by":"crossref","unstructured":"Estrada-Mart\u00ednez, F.J., Hilera, J.R., Ot\u00f3n, S., Aguado-Delgado, J.: Semantic web technologies applied to software accessibility evaluation: a systematic literature review. Universal Access in the Information Society, 1\u201325 (2020)","DOI":"10.1007\/s10209-020-00759-y"},{"key":"967_CR13","doi-asserted-by":"crossref","unstructured":"Chadli, F.E., Gretete, D., Moumen, A.: Digital accessibility: a systematic Literature Review. In: SHS Web of Conferences, Vol. 119. EDP Sciences (2021)","DOI":"10.1051\/shsconf\/202111906005"},{"key":"967_CR14","doi-asserted-by":"crossref","unstructured":"Akram, M., Sulaiman, R.B.: A systematic literature review to determine the web accessibility issues in Saudi Arabian university and government websites for disable people. Int. J. Adv. Comput. Sci. Appl. 8(6) (2017)","DOI":"10.14569\/IJACSA.2017.080642"},{"key":"967_CR15","doi-asserted-by":"crossref","first-page":"91676","DOI":"10.1109\/ACCESS.2020.2994288","volume":"8","author":"M Campoverde-Molina","year":"2020","unstructured":"Campoverde-Molina, M., Lujan-Mora, S., Garcia, L.V.: Empirical studies on web accessibility of educational websites: a systematic literature review. IEEE Access 8, 91676\u201391700 (2020)","journal-title":"IEEE Access"},{"key":"967_CR16","doi-asserted-by":"crossref","unstructured":"Campoverde-Molina, M., Luj\u00e1n-Mora, S., Valverde, L.: Accessibility of university websites worldwide: a systematic literature review. Universal Access in the Information Society, 1\u201336 (2021)","DOI":"10.1007\/s10209-021-00825-z"},{"key":"967_CR17","unstructured":"Stapic, Z., L\u00f3pez, E.G., Cabot, A.G., de Marcos Ortega, L., Strahonja, V.: Performing systematic literature review in software engineering. In: Central European Conference on Information and Intelligent Systems, p. 441. Faculty of Organization and Informatics Varazdin (2012)"},{"key":"967_CR18","unstructured":"Bai, A., Fuglerud, K.S., Skjerve, R.A., Halbach, T.: Categorization and comparison of accessibility testing methods for software development (2018)"},{"issue":"4","key":"967_CR19","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.survophthal.2005.04.004","volume":"50","author":"MF Chiang","year":"2005","unstructured":"Chiang, M.F., Cole, R.G., Gupta, S., Kaiser, G.E., Starren, J.B.: Computer and world wide web accessibility by visually disabled patients: problems and solutions. Surv. Ophthalmol. 50(4), 394\u2013405 (2005)","journal-title":"Surv. Ophthalmol."},{"key":"967_CR20","unstructured":"Caldwell, R.: Web-accessibility, e-learning, and academic libraries. Int. J. Public Inf. Syst. 2(1) (2006)"},{"key":"967_CR21","unstructured":"World Wide Web Consortium.: 2022d. Web content accessibility guidelines (WCAG) 3.0. https:\/\/www.w3.org\/TR\/wcag-3.0\/"},{"key":"967_CR22","unstructured":"World Wide Web Consortium.: 1999. Web content accessibility guidelines (WCAG) 1.0. https:\/\/www.w3.org\/TR\/WAI-WEBCONTENT\/"},{"key":"967_CR23","unstructured":"World Wide Web Consortium.: 2008. Web content accessibility guidelines (WCAG) 1.0. https:\/\/www.w3.org\/TR\/WCAG20\/"},{"key":"967_CR24","unstructured":"World Wide Web Consortium.: 2021. Web content accessibility guidelines (WCAG) 2.2. https:\/\/www.w3.org\/TR\/WCAG22\/"},{"key":"967_CR25","first-page":"1133","volume":"7","author":"AA Dror","year":"2021","unstructured":"Dror, A.A., Morozov, N.G., Layous, E., Mizrachi, M., Daoud, A., Eisenbach, N., Sela, E.: United by hope, divided by access: country mapping of COVID-19 information accessibility and its consequences on pandemic eradication. Front. Med. 7, 1133 (2021)","journal-title":"Front. Med."},{"key":"967_CR26","doi-asserted-by":"crossref","unstructured":"Kim, N.W., Joyner, S.C., Riegelhuth, A., Kim, Y.: Accessible visualization: design space, opportunities, and challenges. In: Computer Graphics Forum, Vol. 40, No. 3, pp. 173\u2013188 (2021)","DOI":"10.1111\/cgf.14298"},{"key":"967_CR27","unstructured":"Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering (2007)"},{"key":"967_CR28","doi-asserted-by":"crossref","unstructured":"Durdu, P.O., Yerlikaya, Z.: The perception of website accessibility: A survey of Turkish software professionals. AJIT-e: Bili\u015fim Teknolojileri Online Dergisi 11(41), 42\u201371 (2020)","DOI":"10.5824\/ajite.2020.02.003.x"},{"key":"967_CR29","doi-asserted-by":"crossref","unstructured":"Bradbard, D.A., Peters, C.: Web accessibility theory and practice: an introduction for university faculty (2010)","DOI":"10.9743\/JEO.2010.1.1"},{"key":"967_CR30","volume":"64","author":"SY Yu","year":"2021","unstructured":"Yu, S.Y.: A review of the accessibility of ACT COVID-19 information portals. Technol. Soc. 64, 101467 (2021)","journal-title":"Technol. Soc."},{"issue":"1","key":"967_CR31","first-page":"47","volume":"17","author":"Y Bai","year":"2019","unstructured":"Bai, Y.: The relationship between Website accessibility and usability: an examination of US county government online portals. Electron. J. e-Gov. 17(1), 47\u201362 (2019)","journal-title":"Electron. J. e-Gov."},{"key":"967_CR32","doi-asserted-by":"crossref","unstructured":"Henry, S.L., Abou-Zahra, S., Brewer, J.: The role of accessibility in a universal web. In: Proceedings of the 11th Web for all Conference, pp. 1\u20134 (2014)","DOI":"10.1145\/2596695.2596719"},{"key":"967_CR33","doi-asserted-by":"crossref","unstructured":"Wu, K., Petersen, E., Ahmad, T., Burlinson, D., Tanis, S., Szafir, D.A.: Understanding data accessibility for people with intellectual and developmental disabilities. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1\u201316 (2021)","DOI":"10.1145\/3411764.3445743"},{"issue":"7","key":"967_CR34","first-page":"29","volume":"48","author":"DA Riley-Huff","year":"2012","unstructured":"Riley-Huff, D.A.: Web accessibility and universal design. Libr. Technol. Rep. 48(7), 29\u201335 (2012)","journal-title":"Libr. Technol. Rep."},{"key":"967_CR35","unstructured":"Marino, S.I., Alfonzo, P.L.: A web accessibility empirical analysis, a case study (2021)"},{"issue":"10","key":"967_CR36","doi-asserted-by":"crossref","first-page":"1207","DOI":"10.1080\/00140139.2020.1774080","volume":"63","author":"J Sauer","year":"2020","unstructured":"Sauer, J., Sonderegger, A., Schmutz, S.: Usability, user experience and accessibility: towards an integrative model. Ergonomics 63(10), 1207\u20131220 (2020)","journal-title":"Ergonomics"},{"key":"967_CR37","doi-asserted-by":"crossref","unstructured":"Vu, K.P.L., Proctor, R.W., Hung, Y.H.: Website Design and Evaluation. Handbook of human factors and ergonomics, pp. 1016\u20131036 (2021)","DOI":"10.1002\/9781119636113.ch39"},{"key":"967_CR38","unstructured":"Almeida, L.D.A., Baranauskas, M.C.C.: Universal design principles combined with web accessibility guidelines: a case study. In: Proceedings of the IX Symposium on Human Factors in Computing Systems, pp. 169\u2013178 (2010)"},{"key":"967_CR39","doi-asserted-by":"crossref","unstructured":"Gaggi, O., Pederiva, V.: WCAG4All, a tool for making web accessibility rules accessible. In: 2021 IEEE 18th Annual Consumer Communications & Networking Conference (CCNC), pp. 1\u20136. IEEE (2021)","DOI":"10.1109\/CCNC49032.2021.9369484"},{"key":"967_CR40","doi-asserted-by":"crossref","first-page":"36500","DOI":"10.1109\/ACCESS.2018.2848978","volume":"6","author":"P Acosta-Vargas","year":"2018","unstructured":"Acosta-Vargas, P., Acosta, T., Lujan-Mora, S.: Challenges to assess accessibility in higher education websites: a comparative study of Latin America universities. IEEE Access 6, 36500\u201336508 (2018)","journal-title":"IEEE Access"},{"key":"967_CR41","doi-asserted-by":"crossref","unstructured":"Inal, Y., Guribye, F., Rajanen, D., Rajanen, M., Rost, M.: Perspectives and practices of digital accessibility: a survey of user experience professionals in uwait countries. In: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, pp. 1\u201311 (2020)","DOI":"10.1145\/3419249.3420119"},{"key":"967_CR42","doi-asserted-by":"crossref","unstructured":"Brajnik, G., Vigo, M.: Automatic Web Accessibility Metrics. In: Web Accessibility, pp. 505\u2013521. Springer, London (2019)","DOI":"10.1007\/978-1-4471-7440-0_27"},{"key":"967_CR43","doi-asserted-by":"crossref","unstructured":"Palaskar, A., Gondkar, S.R., Gondkar, R.R.: Web Accessibility test approach on developed websites. Available at SSRN 3835104 (2021)","DOI":"10.2139\/ssrn.3835104"},{"key":"967_CR44","doi-asserted-by":"crossref","unstructured":"Edelberg, J., Verhulsdonck, G.: Addressing accessibility as advocacy: special needs users in industry web development processes. In: The 39th ACM International Conference on Design of Communication, pp. 343\u2013346 (2021)","DOI":"10.1145\/3472714.3473663"},{"key":"967_CR45","doi-asserted-by":"crossref","unstructured":"Miesenberger, K., Edler, C., Heumader, P., Petz, A.: Tools and applications for cognitive accessibility. In: Web Accessibility, pp. 523\u2013546. Springer, London (2019)","DOI":"10.1007\/978-1-4471-7440-0_28"},{"issue":"9","key":"967_CR46","doi-asserted-by":"crossref","first-page":"1990","DOI":"10.1093\/jamia\/ocab105","volume":"28","author":"S Alismail","year":"2021","unstructured":"Alismail, S., Chipidza, W.: Accessibility evaluation of COVID-19 vaccine registration websites across the United States. J. Am. Med. Inform. Assoc. 28(9), 1990\u20131995 (2021)","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"967_CR47","doi-asserted-by":"crossref","unstructured":"Bhagat, S., Joshi, P.: Evaluation of accessibility and accessibility audit methods for e-governance portals. In: Proceedings of the 12th International Conference on Theory and Practice of Electronic Governance, pp. 220\u2013226 (2019)","DOI":"10.1145\/3326365.3326394"},{"issue":"1","key":"967_CR48","first-page":"1","volume":"33","author":"PK Ojha","year":"2021","unstructured":"Ojha, P.K., Ismail, A., Srinivasan, K.K.: Perusal of readability with focus on web content understandability. J. King Saud Univ. Comput. Inf. Sci. 33(1), 1\u201310 (2021)","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"issue":"6","key":"967_CR49","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1080\/17483107.2017.1344883","volume":"13","author":"A Ismail","year":"2018","unstructured":"Ismail, A., Kuppusamy, K.S., Nengroo, A.S.: Multi-tool accessibility assessment of government department websites: a case-study with JKGAD. Disabil. Rehabil. Assist. Technol. 13(6), 504\u2013516 (2018)","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"967_CR50","doi-asserted-by":"crossref","unstructured":"Kuppusamy, K.S., Balaji, V.: Evaluating web accessibility of educational institutions websites using a variable magnitude approach. Universal Access in the Information Society, pp. 1\u201310 (2021)","DOI":"10.1007\/s10209-021-00812-4"},{"issue":"9","key":"967_CR51","doi-asserted-by":"crossref","first-page":"439","DOI":"10.4236\/jsea.2016.99029","volume":"9","author":"M Alshamari","year":"2016","unstructured":"Alshamari, M.: Accessibility evaluation of Arabic e-commerce web sites using automated tools. J. Softw. Eng. Appl. 9(9), 439\u2013451 (2016)","journal-title":"J. Softw. Eng. Appl."},{"key":"967_CR52","doi-asserted-by":"crossref","unstructured":"Morris, M.R., Johnson, J., Bennett, C.L., Cutrell, E.: Rich representations of visual content for screen reader users. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1\u201311 (2018)","DOI":"10.1145\/3173574.3173633"},{"key":"967_CR53","doi-asserted-by":"crossref","unstructured":"Alahmadi, T.: A multi-method evaluation of university website accessibility: foregrounding user-centred design, mining source code and using a quantitative metric. In: Proceedings of the 14th International Web for All Conference, pp. 1\u20132 (2017)","DOI":"10.1145\/3058555.3058580"},{"issue":"1","key":"967_CR54","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s00799-020-00292-6","volume":"22","author":"S Kaur","year":"2021","unstructured":"Kaur, S., Gupta, S.K.: A fuzzy-based framework for evaluation of website design quality index. Int. J. Digit. Libr. 22(1), 15\u201347 (2021)","journal-title":"Int. J. Digit. Libr."},{"issue":"1","key":"967_CR55","first-page":"63","volume":"16","author":"MS Hassouna","year":"2017","unstructured":"Hassouna, M.S., Sahari, N., Ismail, A.: University website accessibility for totally blind users. J. Inf. Commun. Technol. 16(1), 63\u201380 (2017)","journal-title":"J. Inf. Commun. Technol."},{"key":"967_CR56","doi-asserted-by":"crossref","unstructured":"Sapna, P.G., Mohanty, H.: An ontology based approach for test scenario management. In: International Conference on Information Intelligence, Systems, Technology and Management, pp. 91\u2013100. Springer, Berlin, Heidelberg (2011)","DOI":"10.1007\/978-3-642-19423-8_10"},{"issue":"2","key":"967_CR57","doi-asserted-by":"crossref","first-page":"12","DOI":"10.4018\/IJKBO.2020040102","volume":"10","author":"A Kourtiche","year":"2020","unstructured":"Kourtiche, A., Mohamed Benslimane, S., Hacene, S.B.: OUPIP: ontology based user profile for impairment person in dynamic situation aware social networks. Int. J. Knowl.-Based Org. (IJKBO) 10(2), 12\u201334 (2020)","journal-title":"Int. J. Knowl.-Based Org. (IJKBO)"},{"key":"967_CR58","doi-asserted-by":"crossref","unstructured":"Fayzrahmanov, R.R., G\u00f6bel, M.C., Holzinger, W., Kr\u00fcpl, B., Baumgartner, R.: A unified ontology-based web page model for improving accessibility. In: Proceedings of the 19th International Conference on World Wide Web, pp. 1087\u20131088 (2010)","DOI":"10.1145\/1772690.1772817"},{"key":"967_CR59","doi-asserted-by":"crossref","unstructured":"Li, L.C., Bu, J.J., Zhi, Y., Wei, W.A., Can, W.A.: An overview of web accessibility evaluation of government websites in China. In: International Conference on Social Sciences and Development (ICSSD), pp. 2\u20135 (2016)","DOI":"10.12783\/dtssehs\/icssd2016\/4757"},{"issue":"1","key":"967_CR60","doi-asserted-by":"crossref","first-page":"40","DOI":"10.3390\/info11010040","volume":"11","author":"A Alsaeedi","year":"2020","unstructured":"Alsaeedi, A.: Comparing web accessibility evaluation tools and evaluating the accessibility of webpages: proposed frameworks. Information 11(1), 40 (2020)","journal-title":"Information"},{"key":"967_CR61","doi-asserted-by":"crossref","unstructured":"Song, S., Bu, J., Artmeier, A., Shi, K., Wang, Y., Yu, Z., Wang, C.: Crowdsourcing-based Web accessibility evaluation with golden maximum likelihood inference. In: Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), pp. 1\u201321 (2018)","DOI":"10.1145\/3274432"},{"key":"967_CR62","doi-asserted-by":"crossref","unstructured":"Giovanna, B., Manca, M., Patern\u00f3, F., Pulina, F.: Flexible automatic support for web accessibility validation. In: Proceedings of the ACM on Human\u2013Computer Interaction, p. 4 (2020)","DOI":"10.1145\/3397871"},{"key":"967_CR63","unstructured":"Zeleke, Y.: Usability and accessibility model for e-government websites in Ethiopia (2020)"},{"key":"967_CR64","unstructured":"Sanchez-Gordon, S., Luj\u00e1n-Mora, S.: A method for accessibility testing of web applications in agile environments. In: Proceedings of the 7th World Congress for Software Quality (WCSQ). En proceso de publicaci\u00f3n.(citado en la p\u00e1gina 13, 15, 85) (2017)"},{"key":"967_CR65","doi-asserted-by":"crossref","unstructured":"Song, S., Bu, J., Wang, Y., Yu, Z., Artmeier, A., Dai, L., Wang, C.: Web accessibility evaluation in a crowdsourcing-based system with expertise-based decision strategy. In: Proceedings of the 15th International Web for All Conference, pp. 1\u20134 (2018)","DOI":"10.1145\/3192714.3192827"},{"key":"967_CR66","doi-asserted-by":"crossref","first-page":"125634","DOI":"10.1109\/ACCESS.2019.2939068","volume":"7","author":"P Acosta-Vargas","year":"2019","unstructured":"Acosta-Vargas, P., Salvador-Ullauri, L.A., Luj\u00e1n-Mora, S.: A heuristic method to evaluate web accessibility for users with low vision. IEEE Access 7, 125634\u2013125648 (2019)","journal-title":"IEEE Access"},{"issue":"2","key":"967_CR67","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1002\/col.22580","volume":"46","author":"S Won","year":"2021","unstructured":"Won, S.: Conveying colour research to design practice: design and evaluation of a web-based colour tool. Color. Res. Appl. 46(2), 350\u2013361 (2021)","journal-title":"Color. Res. Appl."},{"key":"967_CR68","doi-asserted-by":"crossref","unstructured":"Mohamad, Y., Velasco, C.A., Kaklanis, N., Tzovaras, D., Patern\u00f2, F.: A holistic decision support environment for web accessibility. In: International Conference on Computers Helping People with Special Needs, pp. 3\u20137. Springer, Cham (2018)","DOI":"10.1007\/978-3-319-94277-3_1"},{"key":"967_CR69","doi-asserted-by":"crossref","unstructured":"Li, L., Wang, C., Song, S., Yu, Z., Zhou, F., Bu, J.: A task assignment strategy for crowdsourcing-based web accessibility evaluation system. In: Proceedings of the 14th International Web for All Conference, pp. 1\u20134 (2017)","DOI":"10.1145\/3058555.3058573"},{"key":"967_CR70","doi-asserted-by":"crossref","unstructured":"\u017duli\u010dek, L., Tomi\u0107, S., Bosni\u0107, I.: Adapting modularized web applications to web accessibility standards. In: 2021 44th International Convention on Information, Communication and Electronic Technology (MIPRO), pp. 470\u2013475. IEEE (2017)","DOI":"10.23919\/MIPRO52101.2021.9596750"},{"key":"967_CR71","first-page":"2021","volume":"10","author":"RP Oliveira","year":"2020","unstructured":"Oliveira, R.P., Afonso, A.P., Pinto, A.S.: E-commerce website accessibility evaluation: case study in Portugal. \u015eubat 10, 2021 (2020)","journal-title":"\u015eubat"},{"issue":"5","key":"967_CR72","doi-asserted-by":"crossref","first-page":"57","DOI":"10.3390\/computers10050057","volume":"10","author":"M Rashida","year":"2021","unstructured":"Rashida, M., Islam, K., Kayes, A.S.M., Hammoudeh, M., Arefin, M.S., Habib, M.A.: Towards developing a framework to analyze the qualities of the university websites. Computers 10(5), 57 (2021)","journal-title":"Computers"},{"key":"967_CR73","doi-asserted-by":"crossref","unstructured":"Lim, Z.Y., Chua, J.M., Yang, K., Tan, W.S., Chai, Y.: Web accessibility testing for uwaitie government e-services. In: Proceedings of the 17th International Web for All Conference, pp. 1\u20135 (2020)","DOI":"10.1145\/3371300.3383353"},{"key":"967_CR74","doi-asserted-by":"crossref","unstructured":"Duarte, C., Matos, I., Carri\u00e7o, L.: Semantic content analysis supporting web accessibility evaluation. In: Proceedings of the 15th International Web for All Conference, pp. 1\u20134 (2018)","DOI":"10.1145\/3192714.3196828"},{"key":"967_CR75","doi-asserted-by":"crossref","unstructured":"Wu, Y., Yu, Z., Li, L., Wang, W., Bu, J., Zhang, Y., Dai, L.: Using semi-supervised group sparse regression to improve web accessibility evaluation. In: International Conference on Computers Helping People with Special Needs, pp. 52\u201356. Springer, Cham (2018)","DOI":"10.1007\/978-3-319-94277-3_10"},{"key":"967_CR76","doi-asserted-by":"crossref","unstructured":"Morato, J., Iglesias, A., Campillo, A., Sanchez-Cuadrado, S.: Automated readability assessment for uwaiti e-government information. J. Inf. Syst. Eng. Manag. 6(2), em0137 (2021)","DOI":"10.29333\/jisem\/9620"},{"key":"967_CR77","unstructured":"Boyalakuntla, K., Sri Manasa Venigalla, A., Chimalakonda, S.: Waccess\u2014a web accessibility tool based on the latest WCAG 2.2 guidelines. arXiv e-prints, arXiv-2107 (2021)"},{"key":"967_CR78","doi-asserted-by":"crossref","DOI":"10.1016\/j.ijhcs.2020.102523","volume":"145","author":"E Michailidou","year":"2021","unstructured":"Michailidou, E., Eraslan, S., Yesilada, Y., Harper, S.: Automated prediction of visual complexity of web pages: tools and evaluations. Int. J. Hum. Comput. Stud. 145, 102523 (2021)","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"967_CR79","doi-asserted-by":"crossref","unstructured":"Bonacin, R., Reis, J.C.D., de Araujo, R.J.: An ontology-based framework for improving color vision deficiency accessibility. Universal Access in the Information Society, pp. 1\u201326 (2021)","DOI":"10.1007\/s10209-021-00791-6"},{"issue":"2","key":"967_CR80","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3178854","volume":"11","author":"HL Antonelli","year":"2018","unstructured":"Antonelli, H.L., Igawa, R.A., Fortes, R.P.D.M., Rizo, E.H., Watanabe, W.M.: Drop-down menu widget identification using HTML structure changes classification. ACM Trans. Access. Comput. (TACCESS) 11(2), 1\u201323 (2018)","journal-title":"ACM Trans. Access. Comput. (TACCESS)"},{"key":"967_CR81","doi-asserted-by":"crossref","unstructured":"Csontos, B., Heckl, I.: Improving accessibility of CMS-based websites using automated methods. Universal Access in the Information Society, pp. 1\u201315 (2020)","DOI":"10.1007\/s10209-020-00784-x"},{"issue":"1","key":"967_CR82","doi-asserted-by":"crossref","first-page":"9","DOI":"10.3390\/fi13010009","volume":"13","author":"G Mato\u0161evi\u0107","year":"2021","unstructured":"Mato\u0161evi\u0107, G., Dob\u0161a, J., Mladeni\u0107, D.: Using machine learning for web page classification in search engine optimization. Future Internet 13(1), 9 (2021)","journal-title":"Future Internet"},{"key":"967_CR83","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1016\/j.chb.2016.12.010","volume":"73","author":"J Martins","year":"2017","unstructured":"Martins, J., Gon\u00e7alves, R., Branco, F.: A full scope web accessibility evaluation procedure proposal based on Iberian eHealth accessibility compliance. Comput. Hum. Behav. 73, 676\u2013684 (2017)","journal-title":"Comput. Hum. Behav."},{"issue":"1","key":"967_CR84","doi-asserted-by":"crossref","first-page":"15","DOI":"10.24818\/issn14531305\/24.1.2020.02","volume":"24","author":"M Padure","year":"2020","unstructured":"Padure, M., Pribeanu, C.: Comparing six free accessibility evaluation tools. Informatica Economica 24(1), 15\u201325 (2020)","journal-title":"Informatica Economica"},{"key":"967_CR85","doi-asserted-by":"crossref","unstructured":"Hassouna, M.S., Sahari, N., Ismail, A.: Accessibility factors for totally blind users of Palestinian universities websites (2015)","DOI":"10.32890\/jict2017.16.1.4"},{"issue":"3","key":"967_CR86","first-page":"265","volume":"20","author":"C Pribeanu","year":"2011","unstructured":"Pribeanu, C., Fogarassy-Neszly, P.: A review of municipal web sites for accessibility: a computer-aided evaluation approach. Stud. Inf. Control 20(3), 265\u2013272 (2011)","journal-title":"Stud. Inf. Control"},{"issue":"1","key":"967_CR87","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s10209-018-0632-6","volume":"19","author":"SF Verkijika","year":"2020","unstructured":"Verkijika, S.F., De Wet, L.: Accessibility of South African university websites. Univ. Access Inf. Soc. 19(1), 201\u2013210 (2020)","journal-title":"Univ. Access Inf. Soc."},{"issue":"1","key":"967_CR88","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s10209-020-00717-8","volume":"20","author":"Z AlMeraj","year":"2021","unstructured":"AlMeraj, Z., Boujarwah, F., Alhuwail, D., Qadri, R.: Evaluating the accessibility of higher education institution websites in the State of Kuwait: empirical evidence. Univ. Access Inf. Soc. 20(1), 121\u2013138 (2021)","journal-title":"Univ. Access Inf. Soc."},{"key":"967_CR89","unstructured":"Sharma, A.: Web Accessibility of Indian University library website: an evaluation with WAVE website evaluation tool (2021)"},{"issue":"9","key":"967_CR90","first-page":"18","volume":"9","author":"SG Abduganiev","year":"2017","unstructured":"Abduganiev, S.G.: Towards automated web accessibility evaluation: a comparative study. Int. J. Inf. Technol. Comput. Sci. 9(9), 18\u201344 (2017)","journal-title":"Int. J. Inf. Technol. Comput. Sci."},{"issue":"1","key":"967_CR91","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1177\/1742395317746471","volume":"15","author":"L Chapman","year":"2019","unstructured":"Chapman, L., Brooks, C., Lawson, J., Russell, C., Adams, J.: Accessibility of online self-management support websites for people with osteoarthritis: a text content analysis. Chronic Illn. 15(1), 27\u201340 (2019)","journal-title":"Chronic Illn."},{"issue":"1","key":"967_CR92","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1080\/01930826.2019.1685273","volume":"60","author":"MD Rysavy","year":"2020","unstructured":"Rysavy, M.D., Michalak, R.: Assessing the accessibility of library tools & services when you aren\u2019t an accessibility expert: Part 1. J. Libr. Adm. 60(1), 71\u201379 (2020)","journal-title":"J. Libr. Adm."},{"issue":"1","key":"967_CR93","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s10209-020-00715-w","volume":"20","author":"Y Akg\u00fcl","year":"2021","unstructured":"Akg\u00fcl, Y.: Accessibility, usability, quality performance, and readability evaluation of university websites of Turkey: a comparative study of state and private universities. Univ. Access Inf. Soc. 20(1), 157\u2013170 (2021)","journal-title":"Univ. Access Inf. Soc."},{"key":"967_CR94","doi-asserted-by":"crossref","unstructured":"Doush, I., AlMeraj, Z.: Evaluating the accessibility of uwaiti e-government websites. Jordanian J. Comput. Inf. Technol. (JJCIT) 5(03) (2019)","DOI":"10.5455\/jjcit.71-1557233833"},{"issue":"1","key":"967_CR95","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1007\/s11528-019-00421-2","volume":"64","author":"SM Baule","year":"2020","unstructured":"Baule, S.M.: Evaluating the accessibility of special education cooperative websites for individuals with disabilities. TechTrends 64(1), 50\u201356 (2020)","journal-title":"TechTrends"},{"issue":"3","key":"967_CR96","first-page":"50","volume":"9","author":"M Ajuji","year":"2021","unstructured":"Ajuji, M., Abubakar, A., Adam, Y.A., Emmanuel, D.U.: Evaluation of accessibility of randomly selected websites. ATBU J. Sci. Technol. Educ. 9(3), 50\u201357 (2021)","journal-title":"ATBU J. Sci. Technol. Educ."},{"key":"967_CR97","doi-asserted-by":"crossref","unstructured":"Grant, J., Sumilang, G., Providenti, M., Cho, S., Reichler, D.: Accountability for the hidden codes toward a better user experience: case study of Hrsimple communication design for web accessibility and SEO. In: The 39th ACM International Conference on Design of Communication, pp. 347\u2013350 (2021)","DOI":"10.1145\/3472714.3473664"},{"key":"967_CR98","doi-asserted-by":"crossref","unstructured":"Kumar, S., Shree, D.V.J., Biswas, P.: Comparing ten WCAG tools for accessibility evaluation of websites. Technology and Disability, (Preprint), pp. 1\u201323 (2021)","DOI":"10.3233\/TAD-210329"},{"key":"967_CR99","doi-asserted-by":"crossref","unstructured":"Burkard, A., Zimmermann, G., Schwarzer, B.: Monitoring systems for checking websites on accessibility. Front. Comput. Sci. 2 (2021)","DOI":"10.3389\/fcomp.2021.628770"},{"key":"967_CR100","doi-asserted-by":"crossref","unstructured":"Jo, G., Habib, D., Varadaraj, V., Smith, J., Epstein, S., Zhu, J., Swenor, B.K.: COVID-19 Vaccine Website Accessibility Dashboard. Disabil. Health J. 101325 (2022)","DOI":"10.1016\/j.dhjo.2022.101325"},{"key":"967_CR101","doi-asserted-by":"crossref","unstructured":"Eus\u00e9bio, C., Teixeira, L., Teixeira, P., Caneiro, M.J., Lemos, D., Silveiro, A.: The State of Web Accessibility for tourists with disabilities: a comparative study between different tourism supply agents. Disabil. Rehabil. Assistive Technol. 1\u201313 (2021)","DOI":"10.1080\/17483107.2021.1941313"},{"issue":"3","key":"967_CR102","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1007\/s10209-020-00732-9","volume":"20","author":"K Kous","year":"2021","unstructured":"Kous, K., Kuhar, S., Pavlinek, M., Heri\u010dko, M., Pu\u0161nik, M.: Web accessibility investigation of Slovenian municipalities\u2019 websites before and after the adoption of European Standard EN 301 549. Univ. Access Inf. Soc. 20(3), 595\u2013615 (2021)","journal-title":"Univ. Access Inf. Soc."},{"key":"967_CR103","doi-asserted-by":"crossref","unstructured":"Ali, L.: Accessible websites for everyone\u2014a case of UAE universities websites. Int. J. Inf. Educ. Technol. 11(4) (2021)","DOI":"10.18178\/ijiet.2021.11.4.1506"},{"key":"967_CR104","doi-asserted-by":"crossref","unstructured":"Zare, S., Rahmatizadeh, S., Valizadeh-Haghi, S.: Academic medical libraries and accessibility challenges: the conformance of the websites with the WCAG2. 1. DESIDOC J. Lib. Inf. Technol. 41(2) (2021)","DOI":"10.14429\/djlit.41.02.16306"},{"issue":"2","key":"967_CR105","doi-asserted-by":"crossref","first-page":"642","DOI":"10.3390\/ijerph18020642","volume":"18","author":"K Kr\u00f3l","year":"2021","unstructured":"Kr\u00f3l, K., Zdonek, D.: The quality of infectious disease hospital websites in Poland in light of the COVID-19 pandemic. Int. J. Environ. Res. Public Health 18(2), 642 (2021)","journal-title":"Int. J. Environ. Res. Public Health"},{"issue":"1","key":"967_CR106","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s10209-018-0625-5","volume":"19","author":"YJ Yi","year":"2020","unstructured":"Yi, Y.J.: Web accessibility of healthcare Web sites of Korean government and public agencies: a user test for persons with visual impairment. Univ. Access Inf. Soc. 19(1), 41\u201356 (2020)","journal-title":"Univ. Access Inf. Soc."},{"issue":"2","key":"967_CR107","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s10209-020-00727-6","volume":"20","author":"L Moreno","year":"2021","unstructured":"Moreno, L., Valencia, X., P\u00e9rez, J.E., Arrue, M.: An exploratory study of web adaptation techniques for people with low vision. Univ. Access Inf. Soc. 20(2), 223\u2013237 (2021)","journal-title":"Univ. Access Inf. Soc."},{"key":"967_CR108","doi-asserted-by":"crossref","unstructured":"Krawiec, \u0141., Dudycz, H.: The approach to the assessment of validators for studying web-accessibility. Inf. Syst. Manag. 6 (2017)","DOI":"10.22630\/ISIM.2017.6.2.3"},{"key":"967_CR109","unstructured":"Grantham, J., Grantham, E., Powers, D.: Website accessibility: an Australian view. In: Proceedings of the Thirteenth Australasian User Interface Conference-Volume 126, pp. 21\u201328 (2012)"},{"key":"967_CR110","doi-asserted-by":"crossref","unstructured":"Hadadi, S.: Adee: bringing accessibility right inside design tools. In: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1\u20134 (2021)","DOI":"10.1145\/3441852.3476478"},{"issue":"3","key":"967_CR111","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1007\/s12528-017-9151-3","volume":"29","author":"R Kimmons","year":"2017","unstructured":"Kimmons, R.: Open to all? Nationwide evaluation of high-priority web accessibility considerations among higher education websites. J. Comput. High. Educ. 29(3), 434\u2013450 (2017)","journal-title":"J. Comput. High. Educ."},{"issue":"7","key":"967_CR112","doi-asserted-by":"crossref","first-page":"3669","DOI":"10.3390\/ijerph18073669","volume":"18","author":"E Radcliffe","year":"2021","unstructured":"Radcliffe, E., Lippincott, B., Anderson, R., Jones, M.: A pilot evaluation of mHealth app accessibility for three top-rated weight management apps by people with disabilities. Int. J. Environ. Res. Public Health 18(7), 3669 (2021)","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"967_CR113","doi-asserted-by":"crossref","unstructured":"Sun, Y.T., Vu, K.P.L., Strybel, T.Z.: A validation test of an accessibility evaluation method. In International Conference on Applied Human Factors and Ergonomics, pp. 625\u2013633. Springer, Cham 2017","DOI":"10.1007\/978-3-319-60492-3_59"},{"key":"967_CR114","doi-asserted-by":"crossref","unstructured":"Alcaraz Mart\u00ednez, R., Turr\u00f3, M.R., Granollers Saltiveri, T.: Methodology for heuristic evaluation of the accessibility of statistical charts for people with low vision and color vision deficiency. Universal access in the information society, pp. 1\u201332 (2021)","DOI":"10.21203\/rs.3.rs-156959\/v1"},{"key":"967_CR115","unstructured":"Cao, S., Loiacono, E.: Perceptions of web accessibility guidelines by student website and app developers. Behav. Inf. Technol. 1\u201319 (2021)"},{"key":"967_CR116","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.ijhcs.2017.10.011","volume":"111","author":"S Giraud","year":"2018","unstructured":"Giraud, S., Th\u00e9rouanne, P., Steiner, D.D.: Web accessibility: Filtering redundant and irrelevant information improves website usability for blind users. Int. J. Hum. Comput. Stud. 111, 23\u201335 (2018)","journal-title":"Int. J. Hum. Comput. Stud."},{"issue":"5","key":"967_CR117","doi-asserted-by":"crossref","first-page":"2867","DOI":"10.3390\/ijerph19052867","volume":"19","author":"J Ara","year":"2022","unstructured":"Ara, J., Sik-Lanyi, C.: Investigation of COVID-19 vaccine information websites across Europe and Asia using automated accessibility protocols. Int. J. Environ. Res. Public Health 19(5), 2867 (2022)","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"967_CR118","doi-asserted-by":"publisher","unstructured":"Abascal, J., Arrue, M., Valencia, X.: Tools for web accessibility evaluation. In: Yesilada, Y., Harper, S. (eds) Web Accessibility. Human\u2013Computer Interaction Series. Springer, London (2019). https:\/\/doi.org\/10.1007\/978-1-4471-7440-0_26","DOI":"10.1007\/978-1-4471-7440-0_26"},{"issue":"1","key":"967_CR119","first-page":"258","volume":"10","author":"H Najadat","year":"2021","unstructured":"Najadat, H., Al-Badarneh, A., Alodibat, S.: A review of website evaluation using web diagnostic tools and data envelopment analysis. Bull. Electr. Eng. Inf. 10(1), 258\u2013265 (2021)","journal-title":"Bull. Electr. Eng. Inf."},{"key":"967_CR120","unstructured":"Muniandy, M., Sulaiman, S.: The role of multimedia design elements in computer accessibility for visually impaired: a complete review. J. Theor. Appl. Inf. Technol. 95(20) (2017)"},{"issue":"5","key":"967_CR121","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1007\/s11528-021-00624-6","volume":"65","author":"SJ Baldwin","year":"2021","unstructured":"Baldwin, S.J., Ching, Y.H.: Accessibility in online courses: a review of national and statewide evaluation instruments. TechTrends 65(5), 731\u2013742 (2021)","journal-title":"TechTrends"},{"issue":"8","key":"967_CR122","doi-asserted-by":"crossref","first-page":"953","DOI":"10.3390\/electronics10080953","volume":"10","author":"U Oh","year":"2021","unstructured":"Oh, U., Joh, H., Lee, Y.: Image accessibility for screen reader users: a systematic review and a road map. Electronics 10(8), 953 (2021)","journal-title":"Electronics"},{"issue":"21","key":"967_CR123","doi-asserted-by":"crossref","first-page":"7859","DOI":"10.3390\/app10217859","volume":"10","author":"L Salvador-Ullauri","year":"2020","unstructured":"Salvador-Ullauri, L., Acosta-Vargas, P., Luj\u00e1n-Mora, S.: Web-based serious games and accessibility: a systematic literature review. Appl. Sci. 10(21), 7859 (2020)","journal-title":"Appl. Sci."},{"key":"967_CR124","unstructured":"Araa, J., Cecilia, S.L.: Artificial intelligence in web accessibility: potentials and possible challenges. In: Proceedings of IAC 2022 in Vienna, p. 173 (2022)"}],"container-title":["Universal Access in the Information Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10209-023-00967-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10209-023-00967-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10209-023-00967-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T13:07:33Z","timestamp":1716901653000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10209-023-00967-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,27]]},"references-count":124,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["967"],"URL":"https:\/\/doi.org\/10.1007\/s10209-023-00967-2","relation":{},"ISSN":["1615-5289","1615-5297"],"issn-type":[{"value":"1615-5289","type":"print"},{"value":"1615-5297","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,27]]},"assertion":[{"value":"10 January 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}