{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T22:59:50Z","timestamp":1772233190181,"version":"3.50.1"},"reference-count":45,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2019,11,27]],"date-time":"2019-11-27T00:00:00Z","timestamp":1574812800000},"content-version":"unspecified","delay-in-days":26,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIEDAM"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Conventional tests with written information used for the evaluation of sign language (SL) comprehension introduce distortions due to the translation process. This fact affects the results and conclusions drawn and, for that reason, it is necessary to design and implement the same language interpreter-independent evaluation tools. Novel web technologies facilitate the design of web interfaces that support online, multiple-choice questionnaires, while exploiting the storage of tracking data as a source of information about user interaction. This paper proposes an online, multiple-choice sign language questionnaire based on an intuitive methodology. It helps users to complete tests and automatically generates accurate, statistical results using the information and data obtained in the process. The proposed system presents SL videos and enables user interaction, fulfilling the requirements that SL interpretation is not able to cover. The questionnaire feeds a remote database with the user answers and powers the automatic creation of data for analytics. Several metrics, including time elapsed, are used to assess the usability of the SL questionnaire, defining the goals of the predictive models. These predictions are based on machine learning models, with the demographic data of the user as features for estimating the usability of the system. This questionnaire reduces costs and time in terms of interpreter dedication, as well as widening the amount of data collected while employing user native language. The validity of this tool was demonstrated in two different use cases.<\/jats:p>","DOI":"10.1017\/s0890060419000374","type":"journal-article","created":{"date-parts":[[2019,11,27]],"date-time":"2019-11-27T08:26:49Z","timestamp":1574843209000},"page":"429-441","source":"Crossref","is-referenced-by-count":5,"title":["Design and development of sign language questionnaires based on video and web interfaces"],"prefix":"10.1017","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5400-2747","authenticated-orcid":false,"given":"Juan Pedro","family":"L\u00f3pez","sequence":"first","affiliation":[]},{"given":"Marta","family":"Bosch-Baliarda","sequence":"additional","affiliation":[]},{"given":"Carlos Alberto","family":"Mart\u00edn","sequence":"additional","affiliation":[]},{"given":"Jos\u00e9 Manuel","family":"Men\u00e9ndez","sequence":"additional","affiliation":[]},{"given":"Pilar","family":"Orero","sequence":"additional","affiliation":[]},{"given":"Olga","family":"Soler","sequence":"additional","affiliation":[]},{"given":"Federico","family":"\u00c1lvarez","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2019,11,27]]},"reference":[{"key":"S0890060419000374_ref45","doi-asserted-by":"publisher","DOI":"10.7763\/IJMLC.2014.V4.414"},{"key":"S0890060419000374_ref43","unstructured":"World Federation of the Deaf (2018) World federation of the deaf. Available at https:\/\/wfdeaf.org"},{"key":"S0890060419000374_ref42","volume-title":"Data Mining: Practical Machine Learning Tools and Techniques","author":"Witten","year":"2016"},{"key":"S0890060419000374_ref40","first-page":"11","article-title":"Evaluating intelligibility and battery drain of mobile sign language video transmitted at low frame rates and bit rates","volume":"7","author":"Tran","year":"2015","journal-title":"ACM Transactions on Accessible Computing (TACCESS)"},{"key":"S0890060419000374_ref37","unstructured":"Smith R , Morrissey S and Somers H (2010) HCI for the deaf community: developing human-like avatars for sign language synthesis."},{"key":"S0890060419000374_ref30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-61061-0_3"},{"key":"S0890060419000374_ref29","unstructured":"MDN Web Docs (2019) Web technology for developers: JavaScript. Last updated March 2019. Available at https:\/\/developer.mozilla.org\/en-US\/docs\/Web\/JavaScript"},{"key":"S0890060419000374_ref28","doi-asserted-by":"publisher","DOI":"10.2105\/AJPH.2013.301343"},{"key":"S0890060419000374_ref27","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2017.08.033"},{"key":"S0890060419000374_ref24","volume-title":"Research Methods in Human-Computer Interaction","author":"Lazar","year":"2017"},{"key":"S0890060419000374_ref22","volume-title":"A study of cross-validation and bootstrap for accuracy estimation and model selection. In International Joint Conferences on Artificial Intelligence","author":"Kohavi","year":"1995"},{"key":"S0890060419000374_ref21","unstructured":"Internet Engineering Task Force, IETF (2014) RFC 7159: the javascript object notation (JSON). Data Interchange Format. March, 2014. Available at https:\/\/tools.ietf.org\/html\/rfc7159"},{"key":"S0890060419000374_ref20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2005.08.023"},{"key":"S0890060419000374_ref19","unstructured":"HBB4ALL Consortium (2017) Hbb4all: hybrid broadcast broadband for all. Available at http:\/\/pagines.uab.cat\/hbb4all\/"},{"key":"S0890060419000374_ref16","doi-asserted-by":"crossref","DOI":"10.15460\/HUP.111","volume-title":"Adaptation and Evaluation of a German Sign Language Test","author":"Haug","year":"2011"},{"key":"S0890060419000374_ref15","doi-asserted-by":"publisher","DOI":"10.1353\/aad.2016.0016"},{"key":"S0890060419000374_ref14","doi-asserted-by":"publisher","DOI":"10.1057\/978-1-137-56917-2_2"},{"key":"S0890060419000374_ref13","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9473(01)00065-2"},{"key":"S0890060419000374_ref12","unstructured":"Fontaine S (2012) Surveying populations with disabilities. Specific mixed-mode methodologies to include sensory disabled people in quantitative surveys. International Conference on Methods for Surveying and Enumerating Hard-to-Reach Populations, New Orleans, October\u2013November 2012."},{"key":"S0890060419000374_ref11","volume-title":"What is a Survey?","author":"Ferber","year":"1980"},{"key":"S0890060419000374_ref9","unstructured":"EasyTV Consortium (2018) Easy tv: easing the access of Europeans with disabilities to converging media and content. Available at http:\/\/easytvproject.eu"},{"key":"S0890060419000374_ref8","unstructured":"Dom\u00ednguez AB (2017) Educaci\u00f3n para la inclusi\u00f3n de alumnos sordos. Revista Latinoamericana de Educaci\u00f3n Inclusiva."},{"key":"S0890060419000374_ref7","first-page":"207","volume-title":"The Handbook of Minority Languages and Communities","author":"De Meulder","year":"2018"},{"key":"S0890060419000374_ref6","unstructured":"Cooper M , Reid LG , Vanderheiden G and Caldwell B (2016) Techniques for WCAG 2.0-techniques and failures for web content accessibility guidelines 2.0. W3C note (last version: 7 October 2016). World Wide Web Consortium (W3C), October."},{"key":"S0890060419000374_ref5","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2132730"},{"key":"S0890060419000374_ref4","doi-asserted-by":"publisher","DOI":"10.1145\/1168987.1169001"},{"key":"S0890060419000374_ref3","unstructured":"Bibal A and Fr\u00e9nay B (2016) Interpretability of machine learning models and representations: an introduction. Proceedings of the ESANN, ESANN."},{"key":"S0890060419000374_ref2","doi-asserted-by":"publisher","DOI":"10.3310\/phr04080"},{"key":"S0890060419000374_ref36","doi-asserted-by":"publisher","DOI":"10.1145\/1015530.1015552"},{"key":"S0890060419000374_ref38","doi-asserted-by":"publisher","DOI":"10.1145\/2049536.2049558"},{"key":"S0890060419000374_ref44","unstructured":"World Wide Web Consortium, W3C (2017) HTML 5.2 W3C Recommendation, 14 December 2017. Available at https:\/\/www.w3.org\/TR\/html5\/"},{"key":"S0890060419000374_ref41","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2212832"},{"key":"S0890060419000374_ref1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118346013.ch2"},{"key":"S0890060419000374_ref10","doi-asserted-by":"publisher","DOI":"10.1177\/1329878X1214200108"},{"key":"S0890060419000374_ref35","first-page":"533","volume-title":"The handbook of linguistics","author":"Sandler","year":"2001"},{"key":"S0890060419000374_ref33","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124942"},{"key":"S0890060419000374_ref39","doi-asserted-by":"publisher","DOI":"10.1145\/2661334.2661358"},{"key":"S0890060419000374_ref17","doi-asserted-by":"publisher","DOI":"10.1179\/1557069X14Y.0000000041"},{"key":"S0890060419000374_ref23","doi-asserted-by":"publisher","DOI":"10.4324\/9780203762974"},{"key":"S0890060419000374_ref32","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2013.05.003"},{"key":"S0890060419000374_ref18","doi-asserted-by":"publisher","DOI":"10.1093\/deafed\/enm027"},{"key":"S0890060419000374_ref31","first-page":"105","article-title":"Conducting experimental research in audiovisual translation (avt): a position paper","volume":"30","author":"Orero","year":"2018","journal-title":"JosTrans: The Journal of Specialised Translation"},{"key":"S0890060419000374_ref25","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmat.2017.08.002"},{"key":"S0890060419000374_ref34","unstructured":"Pyfers L , Robinson J and Schmaling C (n.d.) Deliverable 3.1: signing books for the deaf in EU-countries: state of the art."},{"key":"S0890060419000374_ref26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67684-5_13"}],"container-title":["Artificial Intelligence for Engineering Design, Analysis and Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0890060419000374","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T00:30:34Z","timestamp":1665102634000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0890060419000374\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,11]]}},"alternative-id":["S0890060419000374"],"URL":"https:\/\/doi.org\/10.1017\/s0890060419000374","relation":{},"ISSN":["0890-0604","1469-1760"],"issn-type":[{"value":"0890-0604","type":"print"},{"value":"1469-1760","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]}}}