{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T08:13:40Z","timestamp":1765268020083,"version":"3.45.0"},"reference-count":26,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2008,5,1]],"date-time":"2008-05-01T00:00:00Z","timestamp":1209600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["520798"],"award-info":[{"award-number":["520798"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2008,5]]},"abstract":"<jats:p>There are many important factors in the design of evaluation studies for systems that generate animations of American Sign Language (ASL) sentences, and techniques for evaluating natural language generation of written texts are not easily adapted to ASL. When conducting user-based evaluations, several cultural and linguistic characteristics of members of the American Deaf community must be taken into account so as to ensure the accuracy of evaluations involving these users. This article describes an implementation and user-based evaluation (by native ASL signers) of a prototype ASL natural language generation system that produces sentences containing classifier predicates, which are frequent and complex spatial phenomena that previous ASL generators have not produced. Native signers preferred the system's output to Signed English animations -- scoring it higher in grammaticality, understandability, and naturalness of movement. They were also more successful at a comprehension task after viewing the system's classifier predicate animations.<\/jats:p>","DOI":"10.1145\/1361203.1361206","type":"journal-article","created":{"date-parts":[[2009,1,13]],"date-time":"2009-01-13T08:15:48Z","timestamp":1231834548000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Evaluation of American Sign Language Generation by Native ASL Signers"],"prefix":"10.1145","volume":"1","author":[{"given":"Matt","family":"Huenerfauth","sequence":"first","affiliation":[{"name":"The City University of New York, Queens College"}]},{"given":"Liming","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}]},{"given":"Erdan","family":"Gu","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}]},{"given":"Jan","family":"Allbeck","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}]}],"member":"320","published-online":{"date-parts":[[2008,5]]},"reference":[{"volume-title":"Proceedings of the SAE Digital Human Modeling Conference.]]","author":"Badler N.","key":"e_1_2_1_1_1","unstructured":"Badler, N., Allbeck, J., Lee, S. J., Rabbitz, R., Broderick, T., and Mulkern, K. 2005. New behavioral paradigms for virtual human models. In Proceedings of the SAE Digital Human Modeling Conference.]]"},{"volume-title":"Proceedings of the AAAI Spring Symposium.]]","author":"Badler N.","key":"e_1_2_1_2_1","unstructured":"Badler, N., Bindiganavale, R., Allbeck, J., Schuler, W., Zhao, L., Lee, S., Shin, H., and Palmer, M. 2000. Parameterized action representation & natural language instructions for dynamic behavior modification of embodied agents. In Proceedings of the AAAI Spring Symposium.]]"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.3115\/1118253.1118255"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383316"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Emmorey K. (ed.). 2003. Perspectives on Classifier Constructions in Sign Languages. Lawrence Erlbaum Associates Mahwah NJ.]]","DOI":"10.4324\/9781410607447"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1353\/aad.2012.0684"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290600636769"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1269442"},{"key":"e_1_2_1_9_1","volume-title":"Animations from Article in ACM Transactions on Accessible Computing (TACCESS). Linguistic and Assistive Technologies Laboratory website. (Accessed on","author":"Huenerfauth M.","year":"2008","unstructured":"Huenerfauth, M. 2008. Animations from Article in ACM Transactions on Accessible Computing (TACCESS). Linguistic and Assistive Technologies Laboratory website. (Accessed on 28 March 2008.) http:\/\/latlab.cs.qc.cuny.edu\/taccess2008\/.]]"},{"volume-title":"Generalization of Knowledge: Multidisciplinary Perspectives","author":"Huenerfauth M.","key":"e_1_2_1_10_1","unstructured":"Huenerfauth, M. In Press. Representing ASL Classifier Predicates Using Spatially Parameterized Planning Templates. In Generalization of Knowledge: Multidisciplinary Perspectives. M. T. Banich and D. Caccamise, Eds., Psychology Press, New York, NY.]]"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1610065.1610072"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1296843.1296879"},{"volume-title":"Cambridge University Press","author":"Liddell S.","key":"e_1_2_1_13_1","unstructured":"Liddell, S. 2003. Grammar, Gesture, and Meaning in American Sign Language. Cambridge University Press, Cambridge, UK.]]"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Lucas C. and Valli C. 1992. Language Contact in the American Deaf Community. Academic Press San Diego CA.]]","DOI":"10.1163\/9789004653337"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1353\/sls.2006.0019"},{"volume-title":"Proceedings of the 5th SALTMIL Workshop on Minority Languages, Language Resources and Evaluation Conference (LREC-2006)","author":"Morrissey S.","key":"e_1_2_1_16_1","unstructured":"Morrissey, S. and Way, A. 2006. Lost in translation: The problems of using mainstream MT evaluation metrics for sign language translation. In Proceedings of the 5th SALTMIL Workshop on Minority Languages, Language Resources and Evaluation Conference (LREC-2006).]]"},{"key":"e_1_2_1_17_1","unstructured":"Neidle C. Kegl J. MacLaughlin D. Bahan B. and Lee R. G. 2000. The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. The MIT Press Cambridge MA.]]"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Padden C. and Humphries T. 2005. Inside Deaf Culture. Harvard University Press Cambridge MA.]]","DOI":"10.4159\/9780674041752"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"volume-title":"Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications.]]","author":"Pasquariello S.","key":"e_1_2_1_20_1","unstructured":"Pasquariello, S. and Pelachaud, C. 2001. Greta: A simple facial animation engine. In Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications.]]"},{"key":"e_1_2_1_21_1","unstructured":"S\u00e1f\u00e1r \u00c9. and Marshall I. 2001. The architecture of an English-text-to-Sign-Languages translation system. In Recent Advances in Natural Language Processing.]]"},{"volume-title":"Sign Language and Linguistic Universals","author":"Sandler W.","key":"e_1_2_1_22_1","unstructured":"Sandler, W. and Lillo-Martin, D. 2006. Sign Language and Linguistic Universals. Cambridge University Press, Cambridge, UK.]]"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordjournals.deafed.a014308"},{"key":"e_1_2_1_24_1","first-page":"27","volume-title":"Proceedings of the 2nd National Symposium on Sign Language Research and Teaching, F. Caccamise and D. Hicks (eds.), National Association for the Deaf","author":"Supalla T.","year":"1978","unstructured":"Supalla, T. 1978. Morphology of verbs of motion and location. In Proceedings of the 2nd National Symposium on Sign Language Research and Teaching, F. Caccamise and D. Hicks (eds.), National Association for the Deaf, Silver Spring, MD. pp. 27--45.]]"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/648180.749243"},{"volume-title":"Proceedings of the 2005 SAE Digital Human Modeling for Design and Engineering Conference and Exhibition.]]","author":"Zhao L.","key":"e_1_2_1_26_1","unstructured":"Zhao, L., Liu, Y., and Badler, N. I. 2005. Applying empirical data on upper torso movement to real-time collision-free reach tasks. In Proceedings of the 2005 SAE Digital Human Modeling for Design and Engineering Conference and Exhibition.]]"}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1361203.1361206","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1361203.1361206","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1361203.1361206","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T09:47:42Z","timestamp":1763459262000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1361203.1361206"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,5]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2008,5]]}},"alternative-id":["10.1145\/1361203.1361206"],"URL":"https:\/\/doi.org\/10.1145\/1361203.1361206","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"type":"print","value":"1936-7228"},{"type":"electronic","value":"1936-7236"}],"subject":[],"published":{"date-parts":[[2008,5]]},"assertion":[{"value":"2007-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-04-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-05-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}