{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T23:34:49Z","timestamp":1780961689903,"version":"3.54.1"},"publisher-location":"Cham","reference-count":17,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031628481","type":"print"},{"value":"9783031628498","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T00:00:00Z","timestamp":1720137600000},"content-version":"vor","delay-in-days":186,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study investigates the feasibility of employing artificial intelligence and large language models (LLMs) to customize closed captions\/subtitles to match the personal needs of deaf and hard of hearing viewers. Drawing on recorded live TV samples, it compares user ratings of caption quality, speed, and understandability across five experimental conditions: unaltered verbatim captions, slowed-down verbatim captions, moderately and heavily edited captions via ChatGPT, and lightly edited captions by an LLM optimized for TV content by AppTek, LLC. Results across 16 deaf and hard of hearing participants show a significant preference for verbatim captions, both at original speeds and in the slowed-down version, over those edited by ChatGPT. However, a small number of participants also rated AI-edited captions as best. Despite the overall poor showing of AI, the results suggest that LLM-driven customization of captions on a per-user and per-video basis remains an important avenue for future research.<\/jats:p>","DOI":"10.1007\/978-3-031-62849-8_7","type":"book-chapter","created":{"date-parts":[[2024,7,4]],"date-time":"2024-07-04T16:02:04Z","timestamp":1720108924000},"page":"50-58","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Customization of Closed Captions via Large Language Models"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-6114-4355","authenticated-orcid":false,"given":"Mariana","family":"Arroyo Chavez","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1611-4287","authenticated-orcid":false,"given":"Bernard","family":"Thompson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9889-6355","authenticated-orcid":false,"given":"Molly","family":"Feanny","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8015-7439","authenticated-orcid":false,"given":"Kafayat","family":"Alabi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2599-8954","authenticated-orcid":false,"given":"Minchan","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3771-3684","authenticated-orcid":false,"given":"Lu","family":"Ming","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1763-4352","authenticated-orcid":false,"given":"Abraham","family":"Glasser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0493-413X","authenticated-orcid":false,"given":"Raja","family":"Kushalnagar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2590-6880","authenticated-orcid":false,"given":"Christian","family":"Vogler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,5]]},"reference":[{"key":"7_CR1","doi-asserted-by":"crossref","unstructured":"Berke, L., Albusays, K., Seita, M., Huenerfauth, M.: Preferred appearance of captions generated by automatic speech recognition for deaf and hard-of-hearing viewers. In: Extended Abstracts of 2019 CHI Conference on Human Factors in Computing Systems, pp. 1\u20136 (2019)","DOI":"10.1145\/3290607.3312921"},{"key":"7_CR2","doi-asserted-by":"crossref","unstructured":"Butler, J.: Perspectives of deaf and hard of hearing viewers of captions. Am. Ann. Deaf 163(5), 534\u2013553 (2019). https:\/\/www.jstor.org\/stable\/26663593","DOI":"10.1353\/aad.2019.0002"},{"key":"7_CR3","doi-asserted-by":"publisher","unstructured":"Arroyo Chavez, M., et al.: How users experience closed captions on live television: quality metrics remain a challenge. In: 2024 CHI Conference on Human Factors in Computing Systems (2024, to appear). https:\/\/doi.org\/10.1145\/3613904.3641988","DOI":"10.1145\/3613904.3641988"},{"key":"7_CR4","doi-asserted-by":"crossref","unstructured":"Fresno, N.: Watching accessible cartoons: the speed of closed captions for young audiences in the United States. Perspectives 26(3), 405\u2013421 (2018). https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/0907676X.2017.1377264","DOI":"10.1080\/0907676X.2017.1377264"},{"key":"7_CR5","doi-asserted-by":"crossref","unstructured":"Gernsbacher, M.A.: Video captions benefit everyone. Policy insights from the behavioral and brain sciences 2(1), 195\u2013202 (2015). https:\/\/www.researchgate.net\/publication\/290395991_Video_Captions_Benefit_Everyon","DOI":"10.1177\/2372732215602130"},{"key":"7_CR6","first-page":"33","volume":"10","author":"R Graham","year":"2022","unstructured":"Graham, R., Choo, J.: Preliminary research on AI-generated caption accuracy rate by platforms and variables. J. Technol. Pers. Disabil. 10, 33\u201353 (2022)","journal-title":"J. Technol. Pers. Disabil."},{"key":"7_CR7","doi-asserted-by":"crossref","unstructured":"Jensema, C.: Viewer reaction to different television captioning speeds. Am. Ann. Deaf 143(4), 318\u2013324 (1998). https:\/\/citeseerx.ist.psu.edu\/document?repid=rep1&type=pdf&doi=221f424fb830672e8b16ff34999d0dad6981e4d1","DOI":"10.1353\/aad.2012.0073"},{"key":"7_CR8","unstructured":"Karlsson, F.: User-centered visualizations of transcription uncertainty in AI-generated subtitles of news broadcast (2020)"},{"key":"7_CR9","doi-asserted-by":"crossref","unstructured":"Kawas, S., Karalis, G., Wen, T., Ladner, R.E.: Improving real-time captioning experiences for deaf and hard of hearing students. In: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 15\u201323 (2016)","DOI":"10.1145\/2982142.2982164"},{"issue":"1","key":"7_CR10","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1017\/S0142716421000503","volume":"43","author":"J-L Kruger","year":"2022","unstructured":"Kruger, J.-L., Wisniewska, N., Liao, S.: Why subtitle speed matters: evidence from word skipping and rereading. Appl. Psycholinguist. 43(1), 211\u2013236 (2022). https:\/\/doi.org\/10.1017\/S0142716421000503","journal-title":"Appl. Psycholinguist."},{"key":"7_CR11","doi-asserted-by":"crossref","unstructured":"Levin, K., et al.: Automated closed captioning for Russian live broadcasting. In: Fifteenth Annual Conference of the International Speech Communication Association (2014)","DOI":"10.21437\/Interspeech.2014-352"},{"key":"7_CR12","doi-asserted-by":"crossref","unstructured":"May, L., et al.: Unspoken sound: identifying trends in non-speech audio captioning on YouTube. In: 2024 CHI Conference on Human Factors in Computing Systems (2024, to appear)","DOI":"10.1145\/3613904.3642162"},{"key":"7_CR13","doi-asserted-by":"crossref","unstructured":"Soe, T.H., Guribye, F., Slavkovik, M.: Evaluating AI assisted subtitling. In: ACM International Conference on Interactive Media Experiences, pp. 96\u2013107 (2021)","DOI":"10.1145\/3452918.3458792"},{"issue":"6","key":"7_CR14","doi-asserted-by":"publisher","first-page":"e0199331","DOI":"10.1371\/journal.pone.0199331","volume":"13","author":"A Szarkowska","year":"2018","unstructured":"Szarkowska, A., Gerber-Mor\u00f3n, O.: Viewers can keep up with fast subtitles: evidence from eye movements. PLoS ONE 13(6), e0199331 (2018). https:\/\/doi.org\/10.1371\/journal.pone.0199331","journal-title":"PLoS ONE"},{"key":"7_CR15","doi-asserted-by":"crossref","unstructured":"Shiver, B.N., Wolfe, R.J.: Evaluating alternatives for better deaf accessibility to selected web-based multimedia. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 231\u2013238 (2015)","DOI":"10.1145\/2700648.2809857"},{"key":"7_CR16","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"916","DOI":"10.1007\/978-3-642-03658-3_110","volume-title":"Human-Computer Interaction \u2013 INTERACT 2009","author":"QV Vy","year":"2009","unstructured":"Vy, Q.V., Fels, D.I.: Using avatars for improving speaker identification in captioning. In: Gross, T., et al. (eds.) INTERACT 2009, Part II. LNCS, vol. 5727, pp. 916\u2013919. Springer, Heidelberg (2009). https:\/\/doi.org\/10.1007\/978-3-642-03658-3_110"},{"key":"7_CR17","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Ma, L., Zhu, W.: Syntax customized video captioning by imitating exemplar sentences. IEEE Trans. Pattern Anal. Mach. Intell. 44(12), 10209\u201310221 (2021). https:\/\/arxiv.org\/abs\/2112.01062","DOI":"10.1109\/TPAMI.2021.3131618"}],"container-title":["Lecture Notes in Computer Science","Computers Helping People with Special Needs"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-62849-8_7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T06:08:06Z","timestamp":1728281286000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-62849-8_7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"ISBN":["9783031628481","9783031628498"],"references-count":17,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-62849-8_7","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024]]},"assertion":[{"value":"5 July 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"Christian Vogler partners with AppTek LLC on the NIDILRR grant that funded most of this work. He also has a separate partnership with AppTek on a joint venture with the goal of providing universal accessibility tools. The other authors have no competing interests to declare that are relevant to the content of this article.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure of Interests"}},{"value":"ICCHP","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Computers Helping People with Special Needs","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Linz","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Austria","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"8 July 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"12 July 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"19","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"icchp2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/www.icchp.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}