{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T17:13:04Z","timestamp":1777050784452,"version":"3.51.4"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T00:00:00Z","timestamp":1674432000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T00:00:00Z","timestamp":1674432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004837","name":"Ministry of Science and Innovation","doi-asserted-by":"crossref","award":["PID2020-116527RB-I00"],"award-info":[{"award-number":["PID2020-116527RB-I00"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Computing"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Subtitles are critical elements in making TV as accessible as possible for people with hearing impairment, elderly people and other end-users that could need this kind of service. Moreover, delay in live-originated TV captions or subtitles is a significant factor in the audience\u2019s perception of the absence of quality for the deaf and hard of hearing. This lack of synchronisation leads to poor quality broadcasts because of the inconsistency between images and subtitles presented to the viewer. In some cases, this situation leads to a misunderstanding of the message. Subtitling is a reactive process that starts once a minimum of audio information has been generated and ends when an insertion time, deletion time and text are allocated. Therefore, there will always be a delay associated with this process, related to the audio duration being subtitled and the subtitle production time. Moreover, in live TV programmes, unsynchronised audio and subtitles are inherent to the subtitling process because the broadcasting is performed in real-time. In this paper, the authors present the Synchro-Sub framework for synchronising subtitles with the audio-visual contents for live-captioned TV programs. For doing this, and considering the knowledge obtained in previous approaches defined by the authors, several improvements have been included in the transcription and <jats:italic>chronization<\/jats:italic> phases of the framework that increase the percentage of correctly timed subtitles.<\/jats:p>","DOI":"10.1007\/s00607-023-01156-y","type":"journal-article","created":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T15:14:50Z","timestamp":1674486890000},"page":"1467-1495","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Synchro-Sub, an adaptive multi-algorithm framework for real-time subtitling synchronisation of multi-type TV programmes"],"prefix":"10.1007","volume":"105","author":[{"given":"Jose Manuel","family":"Masiello-Ruiz","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Belen","family":"Ruiz-Mezcua","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paloma","family":"Martinez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8294-3157","authenticated-orcid":false,"given":"Israel","family":"Gonzalez-Carrasco","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,1,23]]},"reference":[{"key":"1156_CR1","doi-asserted-by":"crossref","unstructured":"Mart\u00edn A, Gonz\u00e1lez-Carrasco I, Rodriguez-Fernandez V, Souto-Rico M, Camacho D, Ruiz-Mezcua B (2021) Deep-sync: a novel deep learning-based tool for semantic-aware subtitling synchronisation. Neural Comput Appl 1\u201315","DOI":"10.1007\/s00521-021-05751-y"},{"key":"1156_CR2","doi-asserted-by":"crossref","unstructured":"Simpson MN, Barrett J, Bell PJ, Renals S (2016) Just-in-time prepared captioning for live transmissions. In: IBC 2016 conference, pp 27 (9 .)\u201327 (9 .). Institution of Engineering and Technology","DOI":"10.1049\/ibc.2016.0027"},{"key":"1156_CR3","doi-asserted-by":"publisher","first-page":"60968","DOI":"10.1109\/ACCESS.2019.2915581","volume":"7","author":"I Gonzalez-Carrasco","year":"2019","unstructured":"Gonzalez-Carrasco I, Puente L, Ruiz-Mezcua B, Lopez-Cuadrado JL (2019) Sub-sync: automatic synchronization of subtitles in the broadcasting of true live programs in Spanish. IEEE Access 7:60968\u201360983","journal-title":"IEEE Access"},{"issue":"3","key":"1156_CR4","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1016\/0022-2836(70)90057-4","volume":"48","author":"Saul B Needleman","year":"1970","unstructured":"Needleman Saul B, Wunsch Christian D (1970) A general method applicable to the search for similarities in the amino acid sequence of two proteins. J Mol Biol 48(3):443\u2013453","journal-title":"J Mol Biol"},{"key":"1156_CR5","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/0022-2836(81)90087-5","volume":"147","author":"TF Smith","year":"1981","unstructured":"Smith TF, Waterman MS (1981) Identification of common molecular subsequences. J Mol Biol 147:195\u2013197","journal-title":"J Mol Biol"},{"key":"1156_CR6","unstructured":"World Health Organization (2011) World disability report. Technical report"},{"key":"1156_CR7","doi-asserted-by":"crossref","unstructured":"Mocanu B, Tapu R, Zaharia T (2019) Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning. In: 2019 7th E-health and bioengineering conference, EHB 2019. Institute of Electrical and Electronics Engineers Inc","DOI":"10.1109\/EHB47216.2019.8970038"},{"issue":"7","key":"1156_CR8","doi-asserted-by":"publisher","first-page":"75","DOI":"10.3390\/brainsci7070075","volume":"7","author":"A Tamayo","year":"2017","unstructured":"Tamayo A, Chaume F (2017) Subtitling for d\/deaf and hard-of-hearing children: current practices and new possibilities to enhance language development. Brain Sci 7(7):75","journal-title":"Brain Sci"},{"key":"1156_CR9","doi-asserted-by":"crossref","unstructured":"Hong R, Wang M, Xu M, Yan S, Chua TS (2010) Dynamic captioning: video accessibility enhancement for hearing impairment. In: MM\u201910 - proceedings of the ACM multimedia 2010 international conference, ACM Press, New York, USA, pp 421\u2013430","DOI":"10.1145\/1873951.1874013"},{"key":"1156_CR10","doi-asserted-by":"crossref","unstructured":"Safadi B, Sahuguet M, Huet B (2014) When textual and visual information join forces for multimedia retrieval. In: ICMR 2014 - proceedings of the ACM international conference on multimedia retrieval 2014, Association for Computing Machinery, pp 265\u2013272","DOI":"10.1145\/2578726.2578760"},{"issue":"4","key":"1156_CR11","doi-asserted-by":"publisher","first-page":"3961","DOI":"10.1007\/s11042-017-5092-0","volume":"78","author":"Y Jararweh","year":"2019","unstructured":"Jararweh Y, Al-Ayyoub M, Fakirah M, Alawneh L, Gupta BB (2019) Improving the performance of the needleman-wunsch algorithm using parallelization and vectorization techniques. Multimed Tools Appl 78(4):3961\u20133977","journal-title":"Multimed Tools Appl"},{"issue":"3","key":"1156_CR12","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1016\/0022-2836(70)90057-4","volume":"48","author":"SB Needleman","year":"1970","unstructured":"Needleman SB, Wunsch Christian D (1970) A general method applicable to the search for similarities in the amino acid sequence of two proteins. J Mol Biol 48(3):443\u2013453","journal-title":"J Mol Biol"},{"issue":"4","key":"1156_CR13","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1016\/j.dss.2010.05.001","volume":"49","author":"RF Day","year":"2010","unstructured":"Day RF (2010) Examining the validity of the Needleman-Wunsch algorithm in identifying decision strategy with eye-movement data. Decis Support Syst 49(4):396\u2013403","journal-title":"Decis Support Syst"},{"key":"1156_CR14","doi-asserted-by":"crossref","unstructured":"Zhang F, Qiao XZ, Liu ZY (2002) A parallel Smith-Waterman algorithm based on divide and conquer. In: Proceedings - 5th international conference on algorithms and architectures for parallel processing, ICA3PP 2002, Institute of Electrical and Electronics Engineers Inc., pp 162\u2013169","DOI":"10.1109\/ICAPP.2002.1173568"},{"key":"1156_CR15","doi-asserted-by":"crossref","unstructured":"Ligowski L, Rudnicki W (2009) An efficient implementation of Smith Waterman algorithm on GPU using CUDA, for massively parallel scanning of sequence databases. In: IPDPS 2009 - proceedings of the 2009 IEEE international parallel and distributed processing symposium","DOI":"10.1109\/IPDPS.2009.5160931"},{"key":"1156_CR16","doi-asserted-by":"crossref","unstructured":"Su Z, Ahn BR, Eom KY, Kang MK, Kim JP, Kim MK (2008) Plagiarism detection using the Levenshtein distance and Smith-Waterman algorithm. In: 3rd International conference on innovative computing information and control, ICICIC\u201908","DOI":"10.1109\/ICICIC.2008.422"},{"key":"1156_CR17","doi-asserted-by":"crossref","unstructured":"Lemantara J, Dewiyani\u00a0Sunarto MJ, Hariadi B, Sagirani T, Amelia T (2018) Prototype of online examination on MoLearn applications using text similarity to detect plagiarism. In: Proceedings - 2018 5th international conference on information technology, Computer and Electrical Engineering, ICITACEE 2018, Institute of Electrical and Electronics Engineers Inc., pp 131\u2013136","DOI":"10.1109\/ICITACEE.2018.8576922"},{"key":"1156_CR18","doi-asserted-by":"crossref","unstructured":"Popescu M (2010) An ontological fuzzy Smith-Waterman with applications to patient retrieval in Electronic Medical Records. In: (2010) IEEE World Congress on Computational Intelligence. WCCI 2010","DOI":"10.1109\/FUZZY.2010.5583953"},{"key":"1156_CR19","doi-asserted-by":"crossref","unstructured":"Souto-Rico M, Gonz\u00e1lez-Carrasco I, L\u00f3pez-Cuadrado J-L, Ruiz-Mezcua B (2020) A new system for automatic analysis and quality adjustment in audiovisual subtitled-based contents by means of genetic algorithms. Expert Systems","DOI":"10.1111\/exsy.12512"},{"key":"1156_CR20","unstructured":"Garcia J\u00a0E, Ortega A, Lleida E, Lozano T, Bernues E, Sanchez D (2009) Audio and text synchronization for TV news subtitling based on automatic speech recognition. In: 2009 IEEE International symposium on broadband multimedia systems and broadcasting, BMSB 2009, IEEE, pp 1\u20136"},{"issue":"1","key":"1156_CR21","first-page":"15","volume":"E86\u2013D","author":"A Ando","year":"2003","unstructured":"Ando A, Imai T, Kobayashi A, Homma S, Goto J, Seiyama N, Mishima T, Kobayakawa T, Sato S, Onoe K, Segi H, Imai A, Matsui A, Nakamura A, Tanaka H, Takagi T, Miyasaka E, Isono H (2003) Simultaneous subtitling system for broadcast news programs with a speech recognizer. IEICE Trans Inf Syst E86\u2013D(1):15\u201325","journal-title":"IEICE Trans Inf Syst"},{"key":"1156_CR22","doi-asserted-by":"crossref","unstructured":"Lertwongkhanakool N, Punyabukkana P, Suchato A (2013) Real-time synchronization of live speech with its transcription. In: 2013 10th International Conference on Electrical Engineering\/Electronics, Computer, Telecommunications and Information Technology, ECTI-CON 2013","DOI":"10.1109\/ECTICon.2013.6559560"},{"key":"1156_CR23","doi-asserted-by":"crossref","unstructured":"de\u00a0Castro M, Rodr\u00edguez L\u00a0P, Ruiz-Mezcua B (2015) Synchronized subtitles in live television programmes. In: Audiovisual translation in a global context, Palgrave Macmillan UK, pp 51\u201371","DOI":"10.1057\/9781137552891_4"},{"key":"1156_CR24","doi-asserted-by":"crossref","unstructured":"Pra\u017e\u00e1k A, Loose Z, Trmal J, Psutka J, Psutka J (2012) Captioning of live TV programs through speech recognition and re-speaking. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 7499 LNAI. Springer, Berlin, Heidelberg, pp 513\u2013519","DOI":"10.1007\/978-3-642-32790-2_62"},{"key":"1156_CR25","doi-asserted-by":"crossref","unstructured":"Gao J, Zhao Q, Li T, Yan Y (2009) Simultaneous synchronization of text and speech for broadcast news subtitling. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 5553 LNCS. pp 576\u2013585","DOI":"10.1007\/978-3-642-01513-7_63"},{"issue":"3","key":"1156_CR26","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1109\/11.892155","volume":"46","author":"A Ando","year":"2000","unstructured":"Ando A, Imai T, Kobayashi A, Isono H, Nakabayashi K (2000) Real-time transcription system for simultaneous subtitling of Japanese broadcast news programs. IEEE Trans Broadcast 46(3):189\u2013196","journal-title":"IEEE Trans Broadcast"},{"key":"1156_CR27","doi-asserted-by":"crossref","unstructured":"Suzuki T (2020) Simultaneous speech subtitling systems for multiple speakers. In: Communications in Computer and Information Science, vol 1226 CCIS. Springer, pp 114\u2013120","DOI":"10.1007\/978-3-030-50732-9_16"},{"issue":"8","key":"1156_CR28","first-page":"707","volume":"10","author":"Vladimir Levenshtein","year":"1966","unstructured":"Levenshtein Vladimir (1966) Binary codes capable of correcting deletions, insertions, and reversals. Sov Phys Dokl 10(8):707\u2013710","journal-title":"Sov Phys Dokl"},{"key":"1156_CR29","unstructured":"AENOR (2012) UNE 153010:2012. Subtitulado para personas sordas y personas con discapacidad auditiva"},{"key":"1156_CR30","unstructured":"Souto-Rico M (2021) Estudio de la velocidad de los subt\u00edtulos para sordos en Espa\u00f1a y sus consecuencias normativas. PhD thesis"}],"container-title":["Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00607-023-01156-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00607-023-01156-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00607-023-01156-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,31]],"date-time":"2023-05-31T12:11:29Z","timestamp":1685535089000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00607-023-01156-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,23]]},"references-count":30,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["1156"],"URL":"https:\/\/doi.org\/10.1007\/s00607-023-01156-y","relation":{},"ISSN":["0010-485X","1436-5057"],"issn-type":[{"value":"0010-485X","type":"print"},{"value":"1436-5057","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,23]]},"assertion":[{"value":"23 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}