{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:23:32Z","timestamp":1750307012997,"version":"3.41.0"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2012,7,1]],"date-time":"2012-07-01T00:00:00Z","timestamp":1341100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Speech Lang. Process."],"published-print":{"date-parts":[[2012,7]]},"abstract":"<jats:p>Developing a multilingual speech translation system requires efforts in constructing automatic speech recognition (ASR), machine translation (MT), and text-to-speech synthesis (TTS) components for all possible source and target languages. If the numerous ASR, MT, and TTS systems for different language pairs developed independently in different parts of the world could be connected, multilingual speech translation systems for a multitude of language pairs could be achieved. Yet, there is currently no common, flexible framework that can provide an entire speech translation process by bringing together heterogeneous speech translation components. In this article we therefore propose a distributed architecture framework for multilingual speech translation in which all speech translation components are provided on distributed servers and cooperate over a network. This framework can facilitate the connection of different components and functions. To show the overall mechanism, we first present our state-of-the-art technologies for multilingual ASR, MT, and TTS components, and then describe how to combine those systems into the proposed network-based framework. The client applications are implemented on a handheld mobile terminal device, and all data exchanges among client users and spoken language technology servers are managed through a Web protocol. To support multiparty communication, an additional communication server is provided for simultaneously distributing the speech translation results from one user to multiple users. Field testing shows that the system is capable of realizing multiparty multilingual speech translation for real-time and location-independent communication.<\/jats:p>","DOI":"10.1145\/2287710.2287712","type":"journal-article","created":{"date-parts":[[2012,7,31]],"date-time":"2012-07-31T13:42:45Z","timestamp":1343742165000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Distributed speech translation technologies for multiparty multilingual communication"],"prefix":"10.1145","volume":"9","author":[{"given":"Sakriani","family":"Sakti","sequence":"first","affiliation":[{"name":"Nara Institute of Science and Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Paul","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Finch","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinhui","family":"Hu","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinfu","family":"Ni","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Noriyuki","family":"Kimura","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shigeki","family":"Matsuda","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chiori","family":"Hori","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yutaka","family":"Ashikari","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hisashi","family":"Kawai","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hideki","family":"Kashioka","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eiichiro","family":"Sumita","sequence":"additional","affiliation":[{"name":"National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Satoshi","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Japan; National Institute of Information and Communications Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,8,2]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.1109\/78.978374"},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.3115\/990820.990824"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.5555\/972470.972474"},{"unstructured":"CCITT. 1984. Absolute Category Rating (ACR) Method for Subjective Testing of Digital Processors. Red Book.  CCITT. 1984. Absolute Category Rating (ACR) Method for Subjective Testing of Digital Processors. Red Book.","key":"e_1_2_1_4_1"},{"volume-title":"Proceedings of the Statistical Machine Translation Workshop (WMT). 208--215","author":"Finch A.","unstructured":"Finch , A. and Sumita , E . 2008. Dynamic model interpolation for statistical machine translation . In Proceedings of the Statistical Machine Translation Workshop (WMT). 208--215 . Finch, A. and Sumita, E. 2008. Dynamic model interpolation for statistical machine translation. In Proceedings of the Statistical Machine Translation Workshop (WMT). 208--215.","key":"e_1_2_1_5_1"},{"volume-title":"Proceedings of the Statistical Machine Translation Workshop (WMT). 128--135","author":"Foster G.","unstructured":"Foster , G. and Kuhn , R . 2007. Mixture model adaptation for SMT . In Proceedings of the Statistical Machine Translation Workshop (WMT). 128--135 . Foster, G. and Kuhn, R. 2007. Mixture model adaptation for SMT. In Proceedings of the Statistical Machine Translation Workshop (WMT). 128--135.","key":"e_1_2_1_6_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_7_1","DOI":"10.1093\/ietisy\/e89-d.3.922"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1093\/biomet\/57.1.97"},{"volume-title":"Proceedings of the 7th Workshop on Asian Language Resource, Annual Meeting of Association for Computational Linguistics (ACL). 65--70","author":"Hu X.","unstructured":"Hu , X. , Isotani , R. , and Nakamura , S . 2009. Construction of Chinese segmented and POS-tagged conversational corpora and their evaluations on spontaneous speech recognitions . In Proceedings of the 7th Workshop on Asian Language Resource, Annual Meeting of Association for Computational Linguistics (ACL). 65--70 . Hu, X., Isotani, R., and Nakamura, S. 2009. Construction of Chinese segmented and POS-tagged conversational corpora and their evaluations on spontaneous speech recognitions. In Proceedings of the 7th Workshop on Asian Language Resource, Annual Meeting of Association for Computational Linguistics (ACL). 65--70.","key":"e_1_2_1_9_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.1093\/ietisy\/e88-d.3.391"},{"volume-title":"Proceedings of the ISCA Speech Synthesis Workshop (SSW5). 179--184","author":"Kawai H.","unstructured":"Kawai , H. , Toda , T. , Ni , J. , Tsuzaki , M. , and Tokuda , K . 2004. XIMERA: A new TTS from ATR based on corpus-based technologies . In Proceedings of the ISCA Speech Synthesis Workshop (SSW5). 179--184 . Kawai, H., Toda, T., Ni, J., Tsuzaki, M., and Tokuda, K. 2004. XIMERA: A new TTS from ATR based on corpus-based technologies. In Proceedings of the ISCA Speech Synthesis Workshop (SSW5). 179--184.","key":"e_1_2_1_11_1"},{"volume-title":"Proceedings of EUROSPEECH. 381--384","author":"Kikui G.","unstructured":"Kikui , G. , Sumita , E. , Takezawa , T. , and Yamamoto , S . 2003. Creating corpora for speech-to-speech translation . In Proceedings of EUROSPEECH. 381--384 . Kikui, G., Sumita, E., Takezawa, T., and Yamamoto, S. 2003. Creating corpora for speech-to-speech translation. In Proceedings of EUROSPEECH. 381--384.","key":"e_1_2_1_12_1"},{"volume-title":"Proceedings of the Autumn Meeting of the Acoustical Society of Japan (ASJ). 19--20","author":"Kikui G.","unstructured":"Kikui , G. , Takezawa , T. , Mizushima , M. , Yamamoto , S. , Sasaki , Y. , Kawai , H. , and Nakamura , S . 2005. Monitor experiments of ATR speech-to-speech translation system . In Proceedings of the Autumn Meeting of the Acoustical Society of Japan (ASJ). 19--20 . Kikui, G., Takezawa, T., Mizushima, M., Yamamoto, S., Sasaki, Y., Kawai, H., and Nakamura, S. 2005. Monitor experiments of ATR speech-to-speech translation system. In Proceedings of the Autumn Meeting of the Acoustical Society of Japan (ASJ). 19--20.","key":"e_1_2_1_13_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_14_1","DOI":"10.1109\/TASL.2006.878262"},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.3115\/1073445.1073462"},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 85--88","author":"Lo W. K.","unstructured":"Lo , W. K. and Soong , F. K . 2005. Generalized posterior probability for minimum error verification of recognized sentences . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 85--88 . Lo, W. K. and Soong, F. K. 2005. Generalized posterior probability for minimum error verification of recognized sentences. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 85--88.","key":"e_1_2_1_16_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_17_1","DOI":"10.3115\/1075096.1075117"},{"doi-asserted-by":"publisher","key":"e_1_2_1_18_1","DOI":"10.3115\/1073083.1073133"},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.1162\/089120103321337421"},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.1006\/csla.1996.0021"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.3115\/1073083.1073135"},{"volume-title":"Proceedings of the International Conference on Computational Linguistics, Workshop (COLING). Companion Volume.165--168","author":"Paul M.","unstructured":"Paul , M. , Okuma , H. , Yamamoto , H. , Sumita , E. , Matsuda , S. , Shimizu , T. , and Nakamura , S . 2008. Multilingual mobile-phone translation services for world travelers . In Proceedings of the International Conference on Computational Linguistics, Workshop (COLING). Companion Volume.165--168 . Paul, M., Okuma, H., Yamamoto, H., Sumita, E., Matsuda, S., Shimizu, T., and Nakamura, S. 2008. Multilingual mobile-phone translation services for world travelers. In Proceedings of the International Conference on Computational Linguistics, Workshop (COLING). Companion Volume.165--168.","key":"e_1_2_1_22_1"},{"volume-title":"Proceedings of the Association for Computational Linguistics: Human Language Technologies (NAACL\/HLT). 221--224","author":"Paul M.","unstructured":"Paul , M. , Yamamoto , H. , Sumita , E. , and Nakamura , S . 2009. On the importance of the pivot language selection for statistical machine translation . In Proceedings of the Association for Computational Linguistics: Human Language Technologies (NAACL\/HLT). 221--224 . Paul, M., Yamamoto, H., Sumita, E., and Nakamura, S. 2009. On the importance of the pivot language selection for statistical machine translation. In Proceedings of the Association for Computational Linguistics: Human Language Technologies (NAACL\/HLT). 221--224.","key":"e_1_2_1_23_1"},{"volume-title":"Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU). 507--512","author":"Sakti S.","unstructured":"Sakti , S. , Kimura , N. , Paul , M. , Hori , C. , Sumita , E. , Nakamura , S. , Park , J. , Wutiwiwachai , C. , Xu , B. , Riza , H. , Arora , K. , Luong , C. , and Li , H . 2009. The Asian network-based speech-to-speech translation system . In Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU). 507--512 . Sakti, S., Kimura, N., Paul, M., Hori, C., Sumita, E., Nakamura, S., Park, J., Wutiwiwachai, C., Xu, B., Riza, H., Arora, K., Luong, C., and Li, H. 2009. The Asian network-based speech-to-speech translation system. In Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU). 507--512.","key":"e_1_2_1_24_1"},{"volume-title":"Proceedings of EUROSPEECH. 221--224","author":"Segura J. C.","unstructured":"Segura , J. C. , Torre , A. D. L. , Benitez , M. C. , and Peinado , A. M . 2001. Model-based compensation of the additive noise for continuous speech recognition. Experiments using the AURORA II database and tasks . In Proceedings of EUROSPEECH. 221--224 . Segura, J. C., Torre, A. D. L., Benitez, M. C., and Peinado, A. M. 2001. Model-based compensation of the additive noise for continuous speech recognition. Experiments using the AURORA II database and tasks. In Proceedings of EUROSPEECH. 221--224.","key":"e_1_2_1_25_1"},{"volume-title":"Proceedings of the International Conference on Spoken Language Processing (ICSLP). 441--444","author":"Soong F. K.","unstructured":"Soong , F. K. , Loo , W. K. , and Nakamura , S . 2004. Optimal acoustic and language model weight for minimizing word verification errors . In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 441--444 . Soong, F. K., Loo, W. K., and Nakamura, S. 2004. Optimal acoustic and language model weight for minimizing word verification errors. In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 441--444.","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the International Conference on Spoken Language Processing (ICSLP). 901--904","author":"Stolcke A.","year":"2002","unstructured":"Stolcke , A. 2002 . SRILM - an extensible language modeling toolkit . In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 901--904 . Stolcke, A. 2002. SRILM - an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 901--904."},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 573--576","author":"Takami J.","unstructured":"Takami , J. and Sagayama , S . 1992. A successive state splitting algorithm for efficient allophone modeling . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 573--576 . Takami, J. and Sagayama, S. 1992. A successive state splitting algorithm for efficient allophone modeling. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 573--576.","key":"e_1_2_1_28_1"},{"volume-title":"Proceedings of EUROSPEECH. 2757--2760","author":"Takezawa T.","unstructured":"Takezawa , T. and Kikui , G . 2003. Collecting machine-translation aided bilingual dialogues for corpus-based speech-to-speech translation . In Proceedings of EUROSPEECH. 2757--2760 . Takezawa, T. and Kikui, G. 2003. Collecting machine-translation aided bilingual dialogues for corpus-based speech-to-speech translation. In Proceedings of EUROSPEECH. 2757--2760.","key":"e_1_2_1_29_1"},{"volume-title":"Proceedings of the Annual Conference on Language Resources and Evaluation (LREC). 1589--1592","author":"Takezawa T.","unstructured":"Takezawa , T. and Kikui , G . 2004. A comparative study on human communication behaviors and linguistic characteristics for speech-to-speech translation . In Proceedings of the Annual Conference on Language Resources and Evaluation (LREC). 1589--1592 . Takezawa, T. and Kikui, G. 2004. A comparative study on human communication behaviors and linguistic characteristics for speech-to-speech translation. In Proceedings of the Annual Conference on Language Resources and Evaluation (LREC). 1589--1592.","key":"e_1_2_1_30_1"},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 657--660","author":"Toda T.","unstructured":"Toda , T. , Kawai , H. , and Tsuzaki , M . 2004. Optimizing sub-cost functions for segment selection based on perceptual evaluation in concatenative speech synthesis . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 657--660 . Toda, T., Kawai, H., and Tsuzaki, M. 2004. Optimizing sub-cost functions for segment selection based on perceptual evaluation in concatenative speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 657--660.","key":"e_1_2_1_31_1"},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 660--663","author":"Tokuda K.","unstructured":"Tokuda , K. , Kobayashi , T. , and Imai , S . 1995. Speech parameter generation from HMM using dynamic features . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 660--663 . Tokuda, K., Kobayashi, T., and Imai, S. 1995. Speech parameter generation from HMM using dynamic features. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 660--663.","key":"e_1_2_1_32_1"},{"volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 1215--1218","author":"Tokuda K.","unstructured":"Tokuda , K. , Yoshimura , T. , Masuko , T. , Kobayashi , T. , and Kitamura , T . 2000. Speech parameter generation algorithms for HMM-based speech synthesis . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 1215--1218 . Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., and Kitamura, T. 2000. Speech parameter generation algorithms for HMM-based speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 1215--1218.","key":"e_1_2_1_33_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_34_1","DOI":"10.1016\/S0167-6393(02)00179-6"},{"volume-title":"Proceedings of the Conference on Empirical Methods on Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNNL). 514--523","author":"Yamamoto H.","unstructured":"Yamamoto , H. and Sumita , E . 2007. Bilingual cluster-based model for statistical machine translation . In Proceedings of the Conference on Empirical Methods on Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNNL). 514--523 . Yamamoto, H. and Sumita, E. 2007. Bilingual cluster-based model for statistical machine translation. In Proceedings of the Conference on Empirical Methods on Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNNL). 514--523.","key":"e_1_2_1_35_1"}],"container-title":["ACM Transactions on Speech and Language Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2287710.2287712","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2287710.2287712","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:49:04Z","timestamp":1750236544000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2287710.2287712"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,7]]},"references-count":35,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,7]]}},"alternative-id":["10.1145\/2287710.2287712"],"URL":"https:\/\/doi.org\/10.1145\/2287710.2287712","relation":{},"ISSN":["1550-4875","1550-4883"],"issn-type":[{"type":"print","value":"1550-4875"},{"type":"electronic","value":"1550-4883"}],"subject":[],"published":{"date-parts":[[2012,7]]},"assertion":[{"value":"2011-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-08-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}