{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:22:02Z","timestamp":1750306922630,"version":"3.41.0"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2013,4,1]],"date-time":"2013-04-01T00:00:00Z","timestamp":1364774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Institute of Communication Technology of Japan"},{"name":"MASTAR project"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2013,4]]},"abstract":"<jats:p>picoTrans is a prototype system that introduces a novel icon-based paradigm for cross-lingual communication on mobile devices. Our approach marries a machine translation system with the popular picture book. Users interact with picoTrans by pointing at pictures as if it were a picture book; the system generates natural language from these icons and the user is able to interact with the icon sequence to refine the meaning of the words that are generated. When users are satisfied that the sentence generated represents what they wish to express, they tap a translate button and picoTrans displays the translation. Structuring the process of communication in this way has many advantages. First, tapping icons is a very natural method of user input on mobile devices; typing is cumbersome and speech input errorful. Second, the sequence of icons which is annotated both with pictures and bilingually with words is meaningful to both users, and it opens up a second channel of communication between them that conveys the gist of what is being expressed. We performed a number of evaluations of picoTrans to determine: its coverage of a corpus of in-domain sentences; the input efficiency in terms of the number of key presses required relative to text entry; and users' overall impressions of using the system compared to using a picture book. Our results show that we are able to cover 74% of the expressions in our test corpus using a 2000-icon set; we believe that this icon set size is realistic for a mobile device. We also found that picoTrans requires fewer key presses than typing the input and that the system is able to predict the correct, intended natural language sentence from the icon sequence most of the time, making user interaction with the icon sequence often unnecessary. In the user evaluation, we found that in general users prefer using picoTrans and are able to communicate more rapidly and expressively. Furthermore, users had more confidence that they were able to communicate effectively using picoTrans.<\/jats:p>","DOI":"10.1145\/2448116.2448121","type":"journal-article","created":{"date-parts":[[2013,4,23]],"date-time":"2013-04-23T13:04:26Z","timestamp":1366722266000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["picoTrans"],"prefix":"10.1145","volume":"3","author":[{"given":"Wei","family":"Song","sequence":"first","affiliation":[{"name":"Canon Inc., Tokyo, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Finch","sequence":"additional","affiliation":[{"name":"National Institute of Communication Technology, NICT, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kumiko","family":"Tanaka-Ishii","sequence":"additional","affiliation":[{"name":"Kyushu University, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keiji","family":"Yasuda","sequence":"additional","affiliation":[{"name":"National Institute of Communication Technology, NICT, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eiichiro","family":"Sumita","sequence":"additional","affiliation":[{"name":"National Institute of Communication Technology, NICT, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,4,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119212.1119213"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719984"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1289189.1289273"},{"volume-title":"Proceedings of the Named Entities Workshop. Asian Federation of Natural Language Processing, 23--27","author":"Finch A.","key":"e_1_2_1_4_1","unstructured":"Finch , A. , Dixon , P. , and Sumita , E . 2011a. Integrating models derived from non-parametric bayesian co-segmentation into a statistical machine transliteration system . In Proceedings of the Named Entities Workshop. Asian Federation of Natural Language Processing, 23--27 . Finch, A., Dixon, P., and Sumita, E. 2011a. Integrating models derived from non-parametric bayesian co-segmentation into a statistical machine transliteration system. In Proceedings of the Named Entities Workshop. Asian Federation of Natural Language Processing, 23--27."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP).","volume":"1","author":"Finch A.","unstructured":"Finch , A. and Sumita , E . 2008. Phrase-Based machine transliteration . In Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP). Vol. 1 . Finch, A. and Sumita, E. 2008. Phrase-Based machine transliteration. In Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP). Vol. 1."},{"volume-title":"Proceedings of the 7th International Workshop on Spoken Language Translation (IWSLT), M. Federico, I. Lane, M. Paul, and F. Yvon, Eds., 259--266","author":"Finch A.","key":"e_1_2_1_6_1","unstructured":"Finch , A. and Sumita , E . 2010. A bayesian model of bilingual segmentation for transliteration . In Proceedings of the 7th International Workshop on Spoken Language Translation (IWSLT), M. Federico, I. Lane, M. Paul, and F. Yvon, Eds., 259--266 . Finch, A. and Sumita, E. 2010. A bayesian model of bilingual segmentation for transliteration. In Proceedings of the 7th International Workshop on Spoken Language Translation (IWSLT), M. Federico, I. Lane, M. Paul, and F. Yvon, Eds., 259--266."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2283696.2283831"},{"volume-title":"Proceedings of the 8th International Workshop on Natural Language Processing and Cognitive Science (NLPCS).","author":"Finch A. M.","key":"e_1_2_1_8_1","unstructured":"Finch , A. M. , Song , W. , Tanaka-Ishii , K. , and Sumita , E . 2011c. Source language generation from pictures for machine translation on mobile devices . In Proceedings of the 8th International Workshop on Natural Language Processing and Cognitive Science (NLPCS). Finch, A. M., Song, W., Tanaka-Ishii, K., and Sumita, E. 2011c. Source language generation from pictures for machine translation on mobile devices. In Proceedings of the 8th International Workshop on Natural Language Processing and Cognitive Science (NLPCS)."},{"key":"e_1_2_1_9_1","volume-title":"Me No Speak: China","author":"Flanagan C.","unstructured":"Flanagan , C. 2008. Me No Speak: China , 2 nd ed. Me No Speak. Flanagan, C. 2008. Me No Speak: China, 2nd ed. Me No Speak.","edition":"2"},{"key":"e_1_2_1_10_1","unstructured":"Graf D. 2009. Point it: Traveller's Language Kit - The Original Picture Dictionary - Bigger and Better (English Spanish French Italian German and Russian Edition). Graf Editions.  Graf D. 2009. Point it: Traveller's Language Kit - The Original Picture Dictionary - Bigger and Better (English Spanish French Italian German and Russian Edition). Graf Editions."},{"volume-title":"Proceedings of the Conference on Graphics Interface (GI'10)","author":"Hu C.","key":"e_1_2_1_11_1","unstructured":"Hu , C. , Bederson , B. B. , and Resnik , P . 2010. Translation by iterative collaboration between monolingual users . In Proceedings of the Conference on Graphics Interface (GI'10) . Canadian Information Processing Society, 39--46. Hu, C., Bederson, B. B., and Resnik, P. 2010. Translation by iterative collaboration between monolingual users. In Proceedings of the Conference on Graphics Interface (GI'10). Canadian Information Processing Society, 39--46."},{"volume-title":"Proceedings of the 8th European Conference on Speech Communication and Technology (EUROSPEECH'03)","author":"Kikui G.","key":"e_1_2_1_12_1","unstructured":"Kikui , G. , Sumita , E. , Takezawa , T. , and Yamamoto , S . 2003. Creating corpora for speech-to-speech translation . In Proceedings of the 8th European Conference on Speech Communication and Technology (EUROSPEECH'03) . 381--384. Kikui, G., Sumita, E., Takezawa, T., and Yamamoto, S. 2003. Creating corpora for speech-to-speech translation. In Proceedings of the 8th European Conference on Speech Communication and Technology (EUROSPEECH'03). 381--384."},{"volume-title":"Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Demo and Poster Sessions (ACL'07)","author":"Koehn P.","key":"e_1_2_1_13_1","unstructured":"Koehn , P. , Hoang , H. , Birch , A. , Callison-Burch , C. , Federico , M. , Bertoldi , N. , Cowa , B. , Shen , W. , Moran , C. , Zens , R. , Dyer , C. , Bojar , O. , Constantin , A. , and Herbst , E . 2007. Moses: Open source toolkit for statistical machine translation . In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Demo and Poster Sessions (ACL'07) . 177--180. Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowa, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O., Constantin, A., and Herbst, E. 2007. Moses: Open source toolkit for statistical machine translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Demo and Poster Sessions (ACL'07). 177--180."},{"key":"e_1_2_1_14_1","unstructured":"Kudo T. 2008. MeCab. http:\/\/mecab.sourceforge.net\/.  Kudo T. 2008. MeCab. http:\/\/mecab.sourceforge.net\/."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518759"},{"volume-title":"Mobility, Universality. Morgan Kaufmann","author":"Mackenzie S.","key":"e_1_2_1_16_1","unstructured":"Mackenzie , S. and Tanaka-Ishii , K. , Eds. 2007. Text Entry Systems\u2014Accessibility , Mobility, Universality. Morgan Kaufmann , San Fransisco, CA . Mackenzie, S. and Tanaka-Ishii, K., Eds. 2007. Text Entry Systems\u2014Accessibility, Mobility, Universality. Morgan Kaufmann, San Fransisco, CA."},{"volume-title":"The Wordless Travel Book: Point at These Pictures to Communicate with Anyone","author":"Meader J.","key":"e_1_2_1_17_1","unstructured":"Meader , J. 1995. The Wordless Travel Book: Point at These Pictures to Communicate with Anyone . Ten Speed Press . Meader, J. 1995. The Wordless Travel Book: Point at These Pictures to Communicate with Anyone. Ten Speed Press."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-009-9050-0"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-3156.2008.00490.x"},{"key":"e_1_2_1_20_1","unstructured":"Noguchi Y. and Hayashi K. 2003. Yubisashi Travel Conversation 48: Australian (\u65c5\u306e\u6307\u3055\u3057\u4f1a\u8a71\u5e3348\u30aa\u30fc\u30b9\u30c8\u30ea\u30a2: \u30aa\u30fc\u30b9\u30c8\u30ea\u30a2(\u30c9\u30a4\u30c4)\u8a9e). Information Center Publishing (\u60c5\u5831\u30bb\u30f3\u30bf\u30fc\u51fa\u7248\u5c40).  Noguchi Y. and Hayashi K. 2003. Yubisashi Travel Conversation 48: Australian (\u65c5\u306e\u6307\u3055\u3057\u4f1a\u8a71\u5e3348\u30aa\u30fc\u30b9\u30c8\u30ea\u30a2: \u30aa\u30fc\u30b9\u30c8\u30ea\u30a2(\u30c9\u30a4\u30c4)\u8a9e). Information Center Publishing (\u60c5\u5831\u30bb\u30f3\u30bf\u30fc\u51fa\u7248\u5c40)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3115\/1075096.1075117"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073133"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"volume-title":"Proceedings of the 22nd International Conference on Computational Linguistics, Companion Volume. 165--168","author":"Paul M.","key":"e_1_2_1_24_1","unstructured":"Paul , M. , Okuma , H. , Yamamoto , H. , Sumita , E. , Matsuda , S. , Shimizu , T. , and Nakamura , S . 2008. Multilingual mobile-phone translation services for world travelers . In Proceedings of the 22nd International Conference on Computational Linguistics, Companion Volume. 165--168 . Paul, M., Okuma, H., Yamamoto, H., Sumita, E., Matsuda, S., Shimizu, T., and Nakamura, S. 2008. Multilingual mobile-phone translation services for world travelers. In Proceedings of the 22nd International Conference on Computational Linguistics, Companion Volume. 165--168."},{"volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL) Short Papers. 221--224","author":"Paul M.","key":"e_1_2_1_25_1","unstructured":"Paul , M. , Yamamoto , H. , Sumita , E. , and Nakamura , S . 2009. On the importance of pivot language selection for statistical machine translation . In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL) Short Papers. 221--224 . Paul, M., Yamamoto, H., Sumita, E., and Nakamura, S. 2009. On the importance of pivot language selection for statistical machine translation. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL) Short Papers. 221--224."},{"key":"e_1_2_1_26_1","unstructured":"picTrans. 2010. A simple picture-based translation system. http:\/\/www.7zillion.com\/iPhone\/PicTrans\/.  picTrans. 2010. A simple picture-based translation system. http:\/\/www.7zillion.com\/iPhone\/PicTrans\/."},{"volume-title":"Christchurch. Tech. rep., Department of Computer Science","author":"Sirisena A.","key":"e_1_2_1_27_1","unstructured":"Sirisena , A. 2002. Honours report , Christchurch. Tech. rep., Department of Computer Science , University of Canterbury . Sirisena, A. 2002. Honours report, Christchurch. Tech. rep., Department of Computer Science, University of Canterbury."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1943403.1943409"},{"key":"e_1_2_1_29_1","unstructured":"Stillman. 2007. Kwikpoint International Translator (English Spanish French Italian German Japanese Russian Ukrainian Chinese Hindi Tamil Telug Kannada Malayalam Gujarati Bengali and Korean Edition). Kwikpoint.  Stillman. 2007. Kwikpoint International Translator (English Spanish French Italian German Japanese Russian Ukrainian Chinese Hindi Tamil Telug Kannada Malayalam Gujarati Bengali and Korean Edition). Kwikpoint."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the International Conference on Spoken Language Processing.","volume":"2","author":"Stolcke A.","year":"2002","unstructured":"Stolcke , A. 2002 . SRILM - An extensible language modeling toolkit . In Proceedings of the International Conference on Spoken Language Processing. Vol. 2 . 901--904. Stolcke, A. 2002. SRILM - An extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing. Vol. 2. 901--904."},{"key":"e_1_2_1_31_1","unstructured":"TexTra. 2010. Text translator by NICT. http:\/\/mastar.jp\/translation\/textra-en.html.  TexTra. 2010. Text translator by NICT. http:\/\/mastar.jp\/translation\/textra-en.html."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240727"},{"key":"e_1_2_1_33_1","unstructured":"VoiceTra. 2010. Voice translator by NICT. http:\/\/mastar.jp\/translation\/voicetra-en.html.  VoiceTra. 2010. Voice translator by NICT. http:\/\/mastar.jp\/translation\/voicetra-en.html."},{"volume-title":"Spanish, French, Italian, German, Japanese, Russian, Chinese and Hindi Edition)","author":"Warrink G.","key":"e_1_2_1_34_1","unstructured":"Warrink , G. 2007. ICOON Global Picture Dictionary (English , Spanish, French, Italian, German, Japanese, Russian, Chinese and Hindi Edition) . Amber Press . Warrink, G. 2007. ICOON Global Picture Dictionary (English, Spanish, French, Italian, German, Japanese, Russian, Chinese and Hindi Edition). Amber Press."},{"key":"e_1_2_1_35_1","unstructured":"Yubisashi. 2013. Yubisashi. Information center publishing. http:\/\/www.yubisashi.com\/free\/t\/iphone\/.  Yubisashi. 2013. Yubisashi. Information center publishing. http:\/\/www.yubisashi.com\/free\/t\/iphone\/."},{"volume-title":"Proceedings of the 22nd International Conference on Artificial Intelligence 2. 1590--1595","author":"Zhu X.","key":"e_1_2_1_36_1","unstructured":"Zhu , X. , Goldberg , A. B. , Eldawy , M. , Dyer , C. R. , and Strock , B . 2007. A text-to-picture synthesis system for augmenting communication . In Proceedings of the 22nd International Conference on Artificial Intelligence 2. 1590--1595 . Zhu, X., Goldberg, A. B., Eldawy, M., Dyer, C. R., and Strock, B. 2007. A text-to-picture synthesis system for augmenting communication. In Proceedings of the 22nd International Conference on Artificial Intelligence 2. 1590--1595."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2448116.2448121","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2448116.2448121","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:35:24Z","timestamp":1750235724000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2448116.2448121"}},"subtitle":["An intelligent icon-driven interface for cross-lingual communication"],"short-title":[],"issued":{"date-parts":[[2013,4]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,4]]}},"alternative-id":["10.1145\/2448116.2448121"],"URL":"https:\/\/doi.org\/10.1145\/2448116.2448121","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2013,4]]},"assertion":[{"value":"2011-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-04-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}