{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:54:01Z","timestamp":1777658041036,"version":"3.51.4"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,2,8]],"date-time":"2020-02-08T00:00:00Z","timestamp":1581120000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,8]],"date-time":"2020-02-08T00:00:00Z","timestamp":1581120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["IJDAR"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We describe an online handwriting system that is able to support 102 languages using a deep neural network architecture. This new system has completely replaced our previous segment-and-decode-based system and reduced the error rate by 20\u201340% relative for most languages. Further, we report new state-of-the-art results on IAM-OnDB for both the open and closed dataset setting. The system combines methods from sequence recognition with a new input encoding using B\u00e9zier curves. This leads to up to<jats:inline-formula><jats:alternatives><jats:tex-math>$$10\\times $$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mrow><mml:mn>10<\/mml:mn><mml:mo>\u00d7<\/mml:mo><\/mml:mrow><\/mml:math><\/jats:alternatives><\/jats:inline-formula>faster recognition times compared to our previous system. Through a series of experiments, we determine the optimal configuration of our models and report the results of our setup on a number of additional public datasets.<\/jats:p>","DOI":"10.1007\/s10032-020-00350-4","type":"journal-article","created":{"date-parts":[[2020,2,8]],"date-time":"2020-02-08T06:02:32Z","timestamp":1581141752000},"page":"89-102","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":124,"title":["Fast multi-language LSTM-based online handwriting recognition"],"prefix":"10.1007","volume":"23","author":[{"given":"Victor","family":"Carbune","sequence":"first","affiliation":[]},{"given":"Pedro","family":"Gonnet","sequence":"additional","affiliation":[]},{"given":"Thomas","family":"Deselaers","sequence":"additional","affiliation":[]},{"given":"Henry A.","family":"Rowley","sequence":"additional","affiliation":[]},{"given":"Alexander","family":"Daryin","sequence":"additional","affiliation":[]},{"given":"Marcos","family":"Calvo","sequence":"additional","affiliation":[]},{"given":"Li-Lun","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"Keysers","sequence":"additional","affiliation":[]},{"given":"Sandro","family":"Feuz","sequence":"additional","affiliation":[]},{"given":"Philippe","family":"Gervais","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,2,8]]},"reference":[{"key":"350_CR1","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Man\u00e9, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Vi\u00e9gas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., Zheng, X.: TensorFlow: Large-scale machine learning on heterogeneous systems (2015). https:\/\/www.tensorflow.org\/. Software available from tensorflow.org. Accessed 8 Aug 2019"},{"issue":"6","key":"350_CR2","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1162\/neco.1995.7.6.1289","volume":"7","author":"Y Bengio","year":"1995","unstructured":"Bengio, Y., LeCun, Y., Nohl, C., Burges, C.: Lerec: a NN\/HMM hybrid for on-line handwriting recognition. Neural Comput. 7(6), 1289\u20131303 (1995)","journal-title":"Neural Comput."},{"key":"350_CR3","unstructured":"Brants, T., Popat, A.C., Xu, P., Och, F.J., Dean, J.: Large language models in machine translation. In: EMNLP-CoNLL, pp. 858\u2013867 (2007)"},{"key":"350_CR4","unstructured":"Chua, M., van Esch, D., Coccaro, N., Cho, E., Bhandari, S., Jia, L.: Text normalization infrastructure that scales to hundreds of language varieties. In: Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (2018)"},{"key":"350_CR5","unstructured":"Franzini, M., Lee, K.F., Waibel, A.: Connectionist Viterbi training: a new hybrid method for continuous speech recognition. In: 1990 International Conference on Acoustics, Speech, and Signal Processing, 1990. ICASSP-90, pp. 425\u2013428. IEEE (1990)"},{"key":"350_CR6","doi-asserted-by":"crossref","unstructured":"Frinken, V., Bhattacharya, N., Uchida, S., Pal, U.: Improved blstm neural networks for recognition of on-line bangla complex words. In: S+SSPR (2014)","DOI":"10.1007\/978-3-662-44415-3_41"},{"key":"350_CR7","doi-asserted-by":"crossref","unstructured":"Frinken, V., Uchida, S.: Deep BLSTM neural networks for unconstrained continuous handwritten text recognition. In: ICDAR (2015)","DOI":"10.1109\/ICDAR.2015.7333894"},{"key":"350_CR8","doi-asserted-by":"crossref","unstructured":"Fujii, Y., Driesen, K., Baccash, J., Hurst, A., Popat, A.C.: Sequence-to-label script identification for multilingual OCR. In: ICDAR (2017)","DOI":"10.1109\/ICDAR.2017.35"},{"issue":"6","key":"350_CR9","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1109\/72.963769","volume":"12","author":"FA Gers","year":"2001","unstructured":"Gers, F.A., Schmidhuber, E.: Lstm recurrent networks learn simple context-free and context-sensitive languages. IEEE Trans. Neural Netw. 12(6), 1333\u20131340 (2001)","journal-title":"IEEE Trans. Neural Netw."},{"key":"350_CR10","doi-asserted-by":"crossref","unstructured":"Ghosh, S., Joshi, A.: Text entry in indian languages on mobile: user perspectives. In: India HCI (2014)","DOI":"10.1145\/2676702.2676710"},{"key":"350_CR11","doi-asserted-by":"crossref","unstructured":"Golovin, D., Solnik, B., Moitra, S., Kochanski, G., Karro, J., Sculley, D.: Google vizier: A service for black-box optimization. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1487\u20131495 (2017)","DOI":"10.1145\/3097983.3098043"},{"key":"350_CR12","doi-asserted-by":"crossref","unstructured":"Graves, A., Fern\u00e1ndez, S., Gomez, F.J., Schmidhuber, J.: Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In: ICML (2006)","DOI":"10.1145\/1143844.1143891"},{"key":"350_CR13","doi-asserted-by":"crossref","unstructured":"Graves, A., Jaitly, N.: Towards end-to-end speech recognition with recurrent neural networks. In: ICML (2014)","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"350_CR14","unstructured":"Graves, A., Liwicki, M., Bunke, H., Schmidhuber, J., Fern\u00e1ndez, S.: Unconstrained on-line handwriting recognition with recurrent neural networks. In: Advances in Neural Information Processing Systems, pp. 577\u2013584 (2008)"},{"issue":"5","key":"350_CR15","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1109\/TPAMI.2008.137","volume":"31","author":"A Graves","year":"2009","unstructured":"Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., Schmidhuber, J.: A novel connectionist system for unconstrained handwriting recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(5), 855\u2013868 (2009)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"350_CR16","unstructured":"Graves, A., Schmidhuber, J.: Offline handwriting recognition with multidimensional recurrent neural networks. In: Advances in Neural Information Processing Systems, pp. 545\u2013552 (2009)"},{"issue":"6","key":"350_CR17","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","volume":"29","author":"G Hinton","year":"2012","unstructured":"Hinton, G., Deng, L., Yu, D., Dahl, G.E., Mohamed, A.R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T.N., et al.: Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process. Magazine 29(6), 82\u201397 (2012)","journal-title":"IEEE Signal Process. Magazine"},{"key":"350_CR18","unstructured":"Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R.: Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580 (2012)"},{"issue":"8","key":"350_CR19","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735\u20131780 (1997)","journal-title":"Neural Comput."},{"issue":"10","key":"350_CR20","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1109\/34.541414","volume":"18","author":"J Hu","year":"1996","unstructured":"Hu, J., Brown, M.K., Turin, W.: HMM based online handwriting recognition. IEEE Trans. Pattern Anal. Mach. Intell. 18(10), 1039\u20131045 (1996)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"350_CR21","unstructured":"Huang, B.Q., Zhang, Y., Kechadi, M.T.: Preprocessing techniques for online handwriting recognition. In: Seventh International Conference on Intelligent Systems Design and Applications, 2007. ISDA 2007, pp. 793\u2013800. IEEE (2007)"},{"issue":"3","key":"350_CR22","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/PL00013559","volume":"3","author":"S Jaeger","year":"2001","unstructured":"Jaeger, S., Manke, S., Reichert, J., Waibel, A.: Online handwriting recognition: the NPen++ recognizer. Int. J. Doc. Anal. Recognit. 3(3), 169\u2013180 (2001)","journal-title":"Int. J. Doc. Anal. Recognit."},{"issue":"2","key":"350_CR23","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s10032-003-0107-y","volume":"6","author":"S J\u00e4ger","year":"2003","unstructured":"J\u00e4ger, S., Liu, C., Nakagawa, M.: The state of the art in Japanese online handwriting recognition compared to techniques in western handwriting recognition. Int. J. Doc. Anal. Recognit. 6(2), 75\u201388 (2003)","journal-title":"Int. J. Doc. Anal. Recognit."},{"key":"350_CR24","unstructured":"Jozefowicz, R., Zaremba, W., Sutskever, I.: An empirical exploration of recurrent network architectures. In: International Conference on Machine Learning, pp. 2342\u20132350 (2015)"},{"issue":"6","key":"350_CR25","doi-asserted-by":"crossref","first-page":"1180","DOI":"10.1109\/TPAMI.2016.2572693","volume":"39","author":"D Keysers","year":"2017","unstructured":"Keysers, D., Deselaers, T., Rowley, H., Wang, L.L., Carbune, V.: Multi-language online handwriting recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1180\u20131194 (2017)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"350_CR26","doi-asserted-by":"crossref","unstructured":"Kim, J.H., Sin, B.: Online handwriting recognition. In: Handbook of Document Image Processing & Recognition, pp. 887\u2013915. Springer-Verlag London (2014)","DOI":"10.1007\/978-0-85729-859-1_29"},{"key":"350_CR27","unstructured":"Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2014)"},{"key":"350_CR28","doi-asserted-by":"crossref","unstructured":"LeCun, Y., Bottou, L., andPatrick Haffner, Y.B.: Gradient-based learning applied to document recognition. In: Proceedings of the IEEE (1998)","DOI":"10.1109\/5.726791"},{"key":"350_CR29","doi-asserted-by":"crossref","unstructured":"Liu, C., Yin, F., Wang, Q., Wang, D.: ICDAR 2011 Chinese handwriting recognition competition. In: ICDAR (2011)","DOI":"10.1109\/ICDAR.2011.291"},{"issue":"1","key":"350_CR30","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.patcog.2012.06.021","volume":"46","author":"CL Liu","year":"2013","unstructured":"Liu, C.L., Yin, F., Wang, D.H., Wang, Q.F.: Online and offline handwritten Chinese character recognition: benchmarking on new databases. Pattern Recognit. 46(1), 155\u2013162 (2013)","journal-title":"Pattern Recognit."},{"key":"350_CR31","doi-asserted-by":"crossref","unstructured":"Liwicki, M., Bunke, H.: IAM-OnDB-an on-line English sentence database acquired from handwritten text on a whiteboard. In: ICDAR, pp. 956\u2013961 (2005)","DOI":"10.1109\/ICDAR.2005.132"},{"issue":"1","key":"350_CR32","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s00138-009-0208-9","volume":"22","author":"M Liwicki","year":"2011","unstructured":"Liwicki, M., Bunke, H., Pittman, J.A., Knerr, S.: Combining diverse systems for handwritten text line recognition. Mach. Vis. Appl. 22(1), 39\u201351 (2011)","journal-title":"Mach. Vis. Appl."},{"key":"350_CR33","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111\u20133119 (2013)"},{"key":"350_CR34","doi-asserted-by":"crossref","unstructured":"Nguyen, H.T., Nguyen, C.T., Nakagawa, M.: ICFHR 2018\u2013competition on Vietnamese online handwritten text recognition using HANDS-VNOnDB (VOHTR2018). In: ICFHR (2018)","DOI":"10.1109\/ICFHR-2018.2018.00092"},{"key":"350_CR35","doi-asserted-by":"crossref","unstructured":"Nuntawisuttiwong, T., Dejdumrong, N.: Approximating online handwritten image by b\u00e9zier curve. In: CGIV (2012)","DOI":"10.1109\/CGIV.2012.24"},{"key":"350_CR36","doi-asserted-by":"crossref","unstructured":"Pham, V., Bluche, T., Kermorvant, C., Louradour, J.: Dropout improves recurrent neural networks for handwriting recognition. In: 2014 14th International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 285\u2013290. IEEE (2014)","DOI":"10.1109\/ICFHR.2014.55"},{"issue":"9","key":"350_CR37","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MC.2007.314","volume":"40","author":"JA Pittman","year":"2007","unstructured":"Pittman, J.A.: Handwriting recognition: Tablet PC text input. IEEE Comput. 40(9), 49\u201354 (2007)","journal-title":"IEEE Comput."},{"issue":"1","key":"350_CR38","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/34.824821","volume":"22","author":"R Plamondon","year":"2000","unstructured":"Plamondon, R., Srihari, S.N.: Online and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 63\u201384 (2000)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"350_CR39","doi-asserted-by":"crossref","unstructured":"Prasad, M., Breiner, T., van Esch, D.: Mining training data for language modeling across the world\u2019s languages. In: Proceedings of the 6th International Workshop on Spoken Language Technologies for Under-resourced Languages (SLTU 2018) (2018)","DOI":"10.21437\/SLTU.2018-13"},{"key":"350_CR40","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.neunet.2014.08.005","volume":"64","author":"TN Sainath","year":"2015","unstructured":"Sainath, T.N., Kingsbury, B., Saon, G., Soltau, H., Mohamed, A.R., Dahl, G., Ramabhadran, B.: Deep convolutional neural networks for large-scale speech tasks. Neural Netw. 64, 39\u201348 (2015)","journal-title":"Neural Netw."},{"key":"350_CR41","doi-asserted-by":"crossref","unstructured":"Sainath, T.N., Vinyals, O., Senior, A., Sak, H.: Convolutional, long short-term memory, fully connected deep neural networks. In: ICASSP (2015)","DOI":"10.1109\/ICASSP.2015.7178838"},{"issue":"11","key":"350_CR42","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45(11), 2673\u20132681 (1997)","journal-title":"IEEE Trans. Signal Process."},{"key":"350_CR43","doi-asserted-by":"crossref","unstructured":"Shivram, A., Ramaiah, C., Setlur, S., Govindaraju, V.: IBM\\_UB\\_1: A dual mode unconstrained English handwriting dataset. In: ICDAR (2013)","DOI":"10.1109\/ICDAR.2013.12"},{"key":"350_CR44","unstructured":"Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)"},{"key":"350_CR45","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818\u20132826 (2016)","DOI":"10.1109\/CVPR.2016.308"},{"key":"350_CR46","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/29.21701","volume":"37","author":"A Waibel","year":"1989","unstructured":"Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., Lang, K.J.: Phoneme recognition using time-delay neural networks. IEEE Trans. Acoust. Speech Signal Process. 37, 328\u2013339 (1989)","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"350_CR47","unstructured":"Wang, T., Wu, D.J., Coates, A., Ng, A.Y.: End-to-end text recognition with convolutional neural networks. In: ICPR (2012)"},{"key":"350_CR48","doi-asserted-by":"crossref","unstructured":"Yaeger, L., Webb, B., Lyon, R.: Combining neural networks and context-driven search for on-line, printed handwriting recognition in the Newton. AAAI AI Magazine (1998)","DOI":"10.1007\/3-540-49430-8_14"},{"key":"350_CR49","doi-asserted-by":"crossref","unstructured":"Yang, Y., Liang, K., Xiao, X., Xie, Z., Jin, L., Sun, J., Zhou, W.: Accelerating and compressing LSTM based model for online handwritten Chinese character recognition. In: ICFHR (2018)","DOI":"10.1109\/ICFHR-2018.2018.00028"},{"key":"350_CR50","doi-asserted-by":"crossref","unstructured":"Yin, F., Wang, Q.F., Zhang, X.Y., Liu, C.L.: ICDAR 2013 Chinese handwriting recognition competition. In: 2013 12th International Conference on Document Analysis and Recognition (ICDAR), pp. 1464\u20131470. IEEE (2013)","DOI":"10.1109\/ICDAR.2013.218"},{"key":"350_CR51","doi-asserted-by":"crossref","unstructured":"Zhang, J., Du, J., Dai, L.: A gru-based encoderdecoder approach with attention for online handwritten mathematical expression recognition. In: 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 1, pp. 902\u2013907. IEEE (2017)","DOI":"10.1109\/ICDAR.2017.152"},{"issue":"4","key":"350_CR52","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1109\/TPAMI.2017.2695539","volume":"40","author":"X-Y Zhang","year":"2017","unstructured":"Zhang, X.-Y., Yin, F., Zhang, Y.-M., Liu, C.-L., Bengio, Y.: Drawing and recognizing chinese characters with recurrent neural network. IEEE Trans. Pattern Anal. Mach. 40(4), 849\u2013862 (2017)","journal-title":"IEEE Trans. Pattern Anal. Mach."}],"container-title":["International Journal on Document Analysis and Recognition (IJDAR)"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10032-020-00350-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10032-020-00350-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10032-020-00350-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,15]],"date-time":"2022-10-15T01:17:41Z","timestamp":1665796661000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10032-020-00350-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,8]]},"references-count":52,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["350"],"URL":"https:\/\/doi.org\/10.1007\/s10032-020-00350-4","relation":{},"ISSN":["1433-2833","1433-2825"],"issn-type":[{"value":"1433-2833","type":"print"},{"value":"1433-2825","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,8]]},"assertion":[{"value":"8 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 December 2019","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 January 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 February 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}