{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T03:54:36Z","timestamp":1777434876490,"version":"3.51.4"},"reference-count":41,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2014,9]]},"abstract":"<jats:p> Training speed and accuracy are two major concerns of large-scale natural language processing systems. Typically, we need to make a tradeoff between speed and accuracy. It is trivial to improve the training speed via sacrificing accuracy or to improve the accuracy via sacrificing speed. Nevertheless, it is nontrivial to improve the training speed and the accuracy at the same time, which is the target of this work. To reach this target, we present a new training method, feature-frequency\u2013adaptive on-line training, for fast and accurate training of natural language processing systems. It is based on the core idea that higher frequency features should have a learning rate that decays faster. Theoretical analysis shows that the proposed method is convergent with a fast convergence rate. Experiments are conducted based on well-known benchmark tasks, including named entity recognition, word segmentation, phrase chunking, and sentiment analysis. These tasks consist of three structured classification tasks and one non-structured classification task, with binary features and real-valued features, respectively. Experimental results demonstrate that the proposed method is faster and at the same time more accurate than existing methods, achieving state-of-the-art scores on the tasks with different characteristics. <\/jats:p>","DOI":"10.1162\/coli_a_00193","type":"journal-article","created":{"date-parts":[[2014,3,28]],"date-time":"2014-03-28T23:10:37Z","timestamp":1396048237000},"page":"563-586","source":"Crossref","is-referenced-by-count":6,"title":["Feature-Frequency\u2013Adaptive On-line Training for Fast and Accurate Natural Language Processing"],"prefix":"10.1162","volume":"40","author":[{"given":"Xu","family":"Sun","sequence":"first","affiliation":[{"name":"Peking University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjie","family":"Li","sequence":"additional","affiliation":[{"name":"Hong Kong Polytechnic University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Houfeng","family":"Wang","sequence":"additional","affiliation":[{"name":"Peking University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qin","family":"Lu","sequence":"additional","affiliation":[{"name":"Hong Kong Polytechnic University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"issue":"1","key":"R1","first-page":"39","volume":"22","author":"Berger Adam L.","year":"1996","journal-title":"Computational Linguistics"},{"key":"R2","first-page":"440","volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics","author":"Blitzer John","year":"2007"},{"key":"R3","first-page":"9","volume-title":"Online Learning and Neural Networks.","author":"Bottou L\u00e9on","year":"1998"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.3115\/1118693.1118694"},{"key":"R6","first-page":"414","volume-title":"NIPS'09","author":"Crammer Koby","year":"2009"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390190"},{"key":"R8","first-page":"2,121","volume":"12","author":"Duchi John","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.3115\/1567594.1567614"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007662407062"},{"key":"R11","first-page":"824","volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL'07)","author":"Gao Jianfeng","year":"2007"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5142-6"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(88)90003-2"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.3115\/1567594.1567610"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.3115\/1073336.1073361"},{"key":"R16","first-page":"282","volume-title":"ICML'01","author":"Lafferty John","year":"2001"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220699"},{"key":"R18","first-page":"244","volume-title":"Proceedings of COLT'10","author":"McMahan H. Brendan","year":"2010"},{"key":"R19","first-page":"63","volume-title":"Online Learning in Neural Networks.","author":"Murata Noboru","year":"1998"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1007\/b98874"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.3115\/1220175.1220234"},{"key":"R22","first-page":"133","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing 1996","author":"Ratnaparkhi Adwait","year":"1996"},{"key":"R23","first-page":"127","volume-title":"Proceedings of CoNLL'00","author":"Sang Erik Tjong Kim","year":"2000"},{"key":"R24","author":"Schaul Tom","year":"2012","journal-title":"CoRR"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.3115\/1567594.1567618"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273598"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(93)90004-G"},{"key":"R28","first-page":"1,211","volume-title":"COLING'10 (Posters)","author":"Sun Weiwei","year":"2010"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.129"},{"key":"R30","first-page":"1,236","volume-title":"Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI 2009)","author":"Sun Xu","year":"2009"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.3115\/1599081.1599187"},{"key":"R32","first-page":"253","volume-title":"Proceedings of ACL'12","author":"Sun Xu","year":"2012"},{"key":"R33","doi-asserted-by":"publisher","DOI":"10.3115\/1620754.1620763"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2012.12.003"},{"key":"R35","first-page":"168","volume-title":"Proceedings of the Fourth SIGHAN Workshop","author":"Tseng Huihsin","year":"2005"},{"key":"R36","doi-asserted-by":"publisher","DOI":"10.3115\/1687878.1687946"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143966"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.3115\/1614049.1614098"},{"key":"R39","first-page":"840","volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics","author":"Zhang Yue","year":"2007"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.1145\/1781134.1781135"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2010.09.008"},{"key":"R42","first-page":"2,595","volume-title":"Proceedings of NIPS'10","author":"Zinkevich Martin","year":"2010"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COLI_a_00193","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:27:36Z","timestamp":1615584456000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/40\/3\/563-586\/1478"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,9]]}},"alternative-id":["10.1162\/COLI_a_00193"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00193","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,9]]}}}