{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T03:51:04Z","timestamp":1789271464257,"version":"build-2803163510"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643684369","type":"print"},{"value":"9781643684376","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Large Language Models have shown great capability to comprehend natural language and provide reasonable responses. However, previous researches have shown weak performance of these models on low-resource (long-tail) languages. It remains to be a problem to mitigate the performance gap between long-tail languages and rich-resource ones, which is referred to as long-tail language representation collapsing. Though some previous works can generate pseudo-parallel corpora with the auto-regressive generation, this generation progress is time-consuming and remains low quality, particularly for long-tail languages. In this paper, we propose a (X) Cross-lingual Bootstrapped Unsupervised Fine-tuning Framework (X-BUFF) to mitigate long-tail language representation collapsing. X-BUFF iteratively updates cross-lingual PLMs in a curriculum way. In each iteration of X-BUFF, we (1) select sentences with complementary semantics from monolingual corpora in long-tail languages. (2) match these selected sentences with semantic equivalent sentences in many other languages to create parallel sentence pairs, which we then merge with previous sentence pairs to build a larger and more difficult bootstrapped parallel queue. (3) fine-tune the PLMs with the bootstrapped parallel queue. Extensive experiments show that X-BUFF can mitigate the long-tail language representation collapsing problem in cross-lingual PLMs and achieve significant improvements over the previous baselines on several cross-lingual evaluation benchmarks.<\/jats:p>","DOI":"10.3233\/faia230364","type":"book-chapter","created":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:10:07Z","timestamp":1695978607000},"source":"Crossref","is-referenced-by-count":1,"title":["Mitigating Long-Tail Language Representation Collapsing via Cross-Lingual Bootstrapped Unsupervised Fine-Tuning"],"prefix":"10.3233","author":[{"given":"Ping","family":"Guo","sequence":"first","affiliation":[{"name":"Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China"},{"name":"School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, guoping@iie.ac.cn, huyue@iie.ac.cn, renyubing@iie.ac.cn, liyunpeng@iie.ac.cn, zhangjiarui@iie.ac.cn, zhangxingsheng@iie.ac.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Hu","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China"},{"name":"School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, guoping@iie.ac.cn, huyue@iie.ac.cn, renyubing@iie.ac.cn, liyunpeng@iie.ac.cn, zhangjiarui@iie.ac.cn, zhangxingsheng@iie.ac.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yubing","family":"Ren","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China"},{"name":"School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, guoping@iie.ac.cn, huyue@iie.ac.cn, renyubing@iie.ac.cn, liyunpeng@iie.ac.cn, zhangjiarui@iie.ac.cn, zhangxingsheng@iie.ac.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunpeng","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China"},{"name":"School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, guoping@iie.ac.cn, huyue@iie.ac.cn, renyubing@iie.ac.cn, liyunpeng@iie.ac.cn, zhangjiarui@iie.ac.cn, zhangxingsheng@iie.ac.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiarui","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China"},{"name":"School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, guoping@iie.ac.cn, huyue@iie.ac.cn, renyubing@iie.ac.cn, liyunpeng@iie.ac.cn, zhangjiarui@iie.ac.cn, zhangxingsheng@iie.ac.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xingsheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China"},{"name":"School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, guoping@iie.ac.cn, huyue@iie.ac.cn, renyubing@iie.ac.cn, liyunpeng@iie.ac.cn, zhangjiarui@iie.ac.cn, zhangxingsheng@iie.ac.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2023"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA230364","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:10:08Z","timestamp":1695978608000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA230364"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"ISBN":["9781643684369","9781643684376"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia230364","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]}}}