{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:06:51Z","timestamp":1777705611247,"version":"3.51.4"},"reference-count":2,"publisher":"SAGE Publications","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2022,2,2]]},"abstract":"<jats:p>The BERT pre-trained language model has achieved good results in various subtasks of natural language processing, but its performance in generating Chinese summaries is not ideal. The most intuitive reason is that the BERT model is based on character-level composition, while the Chinese language is mostly in the form of phrases. Directly fine-tuning the BERT model cannot achieve the expected effect. This paper proposes a novel summary generation model with BERT augmented by the pooling layer. In our model, we perform an average pooling operation on token embedding to improve the model\u2019s ability to capture phrase-level semantic information. We use LCSTS and NLPCC2017 to verify our proposed method. Experimental data shows that the average pooling model\u2019s introduction can effectively improve the generated summary quality. Furthermore, different data needs to be set with varying pooling kernel sizes to achieve the best results through comparative analysis. In addition, our proposed method has strong generalizability. It can be applied not only to the task of generating summaries, but also to other natural language processing tasks.<\/jats:p>","DOI":"10.3233\/jifs-211229","type":"journal-article","created":{"date-parts":[[2021,10,1]],"date-time":"2021-10-01T11:46:30Z","timestamp":1633088790000},"page":"1859-1868","source":"Crossref","is-referenced-by-count":9,"title":["Augment BERT with average pooling layer for Chinese summary generation"],"prefix":"10.1177","volume":"42","author":[{"given":"Shuai","family":"Zhao","sequence":"first","affiliation":[{"name":"Jinan University, Guangzhou, China"},{"name":"Beijing Institute of Graphic Communication, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fucheng","family":"You","sequence":"additional","affiliation":[{"name":"Beijing Institute of Graphic Communication, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen","family":"Chang","sequence":"additional","affiliation":[{"name":"Beijing Institute of Graphic Communication, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Institute of Graphic Communication, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Man","family":"Hu","sequence":"additional","affiliation":[{"name":"Beijing Institute of Graphic Communication, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-211229_ref29","first-page":"3","article-title":"Automatic Chinese abstractive summarization with topical keywords fusion","volume":"45","author":"Hou","year":"2019","journal-title":"Acta Automatica Sinica"},{"key":"10.3233\/JIFS-211229_ref31","first-page":"71","article-title":"Automatic Evaluation of Summaries Using N-gram Cooccurrence Statistics","volume":"1","author":"Lin","year":"2003","journal-title":"The Association for Computational Linguistics"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-211229","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:44:26Z","timestamp":1777455866000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-211229"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,2]]},"references-count":2,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.3233\/jifs-211229","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,2]]}}}