{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T04:28:38Z","timestamp":1729225718824,"version":"3.27.0"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643685489","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T00:00:00Z","timestamp":1729036800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,16]]},"abstract":"<jats:p>The emergence of Large Language Models (LLMs) provides a new solution to text generation tasks that involve high complexity, such as text style transfer (TST) tasks. However, previous studies have not fully explored the TST capabilities of different LLMs, and have faced issues with a lack of uniform standards in the human evaluation stage. This makes the results of human evaluation difficult to reproduce and less credible. To address this, this paper designs a prompt template to guide the cutting-edge LLMs to perform effective text style transfer and carries out an in-depth comparative analysis of various small-scale language models. In the stage of human evaluation, this paper eschews the conventional rating system, opting instead for a comparative human assessment methodology, which we refer to as duel-ranking. This method determines the relative ranking of models through mutual comparison, serving as an alternative to direct scoring. Detailed evaluation instructions are provided herein, to enhance the reproducibility of this method and ensure consistency throughout the evaluation process. This manual evaluation process reveals that GPT-3.5 and GPT-4 exhibit excellent performance in the TST tasks.<\/jats:p>","DOI":"10.3233\/faia240865","type":"book-chapter","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T13:34:47Z","timestamp":1729172087000},"source":"Crossref","is-referenced-by-count":0,"title":["Exploring Large Language Models Text Style Transfer Capabilities"],"prefix":"10.3233","author":[{"given":"Weijie","family":"Li","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Xinjiang Normal University, China"},{"name":"School of Software, Xinjiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhentao","family":"Gu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Xinjiang Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaochao","family":"Fan","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Xinjiang Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjun","family":"Deng","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Xinjiang Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Xinjiang Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinyuan","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Xinjiang Normal University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yufeng","family":"Diao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Inner Mongolia Minzu University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Dalian University of Technology, China"},{"name":"Key Laboratory of Social Computing and Cognitive Intelligence, Ministry of Education, Dalian, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2024"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA240865","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T13:34:48Z","timestamp":1729172088000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA240865"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,16]]},"ISBN":["9781643685489"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia240865","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,16]]}}}