{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T16:33:56Z","timestamp":1778085236320,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,2,19]],"date-time":"2021-02-19T00:00:00Z","timestamp":1613692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,2,19]]},"DOI":"10.1145\/3459104.3459171","type":"proceedings-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T22:48:56Z","timestamp":1626821336000},"page":"408-414","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Language Representation Models for Music Genre Classification Using Lyrics"],"prefix":"10.1145","author":[{"given":"Hasan","family":"Akalp","sequence":"first","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enes","family":"Furkan Cigdem","sequence":"additional","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seyma","family":"Yilmaz","sequence":"additional","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Necva","family":"Bolucu","sequence":"additional","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Burcu","family":"Can","sequence":"additional","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,20]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Docbert: Bert for Document Classification","author":"Ram Achyudh","year":"1904","unstructured":"Adhikari, Ashutosh, Achyudh Ram , Raphael Tang , and Jimmy Lin . 2019. \u201c Docbert: Bert for Document Classification .\u201d arXiv Preprint arXiv: 1904 .08398. Adhikari, Ashutosh, Achyudh Ram, Raphael Tang, and Jimmy Lin. 2019. \u201cDocbert: Bert for Document Classification.\u201d arXiv Preprint arXiv:1904.08398."},{"key":"e_1_3_2_1_2_1","volume-title":"Simone Diniz Junqueira Barbosa, and H\u00e9lio Cort\u00eas Vieira Lopes.","author":"Lima Ara\u00fajo","year":"2020","unstructured":"Ara\u00fajo Lima , Raul de , R\u00f4mulo C\u00e9sar Costa de Sousa , Simone Diniz Junqueira Barbosa, and H\u00e9lio Cort\u00eas Vieira Lopes. 2020 . \u201cBrazilian Lyrics-Based Music Genre Classification Using a Blstm Network .\u201d http:\/\/arxiv.org\/abs\/2003.05377. Ara\u00fajo Lima, Raul de, R\u00f4mulo C\u00e9sar Costa de Sousa, Simone Diniz Junqueira Barbosa, and H\u00e9lio Cort\u00eas Vieira Lopes. 2020. \u201cBrazilian Lyrics-Based Music Genre Classification Using a Blstm Network.\u201d http:\/\/arxiv.org\/abs\/2003.05377."},{"key":"e_1_3_2_1_3_1","volume-title":"X-Bert: EXtreme Multi-Label Text Classification with Using Bidirectional Encoder Representations from Transformers","author":"Yu Hsiang-Fu","year":"1905","unstructured":"Chang, Wei-Cheng, Hsiang-Fu Yu , Kai Zhong , Yiming Yang , and Inderjit Dhillon . 2019. \u201c X-Bert: EXtreme Multi-Label Text Classification with Using Bidirectional Encoder Representations from Transformers .\u201d arXiv Preprint arXiv: 1905 .02331. Chang, Wei-Cheng, Hsiang-Fu Yu, Kai Zhong, Yiming Yang, and Inderjit Dhillon. 2019. \u201cX-Bert: EXtreme Multi-Label Text Classification with Using Bidirectional Encoder Representations from Transformers.\u201d arXiv Preprint arXiv:1905.02331."},{"key":"e_1_3_2_1_4_1","volume-title":"Transformer to Cnn: Label-Scarce Distillation for Efficient Text Classification","author":"Ken Yew","year":"1909","unstructured":"Chia, Yew Ken , Sam Witteveen , and Martin Andrews . 2019. \u201c Transformer to Cnn: Label-Scarce Distillation for Efficient Text Classification .\u201d http:\/\/arxiv.org\/abs\/ 1909 .03508. Chia, Yew Ken, Sam Witteveen, and Martin Andrews. 2019. \u201cTransformer to Cnn: Label-Scarce Distillation for Efficient Text Classification.\u201d http:\/\/arxiv.org\/abs\/1909.03508."},{"key":"e_1_3_2_1_5_1","volume-title":"BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding","author":"Chang Ming-Wei","year":"1810","unstructured":"Devlin, Jacob, Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018. \u201c BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding .\u201d http:\/\/arxiv.org\/abs\/ 1810 .04805. Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. \u201cBERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding.\u201d http:\/\/arxiv.org\/abs\/1810.04805."},{"key":"e_1_3_2_1_6_1","volume-title":"Thirteenth Brazilian Symposium on Computer Music. https:\/\/kar.kent.ac.uk\/33266\/.","author":"Silla Carlos N.","unstructured":"Howard, Sam, Carlos N. Silla Jr , and Colin G. Johnson . 2011. \u201cAutomatic Lyrics-Based Music Genre Classification in a Multilingual Setting .\u201d In Thirteenth Brazilian Symposium on Computer Music. https:\/\/kar.kent.ac.uk\/33266\/. Howard, Sam, Carlos N. Silla Jr, and Colin G. Johnson. 2011. \u201cAutomatic Lyrics-Based Music Genre Classification in a Multilingual Setting.\u201d In Thirteenth Brazilian Symposium on Computer Music. https:\/\/kar.kent.ac.uk\/33266\/."},{"key":"e_1_3_2_1_7_1","unstructured":"Huang Derek A Arianna A Serafini and Eli J Pugh. n.d. \u201cMusic Genre Classification.\u201d  Huang Derek A Arianna A Serafini and Eli J Pugh. n.d. \u201cMusic Genre Classification.\u201d"},{"key":"e_1_3_2_1_8_1","volume-title":"Hugging Face \u2013 on a Mission to Solve Nlp, One Commit at a Time","unstructured":"\u201c Hugging Face \u2013 on a Mission to Solve Nlp, One Commit at a Time .\u201d n.d. Hugging Face \u2013 on a Mission to Solve NLP, One Commit at a Time .https:\/\/huggingface.co\/. \u201cHugging Face \u2013 on a Mission to Solve Nlp, One Commit at a Time.\u201d n.d. Hugging Face \u2013 on a Mission to Solve NLP, One Commit at a Time.https:\/\/huggingface.co\/."},{"key":"e_1_3_2_1_9_1","unstructured":"Johnson Rie and Tong Zhang. 2016. \u201cSupervised and Semi-Supervised Text Categorization Using Lstm for Region Embeddings.\u201d http:\/\/arxiv.org\/abs\/1602.02373.  Johnson Rie and Tong Zhang. 2016. \u201cSupervised and Semi-Supervised Text Categorization Using Lstm for Region Embeddings.\u201d http:\/\/arxiv.org\/abs\/1602.02373."},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 562\u201370","author":"Zhang Tong","year":"2017","unstructured":"Johnson, Rie, and Tong Zhang . 2017 . \u201c Deep Pyramid Convolutional Neural Networks for Text Categorization .\u201d In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 562\u201370 . Johnson, Rie, and Tong Zhang. 2017. \u201cDeep Pyramid Convolutional Neural Networks for Text Categorization.\u201d In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 562\u201370."},{"key":"e_1_3_2_1_11_1","volume-title":"arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: Amethodforstochasticoptimization . arXiv preprint arXiv:1412.6980 ( 2014 ). Diederik P Kingma and Jimmy Ba. 2014. Adam:Amethodforstochasticoptimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_1_12_1","volume-title":"In2019 Ieee 25th International Conference on Parallel and Distributed Systems (Icpads), 774\u201377","author":"Gao Shangbing","year":"2019","unstructured":"Li, Wenting, Shangbing Gao , Hong Zhou , Zihe Huang , Kewen Zhang , and Wei Li . 2019 . \u201c The Automatic Text Classification Method Based on Bert and Feature Union .\u201d In2019 Ieee 25th International Conference on Parallel and Distributed Systems (Icpads), 774\u201377 . IEEE. Li, Wenting, Shangbing Gao, Hong Zhou, Zihe Huang, Kewen Zhang, and Wei Li. 2019. \u201cThe Automatic Text Classification Method Based on Bert and Feature Union.\u201d In2019 Ieee 25th International Conference on Parallel and Distributed Systems (Icpads), 774\u201377. IEEE."},{"key":"e_1_3_2_1_13_1","volume-title":"Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio.","author":"Feng Minwei","year":"2017","unstructured":"Lin, Zhouhan, Minwei Feng , Cicero Nogueira dos Santos , Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017 . \u201cA Structured Self-Attentive Sentence Embedding.\u201d arXiv Preprint arXiv:1703.03130. Lin, Zhouhan, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. \u201cA Structured Self-Attentive Sentence Embedding.\u201d arXiv Preprint arXiv:1703.03130."},{"key":"e_1_3_2_1_14_1","volume-title":"On the variance of the adaptive learning rate and beyond. arXiv preprint arXiv:1908.03265","author":"Liu Liyuan","year":"2019","unstructured":"Liyuan Liu , Haoming Jiang , Pengcheng He , Weizhu Chen , Xiaodong Liu , Jianfeng Gao , and Jiawei Han . 2019. On the variance of the adaptive learning rate and beyond. arXiv preprint arXiv:1908.03265 ( 2019 ). Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, and Jiawei Han. 2019. On the variance of the adaptive learning rate and beyond. arXiv preprint arXiv:1908.03265 (2019)."},{"key":"e_1_3_2_1_15_1","volume-title":"Recurrent Neural Network for Text Classification with Multi-Task Learning","author":"Qiu Xipeng","unstructured":"Liu, Pengfei, Xipeng Qiu , and Xuanjing Huang . 2016. \u201c Recurrent Neural Network for Text Classification with Multi-Task Learning .\u201d arXiv Preprint arXiv:1605.05101. Liu, Pengfei, Xipeng Qiu, and Xuanjing Huang. 2016. \u201cRecurrent Neural Network for Text Classification with Multi-Task Learning.\u201d arXiv Preprint arXiv:1605.05101."},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 16th Acm International Conference on Multimedia, 159\u201368","author":"Neumayer Robert","year":"2008","unstructured":"Mayer, Rudolf, Robert Neumayer , and Andreas Rauber . 2008 a. \u201c Combination of Audio and Lyrics Features for Genre Classification in Digital Audio Collections .\u201d In Proceedings of the 16th Acm International Conference on Multimedia, 159\u201368 . Mayer, Rudolf, Robert Neumayer, and Andreas Rauber. 2008a. \u201cCombination of Audio and Lyrics Features for Genre Classification in Digital Audio Collections.\u201d In Proceedings of the 16th Acm International Conference on Multimedia, 159\u201368."},{"key":"e_1_3_2_1_17_1","first-page":"337","article-title":"Rhyme and Style Features for Musical Genre Classification by Song Lyrics","author":"Neumayer Robert","year":"2008","unstructured":"Mayer, Rudolf, Robert Neumayer , and Andreas Rauber . 2008 b. \u201c Rhyme and Style Features for Musical Genre Classification by Song Lyrics .\u201d In Ismir , 337 \u2013 342 . Mayer, Rudolf, Robert Neumayer, and Andreas Rauber. 2008b. \u201cRhyme and Style Features for Musical Genre Classification by Song Lyrics.\u201d In Ismir, 337\u201342.","journal-title":"Ismir"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of International Conference on Music Information Retrieval, 675\u201380","author":"Rauber Andreas","year":"2011","unstructured":"Mayer, Rudolf, and Andreas Rauber . 2011 . \u201c Musical Genre Classification by Ensembles of Audio and Lyrics Features .\u201d In Proceedings of International Conference on Music Information Retrieval, 675\u201380 . Mayer, Rudolf, and Andreas Rauber. 2011. \u201cMusical Genre Classification by Ensembles of Audio and Lyrics Features.\u201d In Proceedings of International Conference on Music Information Retrieval, 675\u201380."},{"key":"e_1_3_2_1_19_1","volume-title":"In2019 Artificial Intelligence for Transforming Business and Society (Aitb), 1:1\u20135","author":"Shakya Sushil","unstructured":"Munikar, Manish, Sushil Shakya , and Aakash Shrestha . 2019. \u201c Fine-Grained Sentiment Classification Using Bert .\u201d In2019 Artificial Intelligence for Transforming Business and Society (Aitb), 1:1\u20135 . IEEE. Munikar, Manish, Sushil Shakya, and Aakash Shrestha. 2019. \u201cFine-Grained Sentiment Classification Using Bert.\u201d In2019 Artificial Intelligence for Transforming Business and Society (Aitb), 1:1\u20135. IEEE."},{"key":"e_1_3_2_1_20_1","volume-title":"European Conference on Information Retrieval, 724\u201327","author":"Rauber Andreas","year":"2007","unstructured":"Neumayer, Robert, and Andreas Rauber . 2007 . \u201c Integration of Text and Audio Features for Genre Classification in Music Information Retrieval .\u201d In European Conference on Information Retrieval, 724\u201327 . Springer. Neumayer, Robert, and Andreas Rauber. 2007. \u201cIntegration of Text and Audio Features for Genre Classification in Music Information Retrieval.\u201d In European Conference on Information Retrieval, 724\u201327. Springer."},{"key":"e_1_3_2_1_21_1","volume-title":"Transactions of the International Society for Music Information Retrieval. 2018","author":"Barbieri Francesco","unstructured":"Oramas, Sergio, Francesco Barbieri , Oriol Nieto , and Xavier Serra . 2018. \u201c Multimodal Deep Learning for Music Genre Classification .\u201d Transactions of the International Society for Music Information Retrieval. 2018 ; 1 (1): 4-21. Oramas, Sergio, Francesco Barbieri, Oriol Nieto, and Xavier Serra. 2018. \u201cMultimodal Deep Learning for Music Genre Classification.\u201d Transactions of the International Society for Music Information Retrieval. 2018; 1 (1): 4-21."},{"key":"e_1_3_2_1_22_1","unstructured":"Oramas Sergio Oriol Nieto Francesco Barbieri and Xavier Serra. 2017. \u201cMulti-Label Music Genre Classification from Audio Text and Images Using Deep Features.\u201d http:\/\/arxiv.org\/abs\/1707.04916.  Oramas Sergio Oriol Nieto Francesco Barbieri and Xavier Serra. 2017. \u201cMulti-Label Music Genre Classification from Audio Text and Images Using Deep Features.\u201d http:\/\/arxiv.org\/abs\/1707.04916."},{"key":"e_1_3_2_1_24_1","volume-title":"DistilBERT, a Distilled Version of Bert: Smaller, Faster, Cheaper and Lighter","author":"Debut Lysandre","year":"1910","unstructured":"Sanh, Victor, Lysandre Debut , Julien Chaumond , and Thomas Wolf . 2019. \u201c DistilBERT, a Distilled Version of Bert: Smaller, Faster, Cheaper and Lighter .\u201d http:\/\/arxiv.org\/abs\/ 1910 .01108. Sanh, Victor, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. \u201cDistilBERT, a Distilled Version of Bert: Smaller, Faster, Cheaper and Lighter.\u201d http:\/\/arxiv.org\/abs\/1910.01108."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_3_2_1_27_1","volume-title":"Thirty-Second Aaai Conference on Artificial Intelligence.","author":"Zhang Yizhe","year":"2018","unstructured":"Shen, Dinghan, Yizhe Zhang , Ricardo Henao , Qinliang Su , and Lawrence Carin . 2018 . \u201c Deconvolutional Latent-Variable Model for Text Sequence Matching .\u201d In Thirty-Second Aaai Conference on Artificial Intelligence. Shen, Dinghan, Yizhe Zhang, Ricardo Henao, Qinliang Su, and Lawrence Carin. 2018. \u201cDeconvolutional Latent-Variable Model for Text Sequence Matching.\u201d In Thirty-Second Aaai Conference on Artificial Intelligence."},{"key":"e_1_3_2_1_28_1","volume-title":"China National Conference on Chinese Computational Linguistics, 194\u2013206","author":"Qiu Xipeng","year":"2019","unstructured":"Sun, Chi, Xipeng Qiu , Yige Xu , and Xuanjing Huang . 2019 . \u201c How to Fine-Tune Bert for Text Classification? \u201d In China National Conference on Chinese Computational Linguistics, 194\u2013206 . Springer. Sun, Chi, Xipeng Qiu, Yige Xu, and Xuanjing Huang. 2019. \u201cHow to Fine-Tune Bert for Text Classification?\u201d In China National Conference on Chinese Computational Linguistics, 194\u2013206. Springer."},{"key":"e_1_3_2_1_29_1","unstructured":"Tsaptsinos Alexandros. 2017. \u201cMusic Genre Classification by Lyrics Using a Hierarchical Attention Network.\u201d In. ICME.  Tsaptsinos Alexandros. 2017. \u201cMusic Genre Classification by Lyrics Using a Hierarchical Attention Network.\u201d In. ICME."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSA.2002.800560"},{"key":"e_1_3_2_1_31_1","first-page":"5998","article-title":"Attention Is All You Need","author":"Shazeer Noam","year":"2017","unstructured":"Vaswani, Ashish, Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . 2017 . \u201c Attention Is All You Need .\u201d In Advances in Neural Information Processing Systems , 5998 \u2013 6008 . Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. \u201cAttention Is All You Need.\u201d In Advances in Neural Information Processing Systems, 5998\u20136008.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1174"},{"key":"e_1_3_2_1_33_1","volume-title":"In2012 International Conference on Information Retrieval & Knowledge Management, 260\u201363","author":"Chao Teh","year":"2012","unstructured":"Ying, Teh Chao , Shyamala Doraisamy , and Lili Nurliyana Abdullah . 2012 . \u201c Genre and Mood Classification Using Lyric Features .\u201d In2012 International Conference on Information Retrieval & Knowledge Management, 260\u201363 . IEEE. Ying, Teh Chao, Shyamala Doraisamy, and Lili Nurliyana Abdullah. 2012. \u201cGenre and Mood Classification Using Lyric Features.\u201d In2012 International Conference on Information Retrieval & Knowledge Management, 260\u201363. IEEE."},{"key":"e_1_3_2_1_34_1","volume-title":"Generative and Discriminative Text Classification with Recurrent Neural Networks","author":"Dyer Chris","unstructured":"Yogatama, Dani, Chris Dyer , Wang Ling , and Phil Blunsom . 2017. \u201c Generative and Discriminative Text Classification with Recurrent Neural Networks .\u201d arXiv Preprint arXiv:1703.0189 Yogatama, Dani, Chris Dyer, Wang Ling, and Phil Blunsom. 2017. \u201cGenerative and Discriminative Text Classification with Recurrent Neural Networks.\u201d arXiv Preprint arXiv:1703.0189"}],"event":{"name":"ISEEIE 2021: 2021 International Symposium on Electrical, Electronics and Information Engineering","location":"Seoul Republic of Korea","acronym":"ISEEIE 2021"},"container-title":["2021 International Symposium on Electrical, Electronics and Information Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3459104.3459171","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3459104.3459171","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:04Z","timestamp":1750193224000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3459104.3459171"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,19]]},"references-count":33,"alternative-id":["10.1145\/3459104.3459171","10.1145\/3459104"],"URL":"https:\/\/doi.org\/10.1145\/3459104.3459171","relation":{},"subject":[],"published":{"date-parts":[[2021,2,19]]},"assertion":[{"value":"2021-07-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}