{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T05:23:17Z","timestamp":1755926597009,"version":"3.37.3"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T00:00:00Z","timestamp":1626912000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T00:00:00Z","timestamp":1626912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Arguments facilitate humans to deliver their ideas. The outcome of the discussion heavily relies on the validity of the argument. If an argument is well-composed, it is more effective to grasp the core idea behind the argument. To grade the argument, machines can be utilized by decomposing into semantic label components. In natural language processing, multiple language models are available to perform this task. It is divided into context-free and contextual models. The majority of previous studies used hand-crafted features to perform argument component classification, while state of the art language models utilize machine learning. The majority of these language models ignore the context in an argument. This research paper aims to analyze whether by including the context in the classification process may improve the accuracy of the language model which will enhance the argumentation mining process as well. The same document corpus is fed into several language models. Word2Vec and GLoVe represent the context free models, while BERT and ELMo as context sensitive language models. Accuracy and time from each model are then compared to determine the importance of context. The result shows that contextual language models are proven to be able to boost classification accuracy by approximately 20%. However, time comes as a cost where contextual models require longer training and prediction time. The benefit from the increase in accuracy outweighs the burden of time. Thus, as a contextual task, argumentation mining is suggested to use contextual model where context must be included to achieve promising results.<\/jats:p>","DOI":"10.1186\/s40537-021-00490-2","type":"journal-article","created":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T09:05:57Z","timestamp":1626944757000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Enhancing argumentation component classification using contextual language model"],"prefix":"10.1186","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5005-8006","authenticated-orcid":false,"family":"Hidayaturrahman","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emmanuel","family":"Dave","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Derwin","family":"Suhartono","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aniati Murni","family":"Arymurthy","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,7,22]]},"reference":[{"key":"490_CR1","volume-title":"Fundamentals of argumentation theory: a handbook of historical backgrounds and contemporary developments","author":"FH Van Eemeren","year":"1996","unstructured":"Van Eemeren FH, Grootendorst R, Henkemans FS, Blair JA, Johnson RH, Krabbe ECW, Plantin C, Walton DN, Willard CA, et al. Fundamentals of argumentation theory: a handbook of historical backgrounds and contemporary developments. Mahwah: Lawrence Erlbaum Associates, Inc; 1996."},{"key":"490_CR2","unstructured":"Stab C, Gurevych I. Annotating argument components and relations in persuasive essays. In: The 25th International Conference on Computational Linguistics, Ireland, Dublin, 2014."},{"key":"490_CR3","volume-title":"Arguments and arguing: the products and process of human decision making","author":"TA Hollilan","year":"2015","unstructured":"Hollilan TA, Baaske KT. Arguments and arguing: the products and process of human decision making. Long Grove: Waveland Press Inc; 2015."},{"key":"490_CR4","doi-asserted-by":"crossref","unstructured":"Wagemans J. Constructing a periodic table of arguments. In: Proceedings of the 11th international conference of the Ontario Society for the Study of Argumentation (OSSA), Windsor, 2016.","DOI":"10.2139\/ssrn.2769833"},{"key":"490_CR5","doi-asserted-by":"crossref","unstructured":"Suhartono D, Gema AP, Winton S, David T, Fanany MI, Arymurthy AM. Hierarchical attention network with XGBoost for recognizing insufficiently supported argument. In: 11th Multi-disciplinary international workshop on artificial intelligence, MIWAI 2017, Gadong, 2017.","DOI":"10.1007\/978-3-319-69456-6_15"},{"issue":"3","key":"490_CR6","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1162\/COLI_a_00295","volume":"43","author":"C Stab","year":"2017","unstructured":"Stab C, Gurevych I. Parsing argumentation structures in persuasive essays Christian stab, Iryna Gurevych. Comput Linguist. 2017;43(3):619\u201359.","journal-title":"Comput Linguist"},{"key":"490_CR7","unstructured":"Xue L, Lynch C. Incorporating task-specific features into deep models to classify argument components. EDM 2020."},{"key":"490_CR8","unstructured":"Paul D, Opitz J, Becker M, Kobbe J, Hirst G, Frank A. Argumentative relation classification with background knowledge. In: Frontiers in artificial intelligence and applications, 2020, pp. 319\u201330."},{"key":"490_CR9","unstructured":"Lenz M, Sahitaj P, Kallenberg S, Coors C, Dumani L, Schenkel R, Bergmann R. Towards an argument mining pipeline transforming texts to argument graphs. ArXiv 2020."},{"key":"490_CR10","doi-asserted-by":"crossref","unstructured":"Eger S, Daxenberger, Gurevych I. Neural end-to-end learning for computational argumentation mining. In: Proceedings of the 55th annual meeting of the association for computational linguistics, Vol 1, Long Papers, Vancouver, Canada; 2017.","DOI":"10.18653\/v1\/P17-1002"},{"key":"490_CR11","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning C. Glove: global vectors for word representation. In: EMNLP, 2014.","DOI":"10.3115\/v1\/D14-1162"},{"key":"490_CR12","unstructured":"Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. In: ar Xiv:1301.3781, 2013."},{"key":"490_CR13","doi-asserted-by":"crossref","unstructured":"Joulin A, Grave E, Bojanowski P, Mikolov T. Bag of tricks for efficient text classification; 2016.","DOI":"10.18653\/v1\/E17-2068"},{"key":"490_CR14","unstructured":"Jacob Devlin KT. BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, Vol 1, Long and Short Papers, Minneapolis, Minnesota; 2019."},{"key":"490_CR15","doi-asserted-by":"crossref","unstructured":"Peters M, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L. Deep contextualized word representations. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, Vol 1 (Long Papers), New Orleans, Louisiana; 2018.","DOI":"10.18653\/v1\/N18-1202"},{"key":"490_CR16","unstructured":"Mayer T, Cabrio E, Villata S. Transformer-based argument mining for healthcare applications. In: 24th European conference on artificial intelligence\u2014ECAI, Santiago de Compostela, Spain, 2020."},{"key":"490_CR17","doi-asserted-by":"crossref","unstructured":"Gema AP, Winton S, David T, Suhartono D, Shodiq M, Gazali W, Shodiq M, Gazali W. It takes two to tango: modification of siamese long short term memory network with attention mechanism in recognizing memory network with attention mechanism in recognizing argumentative relations in persuasive essay argumentative relations in persuasive. In: 2nd international conference on computer science and computational intelligence, Bali; 2017.","DOI":"10.1016\/j.procs.2017.10.036"},{"key":"490_CR18","unstructured":"Fromm M, Faerman E, Berrendorf M, Bhargava S, Qi R, Zhang Y, Dennert L, Selle S, Mao Y, Seidl T. Argument mining driven analysis of peer-reviews. In: https:\/\/arxiv.org\/abs\/2012.07743, 2020."},{"key":"490_CR19","unstructured":"Schaefer R, Stede M. Annotation and detection of arguments in tweets. In: Proceedings of the 7th workshop on argument mining; 2020."},{"key":"490_CR20","unstructured":"Bauwelinck N, Lefever E. Annotating topics, stance, argumentativeness and claims in Dutch Social Media comments: a pilot study. In: Proceedings of the 7th workshop on argument mining; 2020."},{"key":"490_CR21","doi-asserted-by":"crossref","unstructured":"Toledo-Ronen O, Orbach M, Bilu Y, Spector A, Slonim N. Multilingual argument mining: datasets and analysis. In: EMNLP, 2020.","DOI":"10.18653\/v1\/2020.findings-emnlp.29"},{"key":"490_CR22","unstructured":"Sanh V, Debut L, Chaumond J, Wolf T. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. In: arXiv preprint ar Xiv:1910.01108; 2019."},{"key":"490_CR23","doi-asserted-by":"crossref","unstructured":"Sun C, Qiu X, Xu Y, Huang X. How to fine-tune BERT for text classification. In: China National Conference on Chinese Computational Linguistics, 2019, October, p. 194\u2013206.","DOI":"10.1007\/978-3-030-32381-3_16"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-021-00490-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-021-00490-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-021-00490-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T09:07:24Z","timestamp":1626944844000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-021-00490-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,22]]},"references-count":23,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["490"],"URL":"https:\/\/doi.org\/10.1186\/s40537-021-00490-2","relation":{},"ISSN":["2196-1115"],"issn-type":[{"type":"electronic","value":"2196-1115"}],"subject":[],"published":{"date-parts":[[2021,7,22]]},"assertion":[{"value":"15 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"103"}}