{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T16:56:39Z","timestamp":1773593799075,"version":"3.50.1"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006378","name":"Universitas Indonesia","doi-asserted-by":"publisher","award":["1263\/UN2.R3.1\/HKP.05.00\/2018"],"award-info":[{"award-number":["1263\/UN2.R3.1\/HKP.05.00\/2018"]}],"id":[{"id":"10.13039\/501100006378","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Argumentation mining is a research field which focuses on sentences in type of argumentation. Argumentative sentences are often used in daily communication and have important role in each decision or conclusion making process. The research objective is to do observation in deep learning utilization combined with attention mechanism for argument annotation and analysis. Argument annotation is argument component classification from certain discourse to several classes. Classes include major claim, claim, premise and non-argumentative. Argument analysis points to argumentation characteristics and validity which are arranged into one topic. One of the analysis is about how to assess whether an established argument is categorized as sufficient or not. Dataset used for argument annotation and analysis is 402 persuasive essays. This data is translated into Bahasa Indonesia (mother tongue of Indonesia) to give overview about how it works with specific language other than English. Several deep learning models such as CNN (Convolutional Neural Network), LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) are utilized for argument annotation and analysis while HAN (Hierarchical Attention Network) is utilized only for argument analysis. Attention mechanism is combined with the model as weighted access setter for a better performance. From the whole experiments, combination of deep learning and attention mechanism for argument annotation and analysis arrives in a better result compared with previous research.<\/jats:p>","DOI":"10.1186\/s40537-020-00364-z","type":"journal-article","created":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T13:04:25Z","timestamp":1603112665000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Argument annotation and analysis using deep learning with attention mechanism in Bahasa Indonesia"],"prefix":"10.1186","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3271-5874","authenticated-orcid":false,"given":"Derwin","family":"Suhartono","sequence":"first","affiliation":[]},{"given":"Aryo Pradipta","family":"Gema","sequence":"additional","affiliation":[]},{"given":"Suhendro","family":"Winton","sequence":"additional","affiliation":[]},{"given":"Theodorus","family":"David","sequence":"additional","affiliation":[]},{"given":"Mohamad Ivan","family":"Fanany","sequence":"additional","affiliation":[]},{"given":"Aniati Murni","family":"Arymurthy","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,10,19]]},"reference":[{"issue":"1","key":"364_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4018\/jcini.2013010101","volume":"7","author":"A Peldszus","year":"2013","unstructured":"Peldszus A, Stede M. From argument diagrams to argumentation mining in texts: a survey. Int J Cognit Informat Nat Intel. 2013;7(1):1\u201331.","journal-title":"Int J Cognit Informat Nat Intel"},{"key":"364_CR2","volume-title":"Argumentation schemes for presumptive reasoning","author":"DN Walton","year":"1996","unstructured":"Walton DN. Argumentation schemes for presumptive reasoning. Mahwah: Lawrence Erlbaum; 1996."},{"key":"364_CR3","doi-asserted-by":"crossref","unstructured":"Song Y, Heilman M, Klebanov BB, Deane P. Applying argumentation schemes for essay scoring. In: Proceedings of the first workshop on argumentation mining. 2014. p. 69\u201378.","DOI":"10.3115\/v1\/W14-2110"},{"key":"364_CR4","doi-asserted-by":"crossref","unstructured":"Stab C, Gurevych I. Identifying argumentative discourse structures in persuasive essays. In: Proceedings of conference on empirical methods in natural language processing. 2014. p. 46\u201356.","DOI":"10.3115\/v1\/D14-1006"},{"key":"364_CR5","unstructured":"Stab C, Gurevych I. Annotating argument components and relations in persuasive essays. In: Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers. 2014. p. 1501\u20131510."},{"issue":"3","key":"364_CR6","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1162\/COLI_a_00295","volume":"43","author":"C Stab","year":"2017","unstructured":"Stab C, Gurevych I. Parsing argumentation structures in persuasive essays. Comput Linguist. 2017;43(3):619\u201359.","journal-title":"Comput Linguist"},{"key":"364_CR7","doi-asserted-by":"crossref","unstructured":"Moens MF, Boiy E, Palau RM, Reed C. Automatic detection of arguments in legal texts. In: Proceedings of the 11th International Conference on Artificial Intelligence and Law. 2007. p. 225\u2013230.","DOI":"10.1145\/1276318.1276362"},{"key":"364_CR8","unstructured":"Florou E, Konstantopoulos S, Kukurikos A, Karampiperis P. Argument extraction for supporting public policy formulation. In: Proceedings of the 7th Workshop on language technology for cultural heritage, social sciences, and humanities. 2013. p. 49\u201354."},{"key":"364_CR9","unstructured":"Madnani N, Heilman M, Tetreault J, Chodorow M. Identifying high-level organizational elements in argumentative discourse. In: Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2012. p. 20\u201328."},{"key":"364_CR10","doi-asserted-by":"crossref","unstructured":"Ong N, Litman D, Brusilovsky A. Ontology-based argument mining and automatic essay scoring. In: Proceedings of the First Workshop on Argumentation Mining. 2014. p. 24\u201328.","DOI":"10.3115\/v1\/W14-2104"},{"key":"364_CR11","doi-asserted-by":"crossref","unstructured":"Stab C, Gurevych I. Recognizing insufficiently supported arguments in argumentative essays. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. 2017. p. 980\u2013990.","DOI":"10.18653\/v1\/E17-1092"},{"key":"364_CR12","doi-asserted-by":"crossref","unstructured":"Wei Z, Liu Y, Li, Y. Is This Post Persuasive? Ranking argumentative comments in the online forum. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. 2016. p. 195\u2013200.","DOI":"10.18653\/v1\/P16-2032"},{"key":"364_CR13","doi-asserted-by":"crossref","unstructured":"Habernal I, Gurevych I. Which argument is more convincing? Analyzing and predicting convincingness of Web arguments using bidirectional LSTM. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. 2016. p. 1589\u20131599.","DOI":"10.18653\/v1\/P16-1150"},{"issue":"7553","key":"364_CR14","first-page":"436","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G. Deep learning. Nat Int J Sci. 2015;521(7553):436.","journal-title":"Nat Int J Sci."},{"key":"364_CR15","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","volume":"61","author":"J Schmidhuber","year":"2015","unstructured":"Schmidhuber J. Deep learning in neural networks: an overview. Neural Netw. 2015;61:85\u2013117.","journal-title":"Neural Netw"},{"key":"364_CR16","doi-asserted-by":"crossref","unstructured":"Kim Y. Convolutional neural networks for sentence classification. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2014. p. 1746\u20131751.","DOI":"10.3115\/v1\/D14-1181"},{"key":"364_CR17","doi-asserted-by":"crossref","unstructured":"Boltuzic F, \u0160najder J. Fill the Gap! Analyzing implicit premises between claims from online debates. In: Proceedings of the 3rd Workshop on Argument Mining ACL. 2016. p. 124\u2013133.","DOI":"10.18653\/v1\/W16-2815"},{"key":"364_CR18","doi-asserted-by":"crossref","unstructured":"Addawood AA, Bashir MN. \u201cWhat is Your Evidence?\" A study of controversial topics on social media. In: Proceedings of the 3rd Workshop on Argument Mining ACL. 2016. p. 1\u201314.","DOI":"10.18653\/v1\/W16-2801"},{"key":"364_CR19","volume-title":"An argument research corpus","author":"J Katzav","year":"2003","unstructured":"Katzav J, Reed C, Rowe G. An argument research corpus. Corpora: Practical Appl.s of Ling; 2003."},{"issue":"04","key":"364_CR20","doi-asserted-by":"publisher","first-page":"961","DOI":"10.1142\/S0218213004001922","volume":"13","author":"C Reed","year":"2004","unstructured":"Reed C, Rowe G. Araucaria: software for argument analysis, diagramming and representation. Int J Artificial Intel Tools. 2004;13(04):961\u201379.","journal-title":"Int J Artificial Intel Tools."},{"key":"364_CR21","unstructured":"Reed C. Preliminary results from an argument corpus. Linguistics in the twenty-first century. 2006. p. 185\u2013196."},{"issue":"05","key":"364_CR22","doi-asserted-by":"publisher","first-page":"1540024","DOI":"10.1142\/S0218213015400242","volume":"24","author":"T Goudas","year":"2015","unstructured":"Goudas T, Louizos C, Petasis G, Karkaletsis V. Argument extraction from news, blogs, and the social web. Int J Artif Intel Tools. 2015;24(05):1540024.","journal-title":"Int J Artif Intel Tools."},{"key":"364_CR23","doi-asserted-by":"crossref","unstructured":"Sardianos C, Katakis IM, Petasis G, Karkaletsis V. Argument extraction from news. In: Proceedings of the 2nd Workshop on Argumentation Mining. 2015. p. 56\u201366.","DOI":"10.3115\/v1\/W15-0508"},{"issue":"1","key":"364_CR24","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1162\/COLI_a_00276","volume":"43","author":"I Habernal","year":"2016","unstructured":"Habernal I, Gurevych I. Argumentation mining in user-generated web discourse. Comput Linguist. 2016;43(1):125\u201379.","journal-title":"Comput Linguist"},{"key":"364_CR25","doi-asserted-by":"crossref","unstructured":"Aharoni E, Polnarov A, Lavee T, Hershcovich D, Levy R, Rinott R, Gutfreund D, Slonim N. A benchmark dataset for automatic detection of claims and evidence in the context of controversial topics. In: Proceedings of the First Workshop on Argumentation Mining. 2014. p. 64\u201368.","DOI":"10.3115\/v1\/W14-2109"},{"key":"364_CR26","doi-asserted-by":"crossref","unstructured":"Palau RM, Moens MF. Argumentation mining: the detection, classification and structure of arguments in text. In: Proceedings of the 12th International Conference on Artificial Intelligence and Law, 2009.","DOI":"10.1145\/1568234.1568246"},{"key":"364_CR27","doi-asserted-by":"crossref","unstructured":"Eckle-Kohler J, Kluge R, Gurevych I. On the role of discourse markers for discriminating claims and premises in argumentative discourse. In: Proceedings of the 2nd Workshop on Argumentation Mining. 2015. p. 22\u201328.","DOI":"10.18653\/v1\/D15-1267"},{"key":"364_CR28","unstructured":"Desilia Y, Utami VT, Arta C, Suhartono D. An attempt to combine features in classifying argument components in persuasive essays. In: Proceedings of 17th Workshop on Computational Models of Natural Argument. 2017. p. 71\u201375."},{"key":"364_CR29","doi-asserted-by":"crossref","unstructured":"Nguyen HV, Litman DJ. Extracting argument and domain words for identifying argument components in texts. In: Proceedings of the 2nd Workshop on Argumentation Mining. 2015. p. 2\u201328.","DOI":"10.3115\/v1\/W15-0503"},{"key":"364_CR30","unstructured":"Levy R, Bilu Y, Hershcovich D, Aharoni E, Slonim N. Context dependent claim detection. In: Proceedings the 25th International Conference on Computational Linguistics: Technical Papers. 2014. p. 1489\u20131500."},{"key":"364_CR31","doi-asserted-by":"crossref","unstructured":"Bilu Y, Hershcovich D, Slonim N. Automatic Claim Negation: Why, How and When. In: Proceedings of the 2nd Workshop on Argumentation Mining. 2015. p. 84\u201393.","DOI":"10.3115\/v1\/W15-0511"},{"key":"364_CR32","doi-asserted-by":"crossref","unstructured":"Rinott R, Dankin L, Perez CA, Khapra MM, Aharoni E, Slonim N. Show me your evidence\u2013an automatic method for context dependent evidence detection. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing; 2015. p. 440\u2013450.","DOI":"10.18653\/v1\/D15-1050"},{"key":"364_CR33","doi-asserted-by":"crossref","unstructured":"Bar-Haim R, Bhattacharya I, Dinuzzo F, Saha A, Slonim N. Stance classification of context-dependent claims. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, Long Papers. 2016; 1: 251\u2013261.","DOI":"10.18653\/v1\/E17-1024"},{"key":"364_CR34","doi-asserted-by":"crossref","unstructured":"Egan C, Siddharthan A, Wyner A. Summarising the points made in online political debates. In: Proceedings of the 3rd Workshop on Argument Mining. 2016. p. 134\u2013143.","DOI":"10.18653\/v1\/W16-2816"},{"key":"364_CR35","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.procs.2017.10.003","volume":"116","author":"AD Chowanda","year":"2017","unstructured":"Chowanda AD, Sanyoto AR, Suhartono D, Setiadi CJ. Automatic debate text summarization in online debate forum. Procedia Comput Sci. 2017;116:11\u20139.","journal-title":"Procedia Comput Sci"},{"key":"364_CR36","doi-asserted-by":"crossref","unstructured":"Chakrabarty T, Hidey C, Muresan S, Mckeown K, Hwang A. AMPERSAND: Argument Mining for PERSuAsive oNline Discussions. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 2019. p. 2933\u20132943.","DOI":"10.18653\/v1\/D19-1291"},{"key":"364_CR37","doi-asserted-by":"crossref","unstructured":"Hua X, Hu Z, Wang L. Argument generation with retrieval, planning, and realization. proceedings of the 57th annual meeting of the association for computational linguistics, 2019. p. 2661\u20132672.","DOI":"10.18653\/v1\/P19-1255"},{"key":"364_CR38","doi-asserted-by":"crossref","unstructured":"Persing I, Ng V. Modeling argument strength in student essays. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing: Long Papers; 2015; 1: 543\u2013552.","DOI":"10.3115\/v1\/P15-1053"},{"key":"364_CR39","unstructured":"Cabrio I, Villata S. Combining textual entailment and argumentation theory for supporting online debates interactions. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers; 2012; 2: 208\u2013212."},{"key":"364_CR40","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1016\/j.procs.2017.10.036","volume":"116","author":"AP Gema","year":"2017","unstructured":"Gema AP, Winton S, David T, Suhartono D, Shodiq M, Gazali W. It takes two to tango: modification of siamese long short term memory network with attention mechanism in recognizing argumentative relations in persuasive essay. Procedia Comput Sci. 2017;116:449\u201359.","journal-title":"Procedia Comput Sci"},{"key":"364_CR41","doi-asserted-by":"crossref","unstructured":"Suhartono D, Gema AP, Winton S, David T, Fanany MI, Arymurthy AM. \u201cHierarchical Attention Network with XGBoost for Recognizing Insufficiently Supported Argument\u201d. International Workshop on Multi-disciplinary Trends in Artificial Intelligence (MIWAI), p. 174\u2013188, Gadong, Brunei Darussalam, 2017.","DOI":"10.1007\/978-3-319-69456-6_15"},{"key":"364_CR42","unstructured":"Chollet. Keras. https:\/\/github.com\/fchollet\/keras, 2015."},{"issue":"5","key":"364_CR43","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1504\/IJCVR.2019.102282","volume":"9","author":"D Suhartono","year":"2019","unstructured":"Suhartono D, Gema AP, Winton S, David T, Fanany MI, Arymurthy AM. Attention-based argumentation mining. Int J Comput Vision Robot. 2019;9(5):414\u201337.","journal-title":"Int J Comput Vision Robot."},{"key":"364_CR44","unstructured":"Chung J, G\u00fcl\u00e7ehre C, Cho K, Bengio Y. Gated feedback recurrent neural networks. In: Proceedings of International Conference on Machine Learning; 2015. p. 2067\u20132075."},{"key":"364_CR45","doi-asserted-by":"crossref","unstructured":"Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E. Hierarchical attention networks for document classification. In: Proceedings The 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2016. p. 1480\u20131489.","DOI":"10.18653\/v1\/N16-1174"},{"key":"364_CR46","unstructured":"Hinton GE, Salakhutdinov RR. Replicated softmax: an undirected topic model. Advances in Neural Information Processing Systems. 2009. p. 1607\u20131614."},{"key":"364_CR47","unstructured":"Grave E, Bojanowski P, Gupta P, Joulin A, Mikolov T. Learning Word Vectors for 157. Languages. 2018;. arXiv:1802.06893."}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-020-00364-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-020-00364-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-020-00364-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T00:47:47Z","timestamp":1634604467000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-020-00364-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,19]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["364"],"URL":"https:\/\/doi.org\/10.1186\/s40537-020-00364-z","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,19]]},"assertion":[{"value":"5 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"90"}}