{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T15:24:20Z","timestamp":1772205860662,"version":"3.50.1"},"reference-count":55,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T00:00:00Z","timestamp":1616716800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T00:00:00Z","timestamp":1616716800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["GU 798\/25-1"],"award-info":[{"award-number":["GU 798\/25-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005714","name":"Technische Universit\u00e4t Darmstadt","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005714","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["K\u00fcnstl Intell"],"published-print":{"date-parts":[[2021,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Stance detection (StD) aims to detect an author\u2019s stance towards a certain topic and has become a key component in applications like fake news detection, claim validation, or argument search. However, while stance is easily detected by humans, machine learning (ML) models are clearly falling short of this task. Given the major differences in dataset sizes and framing of StD (e.g. number of classes and inputs), ML models trained on a single dataset usually generalize poorly to other domains. Hence, we introduce a StD benchmark that allows to compare ML models against a wide variety of heterogeneous StD datasets to evaluate them for generalizability and robustness. Moreover, the framework is designed for easy integration of new datasets and probing methods for robustness. Amongst several baseline models, we define a model that learns from all ten StD datasets of various domains in a multi-dataset learning (MDL) setting and present new state-of-the-art results on five of the datasets. Yet, the models still perform well below human capabilities and even simple perturbations of the original test samples (adversarial attacks) severely hurt the performance of MDL models. Deeper investigation suggests overfitting on dataset biases as the main reason for the decreased robustness. Our analysis emphasizes the need of focus on robustness and de-biasing strategies in multi-task learning approaches. To foster research on this important topic, we release the dataset splits, code, and fine-tuned weights.<\/jats:p>","DOI":"10.1007\/s13218-021-00714-w","type":"journal-article","created":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T13:02:59Z","timestamp":1616763779000},"page":"329-341","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Stance Detection Benchmark: How Robust is Your Stance Detection?"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1175-4727","authenticated-orcid":false,"given":"Benjamin","family":"Schiller","sequence":"first","affiliation":[]},{"given":"Johannes","family":"Daxenberger","sequence":"additional","affiliation":[]},{"given":"Iryna","family":"Gurevych","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,3,26]]},"reference":[{"key":"714_CR1","doi-asserted-by":"publisher","unstructured":"Atanasova P, Wright D, Augenstein I (2020) Generating label cohesive and well-formed adversarial claims. In: EMNLP\u201920, Online. pp 3168\u20133177. https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.256","DOI":"10.18653\/v1\/2020.emnlp-main.256"},{"key":"714_CR2","doi-asserted-by":"publisher","unstructured":"Augenstein I, Ruder S, S\u00f8gaard A (2018) Multi-task learning of pairwise sequence classification tasks over disparate label spaces. In: NAACL\u201918, Volume 1 (Long Papers), New Orleans, Louisiana. pp 1896\u20131906. https:\/\/doi.org\/10.18653\/v1\/N18-1172","DOI":"10.18653\/v1\/N18-1172"},{"key":"714_CR3","doi-asserted-by":"crossref","unstructured":"Bar-Haim R, Bhattacharya I, Dinuzzo F, Saha A, Slonim N (2017) Stance classification of context-dependent claims. In: EACL\u201917. pp 251\u2013261. https:\/\/www.aclweb.org\/anthology\/E17-1024. Accessed 10 Mar 2021","DOI":"10.18653\/v1\/E17-1024"},{"key":"714_CR4","unstructured":"Belinkov Y, Bisk Y (2017) Synthetic and natural noise both break neural machine translation. arXiv preprint arXiv:171102173"},{"key":"714_CR5","doi-asserted-by":"crossref","unstructured":"Chen S, Khashabi D, Yin W, Callison-Burch C, Roth D (2019) Seeing things from a different angle:discovering diverse perspectives about claims. In: NAACL\u201919. pp 542\u2013557. http:\/\/dx.doi.org\/10.18653\/v1\/N19-1053","DOI":"10.18653\/v1\/N19-1053"},{"key":"714_CR6","doi-asserted-by":"publisher","unstructured":"Clark C, Yatskar M, Zettlemoyer L (2019) Don\u2019t take the easy way out: Ensemble based methods for avoiding known dataset biases. In: EMNLP-IJCNLP\u201919. pp 4067\u20134080. https:\/\/doi.org\/10.18653\/v1\/D19-1418","DOI":"10.18653\/v1\/D19-1418"},{"issue":"1","key":"714_CR7","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37\u201346. https:\/\/doi.org\/10.1177\/001316446002000104","journal-title":"Educ Psychol Meas"},{"key":"714_CR8","doi-asserted-by":"publisher","unstructured":"Conforti C, Berndt J, Pilehvar MT, Giannitsarou C, Toxvaerd F, Collier N (2020) Will-they-won\u2019t-they: a very large dataset for stance detection on Twitter. In: ACL\u201920, Online. pp 1715\u20131724. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.157","DOI":"10.18653\/v1\/2020.acl-main.157"},{"key":"714_CR9","doi-asserted-by":"crossref","unstructured":"Derczynski L, Bontcheva K, Liakata M, Procter R, Hoi GWS, Zubiaga A (2017) Semeval-2017 task 8: Rumoureval: determining rumour veracity and support for rumours. arXiv preprint arXiv:170405972","DOI":"10.18653\/v1\/S17-2006"},{"key":"714_CR10","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:181004805"},{"key":"714_CR11","doi-asserted-by":"publisher","unstructured":"Ferreira W, Vlachos A (2016) Emergent: a novel data-set for stance classification. In: NAACL\u201916. pp 1163\u20131168. https:\/\/doi.org\/10.18653\/v1\/N16-1138","DOI":"10.18653\/v1\/N16-1138"},{"key":"714_CR12","doi-asserted-by":"publisher","unstructured":"Geva M, Goldberg Y, Berant J (2019) Are we modeling the task or the annotator? An investigation of annotator bias in natural language understanding datasets. In: EMNLP-IJCNLP\u201919. pp 1161\u20131166. https:\/\/doi.org\/10.18653\/v1\/D19-1107","DOI":"10.18653\/v1\/D19-1107"},{"key":"714_CR13","doi-asserted-by":"publisher","unstructured":"Glockner M, Shwartz V, Goldberg Y (2018) Breaking nli systems with sentences that require simple lexical inferences. In: ACL\u201918. Short papers, vol 2, pp 650\u2013655. https:\/\/doi.org\/10.18653\/v1\/P18-2103","DOI":"10.18653\/v1\/P18-2103"},{"key":"714_CR14","doi-asserted-by":"publisher","unstructured":"Gorrell G, Aker A, Bontcheva K, Derczynski L, Kochkina E, Liakata M, Zubiaga A (2019) Semeval-2019 task 7: Rumoureval, determining rumour veracity and support for rumours. In: SemEval-2019, pp 845\u2013854. https:\/\/doi.org\/10.18653\/v1\/S19-2147","DOI":"10.18653\/v1\/S19-2147"},{"key":"714_CR15","doi-asserted-by":"publisher","unstructured":"Habernal I, Wachsmuth H, Gurevych I, Stein B (2018) The argument reasoning comprehension task: identification and reconstruction of implicit warrants. In: NAACL\u201918, pp 1930\u20131940. https:\/\/doi.org\/10.18653\/v1\/N18-1175","DOI":"10.18653\/v1\/N18-1175"},{"key":"714_CR16","unstructured":"Hanselowski A, PVS A, Schiller B, Caspelherr F, Chaudhuri D, Meyer CM, Gurevych I (2018) A retrospective analysis of the fake news challenge stance-detection task. In: COLING\u201918. pp 1859\u20131874. https:\/\/www.aclweb.org\/anthology\/C18-1158. Accessed 10 Mar 2021"},{"key":"714_CR17","doi-asserted-by":"publisher","unstructured":"Hanselowski A, Stab C, Schulz C, Li Z, Gurevych I (2019) A richly annotated corpus for different tasks in automated fact-checking. In: CoNLL\u201919, pp 493\u2013503. https:\/\/doi.org\/10.18653\/v1\/K19-1046","DOI":"10.18653\/v1\/K19-1046"},{"key":"714_CR18","unstructured":"Hasan KS, Ng V (2013) Stance classification of ideological debates: data, models, features, and constraints. In: IJCNLP\u201913, pp 1348\u20131356. https:\/\/www.aclweb.org\/anthology\/I13-1191. Accessed 10 Mar 2021"},{"key":"714_CR19","doi-asserted-by":"crossref","unstructured":"Isabelle P, Cherry C, Foster G (2017) A challenge set approach to evaluating machine translation. arXiv preprint arXiv:170407431","DOI":"10.18653\/v1\/D17-1263"},{"key":"714_CR20","unstructured":"Jiang Y (2019) Using machine learning for stance detection. Master\u2019s thesis, The University of Texas at Austin. https:\/\/repositories.lib.utexas.edu\/handle\/2152\/72801. Accessed 10 Mar 2021"},{"key":"714_CR21","doi-asserted-by":"crossref","unstructured":"Kincaid JP, Fishburne RP Jr, Rogers RL, Chissom BS (1975) Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. University of Central Florida, Institute for Simulation and Training. 56. https:\/\/stars.library.ucf.edu\/istlibrary\/56. Accessed 10 Mar 2021","DOI":"10.21236\/ADA006655"},{"key":"714_CR22","unstructured":"Kingma DP, Ba J (2017) Adam: a method for stochastic optimization. arXiv:1412.6980"},{"key":"714_CR23","doi-asserted-by":"publisher","unstructured":"Klein G, Kim Y, Deng Y, Senellart J, Rush AM (2017) OpenNMT: open-source toolkit for neural machine translation. In: ACL\u201917. pp 67\u201372. https:\/\/doi.org\/10.18653\/v1\/P17-4012","DOI":"10.18653\/v1\/P17-4012"},{"key":"714_CR24","doi-asserted-by":"crossref","unstructured":"Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159\u2013174. http:\/\/www.jstor.org\/stable\/2529310. Accessed 10 Mar 2021","DOI":"10.2307\/2529310"},{"key":"714_CR25","doi-asserted-by":"publisher","unstructured":"Liu X, Shen Y, Duh K, Gao J (2018) Stochastic answer networks for machine reading comprehension. In: ACL\u201918, Volume 1: long papers, pp 1694\u20131704. https:\/\/doi.org\/10.18653\/v1\/P18-1157","DOI":"10.18653\/v1\/P18-1157"},{"key":"714_CR26","doi-asserted-by":"publisher","unstructured":"Liu X, He P, Chen W, Gao J (2019) Multi-task deep neural networks for natural language understanding. In: ACL\u201919, pp 4487\u20134496. https:\/\/doi.org\/10.18653\/v1\/P19-1441","DOI":"10.18653\/v1\/P19-1441"},{"key":"714_CR27","doi-asserted-by":"publisher","unstructured":"Mahler T, Cheung W, Elsner M, King D, de\u00a0Marneffe MC, Shain C, Stevens-Guille S, White M (2017) Breaking NLP: using morphosyntax, semantics, pragmatics and world knowledge to fool sentiment analysis systems. EMNLP\u201917, pp 33\u201339. https:\/\/doi.org\/10.18653\/v1\/W17-5405","DOI":"10.18653\/v1\/W17-5405"},{"key":"714_CR28","doi-asserted-by":"crossref","unstructured":"Mallinson J, Sennrich R, Lapata M (2017) Paraphrasing revisited with neural machine translation. In: EACL\u201917, pp 881\u2013893. https:\/\/www.aclweb.org\/anthology\/E17-1083. Accessed 10 Mar 2021","DOI":"10.18653\/v1\/E17-1083"},{"key":"714_CR29","doi-asserted-by":"publisher","unstructured":"Minervini P, Riedel S (2018) Adversarially regularising neural nli models to integrate logical background knowledge. In: CoNLL\u201918, pp 65\u201374. https:\/\/doi.org\/10.18653\/v1\/K18-1007","DOI":"10.18653\/v1\/K18-1007"},{"key":"714_CR30","doi-asserted-by":"publisher","unstructured":"Mohammad S, Kiritchenko S, Sobhani P, Zhu X, Cherry C (2016) Semeval-2016 task 6: detecting stance in tweets. In: SemEval-2016, pp 31\u201341. https:\/\/doi.org\/10.18653\/v1\/S16-1003","DOI":"10.18653\/v1\/S16-1003"},{"key":"714_CR31","unstructured":"Naik A, Ravichander A, Sadeh N, Rose C, Neubig G (2018) Stress test evaluation for natural language inference. In: COLING\u201918. pp 2340\u20132353. https:\/\/www.aclweb.org\/anthology\/C18-1198. Accessed 10 Mar 2021"},{"key":"714_CR32","doi-asserted-by":"publisher","unstructured":"Niven T, Kao HY (2019) Probing neural network comprehension of natural language arguments. In: ACL\u201919. pp 4658\u20134664. https:\/\/doi.org\/10.18653\/v1\/P19-1459","DOI":"10.18653\/v1\/P19-1459"},{"key":"714_CR33","unstructured":"Pomerleau D, Rao D (2017) The fake news challenge: exploring how artificial intelligence technologies could be leveraged to combat fake news. http:\/\/www.fakenewschallenge.org\/. Accessed 06 Jan 2020"},{"key":"714_CR34","doi-asserted-by":"publisher","unstructured":"Popat K, Mukherjee S, Str\u00f6tgen J, Weikum G (2017) Where the truth lies: explaining the credibility of emerging claims on the web and social media. In: WWW\u201917, pp 1003\u20131012. https:\/\/doi.org\/10.1145\/3041021.3055133","DOI":"10.1145\/3041021.3055133"},{"key":"714_CR35","doi-asserted-by":"publisher","unstructured":"Popat K, Mukherjee S, Yates A, Weikum G (2019) STANCY: stance classification based on consistency cues. In: EMNLP-IJCNLP\u201919, pp 6412\u20136417. https:\/\/doi.org\/10.18653\/v1\/D19-1675","DOI":"10.18653\/v1\/D19-1675"},{"key":"714_CR36","doi-asserted-by":"publisher","unstructured":"Pruthi D, Dhingra B, Lipton ZC (2019) Combating adversarial misspellings with robust word recognition. In: ACL\u201919, pp 5582\u20135591. https:\/\/doi.org\/10.18653\/v1\/P19-1561","DOI":"10.18653\/v1\/P19-1561"},{"key":"714_CR37","unstructured":"Ruder S (2017) An overview of multi-task learning in deep neural networks. arXiv preprint arXiv:170605098"},{"key":"714_CR38","doi-asserted-by":"publisher","unstructured":"Schulz C, Eger S, Daxenberger J, Kahse T, Gurevych I (2018) Multi-task learning for argumentation mining in low-resource settings. In: NAACL\u201918, pp 35\u201341. https:\/\/doi.org\/10.18653\/v1\/N18-2006","DOI":"10.18653\/v1\/N18-2006"},{"key":"714_CR39","doi-asserted-by":"publisher","unstructured":"Sirrianni J, Liu X, Adams D (2020) Agreement prediction of arguments in cyber argumentation for detecting stance polarity and intensity. In: ACL\u201920, Online, pp 5746\u20135758. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.509","DOI":"10.18653\/v1\/2020.acl-main.509"},{"key":"714_CR40","doi-asserted-by":"crossref","unstructured":"Sobhani P, Inkpen D, Zhu X (2017) A dataset for multi-target stance detection. In: EACL\u201917. pp 551\u2013557. https:\/\/www.aclweb.org\/anthology\/E17-2088. Accessed 10 Mar 2021","DOI":"10.18653\/v1\/E17-2088"},{"key":"714_CR41","unstructured":"Somasundaran S, Wiebe J (2010) Recognizing stances in ideological on-line debates. In: NAACL-HLT\u201910, pp 116\u2013124. https:\/\/www.aclweb.org\/anthology\/W10-0214. Accessed 10 Mar 2021"},{"key":"714_CR42","doi-asserted-by":"publisher","unstructured":"Stab C, Miller T, Schiller B, Rai P, Gurevych I (2018) Cross-topic argument mining from heterogeneous sources. In: EMNLP\u201918, pp 3664\u20133674. https:\/\/doi.org\/10.18653\/v1\/D18-1402","DOI":"10.18653\/v1\/D18-1402"},{"key":"714_CR43","doi-asserted-by":"crossref","unstructured":"Thomas M, Pang B, Lee L (2006) Get out the vote: Determining support or opposition from congressional floor-debate transcripts. In: EMNLP\u201906, pp 327\u2013335. https:\/\/www.aclweb.org\/anthology\/W06-1639. Accessed 10 Mar 2021","DOI":"10.3115\/1610075.1610122"},{"key":"714_CR44","doi-asserted-by":"publisher","unstructured":"Thorne J, Vlachos A, Christodoulopoulos C, Mittal A (2019) Evaluating adversarial attacks against multiple fact verification systems. In: EMNLP-IJCNLP\u201919. pp 2944\u20132953. https:\/\/doi.org\/10.18653\/v1\/D19-1292","DOI":"10.18653\/v1\/D19-1292"},{"issue":"4","key":"714_CR45","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1016\/j.dss.2012.05.032","volume":"53","author":"MA Walker","year":"2012","unstructured":"Walker MA, Anand P, Abbott R, Tree JEF, Martell C, King J (2012a) That is your evidence? Classifying stance in online political debate. Decis Support Syst 53(4):719\u2013729. https:\/\/doi.org\/10.1016\/j.dss.2012.05.032","journal-title":"Decis Support Syst"},{"key":"714_CR46","unstructured":"Walker MA, Tree JEF, Anand P, Abbott R, King J (2012b) A corpus for research on deliberation and debate. In: LREC\u201912, pp 812\u2013817. https:\/\/www.aclweb.org\/anthology\/L12-1643\/. Accessed 10 Mar 2021"},{"key":"714_CR47","doi-asserted-by":"publisher","unstructured":"Wang A, Singh A, Michael J, Hill F, Levy O, Bowman S (2018) GLUE: a multi-task benchmark and analysis platform for natural language understanding. In: EMNLP\u201918 Workshop BlackboxNLP. pp 353\u2013355. https:\/\/doi.org\/10.18653\/v1\/W18-5446","DOI":"10.18653\/v1\/W18-5446"},{"key":"714_CR48","unstructured":"Wang D, Li C, Wen S, Xiang Y, Zhou W, Nepal S (2018) Defensive collaborative multi-task training-defending against adversarial attack towards deep neural networks. arXiv preprint arXiv:180305123"},{"key":"714_CR49","doi-asserted-by":"publisher","unstructured":"Wang Y, Bansal M (2018) Robust machine comprehension models via adversarial training. In: NAACL\u201918, pp 575\u2013581. https:\/\/doi.org\/10.18653\/v1\/N18-2091","DOI":"10.18653\/v1\/N18-2091"},{"key":"714_CR50","doi-asserted-by":"publisher","unstructured":"Wei P, Mao W, Zeng D (2018) A target-guided neural memory model for stance detection in twitter. In: IJCNN\u201918, pp 1\u20138. https:\/\/doi.org\/10.1109\/IJCNN.2018.8489665","DOI":"10.1109\/IJCNN.2018.8489665"},{"issue":"1","key":"714_CR51","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1186\/s40537-016-0043-6","volume":"3","author":"K Weiss","year":"2016","unstructured":"Weiss K, Khoshgoftaar TM, Wang D (2016) A survey of transfer learning. J Big Data 3(1):9. https:\/\/doi.org\/10.1186\/s40537-016-0043-6","journal-title":"J Big Data"},{"key":"714_CR52","unstructured":"Wu Y, Schuster M, Chen Z, Le QV, Norouzi M, Macherey W, Krikun M, Cao Y, Gao Q, Macherey K, et\u00a0al. (2016) Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint arXiv:160908144"},{"key":"714_CR53","doi-asserted-by":"publisher","unstructured":"Yang R, Xie W, Liu C, Yu D (2019) BLCU$$_{-}$$NLP at SemEval-2019 task 7: An inference chain-based GPT model for rumour evaluation. In: SemEval-2019, pp 1090\u20131096. https:\/\/doi.org\/10.18653\/v1\/S19-2191","DOI":"10.18653\/v1\/S19-2191"},{"key":"714_CR54","doi-asserted-by":"publisher","unstructured":"Zhang Q, Yilmaz E, Liang S (2018) Ranking-based method for news stance detection. In: WWW\u201918, pp 41\u201342. https:\/\/doi.org\/10.1145\/3184558.3186919","DOI":"10.1145\/3184558.3186919"},{"issue":"2","key":"714_CR55","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/j.ipm.2017.11.009","volume":"54","author":"A Zubiaga","year":"2018","unstructured":"Zubiaga A, Kochkina E, Liakata M, Procter R, Lukasik M, Bontcheva K, Cohn T, Augenstein I (2018) Discourse-aware rumour stance classification in social media using sequential classifiers. Inf Process Manag 54(2):273\u2013290. https:\/\/doi.org\/10.1016\/j.ipm.2017.11.009","journal-title":"Inf Process Manag"}],"container-title":["KI - K\u00fcnstliche Intelligenz"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13218-021-00714-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13218-021-00714-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13218-021-00714-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T08:26:58Z","timestamp":1636964818000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13218-021-00714-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,26]]},"references-count":55,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2021,11]]}},"alternative-id":["714"],"URL":"https:\/\/doi.org\/10.1007\/s13218-021-00714-w","relation":{},"ISSN":["0933-1875","1610-1987"],"issn-type":[{"value":"0933-1875","type":"print"},{"value":"1610-1987","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,26]]},"assertion":[{"value":"25 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}