{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T06:36:59Z","timestamp":1778049419168,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2019,9,1]],"date-time":"2019-09-01T00:00:00Z","timestamp":1567296000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Argument &amp; Computation"],"published-print":{"date-parts":[[2019,9,2]]},"abstract":"<jats:p>In this paper, we provide an overview of the benchmarks that have been recently employed in Abstract Argumentation. We first describe the benchmark suite from previous editions of the International Competition of Computational Models of Argumentation (ICCMA), and then briefly describe the benchmarks for non-Dung frameworks. This article is a contribution to the new Argument &amp; Computation Community Resources (ACCR) corner.<\/jats:p>","DOI":"10.3233\/aac-192101","type":"journal-article","created":{"date-parts":[[2019,8,2]],"date-time":"2019-08-02T12:16:48Z","timestamp":1564748208000},"page":"107-112","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Assessment of benchmarks for abstract argumentation"],"prefix":"10.1177","volume":"10","author":[{"given":"Jean-Guy","family":"Mailly","sequence":"first","affiliation":[{"name":"LIPADE, Universit\u00e9 de Paris, France. E-mail:\u00a0"}]},{"given":"Marco","family":"Maratea","sequence":"additional","affiliation":[{"name":"DIBRIS, Universit\u00e0 di Genova, Italy. E-mail:\u00a0"}]}],"member":"179","published-online":{"date-parts":[[2019,9,1]]},"reference":[{"key":"ref001","doi-asserted-by":"crossref","unstructured":"G.\u00a0Alfano, S.\u00a0Greco and F.\u00a0Parisi, Efficient computation of extensions for dynamic abstract argumentation frameworks: An incremental approach, in: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI 2017), Melbourne, Australia, August 19\u201325, 2017, pp.\u00a049\u201355. doi:10.24963\/ijcai.2017\/8.","DOI":"10.24963\/ijcai.2017\/8"},{"key":"ref002","unstructured":"G.\u00a0Alfano, S.\u00a0Greco and F.\u00a0Parisi, Computing stable and preferred extensions of dynamic bipolar argumentation frameworks, in:\n                      Proceedings of the 1st Workshop on Advances in Argumentation in Artificial Intelligence Co-Located with XVI International Conference of the Italian Association for Artificial Intelligence, AI\n                      \n                        3\n                      \n                      @AI*IA 2017\n                      , Bari, Italy, November 16\u201317, 2017, pp.\u00a028\u201342."},{"key":"ref003","doi-asserted-by":"crossref","unstructured":"G.\u00a0Alfano, S.\u00a0Greco and F.\u00a0Parisi, Computing extensions of dynamic abstract argumentation frameworks with second-order attacks, in: Proceedings of the 22nd International Database Engineering & Applications Symposium (IDEAS 2018), Villa San Giovanni, Italy, June 18\u201320, 2018, pp.\u00a0183\u2013192. doi:10.1145\/3216122.3216162.","DOI":"10.1145\/3216122.3216162"},{"key":"ref004","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2008.11.006"},{"key":"ref005","doi-asserted-by":"crossref","unstructured":"T.\u00a0Balyo, M.J.H.\u00a0Heule and M.\u00a0J\u00e4rvisalo, SAT competition 2016: Recent developments, in: Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI 2017), San Francisco, California, USA, February 4\u20139, 2017, AAAI Press, 2017, pp.\u00a05061\u20135063.","DOI":"10.1609\/aaai.v31i1.10641"},{"key":"ref006","doi-asserted-by":"publisher","DOI":"10.1126\/science.286.5439.509"},{"key":"ref007","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-98197-0_18"},{"key":"ref008","doi-asserted-by":"crossref","unstructured":"P.\u00a0Besnard and A.\u00a0Hunter, Elements of Argumentation, MIT Press, 2008, http:\/\/mitpress.mit.edu\/books\/elements-argumentation. ISBN 978-0-262-02643-7.","DOI":"10.7551\/mitpress\/9780262026437.001.0001"},{"key":"ref009","doi-asserted-by":"publisher","DOI":"10.1093\/logcom\/exx031"},{"key":"ref010","doi-asserted-by":"crossref","unstructured":"G.\u00a0Brewka, M.\u00a0Diller, G.\u00a0Heissenberger, T.\u00a0Linsbichler and S.\u00a0Woltran, Solving advanced argumentation problems with answer-set programming, in: Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI 2017), AAAI Press, 2017, pp.\u00a01077\u20131083.","DOI":"10.1609\/aaai.v31i1.10682"},{"key":"ref011","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2015.09.008"},{"key":"ref012","unstructured":"M.\u00a0Caminada, Strong admissibility revisited, in: Proceedings of the 5th International Conference on Computational Models of Argument (COMMA 2014), S.\u00a0Parsons, N.\u00a0Oren, C.\u00a0Reed and F.\u00a0Cerutti, eds, Frontiers in Artificial Intelligence and Applications, Vol.\u00a0266, IOS Press, 2014, pp.\u00a0197\u2013208."},{"key":"ref013","unstructured":"M.W.A.\u00a0Caminada and B.\u00a0Verheij, On the existence of semi-stable extensions, in: Proceedings of the 22nd Benelux Conference on Artificial Intelligence (BNAIC 2010), G.\u00a0Danoy, M.\u00a0Seredynski, R.\u00a0Booth, B.\u00a0Gateau, I.\u00a0Jars and D.\u00a0Khadraoui, eds, 2010, http:\/\/bnaic2010.uni.lu\/proceedings.html."},{"key":"ref014","unstructured":"F.\u00a0Cerutti, M.\u00a0Giacomin and M.\u00a0Vallati, Generating structured argumentation frameworks: AFBenchGen2, in: Proceedings of the 6th International Conference on Computational Models of Argument (COMMA 2016), P.\u00a0Baroni, T.F.\u00a0Gordon, T.\u00a0Scheffler and M.\u00a0Stede, eds, Frontiers in Artificial Intelligence and Applications, Vol.\u00a0287, IOS Press, 2016, pp.\u00a0467\u2013468."},{"key":"ref015","unstructured":"F.\u00a0Cerutti, N.\u00a0Oren, H.\u00a0Strass, M.\u00a0Thimm and M.\u00a0Vallati, A benchmark framework for a computational argumentation competition, in: Proceedings of the 5th International Conference on Computational Models of Argument (COMMA 2014), S.\u00a0Parsons, N.\u00a0Oren, C.\u00a0Reed and F.\u00a0Cerutti, eds, Frontiers in Artificial Intelligence and Applications, Vol.\u00a0266, IOS Press, 2014, pp.\u00a0459\u2013460."},{"key":"ref016","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2015.12.004"},{"key":"ref017","unstructured":"Y.\u00a0Dimopoulos, J.\u00a0Mailly and P.\u00a0Moraitis, Argumentation-based negotiation with incomplete opponent profiles, in: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS 2019), Montreal, QC, Canada, May 13\u201317, 2019, pp.\u00a01252\u20131260."},{"key":"ref018","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(94)00041-X"},{"key":"ref019","doi-asserted-by":"publisher","DOI":"10.5486\/PMD.1959.6.3-4.12"},{"key":"ref020","unstructured":"S.A.\u00a0Gaggl, T.\u00a0Linsbichler, M.\u00a0Maratea and S.\u00a0Woltran, Introducing the second international competition on computational models of argumentation, in: Proceedings of the First International Workshop on Systems and Algorithms for Formal Argumentation (SAFA 2016), M.\u00a0Thimm, F.\u00a0Cerutti, H.\u00a0Strass and M.\u00a0Vallati, eds, CEUR Workshop Proceedings, Vol.\u00a01672, CEUR-WS.org, 2016, pp.\u00a04\u20139."},{"issue":"4","key":"ref021","first-page":"77","volume":"39","author":"Gaggl S.A.","year":"2019","journal-title":"AI Magazine"},{"key":"ref022","doi-asserted-by":"publisher","DOI":"10.1613\/jair.5373"},{"key":"ref023","doi-asserted-by":"crossref","unstructured":"T.\u00a0Lehtonen, J.P.\u00a0Wallner and M.\u00a0Jarvisalo, From structured to abstract argumentation: Assumption-based acceptance via AF reasoning, in: Proceedings of the 14th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU 2017), A.\u00a0Antonucci, L.\u00a0Cholvy and O.\u00a0Papini, eds, Lecture Notes in Computer Science, Vol.\u00a010369, Springer, 2017, pp.\u00a057\u201368. doi:10.1007\/978-3-319-61581-3_6.","DOI":"10.1007\/978-3-319-61581-3_6"},{"key":"ref024","doi-asserted-by":"crossref","unstructured":"T.\u00a0Lehtonen, J.P.\u00a0Wallner and M.\u00a0J\u00e4rvisalo, Reasoning over assumption-based argumentation frameworks via direct answer set programming encodings, in: Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI 2019), Honolulu, Hawaii, USA, Jan 27\u2013Feb 1, AAAI Press, 2019.","DOI":"10.1609\/aaai.v33i01.33012938"},{"key":"ref025","doi-asserted-by":"crossref","unstructured":"T.\u00a0Linsbichler, M.\u00a0Maratea, A.\u00a0Niskanen, J.P.\u00a0Wallner and S.\u00a0Woltran, Novel algorithms for abstract dialectical frameworks based on complexity analysis of subclasses and SAT solving, in: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI 2018), J.Lang, ed. ijcai.org, 2018, pp.\u00a01905\u20131911. doi:10.24963\/ijcai.2018\/263.","DOI":"10.24963\/ijcai.2018\/263"},{"key":"ref026","doi-asserted-by":"crossref","unstructured":"P.\u00a0McBurney, S.\u00a0Parsons and I.\u00a0Rahwan, 8th International Workshop on Argumentation in Multi-Agent Systems (ArgMAS 2011), Taipei, Taiwan, May 3, 2011, Revised Selected Papers. Lecture Notes in Computer Science, Vol. 7543, Springer, 2012. ISBN 978-3-642-33151-0. doi:10.1007\/978-3-642-33152-7.","DOI":"10.1007\/978-3-642-33152-7"},{"key":"ref027","doi-asserted-by":"crossref","unstructured":"A.\u00a0Sideris and Y.\u00a0Dimopoulos, Constraint propagation in propositional planning, in: Proceedings of the 20th International Conference on Automated Planning and Scheduling (ICAPS 2010), R.I.\u00a0Brafman, H.\u00a0Geffner, J.\u00a0Hoffmann and H.A.\u00a0Kautz, eds, AAAI, 2010, pp.\u00a0153\u2013160.","DOI":"10.1609\/icaps.v20i1.13422"},{"key":"ref028","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2017.08.006"},{"key":"ref029","doi-asserted-by":"publisher","DOI":"10.1080\/19462166.2013.869878"},{"key":"ref030","doi-asserted-by":"publisher","DOI":"10.1038\/30918"},{"key":"ref031","doi-asserted-by":"publisher","DOI":"10.1080\/19462166.2014.1002535"},{"key":"ref032","unstructured":"B.\u00a0Yun, M.\u00a0Croitoru, S.\u00a0Vesic and P.\u00a0Bisquert, DAGGER: Datalog+\/- argumentation graph generator, in: Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS 2018), Stockholm, Sweden, July 10\u201315, 2018, pp.\u00a01841\u20131843."},{"key":"ref033","unstructured":"B.\u00a0Yun, M.\u00a0Croitoru, S.\u00a0Vesic and P.\u00a0Bisquert, NAKED:\n                      n\n                      -ary graphs from knowledge bases expressed in datalog\u00b1, in: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS 2019), Montreal, QC, Canada, May 13\u201317, 2019, pp.\u00a02390\u20132392."},{"key":"ref034","unstructured":"B.\u00a0Yun, S.\u00a0Vesic and M.\u00a0Croitoru, Toward a more efficient generation of structured argumentation graphs, in: Proceedings of the 7th International Conference on Computational Models of Argument (COMMA 2018), Warsaw, Poland, 12\u201314 September 2018, Frontiers in Artificial Intelligence and Applications, Vol.\u00a0305, IOS Press, 2018, pp.\u00a0205\u2013212."}],"container-title":["Argument &amp; Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/AAC-192101","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/AAC-192101","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/AAC-192101","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T11:53:10Z","timestamp":1777377190000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/AAC-192101"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,1]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,9,2]]}},"alternative-id":["10.3233\/AAC-192101"],"URL":"https:\/\/doi.org\/10.3233\/aac-192101","relation":{},"ISSN":["1946-2166","1946-2174"],"issn-type":[{"value":"1946-2166","type":"print"},{"value":"1946-2174","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,1]]}}}