{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:22:54Z","timestamp":1777890174492,"version":"3.51.4"},"reference-count":50,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MGS"],"published-print":{"date-parts":[[2023,6,8]]},"abstract":"<jats:p>Multi-agent systems are proposed as a solution to mitigate nowadays software requirements: open and distributed architectures with dynamic and adaptive behaviour. Like any other software, multi-agent systems development process is error-prone; thus testing is a key activity to ensure the quality of the developed product. This paper sheds light on agent testing as it is the primary artefact for any multi-agent system\u2019s testing process. A framework called JADE Testing Framework (JTF) for JADE platform\u2019s agent testing is proposed. JTF allows testing agents at two levels: unit (inner-components) and agent (agent interactions) levels. JTF is the result of the integration of two testing solutions: JAT a well-known framework for JADE\u2019s agent\u2019s interaction testing and UJade, a new solution that was developed for agent\u2019s unit testing. UJade provides also a toolbox that allows for enhancing JAT capabilities. The evidence of JTF usability and effectiveness in JADE agent testing was supported by an empirical study conducted on seven multi-agent systems. The results of the study show that: when an agent\u2019s code can be tested either at agent or unit levels UJade is less test\u2019s effort consuming than JAT; JTF provides better testing capabilities and the developed tests are more effective than those developed using UJade or JAT alone.<\/jats:p>","DOI":"10.3233\/mgs-230023","type":"journal-article","created":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T13:28:03Z","timestamp":1685712483000},"page":"61-98","source":"Crossref","is-referenced-by-count":2,"title":["A testing framework for JADE agent-based software"],"prefix":"10.1177","volume":"19","author":[{"given":"Ayyoub","family":"Kalache","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Rela(CS)2 Laboratory, University of Oum El Bouaghi, Algeria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mourad","family":"Badri","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Software Engineering Research Laboratory, University of Quebec at Trois-Rivi\u00e8res, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Farid","family":"Mokhati","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Rela(CS)2 Laboratory, University of Oum El Bouaghi, Algeria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamed Chaouki","family":"Babahenini","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, LESIA Laboratory, University of Mohamed Khider, Biskra, Algeria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/MGS-230023_ref1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36546-1_45"},{"issue":"5","key":"10.3233\/MGS-230023_ref2","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1007\/s10489-017-1112-z","article-title":"Agent systems verification: Systematic literature review and mapping","volume":"48","author":"Bakar","year":"2018","journal-title":"Appl. Intell."},{"key":"10.3233\/MGS-230023_ref4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29216-3_42"},{"key":"10.3233\/MGS-230023_ref5","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.1016\/j.future.2020.06.049","article-title":"A systematic map on verification and validation of emergent behavior in software engineering research","volume":"112","author":"Brings","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"10.3233\/MGS-230023_ref6","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10422-5_10"},{"issue":"9","key":"10.3233\/MGS-230023_ref7","doi-asserted-by":"publisher","first-page":"1219","DOI":"10.1016\/j.jss.2006.02.036","article-title":"An empirical study into class testability","volume":"79","author":"Bruntink","year":"2006","journal-title":"J. Syst. Softw."},{"issue":"2","key":"10.3233\/MGS-230023_ref10","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1007\/s10796-013-9438-5","article-title":"Beast methodology: An agile testing methodology for multi-agent systems based on behaviour driven development","volume":"16","author":"Carrera","year":"2014","journal-title":"Inf. Syst. Front."},{"key":"10.3233\/MGS-230023_ref11","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.61"},{"key":"10.3233\/MGS-230023_ref12","doi-asserted-by":"publisher","DOI":"10.1109\/IAT.2004.1342998"},{"key":"10.3233\/MGS-230023_ref13","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2007.4362655"},{"key":"10.3233\/MGS-230023_ref14","doi-asserted-by":"publisher","DOI":"10.1145\/1138063.1138079"},{"key":"10.3233\/MGS-230023_ref15","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2948707"},{"key":"10.3233\/MGS-230023_ref18","doi-asserted-by":"publisher","DOI":"10.1109\/WI-IAT.2015.121"},{"key":"10.3233\/MGS-230023_ref19","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/j.engappai.2015.09.013","article-title":"Testing HMAS-based applications: An ASPECS-based approach","volume":"46","author":"Dehimi","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"issue":"4","key":"10.3233\/MGS-230023_ref20","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/C-M.1978.218136","article-title":"Hints on test data selection: Help for the practicing programmer","volume":"11","author":"DeMillo","year":"1978","journal-title":"Computer"},{"issue":"8","key":"10.3233\/MGS-230023_ref21","doi-asserted-by":"publisher","first-page":"74","DOI":"10.4230\/DagRep.2.8.74","article-title":"Engineering Multi-Agent Systems (Dagstuhl Seminar 12342)","volume":"2","author":"Dix","year":"2012","journal-title":"Dagstuhl Rep."},{"key":"10.3233\/MGS-230023_ref22","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338945"},{"issue":"3","key":"10.3233\/MGS-230023_ref23","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1016\/S0164-1212(96)00154-9","article-title":"All-uses vs mutation testing: An experimental comparison of effectiveness","volume":"38","author":"Frankl","year":"1997","journal-title":"J. Syst. Softw."},{"key":"10.3233\/MGS-230023_ref24","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-27813-9_41"},{"key":"10.3233\/MGS-230023_ref25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01338-6_15"},{"key":"10.3233\/MGS-230023_ref27","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2948707"},{"key":"10.3233\/MGS-230023_ref28","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568271"},{"key":"10.3233\/MGS-230023_ref29","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635929"},{"key":"10.3233\/MGS-230023_ref30","doi-asserted-by":"crossref","unstructured":"G. Kiczales, E. Hilsdale, J. Hugunin, M. Kersten, J. Palm and W.G. Griswold, An Overview of AspectJ, in: Proceedings of the 15th European Conference on Object-Oriented Programming, Berlin, Heidelberg, 2001, pp. 327\u2013353.","DOI":"10.1007\/3-540-45337-7_18"},{"issue":"4","key":"10.3233\/MGS-230023_ref31","doi-asserted-by":"publisher","first-page":"2426","DOI":"10.1007\/s10664-017-9582-5","article-title":"How effective are mutation testing tools? An empirical analysis of Java mutation testing tools with manual analysis and real faults","volume":"23","author":"Kintis","year":"2018","journal-title":"Empir. Softw. Eng."},{"issue":"1","key":"10.3233\/MGS-230023_ref32","doi-asserted-by":"publisher","first-page":"11","DOI":"10.18564\/jasss.2661","article-title":"A survey of agent platforms","volume":"18","author":"Kravari","year":"2015","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"10.3233\/MGS-230023_ref33","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3381749"},{"key":"10.3233\/MGS-230023_ref34","doi-asserted-by":"publisher","DOI":"10.1109\/QUATIC.2018.00036"},{"issue":"3","key":"10.3233\/MGS-230023_ref35","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1007\/s11219-020-09507-0","article-title":"Two experiments for evaluating the impact of Hamcrest and AssertJ on assertion development","volume":"28","author":"Leotta","year":"2020","journal-title":"Softw. Qual. J."},{"key":"10.3233\/MGS-230023_ref36","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-29238-6_12"},{"issue":"1","key":"10.3233\/MGS-230023_ref37","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/s10009-015-0378-x","article-title":"MCMAS: An open-source model checker for the verification of multi-agent systems","volume":"19","author":"Lomuscio","year":"2017","journal-title":"Int. J. Softw. Tools Technol. Transf."},{"key":"10.3233\/MGS-230023_ref38","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02658-4_55"},{"key":"10.3233\/MGS-230023_ref39","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635920"},{"issue":"1","key":"10.3233\/MGS-230023_ref40","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1145\/3310013.3322175","article-title":"Engineering multi-agent systems: State of affairs and the road ahead","volume":"44","author":"Mascardi","year":"2019","journal-title":"ACM SIGSOFT Softw. Eng. Notes"},{"key":"10.3233\/MGS-230023_ref41","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-59140-581-8.ch004"},{"key":"10.3233\/MGS-230023_ref42","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233837"},{"key":"10.3233\/MGS-230023_ref44","doi-asserted-by":"publisher","first-page":"204256","DOI":"10.1109\/ACCESS.2020.3036668","article-title":"A metadata-driven approach for testing self-organizing multiagent systems","volume":"8","author":"Nascimento","year":"2020","journal-title":"IEEE Access"},{"key":"10.3233\/MGS-230023_ref45","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-19208-1_13"},{"key":"10.3233\/MGS-230023_ref46","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-79488-2_5"},{"issue":"3","key":"10.3233\/MGS-230023_ref48","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1007\/s10458-008-9050-0","article-title":"Industrial deployment of multi-agent technologies: Review and selected case studies","volume":"17","author":"P\u011bchou\u010dek","year":"2008","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"10.3233\/MGS-230023_ref49","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(90)90057-I"},{"key":"10.3233\/MGS-230023_ref50","doi-asserted-by":"publisher","DOI":"10.1109\/AFIPS.1978.195"},{"issue":"2","key":"10.3233\/MGS-230023_ref51","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1111\/itor.12054","article-title":"PriEsT: An interactive decision support tool to estimate priorities from pairwise comparison judgments: PriEsT: An interactive decision support tool to estimate priorities from pairwise comparison judgments","volume":"22","author":"Siraj","year":"2015","journal-title":"Int. Trans. Oper. Res."},{"key":"10.3233\/MGS-230023_ref52","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70945-9_10"},{"key":"10.3233\/MGS-230023_ref53","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3240474"},{"key":"10.3233\/MGS-230023_ref54","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2012.24"},{"key":"10.3233\/MGS-230023_ref57","doi-asserted-by":"publisher","DOI":"10.1145\/544862.544965"},{"key":"10.3233\/MGS-230023_ref58","doi-asserted-by":"publisher","DOI":"10.1109\/CSCWD49262.2021.9437643"},{"issue":"9","key":"10.3233\/MGS-230023_ref59","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1109\/TSE.2018.2809496","article-title":"Predictive mutation testing","volume":"45","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Softw. Eng."},{"key":"10.3233\/MGS-230023_ref60","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-19208-1_5"}],"container-title":["Multiagent and Grid Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/MGS-230023","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:29:09Z","timestamp":1777613349000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/MGS-230023"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,8]]},"references-count":50,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/mgs-230023","relation":{},"ISSN":["1875-9076","1574-1702"],"issn-type":[{"value":"1875-9076","type":"electronic"},{"value":"1574-1702","type":"print"}],"subject":[],"published":{"date-parts":[[2023,6,8]]}}}