{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T23:45:09Z","timestamp":1771026309161,"version":"3.50.1"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"3-4","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Auton. Adapt. Syst."],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>Hierarchical Multi-agent Systems provide convenient and relevant ways to analyze, model, and simulate complex systems composed of a large number of entities that interact at different levels of abstraction. In this article, we introduce HAMLET (Hierarchical Agent-based Machine LEarning plaTform), a hybrid machine learning platform based on hierarchical multi-agent systems, to facilitate the research and democratization of geographically and\/or locally distributed machine learning entities. The proposed system models machine learning solutions as a hypergraph and autonomously sets up a multi-level structure of heterogeneous agents based on their innate capabilities and learned skills. HAMLET aids the design and management of machine learning systems and provides analytical capabilities for research communities to assess the existing and\/or new algorithms\/datasets through flexible and customizable queries. The proposed hybrid machine learning platform does not assume restrictions on the type of learning algorithms\/datasets and is theoretically proven to be sound and complete with polynomial computational requirements. Additionally, it is examined empirically on 120 training and 4 generalized batch testing tasks performed on 24 machine learning algorithms and 9 standard datasets. The provided experimental results not only establish confidence in the platform\u2019s consistency and correctness but also demonstrate its testing and analytical capacity.<\/jats:p>","DOI":"10.1145\/3530191","type":"journal-article","created":{"date-parts":[[2022,4,25]],"date-time":"2022-04-25T07:50:04Z","timestamp":1650873004000},"page":"1-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["HAMLET: A Hierarchical Agent-based Machine Learning Platform"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0612-2351","authenticated-orcid":false,"given":"Ahmad","family":"Esmaeili","sequence":"first","affiliation":[{"name":"Department of Computer and Information Technology, Purdue University, West Lafayette, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John C.","family":"Gallagher","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, OH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John A.","family":"Springer","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Technology, Purdue University, West Lafayette, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric T.","family":"Matson","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Technology, Purdue University, West Lafayette, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,6]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Scikit-learn API Reference. (n.d.). Retrieved April 1 2020 from https:\/\/scikit-learn.org\/stable\/modules\/classes.html\/."},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.5555\/789091.790420"},{"key":"e_1_3_3_4_2","first-page":"263","volume-title":"Proceedings of the International Conference on Innovative Techniques and Applications of Artificial Intelligence","author":"Albashiri Kamal Ali","year":"2008","unstructured":"Kamal Ali Albashiri, Frans Coenen, and Paul Leng. 2008. EMADS: An extendible multi-agent data miner. In Proceedings of the International Conference on Innovative Techniques and Applications of Artificial Intelligence. Springer, 263\u2013275."},{"issue":"4","key":"e_1_3_3_5_2","first-page":"369","article-title":"Cascading classifiers","volume":"34","author":"Alpaydin Ethem","year":"1998","unstructured":"Ethem Alpaydin and Cenk Kaynak. 1998. Cascading classifiers. Kybernetika 34, 4 (1998), 369\u2013374.","journal-title":"Kybernetika"},{"key":"e_1_3_3_6_2","first-page":"32","volume-title":"Proceedings of the International Workshop on Agent-oriented Software Engineering","author":"Argente Estefan\u00eda","year":"2009","unstructured":"Estefan\u00eda Argente, Vicent Botti, and Vicente Julian. 2009. GORMAS: An organizational-oriented methodological guideline for open MAS. In Proceedings of the International Workshop on Agent-oriented Software Engineering. Springer, 32\u201347."},{"key":"e_1_3_3_7_2","first-page":"507","volume-title":"The Economics of Artificial Intelligence: An Agenda","author":"Athey Susan","year":"2018","unstructured":"Susan Athey. 2018. The impact of machine learning on economics. In The Economics of Artificial Intelligence: An Agenda. University of Chicago Press, 507\u2013547."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/331532.331595"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.3053452"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-4470-8_38"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.5555\/3193939.3193942"},{"key":"e_1_3_3_12_2","volume-title":"Proceedings of the International Conference on the Practical Application of Intelligent Agents and Multi-agent Technology","author":"Burckert Hans Jurgen","year":"1998","unstructured":"Hans Jurgen Burckert, Klaus Fischer, and Gero Vierke. 1998. Transportation scheduling with holonic MAS: The TeleTruck approach. In Proceedings of the International Conference on the Practical Application of Intelligent Agents and Multi-agent Technology."},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2009.45"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-011-9187-0"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23181-0_13"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-009-9099-4"},{"key":"e_1_3_3_18_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-642-34097-0","volume-title":"Agent-based Optimization","author":"Czarnowski Ireneusz","year":"2013","unstructured":"Ireneusz Czarnowski and Piotr J\u0119drzejowicz. 2013. Machine learning and multiagent systems as interrelated technologies. In Agent-based Optimization. Springer, 1\u201328."},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1214\/009053604000000067"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-24209-1_4"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2016.06.011"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2016.12.001"},{"key":"e_1_3_3_23_2","first-page":"226","volume-title":"Proceedings of the Conference on Knowledge Discovery and Data Mining","author":"Ester Martin","year":"1996","unstructured":"Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, Xiaowei Xu, et\u00a0al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the Conference on Knowledge Discovery and Data Mining. 226\u2013231."},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.10.010"},{"key":"e_1_3_3_25_2","first-page":"625","volume-title":"Proceedings of the International Conference on Computer Science, Engineering and Education Applications","author":"Fedushko Solomia","year":"2019","unstructured":"Solomia Fedushko and Taras Ustyianovych. 2019. Predicting pupil\u2019s successfulness factors using machine learning algorithms and mathematical modelling methods. In Proceedings of the International Conference on Computer Science, Engineering and Education Applications. Springer, 625\u2013636."},{"key":"e_1_3_3_26_2","first-page":"2962","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems","author":"Feurer Matthias","year":"2015","unstructured":"Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Springenberg, Manuel Blum, and Frank Hutter. 2015. Efficient and robust automated machine learning. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 2962\u20132970."},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45185-3_7"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-1809.1936.tb02137.x"},{"key":"e_1_3_3_29_2","volume-title":"FIPA Abstract Architecture Specification","author":"Agents Foundation for Intelligent Physical","year":"2002","unstructured":"Foundation for Intelligent Physical Agents. 2002. FIPA Abstract Architecture Specification. Technical Report SC00001L. Foundation for Intelligent Physical Agents."},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1983.10478008"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1155\/2012\/850259"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2021.107630"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/IAT.2003.1241116"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/1160633.1160866"},{"key":"e_1_3_3_35_2","unstructured":"David Harrison Jr and Daniel L. Rubinfeld. 1978. Hedonic housing prices and the demand for clean air. (1978). https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/0095069678900062."},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44539-0_9"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/1342171.1342173"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1970.10488634"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1201\/b16023"},{"key":"e_1_3_3_41_2","first-page":"131","article-title":"Collective data mining: A new perspective toward distributed data mining","volume":"2","author":"Kargupta Hillol","year":"1999","unstructured":"Hillol Kargupta, B. Park, Daryl Hershberger, and Erik Johnson. 1999. Collective data mining: A new perspective toward distributed data mining. Adv. Distrib. Parallel Knowl. Discov. 2 (1999), 131\u2013174.","journal-title":"Adv. Distrib. Parallel Knowl. Discov."},{"key":"e_1_3_3_42_2","volume-title":"Web Based Parallel\/Distributed Medical Data Mining Using Software Agents","author":"Kargupta Hillol","year":"1997","unstructured":"Hillol Kargupta, Brian Stafford, and Ilker Hamzaoglu. 1997. Web Based Parallel\/Distributed Medical Data Mining Using Software Agents. Technical Report. Los Alamos National Lab., NM."},{"key":"e_1_3_3_43_2","volume-title":"Proc. High Performance Computing","author":"Kergupta H.","year":"1997","unstructured":"H. Kergupta, I. Hamzaoglu, and B. Stafford. 1997. Scalable, distributed data mining using an agent based architecture (PADMA). In Proc. High Performance Computing, Vol. 97. AAAI Press."},{"key":"e_1_3_3_44_2","unstructured":"Arthur Koestler. 1968. The ghost in the machine. Macmillan."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18082674"},{"key":"e_1_3_3_46_2","unstructured":"Kevin Bache and Moshe Lichman. UCI machine learning repository 2013. URL http:\/\/archive.ics.uci.edu\/ml."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10799-011-0091-8"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.3390\/fi11020049"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1080\/002075499190699"},{"key":"e_1_3_3_51_2","volume-title":"Machine Learning: A Probabilistic Perspective","author":"Murphy Kevin P.","year":"2012","unstructured":"Kevin P. Murphy. 2012. Machine Learning: A Probabilistic Perspective. The MIT Press."},{"key":"e_1_3_3_52_2","first-page":"78","volume-title":"Proceedings of the International Workshop on Agent-oriented Software Engineering","author":"Odell James","year":"2004","unstructured":"James Odell, Marian Nodine, and Renato Levy. 2004. A metamodel for agents, roles, and groups. In Proceedings of the International Workshop on Agent-oriented Software Engineering. Springer, 78\u201392."},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2001.925048"},{"issue":"4","key":"e_1_3_3_55_2","first-page":"3","article-title":"On designing and implementing a collaborative system using the distributed-object model of Java-RMI","volume":"1","author":"Raje Rajeev R.","year":"1998","unstructured":"Rajeev R. Raje, Snehasis Mukhopadhyay, Michael Boyles, Nila Patel, Artur Papiez, and J. Mostafa. 1998. On designing and implementing a collaborative system using the distributed-object model of Java-RMI. Parallel Distrib. Comput. Pract. J. 1, 4 (1998), 3\u201314.","journal-title":"Parallel Distrib. Comput. Pract. J."},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra1814259"},{"key":"e_1_3_3_57_2","first-page":"616","volume-title":"Proceedings of the 20th International Conference on Machine Learning (ICML\u201903)","author":"Rennie Jason D.","year":"2003","unstructured":"Jason D. Rennie, Lawrence Shih, Jaime Teevan, and David R. Karger. 2003. Tackling the poor assumptions of naive bayes text classifiers. In Proceedings of the 20th International Conference on Machine Learning (ICML\u201903). 616\u2013623."},{"key":"e_1_3_3_58_2","first-page":"29","volume-title":"Proceedings of the 4th International Workshop of Engineering Societies in the Agents World","author":"Rodriguez Sebastian","year":"2003","unstructured":"Sebastian Rodriguez, Vincent Hilaire, and Abder Koukam. 2003. Towards a methodological framework for holonic multi-agent systems. In Proceedings of the 4th International Workshop of Engineering Societies in the Agents World. 29\u201331."},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-25465-X_15"},{"key":"e_1_3_3_60_2","first-page":"410","volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)","author":"Rosenberg Andrew","year":"2007","unstructured":"Andrew Rosenberg and Julia Hirschberg. 2007. V-measure: A conditional entropy-based external cluster evaluation measure. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL). 410\u2013420."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781119597926"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772862"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1980.1675516"},{"key":"e_1_3_3_64_2","first-page":"74","volume-title":"Proceedings of the Conference on Knowledge Discovery and Data Mining","volume":"97","author":"Stolfo Salvatore J.","year":"1997","unstructured":"Salvatore J. Stolfo, Andreas L. Prodromidis, Shelley Tselepis, Wenke Lee, Dave W. Fan, and Philip K. Chan. 1997. JAM: Java agents for meta-learning over distributed databases. In Proceedings of the Conference on Knowledge Discovery and Data Mining, Vol. 97. 74\u201381."},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.082099299"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3386723.3387851"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/1329125.1329243"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41573-019-0024-5"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2641190.2641198"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377454"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3835(94)90099-X"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.5555\/1695886"},{"key":"e_1_3_3_74_2","first-page":"244","volume-title":"Proceedings of the International Workshop on Service Orientation in Holonic and Multi-agent Manufacturing","author":"Yong Bang Xiang","year":"2019","unstructured":"Bang Xiang Yong and Alexandra Brintrup. 2019. Multi agent system for machine learning under uncertainty in cyber physical manufacturing system. In Proceedings of the International Workshop on Service Orientation in Holonic and Multi-agent Manufacturing. Springer, 244\u2013257."},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/11492870_5"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/235968.233324"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"}],"container-title":["ACM Transactions on Autonomous and Adaptive Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3530191","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3530191","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:24Z","timestamp":1750183764000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3530191"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,31]]},"references-count":76,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3530191"],"URL":"https:\/\/doi.org\/10.1145\/3530191","relation":{},"ISSN":["1556-4665","1556-4703"],"issn-type":[{"value":"1556-4665","type":"print"},{"value":"1556-4703","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,31]]},"assertion":[{"value":"2020-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}