{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T19:20:06Z","timestamp":1774293606914,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,12]],"date-time":"2023-01-12T00:00:00Z","timestamp":1673481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Wisdom-of-Crowds-Bots (WoC-Bots) are simple, modular agents working together in a multi-agent environment to collectively make binary predictions. The agents represent a knowledge-diverse crowd, with each agent trained on a subset of available information. A honey-bee-derived swarm aggregation mechanism is used to elicit a collective prediction with an associated confidence value from the agents. Due to their multi-agent design, WoC-Bots can be distributed across multiple hardware nodes, include new features without re-training existing agents, and the aggregation mechanism can be used to incorporate predictions from other sources, thus improving overall predictive accuracy of the system. In addition to these advantages, we demonstrate that WoC-Bots are competitive with other top classification methods on three datasets and apply our system to a real-world sports betting problem, producing a consistent return on investment from 1 January 2021 through 15 November 2022 on most major sports.<\/jats:p>","DOI":"10.3390\/fi15010036","type":"journal-article","created":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T02:29:57Z","timestamp":1673576997000},"page":"36","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Multi-Agent Approach to Binary Classification Using Swarm Intelligence"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6627-9839","authenticated-orcid":false,"given":"Sean","family":"Grimes","sequence":"first","affiliation":[{"name":"Department of Computer Science, Drexel University, Philadelphia, PA 19104, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1376-5008","authenticated-orcid":false,"given":"David E.","family":"Breen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Drexel University, Philadelphia, PA 19104, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.eswa.2017.04.003","article-title":"An up-to-date comparison of state-of-the-art classification algorithms","volume":"82","author":"Zhang","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0263-7","article-title":"Enlarging smaller images before inputting into convolutional neural network: Zero-padding vs. interpolation","volume":"6","author":"Hashemi","year":"2019","journal-title":"J. Big Data"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1109\/TSM.2019.2917521","article-title":"Fault detection and diagnosis using self-attentive convolutional neural networks for variable-length sensor data in semiconductor manufacturing","volume":"32","author":"Kim","year":"2019","journal-title":"IEEE Trans. Semicond. Manuf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1038\/s41550-017-0321-z","article-title":"A recurrent neural network for classification of unevenly sampled variable stars","volume":"2","author":"Naul","year":"2018","journal-title":"Nat. Astron."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Torrey, L., and Shavlik, J. (2010). Transfer learning. Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global.","DOI":"10.4018\/978-1-60566-766-9.ch011"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Olivas, E.S., Guerrero, J.D.M., Martinez-Sober, M., Magdalena-Benedito, J.R., and Serrano, L. (2009). Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques: Algorithms, Methods, and Techniques, IGI Global.","DOI":"10.4018\/978-1-60566-766-9"},{"key":"ref_7","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014). How transferable are features in deep neural networks?. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Grimes, S., Zarella, M.D., Garcia, F.U., and Breen, D.E. (2021, January 9\u201312). An agent-based approach to predicting lymph node metastasis status in breast cancer. Proceedings of the 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Houston, TX, USA.","DOI":"10.1109\/BIBM52615.2021.9669624"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1111\/j.1551-6709.2011.01223.x","article-title":"The wisdom of the crowd in combinatorial problems","volume":"36","author":"Yi","year":"2012","journal-title":"Cogn. Sci."},{"key":"ref_10","unstructured":"Othman, A. (2008, January 12\u201316). Zero-intelligence agents in prediction markets. Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems: Volume 2, Estoril, Portugal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1017\/S1537592708082054","article-title":"The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies. By Scott E. Page. Princeton: Princeton University Press, 2007. 448p. 19.95 paper","volume":"6","author":"Ostrom","year":"2008","journal-title":"Perspect. Politics"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1037\/0033-295X.112.2.494","article-title":"The robust beauty of majority rules in group decisions","volume":"112","author":"Hastie","year":"2005","journal-title":"Psychol. Rev."},{"key":"ref_13","unstructured":"Valentini, G., Hamann, H., and Dorigo, M. (2014, January 5\u20139). Self-organized collective decision making: The weighted voter model. Proceedings of the International Conference on Autonomous Agents and Multi-Agent Systems, Paris, France."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Grimes, S., and Breen, D.E. (2019). Woc-Bots: An Agent-Based Approach to Decision-Making. Appl. Sci., 9.","DOI":"10.3390\/app9214653"},{"key":"ref_15","unstructured":"Team, D. (2018). Deeplearning4j: Open-source distributed deep learning for the JVM. Apache Softw. Found. Licens., 2, Available online: http:\/\/deeplearning4j.org\/."},{"key":"ref_16","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_17","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press. Available online: http:\/\/www.deeplearningbook.org."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Du, Q., Hong, H., Wang, G.A., Wang, P., and Fan, W. (2017, January 4\u20137). CrowdIQ: A New Opinion Aggregation Model. Proceedings of the 50th Hawaii International Conference on System Sciences, Hilton Waikoloa Village, HI, USA.","DOI":"10.24251\/HICSS.2017.211"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rosenberg, L., Pescetelli, N., and Willcox, G. (2017, January 19\u201321). Artificial Swarm Intelligence amplifies accuracy when predicting financial markets. Proceedings of the IEEE 8th Annual Conference on Ubiquitous Computing, Electronics and Mobile Communication, New York City, NY, USA.","DOI":"10.1109\/UEMCON.2017.8248984"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Rosenberg, L. (2016, January 12\u201317). Artificial Swarm Intelligence, a Human-in-the-loop approach to AI. Proceedings of the 13th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.9833"},{"key":"ref_21","first-page":"1","article-title":"Collective decision making in honey-bee foraging dynamics","volume":"9","author":"Tereshko","year":"2005","journal-title":"Comput. Inf. Syst."},{"key":"ref_22","unstructured":"Von Frisch, K. (2013). The Dance Language and Orientation of Bees, Harvard University Press."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1046\/j.1365-2435.2000.00443.x","article-title":"Long-range foraging by the honey-bee, Apis mellifera L.","volume":"14","author":"Beekman","year":"2000","journal-title":"Funct. Ecol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1016\/j.physa.2011.12.004","article-title":"Roulette-wheel selection via stochastic acceptance","volume":"391","author":"Lipowski","year":"2012","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1007\/s11063-015-9420-y","article-title":"Adaptive convolutional neural network and its application in face recognition","volume":"43","author":"Zhang","year":"2016","journal-title":"Neural Process. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"Wolpert","year":"1992","journal-title":"Neural Netw."},{"key":"ref_27","first-page":"1","article-title":"Xgboost: Extreme gradient boosting","volume":"1","author":"Chen","year":"2015","journal-title":"R Package Version 0.4-2"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Schapire, R.E. (2013). Explaining adaboost. Empirical Inference, Springer.","DOI":"10.1007\/978-3-642-41136-6_5"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s11749-016-0481-7","article-title":"A random forest guided tour","volume":"25","author":"Biau","year":"2016","journal-title":"Test"},{"key":"ref_30","unstructured":"Wright, R.E. (1995). Logistic regression. Reading and Understanding Multivariate Statistics, APA Publishing."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1245\/ASO.2003.03.015","article-title":"A nomogram for predicting the likelihood of additional nodal metastases in breast cancer patients with a positive sentinel node biopsy","volume":"10","author":"Manasseh","year":"2003","journal-title":"Ann. Surg. Oncol."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kohrt, H.E., Olshen, R.A., Bermas, H.R., Goodson, W.H., Wood, D.J., Henry, S., Rouse, R.V., Bailey, L., Philben, V.J., and Dirbas, F.M. (2008). New models and online calculator for predicting non-sentinel lymph node status in sentinel lymph node positive breast cancer patients. BMC Cancer, 8.","DOI":"10.1186\/1471-2407-8-66"},{"key":"ref_33","unstructured":"Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., and Mordatch, I. (2017). Multi-agent actor-critic for mixed cooperative-competitive environments. arXiv."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/1\/36\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:04:33Z","timestamp":1760119473000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/1\/36"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,12]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["fi15010036"],"URL":"https:\/\/doi.org\/10.3390\/fi15010036","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,12]]}}}