{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T12:46:48Z","timestamp":1753879608143,"version":"3.41.2"},"reference-count":64,"publisher":"ASME International","issue":"8","license":[{"start":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T00:00:00Z","timestamp":1717113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Self-organizing systems can perform complex tasks in unpredictable situations with adaptability. Previous work has introduced a multiagent reinforcement learning-based model as a design approach to solving the rule generation problem with complex tasks. A deep multiagent reinforcement learning algorithm was devised to train self-organizing agents for knowledge acquisition of the task field and social rules. The results showed that there is an optimal number of agents that achieve good learning stability and system performance. However, finding such a number is nontrivial due to the dynamic task constraints and unavailability of agent knowledge before training. Although extensive training can eventually reveal the optimal number, it requires training simulations of all agent numbers under consideration, which can be computationally expensive and time consuming. Thus, there remains the issue of how to predict such an optimal team size for self-organizing systems with minimal training experiments. In this article, we proposed a measurement of the complexity of the self-organizing system called effective entropy, which considers the task constraints. A systematic approach, including several key concepts and steps, is proposed to calculate the effective entropy for given task environments, which is then illustrated and tested in a box-pushing case study. The results show that our proposed method and complexity measurement can accurately predict the optimal number of agents in self-organizing systems, and training simulations can be reduced by a factor of 10.<\/jats:p>","DOI":"10.1115\/1.4065343","type":"journal-article","created":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T15:18:18Z","timestamp":1713367098000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":1,"title":["Impact of Task Constraint on Agent Team Size of Self-Organizing Systems Measured by Effective Entropy"],"prefix":"10.1115","volume":"24","author":[{"given":"Hao","family":"Ji","sequence":"first","affiliation":[{"name":"University of Southern California Center for Advanced Research Computing, , 3434 South Grand Avenue, Building CAL, Los Angeles, CA 90089"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Jin","sequence":"additional","affiliation":[{"name":"University of Southern California Department of Aerospace and Mechanical Engineering, , 3650 McClintock Avenue, OHE 430, Los Angeles, CA 90089"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"33","published-online":{"date-parts":[[2024,5,31]]},"reference":[{"issue":"4","key":"2024053110492069500_CIT0001","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1145\/37402.37406","article-title":"Flocks, Herds and Schools: A Distributed Behavioral Model","volume":"21","author":"Reynolds","year":"1987","journal-title":"ACM SIGGRAPH Computer Graphics"},{"key":"2024053110492069500_CIT0002","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1007\/978-1-4899-0718-9_28","article-title":"Requisite Variety and Its Implications for the Control of Complex Systems","volume":"7","author":"Ashby","year":"1991","journal-title":"Facets Syst. Sci."},{"key":"2024053110492069500_CIT0003","first-page":"511","article-title":"Design of Cellular Self-Organizing Systems","author":"Chiang","year":"2012"},{"issue":"3","key":"2024053110492069500_CIT0004","first-page":"259","article-title":"Evolutionary Computational Synthesis of Self-Organizing Systems","volume":"28","author":"Humann","year":"2014","journal-title":"AI EDAM"},{"issue":"4","key":"2024053110492069500_CIT0005","doi-asserted-by":"publisher","first-page":"041101","DOI":"10.1115\/1.4032265","article-title":"Effect of Social Structuring in Self-Organizing Systems","volume":"138","author":"Khani","year":"2016","journal-title":"ASME J. Mech. Des."},{"key":"2024053110492069500_CIT0006","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-319-14956-1_1","volume-title":"Design Computing and Cognition'14","author":"Khani","year":"2015"},{"key":"2024053110492069500_CIT0007","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2018-86006","article-title":"Modeling Trust in Self-Organizing Systems With Heterogeneity","author":"Ji","year":"2018"},{"issue":"4","key":"2024053110492069500_CIT0008","first-page":"404","article-title":"Evaluating the Learning and Performance Characteristics of Self-Organizing Systems With Different Task Features","volume":"35","author":"Ji","year":"2021","journal-title":"AI EDAM"},{"issue":"2","key":"2024053110492069500_CIT0009","doi-asserted-by":"publisher","first-page":"021010","DOI":"10.1115\/1.4052800","article-title":"Knowledge Acquisition of Self-Organizing Systems With Deep Multiagent Reinforcement Learning","volume":"22","author":"Ji","year":"2022","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"3","key":"2024053110492069500_CIT0010","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1109\/TSMCA.2008.918619","article-title":"A Multiagent Swarming System for Distributed Automatic Target Recognition Using Unmanned Aerial Vehicles","volume":"38","author":"Dasgupta","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Humans"},{"issue":"5\u20136","key":"2024053110492069500_CIT0011","doi-asserted-by":"publisher","first-page":"812","DOI":"10.1016\/j.neunet.2009.06.032","article-title":"Extending the Evolutionary Robotics Approach to Flying Machines: An Application to MAV Teams","volume":"22","author":"Ruini","year":"2009","journal-title":"Neural Netw."},{"key":"2024053110492069500_CIT0012","doi-asserted-by":"crossref","DOI":"10.1109\/MCDM.2007.369410","article-title":"UAV Swarm Mission Planning and Routing Using Multi-Objective Evolutionary Algorithms","author":"Lamont","year":"2007"},{"key":"2024053110492069500_CIT0013","first-page":"1","article-title":"Agent-Based Simulation for UAV Swarm Mission Planning and Execution","author":"Wei","year":"2013"},{"key":"2024053110492069500_CIT0014","first-page":"95","article-title":"A Behavior Based Approach to Cellular Self-Organizing Systems Design","author":"Chen","year":"2011"},{"volume-title":"Reinforcement Learning: An Introduction","year":"2018","author":"Sutton","key":"2024053110492069500_CIT0015"},{"issue":"2","key":"2024053110492069500_CIT0016","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1109\/TSMCC.2007.913919","article-title":"A Comprehensive Survey of Multiagent Reinforcement Learning","volume":"38","author":"Busoniu","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"issue":"4","key":"2024053110492069500_CIT0017","doi-asserted-by":"publisher","first-page":"e0172395","DOI":"10.1371\/journal.pone.0172395","article-title":"Multiagent Cooperation and Competition With Deep Reinforcement Learning","volume":"12","author":"Tampuu","year":"2017","journal-title":"PLoS One"},{"key":"2024053110492069500_CIT0018","first-page":"330","article-title":"Multiagent Reinforcement Learning: Independent vs. Cooperative Agents","author":"Tan","year":"1993"},{"key":"2024053110492069500_CIT0019","unstructured":"Watkins, C. J. C. H. , 1989, \u201cLearning From Delayed Rewards,\u201d Ph.D. Dissertation, Cambridge University, Cambridge, UK."},{"issue":"7540","key":"2024053110492069500_CIT0020","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-Level Control Through Deep Reinforcement Learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"article-title":"Counterfactual Multiagent Policy Gradients","year":"2018","author":"Foerster","key":"2024053110492069500_CIT0021"},{"key":"2024053110492069500_CIT0022","first-page":"1146","article-title":"Stabilising Experience Replay for Deep Multiagent Reinforcement Learning","author":"Foerster","year":"2017"},{"article-title":"Deep Recurrent q-Learning for Partially Observable Mdps","year":"2015","author":"Hausknecht","key":"2024053110492069500_CIT0023"},{"issue":"8","key":"2024053110492069500_CIT0024","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"article-title":"Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling","year":"2014","author":"Chung","key":"2024053110492069500_CIT0025"},{"article-title":"Multiagent Actor-Critic for Mixed Cooperative-Competitive Environments","year":"2017","author":"Lowe","key":"2024053110492069500_CIT0026"},{"issue":"6456","key":"2024053110492069500_CIT0027","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1126\/science.aay2400","article-title":"Superhuman AI for Multiplayer Poker","volume":"365","author":"Brown","year":"2019","journal-title":"Science"},{"article-title":"Emergent Tool Use From Multiagent Autocurricula","year":"2019","author":"Baker","key":"2024053110492069500_CIT0028"},{"issue":"2","key":"2024053110492069500_CIT0029","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1111\/tops.12525","article-title":"Too Many Cooks: Bayesian Inference for Coordinating Multiagent Collaboration","volume":"13","author":"Wu","year":"2021","journal-title":"Top. Cogn. Sci."},{"volume-title":"General Features of Complex Systems. Encyclopedia of Life Support Systems (EOLSS)","year":"2002","author":"Bar-Yam","key":"2024053110492069500_CIT0030"},{"issue":"4","key":"2024053110492069500_CIT0031","doi-asserted-by":"publisher","first-page":"041101","DOI":"10.1115\/1.4035793","article-title":"Optimizing Design Teams Based on Problem Properties: Computational Team Simulations and an Applied Empirical Test","volume":"139","author":"McComb","year":"2017","journal-title":"ASME J. Mech. Des."},{"issue":"1","key":"2024053110492069500_CIT0032","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1017\/S0890060418000161","article-title":"Modeling Multidisciplinary Design With Multiagent Learning","volume":"33","author":"Hulse","year":"2019","journal-title":"Artif. Intell. Eng. Des. Anal. Manuf."},{"issue":"4","key":"2024053110492069500_CIT0033","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1115\/1.1897405","article-title":"Analysis of Decomposability and Complexity for Design Problems in the Context of Decomposition","volume":"127","author":"Chen","year":"2005","journal-title":"ASME J. Mech. Des."},{"issue":"2","key":"2024053110492069500_CIT0034","doi-asserted-by":"publisher","first-page":"021004","DOI":"10.1115\/1.1897405","article-title":"Mechanical Engineering Design Complexity Metrics: Size, Coupling, and Solvability","volume":"132","author":"Joshua","year":"2010","journal-title":"ASME J. Mech. Des."},{"issue":"10","key":"2024053110492069500_CIT0035","doi-asserted-by":"publisher","first-page":"100906","DOI":"10.1115\/1.4007587","article-title":"An Information-Theoretic Metric of System Complexity With Application to Engineering System Design","volume":"134","author":"Allaire","year":"2012","journal-title":"ASME J. Mech. Des."},{"issue":"5","key":"2024053110492069500_CIT0036","doi-asserted-by":"publisher","first-page":"051102","DOI":"10.1115\/1.4036134","article-title":"Design Manifolds Capture the Intrinsic Complexity and Dimension of Design Spaces","volume":"139","author":"Chen","journal-title":"ASME J. Mech. Des."},{"issue":"6","key":"2024053110492069500_CIT0037","first-page":"467","article-title":"The Architecture of Complexity","volume":"106","author":"Simon","year":"1962","journal-title":"Proc. Am. Philos. Soc."},{"issue":"3","key":"2024053110492069500_CIT0038","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1080\/095448299261317","article-title":"Estimating Design Complexity","volume":"10","author":"Bashir","year":"1999","journal-title":"J. Eng. Des."},{"key":"2024053110492069500_CIT0039","first-page":"933","article-title":"A Complexity Typology for Systems Engineering","author":"Sheard","year":"2010"},{"issue":"2","key":"2024053110492069500_CIT0040","doi-asserted-by":"publisher","first-page":"021004","DOI":"10.1115\/1.4000759","article-title":"Mechanical Engineering Design Complexity Metrics: Size, Coupling, and Solvability","volume":"132","author":"Summers","year":"2010","journal-title":"ASME J. Mech. Des."},{"issue":"4","key":"2024053110492069500_CIT0041","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1109\/MCS.2001.939938","article-title":"Measures of Complexity: A Nonexhaustive List","volume":"21","author":"Lloyd","year":"2001","journal-title":"IEEE Control Syst. Mag."},{"key":"2024053110492069500_CIT0042","first-page":"1","volume-title":"A Complexity Primer for Systems Engineers","author":"Sheard","year":"2015"},{"article-title":"Foundational Issues in Engineering Systems: A Framing Paper","year":"2004","author":"Moses","key":"2024053110492069500_CIT0043"},{"issue":"4","key":"2024053110492069500_CIT0044","doi-asserted-by":"publisher","first-page":"041401","DOI":"10.1115\/1.4052701","article-title":"So You Think Your System Is Complex?: Why and How Existing Complexity Measures Rarely Agree","volume":"144","author":"Hennig","year":"2022","journal-title":"ASME J. Mech. Des."},{"volume-title":"Structural Complexity Management: An Approach for the Field of Product Design","year":"2008","author":"Lindemann","key":"2024053110492069500_CIT0045"},{"key":"2024053110492069500_CIT0046","doi-asserted-by":"crossref","DOI":"10.1002\/9781118001028","volume-title":"Systems Engineering Principles and Practice","author":"Kossiakoff","year":"2011"},{"key":"2024053110492069500_CIT0047","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/8799.001.0001","volume-title":"Engineering Systems: Meeting Human Needs in a Complex Technological World","author":"De Weck","year":"2011"},{"key":"2024053110492069500_CIT0048","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2366.001.0001","volume-title":"Design Rules: The Power of Modularity","author":"Baldwin","year":"2000"},{"issue":"2","key":"2024053110492069500_CIT0049","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/S0007-8506(07)60019-5","article-title":"Complexity in Engineering","volume":"54","author":"Suh","year":"2005","journal-title":"CIRP Ann."},{"key":"2024053110492069500_CIT0050","doi-asserted-by":"crossref","DOI":"10.1201\/9781420058529","volume-title":"The Art of Systems Architecting","author":"Rechtin","year":"2010"},{"volume-title":"Systems Architecture. Strategy and Product Development for Complex Systems","year":"2016","author":"Cameron","key":"2024053110492069500_CIT0051"},{"issue":"2","key":"2024053110492069500_CIT0052","doi-asserted-by":"publisher","first-page":"021102","DOI":"10.1115\/1.4032091","article-title":"System Architecture, Level of Decomposition, and Structural Complexity: Analysis and Observations","volume":"138","author":"Min","year":"2016","journal-title":"ASME J. Mech. Des."},{"issue":"4","key":"2024053110492069500_CIT0053","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/TSE.1976.233837","article-title":"A Complexity Measure","volume":"SE2","author":"McCabe","year":"1976","journal-title":"IEEE Trans. Software Eng."},{"volume-title":"Elements of Software Science (Operating and Programming Systems Series)","year":"1977","author":"Halstead","key":"2024053110492069500_CIT0054"},{"issue":"5","key":"2024053110492069500_CIT0055","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1016\/j.destud.2004.10.001","article-title":"Incorporating Design Effort Complexity Measures in Product Architectural Design and Assessment","volume":"26","author":"H\u00f6ltt\u00e4","year":"2005","journal-title":"Des. Stud."},{"issue":"3","key":"2024053110492069500_CIT0056","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1002\/sys.21356","article-title":"Empirical Validation of Structural Complexity Metric and Complexity Management for Engineering Systems","volume":"19","author":"Sinha","year":"2016","journal-title":"Syst. Eng."},{"article-title":"Structural Complexity and Its Implications for Design of Cyber-Physical Systems","year":"2014","author":"Sinha","key":"2024053110492069500_CIT0057"},{"issue":"3","key":"2024053110492069500_CIT0058","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1002\/sys.21351","article-title":"Measuring Flexibility, Descriptive Complexity, and Rework Potential in Generic System Architectures","volume":"19","author":"Broniatowski","year":"2016","journal-title":"Syst. Eng."},{"issue":"1","key":"2024053110492069500_CIT0059","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1002\/cplx.20249","article-title":"An Information-Theoretic Primer on Complexity, Self-Organization, and Emergence","volume":"15","author":"Prokopenko","year":"2009","journal-title":"Complexity"},{"volume-title":"An Introduction to Cybernetics","year":"1961","author":"Ashby","key":"2024053110492069500_CIT0060"},{"issue":"4","key":"2024053110492069500_CIT0061","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information Theory and Statistical Mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"2024053110492069500_CIT0062","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2016-60053","article-title":"Adaptability Tradeoffs in the Design of Self-Organizing Systems","author":"Humann","year":"2016"},{"key":"2024053110492069500_CIT0063","doi-asserted-by":"crossref","DOI":"10.21236\/ADA459488","article-title":"Adaptive Division of Labor in Large-Scale Minimalist Multi-Robot Systems","author":"Jones","year":"2003"},{"issue":"6","key":"2024053110492069500_CIT0064","doi-asserted-by":"publisher","first-page":"1115","DOI":"10.1109\/TRO.2006.882919","article-title":"Autonomous Self-Assembly in Swarm-Bots","volume":"22","author":"Gro\u00df","year":"2006","journal-title":"IEEE Trans. Rob."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/24\/8\/081004\/7345392\/jcise_24_8_081004.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/24\/8\/081004\/7345392\/jcise_24_8_081004.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,16]],"date-time":"2024-11-16T12:43:01Z","timestamp":1731760981000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/24\/8\/081004\/1199403\/Impact-of-Task-Constraint-on-Agent-Team-Size-of"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,31]]},"references-count":64,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4065343","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2024,5,31]]},"article-number":"081004"}}