{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T05:27:50Z","timestamp":1783056470483,"version":"3.54.6"},"reference-count":50,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,12,17]],"date-time":"2018-12-17T00:00:00Z","timestamp":1545004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100006783","name":"Research Institute, Georgia Institute of Technology","doi-asserted-by":"publisher","award":["D8162-S3"],"award-info":[{"award-number":["D8162-S3"]}],"id":[{"id":"10.13039\/100006783","id-type":"DOI","asserted-by":"publisher"}]},{"name":"United States Army Engineering Research and Development Center","award":["FA8075-16-D-0005-FA807517F1359"],"award-info":[{"award-number":["FA8075-16-D-0005-FA807517F1359"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Adequately exploring the tradespace in the early system design phase is important to determine the best design concepts to pursue in the next life cycle stage. Tradespace exploration (TSE) often uses trade-off analysis. Set-based design (SBD) methods, compared to traditional point-based design, explore significantly more designs. An integrated framework with model-based system engineering (MBSE) and a life cycle cost model enables design evaluation in near real-time. This study proposes an early design phase SBD methodology and demonstrates how SBD enabled by an integrated framework with MBSE and life cycle cost provides an enhanced TSE that can inform system design requirements and help decision makers select high performing designs at an affordable cost. Specifically, this paper (1) provides an overview of TSE and SBD, (2) describes the Integrated Trade-off Analysis Framework, (3) describes a methodology to implement SBD in the early design phase, and (4) demonstrates the techniques using an unmanned aerial vehicle case study. We found that the Integrated Trade-off Analysis Framework informs requirement development based upon how the requirements affect the feasible tradespace. Additionally, the integrated framework that uses SBD better explores the design space compared to traditional methods by finding a larger set of feasible designs early in the design process.<\/jats:p>","DOI":"10.3390\/systems6040045","type":"journal-article","created":{"date-parts":[[2018,12,18]],"date-time":"2018-12-18T02:15:59Z","timestamp":1545099359000},"page":"45","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Early Design Space Exploration with Model-Based System Engineering and Set-Based Design"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0308-0902","authenticated-orcid":false,"given":"Eric","family":"Specking","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1271-3940","authenticated-orcid":false,"given":"Gregory","family":"Parnell","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward","family":"Pohl","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9168-5516","authenticated-orcid":false,"given":"Randy","family":"Buchanan","sequence":"additional","affiliation":[{"name":"U.S. Army Corps of Engineers, Engineer Research and Development Center, Vicksburg, MS 39180, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,12,17]]},"reference":[{"key":"ref_1","unstructured":"Guo, Z.X. (2018, January 9). Co-Evolution of Complex Aeronautical System and Complex System Engineering. Presented at the 2018 INCOSE International Symposium, Washington, DC, USA."},{"key":"ref_2","unstructured":"Specking, E., Parnell, G.S., Pohl, E., and Buchanan, R. (2018, January 17\u201320). A Foundation for System Set-Based Design Trade-off Analytics. Proceedings of the American Society for Engineering Management 2018 International Annual Conference, Coeur d\u2019Alene, ID, USA."},{"key":"ref_3","unstructured":"Specking, E., Small, C., Wade, Z., Parnell, G., Cottam, B., and Pohl, E. (2018). Final Technical Report Task 2: Design Space Exploration, The U.S. Army Engineering Research and Development Center."},{"key":"ref_4","unstructured":"(2018, January 30). Definition of Tradeoff Analysis. Available online: http:\/\/www.businessdictionary.com\/definition\/tradeoff-analysis.html."},{"key":"ref_5","unstructured":"Parnell, G.S. (2016). Trade-Off Analytics: Creating and Exploring the System Tradespace, John Wiley & Sons."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Parnell, G.S., Bresnic, T.A., Tani, S.N., and Johnson, E.R. (2013). Handbook of Decision Analysis, John Wiley & Sons.","DOI":"10.1002\/9781118515853"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Parnell, G.S., Driscoll, P.J., and Henderson, D.L. (2011). Decision Making in Systems Engineering and Management, John Wiley & Sons.","DOI":"10.1002\/9780470926963"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Madni, A., Boehm, B., Ghanem, R., Erwin, D., and Wheaton, M. (2018). Engineering Resilience for Complex Systems. Disciplinary Convergence in Systems Engineering Research, Springer International Publishing.","DOI":"10.1007\/978-3-319-62217-0"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Monat, J., and Gannon, T. (2018). Applying Systems Thinking to Engineering and Design. Systems, 6.","DOI":"10.3390\/systems6030034"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bonnema, G.M., and Broenink, J.F. (2016). Thinking tracks for multidisciplinary system design. Systems, 4.","DOI":"10.3390\/systems4040036"},{"key":"ref_11","unstructured":"Small, C. (2018). Demonstrating Set-Based Design Techniques\u2014A UAV Case Study. [Master\u2019s Thesis, University of Arkansas]."},{"key":"ref_12","unstructured":"INCOSE (2015). Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, John Wiley& Sons. [4th ed.]."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lee, J.Y., and Collins, G.J. (2017). On using ilities of non-functional properties for subsystems and components. Systems, 5.","DOI":"10.3390\/systems5030047"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.2514\/1.A32789","article-title":"Multi-Attribute Tradespace Exploration for Survivability","volume":"51","author":"Ross","year":"2014","journal-title":"J. Spacecr. Rocket."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1109\/17.509982","article-title":"Involving suppliers in product development in the United States and Japan: Evidence for set-based concurrent engineering","volume":"43","author":"Liker","year":"1996","journal-title":"IEEE Trans. Eng. Manag."},{"key":"ref_16","unstructured":"Specking, E., Whitcomb, C., Parnell, G., Goerger, S., Pohl, E., and Kundeti, N. (2017, January 26\u201327). Trade-off Analytics for Set-Based Design. Proceedings of the Design Sciences Series: Set Based Design, Washington, DC, USA."},{"key":"ref_17","unstructured":"Lasdon, L.S. (1970). Optimization Theory for Large Systems, Macmillan."},{"key":"ref_18","unstructured":"Wismer, D.A. (1971). Optimization Methods for Large-Scale Systems ... with Applications, McGraw-Hill Companies."},{"key":"ref_19","unstructured":"Sobieszczanski-Sobieski, J., Barthelemy, J.-F.M., and Giles, G.L. (1984). Aerospace Engineering Design by Systematic Decomposition and Multilevel Optimization."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1115\/1.3258992","article-title":"Multi-level design optimization using global monotonicity analysis","volume":"111","author":"Azarm","year":"1989","journal-title":"J. Mech. Transm. Autom. Des."},{"key":"ref_21","unstructured":"Haimes, Y.Y. (1990). Hierarchical Multiobjective Analysis of Large-Scale Systems, Hemisphere Pub."},{"key":"ref_22","unstructured":"Sobieszczanski-Sobieski, J. (September, January 28). Sensitivity Analysis and Multidisciplinary Optimization for Aircraft Design: Recent Advances and Results. Proceedings of the 16th Congress International Council of the Aeronautical Sciences (ICAS), Jerusalem, Israel."},{"key":"ref_23","unstructured":"Sheridan, D., Clark, D., Jones, R., and Fein, J. (August, January 28). The ASSET Program\u2014A Current Navy Initiative. Proceedings of the SNAME Spring Meeting, Los Angeles, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cramer, E.J., Frank, P.D., Shubin, G.R., Dennis, J., and Lewis, R. (1992, January 21\u201323). On alternative problem formulations for multidisciplinary design optimization. Proceedings of the 4th Annual AIAA\/Air Force\/NASA\/OAI Symposium on Multidisciplinary Analysis and Optimization, Cleveland, OH, USA.","DOI":"10.2514\/6.1992-4752"},{"key":"ref_25","first-page":"739","article-title":"A generalized decomposition procedure and its application to engineering design","volume":"100","author":"Davis","year":"1978","journal-title":"J. Mech. Des."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1115\/1.3267423","article-title":"A basic two-stage decomposition strategy for design optimization","volume":"106","author":"Johnson","year":"1984","journal-title":"J. Mech. Transm. Autom. Des."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1115\/1.3267424","article-title":"A multistage decomposition strategy for design optimization","volume":"106","author":"Johnson","year":"1984","journal-title":"J. Mech. Transm. Autom. Des."},{"key":"ref_28","first-page":"43","article-title":"The second Toyota paradox: How delaying decisions can make better cars faster","volume":"36","author":"Ward","year":"1995","journal-title":"Sloan Manag. Rev."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wade, Z., Parnell, G., Goerger, S., Pohl, E., and Specking, E. (2018, January 8\u20139). Designing Engineered Resilient Systems Using Set-Based Design. Proceedings of the 16th Annual Conference on Systems Engineering Research, Charlottesville, VA, USA.","DOI":"10.1007\/978-3-030-00114-8_10"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1111\/j.1559-3584.2009.00226.x","article-title":"What Is Set-Based Design?","volume":"121","author":"Singer","year":"2009","journal-title":"Nav. Eng. J."},{"key":"ref_31","unstructured":"Burrow, J., Doerry, N., Earnesty, M., Was, J., Myers, J., Banko, J., McConnell, J., Pepper, J., and Tafolla, C.T. (2018, January 30). Concept Exploration of the Amphibious Combat Vehicle. Available online: http:\/\/doerry.org\/Norbert\/papers\/20140726ConceptExplorationoftheAmphibiousCombatVehicle.pdf."},{"key":"ref_32","unstructured":"Finch, W.W., and Ward, A.C. (1997, January 14\u201317). A set-based system for eliminating infeasible designs in engineering problems dominated by uncertainty. Proceedings of the 1997 ASME Design Engineering Technical Conferences, Sacramento, CA, USA. Paper No. DETC97\/DTM-3886."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1109\/TEM.2005.844466","article-title":"Adapting real options to new product development by modeling the second Toyota paradox","volume":"52","author":"Ford","year":"2005","journal-title":"IEEE Trans. Eng. Manag."},{"key":"ref_34","unstructured":"Ghosh, S., and Seering, W. (2014, January 17\u201320). Set-Based Thinking in the Engineering Design Community and Beyond. Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Buffalo, NY, USA."},{"key":"ref_35","unstructured":"Kim, W. (2015). A Framework for Set-Based Manufacturing Analysis and Visual Feedback. [Ph.D. Thesis, Pennsylvania State University]."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Madhavan, K., Shahan, D., Seepersad, C.C., Hlavinka, D.A., and Benson, W. (2008, January 3\u20136). An industrial trial of a set-based approach to collaborative design. Proceedings of the ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Brooklyn, NY, USA.","DOI":"10.1115\/DETC2008-49953"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.cad.2008.06.004","article-title":"Multi-attribute utility analysis in set-based conceptual design","volume":"41","author":"Malak","year":"2008","journal-title":"Comput.-Aided Des."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1111\/j.1559-3584.2011.00331.x","article-title":"Adapting to Changes in Design Requirements Using Set-Based Design","volume":"123","author":"McKenney","year":"2011","journal-title":"Nav. Eng. J."},{"key":"ref_39","unstructured":"McKenney, T.A., and Singer, D.J. (2012, January 9\u201310). Determining the influence of variables for functional design groups in the set-based design process. Proceedings of the American Society of Naval Engineers Day, Arlington, VA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1111\/j.1559-3584.2011.00332.x","article-title":"Set-Based Design and the Ship to Shore Connector","volume":"123","author":"Mebane","year":"2011","journal-title":"Nav. Eng. J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s00170-004-2213-5","article-title":"A new 3D-CAD system for set-based parametric design","volume":"29","author":"Nahm","year":"2006","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_42","unstructured":"Command, S.S.N. (2018, January 30). Ship Design Manager and Systems Integration Manager Manual. Available online: https:\/\/apps.dtic.mil\/dtic\/tr\/fulltext\/u2\/a564501.pdf."},{"key":"ref_43","unstructured":"Panchal, J.H. (2005). A Framework for Simulation-Based Integrated Design of Multiscale Products and Design Processes. [Ph.D. Thesis, Georgia Institute of Technology]."},{"key":"ref_44","unstructured":"Raudberget, D. (2010, January 17\u201320). The decision process in Set-based Concurrent Engineering-An industrial case study. Proceedings of the DESIGN 2010, the 11th International Design Conference, Dubrovnik, Croatia."},{"key":"ref_45","first-page":"67","article-title":"Toyota\u2019s principles of set-based concurrent engineering","volume":"40","author":"Sobek","year":"1999","journal-title":"Sloan Manag. Rev."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ward, A., Durward Sobek, I.I., John, J.C., and Jeffrey, K.L. (1995). Toyota, concurrent engineering, and set-based design. Engineered in Japan: Japanese Technology-Management Practices, Oxford University Press.","DOI":"10.1093\/oso\/9780195095555.003.0008"},{"key":"ref_47","first-page":"51","article-title":"Literature Review: Exploring the Role of Set-Based Design in Trade-off Analytics","volume":"130","author":"Specking","year":"2018","journal-title":"Nav. Eng. J."},{"key":"ref_48","unstructured":"Savage, S., and Thibault, M. (2018, January 30). SIPmath Modeler Tools for Excel Reference Manual. Available online: https:\/\/static1.squarespace.com\/static\/5a4f82d7a8b2b04080732f87\/t\/5a5c9a069140b796c40425fd\/1516018186645\/SIPmath+User+Reference+3.4.0+-+with+bookmarks.pdf."},{"key":"ref_49","unstructured":"Wade, Z. (2018). Convergent Set-Based Design in Integrated Analysis of Alternatives: Designing Engineered Resilient Systems. [Master\u2019s Thesis, University of Arkansas]."},{"key":"ref_50","unstructured":"Cilli, M. (2017). Decision Framework Approach Using the Integrated Systems Engineering Decision Management (ISEDM) Process. Model Center Engineering Workshop, Systems Engineering Research Center (SEPC)."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/6\/4\/45\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:34:27Z","timestamp":1760196867000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/6\/4\/45"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,12,17]]},"references-count":50,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["systems6040045"],"URL":"https:\/\/doi.org\/10.3390\/systems6040045","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,17]]}}}