{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T19:44:13Z","timestamp":1760730253002,"version":"3.41.2"},"reference-count":41,"publisher":"ASME International","issue":"3","content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2011,9,1]]},"abstract":"<jats:p>Thanks to recent advances in computing power and speed, engineers can now generate a wealth of data on demand to support design decision-making. These advances have enabled new approaches to search multidimensional trade spaces through interactive data visualization and exploration. In this paper, we investigate the effectiveness and efficiency of interactive trade space exploration strategies by conducting human subject experiments with novice and expert users. A single objective, constrained design optimization problem involving the sizing of an engine combustion chamber is used for this study. Effectiveness is measured by comparing the best feasible design obtained by each user, and efficiency is assessed based on the percentage of feasible designs generated by each user. Results indicate that novices who watch a 5-min training video before the experiment obtain results that are not significantly different from those obtained by expert users, and both groups are statistically better than the novices without the training video in terms of effectiveness and efficiency. Frequency and ordering of the visualization and exploration tools are also compared to understand the differences in each group\u2019s search strategy. The implications of the results are discussed along with future work.<\/jats:p>","DOI":"10.1115\/1.3615685","type":"journal-article","created":{"date-parts":[[2011,9,2]],"date-time":"2011-09-02T14:38:08Z","timestamp":1314974288000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":8,"title":["The Importance of Training for Interactive Trade Space Exploration: A Study of Novice and Expert Users"],"prefix":"10.1115","volume":"11","author":[{"given":"David","family":"Wolf","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jennifer","family":"Hyland","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy W.","family":"Simpson","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Nuclear Engineering, The Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaolong (Luke)","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Information Sciences and Technology, The Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"33","published-online":{"date-parts":[[2011,9,2]]},"reference":[{"issue":"4","key":"2019100513074494500_c1","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1115\/1.2429697","article-title":"Review of Metamodeling Techniques in Support of Engineering Design Optimization","volume":"129","author":"Wang","journal-title":"ASME J. Mech. Des."},{"volume-title":"Principles of Optimal Design: Modeling and Computation","author":"Papalambros","key":"2019100513074494500_c2"},{"key":"2019100513074494500_c3","first-page":"295","article-title":"Design by Shopping: A New Paradigm?","volume-title":"Proceedings of the Third World Congress of Structural and Multidisciplinary Optimization (WCSMO-3)","author":"Balling"},{"issue":"4","key":"2019100513074494500_c4","doi-asserted-by":"publisher","first-page":"044501","DOI":"10.1115\/1.3243633","article-title":"Visual Steering Commands for Trade Space Exploration: User-Guided Sampling With Example","volume":"9","author":"Stump","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"3","key":"2019100513074494500_c5","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/s001580100139","article-title":"Visual Design Steering for Optimization Solution Improvement","volume":"22","author":"Winer","journal-title":"Struct. Optim."},{"key":"2019100513074494500_c6","first-page":"2654","article-title":"Computational Steering in Simulation of Manufacturing Systems","volume-title":"Proceedings of the 2000 IEEE International Conference on Robotics and Automation","author":"Kesavadas"},{"key":"2019100513074494500_c7","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2008-49681","article-title":"Evaluating the Performance of Visual Steering Commands for User-Guided Pareto Frontier Sampling During Trade Space Exploration","volume-title":"ASME Design Engineering Technical Conferences - Design Automation Conference","author":"Carlsen"},{"key":"2019100513074494500_c8","doi-asserted-by":"crossref","unstructured":"Stump, G. M., Yukish, M., Simpson, T. W., and Bennett, L., 2002, \u201cMultidimensional Visualization and Its Application to a Design by Shopping Paradigm,\u201d AIAA Paper No. 2002\u20135622.","DOI":"10.2514\/6.2002-5622"},{"key":"2019100513074494500_c9","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2003\/DAC-48785","article-title":"Design Space Visualization and Its Application to a Design by Shopping Paradigm","volume-title":"ASME Design Engineering Technical Conferences - Design Automation Conference","author":"Stump"},{"key":"2019100513074494500_c10","doi-asserted-by":"crossref","unstructured":"Simpson, T. W., Spencer, D. B., and Yukish, M. A., 2008, \u201cVisual Steering Commands and Test Problems to Support Research in Trade Space Exploration,\u201d AIAA Paper No. 2008\u20136085.","DOI":"10.2514\/6.2008-6085"},{"key":"2019100513074494500_c11","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1057\/palgrave.ivs.9500091","article-title":"A Rank-By-Feature Framework for Interactive Exploration of Multidimensional Data","volume":"4","author":"Seo","journal-title":"Inf. Visualization"},{"volume-title":"Sources of Power: How People Make Decisions","author":"Klein","key":"2019100513074494500_c12"},{"key":"2019100513074494500_c13","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1006\/ijhc.1996.0068","article-title":"Differences in Expert and Novice Situation Awareness in Naturalistic Decision Making","volume":"45","author":"Randel","journal-title":"Int. J. Hum.-Comput. Stud."},{"issue":"3","key":"2019100513074494500_c14","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1080\/1463922021000050005","article-title":"Theoretical Issues in the Design of Visual Inspection Systems","volume":"5","author":"Jiang","journal-title":"Theor. Issues Ergon. Sci."},{"key":"2019100513074494500_c15","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1006\/jvlc.1993.1004","article-title":"Learning to Read Graphics: Some Evidence That \u2018Seeing\u2019 an Information Display is an Acquired Skill","volume":"4","author":"Petre","journal-title":"J. Visual Lang. Comput."},{"key":"2019100513074494500_c16","first-page":"652","article-title":"Measuring Effective Data Visualization","volume-title":"Advance in Visual Computing","author":"Zhu"},{"key":"2019100513074494500_c17","doi-asserted-by":"crossref","DOI":"10.2514\/6.2008-6085","article-title":"Visual Steering Commands and Test Problems to Support Research in Trade Space Exploration","volume-title":"12th AIAA\/ISSMO Multidisciplinary Analysis and Optimization Conference","author":"Simpson"},{"key":"2019100513074494500_c18","first-page":"3","article-title":"The Reinvention of Decision Making","volume-title":"Decision Making in Action: Models and Methods","author":"Orasanu"},{"key":"2019100513074494500_c19","first-page":"195","article-title":"The Role of the Expert\u2019s Decision Making Skills in Management","volume-title":"33rd Annual Operational Research Society of New Zealand","author":"Gilmour"},{"issue":"3\/4","key":"2019100513074494500_c20","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1016\/0361-3682(84)90016-3","article-title":"Expert vs Novice Decision Making in Accounting: A Summary","volume":"9","author":"Bouwman","journal-title":"Account., Organ., Soc."},{"key":"2019100513074494500_c21","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1037\/0033-295X.89.4.369","article-title":"Acquisition of Cognitive Skill","volume":"89","author":"Anderson","journal-title":"Psychol. Rev."},{"key":"2019100513074494500_c22","doi-asserted-by":"publisher","first-page":"862","DOI":"10.1080\/03640210802221999","article-title":"Modeling How, When, and What is Learned in a Simple Fault-Finding Task","volume":"32","author":"Ritter","journal-title":"Cogn. Sci."},{"issue":"5","key":"2019100513074494500_c23","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1002\/asi.4630370504","article-title":"Organization of Programming Knowledge of Novices and Experts","volume":"37","author":"Wiedenbeck","journal-title":"J. Am. Soc. Inf. Sci."},{"issue":"6","key":"2019100513074494500_c24","first-page":"507","article-title":"Sources of Situation Awareness Errors in Aviation","volume":"67","author":"Jones","journal-title":"Aviat., Space Environ. Med."},{"key":"2019100513074494500_c25","unstructured":"Shneiderman, B.\n          , 1998, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley, Reading."},{"key":"2019100513074494500_c26","first-page":"156","article-title":"Interactive Data Visualization Using Focusing and Linking","volume-title":"Proceedings of the IEEE Conference on Visualization","author":"Buja"},{"issue":"1","key":"2019100513074494500_c27","doi-asserted-by":"publisher","first-page":"127","DOI":"10.2307\/1269768","article-title":"Brushing Scatterplots","volume":"29","author":"Becker","journal-title":"Technometrics"},{"key":"2019100513074494500_c28","doi-asserted-by":"crossref","DOI":"10.2514\/6.2004-4568","article-title":"The ARL Trade Space Visualizer: An Engineering Decision-Making Tool","volume-title":"10th AIAA\/ISSMO Multidisciplinary Analysis and Optimization Conference","author":"Stump"},{"volume-title":"Simulation Modeling and Analysis","author":"Law","key":"2019100513074494500_c29"},{"volume-title":"Differential Evolution - A Practical Approach to Global Optimization","author":"Price","key":"2019100513074494500_c30"},{"key":"2019100513074494500_c31","first-page":"520","article-title":"DEMO: Evolution for Multiobjective Optimization","volume-title":"Third International Conference on Evolutionary Multi-Criterion Optimization","author":"Robic"},{"key":"2019100513074494500_c32","doi-asserted-by":"crossref","DOI":"10.1109\/AERO.2004.1368206","article-title":"Trade Space Exploration of Satellite Datasets Using a Design by Shopping Paradigm","volume-title":"2004 IEEE Aerospace Conference Proceedings","author":"Stump"},{"volume-title":"Usability Inspection Methods","author":"Neilson","key":"2019100513074494500_c33"},{"key":"2019100513074494500_c34","unstructured":"Wagner, T. C., and Papalambros, P. Y., 1991, \u201cOptimal Engine Design Using nonlinear Programming and the Engine System Assessment Model,\u201d Ford Motor Company, Technical Report No. SR-91-154."},{"issue":"1","key":"2019100513074494500_c35","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1115\/1.1543978","article-title":"Multidisciplinary Robust Design Optimization of an Internal Combustion Engine","volume":"125","author":"McAllister","journal-title":"ASME J. Mech. Des."},{"key":"2019100513074494500_c36","unstructured":"ANSI\/ASME PTC 19.1-1998, Measurement Uncertainty, Part I, ASME, New York, NY."},{"key":"2019100513074494500_c37","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2009-87294","article-title":"A Preliminary Study of Novice and Expert Users\u2019 Decision-Making Procedures During Visual Trade Space Exploration","volume-title":"ASME Design Engineering Technical Conferences\u2014Design Automation Conference","author":"Wolf"},{"volume-title":"Probability and Statistics for Engineering and the Sciences","author":"Devore","key":"2019100513074494500_c38","doi-asserted-by":"crossref","DOI":"10.2307\/2532427"},{"volume-title":"Sequential Machines and Automata Theory","author":"Booth","key":"2019100513074494500_c39"},{"key":"2019100513074494500_c40","doi-asserted-by":"crossref","unstructured":"Wolf, D. R.\n          , 2009, \u201cAn Assessment of Novice Users\u2019 Decision-Making Strategies During Visual Trade Sapce Exploration,\u201d M.Sc. Thesis, Mechanical Engineering, Penn State University, University Park.","DOI":"10.1115\/DETC2009-87294"},{"issue":"1","key":"2019100513074494500_c41","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1115\/1.1329875","article-title":"Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set","volume":"123","author":"Wu","journal-title":"ASME J. Mech. Des."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.3615685\/5544363\/031009_1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.3615685\/5544363\/031009_1.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,5]],"date-time":"2019-10-05T17:07:55Z","timestamp":1570295275000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/doi\/10.1115\/1.3615685\/465760\/The-Importance-of-Training-for-Interactive-Trade"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,9,1]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,9,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.3615685","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2011,9,1]]},"article-number":"031009"}}