{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T09:25:29Z","timestamp":1747387529509,"version":"3.30.2"},"reference-count":41,"publisher":"ASME International","issue":"2","content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2003,6,1]]},"abstract":"<jats:p>Despite the apparent advantages of and recent advances in the use of visualization in engineering design and optimization, we have found little evidence in the engineering literature that assesses the impact of fast, graphical design interfaces on the efficiency and effectiveness of engineering design decisions or the design optimization process. In this paper we discuss two examples\u2014the design of an I-beam and the design of a desk lamp\u2014for which we have developed graphical and text-based design interfaces to assess the impact of having fast graphical feedback on design efficiency and effectiveness. Design efficiency is measured by recording the completion time for each design task, and design effectiveness is measured by calculating the error between each submitted design and the known optimal design. The impact of graphical feedback is examined by comparing user performance on the graphical and text-based design interfaces while the importance of rapid feedback is investigated by comparing user performance when response delays are introduced within each design interface. Experimental results indicate that users of graphical design interfaces perform better (i.e., have lower error and faster completion time) on average than those using text-based design interfaces, but these differences are not statistically significant. Likewise, we found that a response delay of 0.5 seconds increases error and task completion time, on average, but these increases are not always statistically significant. Trials using longer delays of 1.5 seconds did yield significant increases in task completion time. We also found that the perceived difficulty of the design task and using the graphical interface controls were inversely correlated with design effectiveness\u2014designers who rated the task more difficult to solve or the graphical interface more difficult to use actually performed better than those who rated them easy. Finally, a significant \u201cplaying\u201d effect was observed in our experiments: those who played video games more frequently or rated the slider bars and zoom controls easy to use took more time to complete the design tasks.<\/jats:p>","DOI":"10.1115\/1.1583757","type":"journal-article","created":{"date-parts":[[2003,7,7]],"date-time":"2003-07-07T14:52:13Z","timestamp":1057589533000},"page":"144-154","update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":23,"title":["Assessing the Impact of Graphical Design Interfaces on Design Efficiency and Effectiveness"],"prefix":"10.1115","volume":"3","author":[{"given":"Christopher","family":"Ligetti","sequence":"first","affiliation":[{"name":"Department of Industrial & Manufacturing Engineering, The Pennsylvania State University, University Park, PA\u200916802"}]},{"given":"Timothy W.","family":"Simpson","sequence":"additional","affiliation":[{"name":"Departments of Mechanical & Nuclear Engineering and Industrial & Manufacturing Engineering, The Pennsylvania State University, University Park, PA\u200916802"}]},{"given":"Mary","family":"Frecker","sequence":"additional","affiliation":[{"name":"Department of Mechanical & Nuclear Engineering, The Pennsylvania State University, University Park, PA\u200916802"}]},{"given":"Russell R.","family":"Barton","sequence":"additional","affiliation":[{"name":"Management Science and Information Systems, The Pennsylvania State University, University Park, PA\u200916802"}]},{"given":"Gary","family":"Stump","sequence":"additional","affiliation":[{"name":"Department of Mechanical & Nuclear Engineering, The Pennsylvania State University, University Park, PA\u200916802"}]}],"member":"33","published-online":{"date-parts":[[2003,6,30]]},"reference":[{"unstructured":"Jost, K. , 1998, \u201cChrysler\u2019s \u201cClean Sheet\u201d V6,\u201d Automotive Engineering International, 106(1), pp. 79\u201381.","key":"2019100600325961000_r1"},{"unstructured":"Mecham, M. , 1997, \u201cRaytheon Integrates Product Development,\u201d Aviat. Week Space Technol., October6, pp. 5050.","key":"2019100600325961000_r2"},{"unstructured":"Mecham, M. , 1997, \u201cAerospace Chases the Software Boom,\u201d Aviat. Week Space Technol., October6, pp. 46\u201348.","key":"2019100600325961000_r3"},{"unstructured":"Sabbagh, K., 1996, Twenty-First Century Jet: The Making and Marketing of the Boeing 777, Scribner, New York, NY.","key":"2019100600325961000_r4"},{"doi-asserted-by":"crossref","unstructured":"Messac, A., and Chen, X., 2000, \u201cVisualizing the Optimization Process in Real-Time Using Physical Programming,\u201d Eng. Optimiz., 32(6), pp. 721\u2013747.","key":"2019100600325961000_r5","DOI":"10.1080\/03052150008941319"},{"doi-asserted-by":"crossref","unstructured":"Eddy, J. and Lewis, K., 2002, \u201cMultidimensional Design Visualization in Multiobjective Optimization,\u201d 9th AIAA\/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, GA, AIAA, AIAA-2002-5621.","key":"2019100600325961000_r6","DOI":"10.2514\/6.2002-5621"},{"doi-asserted-by":"crossref","unstructured":"Stump, G. M., Yukish, M., Simpson, T. W., and Bennett, L., 2002, \u201cMultidimensional Visualization and Its Application to a Design by Shopping Paradigm,\u201d 9th AIAA\/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, GA, AIAA, AIAA-2002-5622.","key":"2019100600325961000_r7","DOI":"10.2514\/6.2002-5622"},{"doi-asserted-by":"crossref","unstructured":"Winer, E. H., and Bloebaum, C. L., 2002, \u201cDevelopment of Visual Design Steering as an Aid in Large-Scale Multidisciplinary Design Optimization. Part I: Method Development,\u201d Structural and Multidisciplinary Optimization, 23(6), pp. 412\u2013424.","key":"2019100600325961000_r8","DOI":"10.1007\/s00158-002-0203-5"},{"doi-asserted-by":"crossref","unstructured":"Winer, E. H., and Bloebaum, C. L., 2002, \u201cDevelopment of Visual Design Steering as an Aid in Large-Scale Multidisciplinary Design Optimization. Part II: Method Validation,\u201d Structural and Multidisciplinary Optimization, 23(6), pp. 425\u2013435.","key":"2019100600325961000_r9","DOI":"10.1007\/s00158-002-0204-4"},{"doi-asserted-by":"crossref","unstructured":"Anderson, R. K., and Dror, M., 2001, \u201cAn Interactive Graphic Presentation for Multiobjective Linear Programming,\u201d Applied Mathematics and Computation, 123(2), pp. 229\u2013248.","key":"2019100600325961000_r10","DOI":"10.1016\/S0096-3003(00)00071-0"},{"doi-asserted-by":"crossref","unstructured":"Kihonge, J. N., Vance, J. M., and Larochelle, P. M., 2002, \u201cSpatial Mechanism Design in Virtual Reality with Networking,\u201d ASME J. Mech. Des., 124(3), pp. 435\u2013440.","key":"2019100600325961000_r11","DOI":"10.1115\/1.1481363"},{"doi-asserted-by":"crossref","unstructured":"Jayaram, S., Vance, J. M., Gadh, R., Jayaram, U., and Srinivasan, H., 2001, \u201cAssessment of VR Technology and its Applications to Engineering Problems,\u201d ASME J. Comput. Inf. Sci. Eng., 1(1), pp. 72\u201383.","key":"2019100600325961000_r12","DOI":"10.1115\/1.1353846"},{"doi-asserted-by":"crossref","unstructured":"Jones, C. V. , 1994, \u201cVisualization and Optimization,\u201d ORSA J. Comput., 6(3), pp. 221\u2013257.","key":"2019100600325961000_r13","DOI":"10.1287\/ijoc.6.3.221"},{"unstructured":"CAD\/CAM Update, 1997, \u201cIBM and Daussault Awarded Boeing CATIA Contract,\u201d CAD\/CAM Update, 9(1), pp. 1\u20138.","key":"2019100600325961000_r14"},{"unstructured":"National Research Council, 1998, \u201cVisionary Manufacturing Challenges for 2020,\u201d Committee on Visionary Manufacturing Challenges, National Research Council, National Academy Press, Washington, D.C.","key":"2019100600325961000_r15"},{"doi-asserted-by":"crossref","unstructured":"Evans, P. T., Vance, J. M., and Dark, V. J., 1999, \u201cAssessing the Effectiveness of Traditional and Virtual Reality Interfaces in Spherical Mechanism Design,\u201d ASME J. Mech. Des., 121(4), pp. 507\u2013514.","key":"2019100600325961000_r16","DOI":"10.1115\/1.2829490"},{"unstructured":"Card, S. K., Moran, T. P., and Newell, A., 1983, The Psychology of Human-Computer Interaction, Lawrence Erlbaum, Hillsdale, NJ.","key":"2019100600325961000_r17"},{"doi-asserted-by":"crossref","unstructured":"Sturman, D. J., Zeltzer, D., and Pieper, S., 1989, \u201cHands-on Interaction With Virtual Environments,\u201d Proceedings of the 1989 ACM SIGGRAPH Symposium on User Interface Software and Technology, pp. 19\u201324.","key":"2019100600325961000_r18","DOI":"10.1145\/73660.73663"},{"doi-asserted-by":"crossref","unstructured":"Ware, C., and Balakrishnan, R., 1994, \u201cReaching for Objects in VR Displays Lag and Frame Rate,\u201d ACM Transactions on Computer-Human Interaction, 1, pp. 331\u2013356.","key":"2019100600325961000_r19","DOI":"10.1145\/198425.198426"},{"doi-asserted-by":"crossref","unstructured":"Watson, B., Walker, N., Hodges, L. F., and Worden, A., 1997, \u201cManaging Level of Detail through Peripheral Degradation: Effects on Search Performance in Head-Mounted Display,\u201d ACM Transactions on Computer-Human Interaction, 4, pp. 323\u2013346.","key":"2019100600325961000_r20","DOI":"10.1145\/267135.267137"},{"unstructured":"Waern, Y., 1989, Cognitive Aspects of Computer Supported Tasks, John Wiley & Sons, New York.","key":"2019100600325961000_r21"},{"doi-asserted-by":"crossref","unstructured":"Goodman, T., and Spence, R., 1978, \u201cThe Effect of System Response Time on Interactive Computer-Aided Design,\u201d Comput. Graphics, 12, pp. 100\u2013104.","key":"2019100600325961000_r22","DOI":"10.1145\/965139.807378"},{"doi-asserted-by":"crossref","unstructured":"Foley, J. D., and Wallace, J. D., 1974, \u201cThe Art of Natural Graphic Man-Machine Conversation,\u201d Proceedings of the IEEE, 4, pp. 462\u2013471.","key":"2019100600325961000_r23","DOI":"10.1109\/PROC.1974.9450"},{"doi-asserted-by":"crossref","unstructured":"Hirschi, N. W., and Frey, D. D., 2002, \u201cCognition and Complexity: An Experiment on the Effect of Coupling in Parameter Design,\u201d Res. Eng. Des., 13(3), pp. 123\u2013131.","key":"2019100600325961000_r24","DOI":"10.1007\/s00163-002-0011-3"},{"doi-asserted-by":"crossref","unstructured":"Gu, L., 2001, \u201cA Comparison of Polynomial Based Regression Models in Vehicle Safety Analysis,\u201d ASME Design Engineering Technical Conferences-Design Automation Conference, A. Diaz, ed., Pittsburgh, PA, ASME Paper No. DETC2001\/DAC-21063.","key":"2019100600325961000_r25","DOI":"10.1115\/DETC2001\/DAC-21063"},{"doi-asserted-by":"crossref","unstructured":"Kleijnen, J. P. C. , 1975, \u201cA Comment on Blanning\u2019s Metamodel for Sensitivity Analysis: The Regression Metamodel in Simulation,\u201d Interfaces, 5(1), pp. 21\u201323.","key":"2019100600325961000_r26","DOI":"10.1287\/inte.5.3.21"},{"doi-asserted-by":"crossref","unstructured":"Barton, R. R., 1998, \u201cSimulation Metamodels,\u201d Proceedings of the 1998 Winter Simulation Conference, D. J. Medeiros, E. F. Watson, J. S. Carson and M. S. Manivannan, eds., Washington, DC, IEEE, pp. 167\u2013174.","key":"2019100600325961000_r27","DOI":"10.1109\/WSC.1998.744912"},{"doi-asserted-by":"crossref","unstructured":"Simpson, T. W., Peplinski, J., Koch, P. N., and Allen, J. K., 2001, \u201cMetamodels for Computer-Based Engineering Design: Survey and Recommendations,\u201d Eng. Comput., 17(2), pp. 129\u2013150.","key":"2019100600325961000_r28","DOI":"10.1007\/PL00007198"},{"doi-asserted-by":"crossref","unstructured":"Haftka, R., and Gurdal, Z., 1992, Elements of Structural Optimization, 3rd Revised and Expanded Edition, Kluwer Academic Publishers, Boston, MA.","key":"2019100600325961000_r29","DOI":"10.1007\/978-94-011-2550-5"},{"unstructured":"Barton, R. R., Limayem, F., Meckesheimer, M., and Yannou, B., 1999, \u201cUsing Metamodels for Modeling the Propagation of Design Uncertainties,\u201d 5th International Conference on Concurrent Engineering, N. Wogum, K.-D. Thoben and K. S. Pawar, eds., The Hague, The Netherlands, Centre for Concurrent Enterprising, pp. 521\u2013528.","key":"2019100600325961000_r30"},{"doi-asserted-by":"crossref","unstructured":"Meckesheimer, M., Barton, R. R., Simpson, T. W., Limayem, F., and Yannou, B., 2001, \u201cMetamodeling of Combined Discrete\/Continuous Responses,\u201d AIAA J., 39(10), pp. 1955\u20131959.","key":"2019100600325961000_r31","DOI":"10.2514\/2.1185"},{"doi-asserted-by":"crossref","unstructured":"Athan, T. W., and Papalambros, P. Y., 1996, \u201cA Note on Weighted Criteria Methods for Compromise Solutions in Multi-Objective Optimization,\u201d Eng. Optimiz., 27(2), pp. 155\u2013176.","key":"2019100600325961000_r32","DOI":"10.1080\/03052159608941404"},{"doi-asserted-by":"crossref","unstructured":"Das, I., and Dennis, J. E., 1997, \u201cA Closer Look at Drawbacks of Minimizing Weighted Sums of Objectives for Pareto Set Generation in Multicriteria Optimization Problems,\u201d Struct. Optim. , 14(1), pp. 63\u201369.","key":"2019100600325961000_r33","DOI":"10.1007\/BF01197559"},{"doi-asserted-by":"crossref","unstructured":"Messac, A., Sundararaj, J. G., Tappeta, R. V., and Renaud, J. E., 2000, \u201cAbility of Objective Functions to Generate Points on NonConvex Pareto Frontiers,\u201d AIAA J., 38(6), pp. 1084\u20131091.","key":"2019100600325961000_r34","DOI":"10.2514\/2.1071"},{"unstructured":"Simpson, T. W., Frecker, M., and Barton, R. R., 2003, \u201cImpact of Metamodel-Driven Visualization on Design,\u201d Proceedings of the 2003 NSF Design, Service and Manufacturing Grantees and Research Conference, R. G. Reddy, ed., Birmingham, AL, The University of Alabama, Tuscaloosa, AL, pp. 478\u2013494.","key":"2019100600325961000_r35"},{"doi-asserted-by":"crossref","unstructured":"Mason, R. L., Gunst, R. F., and Hess, J. L., 2003, Statistical Design and Analysis of Experiments, with Applications to Engineering and Science, 2nd Edition, Wiley-Interscience, New York.","key":"2019100600325961000_r36","DOI":"10.1002\/0471458503"},{"unstructured":"Hicks, C. R., and Turner, K. V., 1999, Fundamental Concepts in the Design of Experiments, 5th Edition, Oxford University Press, New York.","key":"2019100600325961000_r37"},{"unstructured":"Gardner, H., 1983, Frames of Mind: The Theory of Multiple Intelligences, Basic Books, New York, NY.","key":"2019100600325961000_r38"},{"unstructured":"Edwards, B., 1989, Drawing on the Right Side of the Brain, Torcher\/Putnam, New York.","key":"2019100600325961000_r39"},{"unstructured":"Harb, J. N., Terry, R. E., Hurt, P. K., and Williamson, K. J., 1995, Teaching Through the Cycle, 2nd Edition, Brigham Young University Press, Provo, UT.","key":"2019100600325961000_r40"},{"doi-asserted-by":"crossref","unstructured":"Volkov, S., and Vance, J. M., 2001, \u201cEffectiveness of Haptic Sensation for the Evaluation of Virtual Prototypes,\u201d ASME J. Comput. Inf. Sci. Eng., 1(2), pp. 123\u2013128.","key":"2019100600325961000_r41","DOI":"10.1115\/1.1384566"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/3\/2\/144\/5773213\/144_1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/3\/2\/144\/5773213\/144_1.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T04:37:09Z","timestamp":1734064629000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/3\/2\/144\/460118\/Assessing-the-Impact-of-Graphical-Design"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,6,1]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2003,6,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.1583757","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2003,6,1]]}}}