{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T23:40:30Z","timestamp":1735256430635,"version":"3.32.0"},"reference-count":31,"publisher":"ASME International","issue":"1","content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2005,3,1]]},"abstract":"<jats:p>Today, engineers are relying more on modern computer tools and techniques to visualize complex data sets; however, few studies have examined the effect of fast, graphical design interfaces on user performance during system design. The objective in this paper is to extend our previous findings in this area by examining the impact of fast, graphical design interfaces on design efficiency and design effectiveness within the context of a job-shop design problem. We accomplish this by investigating the effect of an artificial response delay, intended to mimic computationally intensive analyses, on user performance. Experimental results indicate that user performance deteriorates significantly when a small response delay of 1.5 s is introduced: percent error and task completion time increase, on average, by 9.4% and 81 s, respectively, when the delay is present. The use of first-order, stepwise, and second-order polynomial regression models for approximating the system responses (outputs) is also investigated, and user performance is found to improve when stepwise polynomial regression models are used instead of first- or second-order models. The stepwise models yielded 12% lower error and 91 s faster completion times, on average, over the first-order models; error was 13.5% lower and completion time was 62 s faster, on average, than when second-order models were used. The results confirm our previous findings about the negative impact of response delay on task completion time while demonstrating that delay can also significantly decrease the efficacy of a metamodel-driven graphical design interface.<\/jats:p>","DOI":"10.1115\/1.1794698","type":"journal-article","created":{"date-parts":[[2005,3,14]],"date-time":"2005-03-14T23:02:33Z","timestamp":1110841353000},"page":"8-17","update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":15,"title":["Metamodel-Driven Design Optimization Using Integrative Graphical Design Interfaces: Results From a Job-Shop Manufacturing Simulation Experiment"],"prefix":"10.1115","volume":"5","author":[{"given":"Christopher B.","family":"Ligetti","sequence":"first","affiliation":[{"name":"Harold and Inge Marcus Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy W.","family":"Simpson","sequence":"additional","affiliation":[{"name":"Harold and Inge Marcus Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"33","published-online":{"date-parts":[[2005,3,14]]},"reference":[{"key":"2019100610112960500_r1","doi-asserted-by":"crossref","unstructured":"Simpson, T. W., and Meckesheimer, M., 2004, \u201cEvaluation of a Graphical Design Interface for Design Space Visualization,\u201d 45th AIAA\/ASME\/ASCE\/AHS\/ASC Structures, Structural Dynamics and Materials Conference, Palm Springs, CA, AIAA, AIAA-2004-1683.","DOI":"10.2514\/6.2004-1683"},{"key":"2019100610112960500_r2","doi-asserted-by":"crossref","unstructured":"Gu, L., 2001, \u201cA Comparison of Polynomial Based Regression Models in Vehicle Safety Analysis,\u201d ASME Design Engineering Technical Conferences\u2014Design Automation Conference, A. Diaz, ed., ASME, New York, Paper No. DETC2001\/DAC-21063.","DOI":"10.1115\/DETC2001\/DAC-21063"},{"key":"2019100610112960500_r3","doi-asserted-by":"crossref","unstructured":"Boesel, J., Bowden, Jr., R. O., Glover, F., Kelly, J. P., and Westwig, E., 2001, \u201cFuture of Simulation Optimization,\u201d Proc. of 2001 Winter Simulation Conference, B. A. Peters, J. S. Smith, D. J. Medeiros, and M. W. Rohrer, eds., IEEE, New York, pp. 1466\u20131469.","DOI":"10.1109\/WSC.2001.977472"},{"key":"2019100610112960500_r4","unstructured":"Law, A. M., and Kelton, W. D., 2000, Simulation Modeling and Analysis, Third Edition, McGraw-Hill, New York."},{"key":"2019100610112960500_r5","doi-asserted-by":"crossref","unstructured":"Fu, M., 2001, \u201cSimulation Optimization,\u201d Proc. of 2001 Winter Simulation Conference, B. A. Peters, J. S. Smith, D. J. Medeiros, and M. W. Rohrer, eds., IEEE, New York, pp. 53\u201361.","DOI":"10.1109\/WSC.2001.977246"},{"key":"2019100610112960500_r6","doi-asserted-by":"crossref","unstructured":"Burgess, S., Pasini, D., and Alemzadeh, K., 2004, \u201cImproved Visualization of the Design Space Using Nested Performance Charts,\u201d Des. Stud., 25(1), pp. 51\u201362.","DOI":"10.1016\/S0142-694X(03)00032-2"},{"key":"2019100610112960500_r7","doi-asserted-by":"crossref","unstructured":"Eddy, J., and Lewis, K., 2002, \u201cMultidimensional Design Visualization in Multiobjective Optimization,\u201d 9th AIAA\/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA, Reston, VA, AIAA-2002-5621.","DOI":"10.2514\/6.2002-5621"},{"key":"2019100610112960500_r8","doi-asserted-by":"crossref","unstructured":"Hirschi, N. W., and Frey, D. D., 2002, \u201cCognition and Complexity: An Experiment on the Effect of Coupling in Parameter Design,\u201d Res. Eng. Des., 13(3), pp. 123\u2013131.","DOI":"10.1007\/s00163-002-0011-3"},{"key":"2019100610112960500_r9","unstructured":"Lewis, K., and Bloebaum, C. L., 2000, \u201cThe Use of Visualization to Aid Multidisciplinary Decision Making in Design,\u201d Proc. of NSF Grantees Conference, NSF, Arlington, VA."},{"key":"2019100610112960500_r10","doi-asserted-by":"crossref","unstructured":"Messac, A., and Chen, X., 2000, \u201cVisualizing the Optimization Process in Real-Time Using Physical Programming,\u201d Eng. Optimiz., 32(6), pp. 721\u2013747.","DOI":"10.1080\/03052150008941319"},{"key":"2019100610112960500_r11","doi-asserted-by":"crossref","unstructured":"Stump, G., Yukish, M., Simpson, T. W., and Harris, E. N., 2003, \u201cDesign Space Visualization and Its Application to a Design by Shopping Paradigm,\u201d ASME Design Engineering Technical Conferences\u2014Design Automation Conference, K. Shimada, ed., ASME, New York, ASME Paper No. DETC2003\/DAC-48785.","DOI":"10.1115\/DETC2003\/DAC-48785"},{"key":"2019100610112960500_r12","doi-asserted-by":"crossref","unstructured":"Winer, E. H., and Bloebaum, C. L., 2002, \u201cDevelopment of Visual Design Steering as an Aid in Large-Scale Multidisciplinary Design Optimization. Part I: Method Development,\u201d Struct. Multidisciplinary Optim., 23(6), pp. 412\u2013424.","DOI":"10.1007\/s00158-002-0203-5"},{"key":"2019100610112960500_r13","doi-asserted-by":"crossref","unstructured":"Winer, E. H., and Bloebaum, C. L., 2001, \u201cVisual Design Steering for Optimization Solution Improvement,\u201d Struct. Optim., 22(3), pp. 219\u2013229.","DOI":"10.1007\/s001580100139"},{"key":"2019100610112960500_r14","doi-asserted-by":"crossref","unstructured":"Jones, C. V. , 1994, \u201cVisualization and Optimization,\u201d ORSA J. Comput., 6(3), pp. 221\u2013257.","DOI":"10.1287\/ijoc.6.3.221"},{"key":"2019100610112960500_r15","unstructured":"National Research Council, 1998, \u201cVisionary Manufacturing Challenges for 2020,\u201d Committee on Visionary Manufacturing Challenges, National Research Council, National Academy Press, Washington, D.C."},{"key":"2019100610112960500_r16","unstructured":"Kleijnen, J. P. C., 1987, Statistical Tools for Simulation Practitioners, Marcel Dekker, New York."},{"key":"2019100610112960500_r17","doi-asserted-by":"crossref","unstructured":"Barton, R. R., 1998, \u201cSimulation Metamodels,\u201d Proc. of 1998 Winter Simulation Conference (WSC\u201998), D. J. Medeiros, E. F. Watson, J. S. Carson, and M. S. Manivannan, eds., IEEE, New York, pp. 167\u2013174.","DOI":"10.1109\/WSC.1998.744912"},{"key":"2019100610112960500_r18","doi-asserted-by":"crossref","unstructured":"Jin, R., Chen, W., and Simpson, T. W., 2001, \u201cComparative Studies of Metamodeling Techniques Under Multiple Modeling Criteria,\u201d Struct. Multidisciplinary Optim., 23(1), pp. 1\u201313.","DOI":"10.1007\/s00158-001-0160-4"},{"key":"2019100610112960500_r19","doi-asserted-by":"crossref","unstructured":"Simpson, T. W., Peplinski, J., Koch, P. N., and Allen, J. K., 2001, \u201cMetamodels for Computer-Based Engineering Design: Survey and Recommendations,\u201d Eng. Comput., 17(2), pp. 129\u2013150.","DOI":"10.1007\/PL00007198"},{"key":"2019100610112960500_r20","doi-asserted-by":"crossref","unstructured":"Ligetti, C., Simpson, T. W., Frecker, M., Barton, R. R., and Stump, G., 2003, \u201cAssessing the Impact of Graphical Design Interfaces on Design Efficiency and Effectiveness,\u201d ASME J. Comput. Inf. Sci. Eng., 3(2), pp. 144\u2013154.","DOI":"10.1115\/1.1583757"},{"key":"2019100610112960500_r21","doi-asserted-by":"crossref","unstructured":"Goodman, T., and Spence, R., 1978, \u201cThe Effect of System Response Time on Interactive Computer-Aided Design,\u201d Comput. Graph., 12, pp. 100\u2013104.","DOI":"10.1145\/965139.807378"},{"key":"2019100610112960500_r22","doi-asserted-by":"crossref","unstructured":"Barron, K., Simpson, T. W., Rothrock, L., Frecker, M., Barton, R. R., and Ligetti, C., 2004, \u201cGraphical User Interfaces for Engineering Design: Impact of Response Delay and Training on User Performance,\u201d ASME Design Engineering Technical Conferences\u2014Design Theory and Methodology Conference, ASME, New York, ASME Paper No. DETC2004\/DTM-57085.","DOI":"10.1115\/DETC2004-57085"},{"key":"2019100610112960500_r23","unstructured":"Myers, R. H., and Montgomery, D. C., 1995, Response Surface Methodology: Process and Product Optimization Using Designed Experiments, Wiley, New York."},{"key":"2019100610112960500_r24","unstructured":"Ligetti, C. B., 2003, \u201cMetamodel-Driven Visualization in Engineering Design: Studies on Design Efficiency and Effectiveness Using Graphical Design Interfaces,\u201d M.S. thesis, Dept. of Indust. and Manuf. Eng., Penn State University, University Park, PA."},{"key":"2019100610112960500_r25","unstructured":"Montgomery, D. C., 1997, Design and Analysis of Experiments, Fourth Edition, Wiley, New York."},{"key":"2019100610112960500_r26","doi-asserted-by":"crossref","unstructured":"Draper, N. R., and Lin, D. K. J., 1996, \u201cResponse Surface Designs,\u201d Handbook of Statistics, S. Ghosh and C. R. Rao, eds., Elsevier Science, New York, pp. 343\u2013375.","DOI":"10.1016\/S0169-7161(96)13013-3"},{"key":"2019100610112960500_r27","unstructured":"Simpson, T. W., Lin, D. K. J., and Chen, W., 2001, \u201cSampling Strategies for Computer Experiments: Design and Analysis,\u201d Int. J. Reliability Appl., 2(3), pp. 209\u2013240."},{"key":"2019100610112960500_r28","doi-asserted-by":"crossref","unstructured":"Koehler, J. R., and Owen, A. B., 1996, \u201cComputer Experiments,\u201d Handbook of Statistics, S. Ghosh and C. R. Rao, eds., Elsevier Science, New York, pp. 261\u2013308.","DOI":"10.1016\/S0169-7161(96)13011-X"},{"key":"2019100610112960500_r29","unstructured":"Neter, J., Kutner, M. H., Nachtsheim, C. J., and Wasserman, W., 1996, Applied Linear Statistical Models, 4th Edition, WCB\/McGraw-Hill, Boston, MA."},{"key":"2019100610112960500_r30","doi-asserted-by":"crossref","unstructured":"Miller, G. A. , 1956, \u201cThe Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information,\u201d Psychol. Res., 63, pp. 81\u201397.","DOI":"10.1037\/h0043158"},{"key":"2019100610112960500_r31","doi-asserted-by":"crossref","unstructured":"Rothrock, L., Barron, K., Simpson, T. W., Frecker, M., Barton, R. R., and Ligetti, C., 2004, \u201cApplying the Proximity Compatibility and the Control-Display Compatibility Principles Engineering Design Interfaces,\u201d Human Factors Ergonomics Manuf., (to appear).","DOI":"10.1037\/e577272012-029"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/5\/1\/8\/5773770\/8_1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/5\/1\/8\/5773770\/8_1.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T23:26:10Z","timestamp":1735255570000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/5\/1\/8\/449199\/MetamodelDriven-Design-Optimization-Using"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,3,1]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2005,3,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.1794698","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2005,3,1]]}}}