{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:51:04Z","timestamp":1767340264318,"version":"3.41.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,2,25]],"date-time":"2016-02-25T00:00:00Z","timestamp":1456358400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMETRICS Perform. Eval. Rev."],"published-print":{"date-parts":[[2016,2,25]]},"abstract":"<jats:p>Performance model solvers and simulation engines have been around for more than two decades. Yet, performance modeling has not received wide acceptance in the software industry, unlike pervasion of modeling and simulation tools in other industries. This paper explores underlying causes and looks at challenges that need to be overcome to increase utility of performance modeling, in order to make critical decisions on software based products and services. Multiple real-world case studies and examples are included to highlight our viewpoints on performance engineering. Finally, we conclude with some possible directions the performance modeling community could take, for better predictive capabilities required for industrial use.<\/jats:p>","DOI":"10.1145\/2897356.2897363","type":"journal-article","created":{"date-parts":[[2016,2,26]],"date-time":"2016-02-26T14:29:03Z","timestamp":1456496943000},"page":"53-62","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Model Driven Software Performance Engineering"],"prefix":"10.1145","volume":"43","author":[{"given":"Manoj","family":"Nambiar","sequence":"first","affiliation":[{"name":"Performance Engineering Research Center, Tata Consultancy Services, Mumbai, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ajay","family":"Kattepur","sequence":"additional","affiliation":[{"name":"Performance Engineering Research Center, Tata Consultancy Services, Mumbai, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gopal","family":"Bhaskaran","sequence":"additional","affiliation":[{"name":"Performance Engineering Research Center, Tata Consultancy Services, Mumbai, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rekha","family":"Singhal","sequence":"additional","affiliation":[{"name":"Performance Engineering Research Center, Tata Consultancy Services, Mumbai, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Subhasri","family":"Duttagupta","sequence":"additional","affiliation":[{"name":"Performance Engineering Research Center, Tata Consultancy Services, Mumbai, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,2,25]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Springer Berlin Heidelberg","author":"Smith C. U.","year":"1993","unstructured":"C. U. Smith , \"Software performance engineering\" , Springer Berlin Heidelberg , 1993 . C. U. Smith, \"Software performance engineering\", Springer Berlin Heidelberg, 1993."},{"volume-title":"http:\/\/www8.hp.com\/in\/en\/software-solutions\/loadrunner-load-testing\/","year":"2014","unstructured":"Loadrunner, Hewlett-Packard , http:\/\/www8.hp.com\/in\/en\/software-solutions\/loadrunner-load-testing\/ , 2014 . Loadrunner, Hewlett-Packard, http:\/\/www8.hp.com\/in\/en\/software-solutions\/loadrunner-load-testing\/, 2014.","key":"e_1_2_1_2_1"},{"volume-title":"http:\/\/www-03.ibm.com\/software\/products\/en\/performance","year":"2014","unstructured":"Rational Performance Tester, IBM , http:\/\/www-03.ibm.com\/software\/products\/en\/performance , 2014 . Rational Performance Tester, IBM, http:\/\/www-03.ibm.com\/software\/products\/en\/performance, 2014.","key":"e_1_2_1_3_1"},{"unstructured":"I. Molyneaux \"The Art of Application Performance Testing\" O'Reilly 2009.   I. Molyneaux \"The Art of Application Performance Testing\" O'Reilly 2009.","key":"e_1_2_1_4_1"},{"key":"e_1_2_1_5_1","volume-title":"Gartner","author":"Head I.","year":"2015","unstructured":"I. Head and M. Govekar , \" Market Guide for Capacity Management Tools \", Gartner , 2015 . I. Head and M. Govekar, \"Market Guide for Capacity Management Tools\", Gartner, 2015."},{"key":"e_1_2_1_6_1","volume-title":"http:\/\/www.tpc.org\/information\/benchmarks.asp","author":"Benchmarks TPC","year":"2015","unstructured":"TPC Benchmarks , http:\/\/www.tpc.org\/information\/benchmarks.asp , 2015 . TPC Benchmarks, http:\/\/www.tpc.org\/information\/benchmarks.asp, 2015."},{"key":"e_1_2_1_7_1","volume-title":"http:\/\/www.spec.org\/benchmarks.html","author":"Standard Performance Evaluation Corporation (SPEC)","year":"2015","unstructured":"Standard Performance Evaluation Corporation (SPEC) , http:\/\/www.spec.org\/benchmarks.html , 2015 . Standard Performance Evaluation Corporation (SPEC), http:\/\/www.spec.org\/benchmarks.html, 2015."},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1016\/j.jss.2008.03.066"},{"key":"e_1_2_1_9_1","first-page":"0","article-title":"Tutorial Introduction to Layered Modeling of Software Performance","volume":"4","author":"Woodside M.","year":"2013","unstructured":"M. Woodside , \" Tutorial Introduction to Layered Modeling of Software Performance \", Carleton University , v 4 . 0 , 2013 . M. Woodside, \"Tutorial Introduction to Layered Modeling of Software Performance\", Carleton University, v 4.0, 2013.","journal-title":"Carleton University"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.1109\/QEST.2006.22"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.1145\/1530873.1530884"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1145\/1383559.1383570"},{"volume-title":"http:\/\/www.dynatrace.com\/en\/index.html","year":"2015","unstructured":"Dynatrace , http:\/\/www.dynatrace.com\/en\/index.html , 2015 . Dynatrace, http:\/\/www.dynatrace.com\/en\/index.html, 2015.","key":"e_1_2_1_13_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_14_1","DOI":"10.1145\/1498765.1498785"},{"volume-title":"http:\/\/www.teamquest.com\/","year":"2014","unstructured":"Performance Predictor, TeamQuest , http:\/\/www.teamquest.com\/ , 2014 . Performance Predictor, TeamQuest, http:\/\/www.teamquest.com\/, 2014.","key":"e_1_2_1_15_1"},{"volume-title":"http:\/\/www.bmc.com\/it-solutions\/capacity-management.html","year":"2015","unstructured":"Capacity Management, BMC , http:\/\/www.bmc.com\/it-solutions\/capacity-management.html , 2015 . Capacity Management, BMC, http:\/\/www.bmc.com\/it-solutions\/capacity-management.html, 2015.","key":"e_1_2_1_16_1"},{"volume-title":"http:\/\/www.metron-athene.com\/","year":"2015","unstructured":"Athene Performance Management, Metron , http:\/\/www.metron-athene.com\/ , 2015 . Athene Performance Management, Metron, http:\/\/www.metron-athene.com\/, 2015.","key":"e_1_2_1_17_1"},{"unstructured":"Capacity Management CA Technologies http:\/\/www.ca.com\/us\/opscenter\/ca-capacity-management.aspx 2015.  Capacity Management CA Technologies http:\/\/www.ca.com\/us\/opscenter\/ca-capacity-management.aspx 2015.","key":"e_1_2_1_18_1"},{"unstructured":"J. Anderson \"Computational Fluid Dynamics\" McGraw-Hill 1995.  J. Anderson \"Computational Fluid Dynamics\" McGraw-Hill 1995.","key":"e_1_2_1_19_1"},{"key":"e_1_2_1_20_1","volume-title":"SAE Technical Paper","author":"Kirkpatrick S.","year":"2000","unstructured":"S. Kirkpatrick , \"Development and Validation of High Fidelity Vehicle Crash Simulation Models\" , SAE Technical Paper , 2000 . S. Kirkpatrick, \"Development and Validation of High Fidelity Vehicle Crash Simulation Models\", SAE Technical Paper, 2000."},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.1016\/j.drudis.2014.06.018"},{"doi-asserted-by":"publisher","key":"e_1_2_1_22_1","DOI":"10.1186\/s40203-014-0004-8"},{"unstructured":"SPICE Simulation Fundamentals National Instruments http:\/\/www.ni.com\/white-paper\/5413\/en\/ 2013.  SPICE Simulation Fundamentals National Instruments http:\/\/www.ni.com\/white-paper\/5413\/en\/ 2013.","key":"e_1_2_1_23_1"},{"volume-title":"Mentor Graphics, https:\/\/www.mentor.com\/products\/fv\/modelsim\/","year":"2015","unstructured":"ModelSim , Mentor Graphics, https:\/\/www.mentor.com\/products\/fv\/modelsim\/ , 2015 . ModelSim, Mentor Graphics, https:\/\/www.mentor.com\/products\/fv\/modelsim\/, 2015.","key":"e_1_2_1_24_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1109\/TPDS.2010.144"},{"key":"e_1_2_1_26_1","volume-title":"Intl. CMG Conf.","author":"Chahal D.","year":"2015","unstructured":"D. Chahal , S. Duttagupta and M. Nambiar , \" Performance Prediction for Enterprise Application Migration \", Intl. CMG Conf. , Texas , 2015 . D. Chahal, S. Duttagupta and M. Nambiar, \"Performance Prediction for Enterprise Application Migration\", Intl. CMG Conf., Texas, 2015."},{"key":"e_1_2_1_27_1","first-page":"2","article-title":"Performance Extrapolation using Load Testing Results","volume":"13","author":"Duttagupta S.","year":"2012","unstructured":"S. Duttagupta and M. Nambiar , \" Performance Extrapolation using Load Testing Results \", Intl. J. of Simulation, Systems, Science and Technology , vol. 13 , 2 , pp. 66--74, 2012 . S. Duttagupta and M. Nambiar, \"Performance Extrapolation using Load Testing Results\", Intl. J. of Simulation, Systems, Science and Technology, vol. 13, 2, pp. 66--74, 2012.","journal-title":"Intl. J. of Simulation, Systems, Science and Technology"},{"key":"e_1_2_1_28_1","volume-title":"Intl. CMG Conf.","author":"Inghal R.","year":"2013","unstructured":"R. S Inghal and M. Nambiar , \" Measurement based model to study the affect of increase in data size on query response time \", Intl. CMG Conf. , California , 2013 . R. SInghal and M. Nambiar, \"Measurement based model to study the affect of increase in data size on query response time\", Intl. CMG Conf., California, 2013."},{"key":"e_1_2_1_29_1","volume-title":"Intl. Joint Conference SPIT and IPC","author":"Sahoo P. R.","year":"2011","unstructured":"P. R. Sahoo and C. Phalak , \" High Speed Data Loading for Large Sized RDBMS Tables \", Intl. Joint Conference SPIT and IPC , Netherlands , 2011 . P. R. Sahoo and C. Phalak, \"High Speed Data Loading for Large Sized RDBMS Tables\", Intl. Joint Conference SPIT and IPC, Netherlands, 2011."},{"key":"e_1_2_1_30_1","volume-title":"CMG International Conference","author":"Kumar H.","year":"2011","unstructured":"H. Kumar , N. K. Agrawal and M. Nambiar , \" A Performance Analysis and Tuning Case Study \", CMG International Conference , Washington , 2011 . H. Kumar, N. K. Agrawal and M. Nambiar, \"A Performance Analysis and Tuning Case Study\", CMG International Conference, Washington, 2011."},{"key":"e_1_2_1_31_1","first-page":"3","article-title":"A Performance Evaluation of OLTP Workloads on Flash-Based SSDs","author":"Meena R.","year":"2014","unstructured":"R. Meena , \" A Performance Evaluation of OLTP Workloads on Flash-Based SSDs \", Intl. J. of Computer and Communication Engineering , v . 3 , no. 2, 2014 . R. Meena, \"A Performance Evaluation of OLTP Workloads on Flash-Based SSDs\", Intl. J. of Computer and Communication Engineering, v. 3, no. 2, 2014.","journal-title":"Intl. J. of Computer and Communication Engineering"},{"doi-asserted-by":"publisher","key":"e_1_2_1_32_1","DOI":"10.1016\/j.procs.2015.05.447"},{"key":"e_1_2_1_33_1","volume-title":"Intl. CMG Conference","author":"Mansharamani R. K.","year":"2002","unstructured":"R. K. Mansharamani , \"Proactive Performance for 100-fold Growth in a Very Large Stock Exchange \", Intl. CMG Conference , 2002 . R. K. Mansharamani, \"Proactive Performance for 100-fold Growth in a Very Large Stock Exchange\", Intl. CMG Conference, 2002."},{"issue":"6","key":"e_1_2_1_34_1","article-title":"Predicting the Effect if Memory Contention in Multi-core Computers Using Analytic Performance Models","volume":"64","author":"Bardhan S.","year":"2015","unstructured":"S. Bardhan and D. Menasce , \" Predicting the Effect if Memory Contention in Multi-core Computers Using Analytic Performance Models \", IEEE Trans. on Computers , vol. 64 , no. 6 , 2015 . S. Bardhan and D. Menasce, \"Predicting the Effect if Memory Contention in Multi-core Computers Using Analytic Performance Models\", IEEE Trans. on Computers, vol. 64, no. 6, 2015.","journal-title":"IEEE Trans. on Computers"},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.5555\/829532.831330"},{"doi-asserted-by":"publisher","key":"e_1_2_1_36_1","DOI":"10.1109\/FOSE.2007.32"},{"doi-asserted-by":"publisher","key":"e_1_2_1_37_1","DOI":"10.1016\/j.peva.2009.07.007"},{"unstructured":"MARSSx86 Micro-ARchitectural and System Simulator for x86-based Systems http:\/\/marss86.org\/ 2015.  MARSSx86 Micro-ARchitectural and System Simulator for x86-based Systems http:\/\/marss86.org\/ 2015.","key":"e_1_2_1_38_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_39_1","DOI":"10.1145\/2668930.2688050"},{"key":"e_1_2_1_40_1","volume-title":"Dispersing Proprietary Applications as Benchmarks through Code Mutation\", bASPLOS","author":"Velde L.","year":"2008","unstructured":"L. Van ert Velde and L. Eickhout , \" Dispersing Proprietary Applications as Benchmarks through Code Mutation\", bASPLOS , 2008 . L. Van ert Velde and L. Eickhout, \"Dispersing Proprietary Applications as Benchmarks through Code Mutation\", bASPLOS, 2008."},{"key":"e_1_2_1_41_1","article-title":"PseudoApp: Performance Prediction for Application Migration to Cloud","author":"Tak B. C.","year":"2013","unstructured":"B. C. Tak , C. Tang , H. Huang and L. Wang , \" PseudoApp: Performance Prediction for Application Migration to Cloud \", IBM T. J. Watson Research Center , 2013 . B. C. Tak, C. Tang, H. Huang and L. Wang, \"PseudoApp: Performance Prediction for Application Migration to Cloud\", IBM T. J. Watson Research Center, 2013.","journal-title":"IBM T. J. Watson Research Center"},{"key":"e_1_2_1_42_1","volume-title":"KIT Scientific Publishing","author":"Kuperberg M.","year":"2011","unstructured":"M. Kuperberg , \"Quantifying and Predicting the Influence of Execution Platform on Software Component Performance\" , KIT Scientific Publishing , 2011 . M. Kuperberg, \"Quantifying and Predicting the Influence of Execution Platform on Software Component Performance\", KIT Scientific Publishing, 2011."},{"doi-asserted-by":"publisher","key":"e_1_2_1_43_1","DOI":"10.1109\/IPDPSW.2015.28"},{"doi-asserted-by":"publisher","key":"e_1_2_1_44_1","DOI":"10.1145\/1958746.1958784"},{"key":"e_1_2_1_45_1","volume-title":"Slash Gear","author":"Burns C.","year":"2015","unstructured":"C. Burns , \"NV IDIA DRIVE PX self-driving car system demoed in tiny DARPA vehicle \", Slash Gear , 2015 . C. Burns, \"NVIDIA DRIVE PX self-driving car system demoed in tiny DARPA vehicle\", Slash Gear, 2015."},{"key":"e_1_2_1_46_1","volume-title":"Performance Modeling, Requirements, Testing, Scalability, and Practice\"","author":"Bondi A. B.","year":"2014","unstructured":"A. B. Bondi , \"Foundations of Software and System Performance Engineering : Process , Performance Modeling, Requirements, Testing, Scalability, and Practice\" , Addison-Wesley Professional , 2014 . A. B. Bondi, \"Foundations of Software and System Performance Engineering: Process, Performance Modeling, Requirements, Testing, Scalability, and Practice\", Addison-Wesley Professional, 2014."},{"key":"e_1_2_1_47_1","volume-title":"SPECTS","author":"Traore I.","year":"2010","unstructured":"I. Traore , I. Woungang , A. A. El Sayed Ahmed and M. S. Obaidat, \"Performance analysis of distributed software systems: A model-driven approach \", SPECTS , 2010 . I. Traore, I. Woungang, A. A. El Sayed Ahmed and M. S. Obaidat, \"Performance analysis of distributed software systems: A model-driven approach\", SPECTS, 2010."},{"doi-asserted-by":"publisher","key":"e_1_2_1_48_1","DOI":"10.1007\/978-3-540-69073-3_18"},{"key":"e_1_2_1_49_1","first-page":"17","article-title":"Application of Advanced Model-Driven Techniques in Performance Engineering","author":"Kapova L.","year":"2010","unstructured":"L. Kapova and R. Reussner , \" Application of Advanced Model-Driven Techniques in Performance Engineering \", EPEW , pp. 17 -- 36 , 2010 . L. Kapova and R. Reussner, \"Application of Advanced Model-Driven Techniques in Performance Engineering\", EPEW, pp. 17--36, 2010.","journal-title":"EPEW"},{"doi-asserted-by":"publisher","key":"e_1_2_1_50_1","DOI":"10.5555\/2820489.2820507"}],"container-title":["ACM SIGMETRICS Performance Evaluation Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897356.2897363","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897356.2897363","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:39:02Z","timestamp":1750221542000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897356.2897363"}},"subtitle":["Current Challenges and Way Ahead"],"short-title":[],"issued":{"date-parts":[[2016,2,25]]},"references-count":50,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,2,25]]}},"alternative-id":["10.1145\/2897356.2897363"],"URL":"https:\/\/doi.org\/10.1145\/2897356.2897363","relation":{},"ISSN":["0163-5999"],"issn-type":[{"type":"print","value":"0163-5999"}],"subject":[],"published":{"date-parts":[[2016,2,25]]},"assertion":[{"value":"2016-02-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}