{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T07:46:58Z","timestamp":1759132018482},"reference-count":49,"publisher":"Sociedade Brasileira de Computacao - SB","issue":"2","license":[{"start":{"date-parts":[[2010,9,21]],"date-time":"2010-09-21T00:00:00Z","timestamp":1285027200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"},{"start":{"date-parts":[[2010,9,21]],"date-time":"2010-09-21T00:00:00Z","timestamp":1285027200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Internet Serv Appl"],"published-print":{"date-parts":[[2010,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Temporal dependence, as a synonym for burstiness, is often found in workloads (i.e., arrival flows and\/or service times) in enterprise systems that use the multi-tier paradigm. Despite the fact that burstiness has deleterious effects on performance, existing modeling and benchmarking techniques do not provide an effective capacity planning for multi-tier systems with temporal dependence. In this paper, we first present strong evidence that existing models cannot capture bursty conditions and accurately predict performance. Therefore, we propose a simple and effective sizing methodology to integrate workload burstiness into models and benchmarking tools used in system sizing. This modeling methodology is based on the index of dispersion which jointly captures variability and burstiness of the <jats:italic>service process<\/jats:italic> in a single number. We report experimentation on a real testbed that validates the accuracy of our modeling technique by showing that experimental and model prediction results are in excellent agreement under both bursty and non-bursty workloads. To further support the capacity planning process under burstiness, we propose an enhanced benchmarking technique that can emulate workload burstiness in systems. We find that most existing benchmarks, like the standard TPC-W benchmark, are designed to assess system performance <jats:italic>only<\/jats:italic> under non-bursty conditions. In this work, we rectify this deficiency by introducing a new module into existing benchmarks, which allows to inject burstiness into the <jats:italic>arrival stream<\/jats:italic> in a controllable and reproducible manner by using the index of dispersion as a single turnable knob. This approach enables a better understanding of system performance degradation due to burstiness and makes a strong case for the usefulness of the proposed benchmark enhancement for capacity planning of enterprise systems.<\/jats:p>","DOI":"10.1007\/s13174-010-0012-9","type":"journal-article","created":{"date-parts":[[2010,9,20]],"date-time":"2010-09-20T18:30:11Z","timestamp":1285007411000},"page":"117-134","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Sizing multi-tier systems with temporal dependence: benchmarks and analytic models"],"prefix":"10.5753","volume":"1","author":[{"given":"Ningfang","family":"Mi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giuliano","family":"Casale","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ludmila","family":"Cherkasova","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Evgenia","family":"Smirni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"3742","published-online":{"date-parts":[[2010,9,21]]},"reference":[{"key":"12_CR1","doi-asserted-by":"crossref","unstructured":"Almeida V, Bestavros A, Crovella M, de Oliveira A (1996) Characterizing reference locality in the WWW. In: IEEE conference on parallel and distributed information systems, Dec 1996","DOI":"10.1109\/PDIS.1996.568672"},{"issue":"2","key":"12_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1145\/588160.588162","volume":"30","author":"V Almeida","year":"2002","unstructured":"Almeida V, Arlitt M, Rolia J (2002) Analyzing a web-based system\u2019s performance measures at multiple timescales. ACM Perform Eval Rev 30(2):3\u20139","journal-title":"ACM Perform Eval Rev"},{"issue":"5","key":"12_CR3","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1109\/49.700908","volume":"16","author":"AT Andersen","year":"1998","unstructured":"Andersen AT, Nielsen BF (1998) A Markovian approach for modeling packet traffic with long-range dependence. IEEE J Sel Areas Commun 16(5):719\u2013732","journal-title":"IEEE J Sel Areas Commun"},{"issue":"4","key":"12_CR4","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1002\/nav.10015","volume":"49","author":"AT Andersen","year":"2002","unstructured":"Andersen AT, Nielsen BF (2002) On the use of second-order descriptors to predict queueing behavior of MAPs. Nav Res Logist 49(4):391\u2013409","journal-title":"Nav Res Logist"},{"key":"12_CR5","unstructured":"Arlitt M, Jin T (1999) Workload characterization of the 1998 World Cup website. Technical Report HPL-1999-35R1"},{"key":"12_CR6","doi-asserted-by":"crossref","unstructured":"Arlitt M, Williamson C (1996) Web server workload characterization: the search for invariants. In: Proc of ACM SIGMETRICS, pp\u00a0126\u2013137","DOI":"10.1145\/233008.233034"},{"issue":"2","key":"12_CR7","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1145\/332944.332951","volume":"27","author":"M Arlitt","year":"1999","unstructured":"Arlitt M, Friedrich R, Jin T (1999) Workload characterization of a web proxy in a cable environment. ACM Perform Eval Rev 27(2):25\u201336","journal-title":"ACM Perform Eval Rev"},{"issue":"1","key":"12_CR8","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/0166-5316(95)00021-6","volume":"26","author":"G Balbo","year":"1996","unstructured":"Balbo G, Serazzi G (1996) Asymptotic analysis of multiclass closed queueing networks: common bottlenecks. Perform Eval 26(1):51\u201372","journal-title":"Perform Eval"},{"issue":"1\u20132","key":"12_CR9","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1023\/A:1019292504731","volume":"2","author":"G Banga","year":"1999","unstructured":"Banga G, Druschel P (1999) Measuring the capacity of a web server under realistic loads. WWW 2(1\u20132):69\u201383","journal-title":"WWW"},{"issue":"1","key":"12_CR10","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1145\/277858.277897","volume":"26","author":"P Barford","year":"1998","unstructured":"Barford P, Crovella M (1998) Generating representative web workloads for network and server performance evaluation. ACM Perform Eval Rev 26(1):151\u2013160","journal-title":"ACM Perform Eval Rev"},{"issue":"1","key":"12_CR11","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1145\/1330555.1330567","volume":"35","author":"G Casale","year":"2007","unstructured":"Casale G, Zhang E, Smirni E (2007) Characterization of moments and autocorrelation in MAPs. ACM Perform Eval Rev 35(1):27\u201329. Special issue on MAMA workshop","journal-title":"ACM Perform Eval Rev"},{"key":"12_CR12","doi-asserted-by":"crossref","unstructured":"Casale G, Mi N, Smirni E (2008) Bound analysis of closed queueing networks with workload burstiness. In: Proc of SIGMETRICS, pp\u00a013\u201324","DOI":"10.1145\/1384529.1375460"},{"key":"12_CR13","unstructured":"Casale G, Mi N, Cherkasova L, Smirni E (2010) Dealing with burstiness in multi-tier applications: new models and their parameterization (under submission)"},{"issue":"1","key":"12_CR14","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1109\/TC.2009.135","volume":"59","author":"G Casale","year":"2010","unstructured":"Casale G, Mi N, Smirni E (2010) Model-driven system capacity planning under workload burstiness. IEEE Trans Comput 59(1):66\u201380","journal-title":"IEEE Trans Comput"},{"key":"12_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-011-7801-3","volume-title":"The statistical analysis of series of events","author":"DR Cox","year":"1966","unstructured":"Cox DR, Lewis PAW (1966) The statistical analysis of series of events. Methuen, London"},{"key":"12_CR16","doi-asserted-by":"crossref","unstructured":"Crovella M, Bestravos A (1996) Self-similarity in Word Wide Web traffic: evidence and possible causes. In: Proc of SIGMETRICS","DOI":"10.1145\/233013.233038"},{"key":"12_CR17","unstructured":"Fonseca R, Almeida V, Crovella M, Abrahao B (2003) On the intrinsic locality properties of web reference streams. Proc IEEE INFOCOM"},{"key":"12_CR18","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1109\/MC.2003.1178045","volume":"36","author":"D Garcia","year":"2003","unstructured":"Garcia D, Garcia J (2003) TPC-W e-commerce benchmark evaluation. IEEE Comput 36:42\u201348","journal-title":"IEEE Comput"},{"issue":"2","key":"12_CR19","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1109\/49.68448","volume":"19","author":"R Gusella","year":"1991","unstructured":"Gusella R (1991) Characterizing the variability of arrival processes with indexes of dispersion. IEEE J Sel Areas Commun 19(2):203\u2013211","journal-title":"IEEE J Sel Areas Commun"},{"key":"12_CR20","doi-asserted-by":"crossref","unstructured":"Jung J, Krishnamurthy B, Rabinovich M (2002) Flash crowds and denial of service attacks: characterization and implications for CDNs and websites. In: Proc of WWW, pp\u00a0293\u2013304","DOI":"10.1145\/511446.511485"},{"key":"12_CR21","unstructured":"Kant K, Tewary V, Iyer R (2001) An internet traffic generator for server architecture evaluation. In: Proc of workshop computer architecture evaluation using commercial workloads"},{"key":"12_CR22","unstructured":"Kobayashi H, Mark BL (2009) System modeling and analysis: foundations of system performance evaluation"},{"issue":"3","key":"12_CR23","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1145\/306225.306232","volume":"26","author":"D Krishnamurthy","year":"1998","unstructured":"Krishnamurthy D, Rolia J (1998) Predicting the QoS of an electronic commerce server: those mean percentiles. ACM Sigmetrics Perform Eva Rev 26(3):16\u201322","journal-title":"ACM Sigmetrics Perform Eva Rev"},{"issue":"4","key":"12_CR24","doi-asserted-by":"publisher","first-page":"1045","DOI":"10.1109\/TPDS.2009.99","volume":"21","author":"H Li","year":"2010","unstructured":"Li H (2010) Realistic workload modeling and its performance impacts in large-scale eScience grids. IEEE Trans Parallel Distrib Syst 21(4):1045\u20139219","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"12_CR25","first-page":"2","volume":"46","author":"Z Liu","year":"2001","unstructured":"Liu Z, Niclausse N, Jalpa-Villanueva C (2001) Traffic model and performance evaluation of web servers. Perform Eval 46(2\u20133)","journal-title":"Perform Eval"},{"issue":"1","key":"12_CR26","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.peva.2004.12.001","volume":"63","author":"Z Liu","year":"2006","unstructured":"Liu Z, Wynter L, Xia CH, Zhang F (2006) Parameter inference of queueing models for it systems using end-to-end measurements. Perform Eval 63(1):36\u201360","journal-title":"Perform Eval"},{"key":"12_CR27","unstructured":"Menasc\u00e9 DA, Almeida VAF, Dowdy WL (1994) Capacity planning and performance modeling: from mainframes to client\u2013server systems"},{"key":"12_CR28","doi-asserted-by":"crossref","unstructured":"Menasc\u00e9 DA, Almeida VAF, Reidi R, Pelegrinelli. R. Fonesca F, Meira\u00a0W\u00a0Jr. (2000) In search of invariants in e-business workloads. In: Proc of ACM conf electronic commerce, pp\u00a056\u201365","DOI":"10.1145\/352871.352878"},{"issue":"9\u201312","key":"12_CR29","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1016\/j.peva.2007.06.016","volume":"64","author":"N Mi","year":"2007","unstructured":"Mi N, Zhang Q, Riska A, Smirni E, Riedel E (2007) Performance impacts of autocorrelated flows in multi-tiered systems. Perform Eval 64(9\u201312):1082\u20131101","journal-title":"Perform Eval"},{"key":"12_CR30","doi-asserted-by":"crossref","unstructured":"Mi N, Casale G, Cherkasova L, Smirni E (2008) Burstiness in multi-tier applications: symptoms, causes, and new models. In: Proc of Middleware","DOI":"10.1007\/978-3-540-89856-6_14"},{"key":"12_CR31","doi-asserted-by":"crossref","unstructured":"Mi N, Casale G, Cherkasova L, Smirni E (2009) Injecting realistic burstiness into a traditional client\u2013server benchmark. In: Proc of ICAC","DOI":"10.1145\/1555228.1555267"},{"key":"12_CR32","doi-asserted-by":"crossref","unstructured":"Minh TN, Wolters L (2009) Modeling job arrival process with long range dependence and burstiness characteristics. In: Proc of int\u2019l symp on cluster computing and the grid, pp 324\u2013330","DOI":"10.1109\/CCGRID.2009.35"},{"key":"12_CR33","doi-asserted-by":"crossref","unstructured":"Mosberger D, Jin T (1998) httperf: a tool for measuring web server performance. In: Proc of workshop internet server performance","DOI":"10.1145\/306225.306235"},{"key":"12_CR34","volume-title":"Structured stochastic matrices of M\/G\/1 type and their applications","author":"MF Neuts","year":"1989","unstructured":"Neuts MF (1989) Structured stochastic matrices of M\/G\/1 type and their applications. Dekker, New York"},{"issue":"3","key":"12_CR35","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1109\/90.392383","volume":"3","author":"V Paxon","year":"1995","unstructured":"Paxon V, Floyd S (1995) Wide area traffic: the failure of poisson modeling. IEEE\/ACM Trans Netw 3(3):226\u2013244","journal-title":"IEEE\/ACM Trans Netw"},{"key":"12_CR36","doi-asserted-by":"crossref","unstructured":"Ranjan S, Rolia J, Fu H, Knightly E (2002) QoS-driven server migration for internet data center. In: Proc of IWQoS, pp\u00a03\u201312","DOI":"10.1109\/IWQoS.2002.1006569"},{"key":"12_CR37","unstructured":"Ranjan S, Rolia J, Fu H, Knightly F (2002) Qos-driven server migration for Internet data centers. In: Proc of IWQoS"},{"issue":"2","key":"12_CR38","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1145\/322186.322195","volume":"27","author":"M Reiser","year":"1980","unstructured":"Reiser M, Lavenberg S (1980) Mean-value analysis of closed multichain queueing networks. J ACM 27(2):312\u2013322","journal-title":"J ACM"},{"issue":"4","key":"12_CR39","doi-asserted-by":"publisher","first-page":"992","DOI":"10.1109\/18.761337","volume":"45","author":"RH Riedi","year":"1999","unstructured":"Riedi RH, Crouse MS, Ribeiro VJ, Baraniuk RG (1999) A multifractal wavelet model with application to network traffic. IEEE Trans Inf Theory 45(4):992\u20131018","journal-title":"IEEE Trans Inf Theory"},{"key":"12_CR40","doi-asserted-by":"crossref","unstructured":"Rolia J, Vetland V (1998) Correlating resource demand information with arm data for application services. In: Proc of WOSP, pp 219\u2013230","DOI":"10.1145\/287318.287366"},{"key":"12_CR41","unstructured":"Slashdot effect, Wikipedia, Oct 13, 2008. http:\/\/en.wikipedia.org\/wiki\/Slashdot_effect"},{"issue":"6","key":"12_CR42","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1109\/JSAC.1986.1146402","volume":"4","author":"K Sriram","year":"1986","unstructured":"Sriram K, Whitt W (1986) Characterizing superposition arrival processes in packet multiplexers for voice and data. IEEE J Sel Areas Commun 4(6):833\u2013846","journal-title":"IEEE J Sel Areas Commun"},{"key":"12_CR43","doi-asserted-by":"crossref","unstructured":"Urgaonkar B, Pacifici G, Shenoy P, Spreitzer M, Tantawi A (2005) An analytical model for multi-tier internet services and its applications. In: Proc of ACM SIGMETRICS, pp\u00a0291\u2013302","DOI":"10.1145\/1071690.1064252"},{"key":"12_CR44","unstructured":"Urgaonkar B, Shenoy P, Chandra A, Goyal P (2005) Dynamic provisioning of multi-tier internet applications. In: Proc of ICAC"},{"issue":"1","key":"12_CR45","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1145\/1189740.1189747","volume":"7","author":"D Villela","year":"2002","unstructured":"Villela D, Pradhan P, Rubenstein D (2002) Provisioning servers in the application tier for e-commerce systems. ACM Trans Internet Technol 7(1):7","journal-title":"ACM Trans Internet Technol"},{"key":"12_CR46","volume-title":"Web workload characterization: ten years later","author":"A Williams","year":"2005","unstructured":"Williams A, Arlitt M, Williamson C, Barker K (2005) Web workload characterization: ten years later. Springer, New York"},{"key":"12_CR47","unstructured":"www.mercury.com\/us\/products\/diagnostics. HP (Mercury) diagnostics"},{"key":"12_CR48","doi-asserted-by":"crossref","unstructured":"Zhang Q, Cherkasova L, Mathews G, Greene W, Smirni E (2007) R-capriccio: a capacity planning and anomaly detection tool for enterprise services with live workloads. In: Proc of Middleware, pp\u00a0244\u2013265","DOI":"10.1007\/978-3-540-76778-7_13"},{"key":"12_CR49","doi-asserted-by":"crossref","unstructured":"Zhang Q, Cherkasova L, Smirni E (2007) A regression-based analytic model for dynamic resource provisioning of multi-tier applications. In: Proc of ICAC","DOI":"10.1109\/ICAC.2007.1"}],"container-title":["Journal of Internet Services and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13174-010-0012-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13174-010-0012-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/www.springerlink.com\/index\/pdf\/10.1007\/s13174-010-0012-9","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13174-010-0012-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T22:14:42Z","timestamp":1644444882000},"score":1,"resource":{"primary":{"URL":"https:\/\/jisajournal.springeropen.com\/articles\/10.1007\/s13174-010-0012-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,9,21]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2010,11]]}},"alternative-id":["12"],"URL":"https:\/\/doi.org\/10.1007\/s13174-010-0012-9","relation":{},"ISSN":["1867-4828","1869-0238"],"issn-type":[{"value":"1867-4828","type":"print"},{"value":"1869-0238","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,9,21]]},"assertion":[{"value":"7 March 2010","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 August 2010","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 September 2010","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}