{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T05:50:27Z","timestamp":1774158627883,"version":"3.50.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,8,2]],"date-time":"2016-08-02T00:00:00Z","timestamp":1470096000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"CACTOS, and through the LCCC Linnaeus and ELLIIT Excellence Centers"},{"name":"Swedish Research Council (VR) for the project \u201cCloud Control,\u201d by the Swedish Government's strategic effort eSSENCE"},{"name":"European Union's Seventh Framework Programme","award":["610711"],"award-info":[{"award-number":["610711"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Perform. Eval. Comput. Syst."],"published-print":{"date-parts":[[2016,9,21]]},"abstract":"<jats:p>\n            Numerous auto-scaling strategies have been proposed in the past few years for improving various Quality of Service (QoS) indicators of cloud applications, for example, response time and throughput, by adapting the amount of resources assigned to the application to meet the workload demand. However, the evaluation of a proposed auto-scaler is usually achieved through experiments under specific conditions and seldom includes extensive testing to account for uncertainties in the workloads and unexpected behaviors of the system. These tests by no means can provide guarantees about the behavior of the system in general conditions. In this article, we present a Performance Evaluation framework for Auto-Scaling (PEAS) strategies in the presence of uncertainties. The evaluation is formulated as a\n            <jats:italic>chance constrained optimization problem<\/jats:italic>\n            , which is solved using\n            <jats:italic>scenario theory<\/jats:italic>\n            . The adoption of such a technique allows one to give probabilistic guarantees of the obtainable performance. Six different auto-scaling strategies have been selected from the literature for extensive test evaluation and compared using the proposed framework. We build a discrete event simulator and parameterize it based on real experiments. Using the simulator, each auto-scaler\u2019s performance is evaluated using 796 distinct real workload traces from projects hosted on the Wikimedia foundations\u2019 servers, and their performance is compared using PEAS. The evaluation is carried out using different performance metrics, highlighting the flexibility of the framework, while providing probabilistic bounds on the evaluation and the performance of the algorithms. Our results highlight the problem of generalizing the conclusions of the original published studies and show that based on the evaluation criteria, a controller can be shown to be better than other controllers.\n          <\/jats:p>","DOI":"10.1145\/2930659","type":"journal-article","created":{"date-parts":[[2016,8,4]],"date-time":"2016-08-04T13:26:34Z","timestamp":1470317194000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["PEAS"],"prefix":"10.1145","volume":"1","author":[{"given":"Alessandro Vittorio","family":"Papadopoulos","sequence":"first","affiliation":[{"name":"Lund University, Lund, Sweden"}]},{"given":"Ahmed","family":"Ali-Eldin","sequence":"additional","affiliation":[{"name":"Ume\u00e5 University, Ume\u00e5, Sweden"}]},{"given":"Karl-Erik","family":"\u00c5rz\u00e9n","sequence":"additional","affiliation":[{"name":"Lund University, Lund, Sweden"}]},{"given":"Johan","family":"Tordsson","sequence":"additional","affiliation":[{"name":"Ume\u00e5 University, Ume\u00e5, Sweden"}]},{"given":"Erik","family":"Elmroth","sequence":"additional","affiliation":[{"name":"Ume\u00e5 University, Ume\u00e5, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2016,8,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2011.6161148"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493123.2462925"},{"key":"e_1_2_1_3_1","volume-title":"Perspectives in Mathematical System Theory, Control, and Signal Processing, Jan C","author":"Alamo Teodoro","unstructured":"Teodoro Alamo , Roberto Tempo , and Amalia Luque . 2010. On the sample complexity of probabilistic analysis and design methods . In Perspectives in Mathematical System Theory, Control, and Signal Processing, Jan C . Willems, Shinji Hara, Yoshito Ohta, and Hisaya Fujioka (Eds.). Lecture Notes in Control and Information Sciences, Vol. 398 . Springer , Berlin, 39--50. DOI:http:\/\/dx.doi.org\/10.1007\/978-3-540-93918-4_4 10.1007\/978-3-540-93918-4_4 Teodoro Alamo, Roberto Tempo, and Amalia Luque. 2010. On the sample complexity of probabilistic analysis and design methods. In Perspectives in Mathematical System Theory, Control, and Signal Processing, Jan C. Willems, Shinji Hara, Yoshito Ohta, and Hisaya Fujioka (Eds.). Lecture Notes in Control and Information Sciences, Vol. 398. Springer, Berlin, 39--50. DOI:http:\/\/dx.doi.org\/10.1007\/978-3-540-93918-4_4"},{"key":"e_1_2_1_4_1","unstructured":"Alexa. 2015. The top 500 sites on the web. (2015). http:\/\/googleresearch.blogspot.com\/2011\/11\/more-google-cluster-data.html http:\/\/www.alexa.com\/topsites {Online; accessed 2015-04-09}.  Alexa. 2015. The top 500 sites on the web. (2015). http:\/\/googleresearch.blogspot.com\/2011\/11\/more-google-cluster-data.html http:\/\/www.alexa.com\/topsites {Online; accessed 2015-04-09}."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/IC2E.2014.50"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/UCC.2014.87"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/NOMS.2012.6211900"},{"key":"e_1_2_1_8_1","volume-title":"Proc. 13th IEEE\/ACM Int. Symposium on Cluster, Cloud and Grid Computing (CCGrid 13)","author":"Almeida Morais F. J.","year":"2013","unstructured":"F. J. Almeida Morais , F. Vilar Brasileiro , R. Vigolvino Lopes , R. Araujo Santos , W. Satterfield , and L. Rosa . 2013. Autoflex: Service agnostic auto-scaling framework for IaaS deployment models . In Proc. 13th IEEE\/ACM Int. Symposium on Cluster, Cloud and Grid Computing (CCGrid 13) . 42--49. DOI:http:\/\/dx.doi.org\/10.1109\/CCGrid. 2013 .74 10.1109\/CCGrid.2013.74 F. J. Almeida Morais, F. Vilar Brasileiro, R. Vigolvino Lopes, R. Araujo Santos, W. Satterfield, and L. Rosa. 2013. Autoflex: Service agnostic auto-scaling framework for IaaS deployment models. In Proc. 13th IEEE\/ACM Int. Symposium on Cluster, Cloud and Grid Computing (CCGrid 13). 42--49. DOI:http:\/\/dx.doi.org\/10.1109\/CCGrid.2013.74"},{"key":"e_1_2_1_9_1","volume-title":"O\u2019Reilly Media","author":"Barrett Daniel J.","unstructured":"Daniel J. Barrett . 2008. MediaWiki ( Wikipedia and Beyond). O\u2019Reilly Media , Inc . Daniel J. Barrett. 2008. MediaWiki (Wikipedia and Beyond). O\u2019Reilly Media, Inc."},{"key":"e_1_2_1_10_1","volume-title":"2013 IFIP\/IEEE International Symposium on Integrated Network Management (IM","author":"Blagodurov Sergey","year":"2013","unstructured":"Sergey Blagodurov , Daniel Gmach , Martin Arlitt , Yuan Chen , Chris Hyser , and Alexandra Fedorova . 2013 . Maximizing server utilization while meeting critical SLAs via weight-based collocation management . In 2013 IFIP\/IEEE International Symposium on Integrated Network Management (IM 2013). IEEE, 277--285. Sergey Blagodurov, Daniel Gmach, Martin Arlitt, Yuan Chen, Chris Hyser, and Alexandra Fedorova. 2013. Maximizing server utilization while meeting critical SLAs via weight-based collocation management. In 2013 IFIP\/IEEE International Symposium on Integrated Network Management (IM 2013). IEEE, 277--285."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807128.1807166"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2013.01.062"},{"key":"e_1_2_1_14_1","volume-title":"Reed","author":"Buneci Emma S.","year":"2008","unstructured":"Emma S. Buneci and Daniel A . Reed . 2008 . Analysis of application heartbeats: Learning structural and temporal features in time series data for identification of performance problems. In Proceedings of the 2008 ACM\/IEEE Conference on Supercomputing. IEEE Press , 52. Emma S. Buneci and Daniel A. Reed. 2008. Analysis of application heartbeats: Learning structural and temporal features in time series data for identification of performance problems. In Proceedings of the 2008 ACM\/IEEE Conference on Supercomputing. IEEE Press, 52."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-003-0499-y"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2006.875041"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10957-010-9754-6"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.arcontrol.2009.07.001"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2012.10.020"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/502059.502045"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICEBE.2009.45"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2408776.2408794"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732240.2732246"},{"key":"e_1_2_1_24_1","volume-title":"Treiber","author":"Dong Margaret A.","year":"1992","unstructured":"Margaret A. Dong and Richard K . Treiber . 1992 . Dynamic resource pool expansion and contraction in multiprocessing environments. Patent No. 5,093,912, Filed March 3, 1992. Margaret A. Dong and Richard K. Treiber. 1992. Dynamic resource pool expansion and contraction in multiprocessing environments. Patent No. 5,093,912, Filed March 3, 1992."},{"key":"e_1_2_1_25_1","volume-title":"Workload Modeling for Computer Systems Performance Evaluation","author":"Feitelson Dror G.","unstructured":"Dror G. Feitelson . 2014. Workload Modeling for Computer Systems Performance Evaluation . Cambridge University Press . http:\/\/www.cs.huji.ac.il\/&sim;feit\/wlmod\/. Dror G. Feitelson. 2014. Workload Modeling for Computer Systems Performance Evaluation. Cambridge University Press. http:\/\/www.cs.huji.ac.il\/&sim;feit\/wlmod\/."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/IC2E.2014.25"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2382553.2382556"},{"key":"e_1_2_1_28_1","volume-title":"Proc. Int. Conf. on Network and Service Management (CNSM 10)","author":"Gong Zhenhuan","year":"2010","unstructured":"Zhenhuan Gong , Xiaohui Gu , and John Wilkes . 2010 . PRESS: PRedictive elastic resource scaling for cloud systems . In Proc. Int. Conf. on Network and Service Management (CNSM 10) . 9--16. DOI:http:\/\/dx.doi.org\/10.1109\/CNSM.2010.5691343 10.1109\/CNSM.2010.5691343 Zhenhuan Gong, Xiaohui Gu, and John Wilkes. 2010. PRESS: PRedictive elastic resource scaling for cloud systems. In Proc. Int. Conf. on Network and Service Management (CNSM 10). 9--16. DOI:http:\/\/dx.doi.org\/10.1109\/CNSM.2010.5691343"},{"key":"e_1_2_1_29_1","volume-title":"Time Series Analysis","author":"Hamilton James D.","unstructured":"James D. Hamilton . 1994. Time Series Analysis . Vol. 2 . Princeton University Press , Princeton, NJ . James D. Hamilton. 1994. Time Series Analysis. Vol. 2. Princeton University Press, Princeton, NJ."},{"key":"e_1_2_1_30_1","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","author":"Hastie Trevor","unstructured":"Trevor Hastie , Robert Tibshirani , and Jerome Friedman . 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction ( 2 nd ed.). Springer-Verlag , New York . DOI:http:\/\/dx.doi.org\/ 10.1007\/978-0-387-84858-7 10.1007\/978-0-387-84858-7 Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd ed.). Springer-Verlag, New York. DOI:http:\/\/dx.doi.org\/ 10.1007\/978-0-387-84858-7","edition":"2"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2479871.2479899"},{"key":"e_1_2_1_32_1","unstructured":"Todd Hoff. 2010. Justin.tv\u2019s Live Video Broadcasting Architecture. (2010). http:\/\/highscalability.com\/blog\/2010\/3\/16\/justintvs-live-video-broadcasting-architecture.html {Online accessed 2014-11-24}.  Todd Hoff. 2010. Justin.tv\u2019s Live Video Broadcasting Architecture. (2010). http:\/\/highscalability.com\/blog\/2010\/3\/16\/justintvs-live-video-broadcasting-architecture.html {Online accessed 2014-11-24}."},{"key":"e_1_2_1_33_1","volume-title":"Proc. Roy. Soc. Lond. A 454, 1971 (1998","author":"Huang Norden E.","year":"1998","unstructured":"Norden E. Huang , Zheng Shen , Steven R. Long , Manli C. Wu , Hsing H. Shih , Quanan Zheng , Nai-Chyuan Yen , Chi Chao Tung , and Henry H. Liu . 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis . Proc. Roy. Soc. Lond. A 454, 1971 (1998 ), 903--995. DOI:http:\/\/dx.doi.org\/10.1098\/rspa. 1998 .0193 10.1098\/rspa.1998.0193 Norden E. Huang, Zheng Shen, Steven R. Long, Manli C. Wu, Hsing H. Shih, Quanan Zheng, Nai-Chyuan Yen, Chi Chao Tung, and Henry H. Liu. 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. Roy. Soc. Lond. A 454, 1971 (1998), 903--995. DOI:http:\/\/dx.doi.org\/10.1098\/rspa.1998.0193"},{"key":"e_1_2_1_34_1","volume-title":"Proc. 5th IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS 12)","author":"Iosup Alexandru","year":"2012","unstructured":"Alexandru Iosup . 2012 . IaaS cloud benchmarking: Approaches, challenges, and experience . In Proc. 5th IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS 12) . ACM, New York, NY, 1--8. DOI:http:\/\/dx.doi.org\/10.1145\/2462307.2462309 10.1145\/2462307.2462309 Alexandru Iosup. 2012. IaaS cloud benchmarking: Approaches, challenges, and experience. In Proc. 5th IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS 12). ACM, New York, NY, 1--8. DOI:http:\/\/dx.doi.org\/10.1145\/2462307.2462309"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2010.10.016"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2011.05.027"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024988512476"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2011.199"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1925861.1925878"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2011.88"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1879141.1879143"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(99)00175-7"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809049.1809051"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1555271.1555275"},{"key":"e_1_2_1_45_1","volume-title":"Silvester","author":"Liu Howard T.","year":"1991","unstructured":"Howard T. Liu and John A . Silvester . 1991 . Dynamic resource allocation scheme for distributed heterogeneous computer systems. Patent No. 5,031,089, Filed July 9, 1991. Howard T. Liu and John A. Silvester. 1991. Dynamic resource allocation scheme for distributed heterogeneous computer systems. Patent No. 5,031,089, Filed July 9, 1991."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-014-9314-7"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2637364.2592019"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1998582.1998604"},{"key":"e_1_2_1_49_1","volume-title":"Proc. 11th IEEE\/ACM Int. Conf. on Grid Computing (GRID 10)","author":"Mao Ming","year":"2010","unstructured":"Ming Mao , Jie Li , and M. Humphrey . 2010. Cloud auto-scaling with deadline and budget constraints . In Proc. 11th IEEE\/ACM Int. Conf. on Grid Computing (GRID 10) . 41--48. DOI:http:\/\/dx.doi.org\/10.1109\/GRID. 2010 .5697966 10.1109\/GRID.2010.5697966 Ming Mao, Jie Li, and M. Humphrey. 2010. Cloud auto-scaling with deadline and budget constraints. In Proc. 11th IEEE\/ACM Int. Conf. on Grid Computing (GRID 10). 41--48. DOI:http:\/\/dx.doi.org\/10.1109\/GRID.2010.5697966"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1891719.1891722"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2010.32"},{"key":"e_1_2_1_52_1","unstructured":"Domas Mituzas. 2007. Page view statistics for Wikimedia projects. (2007). http:\/\/dumps.wikimedia.org\/ other\/pagecounts-raw\/ {Online; accessed 2014-11-20}.  Domas Mituzas. 2007. Page view statistics for Wikimedia projects. (2007). http:\/\/dumps.wikimedia.org\/ other\/pagecounts-raw\/ {Online; accessed 2014-11-20}."},{"key":"e_1_2_1_53_1","volume-title":"Probabilistic and Randomized Methods for Design under Uncertainty","author":"Nemirovski Arkadi","unstructured":"Arkadi Nemirovski and Alexander Shapiro . 2006. Scenario approximations of chance constraints . In Probabilistic and Randomized Methods for Design under Uncertainty , Giuseppe Calafiore and Fabrizio Dabbene (Eds.). Springer , London , 3--47. DOI:http:\/\/dx.doi.org\/10.1007\/1-84628-095-8_1 10.1007\/1-84628-095-8_1 Arkadi Nemirovski and Alexander Shapiro. 2006. Scenario approximations of chance constraints. In Probabilistic and Randomized Methods for Design under Uncertainty, Giuseppe Calafiore and Fabrizio Dabbene (Eds.). Springer, London, 3--47. DOI:http:\/\/dx.doi.org\/10.1007\/1-84628-095-8_1"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1137\/050622328"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASCOTS.2014.32"},{"key":"e_1_2_1_56_1","volume-title":"Proc. 10th Int. Conf. on Autonomic Computing (ICAC 13)","author":"Nguyen Hiep","year":"2013","unstructured":"Hiep Nguyen , Zhiming Shen , Xiaohui Gu , Sethuraman Subbiah , and John Wilkes . 2013 . AGILE: Elastic distributed resource scaling for infrastructure-as-a-service . In Proc. 10th Int. Conf. on Autonomic Computing (ICAC 13) . USENIX, San Jose, CA, 69--82. https:\/\/www.usenix.org\/conference\/icac13\/technical-sessions\/presentation\/nguyen. Hiep Nguyen, Zhiming Shen, Xiaohui Gu, Sethuraman Subbiah, and John Wilkes. 2013. AGILE: Elastic distributed resource scaling for infrastructure-as-a-service. In Proc. 10th Int. Conf. on Autonomic Computing (ICAC 13). USENIX, San Jose, CA, 69--82. https:\/\/www.usenix.org\/conference\/icac13\/technical-sessions\/presentation\/nguyen."},{"key":"e_1_2_1_57_1","first-page":"2","article-title":"Introducing vagrant","volume":"220","author":"Palat Jay","year":"2012","unstructured":"Jay Palat . 2012 . Introducing vagrant . Linux J. 2012, 220 (2012), 2 . Jay Palat. 2012. Introducing vagrant. Linux J. 2012, 220 (2012), 2.","journal-title":"Linux"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.conengprac.2016.03.020"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2562059.2562131"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2016.03.019"},{"key":"e_1_2_1_61_1","unstructured":"Christian Papauschek. 2013. Real-world performance of the Play framework on EC2. (2013). http:\/\/blog.papauschek.com\/2013\/04\/real-world-performance-of-the-play-framework-on-ec2\/ {Online; accessed 2014-11-24}.  Christian Papauschek. 2013. Real-world performance of the Play framework on EC2. (2013). http:\/\/blog.papauschek.com\/2013\/04\/real-world-performance-of-the-play-framework-on-ec2\/ {Online; accessed 2014-11-24}."},{"key":"e_1_2_1_62_1","unstructured":"John Payne. 2014. C-MART:Benchmarking the Cloud. (2014). http:\/\/theone.ece.cmu.edu\/cmart\/ {Online; accessed 2014-11-20}.  John Payne. 2014. C-MART:Benchmarking the Cloud. (2014). http:\/\/theone.ece.cmu.edu\/cmart\/ {Online; accessed 2014-11-20}."},{"key":"e_1_2_1_63_1","volume-title":"Stochastic Programming (Handbooks in Operations Research and Management Science)","author":"Pr\u00e9kopa Andr\u00e1s","unstructured":"Andr\u00e1s Pr\u00e9kopa . 2003. Probabilistic programming . In Stochastic Programming (Handbooks in Operations Research and Management Science) , A. Ruszczy\u01f9ski and A. Shapiro (Eds.), Vol. 10 . Elsevier , London, UK , 267--351. DOI:http:\/\/dx.doi.org\/10.1016\/S0927-0507(03)10005-9 10.1016\/S0927-0507(03)10005-9 Andr\u00e1s Pr\u00e9kopa. 2003. Probabilistic programming. In Stochastic Programming (Handbooks in Operations Research and Management Science), A. Ruszczy\u01f9ski and A. Shapiro (Eds.), Vol. 10. Elsevier, London, UK, 267--351. DOI:http:\/\/dx.doi.org\/10.1016\/S0927-0507(03)10005-9"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2391229.2391236"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD.2011.42"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809049.1809053"},{"key":"e_1_2_1_67_1","unstructured":"R. Sturm W. Morris and M. Jander. 2000. Foundations of Service Level Management. SAMS.  R. Sturm W. Morris and M. Jander. 2000. Foundations of Service Level Management. SAMS."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2012.335"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICAC.2005.27"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1342171.1342172"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.5555\/822083.823227"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2012.46"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2013.17"},{"key":"e_1_2_1_74_1","unstructured":"John Wilkes. 2011. More Google Cluster Data. (2011). http:\/\/googleresearch.blogspot.com\/2011\/11\/more-google-cluster-data.html {Online; accessed 2014-10-30}.  John Wilkes. 2011. More Google Cluster Data. (2011). http:\/\/googleresearch.blogspot.com\/2011\/11\/more-google-cluster-data.html {Online; accessed 2014-10-30}."}],"container-title":["ACM Transactions on Modeling and Performance Evaluation of Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2930659","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2930659","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:56:25Z","timestamp":1750222585000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2930659"}},"subtitle":["A Performance Evaluation Framework for Auto-Scaling Strategies in Cloud Applications"],"short-title":[],"issued":{"date-parts":[[2016,8,2]]},"references-count":73,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,9,21]]}},"alternative-id":["10.1145\/2930659"],"URL":"https:\/\/doi.org\/10.1145\/2930659","relation":{},"ISSN":["2376-3639","2376-3647"],"issn-type":[{"value":"2376-3639","type":"print"},{"value":"2376-3647","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,8,2]]},"assertion":[{"value":"2015-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-08-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}