{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:01:55Z","timestamp":1750309315737,"version":"3.41.0"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2023,10,30]]},"abstract":"<jats:p>Modern cloud services aim to find the middle ground between quality of service and operational cost efficiency by allocating resources if and only if these resources are needed by the customers. Unfortunately, most industrial demand-driven resource allocation approaches are reactive. Given that scaling mechanisms are not instantaneous, the reactive policy may introduce delays to latency-sensitive customer workloads and waste operational costs for cloud service providers. To solve this catch-22, we define the proactive resource allocation policy for Microsoft Azure Cognitive Search. In addition to the current resource demand, the proactive policy takes the typical resource usage patterns into account. We gained the following valuable insights from these patterns over several months of production workloads. One, 87% of the workload is stable due to continuous resource demand. Two, 90% of varying demand is predictable based on a few weeks of historical traces. Three, resources can be reclaimed 52% of the time due to extensive idle intervals of varying workload. Given the size and scope of our analysis, we believe that our approach applies to any latency-sensitive cloud service.<\/jats:p>","DOI":"10.1145\/3631504.3631516","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T14:48:51Z","timestamp":1698936531000},"page":"41-48","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Proactive Resource Allocation Policy for Microsoft Azure Cognitive Search"],"prefix":"10.1145","volume":"52","author":[{"given":"Olga","family":"Poppe","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pablo","family":"Castro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Willis","family":"Lang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jyoti","family":"Leeka","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,11,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"https:\/\/azure.microsoft.com\/enus\/ services\/search\/","author":"Search Azure Cognitive","year":"2023","unstructured":"Azure Cognitive Search . https:\/\/azure.microsoft.com\/enus\/ services\/search\/ , 2023 . Azure Cognitive Search. https:\/\/azure.microsoft.com\/enus\/ services\/search\/, 2023."},{"key":"e_1_2_1_2_1","volume-title":"https:\/\/docs.microsoft.com\/enus\/ azure\/search\/search-what-is-azure-search","author":"Search Documentation Azure Cognitive","year":"2023","unstructured":"Azure Cognitive Search Documentation . https:\/\/docs.microsoft.com\/enus\/ azure\/search\/search-what-is-azure-search , 2023 . Azure Cognitive Search Documentation. https:\/\/docs.microsoft.com\/enus\/ azure\/search\/search-what-is-azure-search, 2023."},{"key":"e_1_2_1_3_1","volume-title":"https:\/\/docs.microsoft.com\/enus\/ azure\/azure-sql\/database\/serverless-tieroverview","author":"Database Serverless Azure SQL","year":"2023","unstructured":"Azure SQL Database Serverless . https:\/\/docs.microsoft.com\/enus\/ azure\/azure-sql\/database\/serverless-tieroverview , 2023 . Azure SQL Database Serverless. https:\/\/docs.microsoft.com\/enus\/ azure\/azure-sql\/database\/serverless-tieroverview, 2023."},{"key":"e_1_2_1_4_1","volume-title":"https:\/\/cloud.google.com\/serverless","author":"Computing Google Serverless","year":"2023","unstructured":"Google Serverless Computing . https:\/\/cloud.google.com\/serverless , 2023 . Google Serverless Computing. https:\/\/cloud.google.com\/serverless, 2023."},{"key":"e_1_2_1_5_1","volume-title":"https:\/\/docs.microsoft.com\/enus\/ dotnet\/api\/microsoft.ml.trainers.fasttree. fastforestbinarytrainer","author":"Binary Trainer ML.NET","year":"2023","unstructured":"ML.NET Binary Trainer . https:\/\/docs.microsoft.com\/enus\/ dotnet\/api\/microsoft.ml.trainers.fasttree. fastforestbinarytrainer , 2023 . ML.NET Binary Trainer. https:\/\/docs.microsoft.com\/enus\/ dotnet\/api\/microsoft.ml.trainers.fasttree. fastforestbinarytrainer, 2023."},{"key":"e_1_2_1_6_1","volume-title":"https:\/\/docs.microsoft.com\/enus\/ python\/api\/nimbusml\/nimbusml.timeseries. ssaforecaster","author":"ML.","year":"2023","unstructured":"Nimbus ML. https:\/\/docs.microsoft.com\/enus\/ python\/api\/nimbusml\/nimbusml.timeseries. ssaforecaster , 2023 . NimbusML. https:\/\/docs.microsoft.com\/enus\/ python\/api\/nimbusml\/nimbusml.timeseries. ssaforecaster, 2023."},{"key":"e_1_2_1_7_1","volume-title":"https:\/\/aws.amazon.com\/serverless\/","author":"Serverless","year":"2023","unstructured":"Serverless on AWS. https:\/\/aws.amazon.com\/serverless\/ , 2023 . Serverless on AWS. https:\/\/aws.amazon.com\/serverless\/, 2023."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2014.2350475"},{"key":"e_1_2_1_9_1","volume-title":"SOSP, page 153--167","author":"Cortez E.","year":"2017","unstructured":"E. Cortez , A. Bonde , A. Muzio , M. Russinovich , M. Fontoura , and R. Bianchini . Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms . In SOSP, page 153--167 , 2017 . E. Cortez, A. Bonde, A. Muzio, M. Russinovich, M. Fontoura, and R. Bianchini. Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms. In SOSP, page 153--167, 2017."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2903733"},{"issue":"4","key":"e_1_2_1_11_1","first-page":"127","article-title":"Quasar","volume":"49","author":"Delimitrou C.","year":"2014","unstructured":"C. Delimitrou and C. Kozyrakis . Quasar : Resource-Efficient and QoS-Aware Cluster Management. SIGPLAN Not. , 49 ( 4 ): 127 -- 144 , 2014 . C. Delimitrou and C. Kozyrakis. Quasar: Resource-Efficient and QoS-Aware Cluster Management. SIGPLAN Not., 49(4):127--144, 2014.","journal-title":"Resource-Efficient and QoS-Aware Cluster Management. SIGPLAN Not."},{"key":"e_1_2_1_12_1","first-page":"1825","volume-title":"Proc. VLDB Endow.","author":"Floratou A.","year":"2017","unstructured":"A. Floratou , A. Agrawal , B. Graham , S. Rao , and K. Ramasamy . Dhalion: Self-Regulating Stream Processing in Heron . In Proc. VLDB Endow. , pages 1825 -- 1836 , 2017 . A. Floratou, A. Agrawal, B. Graham, S. Rao, and K. Ramasamy. Dhalion: Self-Regulating Stream Processing in Heron. In Proc. VLDB Endow., pages 1825--1836, 2017."},{"key":"e_1_2_1_13_1","first-page":"9","volume-title":"TNSM","author":"Gong Z.","year":"2010","unstructured":"Z. Gong , X. Gu , and J. Wilkes . PRESS: PRedictive Elastic ReSource Scaling for cloud systems . In TNSM , pages 9 -- 16 , 2010 . Z. Gong, X. Gu, and J. Wilkes. PRESS: PRedictive Elastic ReSource Scaling for cloud systems. In TNSM, pages 9--16, 2010."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2011.05.027"},{"key":"e_1_2_1_15_1","first-page":"1287","volume-title":"Workload Characterization and Prediction in the Cloud: A Multiple Time Series Approach. In IEEE Network Operations and Management Symposium","author":"Khan A.","year":"2012","unstructured":"A. Khan , X. Yan , S. Tao , and N. Anerousis . Workload Characterization and Prediction in the Cloud: A Multiple Time Series Approach. In IEEE Network Operations and Management Symposium , pages 1287 -- 1294 , 2012 . A. Khan, X. Yan, S. Tao, and N. Anerousis. Workload Characterization and Prediction in the Cloud: A Multiple Time Series Approach. In IEEE Network Operations and Management Symposium, pages 1287--1294, 2012."},{"key":"e_1_2_1_16_1","volume-title":"WWW, page 83--91","author":"Kilcioglu C.","year":"2017","unstructured":"C. Kilcioglu , J. M. Rao , A. Kannan , and R. P. McAfee . Usage Patterns and the Economics of the Public Cloud . In WWW, page 83--91 , 2017 . C. Kilcioglu, J. M. Rao, A. Kannan, and R. P. McAfee. Usage Patterns and the Economics of the Public Cloud. In WWW, page 83--91, 2017."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007264"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1773394.1773400"},{"key":"e_1_2_1_19_1","first-page":"2543","volume-title":"SIGMOD","author":"Moeller J.","year":"2021","unstructured":"J. Moeller , Z. Ye , K. Lin , and W. Lang . Toto - Benchmarking the Efficiency of a Cloud Service . In SIGMOD , pages 2543 -- 2556 , 2021 . J. Moeller, Z. Ye, K. Lin, and W. Lang. Toto - Benchmarking the Efficiency of a Cloud Service. In SIGMOD, pages 2543--2556, 2021."},{"key":"e_1_2_1_20_1","volume-title":"EuroSys, page 13--26","author":"Padala P.","year":"2009","unstructured":"P. Padala , K.-Y. Hou , K. G. Shin , X. Zhu , M. Uysal , Z. Wang , S. Singhal , and A. Merchant . Automated Control of Multiple Virtualized Resources . In EuroSys, page 13--26 , 2009 . P. Padala, K.-Y. Hou, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, and A. Merchant. Automated Control of Multiple Virtualized Resources. In EuroSys, page 13--26, 2009."},{"key":"e_1_2_1_21_1","volume-title":"SIGMOD, page 811--823","author":"Picado J.","year":"2018","unstructured":"J. Picado , W. Lang , and E. C. Thayer . Survivability of Cloud Databases - Factors and Prediction . In SIGMOD, page 811--823 , 2018 . J. Picado, W. Lang, and E. C. Thayer. Survivability of Cloud Databases - Factors and Prediction. In SIGMOD, page 811--823, 2018."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/3425879.3425886"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/3514061.3514073"},{"key":"e_1_2_1_24_1","first-page":"1","volume-title":"SOCC","author":"Reiss C.","year":"2012","unstructured":"C. Reiss , A. Tumanov , G. R. Ganger , R. H. Katz , and M. A. Kozuch . Heterogeneity and Dynamicity of Clouds at Scale: Google Trace Analysis . In SOCC , pages 1 -- 13 , 2012 . C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch. Heterogeneity and Dynamicity of Clouds at Scale: Google Trace Analysis. In SOCC, pages 1--13, 2012."},{"key":"e_1_2_1_25_1","unstructured":"F. Romero G. I. Chaudhry I. Goiri P. Gopa P. Batum N. J. Yadwadkar R. Fonseca F. Romero G. I. Chaudhry I. Goiri P. Gopa P. Batum N. J. Yadwadkar R. Fonseca"},{"key":"e_1_2_1_26_1","first-page":"500","volume-title":"CLOUD","author":"Roy N.","year":"2011","unstructured":"N. Roy , A. Dubey , and A. Gokhale . Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting . In CLOUD , pages 500 -- 507 , 2011 . N. Roy, A. Dubey, and A. Gokhale. Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting. In CLOUD, pages 500--507, 2011."},{"key":"e_1_2_1_27_1","first-page":"205","volume-title":"USENIX","author":"Shahrad M.","year":"2020","unstructured":"M. Shahrad , R. Fonseca , I. Goiri , G. Chaudhry , P. Batum , J. Cooke , E. Laureano , C. Tresness , M. Russinovich , and R. Bianchini . Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider. In A. Gavrilovska and E. Zadok, editors , USENIX , pages 205 -- 218 . USENIX Association , 2020 . M. Shahrad, R. Fonseca, I. Goiri, G. Chaudhry, P. Batum, J. Cooke, E. Laureano, C. Tresness, M. Russinovich, and R. Bianchini. Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider. In A. Gavrilovska and E. Zadok, editors, USENIX, pages 205--218. USENIX Association, 2020."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038916.2038921"},{"key":"e_1_2_1_29_1","volume-title":"SIGMOD, page 205--219","author":"Taft R.","year":"2018","unstructured":"R. Taft , N. El-Sayed , M. Serafini , Y. Lu , A. Aboulnaga , M. Stonebraker , R. Mayerhofer , and F. Andrade . P-Store: An Elastic Database System with Predictive Provisioning . In SIGMOD, page 205--219 , 2018 . R. Taft, N. El-Sayed, M. Serafini, Y. Lu, A. Aboulnaga, M. Stonebraker, R. Mayerhofer, and F. Andrade. P-Store: An Elastic Database System with Predictive Provisioning. In SIGMOD, page 205--219, 2018."},{"key":"e_1_2_1_30_1","first-page":"1111","volume-title":"ICDE","author":"Viswanathan L.","year":"2017","unstructured":"L. Viswanathan , B. Chandra , W. Lang , K. Ramachandra , J. M. Patel , A. Kalhan , D. J. DeWitt , and A. Halverson . Predictive Provisioning: Efficiently Anticipating Usage in Azure SQL Database . In ICDE , pages 1111 -- 1116 , 2017 L. Viswanathan, B. Chandra, W. Lang, K. Ramachandra, J. M. Patel, A. Kalhan, D. J. DeWitt, and A. Halverson. Predictive Provisioning: Efficiently Anticipating Usage in Azure SQL Database. In ICDE, pages 1111--1116, 2017"}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631504.3631516","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631504.3631516","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:53Z","timestamp":1750291433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631504.3631516"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":30,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,10,30]]}},"alternative-id":["10.1145\/3631504.3631516"],"URL":"https:\/\/doi.org\/10.1145\/3631504.3631516","relation":{},"ISSN":["0163-5808"],"issn-type":[{"type":"print","value":"0163-5808"}],"subject":[],"published":{"date-parts":[[2023,10,30]]},"assertion":[{"value":"2023-11-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}