{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:30:35Z","timestamp":1750764635397},"reference-count":24,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2017,8]]},"abstract":"<jats:p>Today's web applications and social networks are serving billions of users around the globe. These users generate billions of key lookups and millions of data object updates per second. A single user's social network page load requires hundreds of key lookups. This scale creates many design challenges for the underlying storage systems. First, these systems have to serve user requests with low latency. Any increase in the request latency leads to a decrease in user interest. Second, storage systems have to be highly available. Failures should be handled seamlessly without affecting user requests. Third, users consume an order of magnitude more data than they produce. Therefore, storage systems have to be optimized for read-intensive workloads. To address these challenges, distributed in-memory caching services have been widely deployed on top of persistent storage. In this tutorial, we survey the recent developments in distributed caching services. We present the algorithmic and architectural efforts behind these systems focusing on the challenges in addition to open research questions.<\/jats:p>","DOI":"10.14778\/3137765.3137831","type":"journal-article","created":{"date-parts":[[2017,9,7]],"date-time":"2017-09-07T13:35:53Z","timestamp":1504791353000},"page":"2002-2005","source":"Crossref","is-referenced-by-count":4,"title":["Caching at the web scale"],"prefix":"10.14778","volume":"10","author":[{"given":"Victor","family":"Zakhary","sequence":"first","affiliation":[{"name":"UC Santa Barbara"}]},{"given":"Divyakant","family":"Agrawal","sequence":"additional","affiliation":[{"name":"UC Santa Barbara"}]},{"given":"Amr El","family":"Abbadi","sequence":"additional","affiliation":[{"name":"UC Santa Barbara"}]}],"member":"320","published-online":{"date-parts":[[2017,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Amazon elasticache in-memory data store and cache. https:\/\/aws.amazon.com\/elasticache\/.  Amazon elasticache in-memory data store and cache. https:\/\/aws.amazon.com\/elasticache\/."},{"key":"e_1_2_1_2_1","unstructured":"Azure redis cache. https:\/\/azure.microsoft.com\/en-us\/services\/cache\/.  Azure redis cache. https:\/\/azure.microsoft.com\/en-us\/services\/cache\/."},{"key":"e_1_2_1_3_1","unstructured":"Caching with twemcache. https:\/\/blog.twitter.com\/2012\/caching-with-twemcache\/.  Caching with twemcache. https:\/\/blog.twitter.com\/2012\/caching-with-twemcache\/."},{"key":"e_1_2_1_4_1","unstructured":"Facebook company info. http:\/\/newsroom.fb.com\/company-info\/.  Facebook company info. http:\/\/newsroom.fb.com\/company-info\/."},{"key":"e_1_2_1_5_1","unstructured":"Memcached. a distributed memory object caching system. https:\/\/memcached.org\/.  Memcached. a distributed memory object caching system. https:\/\/memcached.org\/."},{"key":"e_1_2_1_6_1","unstructured":"Memcachier. https:\/\/www.memcachier.com\/.  Memcachier. https:\/\/www.memcachier.com\/."},{"key":"e_1_2_1_7_1","unstructured":"Redis. http:\/\/redis.io\/.  Redis. http:\/\/redis.io\/."},{"key":"e_1_2_1_8_1","unstructured":"Twitter: number of active users 2010-2016. https:\/\/www.statista.com\/statistics\/282087\/number-of-monthly-active-twitter-users\/.  Twitter: number of active users 2010-2016. https:\/\/www.statista.com\/statistics\/282087\/number-of-monthly-active-twitter-users\/."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2318857.2254766"},{"key":"e_1_2_1_10_1","first-page":"49","volume-title":"Presented as part of the 2013 USENIX Annual Technical Conference (USENIX ATC 13)","author":"Bronson N.","year":"2013","unstructured":"N. Bronson , Z. Amsden , G. Cabrera , P. Chakka , P. Dimov , H. Ding , J. Ferris , A. Giardullo , S. Kulkarni , H. Li , et al. Tao: Facebooks distributed data store for the social graph . In Presented as part of the 2013 USENIX Annual Technical Conference (USENIX ATC 13) , pages 49 -- 60 , 2013 . N. Bronson, Z. Amsden, G. Cabrera, P. Chakka, P. Dimov, H. Ding, J. Ferris, A. Giardullo, S. Kulkarni, H. Li, et al. Tao: Facebooks distributed data store for the social graph. In Presented as part of the 2013 USENIX Annual Technical Conference (USENIX ATC 13), pages 49--60, 2013."},{"key":"e_1_2_1_11_1","volume-title":"7th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 15)","author":"Cidon A.","year":"2015","unstructured":"A. Cidon , A. Eisenman , M. Alizadeh , and S. Katti . Dynacache: Dynamic cloud caching . In 7th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 15) , 2015 . A. Cidon, A. Eisenman, M. Alizadeh, and S. Katti. Dynacache: Dynamic cloud caching. In 7th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 15), 2015."},{"key":"e_1_2_1_12_1","first-page":"379","volume-title":"13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16)","author":"Cidon A.","year":"2016","unstructured":"A. Cidon , A. Eisenman , M. Alizadeh , and S. Katti . Cliffhanger: Scaling performance cliffs in web memory caches . In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16) , pages 379 -- 392 , Santa Clara, CA , Mar. 2016 . USENIX Association. A. Cidon, A. Eisenman, M. Alizadeh, and S. Katti. Cliffhanger: Scaling performance cliffs in web memory caches. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16), pages 379--392, Santa Clara, CA, Mar. 2016. USENIX Association."},{"key":"e_1_2_1_13_1","first-page":"401","volume-title":"Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation","author":"Dragojevi\u0107 A.","year":"2014","unstructured":"A. Dragojevi\u0107 , D. Narayanan , O. Hodson , and M. Castro . Farm: Fast remote memory . In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation , pages 401 -- 414 , 2014 . A. Dragojevi\u0107, D. Narayanan, O. Hodson, and M. Castro. Farm: Fast remote memory. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation, pages 401--414, 2014."},{"key":"e_1_2_1_14_1","first-page":"371","volume-title":"Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13)","author":"Fan B.","year":"2013","unstructured":"B. Fan , D. G. Andersen , and M. Kaminsky . Memc3: Compact and concurrent memcache with dumber caching and smarter hashing . In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13) , pages 371 -- 384 , 2013 . B. Fan, D. G. Andersen, and M. Kaminsky. Memc3: Compact and concurrent memcache with dumber caching and smarter hashing. In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13), pages 371--384, 2013."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522722"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772751"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2592798.2592820"},{"key":"e_1_2_1_18_1","first-page":"429","volume-title":"11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14)","author":"Lim H.","year":"2014","unstructured":"H. Lim , D. Han , D. G. Andersen , and M. Kaminsky . Mica: a holistic approach to fast in-memory key-value storage . In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) , pages 429 -- 444 , 2014 . H. Lim, D. Han, D. G. Andersen, and M. Kaminsky. Mica: a holistic approach to fast in-memory key-value storage. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14), pages 429--444, 2014."},{"key":"e_1_2_1_19_1","first-page":"115","volume-title":"FAST","volume":"3","author":"Megiddo N.","year":"2003","unstructured":"N. Megiddo and D. S. Modha . Arc: A self-tuning, low overhead replacement cache . In FAST , volume 3 , pages 115 -- 130 , 2003 . N. Megiddo and D. S. Modha. Arc: A self-tuning, low overhead replacement cache. In FAST, volume 3, pages 115--130, 2003."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370036.2145874"},{"key":"e_1_2_1_21_1","first-page":"385","volume-title":"Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13)","author":"Nishtala R.","year":"2013","unstructured":"R. Nishtala , H. Fugal , S. Grimm , M. Kwiatkowski , H. Lee , H. C. Li , R. McElroy , M. Paleczny , D. Peek , P. Saab , Scaling memcache at facebook . In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13) , pages 385 -- 398 , 2013 . R. Nishtala, H. Fugal, S. Grimm, M. Kwiatkowski, H. Lee, H. C. Li, R. McElroy, M. Paleczny, D. Peek, P. Saab, et al. Scaling memcache at facebook. In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13), pages 385--398, 2013."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jalgor.2003.12.002"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901318.2901332"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2427795"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3137765.3137831","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:04:56Z","timestamp":1672221896000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3137765.3137831"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8]]},"references-count":24,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2017,8]]}},"alternative-id":["10.14778\/3137765.3137831"],"URL":"https:\/\/doi.org\/10.14778\/3137765.3137831","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2017,8]]}}}