{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T18:26:58Z","timestamp":1768588018504,"version":"3.49.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2006,6,1]],"date-time":"2006-06-01T00:00:00Z","timestamp":1149120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Database Syst."],"published-print":{"date-parts":[[2006,6]]},"abstract":"<jats:p>Wide area data delivery requires timely propagation of up-to-date information to thousands of clients over a wide area network. Applications include web caching, RSS source monitoring, and email access via a mobile network. Data sources vary widely in their update patterns and may experience different update rates at different times or unexpected changes to update patterns. Traditional data delivery solutions are either push-based, which requires servers to push updates to clients, or pull-based, which require clients to check for updates at servers. While push-based solutions ensure timely data delivery, they are not always feasible to implement and may not scale to a large number of clients. In this article, we present adaptive pull-based policies that explicitly aim to reduce the overhead of contacting remote servers, compared to existing pull-based policies, while meeting freshness requirements. We model updates to data sources using update histories, and present two novel history-based policies to estimate when updates occur; they are based on individual history and aggregate history. These policies are presented within an architectural framework that supports their deployment either client-side or server-side. We further develop two adaptive policies to handle objects that initially may have insufficient history or objects that experience changes in update patterns. Extensive experimental evaluation using three data traces from diverse applications shows that history-based policies can reduce contact between clients and servers by up to 60% compared to existing pull-based policies while providing a comparable level of data freshness. Our experiments further demonstrate that our adaptive policies can select the best policy to match the behavior of an object and perform better than any individual policy, thus they dominate standalone policies.<\/jats:p>","DOI":"10.1145\/1138394.1138399","type":"journal-article","created":{"date-parts":[[2006,7,25]],"date-time":"2006-07-25T14:14:26Z","timestamp":1153836866000},"page":"631-671","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["Adaptive pull-based policies for wide area data delivery"],"prefix":"10.1145","volume":"31","author":[{"given":"Laura","family":"Bright","sequence":"first","affiliation":[{"name":"Portland State University, Portland, OR"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Avigdor","family":"Gal","sequence":"additional","affiliation":[{"name":"Technion---Israel Institute of Technology, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louiqa","family":"Raschid","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, MD"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2006,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/88636.87848"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 5th International Workshop on the Web and Databases (WebDB). 37--42","author":"Amiri K.","unstructured":"Amiri , K. , Tewari , R. , Park , S. , and Padmanabhan , S . 2002. On space management in a dynamic edge data cache . In Proceedings of the 5th International Workshop on the Web and Databases (WebDB). 37--42 . Amiri, K., Tewari, R., Park, S., and Padmanabhan, S. 2002. On space management in a dynamic edge data cache. In Proceedings of the 5th International Workshop on the Web and Databases (WebDB). 37--42."},{"key":"e_1_2_1_3_1","unstructured":"Arlitt M. and Jin T. 1998. 1998 world cup web site access logs. (Available at http:\/\/www.acm.org\/sigcomm\/ITA\/).  Arlitt M. and Jin T. 1998. 1998 world cup web site access logs. (Available at http:\/\/www.acm.org\/sigcomm\/ITA\/)."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 23rd Conference on Very Large Data Bases (VLDB). 156--165","author":"Baralis E.","unstructured":"Baralis , E. , Paraboschi , S. , and Teniente , E . 1997. Materialized view selection in a multidimensional database . In Proceedings of the 23rd Conference on Very Large Data Bases (VLDB). 156--165 . Baralis, E., Paraboschi, S., and Teniente, E. 1997. Materialized view selection in a multidimensional database. In Proceedings of the 23rd Conference on Very Large Data Bases (VLDB). 156--165."},{"key":"e_1_2_1_5_1","unstructured":"BlackBerry. 2005. BlackBerry Wireless Handhelds. http:\/\/www.blackberry.com.  BlackBerry. 2005. BlackBerry Wireless Handhelds. http:\/\/www.blackberry.com."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/570790.570805"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 28th Conference on Very Large Data Bases (VLDB). 550--561","author":"Bright L.","unstructured":"Bright , L. and Raschid , L . 2002. Using latency-recency profiles for data delivery on the web . In Proceedings of the 28th Conference on Very Large Data Bases (VLDB). 550--561 . Bright, L. and Raschid, L. 2002. Using latency-recency profiles for data delivery on the web. In Proceedings of the 28th Conference on Very Large Data Bases (VLDB). 550--561."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/375663.375736"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 19th International Conference on Data Engineering (ICDE). 481--492","author":"Carney D.","unstructured":"Carney , D. , Lee , S. , and Zdonik , S . 2003. Scalable application-aware data freshening . In Proceedings of the 19th International Conference on Data Engineering (ICDE). 481--492 . Carney, D., Lee, S., and Zdonik, S. 2003. Scalable application-aware data freshening. In Proceedings of the 19th International Conference on Data Engineering (ICDE). 481--492."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the USENIX File System Workshop. 1--12","author":"Cate V.","year":"1992","unstructured":"Cate , V. 1992 . Alex---A global filesystem . In Proceedings of the USENIX File System Workshop. 1--12 . Cate, V. 1992. Alex---A global filesystem. In Proceedings of the USENIX File System Workshop. 1--12."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of IEEE INFOCOM. IEEE Computer Society Press","author":"Challenger J.","unstructured":"Challenger , J. , Iyengar , A. , and Dantzig , P . 1999. A scalable system for consistently caching dynamic web data . In Proceedings of IEEE INFOCOM. IEEE Computer Society Press , Los Alamitos, CA, 294--303. Challenger, J., Iyengar, A., and Dantzig, P. 1999. A scalable system for consistently caching dynamic web data. In Proceedings of IEEE INFOCOM. IEEE Computer Society Press, Los Alamitos, CA, 294--303."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335391"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/857166.857170"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 28th International Conference on Very Large Data Bases (VLDB). 514--525","author":"Cho J.","unstructured":"Cho , J. and Ntoulas , A . 2002. Effective change detection using sampling . In Proceedings of the 28th International Conference on Very Large Data Bases (VLDB). 514--525 . Cho, J. and Ntoulas, A. 2002. Effective change detection using sampling. In Proceedings of the 28th International Conference on Very Large Data Bases (VLDB). 514--525."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of IEEE INFOCOM. IEEE Computer Society Press","author":"Cohen E.","unstructured":"Cohen , E. and Kaplan , H . 2001. Refreshment policies for web content caches . In Proceedings of IEEE INFOCOM. IEEE Computer Society Press , Los Alamitos, CA, 1398--1406. Cohen, E. and Kaplan, H. 2001. Refreshment policies for web content caches. In Proceedings of IEEE INFOCOM. IEEE Computer Society Press, Los Alamitos, CA, 1398--1406."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372066"},{"key":"e_1_2_1_18_1","volume-title":"Tech. Rep. RRR 16-2005, RUTCOR","author":"Eckstein J.","year":"2005","unstructured":"Eckstein , J. , Gal , A. , and Reiner , S . 2005 . Optimal information monitoring under a politeness constraint. Tech. Rep. RRR 16-2005, RUTCOR , Rutgers University , Piscataway, NJ . Eckstein, J., Gal, A., and Reiner, S. 2005. Optimal information monitoring under a politeness constraint. Tech. Rep. RRR 16-2005, RUTCOR, Rutgers University, Piscataway, NJ."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/261124.261125"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/276304.276360"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/504794.504797"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/645502.656089"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the USENIX Technical Conference. 141--152","author":"Gwertzman J.","unstructured":"Gwertzman , J. and Seltzer , M . 1996. World wide web cache consistency . In Proceedings of the USENIX Technical Conference. 141--152 . Gwertzman, J. and Seltzer, M. 1996. World wide web cache consistency. In Proceedings of the USENIX Technical Conference. 141--152."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/233269.233333"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/35037.35059"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the Conference on Parallel and Distributed Information Systems (PDIS). 131--139","author":"Huang Y.","unstructured":"Huang , Y. , Sloan , R. , and Wolfson , O . 1994. Divergence caching in client-server architectures . In Proceedings of the Conference on Parallel and Distributed Information Systems (PDIS). 131--139 . Huang, Y., Sloan, R., and Wolfson, O. 1994. Divergence caching in client-server architectures. In Proceedings of the Conference on Parallel and Distributed Information Systems (PDIS). 131--139."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/139669.139676"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the USENIX Symposium on Internet Technologies and Systems, 1--12","author":"Krishnamurthy B.","unstructured":"Krishnamurthy , B. and Wills , C . 1997. Study of piggyback cache validation for proxy caches in the world wide web . In Proceedings of the USENIX Symposium on Internet Technologies and Systems, 1--12 . Krishnamurthy, B. and Wills, C. 1997. Study of piggyback cache validation for proxy caches in the world wide web. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, 1--12."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). 391--400","author":"Labrinidis A.","unstructured":"Labrinidis , A. and Roussopoulos , N . 2001. Update propagation strategies for improving the quality of data on the web . In Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). 391--400 . Labrinidis, A. and Roussopoulos, N. 2001. Update propagation strategies for improving the quality of data on the web. In Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). 391--400."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/9.763211"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the Conference on Web Information Systems Engineering (WISE). 21--29","author":"Lee J.-J.","unstructured":"Lee , J.-J. , Whang , K.-Y. , Lee , B. S. , and Chang , J . -W. 2002. An update-risk based approach to TTL estimation in web caching . In Proceedings of the Conference on Web Information Systems Engineering (WISE). 21--29 . Lee, J.-J., Whang, K.-Y., Lee, B. S., and Chang, J.-W. 2002. An update-risk based approach to TTL estimation in web caching. In Proceedings of the Conference on Web Information Systems Engineering (WISE). 21--29."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS). IEEE Computer Society Press","author":"Liu C.","unstructured":"Liu , C. and Cao , P . 1997. Maintaining strong cache consistency in the world wide web . In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS). IEEE Computer Society Press , Los Alamitos, CA, 12--21. Liu, C. and Cao, P. 1997. Maintaining strong cache consistency in the world wide web. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS). IEEE Computer Society Press, Los Alamitos, CA, 12--21."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1080\/00224065.2003.11980190"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/35037.42183"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/qre.4680080605"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/375663.375710"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/564691.564701"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 30th International Conference on Very Large Data Bases (VLDB). 360--371","author":"Pandey S.","unstructured":"Pandey , S. , Dhamdhere , K. , and Olston , C . 2004. WIC: A general purpose algorithm for monitoring web information sources . In Proceedings of the 30th International Conference on Very Large Data Bases (VLDB). 360--371 . Pandey, S., Dhamdhere, K., and Olston, C. 2004. WIC: A general purpose algorithm for monitoring web information sources. In Proceedings of the 30th International Conference on Very Large Data Bases (VLDB). 360--371."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/775152.775245"},{"key":"e_1_2_1_40_1","first-page":"515","article-title":"A general approach to modeling CUSUM charts for a proportion","volume":"32","author":"Reynolds Jr., M.","year":"2000","unstructured":"Reynolds , Jr., M. and Stoumbos , Z. 2000 . A general approach to modeling CUSUM charts for a proportion . IIE Transactions on Quality and Reliability Engineering 32 , 515 -- 535 . Reynolds, Jr., M. and Stoumbos, Z. 2000. A general approach to modeling CUSUM charts for a proportion. IIE Transactions on Quality and Reliability Engineering 32, 515--535.","journal-title":"IIE Transactions on Quality and Reliability Engineering"},{"key":"e_1_2_1_41_1","volume-title":"Stochastic Processes","author":"Ross S.","unstructured":"Ross , S. 1995. Stochastic Processes , second ed. Wiley , New York . Ross, S. 1995. Stochastic Processes, second ed. Wiley, New York."},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Stoumbos Z. Jr. M. R. and Woodall W. 2003. Control chart schemes for monitoring the mean and variance of processes subject to sustained shifts and drifts. The Handbook of Statistics: Statistics in Industry 22. C.R. Rao and R. Khattree (eds.).  Stoumbos Z. Jr. M. R. and Woodall W. 2003. Control chart schemes for monitoring the mean and variance of processes subject to sustained shifts and drifts. The Handbook of Statistics: Statistics in Industry 22. C.R. Rao and R. Khattree (eds.).","DOI":"10.1016\/S0169-7161(03)22015-0"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Taylor H. and Karlin S. 1994. An Introduction to Stochastic Modeling. Academic Press Orlando FL.  Taylor H. and Karlin S. 1994. An Introduction to Stochastic Modeling. Academic Press Orlando FL.","DOI":"10.1016\/B978-0-12-684885-4.50007-0"},{"key":"e_1_2_1_44_1","unstructured":"Wessels D. 1996. Squid internet object cache. http:\/\/www.squid-cache.org.  Wessels D. 1996. Squid internet object cache. http:\/\/www.squid-cache.org."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.2307\/1269915"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.371935"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of IEEE INFOCOM. IEEE Computer Society Press","author":"Zhu H.","unstructured":"Zhu , H. and Yang , T . 2001. Class-based cache management for dynamic web content . In Proceedings of IEEE INFOCOM. IEEE Computer Society Press , Los Alamitos, CA, 1215--1224. Zhu, H. and Yang, T. 2001. Class-based cache management for dynamic web content. In Proceedings of IEEE INFOCOM. IEEE Computer Society Press, Los Alamitos, CA, 1215--1224."}],"container-title":["ACM Transactions on Database Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1138394.1138399","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1138394.1138399","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:18:41Z","timestamp":1750263521000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1138394.1138399"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,6]]},"references-count":46,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2006,6]]}},"alternative-id":["10.1145\/1138394.1138399"],"URL":"https:\/\/doi.org\/10.1145\/1138394.1138399","relation":{},"ISSN":["0362-5915","1557-4644"],"issn-type":[{"value":"0362-5915","type":"print"},{"value":"1557-4644","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,6]]},"assertion":[{"value":"2006-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}