{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,10]],"date-time":"2025-05-10T23:01:02Z","timestamp":1746918062481},"reference-count":26,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2016,8]]},"abstract":"<jats:p>Windowed aggregates are a SQL 2003 feature for computing aggregates in moving windows. Common examples include cumulative sums, local maxima and moving quantiles. With the advent over the last few years of easy-to-use data analytics tools, these functions are becoming widely used by more and more analysts, but some aggregates (such as local maxima) are much easier to compute than others (such as moving quantiles). Nevertheless, aggregates that are more difficult to compute, like quantile and mode (or \"most frequent\") provide more appropriate statistical summaries in the common situation when a distribution is not Gaussian and are an essential part of a data analysis toolkit.<\/jats:p>\n          <jats:p>\n            Recent work has described highly efficient windowed implementations of the most common aggregate function categories, including\n            <jats:italic>distributive<\/jats:italic>\n            <jats:sup>1<\/jats:sup>\n            aggregates such as cumulative sums and algebraic aggregates such as moving averages. But little has been published on either the implementation or the performance of the more complex\n            <jats:italic>holistic<\/jats:italic>\n            windowed aggregates such as moving quantiles.\n          <\/jats:p>\n          <jats:p>This paper provides the first in-depth study of how to efficiently implement the three most common holistic windowed aggregates (count distinct, mode and quantile) by reusing the aggregate state between consecutive frames. Our measurements show that these incremental algorithms generally achieve improvements of about 10x over na\u00efve implementations, and that they can effectively detect when to reset the internal state during extreme frame variation.<\/jats:p>","DOI":"10.14778\/2994509.2994537","type":"journal-article","created":{"date-parts":[[2016,9,6]],"date-time":"2016-09-06T15:27:03Z","timestamp":1473175623000},"page":"1221-1232","source":"Crossref","is-referenced-by-count":17,"title":["Incremental computation of common windowed holistic aggregates"],"prefix":"10.14778","volume":"9","author":[{"given":"Richard","family":"Wesley","sequence":"first","affiliation":[{"name":"Tableau Software, Seattle, WA"}]},{"given":"Fei","family":"Xu","sequence":"additional","affiliation":[{"name":"Tableau Software, Seattle, WA"}]}],"member":"320","published-online":{"date-parts":[[2016,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"http:\/\/docs.oracle.com\/database\/121\/DWHSG\/analysis.htm.  http:\/\/docs.oracle.com\/database\/121\/DWHSG\/analysis.htm."},{"key":"e_1_2_1_2_1","unstructured":"https:\/\/msdn.microsoft.com\/en-us\/library\/ms189461(v=sql.120).aspx.  https:\/\/msdn.microsoft.com\/en-us\/library\/ms189461(v=sql.120).aspx."},{"key":"e_1_2_1_3_1","unstructured":"http:\/\/www-01.ibm.com\/support\/knowledgecenter\/SSEPGG_10.5.0\/com.ibm.db2.luw.sql.ref.doc\/doc\/r0023461.html.  http:\/\/www-01.ibm.com\/support\/knowledgecenter\/SSEPGG_10.5.0\/com.ibm.db2.luw.sql.ref.doc\/doc\/r0023461.html."},{"key":"e_1_2_1_4_1","unstructured":"https:\/\/help.sap.com\/hana\/SAP_HANA_SQL_and_System_Views_Reference_en.pdf?original_fqdn=help.sap.de.  https:\/\/help.sap.com\/hana\/SAP_HANA_SQL_and_System_Views_Reference_en.pdf?original_fqdn=help.sap.de."},{"key":"e_1_2_1_5_1","unstructured":"http:\/\/www.postgresql.org\/docs\/9.4\/static\/tutorial-window.html.  http:\/\/www.postgresql.org\/docs\/9.4\/static\/tutorial-window.html."},{"key":"e_1_2_1_6_1","unstructured":"https:\/\/www.monetdb.org\/Documentation\/Manuals\/SQLreference\/WindowFunctions.  https:\/\/www.monetdb.org\/Documentation\/Manuals\/SQLreference\/WindowFunctions."},{"key":"e_1_2_1_7_1","unstructured":"http:\/\/onlinehelp.tableau.com\/current\/pro\/online\/windows\/en-us\/functions_functions_tablecalculation.html.  http:\/\/onlinehelp.tableau.com\/current\/pro\/online\/windows\/en-us\/functions_functions_tablecalculation.html."},{"key":"e_1_2_1_8_1","unstructured":"https:\/\/docs.tibco.com\/pub\/spotfire\/6.0.0-november-2013\/userguide-webhelp\/ncfe\/ncfe_advanced_custom_expressions.htm.  https:\/\/docs.tibco.com\/pub\/spotfire\/6.0.0-november-2013\/userguide-webhelp\/ncfe\/ncfe_advanced_custom_expressions.htm."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350243"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/800296.811515"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/545381.545466"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/360680.360694"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.273032"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/1076260"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/366622.366647"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070736.2070747"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882957"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767867"},{"key":"e_1_2_1_19_1","volume-title":"Open-Source SQL Engine for Hadoop. In CIDR 2015, Seventh Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4-7, 2015, Online Proceedings","author":"Kornacker M.","year":"2015","unstructured":"M. Kornacker , A. Behm , V. Bittorf , T. Bobrovytsky , C. Ching , A. Choi , J. Erickson , M. Grund , D. Hecht , M. Jacobs , I. Joshi , L. Kuff , D. Kumar , A. Leblang , N. Li , I. Pandis , H. Robinson , D. Rorke , S. Rus , J. Russell , D. Tsirogiannis , S. Wanderman-Milne , and M. Yoder . Impala: A Modern , Open-Source SQL Engine for Hadoop. In CIDR 2015, Seventh Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4-7, 2015, Online Proceedings , 2015 . M. Kornacker, A. Behm, V. Bittorf, T. Bobrovytsky, C. Ching, A. Choi, J. Erickson, M. Grund, D. Hecht, M. Jacobs, I. Joshi, L. Kuff, D. Kumar, A. Leblang, N. Li, I. Pandis, H. Robinson, D. Rorke, S. Rus, J. Russell, D. Tsirogiannis, S. Wanderman-Milne, and M. Yoder. Impala: A Modern, Open-Source SQL Engine for Hadoop. In CIDR 2015, Seventh Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4-7, 2015, Online Proceedings, 2015."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/2794367.2794375"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-024X(199708)27:8%3C983::AID-SPE117%3E3.0.CO;2-#"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5626\/JCSE.2007.1.2.211"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989449"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/645484.656393"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2206869.2206883"},{"key":"e_1_2_1_26_1","first-page":"358","volume-title":"In VLDB","author":"Zhu Y.","year":"2002","unstructured":"Y. Zhu , D. Shasha , and Y. Z. D. Shasha . Statstream : Statistical monitoring of thousands of data streams in real time . In In VLDB , pages 358 -- 369 , 2002 . Y. Zhu, D. Shasha, and Y. Z. D. Shasha. Statstream: Statistical monitoring of thousands of data streams in real time. In In VLDB, pages 358--369, 2002."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2994509.2994537","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:54:54Z","timestamp":1672224894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2994509.2994537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8]]},"references-count":26,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2016,8]]}},"alternative-id":["10.14778\/2994509.2994537"],"URL":"https:\/\/doi.org\/10.14778\/2994509.2994537","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2016,8]]}}}