{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:06:09Z","timestamp":1787022369096,"version":"build-2736575974"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2021,11]]},"abstract":"<jats:p>Complex event processing (CEP) is widely employed to detect user-defined combinations, or patterns, of events in massive streams of incoming data. Numerous applications such as healthcare, fraud detection, and more, use CEP technologies to capture critical alerts, threats, or vital notifications. This requires that the technology meet real-time detection constraints. Multiple optimization techniques have been developed to minimize the processing time for CEP, including parallelization techniques, pattern rewriting, and more. However, these techniques may not suffice or may not be applicable when an unpredictable peak in the input event stream exceeds the system capacity. In such cases, one immediate possible solution is to drop some of the load in a technique known as load shedding.<\/jats:p>\n                  <jats:p>We present a novel load shedding mechanism for real-time complex event processing. Our approach uses statistics that are gathered to detect overload. The solution makes data-driven load shedding decisions to drop the less important events such that we preserve a given latency bound while minimizing the degradation in the quality of results. An extensive experimental evaluation on a broad set of real-life patterns and datasets demonstrates the superiority of our approach over the state-of-the-art techniques.<\/jats:p>","DOI":"10.14778\/3494124.3494137","type":"journal-article","created":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T19:31:46Z","timestamp":1644003106000},"page":"541-554","source":"Crossref","is-referenced-by-count":14,"title":["DARLING"],"prefix":"10.14778","volume":"15","author":[{"given":"Koral","family":"Chapnik","sequence":"first","affiliation":[{"name":"Technion, Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilya","family":"Kolchinsky","sequence":"additional","affiliation":[{"name":"Technion, Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Assaf","family":"Schuster","sequence":"additional","affiliation":[{"name":"Technion, Haifa, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,2,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n.d.]. http:\/\/www.eoddata.com  [n.d.]. http:\/\/www.eoddata.com"},{"key":"e_1_2_1_2_1","unstructured":"[n.d.]. https:\/\/debs.org\/grand-challenges\/2013\/  [n.d.]. https:\/\/debs.org\/grand-challenges\/2013\/"},{"key":"e_1_2_1_3_1","unstructured":"[n.d.]. https:\/\/data.smartdublin.ie\/dataset\/dublin-bus-gps-sample-data-from-dublin-city-council-insight-project  [n.d.]. https:\/\/data.smartdublin.ie\/dataset\/dublin-bus-gps-sample-data-from-dublin-city-council-insight-project"},{"key":"e_1_2_1_4_1","unstructured":"[n.d.]. https:\/\/www.espertech.com\/  [n.d.]. https:\/\/www.espertech.com\/"},{"key":"e_1_2_1_5_1","first-page":"277","article-title":"The design of the borealis stream processing engine","volume":"5","author":"Abadi Daniel J","year":"2005","unstructured":"Daniel J Abadi , Yanif Ahmad , Magdalena Balazinska , Ugur Cetintemel , Mitch Cherniack , Jeong-Hyon Hwang , Wolfgang Lindner , Anurag Maskey , Alex Rasin , Esther Ryvkina , 2005 . The design of the borealis stream processing engine .. In Cidr , Vol. 5. 277 -- 289 . Daniel J Abadi, Yanif Ahmad, Magdalena Balazinska, Ugur Cetintemel, Mitch Cherniack, Jeong-Hyon Hwang, Wolfgang Lindner, Anurag Maskey, Alex Rasin, Esther Ryvkina, et al. 2005. The design of the borealis stream processing engine.. In Cidr, Vol. 5. 277--289.","journal-title":"Cidr"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCW.2006.7"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-003-0108-y"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376634"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453869"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1289612.1289615"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978582.1978597"},{"key":"e_1_2_1_12_1","volume-title":"Stream: The stanford data stream management system. In Data Stream Management","author":"Arasu Arvind","year":"2016","unstructured":"Arvind Arasu , Brian Babcock , Shivnath Babu , John Cieslewicz , Mayur Datar , Keith Ito , Rajeev Motwani , Utkarsh Srivastava , and Jennifer Widom . 2016 . Stream: The stanford data stream management system. In Data Stream Management . Springer , 317--336. Arvind Arasu, Brian Babcock, Shivnath Babu, John Cieslewicz, Mayur Datar, Keith Ito, Rajeev Motwani, Utkarsh Srivastava, and Jennifer Widom. 2016. Stream: The stanford data stream management system. In Data Stream Management. Springer, 317--336."},{"key":"e_1_2_1_13_1","volume-title":"Consistent streaming through time: A vision for event stream processing. arXiv preprint cs\/0612115","author":"Barga Roger S","year":"2006","unstructured":"Roger S Barga , Jonathan Goldstein , Mohamed Ali , and Mingsheng Hong . 2006. Consistent streaming through time: A vision for event stream processing. arXiv preprint cs\/0612115 ( 2006 ). Roger S Barga, Jonathan Goldstein, Mohamed Ali, and Mingsheng Hong. 2006. Consistent streaming through time: A vision for event stream processing. arXiv preprint cs\/0612115 (2006)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2536845"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335432"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2012.03.056"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187671.2187677"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170432"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/11687238_38"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2008.4497476"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1894960"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.06.011"},{"key":"e_1_2_1_23_1","volume-title":"Telegraphcq: continuous dataflow processing for an uncertain world. CIDR. Asilomar: Morgan Kauf. man Publishers","author":"Franklin Michael","year":"2003","unstructured":"Michael Franklin . 2003. Telegraphcq: continuous dataflow processing for an uncertain world. CIDR. Asilomar: Morgan Kauf. man Publishers ( 2003 ), 269--280. Michael Franklin. 2003. Telegraphcq: continuous dataflow processing for an uncertain world. CIDR. Asilomar: Morgan Kauf. man Publishers (2003), 269--280."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2523813"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.07.019"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2009.74"},{"key":"e_1_2_1_27_1","volume-title":"On load shedding in complex event processing. arXiv preprint arXiv:1312.4283","author":"He Yeye","year":"2013","unstructured":"Yeye He , Siddharth Barman , and Jeffrey F Naughton . 2013. On load shedding in complex event processing. arXiv preprint arXiv:1312.4283 ( 2013 ). Yeye He, Siddharth Barman, and Jeffrey F Naughton. 2013. On load shedding in complex event processing. arXiv preprint arXiv:1312.4283 (2013)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2528412"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675743.2772585"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882943"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622265"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/3236187.3236190"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/3236187.3236189"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319869"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675743.2771832"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989416"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559867"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/872757.872825"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0411-4"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3035947"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135989"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2002259.2002277"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882947"},{"key":"e_1_2_1_44_1","volume-title":"Transactions on","author":"Rivetti Nicol\u00f3","unstructured":"Nicol\u00f3 Rivetti , Yann Busnel , and Leonardo Querzoni . 2020. Load-aware shedding in stream processing systems . In Transactions on Large-Scale Data-and Knowledge-Centered Systems XLVI. Springer , 121--153. Nicol\u00f3 Rivetti, Yann Busnel, and Leonardo Querzoni. 2020. Load-aware shedding in stream processing systems. In Transactions on Large-Scale Data-and Knowledge-Centered Systems XLVI. Springer, 121--153."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3303849"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1619258.1619264"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9006436"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3361525.3361548"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3401025.3401742"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2110486.2110493"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.5555\/1315451.1315479"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2247596.2247674"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1353343.1353414"},{"key":"e_1_2_1_54_1","volume-title":"AAAI Spring Symposium: Intelligent Event Processing. 98--100","author":"Widder Alexander","year":"2009","unstructured":"Alexander Widder , Rainer von Ammon , Gerit Hagemann , and Dirk Sch\u00f6nfeld . 2009 . An Approach for Automatic Fraud Detection in the Insurance Domain .. In AAAI Spring Symposium: Intelligent Event Processing. 98--100 . Alexander Widder, Rainer von Ammon, Gerit Hagemann, and Dirk Sch\u00f6nfeld. 2009. An Approach for Automatic Fraud Detection in the Insurance Domain.. In AAAI Spring Symposium: Intelligent Event Processing. 98--100."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142520"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2593671"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2017.166"},{"key":"e_1_2_1_58_1","volume-title":"Load Shedding for Complex Event Processing: Input-based and State-based Techniques. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE, 1093--1104","author":"Zhao Bo","year":"2020","unstructured":"Bo Zhao , Nguyen Quoc Viet Hung , and Matthias Weidlich . 2020 . Load Shedding for Complex Event Processing: Input-based and State-based Techniques. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE, 1093--1104 . Bo Zhao, Nguyen Quoc Viet Hung, and Matthias Weidlich. 2020. Load Shedding for Complex Event Processing: Input-based and State-based Techniques. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE, 1093--1104."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3494124.3494137","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T06:28:15Z","timestamp":1672208895000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3494124.3494137"}},"subtitle":["data-aware load shedding in complex event processing systems"],"short-title":[],"issued":{"date-parts":[[2021,11]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,11]]}},"alternative-id":["10.14778\/3494124.3494137"],"URL":"https:\/\/doi.org\/10.14778\/3494124.3494137","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2021,11]]}}}