{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,24]],"date-time":"2025-08-24T01:30:58Z","timestamp":1755999058055,"version":"3.44.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006374","name":"Nanyang Technological University","doi-asserted-by":"publisher","award":["023452-00001"],"award-info":[{"award-number":["023452-00001"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006374","name":"Ministry of Education - Singapore","doi-asserted-by":"publisher","award":["MOE-T2EP20122-0010"],"award-info":[{"award-number":["MOE-T2EP20122-0010"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2024,3,12]]},"abstract":"<jats:p>Stream Window Join (SWJ), a vital operation in stream analytics, struggles with achieving a balance between accuracy and latency due to out-of-order data arrivals. Existing methods predominantly rely on adaptive buffering, but often fall short in performance, thereby constraining practical applications. We introduce PECJ, a solution that proactively incorporates unobserved data to enhance accuracy while reducing latency, thus requiring robust predictive modeling of stream oscillation. At the heart of PECJ lies a mathematical formulation of the posterior distribution approximation (PDA) problem using variational inference (VI). This approach circumvents error propagation while meeting the low-latency demands of SWJ. We detail the implementation of PECJ, striking a balance between complexity and generality, and discuss both analytical and learning-based approaches. Experimental evaluations reveal PECJ's superior performance. The successful integration of PECJ into a multi-threaded SWJ benchmark testbed further establishes its practical value, demonstrating promising advancements in enhancing data stream processing capabilities amidst out-of-order data.<\/jats:p>","DOI":"10.1145\/3639268","type":"journal-article","created":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T18:51:32Z","timestamp":1711479092000},"page":"1-24","source":"Crossref","is-referenced-by-count":1,"title":["PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4613-9297","authenticated-orcid":false,"given":"Xianzhi","family":"Zeng","sequence":"first","affiliation":[{"name":"Singapore University of Technology and Design, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9927-6925","authenticated-orcid":false,"given":"Shuhao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2564-9674","authenticated-orcid":false,"given":"Hongbin","family":"Zhong","sequence":"additional","affiliation":[{"name":"4paradigm Inc., Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3532-4043","authenticated-orcid":false,"given":"Hao","family":"Zhang","sequence":"additional","affiliation":[{"name":"4paradigm Inc., Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4853-8881","authenticated-orcid":false,"given":"Mian","family":"Lu","sequence":"additional","affiliation":[{"name":"4paradigm Inc., Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5295-9638","authenticated-orcid":false,"given":"Zhao","family":"Zheng","sequence":"additional","affiliation":[{"name":"4paradigm Inc., Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9339-2510","authenticated-orcid":false,"given":"Yuqiang","family":"Chen","sequence":"additional","affiliation":[{"name":"4paradigm Inc., Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,3,26]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"[n. d.]. A Benchmark for Real-Time Relational Data Feature Extraction. https:\/\/github.com\/decis-bench\/febench. Last Accessed: 2023-01-03."},{"key":"e_1_2_2_2_1","unstructured":"[n. d.]. OpenMLDB Use Cases. https:\/\/openmldb.ai\/docs\/en\/main\/use_case\/index.html. Last Accessed: 2022-09--23."},{"key":"e_1_2_2_3_1","unstructured":"2018. Shanghai Stock Exchange http:\/\/ english.sse.com.cn\/ . Last Accessed: 2020-06--29."},{"key":"e_1_2_2_4_1","unstructured":"2023. Pytorch homepage https:\/\/ pytorch.org\/ ."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465355"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Tyler Akidau Edmon Begoli Slava Chernyak Fabian Hueske Kathryn Knight Kenneth Knowles Daniel Mills and Dan Sotolongo. 2021. Watermarks in Stream Processing Systems: Semantics and Comparative Analysis ofApache Flink and Google Cloud Dataflow. Technical Report. Oak Ridge National Lab.(ORNL) Oak Ridge TN (United States).","DOI":"10.14778\/3476311.3476389"},{"key":"e_1_2_2_7_1","volume-title":"et al","author":"Akidau Tyler","year":"2015","unstructured":"Tyler Akidau, Robert Bradshaw, Craig Chambers, Slava Chernyak, Rafael J Fern\u00e1ndez-Moctezuma, Reuven Lax, Sam McVeety, Daniel Mills, Frances Perry, Eric Schmidt, et al . 2015. The dataflow model: a practical approach to balancing correctness, latency, and cost in massive-scale, unbounded, out-of-order data processing. (2015)."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE55515.2023.00155"},{"key":"e_1_2_2_9_1","volume-title":"Adaptive Watermarks: A Concept Drift-based Approach for Predicting Event-Time Progress in Data Streams.. In EDBT. 622--625.","author":"Awad Ahmed","year":"2019","unstructured":"Ahmed Awad, Jonas Traub, and Sherif Sakr. 2019. Adaptive Watermarks: A Concept Drift-based Approach for Predicting Event-Time Progress in Data Streams.. In EDBT. 622--625."},{"volume-title":"Pattern recognition and machine learning","author":"Bishop Christopher M","key":"e_1_2_2_10_1","unstructured":"Christopher M Bishop and Nasser M Nasrabadi. 2006. Pattern recognition and machine learning. Vol. 4. Springer."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2021.3054898"},{"key":"e_1_2_2_12_1","volume-title":"Streaming variational bayes. Advances in neural information processing systems 26","author":"Broderick Tamara","year":"2013","unstructured":"Tamara Broderick, Nicholas Boyd, Andre Wibisono, Ashia C Wilson, and Michael I Jordan. 2013. Streaming variational bayes. Advances in neural information processing systems 26 (2013)."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2010.346"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3465480.3466920"},{"key":"e_1_2_2_15_1","volume-title":"Analysis of Short Selling. In 2022 7th International Conference on Financial Innovation and Economic Development (ICFIED 2022","author":"Ding Kangqi","year":"2022","unstructured":"Kangqi Ding. 2022. Analysis of Short Selling. In 2022 7th International Conference on Financial Innovation and Economic Development (ICFIED 2022). Atlantis Press, 2030--2034."},{"key":"e_1_2_2_16_1","volume-title":"et al","author":"Dingledine Roger","year":"2004","unstructured":"Roger Dingledine, Nick Mathewson, Paul F Syverson, et al . 2004. Tor: The second-generation onion router.. In USENIX security symposium, Vol. 4. 303--320."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-020-00626-5"},{"key":"e_1_2_2_18_1","unstructured":"Behrouz A Forouzan. 2002. TCP\/IP protocol suite. McGraw-Hill Higher Education."},{"key":"e_1_2_2_19_1","series-title":"SIAM journal on imaging sciences 2, 2","volume-title":"The split Bregman method for L1-regularized problems","author":"Goldstein Tom","year":"2009","unstructured":"Tom Goldstein and Stanley Osher. 2009. The split Bregman method for L1-regularized problems. SIAM journal on imaging sciences 2, 2 (2009), 323--343."},{"key":"e_1_2_2_20_1","volume-title":"Proceedings of the 23rd International Conference on Neural Information Processing Systems -","volume":"1","author":"Hoffman Matthew D.","year":"2010","unstructured":"Matthew D. Hoffman, David M. Blei, and Francis Bach. 2010. Online Learning for Latent Dirichlet Allocation. In Proceedings of the 23rd International Conference on Neural Information Processing Systems - Volume 1 (Vancouver, British Columbia, Canada) (NIPS'10). Curran Associates Inc., Red Hook, NY, USA, 856--864."},{"key":"e_1_2_2_21_1","volume-title":"Stochastic variational inference. Journal of Machine Learning Research","author":"Hoffman Matthew D","year":"2013","unstructured":"Matthew D Hoffman, David M Blei, Chong Wang, and John Paisley. 2013. Stochastic variational inference. Journal of Machine Learning Research (2013)."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2016.7498265"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2735371"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/isaf.1500"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882940"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2018.00169"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00100"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915235"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453890"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2877362"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCSW.2007.35"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3517836"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3324958"},{"key":"e_1_2_2_34_1","volume-title":"2017 USENIX Annual Technical Conference (USENIX ATC 17)","author":"Miao Hongyu","year":"2017","unstructured":"Hongyu Miao, Heejin Park, Myeongjae Jeon, Gennady Pekhimenko, Kathryn S McKinley, and Felix Xiaozhu Lin. 2017. Streambox: Modern stream processing on a multicore machine. In 2017 USENIX Annual Technical Conference (USENIX ATC 17) (Santa Clara, CA, USA) (Usenix Atc '17). USENIX Association, Berkeley, CA, USA, 617--629."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3465998.3466005"},{"volume-title":"Introduction to time series analysis and forecasting","author":"Montgomery Douglas C","key":"e_1_2_2_36_1","unstructured":"Douglas C Montgomery, Cheryl L Jennings, and Murat Kulahci. 2015. Introduction to time series analysis and forecasting. John Wiley & Sons."},{"key":"e_1_2_2_37_1","volume-title":"Low-latency Stream Join Architecture with Adjustable Ordering Precision. In 2016 USENIX Annual Technical Conference (USENIX ATC 16)","author":"Najafi Mohammadreza","year":"2016","unstructured":"Mohammadreza Najafi, Mohammad Sadoghi, and Hans-Arno Jacobsen. 2016. SplitJoin: A Scalable, Low-latency Stream Join Architecture with Adjustable Ordering Precision. In 2016 USENIX Annual Technical Conference (USENIX ATC 16). USENIX Association, Denver, CO, 493--505. https:\/\/www.usenix.org\/conference\/atc16\/technical-sessions\/presentation\/najafi"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135989"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3380576"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-020-0206-7"},{"key":"e_1_2_2_41_1","volume-title":"AAAI-97 Workshop on Fraud Detection and Risk Management. 83--90","author":"Stolfo Salvatore","year":"1997","unstructured":"Salvatore Stolfo, David W Fan, Wenke Lee, Andreas Prodromidis, and Philip Chan. 1997. Credit card fraud detection using meta-learning: Issues and initial results. In AAAI-97 Workshop on Fraud Detection and Risk Management. 83--90."},{"key":"e_1_2_2_42_1","first-page":"23592","article-title":"Probabilistic transformer for time series analysis","volume":"34","author":"Tang Binh","year":"2021","unstructured":"Binh Tang and David S Matteson. 2021. Probabilistic transformer for time series analysis. Advances in Neural Information Processing Systems 34 (2021), 23592--23608.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989389"},{"key":"e_1_2_2_44_1","volume-title":"NVAE: A deep hierarchical variational autoencoder. Advances in neural information processing systems 33","author":"Vahdat Arash","year":"2020","unstructured":"Arash Vahdat and Jan Kautz. 2020. NVAE: A deep hierarchical variational autoencoder. Advances in neural information processing systems 33 (2020), 19667--19679."},{"key":"e_1_2_2_45_1","volume-title":"Adversarial sparse transformer for time series forecasting. Advances in neural information processing systems 33","author":"Wu Sifan","year":"2020","unstructured":"Sifan Wu, Xi Xiao, Qianggang Ding, Peilin Zhao, Ying Wei, and Junzhou Huang. 2020. Adversarial sparse transformer for time series forecasting. Advances in neural information processing systems 33 (2020), 17105--17115."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2588579"},{"key":"e_1_2_2_47_1","volume-title":"Haralampos Gavriilidis, Dimitrios Giouroukis, Philipp M. Grulich, Sebastian Bre\u00df, Jonas Traub, and Volker Markl.","author":"Zeuch Steffen","year":"2020","unstructured":"Steffen Zeuch, Ankit Chaudhary, Bonaventura Del Monte, Haralampos Gavriilidis, Dimitrios Giouroukis, Philipp M. Grulich, Sebastian Bre\u00df, Jonas Traub, and Volker Markl. 2020. The NebulaStream Platform for Data and Application Management in the Internet of Things. In CIDR 2020, 10th Conference on Innovative Data Systems Research, Amsterdam, The Netherlands, January 12--15, 2020, Online Proceedings. www.cidrdb.org. http:\/\/cidrdb.org\/cidr2020\/papers\/p7-zeuch-cidr20.pdf"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE55515.2023.00232"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3452793"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639268","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3639268","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T15:12:49Z","timestamp":1755789169000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639268"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,12]]}},"alternative-id":["10.1145\/3639268"],"URL":"https:\/\/doi.org\/10.1145\/3639268","relation":{},"ISSN":["2836-6573"],"issn-type":[{"type":"electronic","value":"2836-6573"}],"subject":[],"published":{"date-parts":[[2024,3,12]]}}}