{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T09:27:46Z","timestamp":1773480466564,"version":"3.50.1"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T00:00:00Z","timestamp":1736380800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T00:00:00Z","timestamp":1736380800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100021828","name":"German Academic Exchange Service","doi-asserted-by":"publisher","award":["57682841"],"award-info":[{"award-number":["57682841"]}],"id":[{"id":"10.13039\/100021828","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This paper presents RL4CEP, a reinforcement learning (RL) approach to dynamically update complex event processing (CEP) rules. RL4CEP uses Double Deep Q-Networks to update the threshold values used by CEP rules. It is implemented using Apache Flink as a CEP engine and Apache Kafka for message distribution. RL4CEP is a generic approach for scenarios in which CEP rules need to be updated dynamically. In this paper, we use RL4CEP in a financial trading use case. Our experimental results based on three financial trading rules and eight financial datasets demonstrate the merits of RL4CEP in improving the overall profit, when compared to baseline and state-of-the-art approaches, with a reasonable consumption of resources, i.e., RAM and CPU. Finally, our experiments indicate that RL4CEP is executed quite fast compared to traditional CEP engines processing static rules.<\/jats:p>","DOI":"10.1007\/s40747-024-01742-3","type":"journal-article","created":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T08:39:40Z","timestamp":1736411980000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["RL4CEP: reinforcement learning for updating CEP rules"],"prefix":"10.1007","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5696-5771","authenticated-orcid":false,"given":"Afef","family":"Mdhaffar","sequence":"first","affiliation":[]},{"given":"Ghassen","family":"Baklouti","sequence":"additional","affiliation":[]},{"given":"Yassine","family":"Rebai","sequence":"additional","affiliation":[]},{"given":"Mohamed","family":"Jmaiel","sequence":"additional","affiliation":[]},{"given":"Bernd","family":"Freisleben","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,1,9]]},"reference":[{"key":"1742_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2017.05.008","author":"Y Wang","year":"2018","unstructured":"Wang Y, Gao H, Chen G (2018) Predictive complex event processing based on evolving bayesian networks. Pattern Recogn Lett. https:\/\/doi.org\/10.1016\/j.patrec.2017.05.008","journal-title":"Pattern Recogn Lett"},{"key":"1742_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2187671.2187677","volume":"44","author":"G Cugola","year":"2012","unstructured":"Cugola G, Margara A (2012) Processing flows of information: from data stream to complex event processing. ACM Comput Surv 44:1\u201362. https:\/\/doi.org\/10.1145\/2187671.2187677","journal-title":"ACM Comput Surv"},{"key":"1742_CR3","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-022-00766-w","author":"L Malburg","year":"2023","unstructured":"Malburg L, Hoffmann M, Bergmann R (2023) Applying MAPE-K control loops for adaptive workflow management in smart factories. J Intell Inf Syst. https:\/\/doi.org\/10.1007\/s10844-022-00766-w","journal-title":"J Intell Inf Syst"},{"issue":"1","key":"1742_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13677-022-00338-x","volume":"11","author":"KA Alaghbari","year":"2022","unstructured":"Alaghbari KA, Md Saad MH, Hussain A, Alam MR (2022) Complex event processing for physical and cyber security in datacentres\u2014recent progress, challenges and recommendations. J Cloud Comput Adv Syst Appl 11(1):1\u201329. https:\/\/doi.org\/10.1186\/s13677-022-00338-x","journal-title":"J Cloud Comput Adv Syst Appl"},{"key":"1742_CR5","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1109\/TNB.2017.2769671","volume":"16","author":"A Mdhaffar","year":"2017","unstructured":"Mdhaffar A, Rodriguez IB, Charfi K, Abid L, Freisleben B (2017) CEP4HFP: complex event processing for heart failure prediction. IEEE Trans Nanobiosci 16:708\u2013717. https:\/\/doi.org\/10.1109\/TNB.2017.2769671","journal-title":"IEEE Trans Nanobiosci"},{"key":"1742_CR6","doi-asserted-by":"publisher","first-page":"1347","DOI":"10.1007\/s10586-020-03189-w","volume":"24","author":"AM Rahmani","year":"2021","unstructured":"Rahmani AM, Babaei Z, Souri A (2021) Event-driven iot architecture for data analysis of reliable healthcare application using complex event processing. Clust Comput 24:1347\u20131360. https:\/\/doi.org\/10.1007\/s10586-020-03189-w","journal-title":"Clust Comput"},{"key":"1742_CR7","doi-asserted-by":"publisher","unstructured":"Pathak R, V V (2014) Complex event processing based remote health monitoring system. In: Proceedings of the 3rd International Conference on Eco-friendly Computing and Communication Systems, pp. 61\u201366. IEEE, Mangalore, India . https:\/\/doi.org\/10.1109\/Eco-friendly.2014.88","DOI":"10.1109\/Eco-friendly.2014.88"},{"key":"1742_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/s21217226","volume":"21","author":"SF Costa Bezerra","year":"2021","unstructured":"Costa Bezerra SF, Filho ASM, Delicato FC, Rocha AR (2021) Processing complex events in fog-based internet of things systems for smart agriculture. Sensors 21:1\u201322. https:\/\/doi.org\/10.3390\/s21217226","journal-title":"Sensors"},{"key":"1742_CR9","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1016\/j.compag.2018.09.013","volume":"154","author":"B Mazon-Olivo","year":"2018","unstructured":"Mazon-Olivo B, Hern\u00e1ndez-Rojas D, Maza-Salinas J, Pan A (2018) Rules engine and complex event processor in the context of internet of things for precision agriculture. Comput Electron Agric 154:347\u2013360. https:\/\/doi.org\/10.1016\/j.compag.2018.09.013","journal-title":"Comput Electron Agric"},{"key":"1742_CR10","doi-asserted-by":"publisher","unstructured":"Cotroneo D, Simone L D, Liguori P, Natella R, Scibelli A (2020) Towards runtime verification via event stream processing in cloud computing infrastructures. In: Hacid, H., Mellouli, S., Kao, O., Paik, H.-Y., Weber, I. (eds.) Service-Oriented Computing - ICSOC 2020 Workshops. Lecture Notes in Computer Science, vol. 12632, pp. 162\u2013175. Springer, Naples, Italy . https:\/\/doi.org\/10.1007\/978-3-030-76352-719","DOI":"10.1007\/978-3-030-76352-719"},{"key":"1742_CR11","doi-asserted-by":"publisher","unstructured":"Mdhaffar A, Halima R B, Jmaiel M, Freisleben B (2014) CEP4Cloud: complex event processing for self-healing clouds. In: Proceedings of the 23rd International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, pp. 62\u201367. IEEE, Parma, Italy . https:\/\/doi.org\/10.1109\/WETICE.2014.56","DOI":"10.1109\/WETICE.2014.56"},{"key":"1742_CR12","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1504\/IJBDI.2014.063842","volume":"1","author":"A Mdhaffar","year":"2014","unstructured":"Mdhaffar A, Halima RB, Jmaiel M, Freisleben B (2014) D-CEP4CMA: a dynamic architecture for cloud performance monitoring and analysis via complex event processing. Int J Big Data Intell 1:89\u2013102. https:\/\/doi.org\/10.1504\/IJBDI.2014.063842","journal-title":"Int J Big Data Intell"},{"key":"1742_CR13","doi-asserted-by":"publisher","unstructured":"Mdhaffar A, Halima R B, Jmaiel M, Freisleben B (2014) CEP4CMA: multi-layer cloud performance monitoring and analysis via complex event processing. In: Proceedings of the International Conference on Networked Systems, pp. 138\u2013152. Springer, Marrakech, Morroco . https:\/\/doi.org\/10.1007\/978-3-319-09581-310","DOI":"10.1007\/978-3-319-09581-310"},{"key":"1742_CR14","doi-asserted-by":"crossref","unstructured":"Simsek M U, Kok I, Ozdemir S (2024) Cepair: an ai-powered and fog-based predictive cep system for air quality monitoring. Clust Comput","DOI":"10.1007\/s10586-024-04434-2"},{"key":"1742_CR15","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1016\/j.eswa.2019.04.007","volume":"129","author":"R Bruns","year":"2019","unstructured":"Bruns R, Dunkel J, Offel N (2019) Learning of complex event processing rules with genetic programming. Expert Syst Appl 129:186\u2013199. https:\/\/doi.org\/10.1016\/j.eswa.2019.04.007","journal-title":"Expert Syst Appl"},{"key":"1742_CR16","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.future.2016.02.011","volume":"66","author":"O-J Lee","year":"2017","unstructured":"Lee O-J, Jung JE (2017) Sequence clustering-based automated rule generation for adaptive complex event processing. Futur Gener Comput Syst 66:100\u2013109. https:\/\/doi.org\/10.1016\/j.future.2016.02.011","journal-title":"Futur Gener Comput Syst"},{"key":"1742_CR17","doi-asserted-by":"publisher","unstructured":"Petersen E, To MA, Maag S, Yamga T (2018) An unsupervised rule generation approach for online complex event processing. In: Proceedings of the 17th International Symposium on Network Computing and Applications, pp. 1\u20138. IEEE, USA . https:\/\/doi.org\/10.1109\/NCA.2018.8548210","DOI":"10.1109\/NCA.2018.8548210"},{"key":"1742_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2022.102421","volume":"134","author":"MM Naseri","year":"2022","unstructured":"Naseri MM, Tabibian S, Homayounvala E (2022) Adaptive and personalized user behavior modeling in complex event processing platforms for remote health monitoring systems. Artif Intell Med 134:102421. https:\/\/doi.org\/10.1016\/j.artmed.2022.102421","journal-title":"Artif Intell Med"},{"key":"1742_CR19","doi-asserted-by":"publisher","unstructured":"Rold\u00e1n J, Boubeta-Puig J, Luis Mart\u00ednez J, Ortiz G (2020) Integrating complex event processing and machine learning: an intelligent architecture for detecting IoT security attacks. Expert Syst Appl 149:113251. https:\/\/doi.org\/10.1016\/j.eswa.2020.113251","DOI":"10.1016\/j.eswa.2020.113251"},{"key":"1742_CR20","doi-asserted-by":"publisher","unstructured":"Moody GB, Mark RG (1996) A database to support development and evaluation of intelligent intensive care monitoring. Comput Cardiol 23:657\u2013660. https:\/\/doi.org\/10.1109\/CIC.1996.542622","DOI":"10.1109\/CIC.1996.542622"},{"key":"1742_CR21","doi-asserted-by":"publisher","first-page":"2851","DOI":"10.1080\/00036846.2014.914145","volume":"46","author":"E P\u00e4t\u00e4ri","year":"2014","unstructured":"P\u00e4t\u00e4ri E, Vilska M (2014) Performance of moving average trading strategies over varying stock market conditions: the Finnish evidence. Appl Econ 46:2851\u20132872. https:\/\/doi.org\/10.1080\/00036846.2014.914145","journal-title":"Appl Econ"},{"key":"1742_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/e23111411","volume":"23","author":"S Li","year":"2021","unstructured":"Li S, Jiang X, Wu J, Tong L, Xu K (2021) Detection of mutual exciting structure in stock Price trend dynamics. Entropy 23:1\u201316. https:\/\/doi.org\/10.3390\/e23111411","journal-title":"Entropy"},{"key":"1742_CR23","doi-asserted-by":"publisher","first-page":"44","DOI":"10.21511\/imfi.17(4).2020.05","volume":"17","author":"A Aguirre","year":"2020","unstructured":"Aguirre A, Medina R, Duque N (2020) Machine learning applied in the stock market through the moving average convergence divergence (macd) indicator. Invest Manag Finan Innov 17:44\u201360. https:\/\/doi.org\/10.21511\/imfi.17(4).2020.05","journal-title":"Invest Manag Finan Innov"},{"key":"1742_CR24","doi-asserted-by":"publisher","unstructured":"Lauguico S, II R C, Alejandrino J, Macasaet D, Tobias R R, Bandala A, Dadios E (2019) A fuzzy logic-based stock market trading algorithm using Bollinger bands. In: Proceedings of the 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management, pp. 1\u20136. IEEE, Laoag, Philippines . https:\/\/doi.org\/10.1109\/HNICEM48295.2019.9072734","DOI":"10.1109\/HNICEM48295.2019.9072734"},{"key":"1742_CR25","doi-asserted-by":"publisher","first-page":"7173","DOI":"10.1109\/ACCESS.2020.2964018","volume":"8","author":"G Wang","year":"2020","unstructured":"Wang G, Xu F (2020) Regional intelligent resource allocation in mobile edge computing based vehicular network. IEEE Access 8:7173\u20137182. https:\/\/doi.org\/10.1109\/ACCESS.2020.2964018","journal-title":"IEEE Access"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-024-01742-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-024-01742-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-024-01742-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T16:28:59Z","timestamp":1738945739000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-024-01742-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,9]]},"references-count":25,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["1742"],"URL":"https:\/\/doi.org\/10.1007\/s40747-024-01742-3","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,9]]},"assertion":[{"value":"2 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no Conflict of interest as defined by Springer, or other interests that might be perceived to influence the results and\/or discussion reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not Applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}}],"article-number":"137"}}