{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T16:32:04Z","timestamp":1784133124606,"version":"3.55.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1-2","license":[{"start":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T00:00:00Z","timestamp":1679356800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T00:00:00Z","timestamp":1679356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006211","name":"Humboldt-Universit\u00e4t zu Berlin","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006211","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ann Oper Res"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep neural network (DNN) architectures such as recurrent neural networks and transformers display outstanding performance in modeling sequential unstructured data. However, little is known about their merit to model customer churn with time-varying data. The paper provides a comprehensive evaluation of the ability of recurrent neural networks and transformers for customer churn prediction (CCP) using time-varying behavioral features in the form of recency, frequency, and monetary value (RFM). RFM variables are the backbone of CCP and, more generally, customer behavior forecasting. We examine alternative strategies for integrating time-varying and non-variant customer features in one network architecture. In this scope, we also assess hybrid approaches that incorporate the outputs of DNNs in conventional CCP models. Using a comprehensive panel data set from a large financial services company, we find recurrent neural networks to outperform transformer architectures when focusing on time-varying RFM features. This finding is confirmed when time-invariant customer features are included, independent of the specific form of feature integration. Finally, we find no statistical evidence that hybrid approaches (based on regularized logistic regression and extreme gradient boosting) improve predictive performance\u2014highlighting that DNNs and especially recurrent neural networks are suitable standalone classifiers for CCP using time-varying RFM measures.<\/jats:p>","DOI":"10.1007\/s10479-023-05259-9","type":"journal-article","created":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T02:59:37Z","timestamp":1679885977000},"page":"765-787","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Exploiting time-varying RFM measures for customer churn prediction with deep neural networks"],"prefix":"10.1007","volume":"339","author":[{"given":"Gary","family":"Mena","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristof","family":"Coussement","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Koen W.","family":"De Bock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arno","family":"De Caigny","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7685-262X","authenticated-orcid":false,"given":"Stefan","family":"Lessmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,21]]},"reference":[{"key":"5259_CR1","doi-asserted-by":"crossref","unstructured":"Bouckaert, R. R., & Frank, E. (2004). Evaluating the replicability of significance tests for comparing learning algorithms\u2014advances in knowledge discovery and data mining. In H. Dai, R. Srikant, & C. Zhang (Eds.), Proceedings of the Pacific-Asia conference on knowledge discovery and data mining (PAKDD) 2004 (pp. 3\u201312). Springer.","DOI":"10.1007\/978-3-540-24775-3_3"},{"issue":"5","key":"5259_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3465055","volume":"12","author":"S Chaudhari","year":"2021","unstructured":"Chaudhari, S., Mithal, V., Polatkan, G., & Ramanath, R. (2021). An attentive survey of attention models. ACM Transactions on Intelligent Systems and Technology, 12(5), 1\u201332.","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"5259_CR3","doi-asserted-by":"crossref","unstructured":"Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 785\u2013794). Association for Computing Machinery.","DOI":"10.1145\/2939672.2939785"},{"issue":"2","key":"5259_CR4","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1016\/j.ejor.2012.06.040","volume":"223","author":"ZY Chen","year":"2012","unstructured":"Chen, Z. Y., Fan, Z. P., & Sun, M. (2012). A hierarchical multiple kernel support vector machine for customer churn prediction using longitudinal behavioral data. European Journal of Operational Research, 223(2), 461\u2013472.","journal-title":"European Journal of Operational Research"},{"key":"5259_CR5","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merri\u00ebnboer, B., Gulcehre, C., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the conference on empirical methods in natural language processing (EMNLP 2014).","DOI":"10.3115\/v1\/D14-1179"},{"key":"5259_CR6","unstructured":"Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. In Proceedings of the NIPS 2014 workshop on deep learning, December 2014."},{"issue":"2","key":"5259_CR7","doi-asserted-by":"publisher","first-page":"760","DOI":"10.1016\/j.ejor.2018.02.009","volume":"269","author":"A De Caigny","year":"2018","unstructured":"De Caigny, A., Coussement, K., & De Bock, K. W. (2018). A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees. European Journal of Operational Research, 269(2), 760\u2013772.","journal-title":"European Journal of Operational Research"},{"issue":"4","key":"5259_CR8","doi-asserted-by":"publisher","first-page":"1563","DOI":"10.1016\/j.ijforecast.2019.03.029","volume":"36","author":"A De Caigny","year":"2020","unstructured":"De Caigny, A., Coussement, K., De Bock, K. W., & Lessmann, S. (2020). Incorporating textual information in customer churn prediction models based on a convolutional neural network. International Journal of Forecasting, 36(4), 1563\u20131578.","journal-title":"International Journal of Forecasting"},{"issue":"10","key":"5259_CR9","doi-asserted-by":"publisher","first-page":"4291","DOI":"10.1109\/TNNLS.2020.3019893","volume":"32","author":"A Galassi","year":"2021","unstructured":"Galassi, A., Lippi, M., & Torroni, P. (2021). Attention in natural language processing. IEEE Transactions on Neural Networks and Learning Systems, 32(10), 4291\u20134308.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"5259_CR10","doi-asserted-by":"publisher","first-page":"664","DOI":"10.1016\/j.ejor.2021.05.035","volume":"295","author":"T Gattermann-Itschert","year":"2021","unstructured":"Gattermann-Itschert, T., & Thonemann, U. W. (2021). How training on multiple time slices improves performance in churn prediction. European Journal of Operational Research, 295, 664\u2013674.","journal-title":"European Journal of Operational Research"},{"key":"5259_CR11","volume-title":"Deep Learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep Learning. MIT Press."},{"issue":"1","key":"5259_CR12","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1016\/j.ejor.2021.03.006","volume":"295","author":"BR Gunnarsson","year":"2021","unstructured":"Gunnarsson, B. R., Vanden Broucke, S., Baesens, B., \u00d3skarsd\u00f3ttir, M., & Lemahieu, W. (2021). Deep learning for credit scoring: Do or don\u2019t? European Journal of Operational Research, 295(1), 292\u2013305.","journal-title":"European Journal of Operational Research"},{"key":"5259_CR13","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction. Springer.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"5259_CR39","doi-asserted-by":"crossref","unstructured":"Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735\u20131780.","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"5259_CR14","doi-asserted-by":"crossref","unstructured":"Janssens, B., Bogaert, M., Bagu\u00e9, A., & Van den Poel, D. (2022). B2Boost: Instance-dependent profit-driven modelling of B2B churn. Annals of Operations Research, 1, 1\u201327.","DOI":"10.1007\/s10479-022-04631-5"},{"key":"5259_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113342","volume":"150","author":"D Koehn","year":"2020","unstructured":"Koehn, D., Lessmann, S., & Schaal, M. (2020). Predicting online shopping behaviour from clickstream data using deep learning. Expert Systems with Applications, 150, 113342.","journal-title":"Expert Systems with Applications"},{"issue":"6","key":"5259_CR16","doi-asserted-by":"publisher","first-page":"1521","DOI":"10.1016\/j.jspi.2007.04.032","volume":"138","author":"J Li","year":"2008","unstructured":"Li, J. (2008). A two-step rejection procedure for testing multiple hypotheses. Journal of Statistical Planning and Inference, 138(6), 1521\u20131527.","journal-title":"Journal of Statistical Planning and Inference"},{"key":"5259_CR17","doi-asserted-by":"crossref","unstructured":"Liu, X., Xie, M., Wen, X., Chen, R., Ge, Y., Duffield, N., & Wang, N. (2018). A semi-supervised and inductive embedding model for churn prediction of large-scale mobile games. In Proceedings of the 2018 IEEE international conference on data mining (ICDM) (pp. 277\u2013286).","DOI":"10.1109\/ICDM.2018.00043"},{"key":"5259_CR18","doi-asserted-by":"crossref","unstructured":"Luong, T., Pham, H., & Manning, C. D. (2015). Effective approaches to attention-based neural machine translation. In Proceedings of the 2015 conference on empirical methods in natural language processing (pp. 1412\u20131421). Association for Computational Linguistics.","DOI":"10.18653\/v1\/D15-1166"},{"issue":"1","key":"5259_CR19","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1509\/jm.15.0519","volume":"81","author":"DM McCarthy","year":"2017","unstructured":"McCarthy, D. M., Fader, P. S., & Hardie, B. G. S. (2017). Valuing subscription-based businesses using publicly disclosed customer data. Journal of Marketing, 81(1), 17\u201335.","journal-title":"Journal of Marketing"},{"key":"5259_CR20","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1016\/j.eswa.2017.05.028","volume":"85","author":"M \u00d3skarsd\u00f3ttir","year":"2017","unstructured":"\u00d3skarsd\u00f3ttir, M., Bravo, C., Verbeke, W., Sarraute, C., Baesens, B., & Vanthienen, J. (2017). Social network analytics for churn prediction in telco: Model building, evaluation and network architecture. Expert Systems with Applications, 85, 204\u2013220.","journal-title":"Expert Systems with Applications"},{"key":"5259_CR21","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1007\/s10479-008-0400-8","volume":"168","author":"J Qi","year":"2009","unstructured":"Qi, J., Zhang, L., Liu, Y., Li, L., Zhou, Y., Shen, Y., et al. (2009). ADTreesLogit model for customer churn prediction. Annals of Operations Research, 168, 247\u2013265.","journal-title":"Annals of Operations Research"},{"key":"5259_CR22","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1016\/j.intmar.2010.04.002","volume":"24","author":"H Risselada","year":"2010","unstructured":"Risselada, H., Verhoef, P. C., & Bijmolt, T. H. A. (2010). Staying power of churn prediction models. Journal of Interactive Marketing, 24, 198\u2013208.","journal-title":"Journal of Interactive Marketing"},{"key":"5259_CR23","doi-asserted-by":"crossref","unstructured":"Rush, A. (2018). The annotated transformer. In Proceedings of the workshop for NLP open source software (NLP-OSS) (pp. 52\u201360). Association for Computational Linguistics.","DOI":"10.18653\/v1\/W18-2509"},{"issue":"1","key":"5259_CR24","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1509\/jmkg.68.1.109.24030","volume":"68","author":"RT Rust","year":"2004","unstructured":"Rust, R. T., Lemon, K. N., & Zeithaml, V. A. (2004). Return on marketing: using customer equity to focus marketing strategy. Journal of Marketing, 68(1), 109\u2013127.","journal-title":"Journal of Marketing"},{"issue":"2","key":"5259_CR25","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1287\/mksc.2013.0832","volume":"33","author":"DA Schweidel","year":"2014","unstructured":"Schweidel, D. A., Park, Y. H., & Jamal, Z. (2014). A multiactivity latent attrition model for customer base analysis. Marketing Science, 33(2), 273\u2013286.","journal-title":"Marketing Science"},{"key":"5259_CR26","unstructured":"Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Proceedings of the 27th international conference on neural information processing systems\u2014volume 2 (pp. 3104\u20133112). MIT Press."},{"key":"5259_CR27","doi-asserted-by":"crossref","unstructured":"Tan, F., Wei, Z., He, J., Wu, X., Peng, B., Liu, H., & Yan, Z. (2018). A blended deep learning approach for predicting user intended actions. In Proceedings of the 2018 IEEE international conference on data mining (ICDM) (pp. 487\u2013496).","DOI":"10.1109\/ICDM.2018.00064"},{"issue":"3","key":"5259_CR28","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/j.ejor.2019.08.015","volume":"281","author":"T Van Nguyen","year":"2020","unstructured":"Van Nguyen, T., Zhou, L., Chong, A. Y. L., Li, B., & Pu, X. (2020). Predicting customer demand for remanufactured products: A data-mining approach. European Journal of Operational Research, 281(3), 543\u2013558.","journal-title":"European Journal of Operational Research"},{"key":"5259_CR29","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., et al. (2017). Attention is all you need. In I. Guyon, U. V Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Proceedings of the Advances in neural information processing systems (Vol. 30). Curran Associates, Inc."},{"issue":"1","key":"5259_CR30","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.ejor.2011.09.031","volume":"218","author":"W Verbeke","year":"2012","unstructured":"Verbeke, W., Dejaeger, K., Martens, D., Hur, J., & Baesens, B. (2012). New insights into churn prediction in the telecommunication sector: A profit driven data mining approach. European Journal of Operational Research, 218(1), 211\u2013229.","journal-title":"European Journal of Operational Research"},{"issue":"5","key":"5259_CR31","doi-asserted-by":"publisher","first-page":"961","DOI":"10.1109\/TKDE.2012.50","volume":"25","author":"T Verbraken","year":"2013","unstructured":"Verbraken, T., Verbeke, W., & Baesens, B. (2013). A novel profit maximizing metric for measuring classification performance of customer churn prediction models. IEEE Transactions on Knowledge and Data Engineering, 25(5), 961\u2013973.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"5259_CR32","unstructured":"Wangperawong, A., Brun, C., Laudy, O., & Pavasuthipaisit, R. (2016). Churn analysis using deep convolutional neural networks and autoencoders. arXiv.org, stat.ML."},{"issue":"2","key":"5259_CR33","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/S0957-4174(02)00030-1","volume":"23","author":"CP Wei","year":"2002","unstructured":"Wei, C. P., & Chiu, I. T. (2002). Turning telecommunications call details to churn prediction: A data mining approach. Expert Systems with Applications, 23(2), 103\u2013112.","journal-title":"Expert Systems with Applications"},{"key":"5259_CR34","doi-asserted-by":"crossref","unstructured":"Wu, Z., Jing, L., Wu, B., & Jin, L. (2022). A PCA-AdaBoost model for E-commerce customer churn prediction. Annals of Operations Research, 1, 1\u201318.","DOI":"10.1007\/s10479-022-04526-5"},{"key":"5259_CR35","doi-asserted-by":"crossref","unstructured":"Yang, C., Shi, X., Jie, L., & Han, J. (2018). I know you\u2019ll be back: Interpretable new user clustering and churn prediction on a mobile social application. In Proceedings of the proceedings of the 24th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 914\u2013922). Association for Computing Machinery.","DOI":"10.1145\/3219819.3219821"},{"key":"5259_CR36","unstructured":"Zaratiegui, J., Montoro, A., & Castanedo, F. (2015). Performing highly accurate predictions through convolutional networks for actual telecommunication challenges. In Proceedings of the international conference on computer vision and pattern recognition (Vol. abs\/1511.0, pp. 1\u20138)."},{"issue":"2","key":"5259_CR37","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1287\/mksc.2014.0873","volume":"34","author":"Y Zhang","year":"2015","unstructured":"Zhang, Y., Bradlow, E. T., & Small, D. S. (2015). Predicting customer value using clumpiness: From RFM to RFMC. Marketing Science, 34(2), 195\u2013208.","journal-title":"Marketing Science"},{"key":"5259_CR38","doi-asserted-by":"crossref","unstructured":"Zhou, J., Yan, J., Yang, L., Wang, M., & Xia, P. (2019). Customer churn prediction model based on LSTM and CNN in music streaming. In Proceedings of the 2019 international conference on advanced electrical, mechatronics and computer engineering (AEMCE 2019) (pp. 254\u2013261).","DOI":"10.12783\/dtetr\/aemce2019\/29520"}],"container-title":["Annals of Operations Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-023-05259-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10479-023-05259-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-023-05259-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T18:30:20Z","timestamp":1722364220000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10479-023-05259-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,21]]},"references-count":39,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["5259"],"URL":"https:\/\/doi.org\/10.1007\/s10479-023-05259-9","relation":{},"ISSN":["0254-5330","1572-9338"],"issn-type":[{"value":"0254-5330","type":"print"},{"value":"1572-9338","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,21]]},"assertion":[{"value":"22 February 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 March 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}