{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T18:20:52Z","timestamp":1793816452333,"version":"4.6.1"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T00:00:00Z","timestamp":1673913600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T00:00:00Z","timestamp":1673913600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Training a machine learning algorithm on a class-imbalanced dataset can be a difficult task, a process that could prove even more challenging under conditions of high dimensionality. Feature extraction and data sampling are among the most popular preprocessing techniques. Feature extraction is used to derive a richer set of reduced dataset features, while data sampling is used to mitigate class imbalance. In this paper, we investigate these two preprocessing techniques, using a credit card fraud dataset and four ensemble classifiers (Random Forest, CatBoost, LightGBM, and XGBoost). Within the context of feature extraction, the<jats:italic>Principal Component Analysis<\/jats:italic>(PCA) and<jats:italic>Convolutional Autoencoder<\/jats:italic>(CAE) methods are evaluated. With regard to data sampling, the<jats:italic>Random Undersampling<\/jats:italic>(RUS),<jats:italic>Synthetic Minority Oversampling Technique<\/jats:italic>(SMOTE), and SMOTE Tomek methods are evaluated. The F1 score and<jats:italic>Area Under the Receiver Operating Characteristic Curve<\/jats:italic>(AUC) metrics serve as measures of classification performance. Our results show that the implementation of the RUS method followed by the CAE method leads to the best performance for credit card fraud detection.<\/jats:p>","DOI":"10.1186\/s40537-023-00684-w","type":"journal-article","created":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T15:02:51Z","timestamp":1673967771000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":104,"title":["The effect of feature extraction and data sampling on credit card fraud detection"],"prefix":"10.1186","volume":"10","author":[{"given":"Zahra","family":"Salekshahrezaee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joffrey L.","family":"Leevy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taghi M.","family":"Khoshgoftaar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,17]]},"reference":[{"key":"684_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2019.105292","volume":"192","author":"B Liu","year":"2020","unstructured":"Liu B, Tsoumakas G. Dealing with class imbalance in classifier chains via random undersampling. Knowl-Based Syst. 2020;192: 105292.","journal-title":"Knowl-Based Syst"},{"key":"684_CR2","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. Smote: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321\u201357.","journal-title":"J Artif Intell Res"},{"key":"684_CR3","doi-asserted-by":"crossref","unstructured":"Jonathan B, Putra PH, Ruldeviyani Y. Observation imbalanced data text to predict users selling products on female daily with smote, tomek, and smote-tomek. In: 2020 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT), IEEE. pp. 81\u201385; 2020.","DOI":"10.1109\/IAICT50021.2020.9172033"},{"key":"684_CR4","doi-asserted-by":"crossref","unstructured":"Thai-Nghe N, Gantner Z, Schmidt-Thieme L. Cost-sensitive learning methods for imbalanced data. In: The 2010 International Joint Conference on Neural Networks (IJCNN), IEEE. pp. 1\u20138; 2010.","DOI":"10.1109\/IJCNN.2010.5596486"},{"key":"684_CR5","first-page":"769","volume":"11","author":"I Tomek","year":"1976","unstructured":"Tomek I, et al. Two modifications of cnn. IEEE Trans Syst Man Cybern. 1976;11:769\u201372.","journal-title":"IEEE Trans Syst Man Cybern"},{"key":"684_CR6","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1016\/j.ins.2019.09.074","volume":"513","author":"C Peng","year":"2020","unstructured":"Peng C, Chen Y, Kang Z, Chen C, Cheng Q. Robust principal component analysis: a factorization-based approach with linear complexity. Inf Sci. 2020;513:581\u201399.","journal-title":"Inf Sci"},{"key":"684_CR7","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.promfg.2018.10.023","volume":"17","author":"M Maggipinto","year":"2018","unstructured":"Maggipinto M, Masiero C, Beghi A, Susto GA. A convolutional autoencoder approach for feature extraction in virtual metrology. Procedia Manufacturing. 2018;17:126\u201333.","journal-title":"Procedia Manufacturing"},{"key":"684_CR8","doi-asserted-by":"publisher","first-page":"78737","DOI":"10.1109\/ACCESS.2020.2990375","volume":"8","author":"SA Alsenan","year":"2020","unstructured":"Alsenan SA, Al-Turaiki IM, Hafez AM. Feature extraction methods in quantitative structure\u2013activity relationship modeling: a comparative study. IEEE Access. 2020;8:78737\u201352.","journal-title":"IEEE Access"},{"key":"684_CR9","doi-asserted-by":"crossref","unstructured":"Popat RR, Chaudhary J. A survey on credit card fraud detection using machine learning. In: 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI), IEEE. 2018. p. 1120\u20131125.","DOI":"10.1109\/ICOEI.2018.8553963"},{"key":"684_CR10","unstructured":"Kaggle: Credit Card Fraud Detection. https:\/\/www.kaggle.com\/mlg-ulb\/creditcardfraud"},{"issue":"1","key":"684_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-020-00369-8","volume":"7","author":"JT Hancock","year":"2020","unstructured":"Hancock JT, Khoshgoftaar TM. Catboost for big data: an interdisciplinary review. J Big data. 2020;7(1):1\u201345.","journal-title":"J Big data"},{"issue":"1","key":"684_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-021-00460-8","volume":"8","author":"R Zuech","year":"2021","unstructured":"Zuech R, Hancock J, Khoshgoftaar TM. Detecting web attacks using random undersampling and ensemble learners. J Big Data. 2021;8(1):1\u201320.","journal-title":"J Big Data"},{"issue":"1","key":"684_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-021-00426-w","volume":"8","author":"JL Leevy","year":"2021","unstructured":"Leevy JL, Hancock J, Zuech R, Khoshgoftaar TM. Detecting cybersecurity attacks across different network features and learners. J Big Data. 2021;8(1):1\u201329.","journal-title":"J Big Data"},{"issue":"10","key":"684_CR14","first-page":"74","volume":"6","author":"HH Patel","year":"2018","unstructured":"Patel HH, Prajapati P. Study and analysis of decision tree based classification algorithms. Int J Computer Sci Eng. 2018;6(10):74\u20138.","journal-title":"Int J Computer Sci Eng"},{"issue":"1","key":"684_CR15","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random forests. Mach Learning. 2001;45(1):5\u201332.","journal-title":"Mach Learning"},{"key":"684_CR16","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1016\/j.aap.2019.05.005","volume":"129","author":"X Shi","year":"2019","unstructured":"Shi X, Wong YD, Li MZ-F, Palanisamy C, Chai C. A feature learning approach based on xgboost for driving assessment and risk prediction. Accid Anal Prev. 2019;129:170\u20139.","journal-title":"Accid Anal Prev"},{"issue":"9","key":"684_CR17","doi-asserted-by":"publisher","first-page":"1458","DOI":"10.3390\/sym12091458","volume":"12","author":"C Tang","year":"2020","unstructured":"Tang C, Luktarhan N, Zhao Y. An efficient intrusion detection method based on lightgbm and autoencoder. Symmetry. 2020;12(9):1458.","journal-title":"Symmetry"},{"key":"684_CR18","unstructured":"Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. Catboost: unbiased boosting with categorical features. In: Advances in Neural Information Processing Systems, p. 6638\u20136648. 2018."},{"key":"684_CR19","doi-asserted-by":"publisher","DOI":"10.1002\/9781118646106","volume-title":"Imbalanced Learning: Foundations, Algorithms, and Applications","author":"H He","year":"2013","unstructured":"He H, Ma Y. Imbalanced Learning: Foundations, Algorithms, and Applications. New York: Wiley; 2013."},{"key":"684_CR20","unstructured":"Brownlee J. Undersampling algorithms for imbalanced classification. https:\/\/machinelearningmastery.com\/undersampling-algorithms-for-imbalanced-classification\/"},{"issue":"2065","key":"684_CR21","doi-asserted-by":"publisher","first-page":"20150202","DOI":"10.1098\/rsta.2015.0202","volume":"374","author":"IT Jolliffe","year":"2016","unstructured":"Jolliffe IT, Cadima J. Principal component analysis: a review and recent developments. Philos Trans R Soci. 2016;374(2065):20150202.","journal-title":"Philos Trans R Soci"},{"key":"684_CR22","doi-asserted-by":"crossref","unstructured":"Meng Q, Catchpoole D, Skillicom D, Kennedy PJ. Relational autoencoder for feature extraction. In: 2017 International Joint Conference on Neural Networks (IJCNN), IEEE; p. 364\u2013371. 2017.","DOI":"10.1109\/IJCNN.2017.7965877"},{"key":"684_CR23","unstructured":"Nicholson C. A Beginner\u2019s Guide to Important Topics in AI, Machine Learning, and Deep Learning: Deep utoencoders. https:\/\/wiki.pathmind.com\/deep-autoencoder"},{"key":"684_CR24","doi-asserted-by":"crossref","unstructured":"Safayenikoo P, Akturk I. Weight update skipping: Reducing training time for artificial neural networks. arXiv preprint arXiv:2012.02792. 2020.","DOI":"10.1109\/JETCAS.2021.3127907"},{"key":"684_CR25","unstructured":"Chablani M. Autoencoders: Introduction and Implementation in TF. https:\/\/towardsdatascience.com\/autoencoders-introduction-and-implementation-3f40483b0a85"},{"key":"684_CR26","doi-asserted-by":"crossref","unstructured":"Khalid S, Khalil T, Nasreen S. A survey of feature selection and feature extraction techniques in machine learning. In: 2014 Science and Information Conference, IEEE. p. 372\u2013378; 2014.","DOI":"10.1109\/SAI.2014.6918213"},{"issue":"3","key":"684_CR27","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/s13042-013-0226-9","volume":"6","author":"A Sharma","year":"2015","unstructured":"Sharma A, Paliwal KK. Linear discriminant analysis for the small sample size problem: an overview. Int J Mach Learn Cybern. 2015;6(3):443\u201354.","journal-title":"Int J Mach Learn Cybern"},{"issue":"4","key":"684_CR28","doi-asserted-by":"publisher","first-page":"3671","DOI":"10.1109\/LRA.2019.2927950","volume":"4","author":"M Polic","year":"2019","unstructured":"Polic M, Krajacic I, Lepora N, Orsag M. Convolutional autoencoder for feature extraction in tactile sensing. IEEE Robot Autom Lett. 2019;4(4):3671\u20138.","journal-title":"IEEE Robot Autom Lett"},{"key":"684_CR29","doi-asserted-by":"crossref","unstructured":"Garc\u0131a JG, Robertsson A, Ortega JG, Johansson R. Generalized contact force estimator for a robot manipulator. In: Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006; p. 4019\u20134024 (2006). IEEE.","DOI":"10.1109\/ROBOT.2006.1642319"},{"key":"684_CR30","doi-asserted-by":"publisher","first-page":"52843","DOI":"10.1109\/ACCESS.2018.2869577","volume":"6","author":"M Al-Qatf","year":"2018","unstructured":"Al-Qatf M, Lasheng Y, Al-Habib M, Al-Sabahi K. Deep learning approach combining sparse autoencoder with svm for network intrusion detection. IEEE Access. 2018;6:52843\u201356.","journal-title":"IEEE Access"},{"key":"684_CR31","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1016\/j.measurement.2018.08.010","volume":"130","author":"Z Meng","year":"2018","unstructured":"Meng Z, Zhan X, Li J, Pan Z. An enhancement denoising autoencoder for rolling bearing fault diagnosis. Measurement. 2018;130:448\u201354.","journal-title":"Measurement"},{"key":"684_CR32","doi-asserted-by":"publisher","first-page":"108346","DOI":"10.1109\/ACCESS.2020.3001350","volume":"8","author":"S Zavrak","year":"2020","unstructured":"Zavrak S, Iskefiyeli M. Anomaly-based intrusion detection from network flow features using variational autoencoder. IEEE Access. 2020;8:108346\u201358.","journal-title":"IEEE Access"},{"key":"684_CR33","doi-asserted-by":"crossref","unstructured":"Lee H, Kim J, Kim B, Kim S. Convolutional autoencoder based feature extraction in radar data analysis. In: 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS), IEEE. p. 81\u201384; 2018.","DOI":"10.1109\/SCIS-ISIS.2018.00023"},{"issue":"5","key":"684_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.9734\/jamcs\/2019\/v33i530192","volume":"33","author":"M Al-Shabi","year":"2019","unstructured":"Al-Shabi M. Credit card fraud detection using autoencoder model in unbalanced datasets. J Adv Math Computer Sci. 2019;33(5):1\u201316.","journal-title":"J Adv Math Computer Sci"},{"key":"684_CR35","doi-asserted-by":"crossref","unstructured":"Chen, J., Shen, Y., Ali, R.: Credit card fraud detection using sparse autoencoder and generative adversarial network. In: 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), pp. 1054\u20131059 (2018). IEEE","DOI":"10.1109\/IEMCON.2018.8614815"},{"issue":"12","key":"684_CR36","doi-asserted-by":"publisher","first-page":"3507","DOI":"10.1016\/j.patcog.2013.06.005","volume":"46","author":"M Kemmler","year":"2013","unstructured":"Kemmler M, Rodner E, Wacker E-S, Denzler J. One-class classification with gaussian processes. Pattern Recogn. 2013;46(12):3507\u201318.","journal-title":"Pattern Recogn"},{"key":"684_CR37","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.neucom.2014.09.086","volume":"165","author":"S Kim","year":"2015","unstructured":"Kim S, Choi Y, Lee M. Deep learning with support vector data description. Neurocomputing. 2015;165:111\u20137.","journal-title":"Neurocomputing"},{"key":"684_CR38","unstructured":"imbalanced-learn developers T. Imbalanced-learn documentation. https:\/\/imbalanced-learn.org\/stable\/"},{"key":"684_CR39","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, et al. Scikit-learn: Machine learning in python. J Mach Learn Res. 2011;12:2825\u201330.","journal-title":"J Mach Learn Res"},{"key":"684_CR40","volume-title":"Deep Learning with Keras","author":"A Gulli","year":"2017","unstructured":"Gulli A, Pal S. Deep Learning with Keras. New York: Packt Publishing Ltd; 2017."},{"key":"684_CR41","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/j.inffus.2020.07.007","volume":"64","author":"S Gonzalez","year":"2020","unstructured":"Gonzalez S, Gar\u0131a S, Del Ser J, Rokach L, Herrera F. A practical tutorial on bagging and boosting based ensembles for machine learning: Algorithms, software tools, performance study, practical perspectives and opportunities. Inform Fusion. 2020;64:205\u201337.","journal-title":"Inform Fusion"},{"key":"684_CR42","doi-asserted-by":"crossref","unstructured":"Wen Z, He B, Kotagiri R, Lu S, Shi J. Efficient gradient boosted decision tree training on gpus. In: 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS), pp. 234\u2013243 (2018). IEEE.","DOI":"10.1109\/IPDPS.2018.00033"},{"issue":"1","key":"684_CR43","first-page":"41","volume":"11","author":"SM Basha","year":"2018","unstructured":"Basha SM, Rajput DS, Vandhan V. Impact of gradient ascent and boosting algorithm in classification. Int J Intell Eng Syst (IJIES). 2018;11(1):41\u20139.","journal-title":"Int J Intell Eng Syst (IJIES)"},{"issue":"3","key":"684_CR44","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1287\/moor.2016.0831","volume":"42","author":"A Gupta","year":"2017","unstructured":"Gupta A, Nagarajan V, Ravi R. Approximation algorithms for optimal decision trees and adaptive tsp problems. Math Oper Res. 2017;42(3):876\u201396.","journal-title":"Math Oper Res"},{"key":"684_CR45","doi-asserted-by":"crossref","unstructured":"Seliya N, Khoshgoftaar TM, Van Hulse J. A study on the relationships of classifier performance metrics. In: ICTAI\u201909. 21st International Conference On Tools with Artificial Intelligence, 2009, IEEE. 2009. p. 59\u201366.","DOI":"10.1109\/ICTAI.2009.25"},{"key":"684_CR46","doi-asserted-by":"crossref","unstructured":"Gu Q, Zhu L, Cai Z. Evaluation measures of the classification performance of imbalanced data sets. In: International Symposium on Intelligence Computation and Applications. 2009; Springer. p. 461\u201371.","DOI":"10.1007\/978-3-642-04962-0_53"},{"key":"684_CR47","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983327","volume-title":"Analysis of Variance","author":"GR Iversen","year":"1987","unstructured":"Iversen GR, Norpoth H, Norpoth HP. Analysis of Variance. New York: Sage; 1987."},{"key":"684_CR48","doi-asserted-by":"publisher","first-page":"99","DOI":"10.2307\/3001913","volume":"8","author":"JW Tukey","year":"1949","unstructured":"Tukey JW. Comparing individual means in the analysis of variance. Biometrics. 1949;8:99\u2013114.","journal-title":"Biometrics"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00684-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-023-00684-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00684-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,12]],"date-time":"2024-10-12T10:51:56Z","timestamp":1728730316000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-023-00684-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,17]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["684"],"URL":"https:\/\/doi.org\/10.1186\/s40537-023-00684-w","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,17]]},"assertion":[{"value":"7 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"6"}}