{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T21:19:44Z","timestamp":1785359984721,"version":"3.55.0"},"reference-count":56,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T00:00:00Z","timestamp":1719792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Big Data"],"abstract":"<jats:p>The k-nearest neighbors (KNN) regression method, known for its nonparametric nature, is highly valued for its simplicity and its effectiveness in handling complex structured data, particularly in big data contexts. However, this method is susceptible to overfitting and fit discontinuity, which present significant challenges. This paper introduces the random kernel k-nearest neighbors (RK-KNN) regression as a novel approach that is well-suited for big data applications. It integrates kernel smoothing with bootstrap sampling to enhance prediction accuracy and the robustness of the model. This method aggregates multiple predictions using random sampling from the training dataset and selects subsets of input variables for kernel KNN (K-KNN). A comprehensive evaluation of RK-KNN on 15 diverse datasets, employing various kernel functions including Gaussian and Epanechnikov, demonstrates its superior performance. When compared to standard KNN and the random KNN (R-KNN) models, it significantly reduces the root mean square error (RMSE) and mean absolute error, as well as improving R-squared values. The RK-KNN variant that employs a specific kernel function yielding the lowest RMSE will be benchmarked against state-of-the-art methods, including support vector regression, artificial neural networks, and random forests.<\/jats:p>","DOI":"10.3389\/fdata.2024.1402384","type":"journal-article","created":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T04:33:10Z","timestamp":1719808390000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":76,"title":["Random kernel k-nearest neighbors regression"],"prefix":"10.3389","volume":"7","author":[{"given":"Patchanok","family":"Srisuradetchai","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Korn","family":"Suksrikran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,7,1]]},"reference":[{"key":"B1","first-page":"1","article-title":"\u201cTowards highly-efficient k-nearest neighbor algorithm for big data classification,\u201d","volume-title":"2022 5th International Conference on Networking, Information Systems and Security","author":"Abdalla","year":"2022"},{"key":"B2","first-page":"255","article-title":"KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework","volume":"17","author":"Alcal\u00e1-Fdez","year":"2011","journal-title":"J. Mult.-Valued Log. Soft Comput"},{"key":"B3","doi-asserted-by":"publisher","first-page":"132095","DOI":"10.1109\/ACCESS.2020.3010099","article-title":"A k-nearest neighbours based ensemble via optimal model selection for regression","volume":"8","author":"Ali","year":"2020","journal-title":"IEEE Access"},{"key":"B4","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman","year":"1992","journal-title":"Am. Stat"},{"key":"B5","doi-asserted-by":"publisher","first-page":"191","DOI":"10.3233\/IDA-1999-3304","article-title":"Nearest neighbor classification from multiple feature subsets","volume":"3","author":"Bay","year":"1999","journal-title":"Intell. Data Anal"},{"key":"B6","doi-asserted-by":"publisher","first-page":"63844","DOI":"10.1109\/ACCESS.2022.3182818","article-title":"Application layer DDoS attack detection using cuckoo search algorithm-trained radial basis function","volume":"10","author":"Beitollahi","year":"2022","journal-title":"IEEE Access"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1999","DOI":"10.1016\/S0031-3203(99)00186-7","article-title":"Adaptive soft k-nearest-neighbour classifiers","volume":"33","author":"Bermejo","year":"2000","journal-title":"Pattern Recogn."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1243962","DOI":"10.3389\/fenvs.2024.1243962","article-title":"Air pollution concentration fuzzy evaluation based on evidence theory and the K-nearest neighbor algorithm","volume":"12","author":"Bian","year":"2024","journal-title":"Front. Environ. Sci"},{"key":"B9","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1021\/ac00029a018","article-title":"Optimal minimal neural interpretation of spectra","volume":"64","year":"1992","journal-title":"Anal. Chem"},{"key":"B10","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn"},{"key":"B11","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-14717-8_39","article-title":"\u201ckNN algorithm with data-driven k value,\u201d","volume-title":"Advanced Data Mining and Applications Lecture Notes in Computer Science","author":"Cheng","year":"2014"},{"key":"B12","doi-asserted-by":"publisher","first-page":"113732","DOI":"10.1016\/j.apenergy.2019.113732","article-title":"Ensemble machine learning-based algorithm for electric vehicle user behavior prediction","volume":"254","author":"Chung","year":"2019","journal-title":"Appl. Energy"},{"key":"B13","volume-title":"Student Performance","author":"Cortez","year":"2014"},{"key":"B14","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.neucom.2015.08.112","article-title":"Efficient kNN classification algorithm for big data","volume":"195","author":"Deng","year":"2016","journal-title":"Neurocomputing"},{"key":"B15","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1186\/s12874-018-0644-1","article-title":"Machine learning methodologies versus cardiovascular risk scores, in predicting disease risk","volume":"18","author":"Dimopoulos","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"115750","DOI":"10.1109\/ACCESS.2021.3106233","article-title":"Advanced ensemble model for solar radiation forecasting using sine cosine algorithm and Newton's laws","volume":"9","author":"El-Kenawy","year":"2021","journal-title":"IEEE Access"},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.1109\/ISAP48318.2019.9065948","article-title":"\u201cK-NN and mean-shift algorithm applied in fault diagnosis in power transformers by DGA,\u201d","author":"Enriquez","year":"2019","journal-title":"Presented at the 2019 20th International Conference on Intelligent System Application to Power Systems (ISAP"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1463","DOI":"10.1021\/ci034032s","article-title":"Predictive toxicology: benchmarking molecular descriptors and statistical methods","volume":"43","author":"Feng","year":"2003","journal-title":"J. Chem. Inf. Comput. Sci"},{"key":"B19","volume-title":"Greedy Function Approximation: A Gradient Boosting Machine","author":"Friedman","year":"1999"},{"key":"B20","doi-asserted-by":"publisher","first-page":"10570","DOI":"10.1016\/j.eswa.2009.02.065","article-title":"Boosting k-nearest neighbor classifier by means of input space projection","volume":"36","author":"Garc\u00eda-Pedrajas","year":"2009","journal-title":"Expert Syst. Appl"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1787","DOI":"10.3390\/buildings13071787","article-title":"\u201cA new ensemble prediction method for reclaimed asphalt pavement (RAP) mixtures containing different constituents","volume":"13","author":"Ghavami","year":"2023","journal-title":"Buildings"},{"key":"B22","doi-asserted-by":"publisher","first-page":"2179","DOI":"10.1021\/ci049849f","article-title":"Development of linear, ensemble, and nonlinear models for the prediction and interpretation of the biological activity of a set of PDGFR inhibitors","volume":"44","author":"Guha","year":"2004","journal-title":"J. Chem. Inf. Comput. Sci"},{"key":"B23","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","author":"Hastie","year":"2009","journal-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics, 2nd ed"},{"key":"B24","unstructured":"HelliwellJ.\n            LayardR.\n            SachsJ.\n          New YorkSustainable Development Solutions NetworkWorld Happiness Report 2017.2017"},{"key":"B25","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1007\/BF00125376","article-title":"Quantitative structure-activity relationships by neural networks and inductive logic programming. II. The inhibition of dihydrofolate reductase by triazines","volume":"8","author":"Hirst","year":"1994","journal-title":"J. Comput. Aided Mol. Des"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1171","DOI":"10.1214\/009053607000000677","article-title":"Kernel methods in machine learning","volume":"36","author":"Hofmann","year":"2008","journal-title":"Ann. Statist"},{"key":"B27","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1016\/j.neucom.2014.07.073","article-title":"Dimensionality reduction for documents with nearest neighbor queries","volume":"150","author":"Ingram","year":"2015","journal-title":"Neurocomputing"},{"key":"B28","doi-asserted-by":"publisher","first-page":"2807","DOI":"10.3390\/smartcities6050126","article-title":"Multiple linear regression and machine learning for predicting the drinking water quality index in Al-seine lake","volume":"6","author":"Jafar","year":"2023","journal-title":"Smart Cities"},{"key":"B29","doi-asserted-by":"publisher","first-page":"108821","DOI":"10.1016\/j.fcr.2023.108821","article-title":"Ensemble machine learning for modeling greenhouse gas emissions at different time scales from irrigated paddy fields","volume":"292","author":"Jiang","year":"2023","journal-title":"Field Crops Res"},{"key":"B30","volume-title":"QSAR: Hansch Analysis and Related Approaches. Methods and Principles in Medicinal Chemistry.","author":"Kubinyi","year":"1993"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1909","DOI":"10.1016\/j.jia.2023.02.011","article-title":"Ensemble learning prediction of soybean yields in China based on meteorological data","volume":"22","author":"Li","year":"2023","journal-title":"J. Integr. Agric"},{"key":"B32","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1109\/ICDMW.2014.112","article-title":"\u201cRandom KNN,\u201d","volume-title":"Presented at the 2014 IEEE International Conference on Data Mining Workshop, Shenzhen, China","author":"Li","year":"2014"},{"key":"B33","unstructured":"dataset-autoHorse_fixed2024"},{"key":"B34","doi-asserted-by":"crossref","DOI":"10.1007\/978-981-33-6400-4_4","article-title":"\u201cBig data classification: applications and challenges,\u201d","author":"Pramanik","year":"2021","journal-title":"Artificial Intelligence and IoT. Studies in Big Data"},{"key":"B35","volume-title":"Residential Building Data Set","author":"Rafiei","year":"2018"},{"key":"B36","volume-title":"Communities and Crime","author":"Redmond","year":"2009"},{"key":"B37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/HPCSIM.2009.5192804","article-title":"\u201cParallelization of the nearest-neighbour search and the cross-validation error evaluation for the kernel weighted k-nn algorithm applied to large data sets in MATLAB,\u201d","volume-title":"Presented at the 2009 International Conference on High Performance Computing & Simulation","author":"Rubio","year":"2009"},{"key":"B38","doi-asserted-by":"publisher","first-page":"286","DOI":"10.3390\/math8020286","article-title":"A new K-nearest neighbors classifier for big data based on efficient data pruning","volume":"8","author":"Saadatfar","year":"2020","journal-title":"Mathematics"},{"key":"B39","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4175.001.0001","volume-title":"Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, 1st ed","author":"Sch\u00f6lkopf","year":"2001"},{"key":"B40","doi-asserted-by":"crossref","DOI":"10.1109\/SmartNets58706.2023.10216028","article-title":"\u201cImproved k-NN regression model using random forests for air pollution prediction,\u201d","volume-title":"Presented at the International Conference on Smart Applications, Communications, and Networking (SmartNets)","author":"Sharma","year":"2023"},{"key":"B41","doi-asserted-by":"publisher","first-page":"4644","DOI":"10.3390\/app13074644","article-title":"Forecasting stock market indices using the recurrent neural network based hybrid models: CNN-LSTM, GRU-CNN, and ensemble models","volume":"13","author":"Song","year":"2023","journal-title":"Appl. Sci"},{"key":"B42","doi-asserted-by":"publisher","first-page":"4198","DOI":"10.1109\/TIA.2018.2836953","article-title":"A novel regression modeling method for PMSLM structural design optimization using a distance-weighted KNN algorithm","volume":"54","author":"Song","year":"2018","journal-title":"IEEE Trans. Indust. Appl"},{"key":"B43","doi-asserted-by":"publisher","first-page":"2032","DOI":"10.1109\/ACCESS.2023.3348078","article-title":"A novel interval forecast for k-nearest neighbor time series: a case study of durian export in Thailand","volume":"12","author":"Srisuradetchai","year":"2023","journal-title":"IEEE Access"},{"key":"B44","article-title":"\u201cUsing ensemble machine learning methods to forecast particulate matter (PM2.5) in Bangkok, Thailand,\u201d","author":"Srisuradetchai","year":"2022","journal-title":"Multi-disciplinary Trends in Artificial Intelligence"},{"key":"B45","first-page":"155","article-title":"\u201cCombining machine learning models with ARIMA for COVID-19 epidemic in Thailand,\u201d","volume-title":"Proceedings of the 2023 Research, Invention, and Innovation Congress: Innovation in Electrical and Electronics (RI2C), Bangkok, Thailand","author":"Srisuradetchai","year":"2023"},{"key":"B46","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1007\/s10994-008-5096-0","article-title":"Exact bootstrap k-nearest neighbor learners","volume":"74","author":"Steele","year":"2009","journal-title":"Mach. Learn"},{"key":"B47","doi-asserted-by":"publisher","first-page":"198328","DOI":"10.1109\/ACCESS.2020.3034550","article-title":"Monitoring statistics and tuning of Kernel principal component analysis with radial basis function kernels","volume":"8","author":"Tan","year":"2020","journal-title":"IEEE Access"},{"key":"B48","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/72.478392","article-title":"A review of Bayesian neural networks with an application to near infrared spectroscopy","volume":"7","author":"Thodberg","year":"1996","journal-title":"IEEE Trans. Neural Networks"},{"key":"B49","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/0169-7439(94)00025-E","article-title":"Weighted holistic invariant molecular descriptors. Part 2. Theory development and applications on modeling physicochemical properties of polyaromatic hydrocarbons","volume":"27","author":"Todeschini","year":"1995","journal-title":"Chemometrics Intell. Lab. Syst"},{"key":"B50","doi-asserted-by":"crossref","DOI":"10.1007\/b13794","volume-title":"Introduction to Nonparametric Estimation. 1st ed","author":"Tsybakov","year":"2009"},{"key":"B51","doi-asserted-by":"publisher","first-page":"629","DOI":"10.3390\/s23020629","article-title":"Survey on exact kNN queries over high-dimensional data space","volume":"23","author":"Ukey","year":"2023","journal-title":"Sensors"},{"key":"B52","volume-title":"Breast Cancer Wisconsin (Diagnostic).","author":"Wolberg","year":"1995"},{"key":"B53","doi-asserted-by":"publisher","first-page":"2417","DOI":"10.1109\/TKDE.2017.2740926","article-title":"Dependency analysis of accuracy estimates in k-fold cross validation","volume":"29","author":"Wong","year":"2017","journal-title":"IEEE Trans. Knowl. Data Eng"},{"key":"B54","doi-asserted-by":"publisher","first-page":"1586","DOI":"10.1109\/TKDE.2019.2912815","article-title":"Reliable accuracy estimates from k-fold cross validation","volume":"32","author":"Wong","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng"},{"key":"B55","doi-asserted-by":"publisher","first-page":"4983","DOI":"10.1109\/TNNLS.2020.3026532","article-title":"Multiple kernel k-means clustering by selecting representative kernels","volume":"32","author":"Yao","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst"},{"key":"B56","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1109\/FSKD.2008.43","article-title":"\u201cA Modified K-NN algorithm for holter waveform classification based on kernel function,\u201d","volume-title":"2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery, Jinan, China","author":"Zheng","year":"2008"}],"container-title":["Frontiers in Big Data"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2024.1402384\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T04:33:31Z","timestamp":1719808411000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2024.1402384\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,1]]},"references-count":56,"alternative-id":["10.3389\/fdata.2024.1402384"],"URL":"https:\/\/doi.org\/10.3389\/fdata.2024.1402384","relation":{},"ISSN":["2624-909X"],"issn-type":[{"value":"2624-909X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,1]]},"article-number":"1402384"}}