{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T00:25:17Z","timestamp":1759883117715,"version":"build-2065373602"},"reference-count":113,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,1,2]],"date-time":"2025-01-02T00:00:00Z","timestamp":1735776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Artificial neural networks are parametric machine learning models that have been applied successfully to an extended series of classification and regression problems found in the recent literature. For the effective identification of the parameters of the artificial neural networks, a series of optimization techniques have been proposed in the relevant literature, which, although they present good results in many cases, either the optimization method used is not efficient and the training error of the network is trapped in sub-optimal values, or the neural network exhibits the phenomenon of overfitting which means that it has poor results when applied to data that was not present during the training. This paper proposes an innovative technique for constructing the weights of artificial neural networks based on appropriate BNF grammars, used in the evolutionary process of Grammatical Evolution. The new procedure locates an interval of values for the parameters of the artificial neural network, and the optimization method effectively locates the network parameters within this interval. The new technique was applied to a wide range of data classification and adaptation problems covering a number of scientific areas and the experimental results were more than promising.<\/jats:p>","DOI":"10.3390\/bdcc9010005","type":"journal-article","created":{"date-parts":[[2025,1,2]],"date-time":"2025-01-02T10:32:26Z","timestamp":1735813946000},"page":"5","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Training Neural Networks with a Procedure Guided by BNF Grammars"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2343-2733","authenticated-orcid":false,"given":"Ioannis G.","family":"Tsoulos\u00a0","sequence":"first","affiliation":[{"name":"Department of Informatics and Telecommunications, University of Ioannina, 45110 Ioannina, Greece"}]},{"given":"Vasileios","family":"Charilogis","sequence":"additional","affiliation":[{"name":"Department of Informatics and Telecommunications, University of Ioannina, 45110 Ioannina, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.nima.2005.11.139","article-title":"The use of clustering techniques for the classification of high energy physics data","volume":"559","author":"Mjahed","year":"2006","journal-title":"Nucl. Instrum. Methods Phys. Res. Sect. A Accel. Spectrometers Detect. Assoc. Equip."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"042022","DOI":"10.1088\/1742-6596\/1085\/4\/042022","article-title":"End-to-End Event Classification of High-Energy Physics Data","volume":"1085","author":"Andrews","year":"2018","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.chemolab.2003.10.001","article-title":"Improving the classification accuracy in chemistry via boosting technique","volume":"70","author":"He","year":"2004","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"109409","DOI":"10.1016\/j.commatsci.2019.109409","article-title":"Crystallographic prediction from diffraction and chemistry data for higher throughput classification using machine learning","volume":"173","author":"Aguiar","year":"2020","journal-title":"Comput. Mater. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/0925-2312(95)00039-9","article-title":"Designing a neural network for forecasting financial and economic time series","volume":"10","author":"Kaastra","year":"1996","journal-title":"Neurocomputing"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.asoc.2014.12.028","article-title":"A bat-neural network multi-agent system (BNNMAS) for stock price prediction: Case study of DAX stock price","volume":"29","author":"Hafezi","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1186\/s40537-019-0276-2","article-title":"Deep convolutional neural network based medical image classification for disease diagnosis","volume":"6","author":"Yadav","year":"2019","journal-title":"J. Big Data"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Qing, L., Linhong, W., and Xuehai, D. (2019). A Novel Neural Network-Based Method for Medical Text Classification. Future Internet, 11.","DOI":"10.3390\/fi11120255"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bishop, C. (1995). Neural Networks for Pattern Recognition, Oxford University Press.","DOI":"10.1093\/oso\/9780198538493.001.0001"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/BF02551274","article-title":"Approximation by superpositions of a sigmoidal function","volume":"2","author":"Cybenko","year":"1989","journal-title":"Math. Control Signals Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2279","DOI":"10.1016\/S0031-3203(01)00178-9","article-title":"Image processing with neural networks\u2014A review","volume":"35","author":"Handels","year":"2002","journal-title":"Pattern Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/j.eswa.2009.05.044","article-title":"An artificial neural network (p,d,q) model for time series forecasting","volume":"37","author":"Khashei","year":"2010","journal-title":"Expert Syst. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1016\/j.solener.2010.02.006","article-title":"A 24-h forecast of solar irradiance using artificial neural network: Application for performance prediction of a grid-connected PV plant at Trieste, Italy","volume":"84","author":"Mellit","year":"2010","journal-title":"Sol. Energy"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"47","DOI":"10.2478\/v10136-012-0031-x","article-title":"Artificial neural networks in medical diagnosis","volume":"11","author":"Amato","year":"2013","journal-title":"J. Appl. Biomed."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.asoc.2008.02.003","article-title":"Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations","volume":"9","author":"Shirvany","year":"2009","journal-title":"Appl. Soft Comput."},{"key":"ref_16","first-page":"260","article-title":"Numerical solution for high order differential equations using a hybrid neural network\u2014Optimization method","volume":"183","author":"Malek","year":"2006","journal-title":"Appl. Math. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1016\/j.advengsoft.2009.10.003","article-title":"Predicting moisture content of agricultural products using artificial neural networks","volume":"41","author":"Topuz","year":"2010","journal-title":"Adv. Eng. Softw."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Escamilla-Garc\u00eda, A., Soto-Zaraz\u00faa, G.M., Toledano-Ayala, M., Rivas-Araiza, E., and Gast\u00e9lum-Barrios, A. (2020). Applications of Artificial Neural Networks in Greenhouse Technology and Overview for Smart Agriculture Development. Appl. Sci., 10.","DOI":"10.3390\/app10113835"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_20","unstructured":"Riedmiller, M., and Braun, H. (April, January 28). A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP algorithm. Proceedings of the IEEE International Conference on Neural Networks, San Francisco, CA, USA."},{"key":"ref_21","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). ADAM:A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations (ICLR 2015), San Diego, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1016\/0098-1354(95)00228-6","article-title":"Modified quasi-Newton methods for training neural networks","volume":"20","author":"Robitaille","year":"1996","journal-title":"Comput. Chem. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1016\/S0377-2217(97)00292-0","article-title":"Global optimization for artificial neural networks: A tabu search application","volume":"106","author":"Sexton","year":"1998","journal-title":"Eur. J. Oper. Res."},{"key":"ref_24","unstructured":"Yamazaki, A., de Souto, M.C.P., and Ludermir, T.B. (2002, January 12\u201317). Optimization of neural network weights and architectures for odor recognition using simulated annealing. Proceedings of the 2002 International Joint Conference on Neural Networks, IJCNN\u201902, Honolulu, HI, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1109\/TNN.2002.804317","article-title":"Tuning of the structure and parameters of a neural network using an improved genetic algorithm","volume":"14","author":"Leung","year":"2003","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_26","unstructured":"Zhang, C., Shao, H., and Li, Y. (2000, January 8\u201311). Particle swarm optimization for evolving artificial neural network. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Nashville, TN, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1023\/A:1022995128597","article-title":"Differential Evolution Training Algorithm for Feed-Forward Neural Networks","volume":"17","author":"lonen","year":"2003","journal-title":"Neural Processing Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/s11721-015-0112-z","article-title":"Learning neural network structures with ant colony algorithms","volume":"9","author":"Salama","year":"2015","journal-title":"Swarm Intell"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1016\/j.asoc.2012.10.023","article-title":"Artificial neural network training using a new efficient optimization algorithm","volume":"13","author":"Askarzadeh","year":"2013","journal-title":"Appl. Soft Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.engappai.2006.06.005","article-title":"Optimizing feedforward artificial neural network architecture","volume":"20","author":"Benardos","year":"2007","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Karaboga, D., and Akay, B. (2007, January 11\u201313). Artificial Bee Colony (ABC) Algorithm on Training Artificial Neural Networks. Proceedings of the 2007 IEEE 15th Signal Processing and Communications Applications, Eskisehir, Turkey.","DOI":"10.1109\/SIU.2007.4298679"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"292","DOI":"10.3390\/a8020292","article-title":"Training Artificial Neural Networks by a Hybrid PSO-CS Algorithm","volume":"8","author":"Chen","year":"2015","journal-title":"Algorithms"},{"key":"ref_33","first-page":"330","article-title":"Engineering Optimisation by Cuckoo Search","volume":"1","author":"Yang","year":"2010","journal-title":"Int. J. Math. Model. Numer. Optim."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1016\/j.patrec.2010.02.003","article-title":"Parallel implementation of Artificial Neural Network training for speech recognition","volume":"31","author":"Scanzio","year":"2010","journal-title":"Pattern Recognit. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sierra-Canto, X., Madera-Ramirez, F., and Uc-Cetina, V. (2010, January 12\u201314). Parallel Training of a Back-Propagation Neural Network Using CUDA. Proceedings of the 2010 Ninth International Conference on Machine Learning and Applications, Washington, DC, USA.","DOI":"10.1109\/ICMLA.2010.52"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"12470","DOI":"10.1016\/j.eswa.2011.04.028","article-title":"A parallel neural network approach to prediction of Parkinson\u2019s Disease","volume":"38","author":"Koker","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/0950-7051(96)81917-4","article-title":"Initialization of neural networks by means of decision trees","volume":"8","author":"Ivanova","year":"1995","journal-title":"Knowl.-Based Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/S0925-2312(99)00127-7","article-title":"A weight initialization method for improving training speed in feedforward neural network","volume":"30","author":"Yam","year":"2000","journal-title":"Neurocomputing"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.neunet.2021.11.020","article-title":"Feedforward neural networks initialization based on discriminant learning","volume":"146","author":"Chumachenko","year":"2022","journal-title":"Neural Netw."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Itano, F., Sousa, M.A.d.d., and Del-Moral-Hernandez, E. (2018, January 8\u201313). Extending MLP ANN hyper-parameters Optimization by using Genetic Algorithm. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489520"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.aasri.2014.05.004","article-title":"Interval based Weight Initialization Method for Sigmoidal Feedforward Artificial Neural Networks","volume":"6","author":"Sodhi","year":"2014","journal-title":"AASRI Procedia"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"de Sousa, C.A.R. (2016, January 24\u201329). An overview on weight initialization methods for feedforward neural networks. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2016.7727180"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1162\/neco.1992.4.4.473","article-title":"Simplifying neural networks by soft weight sharing","volume":"4","author":"Nowlan","year":"1992","journal-title":"Neural Comput."},{"key":"ref_44","first-page":"177","article-title":"Comparing biases for minimal network construction with back propagation","volume":"Volume 1","author":"Touretzky","year":"1989","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_45","first-page":"107","article-title":"Skeletonization: A technique for trimming the fat from a network via relevance assesment","volume":"Volume 1","author":"Touretzky","year":"1989","journal-title":"Advances in Neural Processing Systems"},{"key":"ref_46","first-page":"105","article-title":"Pruning algorithms of neural networks\u2014A comparative study","volume":"3","author":"Augasta","year":"2003","journal-title":"Cent. Eur. Comput. Sci."},{"key":"ref_47","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1016\/S0893-6080(98)00046-X","article-title":"Weight decay backpropagation for noisy data","volume":"11","author":"Gupta","year":"1998","journal-title":"Neural Netw."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Carvalho, M., and Ludermir, T.B. (2006, January 13\u201315). Particle Swarm Optimization of Feed-Forward Neural Networks with Weight Decay. Proceedings of the 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS\u201906), Rio de Janeiro, Brazil.","DOI":"10.1109\/HIS.2006.264888"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1109\/72.701179","article-title":"Simulated annealing and weight decay in adaptive learning: The SARPROP algorithm","volume":"9","author":"Treadgold","year":"1998","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2399","DOI":"10.1093\/ietisy\/e88-d.10.2399","article-title":"Neural network training algorithm with possitive correlation","volume":"88","author":"Shahjahan","year":"2005","journal-title":"IEEE Trans. Inf. Syst."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Mirjalili, S., and Mirjalili, S. (2019). Genetic algorithm. Evolutionary Algorithms and Neural Networks: Theory and Applications, Springer.","DOI":"10.1007\/978-3-319-93025-1"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1109\/4235.942529","article-title":"Grammatical evolution","volume":"5","author":"Ryan","year":"2001","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_54","unstructured":"Backus, J.W. (1959, January 15\u201320). The Syntax and Semantics of the Proposed International Algebraic Language of the Zurich ACM-GAMM Conference. Proceedings of the International Conference on Information Processing, UNESCO, Paris, France."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.cosrev.2009.03.005","article-title":"Reservoir computing approaches to recurrent neural network training","volume":"3","author":"Jaeger","year":"2009","journal-title":"Comput. Sci. Rev."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_57","unstructured":"Puente, A.O., Alfonso, R.S., and Moreno, M.A. (2002, January 22\u201325). Automatic composition of music by means of grammatical evolution. Proceedings of the APL \u201902: Proceedings of the 2002 Conference on APL: Array Processing Languages: Lore, Problems, and Applications, Madrid, Spain."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Galv\u00e1n-L\u00f3pez, E., Swafford, J.M., O\u2019Neill, M., and Brabazon, A. (2010). Evolving a Ms. PacMan Controller Using Grammatical Evolution. Applications of Evolutionary Computation, Springer. EvoApplications 2010. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-642-12239-2_17"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Shaker, N., Nicolau, M., Yannakakis, G.N., Togelius, J., and O\u2019Neill, M. (2012, January 11\u201314). Evolving levels for Super Mario Bros using grammatical evolution. Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (CIG), Granada, Spain.","DOI":"10.1109\/CIG.2012.6374170"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1147\/rd.474.0483","article-title":"Grammatical evolution to design fractal curves with a given dimension","volume":"47","author":"Ortega","year":"2003","journal-title":"IBM J. Res. Dev."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1504\/IJICA.2007.013399","article-title":"Constant creation in grammatical evolution","volume":"1","author":"Dempsey","year":"2007","journal-title":"Int. J. Innov. Comput. Appl."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Burbidge, R., Walker, J.H., and Wilson, M.S. (2009, January 10\u201315). Grammatical evolution of a robot controller. Proceedings of the 2009 IEEE\/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA.","DOI":"10.1109\/IROS.2009.5354411"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Peabody, C., and Seitzer, J. (2015, January 25\u201330). GEF: A self-programming robot using grammatical evolution. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9721"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.asoc.2013.11.006","article-title":"Modeling glycemia in humans by means of Grammatical Evolution","volume":"20","author":"Hidalgo","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"2907","DOI":"10.1007\/s00500-017-2544-4","article-title":"Discovering taxonomies in Wikipedia by means of grammatical evolution","volume":"22","author":"Araujo","year":"2018","journal-title":"Soft Comput."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"105713","DOI":"10.1016\/j.asoc.2019.105713","article-title":"Grammatical Evolution-based ensembles for algorithmic trading","volume":"84","author":"Quintana","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.neucom.2008.01.017","article-title":"Neural network construction and training using grammatical evolution","volume":"72","author":"Tsoulos","year":"2008","journal-title":"Neurocomputing"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.ejor.2005.07.025","article-title":"Integrated crossover rules in real coded genetic algorithms","volume":"176","author":"Kaelo","year":"2007","journal-title":"Eur. J. Oper. Res."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/BF01589118","article-title":"A Tolerant Algorithm for Linearly Constrained Optimization Calculations","volume":"45","author":"Powell","year":"1989","journal-title":"Math. Program."},{"key":"ref_70","unstructured":"Kelly, M., Longjohn, R., and Nottingham, K. (2024, December 30). The UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu."},{"key":"ref_71","first-page":"255","article-title":"KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework","volume":"17","author":"Fernandez","year":"2011","journal-title":"J. -Mult.-Valued Log. Soft Comput."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Tzimourta, K.D., Tsoulos, I., Bilero, I.T., Tzallas, A.T., Tsipouras, M.G., and Giannakeas, N. (2018). Direct Assessment of Alcohol Consumption in Mental State Using Brain Computer Interfaces and Grammatical Evolution. Inventions, 3.","DOI":"10.3390\/inventions3030051"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/S0020-7373(87)80053-6","article-title":"Simplifying Decision Trees","volume":"27","author":"Quinlan","year":"1987","journal-title":"Int. J. Man-Mach. Stud."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/64.295130","article-title":"Overcoming process delays with decision tree induction","volume":"9","author":"Evans","year":"1994","journal-title":"IEEE Expert"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1109\/TKDE.2004.11","article-title":"NeC4.5: Neural ensemble based C4.5","volume":"16","author":"Zhou","year":"2004","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1023\/A:1008307919726","article-title":"FERNN: An Algorithm for Fast Extraction of Rules from Neural Networks","volume":"12","author":"Setiono","year":"2000","journal-title":"Appl. Intell."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/S0933-3657(98)00028-1","article-title":"Learning Differential Diagnosis of Eryhemato-Squamous Diseases using Voting Feature Intervals","volume":"13","author":"Demiroz","year":"1998","journal-title":"Artif. Intell. Med."},{"key":"ref_78","first-page":"109","article-title":"A Probabilistic Classification System for Predicting the Cellular Localization Sites of Proteins","volume":"4","author":"Horton","year":"1996","journal-title":"Proc. Int. Conf. Intell. Syst. Mol. Biol."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/S0022-5371(77)80054-6","article-title":"Concept learning and the recognition and classification of exemplars","volume":"16","year":"1977","journal-title":"J. Verbal Learn. Verbal Behav."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1023\/A:1008280620621","article-title":"Overcoming the Myopia of Inductive Learning Algorithms with RELIEFF","volume":"7","author":"Kononenko","year":"1997","journal-title":"Appl. Intell."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"1755","DOI":"10.1162\/08997660260028700","article-title":"Using noise to compute error surfaces in connectionist networks: A novel means of reducing catastrophic forgetting","volume":"14","author":"French","year":"2002","journal-title":"Neural Comput."},{"key":"ref_82","first-page":"845","article-title":"Feature Selection for Unsupervised Learning","volume":"5","author":"Dy","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1023\/A:1018792728057","article-title":"Input Feature Extraction for Multilayered Perceptrons Using Supervised Principal Component Analysis","volume":"10","author":"Perantonis","year":"1999","journal-title":"Neural Process. Lett."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"483","DOI":"10.3233\/IDA-2002-6602","article-title":"Classification with sparse grids using simplicial basis functions","volume":"6","author":"Garcke","year":"2002","journal-title":"Intell. Data Anal."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.patrec.2016.01.004","article-title":"Diagnosing a disorder in a classification benchmark","volume":"73","author":"Mcdermott","year":"2016","journal-title":"Pattern Recognit. Lett."},{"key":"ref_86","unstructured":"Bratko, I., and Lavrac, N. (1987). Assistant-86: A Knowledge-Elicitation Tool for Sophisticated Users. Progress in Machine Learning, Sigma Press."},{"key":"ref_87","unstructured":"Heck, D., Knapp, J., Capdevielle, J.N., Schatz, G., and Thouw, T. (2024, December 08). CORSIKA: A Monte Carlo Code to Simulate Extensive Air Showers. Available online: https:\/\/digbib.bibliothek.kit.edu\/volltexte\/fzk\/6019\/6019.pdf."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"4164","DOI":"10.1118\/1.2786864","article-title":"The prediction of breast cancer biopsy outcomes using two CAD approaches that both emphasize an intelligible decision process","volume":"34","author":"Elter","year":"2007","journal-title":"Med. Phys."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/08839519408945432","article-title":"Multistrategy Learning for Document Recognition","volume":"8","author":"Malerba","year":"1994","journal-title":"Appl. Artif. Intell."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1186\/1475-925X-6-23","article-title":"Exploiting Nonlinear Recurrence and Fractal Scaling Properties for Voice Disorder Detection","volume":"6","author":"Little","year":"2007","journal-title":"BioMed Eng. OnLine"},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1109\/TBME.2008.2005954","article-title":"Suitability of dysphonia measurements for telemonitoring of Parkinson\u2019s disease","volume":"56","author":"Little","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_92","unstructured":"Smith, J.W., Everhart, J.E., Dickson, W.C., Knowler, W.C., and Johannes, R.S. Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. Proceedings of the Symposium on Computer Applications and Medical Care."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.5194\/gmd-6-1157-2013","article-title":"Failure analysis of parameter-induced simulation crashes in climate models","volume":"6","author":"Lucas","year":"2013","journal-title":"Geosci. Dev."},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Giannakeas, N., Tsipouras, M.G., Tzallas, A.T., Kyriakidi, K., Tsianou, Z.E., Manousou, P., Hall, A., Karvounis, E.C., Tsianos, V., and Tsianos, E. (2015, January 25\u201329). A clustering based method for collagen proportional area extraction in liver biopsy images. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, Milan, Italy.","DOI":"10.1109\/EMBC.2015.7319047"},{"key":"ref_95","first-page":"260","article-title":"Non-parametric logistic and proportional odds regression","volume":"36","author":"Hastie","year":"1987","journal-title":"JRSS-C (Appl. Stat.)"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/S0169-023X(02)00138-6","article-title":"Fast hierarchical clustering and its validation","volume":"44","author":"Dash","year":"2003","journal-title":"Data Knowl. Eng."},{"key":"ref_97","unstructured":"Cortez, P., and Silva, A.M.G. (2008, January 9\u201311). Using data mining to predict secondary school student performance. Proceedings of the 5th Future Business Technology Conference (FUBUTEC 2008), EUROSIS-ETI, Porto, Portugal."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"5866","DOI":"10.1016\/j.eswa.2008.07.018","article-title":"Knowledge discovery on RFM model using Bernoulli sequence","volume":"36","author":"Yeh","year":"2009","journal-title":"Expert. Appl."},{"key":"ref_99","first-page":"1257","article-title":"Modified bat algorithm for feature selection with the wisconsin diagnosis breast cancer (WDBC) dataset","volume":"18","author":"Jeyasingh","year":"2017","journal-title":"Asian Pac. J. Cancer Prev. APJCP"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"103141","DOI":"10.1016\/j.bspc.2021.103141","article-title":"Computer-aided detection of breast cancer on the Wisconsin dataset: An artificial neural networks approach","volume":"71","author":"Alshayeji","year":"2022","journal-title":"Biomed. Signal Processing Control."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1109\/TSMCB.2003.816922","article-title":"Knowledge discovery in medical and biological datasets using a hybrid Bayes classifier\/evolutionary algorithm","volume":"33","author":"Raymer","year":"2003","journal-title":"IEEE Trans. Syst. Cybern. Part B Cybern. Publ. IEEE Syst. Man, Cybern. Soc."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1080\/10556780600834745","article-title":"Regularized nonsmooth Newton method for multi-class support vector machines","volume":"22","author":"Zhong","year":"2007","journal-title":"Optim. Methods Softw."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"061907","DOI":"10.1103\/PhysRevE.64.061907","article-title":"Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state","volume":"64","author":"Andrzejak","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"80510","DOI":"10.1155\/2007\/80510","article-title":"Automatic Seizure Detection Based on Time-Frequency Analysis and Artificial Neural Networks","volume":"2007","author":"Tzallas","year":"2007","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_105","first-page":"549","article-title":"Exact Bayesian Structure Discovery in Bayesian Networks","volume":"5","author":"Koivisto","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_106","unstructured":"Nash, W.J., Sellers, T.L., Talbot, S.R., Cawthor, A.J., and Ford, W.B. (1994). The Population Biology of Abalone (_Haliotis_ species) in Tasmania. I. Blacklip Abalone (_H. rubra_) from the North Coast and Islands of Bass Strait, Sea Fisheries Division, Department of Primary Industry and Fisheries, Tasmania. Technical Report No. 48."},{"key":"ref_107","unstructured":"Brooks, T.F., Pope, D.S., and Marcolini, A.M. (2024, November 14). Airfoil Self-Noise and Prediction. Technical Report, NASA RP-1218. July 1989, Available online: https:\/\/ntrs.nasa.gov\/citations\/19890016302."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"1797","DOI":"10.1016\/S0008-8846(98)00165-3","article-title":"Modeling of strength of high performance concrete using artificial neural networks","volume":"28","author":"Yeh","year":"1998","journal-title":"Cem. Concr. Res."},{"key":"ref_109","first-page":"141","article-title":"Multivariate Adaptative Regression Splines","volume":"19","author":"Friedman","year":"1991","journal-title":"Ann. Stat."},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/0095-0696(78)90006-2","article-title":"Hedonic prices and the demand for clean ai","volume":"5","author":"Harrison","year":"1978","journal-title":"J. Environ. Econ. Manag."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1162\/106365602320169811","article-title":"Evolving Neural Networks through Augmenting Topologies","volume":"10","author":"Stanley","year":"2002","journal-title":"Evol. Comput."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1162\/neco.1991.3.2.246","article-title":"Universal Approximation Using Radial-Basis-Function Networks","volume":"3","author":"Park","year":"1991","journal-title":"Neural Comput."},{"key":"ref_113","first-page":"52","article-title":"Radial basis function neural networks: A review","volume":"1","author":"Montazer","year":"2018","journal-title":"Comput. Rev. J."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/1\/5\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T15:23:52Z","timestamp":1759850632000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/1\/5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,2]]},"references-count":113,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["bdcc9010005"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9010005","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2025,1,2]]}}}