{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T13:08:19Z","timestamp":1783688899512,"version":"3.55.0"},"reference-count":56,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,7,27]],"date-time":"2021-07-27T00:00:00Z","timestamp":1627344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>One of the main focuses of Education 4.0 is to provide students with knowledge on disruptive technologies, such as Machine Learning (ML), as well as the skills to implement this knowledge to solve real-life problems. Therefore, both students and professors require teaching and learning tools that facilitate the introduction to such topics. Consequently, this study looks forward to contributing to the development of those tools by introducing the basic theory behind three machine learning classifying algorithms: K-Nearest-Neighbor (KNN), Linear Discriminant Analysis (LDA), and Simple Perceptron; as well as discussing the diverse advantages and disadvantages of each method. Moreover, it is proposed to analyze how these methods work on different conditions through their implementation over a test bench. Thus, in addition to the description of each algorithm, we discuss their application to solving three different binary classification problems using three different datasets, as well as comparing their performances in these specific case studies. The findings of this study can be used by teachers to provide students the basic knowledge of KNN, LDA, and perceptron algorithms, and, at the same time, it can be used as a guide to learn how to apply them to solve real-life problems that are not limited to the presented datasets.<\/jats:p>","DOI":"10.3390\/fi13080193","type":"journal-article","created":{"date-parts":[[2021,7,27]],"date-time":"2021-07-27T12:18:31Z","timestamp":1627388311000},"page":"193","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Education 4.0: Teaching the Basics of KNN, LDA and Simple Perceptron Algorithms for Binary Classification Problems"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3358-9574","authenticated-orcid":false,"given":"Diego","family":"Lopez-Bernal","sequence":"first","affiliation":[{"name":"Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7630-8608","authenticated-orcid":false,"given":"David","family":"Balderas","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7035-5286","authenticated-orcid":false,"given":"Pedro","family":"Ponce","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5461-2879","authenticated-orcid":false,"given":"Arturo","family":"Molina","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, National Department of Research, Puente 222, Del. Tlalpan, Mexico City 14380, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1080\/00207543.2018.1444806","article-title":"Industry 4.0: State of the art and future trends","volume":"56","author":"Xu","year":"2018","journal-title":"Int. J. Prod. Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-Abitia, G., and Bribiesca-Correa, G. (2021). Assessing Digital Transformation in Universities. Future Internet, 13.","DOI":"10.3390\/fi13020052"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ramirez-Mendoza, R.A., Morales-Menendez, R., Iqbal, H., and Parra-Saldivar, R. (2018, January 17\u201320). Engineering Education 4.0: Proposal for a new Curricula. Proceedings of the 2018 IEEE Global Engineering Education Conference (EDUCON), Santa Cruz de Tenerife, Spain.","DOI":"10.1109\/EDUCON.2018.8363376"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Karacay, G. (2018). Talent development for Industry 4.0. Industry 4.0: Managing the Digital Transformation, Springer.","DOI":"10.1007\/978-3-319-57870-5_7"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1111\/ejed.12162","article-title":"Enhancing the development of competencies: The role of UBC","volume":"51","author":"Quintana","year":"2016","journal-title":"Eur. J. Educ."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Prieto, M.D., Sobrino, \u00c1.F., Soto, L.R., Romero, D., Biosca, P.F., and Mart\u00ednez, L.R. (2019, January 10\u201313). Active learning based laboratory towards engineering education 4.0. Proceedings of the 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Zaragoza, Spain.","DOI":"10.1109\/ETFA.2019.8869509"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, X.D. (2020). A Matrix Algebra Approach to Artificial Intelligence, Springer.","DOI":"10.1007\/978-981-15-2770-8"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ahmad, M.A., Eckert, C., and Teredesai, A. (September, January 29). Interpretable machine learning in healthcare. Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, Washington, DC, USA.","DOI":"10.1145\/3233547.3233667"},{"key":"ref_9","first-page":"25","article-title":"Applying machine learning methods in diagnosing heart disease for diabetic patients","volume":"3","author":"Parthiban","year":"2012","journal-title":"Int. J. Appl. Inf. Syst. (IJAIS)"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Iyer, A., Jeyalatha, S., and Sumbaly, R. (2015). Diagnosis of diabetes using classification mining techniques. arXiv.","DOI":"10.5121\/ijdkp.2015.5101"},{"key":"ref_11","first-page":"396","article-title":"Application of meta learning algorithms for the prediction of diabetes disease","volume":"2","author":"Sen","year":"2014","journal-title":"Int. J. Adv. Res. Comput. Sci. Manag. Stud."},{"key":"ref_12","first-page":"35","article-title":"Breast cancer diagnosis via data mining: Performance analysis of seven different algorithms","volume":"4","author":"Senturk","year":"2014","journal-title":"Comput. Sci. Eng."},{"key":"ref_13","first-page":"1","article-title":"Breast cancer risk prediction using data mining classification techniques","volume":"3","author":"Williams","year":"2015","journal-title":"Trans. Netw. Commun."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Papageorgiou, E.I., Papandrianos, N.I., Apostolopoulos, D.J., and Vassilakos, P.J. (2008, January 1\u20136). Fuzzy cognitive map based decision support system for thyroid diagnosis management. Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence), Hong Kong, China.","DOI":"10.1109\/FUZZY.2008.4630524"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhu, W., Liu, C., Fan, W., and Xie, X. (2018, January 12\u201315). Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00079"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Afshar, P., Mohammadi, A., and Plataniotis, K.N. (2018, January 7\u201310). Brain tumor type classification via capsule networks. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451379"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/asmb.2209","article-title":"Deep learning for finance: Deep portfolios","volume":"33","author":"Heaton","year":"2017","journal-title":"Appl. Stoch. Model. Bus. Ind."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"59","DOI":"10.3905\/jpm.2016.42.4.059","article-title":"Building diversified portfolios that outperform out of sample","volume":"42","year":"2016","journal-title":"J. Portf. Manag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"89","DOI":"10.3905\/jpm.2018.44.2.089","article-title":"Hierarchical clustering-based asset allocation","volume":"44","author":"Raffinot","year":"2017","journal-title":"J. Portf. Manag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1109\/TNN.2003.820556","article-title":"Support vector machine with adaptive parameters in financial time series forecasting","volume":"14","author":"Cao","year":"2003","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_21","unstructured":"Fan, A., and Palaniswami, M. (2001, January 15\u201319). Stock selection using support vector machines. Proceedings of the IJCNN\u201901. International Joint Conference on Neural Networks. Proceedings (Cat. No. 01CH37222), Washington, DC, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1016\/j.asoc.2015.06.040","article-title":"A Na\u00efve SVM-KNN based stock market trend reversal analysis for Indian benchmark indices","volume":"35","author":"Nayak","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1016\/j.asoc.2016.08.026","article-title":"Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine","volume":"49","author":"Zhang","year":"2016","journal-title":"Appl. Soft Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1016\/j.petrol.2017.01.024","article-title":"Ensemble machine learning: An untapped modeling paradigm for petroleum reservoir characterization","volume":"151","author":"Anifowose","year":"2017","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1016\/j.renene.2016.12.095","article-title":"Machine learning methods for solar radiation forecasting: A review","volume":"105","author":"Voyant","year":"2017","journal-title":"Renew. Energy"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1016\/j.renene.2015.11.073","article-title":"Machine learning ensembles for wind power prediction","volume":"89","author":"Heinermann","year":"2016","journal-title":"Renew. Energy"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.energy.2017.03.094","article-title":"Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network","volume":"127","author":"Zeng","year":"2017","journal-title":"Energy"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/j.anucene.2017.11.014","article-title":"Machine learning based system performance prediction model for reactor control","volume":"113","author":"Zeng","year":"2018","journal-title":"Ann. Nucl. Energy"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cosust.2015.06.005","article-title":"Living labs and co-production: University campuses as platforms for sustainability science","volume":"16","author":"Evans","year":"2015","journal-title":"Curr. Opin. Environ. Sustain."},{"key":"ref_30","unstructured":"Detrano, R. (1988). The Cleveland Heart Disease Data Set, VA Medical Center, Long Beach and Cleveland Clinic Foundation."},{"key":"ref_31","unstructured":"Dua, D., and Graff, C. (2017). UCI Machine Learning Repository, University of California."},{"key":"ref_32","unstructured":"Evelyn, F., and Hodges, J. (1989). Discriminatory Analysis-Nonparametric Discrimination: Consistency Properties, International Statistical Institute (ISI). Technical Report."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sun, S., and Huang, R. (2010, January 10\u201312). An adaptive k-nearest neighbor algorithm. Proceedings of the 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery, Yantai, China.","DOI":"10.1109\/FSKD.2010.5569740"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"112869","DOI":"10.1016\/j.eswa.2019.112869","article-title":"Machine learning-based design support system for the prediction of heterogeneous machine parameters in industry 4.0","volume":"140","author":"Romeo","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_36","unstructured":"Taha, H.A., Sakr, A.H., and Yacout, S. (2019, January 23\u201325). Aircraft Engine Remaining Useful Life Prediction Framework for Industry 4.0. Proceedings of the 4th North America conference on Industrial Engineering and Operations Management, Toronto, ON, Canada."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhou, C., and Tham, C.K. (2018, January 11\u201313). Graphel: A graph-based ensemble learning method for distributed diagnostics and prognostics in the industrial internet of things. Proceedings of the 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS), Singapore.","DOI":"10.1109\/PADSW.2018.8644943"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, P., Wang, R., and Shi, N. (2020). IgA Nephropathy Prediction in Children with Machine Learning Algorithms. Future Internet, 12.","DOI":"10.3390\/fi12120230"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Thapa, N., Liu, Z., Kc, D.B., Gokaraju, B., and Roy, K. (2020). Comparison of machine learning and deep learning models for network intrusion detection systems. Future Internet, 12.","DOI":"10.3390\/fi12100167"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40064-016-2941-7","article-title":"The distance function effect on k-nearest neighbor classification for medical datasets","volume":"5","author":"Hu","year":"2016","journal-title":"SpringerPlus"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","article-title":"The use of multiple measurements in taxonomic problems","volume":"7","author":"Fisher","year":"1936","journal-title":"Ann. Eugen."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Xanthopoulos, P., Pardalos, P.M., and Trafalis, T.B. (2013). Linear discriminant analysis. Robust Data Mining, Springer.","DOI":"10.1007\/978-1-4419-9878-1"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kuo, C.J., Ting, K.C., and Chen, Y.C. (2017, January 13\u201317). State of product detection method applicable to Industry 4.0 manufacturing models with small quantities and great variety: An example with springs. Proceedings of the 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan.","DOI":"10.1109\/ICASI.2017.7988251"},{"key":"ref_44","unstructured":"Natesha, B., and Guddeti, R.M.R. (2021). Fog-based Intelligent Machine Malfunction Monitoring System for Industry 4.0. IEEE Trans. Ind. Inform."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Bressan, G., Cisotto, G., M\u00fcller-Putz, G.R., and Wriessnegger, S.C. (2021). Deep learning-based classification of fine hand movements from low frequency EEG. Future Internet, 13.","DOI":"10.3390\/fi13050103"},{"key":"ref_46","unstructured":"Rosenblatt, F. (1957). The Perceptron, a Perceiving and Recognizing Automaton Project Para, Cornell Aeronautical Laboratory."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"107308","DOI":"10.1016\/j.compchemeng.2021.107308","article-title":"Performance prediction of trace metals and cod in wastewater treatment using artificial neural network","volume":"149","author":"Matheri","year":"2021","journal-title":"Comput. Chem. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.procir.2019.02.012","article-title":"Condition monitoring in Industry 4.0 production systems-the idea of computational intelligence methods application","volume":"79","author":"Kluska","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.promfg.2019.07.027","article-title":"Comparative analysis of artificial intelligence techniques for material selection applied to manufacturing in Industry 4.0","volume":"41","author":"Merayo","year":"2019","journal-title":"Procedia Manuf."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Hitimana, E., Bajpai, G., Musabe, R., Sibomana, L., and Kayalvizhi, J. (2021). Implementation of IoT Framework with Data Analysis Using Deep Learning Methods for Occupancy Prediction in a Building. Future Internet, 13.","DOI":"10.3390\/fi13030067"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Sagheer, A., Zidan, M., and Abdelsamea, M.M. (2019). A novel autonomous perceptron model for pattern classification applications. Entropy, 21.","DOI":"10.3390\/e21080763"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.21275\/v5i1.NOV153131","article-title":"Comparative study of K-NN, naive Bayes and decision tree classification techniques","volume":"5","author":"Jadhav","year":"2016","journal-title":"Int. J. Sci. Res. (IJSR)"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"De Leonardis, G., Rosati, S., Balestra, G., Agostini, V., Panero, E., Gastaldi, L., and Knaflitz, M. (2018, January 11\u201313). Human Activity Recognition by Wearable Sensors: Comparison of different classifiers for real-time applications. Proceedings of the 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Rome, Italy.","DOI":"10.1109\/MeMeA.2018.8438750"},{"key":"ref_54","first-page":"84","article-title":"Survey on EEG signal processing methods","volume":"4","author":"Lakshmi","year":"2014","journal-title":"Int. J. Adv. Res. Comput. Sci. Softw. Eng."},{"key":"ref_55","first-page":"206","article-title":"Using Discriminant Analysis for Classification of Patient Status after Three Months from Brain Stroke","volume":"24","author":"Mahmood","year":"2020","journal-title":"Zanco J. Humanit. Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/B978-0-444-63623-2.00007-4","article-title":"Artificial neural networks: Multilayer perceptron for ecological modeling","volume":"Volume 28","author":"Park","year":"2016","journal-title":"Developments in Environmental Modelling"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/8\/193\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:35:35Z","timestamp":1760164535000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/8\/193"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,27]]},"references-count":56,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["fi13080193"],"URL":"https:\/\/doi.org\/10.3390\/fi13080193","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,27]]}}}