{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T10:37:03Z","timestamp":1790764623927,"version":"4.1.0"},"reference-count":67,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,1,2]],"date-time":"2021-01-02T00:00:00Z","timestamp":1609545600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>This paper presents a novel approach of using machine learning algorithms based on experts\u2019 knowledge to classify web pages into three predefined classes according to the degree of content adjustment to the search engine optimization (SEO) recommendations. In this study, classifiers were built and trained to classify an unknown sample (web page) into one of the three predefined classes and to identify important factors that affect the degree of page adjustment. The data in the training set are manually labeled by domain experts. The experimental results show that machine learning can be used for predicting the degree of adjustment of web pages to the SEO recommendations\u2014classifier accuracy ranges from 54.59% to 69.67%, which is higher than the baseline accuracy of classification of samples in the majority class (48.83%). Practical significance of the proposed approach is in providing the core for building software agents and expert systems to automatically detect web pages, or parts of web pages, that need improvement to comply with the SEO guidelines and, therefore, potentially gain higher rankings by search engines. Also, the results of this study contribute to the field of detecting optimal values of ranking factors that search engines use to rank web pages. Experiments in this paper suggest that important factors to be taken into consideration when preparing a web page are page title, meta description, H1 tag (heading), and body text\u2014which is aligned with the findings of previous research. Another result of this research is a new data set of manually labeled web pages that can be used in further research.<\/jats:p>","DOI":"10.3390\/fi13010009","type":"journal-article","created":{"date-parts":[[2021,1,3]],"date-time":"2021-01-03T19:54:46Z","timestamp":1609703686000},"page":"9","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":51,"title":["Using Machine Learning for Web Page Classification in Search Engine Optimization"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9681-5930","authenticated-orcid":false,"given":"Goran","family":"Mato\u0161evi\u0107","sequence":"first","affiliation":[{"name":"Faculty of Economics and Tourism Dr. Mijo Mirkovi\u0107, University of Pula, 52100 Pula, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jasminka","family":"Dob\u0161a","sequence":"additional","affiliation":[{"name":"Faculty of Organization and Informatics Vara\u017edin, University of Zagreb, 10000 Zagreb, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dunja","family":"Mladeni\u0107","sequence":"additional","affiliation":[{"name":"Institute Jozes Stefan Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gupta, S., Rakesh, N., Thakral, A., and Chaudhary, D.K. (2016, January 22\u201324). Search engine optimization: Success factors. Proceedings of the 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC), Pradesh, India.","DOI":"10.1109\/PDGC.2016.7913146"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1108\/OIR-04-2015-0112","article-title":"Estimating Google\u2019s search engine ranking function from a search engine optimization perspective","volume":"40","author":"Luh","year":"2016","journal-title":"Online Inf. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhu, C., and Wu, G. (2011, January 4\u20136). Research and analysis of search engine optimization factors based on reverse engineering. Proceedings of the 2011 Third International Conference on Multimedia Information Networking and Security (MINES), Shanghai, China.","DOI":"10.1109\/MINES.2011.99"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1016\/j.ipm.2003.12.002","article-title":"The impact of metadata implementation on webpage visibility in search engine results (Part II)","volume":"41","author":"Zhang","year":"2005","journal-title":"Inf. Process. Manag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1016\/j.ipm.2003.12.001","article-title":"The impact of webpage content characteristics on webpage visibility in search engine results (Part I)","volume":"41","author":"Zhang","year":"2005","journal-title":"Inf. Process. Manag."},{"key":"ref_6","first-page":"28","article-title":"Factors Affect Search Engine Optimization","volume":"14","author":"Hussien","year":"2014","journal-title":"Int. J. Comput. Sci. Netw. Secur."},{"key":"ref_7","unstructured":"(2019, October 10). Google Webmaster Guidelines. Available online: https:\/\/support.google.com\/webmasters\/answer\/35769?hl=en."},{"key":"ref_8","unstructured":"(2019, October 10). Bing Webmaster Guidelines. Available online: https:\/\/www.bing.com\/webmaster\/help\/webmaster-guidelines-30fba23a."},{"key":"ref_9","unstructured":"Rutz, O.J., and Bucklin, R.E. (2016). Paid search advertising. Advanced Database Marketing, Routledge."},{"key":"ref_10","unstructured":"(2019, January 04). What is an SEO specialist?. Available online: https:\/\/www.seo.com\/blog\/what-is-an-seo-specialist\/."},{"key":"ref_11","first-page":"148","article-title":"Search engine optimization: Comparison of link building and social sharing","volume":"57","author":"Zhang","year":"2017","journal-title":"J. Comput. Inf. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0169-7552(98)00110-X","article-title":"The anatomy of a large-scale hypertextual web search engine","volume":"30","author":"Brin","year":"1998","journal-title":"Comput. Netw. ISDN Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/3-540-48686-0_1","article-title":"The web as a graph: Measurements, models, and methods","volume":"Volume 1627","author":"Kleinberg","year":"1999","journal-title":"International Computing and Combinatorics Conference"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"White, R.W., Richardson, M., and Yih, W.-T. (2015, January 18). Questions vs. queries in informational search tasks. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.","DOI":"10.1145\/2740908.2742769"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.eswa.2017.12.016","article-title":"Web spam classification method based on deep belief networks","volume":"96","author":"Li","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.eswa.2018.07.067","article-title":"Intelligent web-phishing detection and protection scheme using integrated features of Images, frames and text","volume":"115","author":"Adebowale","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"112986","DOI":"10.1016\/j.eswa.2019.112986","article-title":"Fake news, rumor, information pollution in social media and web: A contemporary survey of state-of-the-arts, challenges and opportunities","volume":"153","author":"Meel","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_18","first-page":"29","article-title":"Conversion of Website Users to Customers-The Black Hat SEO Technique","volume":"8","author":"Bello","year":"2018","journal-title":"Int. J. Adv. Res. Comput. Sci. Softw. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"112876","DOI":"10.1016\/j.eswa.2019.112876","article-title":"Complex Network based Supervised Keyword Extractor","volume":"140","author":"Duari","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3407","DOI":"10.1016\/j.eswa.2010.08.126","article-title":"A web page classification system based on a genetic algorithm using tagged-terms as features","volume":"38","year":"2011","journal-title":"Expert Syst Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1108\/OIR-04-2012-0063","article-title":"Overlapping factors in search engine optimization and web accessibility","volume":"37","author":"Moreno","year":"2013","journal-title":"Online Inf. Rev."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2579990","article-title":"How to improve your search engine ranking: Myths and reality","volume":"8","author":"Su","year":"2014","journal-title":"ACM Trans. Web"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sagot, S., Ostrosi, E., and Foug\u00e8res, A.-J. (2016, January 9\u201312). A multi-agent approach for building a fuzzy decision support system to assist the SEO process. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844859"},{"key":"ref_24","first-page":"379","article-title":"Investigating search engine optimization factors in media websites: The case of Greece","volume":"4","author":"Giomelakis","year":"2016","journal-title":"Digit. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s12046-018-0812-3","article-title":"A distinctive approach to obtain higher page rank through search engine optimization","volume":"43","author":"Khan","year":"2018","journal-title":"S\u0101dhan\u0101"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lee, N. (2016). Search Engine Optimization: Getting to Google\u2019s First Page. Google It, Springer.","DOI":"10.1007\/978-1-4939-6415-4"},{"key":"ref_27","first-page":"199","article-title":"Measuring the utilization of on-page search engine optimization in selected domain","volume":"39","year":"2015","journal-title":"J. Inf. Organ. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ziakis, C., Vlachopoulou, M., Kyrkoudis, T., and Karagkiozidou, M. (2019). Important Factors for Improving Google Search Rank. Future Internet, 11.","DOI":"10.3390\/fi11020032"},{"key":"ref_29","unstructured":"Cirovic, S. (2020). Comparative analysis of SEO factors across and within distinct industries\u2014ecommerce, hospitality, telecommunications. [Master\u2019s Thesis, School of Journalism and Mass Communications, Faculty of Economic and Political Sciences]."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-018-9644-0","article-title":"Improving search engine optimization (SEO) by using hybrid modified MCDM models","volume":"53","author":"Tsuei","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_31","unstructured":"Carvalho, L.L. (2018). Search Engine Ranking Factors Analysis: Moz Digital Marketing Company Survey Study. [Master\u2019s Thesis, Universidade Nova de Lisboa]."},{"key":"ref_32","unstructured":"Aul, V. (2018). Harnessing Search Engine Optimization Experience to Enhance the Visibility of Websites. [Ph.D. Thesis, University of West London]."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"11921","DOI":"10.1007\/s11042-019-08373-8","article-title":"Web page classification: A survey of perspectives, gaps, and future directions","volume":"79","author":"Hashemi","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Balim, C., and \u00d6zkan, K. (2019, January 24\u201326). Functional Classification of Web Pages with Deep Learning. Proceedings of the 27th Signal Processing and Communications Applications Conference (SIU), Sivas, Turkey.","DOI":"10.1109\/SIU.2019.8806240"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Salminen, J., Corporan, J., Marttila, R., Salenius, T., and Jansen, B.J. (2019, January 24\u201326). Using Machine Learning to Predict Ranking of Webpages in the Gift Industry: Factors for Search-Engine Optimization. Proceedings of the 9th International Conference on Information Systems and Technologies, Caro, Egypt.","DOI":"10.1145\/3361570.3361578"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.eswa.2007.09.008","article-title":"Two novel feature selection approaches for web page classification","volume":"36","author":"Chen","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Rovira, C., Codina, L., Guerrero-Sole, F., and Lopezosa, C. (2019). Ranking by Relevance and Citation Counts, a Comparative Study: Google Scholar, Microsoft Academic, WoS and Scopus. Future Internet, 11.","DOI":"10.3390\/fi11090202"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Giannakoulopoulos, A., Konstantinou, N., Koutsompolis, D., Pergantis, M., and Varlamis, I. (2019). Academic Excellence, Website Quality, SEO Performance: Is there a Correlation?. Future Internet, 11.","DOI":"10.3390\/fi11110242"},{"key":"ref_39","unstructured":"Witten, I.H., Frank, E., Hall, A.M., and Pal, C.J. (2016). Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10115-007-0114-2","article-title":"Top 10 algorithms in data mining","volume":"14","author":"Wu","year":"2008","journal-title":"Knowl. Inf. Syst."},{"key":"ref_41","unstructured":"Saura, J.R. (2020). Using Data Sciences in Digital Marketing: Framework, methods, and performance metrics. J. Innov. Knowl., in press."},{"key":"ref_42","unstructured":"Larose, D.T., and Larose, C.D. (2015). Data Mining and Predictive Analytics, John Wiley & Sons, Inc."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning, Springer.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Gaudette, L., and Japkowicz, N. (2009, January 25\u201327). Evaluation methods for ordinal classification. Proceedings of the 22nd Canadian Conference on Artificial Intelligence, Canadian AI 2009, Kelowna, BC, Canada.","DOI":"10.1007\/978-3-642-01818-3_25"},{"key":"ref_46","first-page":"2546","article-title":"Algorithms for hyper-parameter optimization","volume":"24","author":"Bergstra","year":"2011","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Mantovani, R.G., Horv\u00e1th, T., Cerri, R., Vanschoren, J., and Carvalho, A. (2016, January 9\u201312). Hyper-parameter tuning of a decision tree induction algorithm. Proceedings of the 5th Brazilian Conference on Intelligent Systems (BRACIS), Recife, Brazil.","DOI":"10.1109\/BRACIS.2016.018"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/978-1-60327-241-4_13","article-title":"A user\u2019s guide to support vector machines","volume":"Volume 609","author":"Carugo","year":"2010","journal-title":"Data Mining Techniques for the Life Sciences"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Aliakbary, S., Abolhassani, H., Rahmani, H., and Nobakht, B. (2009, January 29\u201331). Web page classification using social tags. Proceedings of the International Conference on Computational Science and Engineering, Vancouver, BC, Canada.","DOI":"10.1109\/CSE.2009.411"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.amc.2015.07.120","article-title":"Web page classification based on a simplified swarm optimization","volume":"270","author":"Lee","year":"2015","journal-title":"Appl. Math. Comput."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Marath, S.T., Shepherd, M., Milios, E., and Duffy, J. (2014, January 6\u20139). Large-scale web page classification. Proceedings of the 47th Hawaii International Conference on System Sciences (HICSS), Waikoloa, HI, USA.","DOI":"10.1109\/HICSS.2014.229"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Berger, A.L., and Mittal, V.O. (2000, January 24\u201328). OCELOT: A system for summarizing Web pages. Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece.","DOI":"10.1145\/345508.345565"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Sun, J.-T., Shen, D., Zeng, H.-J., Yang, Q., Lu, Y., and Chen, Z. (2005, January 15\u201319). Web-page summarization using clickthrough data. Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Salvador, Brazil.","DOI":"10.1145\/1076034.1076070"},{"key":"ref_54","first-page":"60","article-title":"Term-based clustering and summarization of web page collections","volume":"Volume 3060","author":"Tawfik","year":"2004","journal-title":"Advances in Artificial Intelligence"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"174","DOI":"10.7763\/IJCTE.2013.V5.672","article-title":"Webpage Keyword Extraction Using Term Frequency","volume":"5","author":"Mostafa","year":"2013","journal-title":"Int. J. Comput. Theory Eng."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","article-title":"A New Measure of Rank Correlation","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"ref_58","unstructured":"Abdullah, K.D. (2021, January 02). Search Engine Optimization Techniques by Google\u2019s Top Ranking Factors: Website Ranking Signals; 2017. Available online: https:\/\/dl.acm.org\/doi\/book\/10.5555\/3169359."},{"key":"ref_59","unstructured":"Andersson, V., and Lindgren, D. (2017). Ranking Factors to Increase Your Position on the Search Engine Result Page: Theoretical and Practical Examples, Faculty of Computing, Blekinge Institute of Technology."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.engappai.2015.02.002","article-title":"Identifying valid search engine ranking factors in a Web 2.0 and Web 3.0 context for building efficient SEO mechanisms","volume":"41","author":"Mavridis","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1","DOI":"10.17485\/ijst\/2016\/v9i46\/107317","article-title":"On-Page Search Engine Optimization: Study of Factors Affecting Online Purchase Decisions of Consumers","volume":"9","author":"Sujata","year":"2016","journal-title":"Indian J. Sci. Technol."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Jovi\u0107, A., Brki\u0107, K., and Bogunovi\u0107, N. (2015, January 25\u201329). A review of feature selection methods with applications. Proceedings of the 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.","DOI":"10.1109\/MIPRO.2015.7160458"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1080\/00031305.1978.10479236","article-title":"Variations of box plots","volume":"32","author":"McGill","year":"1978","journal-title":"Am. Stat."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Japkowicz, N., and Shah, M. (2011). Statistical Significance Testing. Evaluating Learning Algorithms: A Classification Perspective, Cambridge University Press.","DOI":"10.1017\/CBO9780511921803"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1162\/089976698300017197","article-title":"Approximate statistical tests for comparing supervised classification learning algorithms","volume":"10","author":"Dietterich","year":"1998","journal-title":"Neural Comput."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1214\/aoms\/1177731944","article-title":"A comparison of alternative tests of significance for the problem of m rankings","volume":"11","author":"Milton","year":"1940","journal-title":"Ann. Math. Stat."},{"key":"ref_67","first-page":"263","article-title":"Distribution-free multiple comparisons","volume":"18","author":"Nemenyi","year":"1962","journal-title":"Biometrics"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/1\/9\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:06:26Z","timestamp":1760159186000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/1\/9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,2]]},"references-count":67,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["fi13010009"],"URL":"https:\/\/doi.org\/10.3390\/fi13010009","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,2]]}}}