{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T20:46:09Z","timestamp":1783975569967,"version":"3.55.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T00:00:00Z","timestamp":1749772800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T00:00:00Z","timestamp":1749772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["GR 200839GR 200839GR 200839GR 200839"],"award-info":[{"award-number":["GR 200839GR 200839GR 200839GR 200839"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Inf Syst"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The ability to understand and process websites is crucial across various domains. It lays the foundation for machine understanding of websites. Specifically, website embedding proves invaluable when monitoring local government websites within the context of digital transformation. In this paper, we present a comparison of different state-of-the-art website embedding methods and their capability of creating a reasonable website embedding for our specific task. The models consist of visual, mixed, and textual-based embedding methods. We compare the models with a baseline model which embeds the header section of a website. We measure the performance of the models using zero-shot and transfer learning. We evaluate the performance of the models on three different datasets. Additionally to the embedding scoring, we evaluate the classification performance on these datasets. From the zero-shot models Homepage2Vec with visual, a combination of visual and textual embedding, performs best in general over all datasets. When applying transfer learning, TF-IDF &amp; FNN, a text based model, outperforms the others in both cluster scoring as well as precision and F1-score in the classification task. However, time is an important factor when it comes to processing large data quantities. Thus, when additionally considering the time needed, our baseline model is a good alternative, being 1.88 times faster with a maximum decrease of 10 % in the F1-score.<\/jats:p>","DOI":"10.1007\/s10844-025-00954-4","type":"journal-article","created":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T08:02:13Z","timestamp":1749801733000},"page":"97-120","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Benchmarking state of the art website embedding methods for effective processing and analysis in the public sector"],"prefix":"10.1007","volume":"64","author":[{"given":"Jonathan","family":"Gerber","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jasmin","family":"Saxer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bruno","family":"Kreiner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Weiler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,6,13]]},"reference":[{"issue":"2","key":"954_CR1","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1109\/MCI.2015.2405317","volume":"10","author":"A Akusok","year":"2015","unstructured":"Akusok, A., Miche, Y., Karhunen, J., Bjork, K. M., Nian, R., & Lendasse, A. (2015). Arbitrary category classification of websites based on image content. IEEE Computational Intelligence Magazine, 10(2), 30\u201341.","journal-title":"IEEE Computational Intelligence Magazine"},{"key":"954_CR2","doi-asserted-by":"publisher","unstructured":"Andersen, K. V., & Henriksen, H. Z. (2006). E-government maturity models: Extension of the Layne and Lee model. Government Information Quarterly, 23(2), 236\u2013248. https:\/\/doi.org\/10.1016\/j.giq.2005.11.008. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0740624X05000973","DOI":"10.1016\/j.giq.2005.11.008"},{"issue":"3","key":"954_CR3","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1080\/13614568.2016.1152316","volume":"22","author":"VK Bhalla","year":"2016","unstructured":"Bhalla, V. K., & Kumar, N. (2016). An efficient scheme for automatic web pages categorization using the support vector machine. New Review of Hypermedia and Multimedia, 22(3), 223\u2013242.","journal-title":"New Review of Hypermedia and Multimedia"},{"key":"954_CR4","doi-asserted-by":"publisher","first-page":"113001","DOI":"10.1016\/j.eswa.2019.113001","volume":"142","author":"R Bruni","year":"2020","unstructured":"Bruni, R., & Bianchi, G. (2020). Website categorization: A formal approach and robustness analysis in the case of e-commerce detection. Expert Systems with Applications, 142, 113001.","journal-title":"Expert Systems with Applications"},{"key":"954_CR5","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.procs.2019.06.011","volume":"154","author":"E Buber","year":"2019","unstructured":"Buber, E., & Diri, B. (2019). Web page classification using RNN. Procedia Computer Science, 154, 62\u201372.","journal-title":"Procedia Computer Science"},{"key":"954_CR6","doi-asserted-by":"crossref","unstructured":"Chen, X., Zhao, Z., Chen, L., Zhang, D., Ji, J., Luo, A., Xiong, Y., Yu, K.: WebSRC: a dataset for web-based structural reading comprehension. arXiv preprint arXiv:2101.09465 (2021)","DOI":"10.18653\/v1\/2021.emnlp-main.343"},{"key":"954_CR7","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","volume":"2","author":"DL Davies","year":"1979","unstructured":"Davies, D. L., & Bouldin, D. W. (1979). A cluster separation measure. IEEE transactions on pattern analysis and machine intelligence, 2, 224\u2013227.","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"954_CR8","doi-asserted-by":"crossref","unstructured":"Espinosa-Leal, L., Akusok, A., Lendasse, A., Bj\u00f6rk, K.M.: Website classification from webpage renders. In: Proceedings of ELM2019 9. pp. 41\u201350. Springer (2021)","DOI":"10.1007\/978-3-030-58989-9_5"},{"key":"954_CR9","doi-asserted-by":"crossref","unstructured":"Gao, T., Yao, X., Chen, D.: Simcse: Simple contrastive learning of sentence embeddings. arXiv preprint arXiv:2104.08821 (2021)","DOI":"10.18653\/v1\/2021.emnlp-main.552"},{"issue":"5","key":"954_CR10","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1002\/eet.1622","volume":"23","author":"IM Garc\u00eda-S\u00e1nchez","year":"2013","unstructured":"Garc\u00eda-S\u00e1nchez, I. M., Rodr\u00edguez-Dom\u00ednguez, L., & Frias-Aceituno, J. V. (2013). Evolutions in e-governance: evidence from Spanish local governments. Environmental Policy and Governance, 23(5), 323\u2013340.","journal-title":"Environmental Policy and Governance"},{"key":"954_CR11","doi-asserted-by":"crossref","unstructured":"Gerber, J., Kreiner, B., Saxer, J., & Weiler, A. (2024a). Digilog: Enhancing website embedding on local governments - a comparative analysis. In A. Appice, H. Azzag, M. S. Hacid, A. Hadjali, & Z. Ras (Eds.), Foundations of Intelligent Systems (pp. 126\u2013135). Cham: Springer Nature Switzerland.","DOI":"10.1007\/978-3-031-62700-2_12"},{"key":"954_CR12","doi-asserted-by":"crossref","unstructured":"Gerber, J., Kreiner, B., Saxer, J., & Weiler, A. (2024b). Towards Website X-Ray for Europe\u2019s Municipalities: Unveiling Digital Transformation with Multimodal Embeddings. In 26th International Conference on Information Integration and Web Intelligence (iiWAS2024). Bratislava, Slovakia.","DOI":"10.1007\/978-3-031-78090-5_11"},{"key":"954_CR13","unstructured":"Gerber, J., Saxer, J.S., B Kreiner, B., Weiler, A. (2024). Digilog: towards a monitoring platform for digital transformation of european communities. In 18th International Conference on Research Challenges in Information Science (RCIS), Guimar\u00e3es, Portugal (pp. 14\u201317). RWTH Aachen University."},{"key":"954_CR14","doi-asserted-by":"publisher","first-page":"25219","DOI":"10.1007\/s11042-021-10891-3","volume":"80","author":"A Gupta","year":"2021","unstructured":"Gupta, A., & Bhatia, R. (2021). Ensemble approach for web page classification. Multimedia Tools and Applications, 80, 25219\u201325240.","journal-title":"Multimedia Tools and Applications"},{"issue":"17\u201318","key":"954_CR15","doi-asserted-by":"publisher","first-page":"11921","DOI":"10.1007\/s11042-019-08373-8","volume":"79","author":"M Hashemi","year":"2020","unstructured":"Hashemi, M. (2020). Web page classification: a survey of perspectives, gaps, and future directions. Multimedia Tools and Applications, 79(17\u201318), 11921\u201311945.","journal-title":"Multimedia Tools and Applications"},{"key":"954_CR16","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.imavis.2019.06.001","volume":"89","author":"M Hashemi","year":"2019","unstructured":"Hashemi, M., & Hall, M. (2019). Detecting and classifying online dark visual propaganda. Image and Vision Computing, 89, 95\u2013105.","journal-title":"Image and Vision Computing"},{"issue":"4","key":"954_CR17","doi-asserted-by":"publisher","first-page":"150","DOI":"10.3390\/info10040150","volume":"10","author":"K Kowsari","year":"2019","unstructured":"Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. (2019). Text classification algorithms: A survey. Information, 10(4), 150.","journal-title":"Information"},{"key":"954_CR18","doi-asserted-by":"publisher","unstructured":"Layne, K., & Lee, J. (Jun 2001). Developing fully functional E-government: A four stage model. Government Information Quarterly, 18(2), 122\u2013136. https:\/\/doi.org\/10.1016\/S0740-624X(01)00066-1","DOI":"10.1016\/S0740-624X(01)00066-1"},{"key":"954_CR19","doi-asserted-by":"crossref","unstructured":"Li, J., Xu, Y., Cui, L., Wei, F.: MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding (Mar 2022), http:\/\/arxiv.org\/abs\/2110.08518","DOI":"10.18653\/v1\/2022.acl-long.420"},{"key":"954_CR20","doi-asserted-by":"crossref","unstructured":"Lin, B.Y., Sheng, Y., Vo, N., Tata, S.: Freedom: A transferable neural architecture for structured information extraction on web documents. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. pp. 1092\u20131102 (2020)","DOI":"10.1145\/3394486.3403153"},{"key":"954_CR21","unstructured":"L\u00f3pez-S\u00e1nchez, D., Corchado, J.M., Arrieta, A.G.: A CBR system for image-based webpage classification: case representation with convolutional neural networks. In: The Thirtieth International Flairs Conference (2017)"},{"key":"954_CR22","doi-asserted-by":"publisher","unstructured":"Lugeon, S., Piccardi, T., & West, R. (May 2022). Homepage2Vec: Language-Agnostic Website Embedding and Classification. Proceedings of the International AAAI Conference on Web and Social Media, 16, 1285\u20131291. https:\/\/doi.org\/10.1609\/icwsm.v16i1.19380","DOI":"10.1609\/icwsm.v16i1.19380"},{"issue":"1","key":"954_CR23","doi-asserted-by":"publisher","first-page":"9","DOI":"10.3390\/fi13010009","volume":"13","author":"G Mato\u0161evi\u0107","year":"2021","unstructured":"Mato\u0161evi\u0107, G., Dob\u0161a, J., & Mladeni\u0107, D. (2021). Using machine learning for web page classification in search engine optimization. Future Internet, 13(1), 9.","journal-title":"Future Internet"},{"issue":"3","key":"954_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3439726","volume":"54","author":"S Minaee","year":"2021","unstructured":"Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Chenaghlu, M., & Gao, J. (2021). Deep learning\u2013based text classification: a comprehensive review. ACM computing surveys (CSUR), 54(3), 1\u201340.","journal-title":"ACM computing surveys (CSUR)"},{"issue":"10","key":"954_CR25","doi-asserted-by":"publisher","first-page":"1772","DOI":"10.3390\/sym13101772","volume":"13","author":"AK Nandanwar","year":"2021","unstructured":"Nandanwar, A. K., & Choudhary, J. (2021). Semantic features with contextual knowledge-based web page categorization using the GloVe model and stacked BiLSTM. Symmetry, 13(10), 1772.","journal-title":"Symmetry"},{"key":"954_CR26","doi-asserted-by":"publisher","unstructured":"Nandanwar, A. K., & Choudhary, J. (Feb 2023). Contextual Embeddings-Based Web Page Categorization Using the Fine-Tune BERT Model. Symmetry, 15(2), 395. https:\/\/doi.org\/10.3390\/sym15020395","DOI":"10.3390\/sym15020395"},{"issue":"1","key":"954_CR27","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1002\/poi3.317","volume":"15","author":"Z Patergiannaki","year":"2023","unstructured":"Patergiannaki, Z., & Pollalis, Y. (2023). E-Government maturity assessment: Evidence from Greek municipalities. Policy & Internet, 15(1), 6\u201335. https:\/\/doi.org\/10.1002\/poi3.317","journal-title":"Policy & Internet"},{"issue":"2","key":"954_CR28","first-page":"449","volume":"85","author":"V Pina","year":"2007","unstructured":"Pina, V., Torres, L., & Royo, S. (2007). Are ICTs improving transparency and accountability in the EU regional and local governments? An empirical study. Public administration, 85(2), 449\u2013472.","journal-title":"An empirical study. Public administration"},{"key":"954_CR29","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","volume":"20","author":"PJ Rousseeuw","year":"1987","unstructured":"Rousseeuw, P. J. (1987). Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. Journal of computational and applied mathematics, 20, 53\u201365.","journal-title":"Journal of computational and applied mathematics"},{"key":"954_CR30","unstructured":"Windley, P.J.: eGovernment Maturity. Tech. rep., Office of the Governor, State of Utah (2002), https:\/\/www.windley.com\/docs\/eGovernment%20Maturity.pdf"},{"key":"954_CR31","unstructured":"Zhou, Y., Sheng, Y., Vo, N., Edmonds, N., Tata, S.: Simplified dom trees for transferable attribute extraction from the web. arXiv preprint arXiv:2101.02415 (2021)"}],"container-title":["Journal of Intelligent Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10844-025-00954-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10844-025-00954-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10844-025-00954-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T07:39:42Z","timestamp":1771227582000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10844-025-00954-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,13]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["954"],"URL":"https:\/\/doi.org\/10.1007\/s10844-025-00954-4","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-5664280\/v1","asserted-by":"object"}]},"ISSN":["0925-9902","1573-7675"],"issn-type":[{"value":"0925-9902","type":"print"},{"value":"1573-7675","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,13]]},"assertion":[{"value":"17 December 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 May 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 June 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 June 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}