{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T18:33:01Z","timestamp":1783621981778,"version":"3.55.0"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,9,27]],"date-time":"2020-09-27T00:00:00Z","timestamp":1601164800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,27]],"date-time":"2020-09-27T00:00:00Z","timestamp":1601164800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100011102","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["ICT-2013-612944"],"award-info":[{"award-number":["ICT-2013-612944"]}],"id":[{"id":"10.13039\/100011102","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["H2020-688797"],"award-info":[{"award-number":["H2020-688797"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["World Wide Web"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A sitemap represents an explicit specification of the design concept and knowledge organization of a website and is therefore considered as the website\u2019s basic ontology. It not only presents the main usage flows for users, but also hierarchically organizes concepts of the website. Typically, sitemaps are defined by webmasters in the very early stages of the website design. However, during their life websites significantly change their structure, their content and their possible navigation paths. Even if this is not the case, webmasters can fail to either define sitemaps that reflect the actual website content or, vice versa, to define the actual organization of pages and links which do not reflect the intended organization of the content coded in the sitemaps. In this paper we propose an approach which automatically generates sitemaps. Contrary to other approaches proposed in the literature, which mainly generate sitemaps from the textual content of the pages, in this work sitemaps are generated by analyzing the Web graph of a website. This allows us to: <jats:italic>i)<\/jats:italic> automatically generate a sitemap on the basis of possible navigation paths, <jats:italic>ii)<\/jats:italic> compare the generated sitemaps with either the sitemap provided by the Web designer or with the intended sitemap of the website and, consequently, <jats:italic>iii)<\/jats:italic> plan possible website re-organization. The solution we propose is based on closed frequent sequence extraction and only concentrates on hyperlinks organized in \u201cWeb lists\u201d, which are logical lists embedded in the pages. These \u201cWeb lists\u201d are typically used for supporting users in Web site navigation and they include menus, navbars and content tables. Experiments performed on three real datasets show that the extracted sitemaps are much more similar to those defined by website curators than those obtained by competitor algorithms.<\/jats:p>","DOI":"10.1007\/s11280-020-00839-2","type":"journal-article","created":{"date-parts":[[2020,9,27]],"date-time":"2020-09-27T08:02:33Z","timestamp":1601193753000},"page":"175-203","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Closed sequential pattern mining for sitemap generation"],"prefix":"10.1007","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6690-7583","authenticated-orcid":false,"given":"Michelangelo","family":"Ceci","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pasqua Fabiana","family":"Lanotte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,9,27]]},"reference":[{"key":"839_CR1","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., Zhai, C.: A Survey of Text Clustering Algorithms. In: Aggarwal, C.C., Zhai, C. (eds.) Mining Text Data, pp 77\u2013128. Springer (2012)","DOI":"10.1007\/978-1-4614-3223-4_4"},{"key":"839_CR2","doi-asserted-by":"crossref","unstructured":"Algosaibi, A.A., Melton, A.C.: Using the semantics inherent in sitemaps to learn ontologies. In: IEEE 38Th Annual Computer Software and Applications Conference, COMPSAC Workshops 2014, Vasteras, Sweden, July 21-25, 2014, pp 360\u2013365. IEEE Computer Society (2014)","DOI":"10.1109\/COMPSACW.2014.62"},{"key":"839_CR3","unstructured":"Anderson, C.R., Domingos, P., Weld, D.S.: Adaptive Web navigation for wireless devices. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence - Volume 2, IJCAI\u201901, pp 879\u2013884. Morgan Kaufmann Publishers Inc., San Francisco (2001)"},{"key":"839_CR4","doi-asserted-by":"crossref","unstructured":"Baumgarten, M., B\u00fcchner, A.G., Anand, S.S., Mulvenna, M.D., Hughes, J.G.: User-driven navigation pattern discovery from internet data. In: Revised Papers from the International Workshop on Web Usage Analysis and User Profiling, WEBKDD \u201999, pp 74\u201391. Springer, London (2000)","DOI":"10.1007\/3-540-44934-5_5"},{"issue":"3","key":"839_CR5","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.datak.2004.11.004","volume":"54","author":"V Crescenzi","year":"2005","unstructured":"Crescenzi, V., Merialdo, P., Missier, P.: Clustering Web pages based on their structure. Data Knowl. Eng. 54(3), 279\u2013299 (2005)","journal-title":"Data Knowl. Eng."},{"key":"839_CR6","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1\u201330 (2006)","journal-title":"J. Mach. Learn. Res."},{"issue":"2","key":"839_CR7","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1016\/j.dss.2006.11.004","volume":"43","author":"X Fang","year":"2007","unstructured":"Fang, X., Holsapple, C.W.: An empirical study of Web site navigation structures\u2019 impacts on Web site usability. Decision Support Systems 43(2), 476\u2013491 (2007). Emerging Issues in Collaborative Commerce","journal-title":"Decision Support Systems"},{"key":"839_CR8","unstructured":"Firth, J.R.: Papers in linguistics 1934\u201351. Oxford University Press (1957)"},{"issue":"1","key":"839_CR9","first-page":"54","volume":"1","author":"P Fournier-Viger","year":"2017","unstructured":"Fournier-Viger, P., Lin, J.C.W., Kiran, R.U., Koh, Y.S.: A survey of sequential pattern mining. Data Science and Pattern Recognition 1(1), 54\u201377 (2017)","journal-title":"Data Science and Pattern Recognition"},{"key":"839_CR10","doi-asserted-by":"crossref","unstructured":"Fournier-Viger, P., Lin, J.C.W., Nkambou, R., Vo, B., Tseng, V.S.: High-Utility Pattern Mining: Theory, Algorithms and Applications, 1St Edn, Springer Publishing Company, Incorporated (2019)","DOI":"10.1007\/978-3-030-04921-8"},{"key":"839_CR11","doi-asserted-by":"crossref","unstructured":"Fumarola, F., Lanotte, P.F., Ceci, M., Malerba, D.: Clofast: closed sequential pattern mining using sparse and vertical id-lists Knowledge and Information Systems (2016)","DOI":"10.1007\/s10115-015-0884-x"},{"key":"839_CR12","doi-asserted-by":"crossref","unstructured":"Gan, W., Lin, C., Fournier-Viger, P., Chao, H., Tseng, V., Yu, P.: A survey of utility-oriented pattern mining. IEEE Trans. Knowl. Data Eng., pp 1\u20131 (2019)","DOI":"10.1145\/3314107"},{"key":"839_CR13","doi-asserted-by":"crossref","unstructured":"Gan, W., Lin, J.C., Zhang, J., Chao, H., Fujita, H., Yu, P.S.: Proum: high utility sequential pattern mining. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp. 767\u2013773 (2019)","DOI":"10.1109\/SMC.2019.8914402"},{"key":"839_CR14","doi-asserted-by":"crossref","unstructured":"Gomariz, A., Campos, M., Mar\u00edn, R., Goethals, B.: ClaSP: An Efficient Algorithm for Mining Frequent Closed Sequences. In: PAKDD (1), pp. 50\u201361 (2013)","DOI":"10.1007\/978-3-642-37453-1_5"},{"key":"839_CR15","doi-asserted-by":"crossref","unstructured":"G\u00f6rnerup, O., Gillblad, D., Vasiloudis, T.: Knowing an object by the company it keeps: a domain-agnostic scheme for similarity discovery. In: Aggarwal, C., Zhou, Z., Tuzhilin, A., Xiong, H., Wu, X. (eds.) 2015 IEEE International Conference on Data Mining, ICDM 2015, Atlantic City, NJ, USA, November 14-17, 2015, pp 121\u2013130. IEEE Computer Society (2015)","DOI":"10.1109\/ICDM.2015.85"},{"key":"839_CR16","doi-asserted-by":"crossref","unstructured":"He, D., Wu, D., Graves, W., Klein, M.: Creation of a DL by the Communities and for the Communities. In: 2019 ACM\/IEEE joint conference on digital libraries (JCDL), pp. 327\u2013328 (2019)","DOI":"10.1109\/JCDL.2019.00054"},{"key":"839_CR17","doi-asserted-by":"crossref","unstructured":"Huang, K.Y., Chang, C.H., Tung, J.H., Ho, C.T.: COBRA: closed sequential pattern mining using bi-phase reduction approach. In: Tjoa, A.M., Trujillo, J. (eds.) DaWaK, Lecture Notes in Computer Science, vol. 4081, pp 280\u2013291. Springer (2006)","DOI":"10.1007\/11823728_27"},{"key":"839_CR18","doi-asserted-by":"crossref","unstructured":"Keller, M., M\u00fchlschlegel, P., Hartenstein, H.: Search result presentation: Supporting post-search navigation by integration of taxonomy data. In: Proceedings of the 22nd International Conference on World Wide Web, WWW \u201913 Companion, pp 1269\u20131274. ACM, New York (2013)","DOI":"10.1145\/2487788.2488161"},{"key":"839_CR19","doi-asserted-by":"crossref","unstructured":"Keller, M., Nussbaumer, M.: Menuminer: Revealing the information architecture of large Web sites by analyzing maximal cliques. In: Proceedings of the 21st International Conference on World Wide Web, WWW \u201912 Companion, pp 1025\u20131034. ACM, New York (2012)","DOI":"10.1145\/2187980.2188237"},{"key":"839_CR20","doi-asserted-by":"crossref","unstructured":"Kim, D.J., Lee, S.C., Son, H.Y., Kim, S.W., Lee, J.B.: C-rank: A contribution-based Web page ranking approach. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, SAC \u201914, pp 908\u2013912. Association for Computing Machinery, New York (2014)","DOI":"10.1145\/2554850.2554910"},{"key":"839_CR21","doi-asserted-by":"crossref","unstructured":"Kruskal, J.B.: On the shortest spanning subtree of a graph and the traveling salesman problem. In: Proceedings of the American Mathematical Society, pp. 7:48\u201350 (1956)","DOI":"10.1090\/S0002-9939-1956-0078686-7"},{"key":"839_CR22","doi-asserted-by":"crossref","unstructured":"Lanotte, P.F., Fumarola, F., Ceci, M., Scarpino, A., Torelli, M., Malerba, D.: Automatic extraction of logical Web lists. In: Andreasen, T., Christiansen, H., Cubero, J.C., Ra\u015b, Z. (eds.) Foundations of Intelligent Systems, Lecture Notes in Computer Science, vol. 8502, pp 365\u2013374. Springer International Publishing (2014)","DOI":"10.1007\/978-3-319-08326-1_37"},{"key":"839_CR23","doi-asserted-by":"crossref","unstructured":"Lanotte, P.F., Fumarola, F., Malerba, D., Ceci, M.: Automatic generation of sitemaps based on navigation systems. In: Pardalos, P.M., Conca, P., Giuffrida, G., Nicosia, G. (eds.) Machine Learning, Optimization, and Big Data - Second International Workshop, MOD 2016, Volterra, Italy, August 26-29, 2016, Revised Selected Papers, Lecture Notes in Computer Science, vol. 10122, pp 216\u2013223. Springer (2016)","DOI":"10.1007\/978-3-319-51469-7_18"},{"key":"839_CR24","doi-asserted-by":"crossref","unstructured":"Lee, U., Liu, Z., Cho, J.: Automatic identification of user goals in Web search. In: Proceedings of the 14th International Conference on World Wide Web, WWW \u201905, pp 391\u2013400. ACM, New York (2005)","DOI":"10.1145\/1060745.1060804"},{"key":"839_CR25","unstructured":"Lie, H.W., Bos, B.: Cascading Style Sheets:Designing for the Web, 2nd Edition Addison-Wesley Professional (1999)"},{"key":"839_CR26","doi-asserted-by":"crossref","unstructured":"Lin, C.X., Yu, Y., Han, J., Liu, B.: Hierarchical web-page clustering via in-page and cross-page link structures. In: Proceedings of the 14th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining - Volume Part II, PAKDD\u201910, pp 222\u2013229. Springer, Berlin (2010)","DOI":"10.1007\/978-3-642-13672-6_22"},{"issue":"4","key":"839_CR27","doi-asserted-by":"publisher","first-page":"3944","DOI":"10.1016\/j.eswa.2010.09.056","volume":"38","author":"SH Lin","year":"2011","unstructured":"Lin, S.H., Chu, K.P., Chiu, C.M.: Automatic sitemaps generation: Exploring website structures using block extraction and hyperlink analysis. Expert Syst. Appl. 38(4), 3944\u20133958 (2011)","journal-title":"Expert Syst. Appl."},{"key":"839_CR28","doi-asserted-by":"crossref","unstructured":"Liu, Z., Ng, W.K., Lim, E.P.: An automated algorithm for extracting Website skeleton. In: Database Systems for Advanced Applications, pp. 799\u2013811. Springer (2004)","DOI":"10.1007\/978-3-540-24571-1_70"},{"key":"839_CR29","unstructured":"Luo, Y., She, G., Cheng, P., Xiong, Y.: Botgraph: Web bot detection based on sitemap. arXiv:1903.08074 (2019)"},{"key":"839_CR30","doi-asserted-by":"crossref","unstructured":"Mobasher, B.: Data mining for Web personalization. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web, Methods and Strategies of Web Personalization, Lecture Notes in Computer Science, vol. 4321, pp 90\u2013135. Springer (2007)","DOI":"10.1007\/978-3-540-72079-9_3"},{"issue":"2","key":"839_CR31","doi-asserted-by":"publisher","first-page":"19:1","DOI":"10.1145\/2431211.2431218","volume":"45","author":"C Mooney","year":"2013","unstructured":"Mooney, C., Roddick, J.F.: Sequential pattern mining - approaches and algorithms. ACM Comput. Surv. 45(2), 19:1\u201319:39 (2013)","journal-title":"ACM Comput. Surv."},{"key":"839_CR32","unstructured":"Nakagawa, M., Mobasher, B.: A hybrid Web personalization model based on site connectivity. In: Proceedings of WebKDD, pp. 59\u201370 (2003)"},{"key":"839_CR33","volume-title":"Distribution-free Multiple Comparisons","author":"PB Nemenyi","year":"1963","unstructured":"Nemenyi, P.B.: Distribution-free Multiple Comparisons. Ph.D. Thesis, Princeton University, Princeton (1963)"},{"key":"839_CR34","unstructured":"Nielsen, J., Loranger, H.: Prioritizing Web usability. New riders publishing, thousand oaks, CA USA (2006)"},{"issue":"3","key":"839_CR35","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1145\/937549.937550","volume":"10","author":"C Olston","year":"2003","unstructured":"Olston, C., Chi, E.H.: Scenttrails: Integrating browsing and searching on the web. ACM Trans. Comput.-hum Interact. 10(3), 177\u2013197 (2003)","journal-title":"ACM Trans. Comput.-hum Interact."},{"issue":"2","key":"839_CR36","doi-asserted-by":"publisher","first-page":"191","DOI":"10.7155\/jgaa.00124","volume":"10","author":"P Pons","year":"2006","unstructured":"Pons, P., Latapy, M.: Computing communities in large networks using random walks. Journal of Graph Algorithms and Applications 10(2), 191\u2013218 (2006)","journal-title":"Journal of Graph Algorithms and Applications"},{"issue":"2","key":"839_CR37","doi-asserted-by":"publisher","first-page":"12:1","DOI":"10.1145\/1459352.1459357","volume":"41","author":"X Qi","year":"2009","unstructured":"Qi, X., Davison, B.D.: Web page classification: Features and algorithms. ACM Comput. Surv. 41(2), 12:1\u201312:31 (2009)","journal-title":"ACM Comput. Surv."},{"key":"839_CR38","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1109\/TKDE.2007.1043","volume":"19","author":"J Wang","year":"2007","unstructured":"Wang, J., Han, J., Li, C.: Frequent closed sequence mining without candidate maintenance. IEEE Trans. on Knowl. Data Eng. 19, 1042\u20131056 (2007)","journal-title":"IEEE Trans. on Knowl. Data Eng."},{"key":"839_CR39","unstructured":"Wang, X., Ahuja, N., Llorens, N., Bansal, R., Dhar, S.: Toward an intelligent crawling scheduler for archiving news websites using reinforcement learning. Tech. rep., Virginia Tech . http:\/\/hdl.handle.net\/10919\/96482 (2019)"},{"key":"839_CR40","doi-asserted-by":"crossref","unstructured":"Weninger, T., Bisk, Y., Han, J.: Document-topic hierarchies from document graphs. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, CIKM \u201912, pp 635\u2013644. ACM, New York (2012)","DOI":"10.1145\/2396761.2396843"},{"key":"839_CR41","doi-asserted-by":"crossref","unstructured":"Weninger, T., Han, J.: Exploring structure and content on the web: Extraction and integration of the semi-structured web. In: Proceedings of the Sixth ACM International Conference on Web Search and Data Mining, WSDM \u201913, pp 779\u2013780. Association for Computing Machinery, New York (2013)","DOI":"10.1145\/2433396.2433499"},{"issue":"3","key":"839_CR42","doi-asserted-by":"publisher","first-page":"16:1","DOI":"10.1145\/2516633.2516638","volume":"7","author":"T Weninger","year":"2013","unstructured":"Weninger, T., Johnston, T.J., Han, J.: The parallel path framework for entity discovery on the web. TWEB 7(3), 16:1\u201316:29 (2013)","journal-title":"TWEB"},{"key":"839_CR43","doi-asserted-by":"publisher","first-page":"80","DOI":"10.2307\/3001968","volume":"1","author":"F Wilcoxon","year":"1945","unstructured":"Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics Bulletin 1, 80\u201383 (1945)","journal-title":"Biometrics Bulletin"},{"key":"839_CR44","doi-asserted-by":"crossref","unstructured":"Yan, X., Han, J., Afshar, R.: Clospan: Mining Closed Sequential Patterns in Large Datasets. In: SDM, pp. 166\u2013177 (2003)","DOI":"10.1137\/1.9781611972733.15"},{"issue":"3","key":"839_CR45","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1002\/asi.20990","volume":"60","author":"CC Yang","year":"2009","unstructured":"Yang, C.C., Liu, N.: Web site topic-hierarchy generation based on link structure. J. Am. Soc. Inf. Sci. Technol. 60(3), 495\u2013508 (2009)","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"839_CR46","doi-asserted-by":"crossref","unstructured":"Yin, Z., Gupta, M., Weninger, T., Han, J.: A unified framework for link recommendation using random walks. In: 2010 International Conference on Advances in Social Networks Analysis and Mining, pp. 152\u2013159 (2010)","DOI":"10.1109\/ASONAM.2010.27"},{"issue":"6","key":"839_CR47","doi-asserted-by":"publisher","first-page":"1091","DOI":"10.1109\/TPAMI.2007.1078","volume":"29","author":"L Yujian","year":"2007","unstructured":"Yujian, L., Bo, L.: A normalized levenshtein distance metric. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 1091\u20131095 (2007)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["World Wide Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11280-020-00839-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11280-020-00839-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11280-020-00839-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,26]],"date-time":"2021-09-26T23:56:13Z","timestamp":1632700573000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11280-020-00839-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,27]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["839"],"URL":"https:\/\/doi.org\/10.1007\/s11280-020-00839-2","relation":{},"ISSN":["1386-145X","1573-1413"],"issn-type":[{"value":"1386-145X","type":"print"},{"value":"1573-1413","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,27]]},"assertion":[{"value":"24 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 August 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}