{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T03:08:10Z","timestamp":1761102490710,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The content at the end of any hyperlink is subject to two phenomena: the link may break (Link Rot) or the content at the end of the link may no longer be the same as it was when it was created (Content Drift). Reference Rot denotes the combination of both effects. Spatial metadata records rely on hyperlinks for indicating the location of the resources they describe. Therefore, they are also subject to Reference Rot. This paper evaluates the presence of Reference Rot and its impact on the 22,738 distribution URIs of 18,054 metadata records from 26 European INSPIRE spatial data catalogues. Our Link Rot checking method detects broken links while considering the specific requirements of spatial data services. Our Content Drift checking method uses the data format as an indicator. It compares the data formats declared in the metadata with the actual data types returned by the hyperlinks. Findings show that 10.41% of the distribution URIs suffer from Link Rot and at least 6.21% of records suffer from Content Drift (do not declare its distribution types correctly). Additionally, 14.94% of metadata records only contain intermediate HTML web pages as distribution URIs and 31.37% contain at least one HTML web page; thus, they cannot be accessed or checked directly.<\/jats:p>","DOI":"10.3390\/ijgi11010027","type":"journal-article","created":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T20:49:38Z","timestamp":1641242978000},"page":"27","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["The Problem of Reference Rot in Spatial Metadata Catalogues"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0287-9488","authenticated-orcid":false,"given":"Sergio","family":"Martin-Segura","sequence":"first","affiliation":[{"name":"Department of Computer Science and System Engineering, University of Zaragoza, 50018 Zaragoza, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6491-7430","authenticated-orcid":false,"given":"Francisco Javier","family":"Lopez-Pellicer","sequence":"additional","affiliation":[{"name":"Department of Computer Science and System Engineering, University of Zaragoza, 50018 Zaragoza, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1279-0367","authenticated-orcid":false,"given":"Javier","family":"Nogueras-Iso","sequence":"additional","affiliation":[{"name":"Department of Computer Science and System Engineering, University of Zaragoza, 50018 Zaragoza, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3071-5819","authenticated-orcid":false,"given":"Javier","family":"Lacasta","sequence":"additional","affiliation":[{"name":"Department of Computer Science and System Engineering, University of Zaragoza, 50018 Zaragoza, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6557-2494","authenticated-orcid":false,"given":"Francisco Javier","family":"Zarazaga-Soria","sequence":"additional","affiliation":[{"name":"Department of Computer Science and System Engineering, University of Zaragoza, 50018 Zaragoza, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,31]]},"reference":[{"key":"ref_1","first-page":"3","article-title":"Interoperable Spatial Data Catalogs","volume":"65","author":"Nebert","year":"1999","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.cageo.2004.05.015","article-title":"OGC Catalog Services: A Key Element for the Development of Spatial Data Infrastructures","volume":"31","year":"2005","journal-title":"Comput. Geosci."},{"key":"ref_3","unstructured":"INSPIRE MIG (2017). Technical Guidelines for Implementing Dataset and Service Metadata Based on ISO\/TS 19139:2007. INSPIRE Maintenance and Implementation Group (MIG), Version 2.0.1, Technical Report."},{"key":"ref_4","unstructured":"(2014). Geographic Information\u2014Metadata\u2014Part 1: Fundamentals (Standard No. ISO 19115-1:2014)."},{"key":"ref_5","unstructured":"Nebert, D.D. (2021, February 02). The SDI Cookbook. Available online: http:\/\/www.gsdi.org\/pubs.html."},{"key":"ref_6","first-page":"309","article-title":"Librarians and Link Rot: A Comparative Analysis with Some Methodological Considerations","volume":"3","author":"Tyler","year":"2003","journal-title":"Portal Libr. Acad."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/13658816.2018.1515437","article-title":"A Method for Checking the Quality of Geographic Metadata Based on ISO 19157","volume":"33","author":"Lacasta","year":"2019","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Quarati, A., De Martino, M., and Rosim, S. (2021). Geospatial Open Data Usage and Metadata Quality. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10010030"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Klein, M., Van De Sompel, H., Sanderson, R., Shankar, H., Balakireva, L., Zhou, K., and Tobin, R. (2014). Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0115253"},{"key":"ref_10","first-page":"85","article-title":"Persistence and Decay of Web Citations Used in Theses and Dissertations Available at the Sokoine National Agricultural Library, Tanzania","volume":"9","author":"Sife","year":"2013","journal-title":"Int. J. Educ. Dev. Using Inf. Commun. Technol. (IJEDICT)"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1017\/S1049096516002353","article-title":"Reference Rot: An Emerging Threat to Transparency in Political Science","volume":"50","author":"Gertler","year":"2017","journal-title":"PS-Polit. Sci. Polit."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1016\/0169-7552(96)00069-4","article-title":"Fixing the \u201cBroken-Link\u201d Problem: The W3Objects Approach","volume":"28","author":"Ingham","year":"1996","journal-title":"Comput. Netw. ISDN Syst."},{"key":"ref_13","unstructured":"Nielsen, J. (2021, January 13). Fighting Linkrot. Available online: https:\/\/www.nngroup.com\/articles\/fighting-linkrot\/."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"299","DOI":"10.3998\/3336451.0003.212","article-title":"ARCHIVE: Electronic Journals and Scholarly Communication: A Citation and Reference Study","volume":"3","author":"Harter","year":"1997","journal-title":"J. Electron. Publ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1002\/(SICI)1097-4571(1999)50:2<162::AID-ASI7>3.0.CO;2-B","article-title":"An Analysis of Web Page and Web Site Constancy and Permanence","volume":"50","author":"Koehler","year":"1999","journal-title":"J. Am. Soc. Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1002\/1532-2890(2000)9999:9999<::AID-ASI1069>3.0.CO;2-P","article-title":"The Effect of the Web on Undergraduate Citation Behavior 1996\u20131999","volume":"52","author":"Davis","year":"2001","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_17","first-page":"300","article-title":"Web Citation Availability: Analysis and Implications for Scholarship | Casserly | College & Research Libraries","volume":"9","author":"Casserly","year":"2003","journal-title":"Am. Commun. J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1001\/archderm.142.9.1147","article-title":"Uniform Resource Locator Decay in Dermatology Journals: Author Attitudes and Preservation Practices","volume":"142","author":"Wren","year":"2006","journal-title":"Arch. Dermatol."},{"key":"ref_19","first-page":"2","article-title":"Raising the Dead: Recovery of Decayed Online Citations","volume":"9","author":"Dimitrova","year":"2007","journal-title":"Am. Commun. J."},{"key":"ref_20","unstructured":"Rhodes, J.S. (2016, March 15). Web Sites That Heal. Available online: http:\/\/web.archive.org\/web\/20160315090512\/http:\/\/www.webword.com\/moving\/healing.html."},{"key":"ref_21","unstructured":"Rajabifard, A., Kalantari Soltanieh, S., and Binns, A. (2009, January 15\u201319). SDI and Metadata Entry and Updating Tools. Proceedings of the GSDI 11 World Conference, Rotterdam, The Netherlands."},{"key":"ref_22","unstructured":"Olfat, H., Kalantari, M., Rajabifard, A., Williamson, I.P., Pettit, C., and Williams, S. (2010, January 19\u201322). Exploring the Key Areas of Spatial Metadata Automation Research in Australia. Proceedings of the GSDI 12 World Conference: Realising Spatially Enabled Societies, Singapore."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/2.841784","article-title":"Keeping up with the Changing Web","volume":"33","author":"Brewington","year":"2000","journal-title":"Computer"},{"key":"ref_24","unstructured":"Cho, J., and Garcia-Molina, H. (2000, January 10\u201314). The Evolution of the Web and Implications for an Incremental Crawler. Proceedings of the Conference on Very Large Databases, Cairo, Egypt."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1002\/asi.10018","article-title":"Web Page Change and Persistence\u2014A Four-Year Longitudinal Study","volume":"53","author":"Koehler","year":"2002","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/spe.577","article-title":"A Large-Scale Study of the Evolution of Web Pages","volume":"34","author":"Fetterly","year":"2004","journal-title":"Softw. Pract. Exp."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ntoulas, A., Cho, J., and Olston, C. (2004, January 17\u201320). What\u2019s New on the Web? The Evolution of the Web from a Search Engine Perspective. Proceedings of the 13th International Conference on World Wide Web (WWW\u201904), New York, NY, USA.","DOI":"10.1145\/988672.988674"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Adar, E., Teevan, J., Dumais, S.T., and Elsas, J.L. (2009, January 9\u201312). The Web Changes Everything: Understanding the Dynamics of Web Content. Proceedings of the Second ACM International Conference on Web Search and Data Mining (WSDM\u201909), Barcelona, Spain.","DOI":"10.1145\/1498759.1498837"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sanderson, R., Van de Sompel, H., Burnhill, P., and Grover, C. (2013, January 25). Hiberlink: Towards Time Travel for the Scholarly Web. Proceedings of the 1st International Workshop on Digital Preservation of Research Methods and Artefacts (DPRMA\u201913), Indianapolis, IN, USA.","DOI":"10.1145\/2499583.2500370"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1629\/uksg.237","article-title":"Reference Rot in Scholarly Statement: Threat and Remedy","volume":"28","author":"Burnhill","year":"2015","journal-title":"Insights UKSG J."},{"key":"ref_31","first-page":"2:1","article-title":"Automated Quality Assessment of Metadata across Open Data Portals","volume":"8","author":"Neumaier","year":"2016","journal-title":"J. Data Inf. Qual."},{"key":"ref_32","unstructured":"European Data Portal (2021, March 29). Metadata Quality Dashboard\u2014Methodology. Available online: https:\/\/www.europeandataportal.eu\/mqa\/methodology?locale=en#."},{"key":"ref_33","unstructured":"INSPIRE Joint Research Centre (2020). Geoportal Workflow for Establishing Links between Data Sets and Network Services, INSPIRE Joint Research Centre. Technical Report."},{"key":"ref_34","unstructured":"W3C (2020). Data Catalog Vocabulary (DCAT)\u2014Version 2, World Wide Web Consortium. Technical Report."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"60364","DOI":"10.1109\/ACCESS.2021.3073455","article-title":"Quality of Metadata in Open Data Portals","volume":"9","author":"Lacasta","year":"2021","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Freed, N., and Borenstein, N. (1996). Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies, RFC Editor. RFC 2045.","DOI":"10.17487\/rfc2045"},{"key":"ref_37","unstructured":"Nebert, D., Whiteside, A., and Vretanos, P. (2007). Open GIS Catalogue Services Specification (Version: 2.0.2), Open Geospatial Consortium. Technical Report."},{"key":"ref_38","unstructured":"Kessler, G. (2021, February 04). File Signatures. Available online: https:\/\/www.garykessler.net\/library\/file_sigs.html."},{"key":"ref_39","unstructured":"GO FAIR (2021, September 22). FAIR Principles. Available online: https:\/\/www.go-fair.org\/fair-principles\/."},{"key":"ref_40","first-page":"206","article-title":"The Hyper-G Network Information System","volume":"1","author":"Andrews","year":"1995","journal-title":"J. Univers. Comput. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sun, S., Reilly, S., Lannom, L., and Petrone, J. (2003). Handle System Protocol (Ver 2.1) Specification, RFC Editor. RFC 3652.","DOI":"10.17487\/rfc3652"},{"key":"ref_42","unstructured":"(2012). Information and Documentation\u2014Digital Object Identifier System (Standard No. ISO 26324:2012)."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s12145-015-0231-5","article-title":"DOI for Geoscience Data\u2014How Early Practices Shape Present Perceptions","volume":"9","author":"Klump","year":"2016","journal-title":"Earth Sci. Inform."},{"key":"ref_44","unstructured":"The Internet Archive (2021, January 13). Wayback Machine. Available online: https:\/\/web.archive.org\/."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Van de Sompel, H., Nelson, M., and Sanderson, R. (2013). HTTP Framework for Time-Based Access to Resource States\u2014Memento, RFC Editor. RFC 7089.","DOI":"10.17487\/rfc7089"},{"key":"ref_46","unstructured":"WebCite Consortium (2020, December 28). WebCite. Available online: https:\/\/www.webcitation.org\/."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/11\/1\/27\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:56:33Z","timestamp":1760169393000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/11\/1\/27"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,31]]},"references-count":46,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["ijgi11010027"],"URL":"https:\/\/doi.org\/10.3390\/ijgi11010027","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2021,12,31]]}}}