{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T22:52:44Z","timestamp":1784674364802,"version":"3.55.0"},"reference-count":73,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2016,6,8]],"date-time":"2016-06-08T00:00:00Z","timestamp":1465344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41501434"],"award-info":[{"award-number":["41501434"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41371372"],"award-info":[{"award-number":["41371372"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>One of the most widely-implemented service standards provided by the Open Geospatial Consortium (OGC) to the user community is the Web Map Service (WMS). WMS is widely employed globally, but there is limited knowledge of the global distribution, adoption status or the service quality of these online WMS resources. To fill this void, we investigated global WMSs resources and performed distributed performance monitoring of these services. This paper explicates a distributed monitoring framework that was used to monitor 46,296 WMSs continuously for over one year and a crawling method to discover these WMSs. We analyzed server locations, provider types, themes, the spatiotemporal coverage of map layers and the service versions for 41,703 valid WMSs. Furthermore, we appraised the stability and performance of basic operations for 1210 selected WMSs (i.e., GetCapabilities and GetMap). We discuss the major reasons for request errors and performance issues, as well as the relationship between service response times and the spatiotemporal distribution of client monitoring sites. This paper will help service providers, end users and developers of standards to grasp the status of global WMS resources, as well as to understand the adoption status of OGC standards. The conclusions drawn in this paper can benefit geospatial resource discovery, service performance evaluation and guide service performance improvements.<\/jats:p>","DOI":"10.3390\/ijgi5060088","type":"journal-article","created":{"date-parts":[[2016,6,8]],"date-time":"2016-06-08T11:26:26Z","timestamp":1465385186000},"page":"88","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Global-Scale Resource Survey and Performance Monitoring of Public OGC Web Map Services"],"prefix":"10.3390","volume":"5","author":[{"given":"Zhipeng","family":"Gui","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"},{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Cao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojing","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoqiang","family":"Cheng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huayi","family":"Wu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2016,6,8]]},"reference":[{"key":"ref_1","unstructured":"Doyle, A. (2000). OpenGIS Web Map Server Interface Implementation Specification Revision 1.0.0, Open Geospatial Consortium."},{"key":"ref_2","unstructured":"De la Beaujardiere, J. (2006). OpenGIS Web Map Service (WMS) Implementation Specification Version 1.3.0, Open Geospatial Consortium."},{"key":"ref_3","unstructured":"International Organization for Standardization (2005). Geographic Information\u2014Web Map Server Interface, International Organization for Standardization. ISO\/TC 211, ISO 19128:2005."},{"key":"ref_4","unstructured":"Shen, S., Liu, W., Wu, H., and Chen, Y. (2009, January 12\u201314). A multi-level comprehensive evaluation method for quality of WMS based on fuzzy mathematics. Proceedings of the 17th International Conference on Geoinformatics, Fairfax, VA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sui, D., Elwood, S., and Goodchild, M. (2012). Crowdsourcing Geographic Knowledge: Volunteered Geographic Information (VGI) in Theory and Practice, Springer.","DOI":"10.1007\/978-94-007-4587-2"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"146","DOI":"10.3390\/ijgi1020146","article-title":"Analyzing the contributor activity of a volunteered geographic information project\u2014The case of OpenStreetMap","volume":"1","author":"Neis","year":"2012","journal-title":"ISPRS Int. J. Geo-Inform."},{"key":"ref_7","first-page":"73","article-title":"Geospatial Service Web: Towards integrated cyberinfrastructure for GIScience","volume":"15","author":"Gong","year":"2012","journal-title":"GSIS"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1080\/19475683.2015.1098727","article-title":"GeoSquare: Collaborative geoprocessing models\u2019 building, execution and sharing on Azure Cloud","volume":"21","author":"Wu","year":"2015","journal-title":"Ann. GIS"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MCG.2007.39","article-title":"Imaging the world: The state of online mapping","volume":"27","author":"Geller","year":"2007","journal-title":"IEEE Comput. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"65","DOI":"10.14714\/CP37.810","article-title":"A new technology for interactive online mapping with vector markup and XML","volume":"37","author":"Zavlavsky","year":"2000","journal-title":"Cartogr. Perspect."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2456","DOI":"10.1109\/TVCG.2013.179","article-title":"Nanocubes for real-time exploration of spatiotemporal datasets","volume":"19","author":"Lins","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Boulos, M.N.K., Warren, J., Gong, J., and Yue, P. (2010). Web GIS in practice VIII: HTML5 and the canvas element for interactive online mapping. Int. J. Health Geogr., 9.","DOI":"10.1186\/1476-072X-9-14"},{"key":"ref_13","unstructured":"Neumann, A., and Winter, A.M. (2001, January 6\u201310). Time for SVG\u2014Towards high quality interactive web-maps. Proceedings of the 20th International Cartographic Conference, Beijing, China."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Peterson, M.P. (2008). International Perspectives on Maps and the Internet, Springer.","DOI":"10.1007\/978-3-540-72029-4"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Peterson, M.P. (2012). Online Maps with APIs and WebServices, Springer.","DOI":"10.1007\/978-3-642-27485-5"},{"key":"ref_16","unstructured":"Open Source Geospatial Foundation Tile Map Service Specification. Available online: http:\/\/wiki.osgeo.org\/wiki\/Tile_Map_Service_Specification."},{"key":"ref_17","unstructured":"Mas\u00f3, J., Pomakis, K., and Juli\u00e0, N. (2010). OpenGIS Web Map Tile Service (WMTS) Implementation Standard Version 1.0.0, Open Geospatial Consortium."},{"key":"ref_18","first-page":"121","article-title":"Restful implementation of catalogue service for geospatial data provenance","volume":"1","author":"Jiang","year":"2013","journal-title":"ISPRS Arch."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1080\/19475683.2013.782467","article-title":"A visualization-enhanced graphical user interface for geospatial resource discovery","volume":"19","author":"Gui","year":"2013","journal-title":"Ann. GIS"},{"key":"ref_20","unstructured":"ArcGIS Server Website. Available online: http:\/\/www.esri.com\/software\/arcgis\/arcgisserver\/."},{"key":"ref_21","unstructured":"AUTODESK AUTOCAD MAP 3D To Add an Image from WMS (Web Map Service). Available online: https:\/\/knowledge.autodesk.com\/support\/autocad-map-3d\/learn-explore\/caas\/CloudHelp\/cloudhelp\/2015\/ENU\/MAP3D-Use\/files\/GUID-A9F620AD-6B9A-487D-9B33-7D365307D571-htm.html."},{"key":"ref_22","unstructured":"AUTODESK AUTOCAD CIVIL 3D To Add an Image from WMS (Web Map Service). Available online: https:\/\/knowledge.autodesk.com\/support\/autocad-civil-3d\/learn-explore\/caas\/CloudHelp\/cloudhelp\/2017\/ENU\/MAP3D-Use\/files\/GUID-A9F620AD-6B9A-487D-9B33-7D365307D571-htm.html."},{"key":"ref_23","unstructured":"OpenLayers Web Map Service Layers. Available online: http:\/\/openlayers.org\/workshop\/layers\/wms.html."},{"key":"ref_24","unstructured":"GRASS GIS GRASS GIS Manuals. Available online: https:\/\/grass.osgeo.org\/index.php?mact=News,cntnt01,detail,0&cntnt01articleid=42&cntnt01returnid=58."},{"key":"ref_25","unstructured":"QGIS QGIS as OGC Data Client. Available online: http:\/\/docs.qgis.org\/2.8\/en\/docs\/user_manual\/working_with_ogc\/ogc_client_support.html#wms-wmts-client."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shekhar, S., and Xiong, H. (2008). Encyclopedia of GIS, Springer.","DOI":"10.1007\/978-0-387-35973-1"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1145\/1058150.1058156","article-title":"A snapshot of public web services","volume":"34","author":"Fan","year":"2005","journal-title":"Sigmod. Rec."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, Y., Liu, Y., Zhang, L., Li, G., Xie, B., and Sun, J. (2007, January 9\u201313). An exploratory study of web services on the internet. Proceedings of the 2007 IEEE International Conference on Web Services, Salt Lake City, UT, USA.","DOI":"10.1109\/ICWS.2007.37"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1080\/13658810802698571","article-title":"Developing a grid-enabled spatial Web portal for Internet GIServices and geospatial cyberinfrastructure","volume":"23","author":"Zhang","year":"2009","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_30","unstructured":"GEOSS Clearinghouse Website. Available online: http:\/\/clearinghouse.cisc.gmu.edu\/geonetwork\/srv\/en\/main.home."},{"key":"ref_31","unstructured":"Data.gov Website, Available online: http:\/\/catalog.data.gov\/dataset."},{"key":"ref_32","first-page":"168","article-title":"A review of the implementation of OGC Web Services across Europe","volume":"6","author":"Florczyk","year":"2011","journal-title":"IJSDIR"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Gensel, J., Josselin, D., and Vandenbroucke, D. (2012). Bridging the Geographic Information Sciences, Springer.","DOI":"10.1007\/978-3-642-29063-3"},{"key":"ref_34","unstructured":"Refractions Research OGC Services Survey. Available online: http:\/\/www.refractions.net\/expertise\/whitepapers\/ogcsurvey\/ogcsurvey\/."},{"key":"ref_35","unstructured":"Skylab Mobilesystems Ltd. OGC WMS Server List. Available online: http:\/\/www.skylab-mobilesystems.com\/en\/wms_serverlist.html."},{"key":"ref_36","unstructured":"Bartley, J.D. (2005, January 7). MAPDEX: A global index of distributed web map services. Proceedings of the FGDC Coordination Meeting Summary, Washington, DC, USA."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1080\/13658810903514172","article-title":"An active crawler for discovering geospatial web services and their distribution pattern\u2014A case study of OGC web map service","volume":"24","author":"Li","year":"2010","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.cageo.2011.10.017","article-title":"Identifying orthoimages in web map services","volume":"47","author":"Florczyk","year":"2012","journal-title":"Comput. Geosci."},{"key":"ref_39","first-page":"1","article-title":"QoS for web services: Requirements and possible approaches","volume":"25","author":"Lee","year":"2003","journal-title":"W3C Work. Group Note"},{"key":"ref_40","unstructured":"INSPIRE Implementing Directive 2007\/2\/EC of the European Parliament and of the Council as Regards the Network Services. Available online: http:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/PDF\/?uri=CELEX:32009R0976&from=EN."},{"key":"ref_41","unstructured":"INSPIRE Technical Guidance for the Implementation of INSPIRE View Services. Available online: http:\/\/inspire.ec.europa.eu\/documents\/Network_Services\/TechnicalGuidance_ViewServices_v3.11.pdf."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Seip, C., and Bill, R. (2015). Evaluation and monitoring of service quality: Discussing ways to meet INSPIRE requirements. Trans. GIS.","DOI":"10.1111\/tgis.12145"},{"key":"ref_43","unstructured":"Anderson, B., and Deoliveira, J. (2007, January 24\u201327). WMS performance tests! Mapserver & Geoserver. Proceedings of the Free and Open Source Software for Geospatial Conference, Victoria, BC, Canada."},{"key":"ref_44","unstructured":"Hor\u00e1k, J., Ardielli, J., and Hor\u00e1kov\u00e1, B. (2009, January 15\u201319). Testing of web map services. Proceedings of the Global Spatial Data Infrastructure Association World Conference, Rotterdam, Netherland."},{"key":"ref_45","first-page":"1","article-title":"Testing OGC Web Feature and Coverage Service performance: Towards efficient delivery of geospatial data","volume":"7","author":"Giuliani","year":"2013","journal-title":"J. Spat. Inf. Sci."},{"key":"ref_46","unstructured":"Anthony, M., and Nebert, D. (2012, January 14\u201317). Monitoring the performance and reliability of geospatial web services: Service Status Checker (SSC) system overview. Proceedings of the Global Spatial Data Infrastructure World Conference, Qu\u00e9bec, QC, Canada."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1080\/13658816.2010.484811","article-title":"An optimized framework for seamlessly integrating OGC Web Services to support geospatial sciences","volume":"25","author":"Li","year":"2011","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1080\/13658816.2012.739692","article-title":"A performance, semantic and service quality-enhanced distributed search engine for improving geospatial resource discovery","volume":"27","author":"Gui","year":"2013","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.cageo.2010.05.026","article-title":"Monitoring and evaluating the quality of Web Map Service resources for optimizing map composition over the internet to support decision making","volume":"37","author":"Wu","year":"2011","journal-title":"Comput. Geosci."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1080\/13658816.2014.968783","article-title":"Forming a global monitoring mechanism and a spatiotemporal performance model for geospatial services","volume":"29","author":"Xia","year":"2015","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_51","first-page":"385","article-title":"QoGIS: Concept and research framework","volume":"32","author":"Wu","year":"2007","journal-title":"Geomat. Inform. Sci. Wuhan Univ."},{"key":"ref_52","unstructured":"SETI@home Website. Available online: http:\/\/seti.ssl.berkeley.edu\/."},{"key":"ref_53","unstructured":"Climate@Home Website, Available online: http:\/\/www.nasa.gov\/offices\/ocio\/ittalk\/08\u20132010_climate.html#.VxR-__mF6Ul."},{"key":"ref_54","first-page":"161","article-title":"Research on conception and methods of geospatial information services quality evaluation","volume":"37","author":"Zhang","year":"2012","journal-title":"Sci. Surv. Map."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"320","DOI":"10.2747\/1548-1603.44.4.320","article-title":"Web map server performance and client design principles","volume":"44","author":"Yang","year":"2007","journal-title":"Gisci. Remote Sens."},{"key":"ref_56","first-page":"185","article-title":"A topic crawler for discovering geospatial web services","volume":"17","author":"Shen","year":"2015","journal-title":"J. Geo-Inform. Sci."},{"key":"ref_57","unstructured":"EuroGEOSS Broker Website. Available online: http:\/\/www.eurogeoss-broker.eu\/."},{"key":"ref_58","unstructured":"An ArcGIS REST Service Directory from NOAA Office for Coastal Management, Available online: https:\/\/coast.noaa.gov\/arcgis\/rest\/services."},{"key":"ref_59","unstructured":"An ArcGIS REST Service Directory from IndianaMAP. Available online: http:\/\/maps.indiana.edu\/arcgis\/rest\/services."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Wu, S., Zhang, M., Huang, Q., Zhang, Y., Wan, C., Zhang, K., Cao, J., Gui, Z., and Qin, K. (2015, January 19\u201321). Design a web portal for visualizing and exploring service quality of global OGC web map services. Proceedings of the Geoinformatics 2015, Wuhan, China.","DOI":"10.1109\/GEOINFORMATICS.2015.7378687"},{"key":"ref_61","unstructured":"USGS Water Services Frequently Asked Questions, Available online: http:\/\/waterservices.usgs.gov\/docs\/faq.html."},{"key":"ref_62","unstructured":"cURL Man Page. Available online: https:\/\/curl.haxx.se\/docs\/manpage.html."},{"key":"ref_63","unstructured":"Directive, I.N.S.P.I.R.E. Directive 2007\/2\/EC of the European Parliament and of the Council of 14 March 2007 Establishing An Infrastructure for Spatial Information in the European Community (INSPIRE). Available online: http:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/PDF\/?uri=CELEX:32007L0002&from=EN."},{"key":"ref_64","unstructured":"INSPIRE Geoportal Website. Available online: http:\/\/inspire-geoportal.ec.europa.eu\/."},{"key":"ref_65","unstructured":"Group on Earth Observations GEO Societal Benefit Areas. Available online: https:\/\/www.aprsaf.org\/data\/feature\/f_086_3.pdf."},{"key":"ref_66","unstructured":"RGIS Website. Available online: http:\/\/rgis.unm.edu\/."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1080\/00107510500052444","article-title":"Power laws, Pareto distributions and Zipf\u2019s law","volume":"46","author":"Newman","year":"2005","journal-title":"Contemp. Phys."},{"key":"ref_68","unstructured":"A GeoServer WMS from the Socioeconomic Data and Applications Center (SEDAC). Available online: http:\/\/sedac.ciesin.columbia.edu\/geoserver\/wms?SERVICE=WMS&REQUEST=GetCapabilities&VERSIO N=1.3.0."},{"key":"ref_69","unstructured":"China Employment and Wage Maps from the National Geomatics Center of China (NGCC). Available online: http:\/\/gisserver.tianditu.com\/TDTService\/ew\/2014\/wms?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.3.0."},{"key":"ref_70","unstructured":"NASA Earth Observations (NEO) WMS, Available online: http:\/\/neowms.sci.gsfc.nasa.gov\/wms\/wms?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.3.0."},{"key":"ref_71","unstructured":"Kim, E., and Lee, Y. (2005). Quality Model for Web Services, Organization for the Advancement of Structured Information Standards."},{"key":"ref_72","unstructured":"Coallier, F. (2001). Software Engineering\u2013Product Quality\u2014Part 1: Quality Model, International Organization for Standardization."},{"key":"ref_73","unstructured":"A Geological Data WMS from Arizona Geological Survey, Available online: http:\/\/services.azgs.az.gov\/ArcGIS\/services\/OneGeology\/AZGS_Arizona_Geology\/MapServer\/WMSServer?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.3.0."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/5\/6\/88\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:25:10Z","timestamp":1760210710000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/5\/6\/88"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,8]]},"references-count":73,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["ijgi5060088"],"URL":"https:\/\/doi.org\/10.3390\/ijgi5060088","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,6,8]]}}}