{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T17:27:14Z","timestamp":1776706034804,"version":"3.51.2"},"reference-count":60,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T00:00:00Z","timestamp":1604016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Continuous observation of climate indicators, such as trends in lake freezing, is important to understand the dynamics of the local and global climate system. Consequently, lake ice has been included among the Essential Climate Variables (ECVs) of the Global Climate Observing System (GCOS), and there is a need to set up operational monitoring capabilities. Multi-temporal satellite images and publicly available webcam streams are among the viable data sources capable of monitoring lake ice. In this work we investigate machine learning-based image analysis as a tool to determine the spatio-temporal extent of ice on Swiss Alpine lakes as well as the ice-on and ice-off dates, from both multispectral optical satellite images (VIIRS and MODIS) and RGB webcam images. We model lake ice monitoring as a pixel-wise semantic segmentation problem, i.e., each pixel on the lake surface is classified to obtain a spatially explicit map of ice cover. We show experimentally that the proposed system produces consistently good results when tested on data from multiple winters and lakes. Our satellite-based method obtains mean Intersection-over-Union (mIoU) scores &gt; 93%, for both sensors. It also generalises well across lakes and winters with mIoU scores &gt; 78% and &gt;80% respectively. On average, our webcam approach achieves mIoU values of \u224887% and generalisation scores of \u224871% and \u224869% across different cameras and winters respectively. Additionally, we generate and make available a new benchmark dataset of webcam images (Photi-LakeIce) which includes data from two winters and three cameras.<\/jats:p>","DOI":"10.3390\/rs12213555","type":"journal-article","created":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T09:29:32Z","timestamp":1604050172000},"page":"3555","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Ice Monitoring in Swiss Lakes from Optical Satellites and Webcams Using Machine Learning"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0352-7153","authenticated-orcid":false,"given":"Manu","family":"Tom","sequence":"first","affiliation":[{"name":"Institute of Geodesy and Photogrammetry, ETH Zurich, 8093 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rajanie","family":"Prabha","sequence":"additional","affiliation":[{"name":"Dynamic Vision and Learning Group, TU Munich, 85748 Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8321-9483","authenticated-orcid":false,"given":"Tianyu","family":"Wu","sequence":"additional","affiliation":[{"name":"Institute of Geodesy and Photogrammetry, ETH Zurich, 8093 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emmanuel","family":"Baltsavias","sequence":"additional","affiliation":[{"name":"Institute of Geodesy and Photogrammetry, ETH Zurich, 8093 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura","family":"Leal-Taix\u00e9","sequence":"additional","affiliation":[{"name":"Dynamic Vision and Learning Group, TU Munich, 85748 Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3172-9246","authenticated-orcid":false,"given":"Konrad","family":"Schindler","sequence":"additional","affiliation":[{"name":"Institute of Geodesy and Photogrammetry, ETH Zurich, 8093 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,30]]},"reference":[{"key":"ref_1","unstructured":"Rolnick, D., Donti, P.L., Kaack, L.H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A.S., Milojevic-Dupont, N., Jaques, N., and Waldman-Brown, A. (2019). Tackling Climate Change with Machine Learning. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1038\/s41558-018-0393-5","article-title":"Widespread loss of lake ice around the Northern Hemisphere in a warming world","volume":"9","author":"Sharma","year":"2019","journal-title":"Nat. Clim. Chang."},{"key":"ref_3","unstructured":"WMO (2020, March 24). Available online: https:\/\/public.wmo.int\/en\/programmes\/global-climate-observing-system\/essential-climate-variables."},{"key":"ref_4","unstructured":"(2020, October 11). ESA Climate Change Initiative. Available online: https:\/\/www.esa.int\/Applications\/Observing_the_Earth\/Space_for_our_climate\/ESA_s_Climate_Change_Initiative."},{"key":"ref_5","unstructured":"(2020, October 11). ESA CCI+ Overview. Available online: https:\/\/climate.esa.int\/sites\/default\/files\/01_180320%20CCI%2B%20Overview%20revised.pdf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1002\/lol2.10116","article-title":"Consequences of lake and river ice loss on cultural ecosystem services","volume":"4","author":"Knoll","year":"2019","journal-title":"Limnol. Oceanogr. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1126\/science.250.4983.967","article-title":"Effects of Climatic Warming on Lakes of the Central Boreal Forest","volume":"250","author":"Schindler","year":"1990","journal-title":"Science"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1743","DOI":"10.1126\/science.289.5485.1743","article-title":"Historical Trends in Lake and River Ice Cover in the Northern Hemisphere","volume":"289","author":"Magnuson","year":"2000","journal-title":"Science"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tedesco, M. (2015). Remote sensing of lake and river ice. Remote Sensing of the Cryosphere, Wiley-Blackwell.","DOI":"10.1002\/9781118368909"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1002\/hyp.6131","article-title":"Recent trends in Canadian lake ice cover","volume":"20","author":"Duguay","year":"2006","journal-title":"Hydrol. Process."},{"key":"ref_11","unstructured":"Spencer, P., Miller, A.E., Reed, B., and Budde, M. (2008, January 18\u201320). Monitoring lake ice seasons in southwest Alaska with MODIS images. Proceedings of the Pecora Conference, Denver, CO, USA."},{"key":"ref_12","first-page":"431","article-title":"Modelling Lake Ice Phenology with an Examination of Satellite-Detected Subgrid Cell Variability","volume":"6","author":"Brown","year":"2012","journal-title":"Adv. Meteorol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"287","DOI":"10.5194\/tc-7-287-2013","article-title":"Analysis of ice phenology of lakes on the Tibetan Plateau from MODIS data","volume":"7","author":"Maussion","year":"2013","journal-title":"Cryosphere"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1080\/20964471.2019.1631729","article-title":"MODIS-based Daily Lake Ice Extent and Coverage dataset for Tibetan Plateau","volume":"3","author":"Qiu","year":"2019","journal-title":"Big Earth Data"},{"key":"ref_15","unstructured":"Riggs, G.A., Hall, D.K., and Rom\u00e1n, M.O. (2020, October 07). MODIS Snow Products Collection 6 User Guide, Available online: https:\/\/modis-snow-ice.gsfc.nasa.gov\/uploads\/C6_MODIS_Snow_User_Guide.pdf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1007\/s10584-019-02623-2","article-title":"MODIS-observed variations of lake ice phenology in Xinjiang, China","volume":"158","author":"Cai","year":"2020","journal-title":"Clim. Chang."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, S., and Pavelsky, T.M. (2019). Remote Sensing of Lake Ice Phenology across a Range of Lakes Sizes, ME, USA. Remote Sens., 11.","DOI":"10.3390\/rs11141718"},{"key":"ref_18","unstructured":"Cr\u00e9taux, J.-F., Merchant, C.J., Duguay, C., Simis, S., Calmettes, B., Berg\u00e9-Nguyen, M., Wu, Y., Zhang, D., Carrea, L., and Liu, X. (2020, October 11). ESA Lakes Climate Change Initiative (Lakes_cci): Lake Products, Version 1.0. Centre for Environmental Data Analysis. Available online: http:\/\/dx.doi.org\/10.5285\/3c324bb4ee394d0d876fe2e1db217378."},{"key":"ref_19","unstructured":"(2020, April 24). Lake Ice Extent Product. Available online: https:\/\/land.copernicus.eu\/global\/products\/lie."},{"key":"ref_20","unstructured":"Riggs, G.A., Hall, D.K., and Rom\u00e1n, M.O. (2020, October 07). MODIS Snow Products Collection 6.1 User Guide, Available online: https:\/\/modis-snow-ice.gsfc.nasa.gov\/uploads\/snow_user_guide_C6.1_final_revised_april.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Riggs, G.A., Hall, D.K., and Rom\u00e1n, M.O. (2020, October 12). NASA S-NPP VIIRS Snow Products Collection 1 (C1) User Guide. Available online: https:\/\/nsidc.org\/sites\/nsidc.org\/files\/technical-references\/VIIRS-snow-products-user-guide-final.pdf.","DOI":"10.3390\/rs12223781"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1080\/07038992.2019.1601006","article-title":"Clear-Sky Composites over Canada from Visible Infrared Imaging Radiometer Suite: Continuing MODIS Time Series into the Future","volume":"45","author":"Trishchenko","year":"2019","journal-title":"Can. J. Remote Sens."},{"key":"ref_23","unstructured":"Trishchenko, A.P., and Ungureanu, C. (2017, January 7\u20139). Intercomparison of MODIS and VIIRS Results for Mapping Summer Minimum of Snow and Ice (MSI) Extent Over Canadian Landmass. Proceedings of the EARSeL workshop on Land Ice and Snow, Bern, Switzerland."},{"key":"ref_24","unstructured":"S\u00fctterlin, M., Duguay-Tetzlaff, A., and Wunderle, S. (2017, January 23\u201328). Toward a Lake Ice Phenology Derived from VIIRS Data. Proceedings of the EGU General Assembly, Vienna, Austria."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, Y., Key, J., and Mahoney, R. (2016). Sea and Freshwater Ice Concentration from VIIRS on Suomi NPP and the Future JPSS Satellites. Remote Sens., 8.","DOI":"10.3390\/rs8060523"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Trishchenko, A.P., and Ungureanu, C. (2018, January 22\u201327). Warm Season Snow\/Ice Probability Maps from MODIS and VIIRS Sensors over Canada. Proceedings of the International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519558"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1080\/01431161.2018.1519281","article-title":"The Role of Lake Size and Local Phenomena for Monitoring Ground-Fast Lake Ice","volume":"40","author":"Pointner","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3646","DOI":"10.1080\/01431161.2018.1447165","article-title":"Icy lakes extraction and water-ice classification using Landsat 8 OLI multispectral data","volume":"39","author":"Barbieux","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3045","DOI":"10.5194\/tc-12-3045-2018","article-title":"Dual-satellite (Sentinel-2 and Landsat 8) remote sensing of supraglacial lakes in Greenland","volume":"12","author":"Williamson","year":"2018","journal-title":"Cryosphere"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"58","DOI":"10.3389\/feart.2017.00058","article-title":"Toward Monitoring Surface and Subsurface Lakes on the Greenland Ice Sheet Using Sentinel-1 SAR and Landsat-8 OLI Imagery","volume":"5","author":"Miles","year":"2017","journal-title":"Front. Earth Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jacobs, N., Burgin, W., Fridrich, N., Abrams, A., Miskell, K., Braswell, B.H., Richardson, A.D., and Pless, R. (2009, January 4\u20136). The Global Network of Outdoor Webcams: Properties and Applications. Proceedings of the ACM International Conference on Advances in Geographic Information Systems, Seattle, WA, USA.","DOI":"10.1145\/1653771.1653789"},{"key":"ref_32","unstructured":"J\u00e9gou, S., Drozdzal, M., V\u00e1zquez, D., Romero, A., and Bengio, Y. (July, January 26). The one hundred layers tiramisu: Fully convolutional DenseNets for semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"311","DOI":"10.5194\/isprs-annals-IV-2-311-2018","article-title":"Lake ice monitoring with webcams","volume":"2","author":"Xiao","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_34","unstructured":"Tom, M., Suetterlin, M., Bouffard, D., Rothermel, M., Wunderle, S., and Baltsavias, E. (2020, October 09). Integrated Monitoring of Ice in Selected Swiss Lakes, Final Project Report. Available online: https:\/\/arxiv.org\/abs\/2008.00512."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"279","DOI":"10.5194\/isprs-annals-IV-2-279-2018","article-title":"Lake ice detection in low-resolution optical satellite images","volume":"2","author":"Tom","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"549","DOI":"10.5194\/isprs-annals-V-2-2020-549-2020","article-title":"Lake Ice Monitoring with Webcams and Crowd-Sourced Images","volume":"2-2020","author":"Prabha","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"409","DOI":"10.5194\/isprs-annals-V-3-2020-409-2020","article-title":"Lake Ice Detection from Sentinel-1 SAR with Deep Learning","volume":"3-2020","author":"Tom","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3707","DOI":"10.1002\/hyp.1235","article-title":"Development of a historical ice database for the study of climate change in Canada","volume":"16","author":"Lenormand","year":"2002","journal-title":"Hydrol. Process."},{"key":"ref_39","unstructured":"(2018, January 11). Suomi National Polar-Orbiting Partnership Mission. Available online: https:\/\/eoportal.org\/web\/eoportal\/satellite-missions\/s\/suomi-npp."},{"key":"ref_40","unstructured":"(2020, May 23). Terra Mission (EOS\/AM-1). Available online: https:\/\/eoportal.org\/web\/eoportal\/satellite-missions\/t\/terra."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A Scalable Tree Boosting System. Proceedings of the International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-Vector Networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1002\/joc.1553","article-title":"Freezing of lakes on the Swiss plateau in the period 1901\u20132006","volume":"28","author":"Scherrer","year":"2008","journal-title":"Int. J. Climatol."},{"key":"ref_44","unstructured":"Federal Office of Topography Swisstopo (2020, October 21). Available online: https:\/\/www.swisstopo.admin.ch\/."},{"key":"ref_45","unstructured":"(2020, May 23). Aqua Mission (EOS\/PM-1). Available online: https:\/\/eoportal.org\/web\/eoportal\/satellite-missions\/a\/aqua."},{"key":"ref_46","unstructured":"(2020, September 30). Level-1 and Atmosphere Archive & Distribution System Distributed Active Archive Center, Available online: https:\/\/ladsweb.modaps.eosdis.nasa.gov\/."},{"key":"ref_47","unstructured":"(2020, October 09). Labelme: Image Polygonal Annotation with Python. Available online: https:\/\/github.com\/wkentaro\/labelme."},{"key":"ref_48","unstructured":"MODIS Reprojection Tool Swath (2017, September 11). Available online: https:\/\/lpdaac.usgs.gov\/tools\/modis_reprojection_tool_swath."},{"key":"ref_49","unstructured":"Satpy (2020, August 04). Available online: https:\/\/satpy.readthedocs.io\/."},{"key":"ref_50","unstructured":"H5py (2020, August 04). Available online: https:\/\/www.h5py.org\/."},{"key":"ref_51","unstructured":"Pyresample (2020, August 04). Available online: https:\/\/pyresample.readthedocs.io\/."},{"key":"ref_52","unstructured":"GDAL (2020, August 04). Available online: https:\/\/gdal.org\/."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"112","DOI":"10.3138\/FM57-6770-U75U-7727","article-title":"Algorithms for the reduction of the number of points required to represent a digitized line or its caricature","volume":"10","author":"Douglas","year":"1973","journal-title":"Cartographica"},{"key":"ref_54","unstructured":"Tom, M., Lanaras, C., Baltsavias, E., and Schindler, K. (2017, January 23\u201327). Ice Detection in Swiss Lakes using MODIS Data. Proceedings of the Asian Conference on Remote Sensing, New Delhi, India."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The Pascal Visual Object Classes Challenge: A Retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_57","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (July, January 26). The Cityscapes dataset for semantic Urban Scene Understanding. Proceedings of the International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_59","unstructured":"(2020, October 07). MODIS\/Terra CGF Snow Cover Daily L3 Global 500m SIN Grid, Version 61. Available online: https:\/\/nsidc.org\/data\/MOD10A1F\/versions\/61."},{"key":"ref_60","unstructured":"(2020, August 04). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: https:\/\/www.tensorflow.org\/."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/21\/3555\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:27:00Z","timestamp":1760178420000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/21\/3555"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,30]]},"references-count":60,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["rs12213555"],"URL":"https:\/\/doi.org\/10.3390\/rs12213555","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,30]]}}}