{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T04:16:03Z","timestamp":1747196163395,"version":"3.40.5"},"reference-count":55,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T00:00:00Z","timestamp":1658880000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Automated monitoring of vegetation health in a landscape is often attributed to calculating values of various vegetation indexes over a period of time. However, such approaches suffer from an inaccurate estimation of vegetational change due to the over-reliance of index values on vegetation\u2019s colour attributes and the availability of multi-spectral bands. One common observation is the sensitivity of colour attributes to seasonal variations and imaging devices, thus leading to false and inaccurate change detection and monitoring. In addition, these are very strong assumptions in a citizen science project. In this article, we build upon our previous work on developing a Semantic Vegetation Index (SVI) and expand it to introduce a semantic vegetation health monitoring platform to monitor vegetation health in a large landscape. However, unlike our previous work, we use RGB images of the Australian landscape for a quarterly series of images over six years (2015\u20132020). This Semantic Vegetation Index (SVI) is based on deep semantic segmentation to integrate it with a citizen science project (Fluker Post) for automated environmental monitoring. It has collected thousands of vegetation images shared by various visitors from around 168 different points located in Australian regions over six years. This paper first uses a deep learning-based semantic segmentation model to classify vegetation in repeated photographs. A semantic vegetation index is then calculated and plotted in a time series to reflect seasonal variations and environmental impacts. The results show variational trends of vegetation cover for each year, and the semantic segmentation model performed well in calculating vegetation cover based on semantic pixels (overall accuracy = 97.7%). This work has solved a number of problems related to changes in viewpoint, scale, zoom, and seasonal changes in order to normalise RGB image data collected from different image devices.<\/jats:p>","DOI":"10.1371\/journal.pone.0270625","type":"journal-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T17:47:18Z","timestamp":1658944038000},"page":"e0270625","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["A deep semantic vegetation health monitoring platform for citizen science imaging data"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0543-3350","authenticated-orcid":true,"given":"Asim","family":"Khan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Warda","family":"Asim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anwaar","family":"Ulhaq","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Randall W.","family":"Robinson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"issue":"3","key":"pone.0270625.ref001","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1177\/0309133319831673","article-title":"The chronostratigraphic method is unsuitable for determining the start of the Anthropocene","volume":"43","author":"M Edgeworth","year":"2019","journal-title":"Progress in Physical Geography: Earth and Environment"},{"key":"pone.0270625.ref002","article-title":"Extensive twenty-first century woody encroachment in South America\u2019s Savanna","author":"TM Rosan","year":"2019","journal-title":"Geophysical Research Letters"},{"key":"pone.0270625.ref003","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.isprsjprs.2019.11.018","article-title":"Remote sensing algorithms for estimation of fractional vegetation cover using pure vegetation index values: A review","volume":"159","author":"L Gao","year":"2020","journal-title":"ISPRS Journal of Photogrammetry and Remote Sensing"},{"key":"pone.0270625.ref004","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.ecoinf.2016.11.008","article-title":"Long-term patterns of change in a vanishing cultural landscape: A GIS-based assessment","volume":"37","author":"V Amici","year":"2017","journal-title":"Ecological Informatics"},{"key":"pone.0270625.ref005","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.envsci.2015.05.012","article-title":"Managing abandoned farmland to control the impact of re-vegetation on the environment. The state of the art in Europe","volume":"52","author":"T Lasanta","year":"2015","journal-title":"Environmental Science & Policy"},{"issue":"3","key":"pone.0270625.ref006","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.landurbplan.2012.01.003","article-title":"Urban Neighborhood Green Index\u2013A measure of green spaces in urban areas","volume":"105","author":"K Gupta","year":"2012","journal-title":"Landscape and urban planning"},{"key":"pone.0270625.ref007","article-title":"Interconnections of urban green spaces and environmental quality of Tehran","author":"S Faryadi","year":"2009","journal-title":"INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH (IJER)"},{"issue":"2","key":"pone.0270625.ref008","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.landurbplan.2008.12.004","article-title":"Can you see green? Assessing the visibility of urban forests in cities","volume":"91","author":"J Yang","year":"2009","journal-title":"Landscape and Urban Planning"},{"issue":"4","key":"pone.0270625.ref009","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1071\/BT01053","article-title":"Assessing vegetation change over a century using repeat photography","volume":"50","author":"J Pickard","year":"2002","journal-title":"Australian Journal of Botany"},{"key":"pone.0270625.ref010","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/978-981-15-1735-8_11","volume-title":"Statistics for Data Science and Policy Analysis","author":"A Khan","year":"2020"},{"issue":"5","key":"pone.0270625.ref011","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1111\/j.1365-2699.2010.02453.x","article-title":"A century of tree line changes in sub-Arctic Sweden shows local and regional variability and only a minor influence of 20th century climate warming","volume":"38","author":"R Van Bogaert","year":"2011","journal-title":"Journal of Biogeography"},{"key":"pone.0270625.ref012","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.agrformet.2014.08.007","article-title":"Using digital camera images to analyse snowmelt and phenology of a subalpine grassland","volume":"198","author":"T Julitta","year":"2014","journal-title":"Agricultural and Forest Meteorology"},{"issue":"8","key":"pone.0270625.ref013","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.3390\/rs10081293","article-title":"Using near-infrared-enabled digital repeat photography to track structural and physiological phenology in Mediterranean tree\u2013grass ecosystems","volume":"10","author":"Y Luo","year":"2018","journal-title":"Remote Sensing"},{"issue":"17","key":"pone.0270625.ref014","doi-asserted-by":"crossref","first-page":"5085","DOI":"10.5194\/bg-13-5085-2016","article-title":"Reviews and syntheses: Australian vegetation phenology: new insights from satellite remote sensing and digital repeat photography","volume":"13","author":"CE Moore","year":"2016","journal-title":"Biogeosciences"},{"issue":"11","key":"pone.0270625.ref015","doi-asserted-by":"crossref","first-page":"1948","DOI":"10.3390\/s16111948","article-title":"Extracting plant phenology metrics in a great basin watershed: Methods and considerations for quantifying phenophases in a cold desert","volume":"16","author":"KA Snyder","year":"2016","journal-title":"Sensors"},{"issue":"5","key":"pone.0270625.ref016","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1111\/jvs.12303","article-title":"A repeat photograph analysis of long-term vegetation change in semi-arid South Africa in response to land use and climate","volume":"26","author":"ML Masubelele","year":"2015","journal-title":"Journal of Vegetation Science"},{"issue":"6","key":"pone.0270625.ref017","doi-asserted-by":"crossref","first-page":"588","DOI":"10.2111\/04-111R2.1","article-title":"Quantifying vegetation change by point sampling landscape photography time series","volume":"58","author":"PE Clark","year":"2005","journal-title":"Rangeland ecology & management"},{"issue":"2","key":"pone.0270625.ref018","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1657\/1523-0430(2007)39[297:DOASAM]2.0.CO;2","article-title":"Development of a spatial analysis method using ground-based repeat photography to detect changes in the alpine treeline ecotone, Glacier National Park, Montana, USA","volume":"39","author":"W Roush","year":"2007","journal-title":"Arctic, Antarctic, and Alpine Research"},{"issue":"3","key":"pone.0270625.ref019","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1002\/rse2.100","article-title":"Estimates of landscape composition from terrestrial oblique photographs suggest homogenization of Rocky Mountain landscapes over the last century","volume":"5","author":"JA Fortin","year":"2019","journal-title":"Remote Sensing in Ecology and Conservation"},{"key":"pone.0270625.ref020","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2015.01.006","article-title":"A critical synthesis of remotely sensed optical image change detection techniques","volume":"160","author":"AP Tewkesbury","year":"2015","journal-title":"Remote Sensing of Environment"},{"key":"pone.0270625.ref021","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jaridenv.2019.01.007","article-title":"Vegetation and climate change in the Pro-Namib and Namib Desert based on repeat photography: Insights into climate trends","volume":"165","author":"RF Rohde","year":"2019","journal-title":"Journal of Arid Environments"},{"key":"pone.0270625.ref022","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.agrformet.2017.09.004","article-title":"Estimation of plant area index and phenological transition dates from digital repeat photography and radiometric approaches in a hardwood forest in the Northeastern United States","volume":"249","author":"M Toda","year":"2018","journal-title":"Agricultural and Forest Meteorology"},{"issue":"1-3","key":"pone.0270625.ref023","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.foreco.2006.02.049","article-title":"A century of vegetation change in the San Juan Mountains, Colorado: an analysis using repeat photography","volume":"228","author":"JL Zier","year":"2006","journal-title":"Forest Ecology and Management"},{"issue":"1","key":"pone.0270625.ref024","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1659\/mrd.1028","article-title":"Using repeat landscape photography to assess vegetation changes in rural communities of the Southern Appalachian Mountains in Virginia, USA","volume":"29","author":"LE Hendrick","year":"2009","journal-title":"Mountain Research and Development"},{"issue":"4","key":"pone.0270625.ref025","doi-asserted-by":"crossref","first-page":"329","DOI":"10.3390\/rs8040329","article-title":"Classification and segmentation of satellite orthoimagery using convolutional neural networks","volume":"8","author":"M L\u00e4ngkvist","year":"2016","journal-title":"Remote Sensing"},{"key":"pone.0270625.ref026","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.rse.2018.06.034","article-title":"An object-based convolutional neural network (OCNN) for urban land use classification","volume":"216","author":"C Zhang","year":"2018","journal-title":"Remote sensing of environment"},{"key":"pone.0270625.ref027","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.compag.2018.02.027","article-title":"Improved image processing-based crop detection using Kalman filtering and the Hungarian algorithm","volume":"148","author":"E Hamuda","year":"2018","journal-title":"Computers and electronics in agriculture"},{"key":"pone.0270625.ref028","doi-asserted-by":"crossref","unstructured":"Tompson J, Goroshin R, Jain A, LeCun Y, Bregler C. Efficient object localization using convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2015. p. 648\u2013656.","DOI":"10.1109\/CVPR.2015.7298664"},{"key":"pone.0270625.ref029","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.ecoinf.2018.10.002","article-title":"Deep convolution neural network for image recognition","volume":"48","author":"BB Traore","year":"2018","journal-title":"Ecological Informatics"},{"key":"pone.0270625.ref030","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.envsoft.2017.02.004","article-title":"Automatic land cover classification of geo-tagged field photos by deep learning","volume":"91","author":"G Xu","year":"2017","journal-title":"Environmental Modelling & Software"},{"key":"pone.0270625.ref031","article-title":"A deep learning-based approach for banana leaf diseases classification","author":"J Amara","year":"2017","journal-title":"Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW 2017)-Workshopband"},{"issue":"4","key":"pone.0270625.ref032","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1007\/s11629-016-3950-2","article-title":"Cultivated land information extraction in UAV imagery based on deep convolutional neural network and transfer learning","volume":"14","author":"H Lu","year":"2017","journal-title":"Journal of Mountain Science"},{"key":"pone.0270625.ref033","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.eswa.2017.11.028","article-title":"A new image classification method using CNN transfer learning and web data augmentation","volume":"95","author":"D Han","year":"2018","journal-title":"Expert Systems with Applications"},{"issue":"12","key":"pone.0270625.ref034","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0243243","article-title":"Real-time plant health assessment via implementing cloud-based scalable transfer learning on AWS DeepLens","volume":"15","author":"A Khan","year":"2020","journal-title":"PLOS ONE"},{"issue":"11","key":"pone.0270625.ref035","doi-asserted-by":"crossref","DOI":"10.3390\/rs13112194","article-title":"Health Assessment of Eucalyptus Trees Using Siamese Network from Google Street and Ground Truth Images","volume":"13","author":"A Khan","year":"2021","journal-title":"Remote Sensing"},{"issue":"1","key":"pone.0270625.ref036","doi-asserted-by":"crossref","first-page":"228","DOI":"10.3390\/rs14010228","article-title":"A Multiview Semantic Vegetation Index for Robust Estimation of Urban Vegetation Cover","volume":"14","author":"A Khan","year":"2022","journal-title":"Remote Sensing"},{"key":"pone.0270625.ref037","unstructured":"Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL. Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:14127062. 2014;."},{"key":"pone.0270625.ref038","doi-asserted-by":"crossref","unstructured":"Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2015. p. 3431\u20133440.","DOI":"10.1109\/CVPR.2015.7298965"},{"issue":"8","key":"pone.0270625.ref039","doi-asserted-by":"crossref","first-page":"e72296","DOI":"10.1371\/journal.pone.0072296","article-title":"Quantifying plant colour and colour difference as perceived by humans using digital images","volume":"8","author":"D Kendal","year":"2013","journal-title":"PLoS one"},{"key":"pone.0270625.ref040","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.imavis.2018.03.008","article-title":"Detection of roadside vegetation using Fully Convolutional Networks","volume":"74","author":"I Harba\u0161","year":"2018","journal-title":"Image and Vision Computing"},{"issue":"12","key":"pone.0270625.ref041","doi-asserted-by":"crossref","first-page":"12037","DOI":"10.3390\/rs61212037","article-title":"Feature learning based approach for weed classification using high resolution aerial images from a digital camera mounted on a UAV","volume":"6","author":"C Hung","year":"2014","journal-title":"Remote Sensing"},{"issue":"6","key":"pone.0270625.ref042","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1002\/rob.21727","article-title":"Robot for weed species plant-specific management","volume":"34","author":"O Bawden","year":"2017","journal-title":"Journal of Field Robotics"},{"key":"pone.0270625.ref043","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/978-3-030-34879-3_21","volume-title":"Pacific-Rim Symposium on Image and Video Technology","author":"A Khan","year":"2019"},{"key":"pone.0270625.ref044","doi-asserted-by":"crossref","first-page":"114","DOI":"10.4135\/9781446268278.n6","article-title":"Repeat photography in landscape research","author":"M Klett","year":"2011","journal-title":"The Sage handbook of visual research methods"},{"key":"pone.0270625.ref045","first-page":"258","article-title":"Documenting landscape change through fixed angle photography","author":"O Puschmann","year":"2002","journal-title":"Agricultural impacts on landscapes"},{"key":"pone.0270625.ref046","unstructured":"Fluker M. Fluker Post; 2022. https:\/\/www.flukerpost.com\/."},{"key":"pone.0270625.ref047","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. Springer; 2015. p. 234\u2013241.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"pone.0270625.ref048","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.isprsjprs.2019.03.002","article-title":"Robust registration for remote sensing images by combining and localizing feature-and area-based methods","volume":"151","author":"R Feng","year":"2019","journal-title":"ISPRS Journal of Photogrammetry and Remote Sensing"},{"issue":"1","key":"pone.0270625.ref049","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"C Shorten","year":"2019","journal-title":"Journal of big data"},{"key":"pone.0270625.ref050","unstructured":"Zeiss. APEER Annotate; 2022. https:\/\/www.apeer.com\/annotate."},{"key":"pone.0270625.ref051","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.patcog.2016.05.013","article-title":"Spatial contextual superpixel model for natural roadside vegetation classification","volume":"60","author":"L Zhang","year":"2016","journal-title":"Pattern Recognition"},{"key":"pone.0270625.ref052","doi-asserted-by":"crossref","unstructured":"Byeon W, Breuel TM, Raue F, Liwicki M. Scene labeling with LSTM recurrent neural networks. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2015. p. 3547\u20133555.","DOI":"10.1109\/CVPR.2015.7298977"},{"key":"pone.0270625.ref053","doi-asserted-by":"crossref","unstructured":"Shuai B, Zuo Z, Wang B, Wang G. Dag-recurrent neural networks for scene labeling. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 3620\u20133629.","DOI":"10.1109\/CVPR.2016.394"},{"issue":"12","key":"pone.0270625.ref054","doi-asserted-by":"crossref","first-page":"2930","DOI":"10.3390\/s17122930","article-title":"Estimation of the botanical composition of clover-grass leys from RGB images using data simulation and fully convolutional neural networks","volume":"17","author":"S Skovsen","year":"2017","journal-title":"Sensors"},{"key":"pone.0270625.ref055","unstructured":"of Meteorology Australia TB. Previous droughts; 2020. http:\/\/www.bom.gov.au\/climate\/drought\/knowledge-centre\/previous-droughts.shtml."}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0270625","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,12]],"date-time":"2023-02-12T19:34:53Z","timestamp":1676230493000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0270625"}},"subtitle":[],"editor":[{"given":"Bhabesh","family":"Deka","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,7,27]]},"references-count":55,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7,27]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0270625","relation":{},"ISSN":["1932-6203"],"issn-type":[{"type":"electronic","value":"1932-6203"}],"subject":[],"published":{"date-parts":[[2022,7,27]]}}}