{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T03:45:17Z","timestamp":1793159117449,"version":"4.5.0"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100019290","name":"Halmstad University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100019290","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Lyme borreliosis and tick-borne encephalitis significantly impact public health in Europe, transmitted primarily by endemic tick species. The recent introduction of exotic tick species into northern Europe via migratory birds, imported animals, and travelers highlights the urgent need for rapid detection and accurate species identification. To address this, the Swedish Veterinary Agency launched a citizen science initiative, resulting in the submission of over 15,000 tick images spanning seven species. We developed, trained, and evaluated deep learning models incorporating image analysis, object detection, and transfer learning to support automated tick classification. The EfficientNetV2M model achieved a macro recall of 0.60 and a Matthews Correlation Coefficient (MCC) of 0.55 on out-of-distribution, citizen-submitted data. These results demonstrate the feasibility of integrating AI with citizen science for large-scale tick monitoring while also highlighting challenges related to class imbalance, species similarity, and morphological variability. Rather than robust species-level classification, our framework serves as a proof of concept for infrastructure that supports scalable and adaptive tick surveillance. This work lays the groundwork for future AI-driven systems in One Health contexts, extendable to other arthropod vectors and emerging public health threats.<\/jats:p>","DOI":"10.1038\/s41598-025-10265-x","type":"journal-article","created":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T16:54:09Z","timestamp":1752166449000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Automated tick classification using deep learning and its associated challenges in citizen science"],"prefix":"10.1038","volume":"15","author":[{"given":"Anna","family":"Omazic","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Giulio","family":"Grandi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Widgren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joacim","family":"Rockl\u00f6v","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonas","family":"Wallin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan C.","family":"Semenza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Najmeh","family":"Abiri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,10]]},"reference":[{"key":"10265_CR1","doi-asserted-by":"publisher","first-page":"593232","DOI":"10.1155\/2009\/593232","volume":"2009","author":"J Gray","year":"2009","unstructured":"Gray, J., Dautel, H., Estrada-Pe\u00f1a, A., Kahl, O. & Lindgren, E. Effects of climate change on ticks and tick-borne diseases in Europe. Interdiscip. Perspect. Infect. Dis. 2009, 593232 (2009).","journal-title":"Interdiscip. Perspect. Infect. Dis."},{"key":"10265_CR2","doi-asserted-by":"crossref","unstructured":"Semenza, J.C. & Paz, S. Climate change and infectious disease in Europe: Impact, projection and adaptation. Lancet Region. Health\u2013Eur. 9 (2021).","DOI":"10.1016\/j.lanepe.2021.100230"},{"key":"10265_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1756-3305-6-1","volume":"6","author":"JM Medlock","year":"2013","unstructured":"Medlock, J. M. et al. Driving forces for changes in geographical distribution of Ixodes ricinus ticks in Europe. Parasites Vectors 6, 1\u201311 (2013).","journal-title":"Parasites Vectors"},{"key":"10265_CR4","doi-asserted-by":"crossref","unstructured":"Semenza, J.C. & Suk, J.E. Vector-borne diseases and climate change: A European perspective. FEMS Microbiol. Lett. 365, fnx244 (2018).","DOI":"10.1093\/femsle\/fnx244"},{"key":"10265_CR5","doi-asserted-by":"publisher","first-page":"770","DOI":"10.3390\/pathogens13090770","volume":"13","author":"M Eslava","year":"2024","unstructured":"Eslava, M., Carlos, S. & Reina, G. Crimean-Congo hemorrhagic fever virus: An emerging threat in Europe with a focus on epidemiology in Spain. Pathogens 13, 770 (2024).","journal-title":"Pathogens"},{"key":"10265_CR6","unstructured":"ECDC. European network for medical and veterinary entomology (vectornet) (2024). Accessed 16 Sep 2024."},{"key":"10265_CR7","unstructured":"Abiri, N. et al. Tick citizen science: A web application for the public to engage in tick and tick-borne pathogens surveillance in Sweden. Infect. Ecol. Epidemiol. (2025) (submitted for publication)."},{"key":"10265_CR8","doi-asserted-by":"publisher","first-page":"e0000051","DOI":"10.1371\/journal.pstr.0000051","volume":"2","author":"K Bjerge","year":"2023","unstructured":"Bjerge, K. et al. Accurate detection and identification of insects from camera trap images with deep learning. PLOS Sustain. Transform. 2, e0000051 (2023).","journal-title":"PLOS Sustain. Transform."},{"key":"10265_CR9","doi-asserted-by":"publisher","first-page":"5187","DOI":"10.3390\/app13085187","volume":"13","author":"B Ilijoski","year":"2023","unstructured":"Ilijoski, B. et al. Deep learning methods for bug bite classification: An end-to-end system. Appl. Sci. 13, 5187 (2023).","journal-title":"Appl. Sci."},{"key":"10265_CR10","doi-asserted-by":"publisher","unstructured":"Luo, C.-Y., Pearson, P., Xu, G. & Rich, S.\u00a0M. A computer vision-based approach for tick identification using deep learning models. Insects 13. https:\/\/doi.org\/10.3390\/insects13020116 (2022).","DOI":"10.3390\/insects13020116"},{"key":"10265_CR11","doi-asserted-by":"publisher","unstructured":"Xu, Z. et al. Tickphone app: A smartphone application for rapid tick identification using deep learning. Appl. Sci. 11. https:\/\/doi.org\/10.3390\/app11167355 (2021).","DOI":"10.3390\/app11167355"},{"key":"10265_CR12","doi-asserted-by":"publisher","first-page":"e0260622","DOI":"10.1371\/journal.pone.0260622","volume":"16","author":"L Justen","year":"2021","unstructured":"Justen, L., Carlsmith, D., Paskewitz, S. M., Bartholomay, L. C. & Bron, G. M. Identification of public submitted tick images: A neural network approach. Plos one 16, e0260622 (2021).","journal-title":"Plos one"},{"key":"10265_CR13","unstructured":"Ovadia, Y. et al. Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift. Adv. Neural Inf. Process. Syst. 32 (2019)."},{"key":"10265_CR14","unstructured":"Hendrycks, D. & Gimpel, K. A baseline for detecting misclassified and out-of-distribution examples in neural networks. arXiv preprint arXiv:1610.02136 (2016)."},{"key":"10265_CR15","unstructured":"European Scientific Counsel Companion Animal Parasites (ESCCAP) (2024). Accessed 03 Oct 2024."},{"key":"10265_CR16","unstructured":"Johnson, N. Ticks: Biology, Ecology, and Diseases (Elsevier, 2023)."},{"key":"10265_CR17","unstructured":"Sonenshine, D. & Roe, R. Biology of Ticks. Vol. 1. (OUP , 2014)."},{"key":"10265_CR18","unstructured":"Petsiuk, V. Rise: Randomized input sampling for explanation of black-box models. arXiv preprint arXiv:1806.07421 (2018)."},{"key":"10265_CR19","doi-asserted-by":"publisher","first-page":"357","DOI":"10.3390\/microorganisms11020357","volume":"11","author":"E Tompa","year":"2023","unstructured":"Tompa, E., Jaenson, T. G. & Wilhelmsson, P. First records of possibly human pathogenic rickettsia species in bat ticks, Carios vespertilionis, in Sweden. Microorganisms 11, 357 (2023).","journal-title":"Microorganisms"},{"key":"10265_CR20","doi-asserted-by":"publisher","unstructured":"Jaenson, T. G.\u00a0T. & Wilhelmsson, P. First record of a suspected human-pathogenic borrelia species in populations of the bat tick Carios vespertilionis in Sweden. Microorganisms 9. https:\/\/doi.org\/10.3390\/microorganisms9051100 (2021).","DOI":"10.3390\/microorganisms9051100"},{"key":"10265_CR21","doi-asserted-by":"publisher","first-page":"684737","DOI":"10.3389\/fvets.2021.684737","volume":"8","author":"AD S\u00e1ndor","year":"2021","unstructured":"S\u00e1ndor, A. D., Mihalca, A. D., Dom\u015fa, C., P\u00e9ter, \u00c1. & Hornok, S. Argasid ticks of palearctic bats: distribution, host selection, and zoonotic importance. Front. Vet. Sci. 8, 684737. https:\/\/doi.org\/10.3389\/fvets.2021.684737 (2021).","journal-title":"Front. Vet. Sci."},{"key":"10265_CR22","doi-asserted-by":"publisher","first-page":"106085","DOI":"10.1016\/j.actatropica.2021.106085","volume":"223","author":"A Kazim","year":"2021","unstructured":"Kazim, A., Houssaini, J., Ehlers, J., Tappe, D. & Heo, C. Soft ticks (Acari: Argasidae) in the island nations of southeast Asia: A review on their distribution, associated hosts and potential pathogens. Acta Trop. 223, 106085 (2021).","journal-title":"Acta Trop."},{"key":"10265_CR23","doi-asserted-by":"publisher","unstructured":"Dan\u011bk, O., Hrazdilov\u00e1, K., Kozderkov\u00e1, D., Jirk, D. & Modr\u1ef3, D. The distribution of Dermacentor reticulatus in the Czech Republic re-assessed: Citizen science approach to understanding the current distribution of the Babesia canis vector. Parasites Vectors 15, 132. https:\/\/doi.org\/10.1186\/s13071-022-05242-6 (2022).","DOI":"10.1186\/s13071-022-05242-6"},{"key":"10265_CR24","doi-asserted-by":"publisher","unstructured":"F\u00f6ldv\u00e1ri, G., \u0160irok\u1ef3, P., Szekeres, S., Majoros, G. & Sprong, H. Dermacentor reticulatus: A vector on the rise. Parasites vectors 9, 1\u201329. https:\/\/doi.org\/10.1186\/s13071-016-1599-x (2016).","DOI":"10.1186\/s13071-016-1599-x"},{"key":"10265_CR25","unstructured":"New tick species discovered in Sweden (2024). Accessed 03 Oct 2024."},{"key":"10265_CR26","doi-asserted-by":"publisher","unstructured":"Pf\u00e4ffle, M., Santos-Silva, M., Jaenson, T., Vatansever, Z. & Petney, T. Haemaphysalis punctata canestrini and fanzago, 1878 (figs. 88\u201390). In Ticks of Europe and North Africa: A Guide to Species Identification. 237\u2013242. https:\/\/doi.org\/10.1007\/978-3-319-63760-046 (2017).","DOI":"10.1007\/978-3-319-63760-046"},{"key":"10265_CR27","doi-asserted-by":"publisher","unstructured":"Mehlhorn, H. Encyclopedia of Parasitology. https:\/\/doi.org\/10.1007\/978-3-662-43978-41366 (Springer, 2016).","DOI":"10.1007\/978-3-662-43978-41366"},{"key":"10265_CR28","unstructured":"European Centre for Disease Prevention and Control - Hyalomma marginatum - Factsheet for Experts (2024). Accessed 03 Oct 2024."},{"key":"10265_CR29","doi-asserted-by":"publisher","first-page":"e0010855","DOI":"10.1371\/journal.pntd.0010855","volume":"17","author":"SS Celina","year":"2023","unstructured":"Celina, S. S., \u010cern\u1ef3, J. & Samy, A. M. Mapping the potential distribution of the principal vector of Crimean-Congo haemorrhagic fever virus hyalomma marginatum in the old world. PLoS Neglect. Trop. Dis. 17, e0010855. https:\/\/doi.org\/10.1371\/journal.pntd.0010855 (2023).","journal-title":"PLoS Neglect. Trop. Dis."},{"key":"10265_CR30","volume-title":"British Ticks","author":"DR Arthur","year":"1963","unstructured":"Arthur, D. R. British Ticks (Butterworths, 1963)."},{"key":"10265_CR31","first-page":"680","volume":"23","author":"MD Walker","year":"2018","unstructured":"Walker, M. D. The hedgehog tick, Ixodes hexagonus (Leach, 1815) (Acari: Ixodidae); The natural history and ecology of a nest ectoparasite. Syst. Appl. Acarol. 23, 680\u2013714 (2018).","journal-title":"Syst. Appl. Acarol."},{"key":"10265_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.11646\/zootaxa.5251.1.1","volume":"5251","author":"AA Guglielmone","year":"2023","unstructured":"Guglielmone, A. A., Nava, S. & Robbins, R. G. Geographic distribution of the hard ticks (Acari: Ixodida: Ixodidae) of the world by countries and territories. Zootaxa 5251, 1\u2013274 (2023).","journal-title":"Zootaxa"},{"key":"10265_CR33","unstructured":"Herrin, B. Tick-Borne Rickettsial Infections of Dogs. Vol. 9. 20\u201325 (Eastern States Veterinary Association, Inc (NAVC) , 2019)."},{"key":"10265_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13071-018-3192-y","volume":"11","author":"RL Galay","year":"2018","unstructured":"Galay, R. L. et al. Molecular detection of tick-borne pathogens in canine population and Rhipicephalus sanguineus (sensu lato) ticks from southern metro manila and Laguna, Philippines. Parasites Vectors 11, 1\u20138 (2018).","journal-title":"Parasites Vectors"},{"key":"10265_CR35","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1186\/s13071-024-06572-3","volume":"17","author":"F Dantas-Torres","year":"2024","unstructured":"Dantas-Torres, F., de Sousa-Paula, L. C. & Otranto, D. The Rhipicephalus sanguineus group: updated list of species, geographical distribution, and vector competence. Parasites Vectors 17, 540 (2024).","journal-title":"Parasites Vectors"},{"key":"10265_CR36","unstructured":"National Center for Emerging and Zoonotic Infectious Diseases (NCEZID) (2024). Accessed 16 Sep 2024."},{"key":"10265_CR37","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org. GBIF Occurrence Download. https:\/\/doi.org\/10.15468\/dl.nexuvw. Accessed 29 July 2024 (2024)","DOI":"10.15468\/dl.nexuvw"},{"key":"10265_CR38","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org. GBIF Occurrence Download. https:\/\/doi.org\/10.15468\/dl.wp6ecw. Accessed 29 July 2024 (2024)","DOI":"10.15468\/dl.wp6ecw"},{"key":"10265_CR39","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org GBIF occurrence download. https:\/\/doi.org\/10.15468\/dl.hhzg95. Accessed 29 July 2024 (2024)","DOI":"10.15468\/dl.hhzg95"},{"key":"10265_CR40","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org GBIF occurrence download https:\/\/doi.org\/10.15468\/dl.qgu26k. Accessed 29 July 2024 (2024)","DOI":"10.15468\/dl.qgu26k"},{"key":"10265_CR41","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org GBIF occurrence download. https:\/\/doi.org\/10.15468\/dl.hggrm4.","DOI":"10.15468\/dl.hggrm4"},{"key":"10265_CR42","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org GBIF occurrence download. https:\/\/doi.org\/10.15468\/dl.j93hck.","DOI":"10.15468\/dl.j93hck"},{"key":"10265_CR43","doi-asserted-by":"publisher","unstructured":"GBIF.Org User. Gbif.org GBIF occurrence download. https:\/\/doi.org\/10.15468\/dl.q97fqp.","DOI":"10.15468\/dl.q97fqp"},{"key":"10265_CR44","doi-asserted-by":"crossref","unstructured":"Grandi, G. et al. First records of adult Hyalomma marginatum and H. rufipes ticks (Acari: Ixodidae) in Sweden. Ticks Tick-Borne Dis. 11, 101403 (2020).","DOI":"10.1016\/j.ttbdis.2020.101403"},{"key":"10265_CR45","unstructured":"Abadi, M. et al. TensorFlow: Large-scale machine learning on heterogeneous systems (2015). Software available from tensorflow.org."},{"key":"10265_CR46","doi-asserted-by":"publisher","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","volume":"35","author":"H-C Shin","year":"2016","unstructured":"Shin, H.-C. et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35, 1285\u20131298 (2016).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"10265_CR47","doi-asserted-by":"crossref","unstructured":"Kornblith, S., Shlens, J. & Le, QV. Do better ImageNet models transfer better? In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 2661\u20132671 (2019).","DOI":"10.1109\/CVPR.2019.00277"},{"key":"10265_CR48","doi-asserted-by":"crossref","unstructured":"Csurka, G. Domain adaptation for visual applications: A comprehensive survey. In Domain Adaptation in Computer Vision Applications. 1\u201335 (Springer, 2017).","DOI":"10.1007\/978-3-319-58347-1_1"},{"key":"10265_CR49","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Identity mappings in deep residual networks. In Computer Vision\u2013ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11\u201314, 2016, Proceedings, Part IV 14. 630\u2013645 (Springer, 2016).","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"10265_CR50","doi-asserted-by":"publisher","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V. & Alemi, A. Inception-v4, inception-ResNet and the impact of residual connections on learning. In Proceedings of the AAAI Conference on Artificial Intelligence. Vol.\u00a031. https:\/\/doi.org\/10.1609\/aaai.v31i1.11231 (2017).","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"10265_CR51","unstructured":"Tan, M. & Le, Q. Efficientnetv2: Smaller models and faster training. In International Conference on Machine Learning. 10096\u201310106 (PMLR, 2021)."},{"key":"10265_CR52","unstructured":"Chollet, F. Deep learning with Python (Simon and Schuster, 2021)."},{"key":"10265_CR53","unstructured":"Loshchilov, I. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017)."},{"key":"10265_CR54","doi-asserted-by":"crossref","unstructured":"Lin, T. Focal loss for dense object detection. arXiv preprint arXiv:1708.02002 (2017).","DOI":"10.1109\/ICCV.2017.324"},{"key":"10265_CR55","doi-asserted-by":"publisher","first-page":"e0177678","DOI":"10.1371\/journal.pone.0177678","volume":"12","author":"S Boughorbel","year":"2017","unstructured":"Boughorbel, S., Jarray, F. & El-Anbari, M. Optimal classifier for imbalanced data using Matthews correlation coefficient metric. PloS one 12, e0177678 (2017).","journal-title":"PloS one"},{"key":"10265_CR56","doi-asserted-by":"crossref","unstructured":"Touvron, H. et al. Training data-efficient image transformers & distillation through attention. In International Conference on Machine Learning. 10347\u201310357 (PMLR, 2021).","DOI":"10.1109\/ICCV48922.2021.00010"},{"key":"10265_CR57","doi-asserted-by":"crossref","unstructured":"Liu, Z. et al. A convnet for the 2020s. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11976\u201311986 (2022).","DOI":"10.1109\/CVPR52688.2022.01167"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-10265-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-10265-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-10265-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,7]],"date-time":"2025-09-07T04:45:59Z","timestamp":1757220359000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-10265-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,10]]},"references-count":57,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["10265"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-10265-x","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,10]]},"assertion":[{"value":"6 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"An ethics statement is not applicable as this study was not classified as a human or animal experiment. Reports of ticks and tick samples were sent in voluntarily by people living in Sweden. The web application only collects information on the location and host of each participant. No personal data or IP addresses are saved. SVA processed the data in accordance with the Data Protection Regulation (EU) 2016\/679. The senders were informed that SVA reserves the right to use the submitted ticks and the accompanying metadata (i.e., images and information on the location of the finding and host) for research purposes as part of SVA\u2019s activities. The research is published without reference to individual submitted responses unless required by Swedish law.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"24942"}}