{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T07:07:21Z","timestamp":1780384041465,"version":"3.54.1"},"reference-count":39,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T00:00:00Z","timestamp":1736467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"France 2030 investment program","award":["ANR-20-SFRI-0013"],"award-info":[{"award-number":["ANR-20-SFRI-0013"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Citizen science (CS) projects, which engage the general public in scientific research, often face challenges in ensuring high-quality data collection and maintaining user engagement. Recent advancements in Large Language Models (LLMs) present a promising solution by providing automated, real-time assistance to users, reducing the need for extensive human intervention, and offering instant support. The CS project Les Herbonautes, dedicated to mass digitization of the French National Herbarium, serves as a case study for this paper, which details the development and evaluation of a network of open source LLM agents to assist users during data collection. The research involved the review of related work, stakeholder meetings with the Mus\u00e9um National d\u2019Histoire Naturelle, and user and context analyses to formalize system requirements. With these, a prototype with a user interface in the form of a chatbot was designed and implemented using LangGraph, and afterward evaluated through expert evaluation to assess its effect on usability and user experience (UX). The findings indicate that such a chatbot can enhance UX and improve data quality by guiding users and providing immediate feedback. However, limitations due to the non-deterministic nature of LLMs exist, suggesting that workflows must be carefully designed to mitigate potential errors and ensure reliable performance.<\/jats:p>","DOI":"10.3390\/computers14010021","type":"journal-article","created":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T03:48:11Z","timestamp":1736480891000},"page":"21","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Impact of Chatbots on User Experience and Data Quality on Citizen Science Platforms"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-0278-8313","authenticated-orcid":false,"given":"Akasha-Leonie","family":"Kessel","sequence":"first","affiliation":[{"name":"Institut f\u00fcr Informationssysteme, Universit\u00e4t zu L\u00fcbeck, Ratzeburger Allee 160, 23562 L\u00fcbeck, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soror","family":"Sahri","sequence":"additional","affiliation":[{"name":"Laboratoire d\u2019Informatique Paris Descartes, Universit\u00e9 Paris Cit\u00e9, 45 Rue des Saints-P\u00e8res, 75006 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5196-1117","authenticated-orcid":false,"given":"Sven","family":"Groppe","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Informationssysteme, Universit\u00e4t zu L\u00fcbeck, Ratzeburger Allee 160, 23562 L\u00fcbeck, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinghua","family":"Groppe","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Informationssysteme, Universit\u00e4t zu L\u00fcbeck, Ratzeburger Allee 160, 23562 L\u00fcbeck, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanieh","family":"Khorashadizadeh","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Informationssysteme, Universit\u00e4t zu L\u00fcbeck, Ratzeburger Allee 160, 23562 L\u00fcbeck, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Pignal","sequence":"additional","affiliation":[{"name":"Institut de Syst\u00e9matique, Evolution, Biodiversit\u00e9 (ISYEB), Mus\u00e9um National d\u2019Histoire Naturelle, 57 Rue Cuvier, 75005 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eva","family":"Perez Pimpar\u00e9","sequence":"additional","affiliation":[{"name":"Infrastructure R\u00e9colnat, Direction G\u00e9n\u00e9rale D\u00e9l\u00e9gu\u00e9e Aux Collections, Mus\u00e9um National d\u2019Histoire Naturelle, 57 Rue Cuvier, 75005 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6912-6248","authenticated-orcid":false,"given":"R\u00e9gine","family":"Vignes-Lebbe","sequence":"additional","affiliation":[{"name":"Institut de Syst\u00e9matique, Evolution, Biodiversit\u00e9 (ISYEB), Mus\u00e9um National d\u2019Histoire Naturelle, 57 Rue Cuvier, 75005 Paris, France"},{"name":"Laboratoire Informatique et Syst\u00e9matique, Sorbonne Universit\u00e9, 1 Rue Victor Cousin, 75005 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,10]]},"reference":[{"key":"ref_1","unstructured":"Bonn, A., Richter, A., and Vohland, K. (2020). Gr\u00fcnbuch Citizen Science Strategie 2020 f\u00fcr Deutschland, GEWISS."},{"key":"ref_2","unstructured":"Rouhan, G., Chagnoux, S., Denneti\u00e8re, B., Sch\u00e4fer, V., and Pignal, M. (2014, January 22\u201325). The herbonauts website: Recruiting the general public to acquire the data from herbarium labels. Proceedings of the Botanists of the Twenty First Century: Roles, Challenges and Opportunities, UNESCO International Conference, Paris, France."},{"key":"ref_3","unstructured":"James, T. (2006). Improving Wildlife Data Quality: Guidance on Data Verification, Validation and Their Application in Biological Recording, National Biodiversity Network."},{"key":"ref_4","unstructured":"Commission, E., Centre, J.R., Mitton, I., Tricarico, E., Schade, S., Lopez Canizares, C., Tsiamis, K., Gervasini, E., Adriaens, T., and Cardoso, A. (2021). Data-Validation Solutions for Citizen Science Data on Invasive Alien Species, Publications Office of the European Union."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s12525-024-00705-3","article-title":"Designing a conversational agent for supporting data exploration in citizen science","volume":"34","author":"Stein","year":"2024","journal-title":"Electron. Mark."},{"key":"ref_6","unstructured":"Junior, S.B., Ceravolo, P., Groppe, S., Jarrar, M., Maghool, S., S\u00e8des, F., Sahri, S., and Keulen, M.V. Are Large Language Models the New Interface for Data Pipelines? In Proceedings of the International Workshop on Big Data in Emergent Distributed Environments, Santiago, Chile, 9\u201315 June 2024."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e16256","DOI":"10.1002\/ajb2.16256","article-title":"Herbarium specimen label transcription reimagined with large language models: Capabilities, productivity, and risks","volume":"110","author":"Weaver","year":"2023","journal-title":"Am. J. Bot."},{"key":"ref_8","unstructured":"Ahmed, S. (2019). An Architecture for Dynamic Conversational Agents for Citizen Participation and Ideation. [Ph.D. Thesis, Technische Universit\u00e4t M\u00fcnchen]."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bittner, E., Oeste-Rei\u00df, S., and Leimeister, J.M. (2019, January 8\u201311). Where is the Bot in our Team? Toward a Taxonomy of Design Option Combinations for Conversational Agents in Collaborative Work. Proceedings of the 52nd Hawaii International Conferenceon System Sciences, Maui, HI, USA.","DOI":"10.24251\/HICSS.2019.035"},{"key":"ref_10","unstructured":"Dam, S.K., Hong, C.S., Qiao, Y., and Zhang, C. (2024). A Complete Survey on LLM-based AI Chatbots. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kim, S., Lee, J., and Gweon, G. (2019, January 4\u20139). Comparing Data from Chatbot and Web Surveys: Effects of Platform and Conversational Style on Survey Response Quality. Proceedings of the CHI \u201919: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow Scotland, UK.","DOI":"10.1145\/3290605.3300316"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., and Shadbolt, N. (2018, January 21\u201326). \u2018It\u2019s Reducing a Human Being to a Percentage\u2019: Perceptions of Justice in Algorithmic Decisions. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI \u201918, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3173951"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bender, E.M., Gebru, T., McMillan-Major, A., and Shmitchell, S. (2021, January 3\u201310). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT \u201921, Virtual.","DOI":"10.1145\/3442188.3445922"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kvale, K., Freddi, E., Hodnebrog, S., Sell, O., and F\u00f8lstad, A. (2021). Understanding the User Experience of Customer Service Chatbots: What Can We Learn from Customer Satisfaction Surveys?. Chatbot Research and Design, Springer.","DOI":"10.1007\/978-3-030-68288-0_14"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Vadapalli, J., Gupta, S., Karki, B., and Tsai, C.H. (2024, January 11\u201314). Incorporating Citizen-Generated Data into Large Language Models. Proceedings of the 25th Annual International Conference on Digital Government Research, dg.o 2024, Taipei, Taiwan.","DOI":"10.1145\/3657054.3659119"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lee, G., Hartmann, V., Park, J., Papailiopoulos, D., and Lee, K. (2023, January 9\u201314). Prompted LLMs as Chatbot Modules for Long Open-domain Conversation. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, Toronto, ON, Canada.","DOI":"10.18653\/v1\/2023.findings-acl.277"},{"key":"ref_17","first-page":"1877","article-title":"Language Models are Few-Shot Learners","volume":"Volume 33","author":"Larochelle","year":"2020","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_18","unstructured":"Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E.H., Le, Q.V., and Zhou, D. (December, January 28). Chain-of-thought prompting elicits reasoning in large language models. Proceedings of the 36th International Conference on Neural Information Processing Systems, NIPS \u201922, New Orleans, LA, USA."},{"key":"ref_19","unstructured":"Radziwill, N.M., and Benton, M.C. (2017). Evaluating Quality of Chatbots and Intelligent Conversational Agents. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"F\u00f8lstad, A., Araujo, T., Papadopoulos, S., Law, E.L.C., Luger, E., Goodwin, M., and Brandtzaeg, P.B. (2021). Customer Service Chatbots: A Qualitative Interview Study into the Communication Journey of Customers. Chatbot Research and Design, Springer.","DOI":"10.1007\/978-3-030-94890-0"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Klopfenstein, L., Delpriori, S., Malatini, S., and Bogliolo, A. (2017, January 10\u201314). The Rise of Bots: A Survey of Conversational Interfaces, Patterns, and Paradigms. Proceedings of the DIS \u201917: Designing Interactive Systems Conference 2017, Edinburgh, UK.","DOI":"10.1145\/3064663.3064672"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1057\/s41599-024-02720-3","article-title":"AI chatbots contribute to global conservation injustices","volume":"11","author":"Urzedo","year":"2024","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez Cuadrado, J., P\u00e9rez-Soler, S., Guerra, E., and De Lara, J. (2024, January 8\u201310). Automating the Development of Task-oriented LLM-based Chatbots. Proceedings of the ACM Conversational User Interfaces 2024, CUI \u201924, Luxembourg.","DOI":"10.1145\/3640794.3665538"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Elliott, M., and Fortes, J. (2023). Using ChatGPT with Confidence for Biodiversity-Related Information Tasks. Biodivers. Inf. Sci. Stand., 7.","DOI":"10.3897\/biss.7.112926"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Elliott, M.J., and Fortes, J.A.B. (2024, January 16\u201320). Toward Reliable Biodiversity Information Extraction From Large Language Models. Proceedings of the 2024 IEEE 20th International Conference on e-Science (e-Science), Osaka, Japan.","DOI":"10.1109\/e-Science62913.2024.10678666"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mora-Cross, M., and Calderon-Ramirez, S. (2024, January 16\u201321). Uncertainty Estimation in Large Language Models to Support Biodiversity Conservation. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track), Mexico City, Mexico.","DOI":"10.18653\/v1\/2024.naacl-industry.31"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Elliott, M., Luciano, M., and Fortes, J. (2024). Integrating Large Language Models and the iDigBio Portal for Conversational Data Exploration and Retrieval. Biodivers. Inf. Sci. Stand., 8.","DOI":"10.3897\/biss.8.142696"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Du, Y., Wang, Y., and Zhao, E. (2024). Leveraging Multimodal LLMs for Plant Species Identification and Educational Insights. SocArXiv.","DOI":"10.31235\/osf.io\/zayh4"},{"key":"ref_29","unstructured":"Blake, S., Siddharthan, A., Nguyen, H., Sharma, N., Robinson, A.M., Elaine, O., Darvill, B., Mellish, C., and Van Der Wal, R. (2012, January 8\u201315). Natural language generation for nature conservation: Automating feedback to help volunteers identify bumblebee species. Proceedings of the COLING 2012, Mumbai, India."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cascaes Cardoso, M. (2017, January 6\u201311). The Onboarding Effect: Leveraging User Engagement and Retention in Crowdsourcing Platforms. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, CO, USA.","DOI":"10.1145\/3027063.3027128"},{"key":"ref_31","first-page":"428","article-title":"Personalising the User Experience of a Mobile Health Application towards Patient Engagement","volume":"Volume 141","author":"Madeira","year":"2018","journal-title":"Procedia Computer Science, Proceedings of the 9th International Conference on Emerging Ubiquitous Systems and Pervasive Networks (EUSPN-2018)\/The 8th International Conference on Current and Future Trends of Information and Communication Technologies in Healthcare (ICTH-2018)\/Affiliated Workshops, Leuven, Belgium, 5\u20138 November 2018"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"105597","DOI":"10.1016\/j.fishres.2020.105597","article-title":"Insights into the users of a citizen science platform for collecting recreational fisheries data","volume":"229","author":"Gundelund","year":"2020","journal-title":"Fish. Res."},{"key":"ref_33","unstructured":"Dechert, M. (2019). Implementation and Evaluation of a Chatbot to Crowdsource Geotagged Images to Detect Mosquito Breeding Sites. [Master\u2019s Thesis, Universit\u00e4t Bremen]."},{"key":"ref_34","unstructured":"Tavanapour, N., Poser, M., and Bittner, E. (2019, January 8\u201314). Supporting the Idea Generation Process in Citizen Participation\u2014Toward an interactive system with a Conversational Agent as Facilitator. Proceedings of the Twenty-Seventh European Conference on Information Systems (ECIS2019), Stockholm and Uppsala, Sweden."},{"key":"ref_35","unstructured":"Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., K\u00fcttler, H., Lewis, M., Yih, W.t., and Rockt\u00e4schel, T. (2020, January 6\u201312). Retrieval-augmented generation for knowledge-intensive NLP tasks. Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS \u201920, Vancouver, BC, Canada."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yu, K., Berkovsky, S., Taib, R., Conway, D., Zhou, J., and Chen, F. (2017, January 13\u201316). User Trust Dynamics: An Investigation Driven by Differences in System Performance. Proceedings of the 22nd International Conference on Intelligent User Interfaces, IUI \u201917, Limassol, Cyprus.","DOI":"10.1145\/3025171.3025219"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"100021","DOI":"10.1016\/j.digbus.2022.100021","article-title":"The impact of trust in the internet of things for health on user engagement","volume":"2","author":"Samhale","year":"2022","journal-title":"Digit. Bus."},{"key":"ref_38","unstructured":"Khorashadizadeh, H., Amara, F.Z., Ezzabady, M., Ieng, F., Tiwari, S., Mihindukulasooriya, N., Groppe, J., Sahri, S., Benamara, F., and Groppe, S. (2024, January 26). Research Trends for the Interplay between Large Language Models and Knowledge Graphs. Proceedings of the VLDB 2024 Workshop: The International Workshop on Data Management Opportunities in Unifying Large Language Models + Knowledge Graphs (LLM+KG), Guangzhou, China."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ezzabady, M., Ieng, F., Khorashadizadeh, H., Benamara, F., Groppe, S., and Sahri, S. (2024, January 25\u201327). Towards Generating High-Quality Knowledge Graphs by Leveraging Large Language Models. Proceedings of the 29th Annual International Conference on Natural Language & Information Systems (NLDB 2024), Turin, Italy.","DOI":"10.1007\/978-3-031-70239-6_31"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/1\/21\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:26:12Z","timestamp":1759919172000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/1\/21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,10]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["computers14010021"],"URL":"https:\/\/doi.org\/10.3390\/computers14010021","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,10]]}}}