{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T16:20:32Z","timestamp":1776270032725,"version":"3.50.1"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T00:00:00Z","timestamp":1762992000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T00:00:00Z","timestamp":1762992000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010608","name":"Universit\u00e0 degli Studi di Urbino Carlo Bo","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100010608","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Chronic disease management requires continuous monitoring, lifestyle modification and therapy adherence, thus requiring constant support from healthcare professionals. Chatbots have proven to be a promising approach for engaging patients in managing their health condition at home and for offering continuous assistance by being readily available to answer questions. While large language models offer an impressive solution for chatbot implementation, third-party systems raise privacy concerns, and computational requirements limit small-scale deployment. We address these challenges by developing a chatbot for hypertensive patients based on open-source small language models (SLMs), specifically designed for running on personal resource-constrained devices and for providing assistance in QA tasks. In order to guarantee comparable conversational performances with respect to larger language models, we exploited retrieval-augmented generation (RAG) with a local knowledge base. This ensures data privacy by deploying models locally while achieving competitive accuracy and maintaining low computational costs suitable for end-user devices. We experimented with eight SLMs, two prompt configurations, and different RAG strategies \u2013 both in the embedding and retrieval components \u2013 to identify the most effective solution. The evaluation of our solution grounds on both reference metrics and expert evaluation. Our findings suggest that RAG-enhanced SLMs can improve response clarity and content accuracy. However, our results also indicate that newer SLMs like Qwen3 demonstrate strong performance even without RAG, suggesting a potential shift in the necessity for complex retrieval mechanisms with rapidly evolving model architectures.<\/jats:p>","DOI":"10.1007\/s10916-025-02297-7","type":"journal-article","created":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T06:39:29Z","timestamp":1763015969000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["RAG-Enhanced Open SLMs for Hypertension Management Chatbots"],"prefix":"10.1007","volume":"49","author":[{"given":"Gianluca","family":"Aguzzi","sequence":"first","affiliation":[]},{"given":"Matteo","family":"Magnini","sequence":"additional","affiliation":[]},{"given":"Aqila","family":"Farahmand","sequence":"additional","affiliation":[]},{"given":"Stefano","family":"Ferretti","sequence":"additional","affiliation":[]},{"given":"Martino Francesco","family":"Pengo","sequence":"additional","affiliation":[]},{"given":"Sara","family":"Montagna","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,11,13]]},"reference":[{"key":"2297_CR1","doi-asserted-by":"publisher","unstructured":"Li, C., Zhao, Y., Bai, Y., Zhao, B., Tola, Y.O., Chan, C.W., Zhang, M., Fu, X.: Unveiling the potential of large language models in transforming chronic disease management: Mixed methods systematic review. Journal of Medical Internet Research 27, 70535 (2025) https:\/\/doi.org\/10.2196\/70535","DOI":"10.2196\/70535"},{"key":"2297_CR2","doi-asserted-by":"publisher","unstructured":"Huo, B., Boyle, A., Marfo, N., Tangamornsuksan, W., Steen, J.P., McKechnie, T., Lee, Y., Mayol, J., Antoniou, S.A., Thirunavukarasu, A.J., Sanger, S., Ramji, K., Guyatt, G.: Large language models for chatbot health advice studies: A systematic review. JAMA Network Open 8(2), 2457879\u20132457879 (2025) https:\/\/doi.org\/10.1001\/jamanetworkopen.2024.57879","DOI":"10.1001\/jamanetworkopen.2024.57879"},{"key":"2297_CR3","doi-asserted-by":"publisher","unstructured":"Decety, J., Li, J.: The value of empathy in medical practice: A neurobehavioral perspective. Social Sciences & Humanities Open 12, 101956 (2025) https:\/\/doi.org\/10.1016\/j.ssaho.2025.101956","DOI":"10.1016\/j.ssaho.2025.101956"},{"key":"2297_CR4","doi-asserted-by":"publisher","unstructured":"Seitz, L.: Artificial empathy in healthcare chatbots: Does it feel authentic? Computers in Human Behavior: Artificial Humans 2(1), 100067 (2024) https:\/\/doi.org\/10.1016\/j.chbah.2024.100067","DOI":"10.1016\/j.chbah.2024.100067"},{"key":"2297_CR5","doi-asserted-by":"publisher","unstructured":"Seeger, A.-M., Pfeiffer, J., Heinzl, A.: Texting with humanlike conversational agents: Designing for anthropomorphism. Journal of the Association for Information Systems 22(4) (2021) https:\/\/doi.org\/10.17705\/1jais.00685","DOI":"10.17705\/1jais.00685"},{"key":"2297_CR6","doi-asserted-by":"publisher","unstructured":"Ayers, J.W., Poliak, A., Dredze, M., Leas, E.C., Zhu, Z., Kelley, J.B., Faix, D.J., Goodman, A.M., Longhurst, C.A., Hogarth, M., Smith, D.M.: Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Internal Medicine 183(6), 589\u2013596 (2023) https:\/\/doi.org\/10.1001\/jamainternmed.2023.1838","DOI":"10.1001\/jamainternmed.2023.1838"},{"key":"2297_CR7","doi-asserted-by":"publisher","unstructured":"Sorin, V., Brin, D., Barash, Y., Konen, E., Charney, A., Nadkarni, G., Klang, E.: Large language models and empathy: Systematic review. J Med Internet Res 26, 52597 (2024) https:\/\/doi.org\/10.2196\/52597","DOI":"10.2196\/52597"},{"key":"2297_CR8","doi-asserted-by":"publisher","unstructured":"Magnini, M., Aguzzi, G., Montagna, S.: Open-source small language models for personal medical assistant chatbots. Intelligence-Based Medicine 11, 100197 (2025) https:\/\/doi.org\/10.1016\/j.ibmed.2024.100197","DOI":"10.1016\/j.ibmed.2024.100197"},{"key":"2297_CR9","doi-asserted-by":"publisher","unstructured":"Montagna, S., Ferretti, S., Klopfenstein, L.C., Ungolo, M., Pengo, M.F., Aguzzi, G., Magnini, M.: Privacy-preserving llm-based chatbots for hypertensive patient self-management. Smart Health 36, 100552 (2025) https:\/\/doi.org\/10.1016\/j.smhl.2025.100552","DOI":"10.1016\/j.smhl.2025.100552"},{"key":"2297_CR10","unstructured":"Aguzzi, G., Magnini, M., Ferretti, S., Salcuni, G.P., Montagna, S.: Applying Retrieval-Augmented Generation on open LLMs for a medical chatbot supporting hypertensive patients. In: Calimeri, F., Dragoni, M., Stella, F. (eds.) Proceedings of the 3rd AIxIA Workshop on Artificial Intelligence For Healthcare (HC@AIxIA 2024) Co-located with the 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024), Bolzano, Italy, 27-28 November 2024. CEUR Workshop Proceedings, vol. 3880, pp. 189\u2013201. CEUR-WS.org, Aachen, Germany (2024). https:\/\/ceur-ws.org\/Vol-3880\/paper17.pdf"},{"key":"2297_CR11","unstructured":"Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., K\u00fcttler, H., Lewis, M., Yih, W.-t., Rockt\u00e4schel, T., Riedel, S., Kiela, D.: Retrieval-augmented generation for knowledge-intensive nlp tasks. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. NIPS \u201920. Curran Associates Inc., Red Hook, NY, USA (2020). https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/6b493230205f780e1bc26945df7481e5-Abstract.html"},{"key":"2297_CR12","doi-asserted-by":"publisher","unstructured":"Clusmann, J., Kolbinger, F.R., Muti, H.S., Carrero, Z.I., Eckardt, J.-N., Laleh, N.G., L\u00f6ffler, C.M.L., Schwarzkopf, S.-C., Unger, M., Veldhuizen, G.P., Wagner, S.J., Kather, J.N.: The future landscape of large language models in medicine. Communications Medicine 3(1), 141 (2023) https:\/\/doi.org\/10.1038\/s43856-023-00370-1","DOI":"10.1038\/s43856-023-00370-1"},{"key":"2297_CR13","doi-asserted-by":"publisher","unstructured":"Haltaufderheide, J., Ranisch, R.: The ethics of chatgpt in medicine and healthcare: a systematic review on large language models (llms). npj Digital Medicine 7(1), 183 (2024) https:\/\/doi.org\/10.1038\/s41746-024-01157-x","DOI":"10.1038\/s41746-024-01157-x"},{"key":"2297_CR14","doi-asserted-by":"publisher","unstructured":"Li, H., Moon, J.T., Purkayastha, S., Celi, L.A., Trivedi, H., Gichoya, J.W.: Ethics of large language models in medicine and medical research. The Lancet Digital Health 5(6), 333\u2013335 (2023) https:\/\/doi.org\/10.1016\/S2589-7500(23)00083-3","DOI":"10.1016\/S2589-7500(23)00083-3"},{"key":"2297_CR15","doi-asserted-by":"publisher","unstructured":"Kim, H., Hwang, H., Lee, J., Park, S., Kim, D., Lee, T., Yoon, C., Sohn, J., Park, J., Reykhart, O., Fetherston, T., Choi, D., Kwak, S.H., Chen, Q., Kang, J.: Small language models learn enhanced reasoning skills from medical textbooks. npj Digital Medicine 8(1), 240 (2025) https:\/\/doi.org\/10.1038\/s41746-025-01653-8","DOI":"10.1038\/s41746-025-01653-8"},{"key":"2297_CR16","doi-asserted-by":"publisher","unstructured":"Chen, Q., Hu, Y., Peng, X., Xie, Q., Jin, Q., Gilson, A., Singer, M.B., Ai, X., Lai, P.-T., Wang, Z., Keloth, V.K., Raja, K., Huang, J., He, H., Lin, F., Du, J., Zhang, R., Zheng, W.J., Adelman, R.A., Lu, Z., Xu, H.: Benchmarking large language models for biomedical natural language processing applications and recommendations. Nature Communications 16(1), 3280 (2025) https:\/\/doi.org\/10.1038\/s41467-025-56989-2","DOI":"10.1038\/s41467-025-56989-2"},{"key":"2297_CR17","doi-asserted-by":"publisher","unstructured":"Xu, T., Chen, L., Hu, Z., Li, B.: Staf-llm: A scalable and task-adaptive fine-tuning framework for large language models in medical domain. Expert Systems with Applications 281, 127582 (2025) https:\/\/doi.org\/10.1016\/j.eswa.2025.127582","DOI":"10.1016\/j.eswa.2025.127582"},{"key":"2297_CR18","doi-asserted-by":"crossref","unstructured":"Kresevic, S., Giuffr\u00e8, M., Ajcevic, M., Accardo, A., Croc\u00e8, L.S., Shung, D.L.: Optimization of hepatological clinical guidelines interpretation by large language models: a retrieval augmented generation-based framework. npj Digital Medicine 7(1), 102 (2024)","DOI":"10.1038\/s41746-024-01091-y"},{"key":"2297_CR19","unstructured":"Nussbaum, Z., Morris, J.X., Duderstadt, B., Mulyar, A.: Nomic embed: Training a reproducible long context text embedder. CoRR. arXiv:abs\/2402.01613 (2024)"},{"key":"2297_CR20","doi-asserted-by":"publisher","unstructured":"Robertson, S.E., Zaragoza, H.: The probabilistic relevance framework: BM25 and beyond. Found. Trends Inf. Retr. 3(4), 333\u2013389 (2009) https:\/\/doi.org\/10.1561\/1500000019","DOI":"10.1561\/1500000019"},{"key":"2297_CR21","doi-asserted-by":"publisher","unstructured":"Zhang, Y., Radishian, C., Brunswicker, S., Whitenack, D., Linna, D.W.: Empathetic language in llms under prompt engineering: A comparative study in the legal field. In: Shaalan, K., El-Beltagy, S.R. (eds.) 6th International Conference on AI in Computational Linguistics, ACLING 2024, September 21-22, 2024, Dubai, UAE. Procedia Computer Science, vol. 244, pp. 308\u2013317. Elsevier, Amsterdam, Netherlands (2024). https:\/\/doi.org\/10.1016\/J.PROCS.2024.10.204 .","DOI":"10.1016\/J.PROCS.2024.10.204"},{"key":"2297_CR22","doi-asserted-by":"publisher","unstructured":"Liu, Y., Iter, D., Xu, Y., Wang, S., Xu, R., Zhu, C.: G-eval: NLG evaluation using gpt-4 with better human alignment, 2511\u20132522 (2023) https:\/\/doi.org\/10.18653\/V1\/2023.EMNLP-MAIN.153","DOI":"10.18653\/V1\/2023.EMNLP-MAIN.153"},{"key":"2297_CR23","unstructured":"Cram\u00e9r, H.: Mathematical Methods of Statistics. Princeton Mathematical Series. Princeton University Press, Princeton, NJ (1946)"}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-025-02297-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10916-025-02297-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-025-02297-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T06:39:37Z","timestamp":1763015977000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10916-025-02297-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,13]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2297"],"URL":"https:\/\/doi.org\/10.1007\/s10916-025-02297-7","relation":{},"ISSN":["1573-689X"],"issn-type":[{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,13]]},"assertion":[{"value":"30 May 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 November 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. SM is an Associate Editors of the Journal of Medical Systems.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"159"}}