{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T12:27:24Z","timestamp":1769344044432,"version":"3.49.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T00:00:00Z","timestamp":1668988800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T00:00:00Z","timestamp":1668988800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100019927","name":"Universidad de Deusto","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100019927","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>COVID-19 is a disease that affects the quality of life in all aspects. However, the government policy applied in 2020 impacted the lifestyle of the whole world. In this sense, the study of sentiments of people in different countries is a very important task to face future challenges related to lockdown caused by a virus. To contribute to this objective, we have proposed a natural language processing model with the aim to detect positive and negative feelings in open-text answers obtained from a survey in pandemic times. We have proposed a distilBERT transformer model to carry out this task. We have used three approaches to perform a comparison, obtaining for our best model the following average metrics: Accuracy: 0.823, Precision: 0.826, Recall: 0.793 and <jats:italic>F<\/jats:italic>1 Score: 0.803.\u00a0<\/jats:p>","DOI":"10.1007\/s00146-022-01594-w","type":"journal-article","created":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T06:09:01Z","timestamp":1669010941000},"page":"883-890","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Natural language processing analysis applied to COVID-19 open-text opinions using a distilBERT model for sentiment categorization"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6578-071X","authenticated-orcid":false,"given":"Mario","family":"Jojoa","sequence":"first","affiliation":[]},{"given":"Parvin","family":"Eftekhar","sequence":"additional","affiliation":[]},{"given":"Behdin","family":"Nowrouzi-Kia","sequence":"additional","affiliation":[]},{"given":"Begonya","family":"Garcia-Zapirain","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,21]]},"reference":[{"issue":"11","key":"1594_CR1","doi-asserted-by":"publisher","first-page":"3006","DOI":"10.3390\/su11113006","volume":"11","author":"J Abbas","year":"2019","unstructured":"Abbas J et al (2019) The impact of entrepreneurial business networks on firms\u2019 performance through a mediating role of dynamic capabilities. Sustainability 11(11):3006","journal-title":"Sustainability"},{"key":"1594_CR2","doi-asserted-by":"crossref","unstructured":"Aqeel M, et al (2021) \"The influence of illness perception, anxiety and depression disorders on students mental health during COVID-19 outbreak in Pakistan: a web-based cross-sectional survey. Int J Human Rights Healthc","DOI":"10.21203\/rs.3.rs-30128\/v1"},{"key":"1594_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(20)30673-5","author":"J Bedford","year":"2020","unstructured":"Bedford J, Enria D, Giesecke J et al (2020) COVID-19: towards controlling of a pandemic. Lancet. https:\/\/doi.org\/10.1016\/S0140-6736(20)30673-5","journal-title":"Lancet"},{"key":"1594_CR4","doi-asserted-by":"crossref","unstructured":"Broniatowski DA (2010) A method for analysis of expert committee decision-making applied to FDA medical device panels. Diss. Massachusetts Institute of Technology","DOI":"10.1037\/e673512012-014"},{"key":"1594_CR5","doi-asserted-by":"publisher","first-page":"912","DOI":"10.1016\/S0140-6736(20)30460-8","volume":"395","author":"SK Brooks","year":"2020","unstructured":"Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N et al (2020) The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet 395:912\u2013920","journal-title":"Lancet"},{"key":"1594_CR6","doi-asserted-by":"publisher","first-page":"112934","DOI":"10.1016\/j.psychres.2020.112934","volume":"287","author":"W Cao","year":"2020","unstructured":"Cao W et al (2020) The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Res 287:112934","journal-title":"Psychiatry Res"},{"key":"1594_CR7","unstructured":"CDC, National Center for Health Statistics (2020) Indicators of Anxiety or Depression Based on Reported Frequency of Symptoms during the Last 7 Days. Household Pulse Survey. Atlanta, GA: US Department of Health and Human Services, CDC, National Center for Health Statistics; https:\/\/www.cdc.gov\/nchs\/covid19\/pulse\/mentalhealth.htm"},{"key":"1594_CR8","first-page":"e7357","volume":"12","author":"M Chahrour","year":"2020","unstructured":"Chahrour M, Assi S, Bejjani M, Nasrallah AA, Salhab H, Fares MY, Khachfe HH (2020) A bibliometric analysis of COVID-19 research activity: a call for increased output. Cureus 12:e7357 (10.7759)","journal-title":"Cureus"},{"key":"1594_CR9","doi-asserted-by":"crossref","unstructured":"Conneau A et al (2017) Supervised learning of universal sentence representations from natural language inference data. arXiv preprint arXiv:1705.02364","DOI":"10.18653\/v1\/D17-1070"},{"key":"1594_CR10","unstructured":"Coronavirus COVID-19 global cases by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University (JHU) (2020) https:\/\/coronavirus.jhu.edu\/map.html. Accessed 20 Mar 2020"},{"issue":"32","key":"1594_CR11","doi-asserted-by":"publisher","first-page":"1049","DOI":"10.15585\/mmwr.mm6932a1","volume":"69","author":"M\u00c9 Czeisler","year":"2020","unstructured":"Czeisler M\u00c9, Lane RI, Petrosky E et al (2020) Mental health, substance use, and suicidal ideation during the COVID-19 pandemic\u2014United States. MMWR Morb Mortal Wkly Rep 69(32):1049\u20131057. https:\/\/doi.org\/10.15585\/mmwr.mm6932a1","journal-title":"MMWR Morb Mortal Wkly Rep"},{"key":"1594_CR12","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1056\/NEJMp2008017","volume":"383","author":"B Fefferbaum","year":"2020","unstructured":"Fefferbaum B, North CS (2020) Mental health and the Covid-19 pandemic. N Engl J Medicine 383:510\u2013512","journal-title":"N Engl J Medicine"},{"key":"1594_CR13","unstructured":"Ho J et al (2019) \"Axial attention in multidimensional transformers. arXiv preprint arXiv:1912.12180"},{"issue":"11","key":"1594_CR14","doi-asserted-by":"publisher","first-page":"5820","DOI":"10.3390\/ijerph18115820","volume":"18","author":"M Jojoa","year":"2021","unstructured":"Jojoa M et al (2021) The impact of COVID 19 on University Staff and Students from Iberoamerica: online learning and teaching experience. Int J Environ Res Public Health 18(11):5820","journal-title":"Int J Environ Res Public Health"},{"key":"1594_CR15","unstructured":"Kannan S, Gurusamy V (2014) Preprocessing techniques for text mining"},{"key":"1594_CR16","doi-asserted-by":"crossref","unstructured":"Karpov P, Godin G, Tetko IV (2019) A transformer model for retrosynthesis. In: International Conference on artificial neural networks. Springer, Cham","DOI":"10.26434\/chemrxiv.8058464"},{"key":"1594_CR17","doi-asserted-by":"crossref","unstructured":"Liu W et al (2020) Fastbert: a self-distilling bert with adaptive inference time. arXiv preprint arXiv:2004.02178","DOI":"10.18653\/v1\/2020.acl-main.537"},{"key":"1594_CR18","unstructured":"Lovering C et al (2020) Predicting inductive biases of pre-trained models. In: International Conference on learning representations"},{"key":"1594_CR19","doi-asserted-by":"crossref","unstructured":"Nadeem M, Bethke A, Reddy S (2020) Stereoset: measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456","DOI":"10.18653\/v1\/2021.acl-long.416"},{"key":"1594_CR20","doi-asserted-by":"publisher","first-page":"205031212210744","DOI":"10.1177\/20503121221074480","volume":"10","author":"B Nowrouzi-Kia","year":"2022","unstructured":"Nowrouzi-Kia B et al (2022) The early impact of the global lockdown on post-secondary students and staff: a global, descriptive study. SAGE Open Med 10:20503121221074480","journal-title":"SAGE Open Med"},{"issue":"10","key":"1594_CR21","doi-asserted-by":"publisher","first-page":"1872","DOI":"10.1007\/s11431-020-1647-3","volume":"63","author":"X Qiu","year":"2020","unstructured":"Qiu X et al (2020) Pre-trained models for natural language processing: a survey. Sci China Technol Sci 63(10):1872\u20131897","journal-title":"Sci China Technol Sci"},{"key":"1594_CR22","unstructured":"Sahlgren M, Olsson F (2019) Gender bias in pretrained Swedish embeddings. In: Proceedings of the 22nd Nordic Conference on computational linguistics"},{"key":"1594_CR23","unstructured":"Sanh V et al (2019) DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108"},{"key":"1594_CR24","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/s0140-6736(20)30493-1","volume":"395","author":"S Spina","year":"2020","unstructured":"Spina S, Marrazzo F, Migliari M, Stucchi R, Sforza A, Fumagalli R (2020) The response of Milan\u2019s emergency medical system to the COVID-19 outbreak in Italy. Lancet 395:49\u201350. https:\/\/doi.org\/10.1016\/s0140-6736(20)30493-1","journal-title":"Lancet"},{"key":"1594_CR25","doi-asserted-by":"crossref","unstructured":"Tang H et al (2020) Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","DOI":"10.18653\/v1\/2020.acl-main.588"},{"key":"1594_CR26","unstructured":"Vaswani A et al (2017) Attention is all you need. In: Advances in neural information processing systems, p 30"},{"key":"1594_CR27","doi-asserted-by":"crossref","unstructured":"Wang A et al (2018) GLUE: a multi-task benchmark and analysis platform for natural language understanding. arXiv preprint arXiv:1804.07461","DOI":"10.18653\/v1\/W18-5446"},{"key":"1594_CR28","unstructured":"WHO (2020) Coronavirus disease (COVID-19) pandemic. https:\/\/www.who.int\/emergencies\/diseases\/novel-coronavirus-2019. . Accessed 21 Feb 2021"},{"key":"1594_CR29","doi-asserted-by":"publisher","DOI":"10.1016\/j.janxdis.2020.102328","volume":"77","author":"L Yan","year":"2020","unstructured":"Yan L, Gan Y, Ding X, Wu J, Duan H (2020) The relationship between perceived stress and emotional distress during the COVID-19 outbreak: effects of boredom proneness and coping style. J Anxiety Disord 77:102328. https:\/\/doi.org\/10.1016\/j.janxdis.2020.102328","journal-title":"J Anxiety Disord"},{"key":"1594_CR30","doi-asserted-by":"crossref","unstructured":"Yates A, Nogueira R, Lin J (2021) Pretrained transformers for text ranking: BERT and beyond. In: Proceedings of the 14th ACM International Conference on web search and data mining","DOI":"10.1145\/3437963.3441667"},{"key":"1594_CR31","doi-asserted-by":"crossref","unstructured":"Yu F, et al (2021) Audio DistilBERT: a distilled audio BERT for speech representation learning. In: 2021 International Joint Conference on Neural Networks (IJCNN). IEEE, 2021","DOI":"10.1109\/IJCNN52387.2021.9533328"},{"key":"1594_CR32","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1089\/tmj.2020.0068","volume":"26","author":"X Zhou","year":"2020","unstructured":"Zhou X, Snoswell CL, Harding LE et al (2020) The role of telehealth in reducing the mental health burden from COVID-19. Telemed J E Health 26:377\u2013379","journal-title":"Telemed J E Health"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01594-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-022-01594-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01594-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T17:05:58Z","timestamp":1719594358000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-022-01594-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,21]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["1594"],"URL":"https:\/\/doi.org\/10.1007\/s00146-022-01594-w","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,21]]},"assertion":[{"value":"9 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}