{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T00:41:52Z","timestamp":1740184912745,"version":"3.37.3"},"reference-count":30,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T00:00:00Z","timestamp":1657670400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009633","name":"Eunice Kennedy Shriver National Institute of Child Health and Human Development","doi-asserted-by":"publisher","award":["T32HD040128"],"award-info":[{"award-number":["T32HD040128"]}],"id":[{"id":"10.13039\/100009633","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosdigitalhealth.org"],"crossmark-restriction":false},"short-container-title":["PLOS Digit Health"],"abstract":"<jats:p>The health and safety of incarcerated persons and correctional personnel have been prominent in the U.S. news media discourse during the COVID-19 pandemic. Examining changing attitudes toward the health of the incarcerated population is imperative to better assess the extent to which the general public favors criminal justice reform. However, existing natural language processing lexicons that underlie current sentiment analysis (SA) algorithms may not perform adequately on news articles related to criminal justice due to contextual complexities. News discourse during the pandemic has highlighted the need for a novel SA lexicon and algorithm (i.e., an SA package) tailored for examining public health policy in the context of the criminal justice system. We analyzed the performance of existing SA packages on a corpus of news articles at the intersection of COVID-19 and criminal justice collected from state-level outlets between January and May 2020. Our results demonstrated that sentence sentiment scores provided by three popular SA packages can differ considerably from manually-curated ratings. This dissimilarity was especially pronounced when the text was more polarized, whether negatively or positively. A randomly selected set of 1,000 manually scored sentences, and the corresponding binary document term matrices, were used to train two new sentiment prediction algorithms (i.e., linear regression and random forest regression) to verify the performance of the manually-curated ratings. By better accounting for the unique context in which incarceration-related terminologies are used in news media, both of our proposed models outperformed all existing SA packages considered for comparison. Our findings suggest that there is a need to develop a novel lexicon, and potentially an accompanying algorithm, for analysis of text related to public health within the criminal justice system, as well as criminal justice more broadly.<\/jats:p>","DOI":"10.1371\/journal.pdig.0000063","type":"journal-article","created":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T17:41:56Z","timestamp":1657734116000},"page":"e0000063","update-policy":"https:\/\/doi.org\/10.1371\/journal.pdig.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating criminal justice reform during COVID-19: The need for a novel sentiment analysis package"],"prefix":"10.1371","volume":"1","author":[{"given":"Divya","family":"Ramjee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9029-4644","authenticated-orcid":true,"given":"Louisa H.","family":"Smith","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0924-2287","authenticated-orcid":true,"given":"Anhvinh","family":"Doanvo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marie-Laure","family":"Charpignon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4281-8236","authenticated-orcid":true,"given":"Alyssa","family":"McNulty-Nebel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6590-7821","authenticated-orcid":true,"given":"Elle","family":"Lett","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8962-9427","authenticated-orcid":true,"given":"Angel N.","family":"Desai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maimuna S.","family":"Majumder","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2022,7,13]]},"reference":[{"issue":"4","key":"pdig.0000063.ref001","doi-asserted-by":"crossref","first-page":"e188","DOI":"10.1016\/S2468-2667(20)30058-X","article-title":"Prisons and custodial settings are part of a comprehensive response to COVID-19","volume":"5","author":"SA Kinner","year":"2020","journal-title":"Lancet Public Health"},{"issue":"7\u20138","key":"pdig.0000063.ref002","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1080\/15564886.2020.1813229","article-title":"The global impact of the pandemic on institutional and community corrections: Assessing short-term crisis management and long-term change strategies","volume":"15","author":"KM Nowonty","year":"2020","journal-title":"Vict Offenders"},{"key":"pdig.0000063.ref003","unstructured":"U.S. Department of Justice, Bureau of Prisons. Federal Bureau of Prisons COVID-19 Action Plan [Internet]. [cited 2021 Aug 4]. Available from: https:\/\/www.bop.gov\/resources\/news\/20200313_covid-19.jsp"},{"volume-title":"Understanding public attitudes to criminal justice","year":"2005","author":"JV Roberts","key":"pdig.0000063.ref004"},{"issue":"5","key":"pdig.0000063.ref005","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1177\/0011128716687758","article-title":"The effect of message frames on public attitudes toward criminal justice reform for nonviolent offenses","volume":"63","author":"A. Gottlieb","year":"2017","journal-title":"Crime Delinquency"},{"key":"pdig.0000063.ref006","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1146\/annurev-criminol-011518-024826","article-title":"Public opinion and criminal justice policy: Theory and research","volume":"2","author":"JT Pickett","year":"2019","journal-title":"Annu Rev Criminol"},{"key":"pdig.0000063.ref007","article-title":"Vader: A parsimonious rule-based model for sentiment analysis of social media text","author":"C Hutto","year":"2014","journal-title":"Proceedings of the International AAAI Conference on Web and Social Media"},{"issue":"1","key":"pdig.0000063.ref008","doi-asserted-by":"crossref","first-page":"e16023","DOI":"10.2196\/16023","article-title":"Sentiment analysis in health and well-being: systematic review","volume":"8","author":"A Zunic","year":"2020","journal-title":"JMIR Med Inform"},{"key":"pdig.0000063.ref009","doi-asserted-by":"crossref","first-page":"591","DOI":"10.18653\/v1\/P16-2096","article-title":"The social impact of natural language processing","author":"D Hovy","year":"2016","journal-title":"In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (volume 2: Short Papers)"},{"key":"pdig.0000063.ref010","first-page":"595","article-title":"Inducing domain-specific sentiment lexicons from unlabeled corpora","author":"WL Hamilton","year":"2016","journal-title":"In: Proceedings of the Conference on Empirical Methods in Natural Language Processing Conference on Empirical Methods in Natural Language Processing"},{"key":"pdig.0000063.ref011","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3115\/v1\/P14-5010","article-title":"The Stanford CoreNLP natural language processing toolkit","author":"CD Manning","year":"2014","journal-title":"In: Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations"},{"key":"pdig.0000063.ref012","first-page":"685","article-title":"Progressive prosecution in a pandemic","volume":"110","author":"C Flanders","year":"2020","journal-title":"J Crim Criminol"},{"issue":"S1","key":"pdig.0000063.ref013","doi-asserted-by":"crossref","first-page":"S14-S","DOI":"10.2105\/AJPH.2019.305486","article-title":"Mass incarceration as a social-structural driver of health inequities: A supplement to AJPH","volume":"110","author":"L Brinkley-Rubinstein","year":"2020","journal-title":"Am J Public Health"},{"volume-title":"The new Jim Crow: Mass incarceration in the age of colorblindness. Tenth anniversary edition","year":"2020","author":"M. Alexander","key":"pdig.0000063.ref014"},{"issue":"6","key":"pdig.0000063.ref015","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.1086\/651940","article-title":"Drawing blood from stones: Legal debt and social inequality in the contemporary United States","volume":"115","author":"A Harris","year":"2010","journal-title":"Am J Sociol"},{"issue":"S1","key":"pdig.0000063.ref016","doi-asserted-by":"crossref","first-page":"S5","DOI":"10.2105\/AJPH.2019.305475","article-title":"Documenting and addressing the health impacts of carceral systems","volume":"110","author":"DH Cloud","year":"2020","journal-title":"Am J Public Health"},{"issue":"2","key":"pdig.0000063.ref017","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1017\/S1742058X15000065","article-title":"Racial inequalities in connectedness to imprisoned individuals in the United States","volume":"12","author":"H Lee","year":"2015","journal-title":"Bois Rev Soc Sci Res Race"},{"key":"pdig.0000063.ref018","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1146\/annurev-soc-073014-112326","article-title":"Incarceration and health","volume":"41","author":"M Massoglia","year":"2015","journal-title":"Annu Rev Sociol"},{"issue":"2","key":"pdig.0000063.ref019","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1177\/000312240406900201","article-title":"Mass imprisonment and the life course: Race and class inequality in US incarceration","volume":"69","author":"B Pettit","year":"2004","journal-title":"Am Sociol Rev"},{"key":"pdig.0000063.ref020","first-page":"204","volume-title":"Punishing race: A continuing American dilemma","author":"MH Tonry","year":"2011"},{"issue":"2","key":"pdig.0000063.ref021","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1017\/S0898588X07000211","article-title":"Frontlash: Race and the development of punitive crime policy","volume":"21","author":"VM Weaver","year":"2007","journal-title":"Stud Am Polit Dev"},{"issue":"10077","key":"pdig.0000063.ref022","doi-asserted-by":"crossref","first-page":"1453","DOI":"10.1016\/S0140-6736(17)30569-X","article-title":"Structural racism and health inequities in the USA: Evidence and interventions","volume":"389","author":"ZD Bailey","year":"2017","journal-title":"The Lancet"},{"key":"pdig.0000063.ref023","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1146\/annurev-soc-071811-145508","article-title":"The race discrimination system","volume":"38","author":"B. Reskin","year":"2012","journal-title":"Annu Rev Sociol"},{"key":"pdig.0000063.ref024","doi-asserted-by":"crossref","first-page":"80","DOI":"10.2307\/2626958","article-title":"Social conditions as fundamental causes of disease","author":"BG Link","year":"1995","journal-title":"J Health Soc Behav"},{"key":"pdig.0000063.ref025","first-page":"azab023","article-title":"Incarceration as a fundamental social cause of health inequalities: Jails, prisons and vulnerability to COVID-19","author":"MA Novisky","year":"2021","journal-title":"Br J Criminol"},{"key":"pdig.0000063.ref026","doi-asserted-by":"crossref","first-page":"97","DOI":"10.26615\/978-954-452-049-6_015","article-title":"Inter-annotator agreement in sentiment analysis: machine learning perspective","author":"V Bobicev","year":"2017","journal-title":"In: RANLP 2017:Recent Advances in Natural Language Processing Meet Deep Learning"},{"issue":"1","key":"pdig.0000063.ref027","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/meet.14504701116","article-title":"Investigating multi-label classification for human values: Investigating Multi-Label Classification for Human Values","volume":"47","author":"E Ishita","year":"2010","journal-title":"Proc Am Soc Inf Sci Technol"},{"journal-title":"ETELEMED EHealth Telemed Soc Med","article-title":"Patient\u2019s rationale: Patient knowledge retrieval from health forums","author":"S Melzi","key":"pdig.0000063.ref028"},{"key":"pdig.0000063.ref029","unstructured":"Media Cloud [Internet]. Media Cloud. [cited 2021 Aug 4]. Available from: https:\/\/mediacloud.org"},{"issue":"2","key":"pdig.0000063.ref030","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1007\/s11109-020-09646-x","article-title":"The feedback effects of controversial police use of force","volume":"43","author":"KJ Mullinix","year":"2021","journal-title":"Polit Behav"}],"container-title":["PLOS Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0000063","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T17:42:31Z","timestamp":1657734151000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0000063"}},"subtitle":[],"editor":[{"given":"Imon","family":"Banerjee","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,7,13]]},"references-count":30,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pdig.0000063","relation":{},"ISSN":["2767-3170"],"issn-type":[{"type":"electronic","value":"2767-3170"}],"subject":[],"published":{"date-parts":[[2022,7,13]]}}}