{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T18:00:37Z","timestamp":1771351237495,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T00:00:00Z","timestamp":1645660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["R01CA225773"],"award-info":[{"award-number":["R01CA225773"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>To combat the e-cigarette epidemic among young audiences, a federal law was passed in the US that raised the minimum legal sales age of tobacco to 21 years (commonly known as Tobacco 21). Little is known about sentiment toward this law. Thus, the purpose of our study was to systematically explore trends about Tobacco 21 discussions and comparisons to other age-restriction behaviors on Twitter. Twitter data (n = 4628) were collected from September to December of 2019 that were related to Tobacco 21. A random subsample of identified tweets was used to develop a codebook. Two trained coders independently coded all data, with strong inter-rater reliability (\u03ba = 0.71 to 0.93) found for all content categories. Associations between sentiment and content categories were calculated using \u03c72 analyses. Among relevant tweets (n = 955), the most common theme\u2014the disjunction between ages for military enlistment and tobacco use\u2014was found in 17.8% of all tweets. Anti-policy sentiment was strongly associated with the age of military enlistment, alcohol, voting, and adulthood (p &lt; 0.001 for all). Opposition to Tobacco 21 propagates on social media because the US federal law does not exempt military members. However, the e-cigarette epidemic may have fueled some support for this law.<\/jats:p>","DOI":"10.3390\/ijerph19052613","type":"journal-article","created":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T07:22:35Z","timestamp":1645687355000},"page":"2613","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Policy and Behavior: Comparisons between Twitter Discussions about the US Tobacco 21 Law and Other Age-Related Behaviors"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1913-6488","authenticated-orcid":false,"given":"Page D.","family":"Dobbs","sequence":"first","affiliation":[{"name":"Health, Human Performance and Recreation Department, University of Arkansas, Fayetteville, AR 72701, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason B.","family":"Colditz","sequence":"additional","affiliation":[{"name":"Center for Research on Media, Technology and Health, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shelby","family":"Shields","sequence":"additional","affiliation":[{"name":"Health, Human Performance and Recreation Department, University of Arkansas, Fayetteville, AR 72701, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Meadows","sequence":"additional","affiliation":[{"name":"Health, Human Performance and Recreation Department, University of Arkansas, Fayetteville, AR 72701, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian A.","family":"Primack","sequence":"additional","affiliation":[{"name":"College of Education and Health Professions, University of Arkansas, Fayetteville, AR 72701, USA"},{"name":"College of Public Health and Human Science, Oregon State University, Corvallis, OR 97331, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.15585\/mmwr.mm6845e1","article-title":"Risk Factors for E-Cigarette, or Vaping, Product Use\u2013Associated Lung Injury (EVALI) Among Adults Who Use E-Cigarette, or Vaping, Products\u2014Illinois, July\u2013October 2019","volume":"68","author":"Navon","year":"2019","journal-title":"MMWR Morb. Mortal. Wkly. Rep."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bonnie, R.J., Stratton, K., and Kwan, L.Y. (2015). Committee on the Public Health Implications of Raising the Minimum Age for Purchasing Tobacco Products, Board on Population Health and Public Health Practice, Institute of Medicine.","DOI":"10.17226\/18997"},{"key":"ref_3","unstructured":"World Health Organization Regional Office for Europe (2017). Tobacco-Free Generations-Protecting Children from Tobacco in the WHO European Region, World Health Organization."},{"key":"ref_4","first-page":"487","article-title":"Development of a tobacco 21 policy assessment tool and state-level analysis in the USA, 2015-2019","volume":"29","author":"Dobbs","year":"2020","journal-title":"Tob. Control"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1136\/tobaccocontrol-2014-052207","article-title":"Community reductions in youth smoking after raising the minimum tobacco sales age to 21","volume":"25","author":"Buka","year":"2016","journal-title":"Tob. Control"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1093\/ntr\/ntz123","article-title":"Do Local Tobacco-21 Laws Reduce Smoking Among 18 to 20 Year-Olds?","volume":"22","author":"Friedman","year":"2020","journal-title":"Nicotine Tob. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1816","DOI":"10.1111\/add.14653","article-title":"Tobacco-21 laws and young adult smoking: Quasi-experimental evidence","volume":"114","author":"Friedman","year":"2019","journal-title":"Addiction"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.2105\/AJPH.2016.303172","article-title":"Minimum Ages of Legal Access for Tobacco in the United States From 1863 to 2015","volume":"106","author":"Apollonio","year":"2016","journal-title":"Am. J. Public Health"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"848","DOI":"10.7205\/MILMED-D-14-00501","article-title":"Tobacco research in the military: Reflections on 20 years of research in the United States Air Force","volume":"180","author":"Talcott","year":"2015","journal-title":"Mil. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"797","DOI":"10.7205\/MILMED-D-04-4108","article-title":"Tobacco promotion to military personnel: \u201cThe plums are here to be piucked\u201d","volume":"174","author":"Smith","year":"2009","journal-title":"Mil. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.2105\/AJPH.2008.152983","article-title":"\u201cEverywhere the soldier will be\u201d: Wartime tobacco promotion in the us military","volume":"99","author":"Smith","year":"2009","journal-title":"Am. J. Public Health"},{"key":"ref_12","unstructured":"U.S. Department of Health and Human Services (2016). E-Cigarette Use among Youth and Young Adults: A Report of the Surgeon General."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1093\/milmed\/usx021","article-title":"Socioecological Risk and Protective Factors for Smoking Among Active Duty U.S. Military Personnel","volume":"183","author":"Brown","year":"2018","journal-title":"Mil. Med."},{"key":"ref_14","first-page":"e163","article-title":"JUUL targets military personnel and veterans","volume":"29","author":"Fahey","year":"2020","journal-title":"Tob. Control"},{"key":"ref_15","first-page":"23","article-title":"Prevalence and Percpetions of Cigarettes, Vaping, and Waterpine Among Veterans","volume":"3","author":"Valverde","year":"2020","journal-title":"Int. J. Addict. Res. Ther."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e127","DOI":"10.1093\/milmed\/usx024","article-title":"Prevalence of Use and Perceptions of Electronic Smoking Devices in a US Army Infantry Division","volume":"183","author":"Chin","year":"2018","journal-title":"Mil. Med."},{"key":"ref_17","unstructured":"(2021, December 15). Truth Initative Tobacco Use in the Military. Available online: https:\/\/truthinitiative.org\/research-resources\/targeted-communities\/tobacco-use-military."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1018","DOI":"10.1001\/jamapediatrics.2015.1742","article-title":"Progression to traditional cigarette smoking after electronic cigarette use among us adolescents and young adults","volume":"169","author":"Primack","year":"2015","journal-title":"JAMA Pediatr."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Soneji, S.S., Sung, H.-Y., Primack, B.A., Pierce, J.P., and Sargent, J.D. (2018). Quantifying population-level health benefits and harms of e-cigarette use in the United States. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0193328"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e20171832","DOI":"10.1542\/peds.2017-1832","article-title":"Trajectories of E-cigarette and conventional cigarette use among youth","volume":"141","author":"Bold","year":"2018","journal-title":"Pediatrics"},{"key":"ref_21","first-page":"226","article-title":"State and regional gaps in coverage of \u201cTobacco 21\u201d policies","volume":"29","author":"Leas","year":"2020","journal-title":"Tob. Control"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1136\/tobaccocontrol-2017-054088","article-title":"Evaluation of California\u2019s Tobacco 21\u2019 law","volume":"27","author":"Zhang","year":"2018","journal-title":"Tob. Control"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, J., Ho, S.Y., Leung, L.T., Wang, M.P., and Lam, T.H. (2019). Adolescent Support for Tobacco Control Policies and Associations with Tobacco Denormalization Beliefs and Harm Perceptions. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16010147"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1136\/tc.2010.040477","article-title":"The influence of newspaper coverage and a media campaign on smokers\u2019 support for smoke-free bars and restaurants and on secondhand smoke harm awareness: Findings from the International Tobacco Control (ITC) Netherlands Survey","volume":"21","author":"Nagelhout","year":"2011","journal-title":"Tob. Control"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.ypmed.2010.05.016","article-title":"The \u201clanguage\u201d of the unsuccessful anti-smoking campaign in Greece: Examples from Greek newspaper headlines","volume":"51","author":"Andreou","year":"2010","journal-title":"Prev. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1016\/j.amepre.2016.04.009","article-title":"Raising the Legal Age of Tobacco Sales: Policy Support and Trust in Government, 2014\u20132015, U.S","volume":"51","author":"Lee","year":"2016","journal-title":"Am. J. Prev. Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.amepre.2015.05.012","article-title":"Attitudes toward raising the minimum age of sale for tobacco among U.S. Adults","volume":"49","author":"King","year":"2015","journal-title":"Am. J. Prev. Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.amepre.2018.03.008","article-title":"Tobacco 21 Policy Support by U.S. Individuals Aged 13\u201325 Years: Evidence From a Rolling Cross-sectional Study (2014\u20132017)","volume":"55","author":"Volinsky","year":"2018","journal-title":"Am. J. Prev. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1136\/tobaccocontrol-2014-052126","article-title":"Public support for raising the age of sale for tobacco to 21 in the United States","volume":"25","author":"Winickoff","year":"2016","journal-title":"Tob. Control"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1056\/NEJMp1314626","article-title":"Tobacco 21\u2014An Idea Whose Time Has Come","volume":"370","author":"Winickoff","year":"2014","journal-title":"N. Engl. J. Med."},{"key":"ref_31","unstructured":"Monica Anderson, M., and Jiang, J. (2018). Teens, Social Media & Technology, Pew Research Center."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"107500","DOI":"10.1016\/j.drugalcdep.2019.06.005","article-title":"I wake up and hit the JUUL: Analyzing Twitter for JUUL nicotine effects and dependence","volume":"204","author":"Sidani","year":"2019","journal-title":"Drug Alcohol Depend."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1111\/josh.12858","article-title":"JUUL on Twitter: Analyzing Tweets About Use of a New Nicotine Delivery System","volume":"90","author":"Sidani","year":"2020","journal-title":"J. Sch. Health"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e238","DOI":"10.2196\/jmir.3622","article-title":"Tweeting for and against public health policy: Response to the Chicago Department of Public Health\u2019s electronic cigarette Twitter campaign","volume":"16","author":"Harris","year":"2014","journal-title":"J. Med. Internet Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1136\/tobaccocontrol-2017-054188","article-title":"We have a rich heritage and, we believe, a bright future\u2019: How transnational tobacco companies are using Twitter to oppose policy and shape their public identity","volume":"28","author":"Watts","year":"2019","journal-title":"Tob. Control"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Czaplicki, L., Kostygina, G., Kim, Y., Perks, S.N., Szczypka, G., Emery, S.L., Vallone, D., and Hair, E.C. (2019). Characterising JUUL-related posts on Instagram. Tob. Control, 29.","DOI":"10.1136\/tobaccocontrol-2018-054824"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1016\/j.jadohealth.2018.08.002","article-title":"JUUL: Spreading Online and Offline","volume":"63","author":"Chu","year":"2018","journal-title":"J. Adolesc. Health"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"e112","DOI":"10.1136\/tobaccocontrol-2016-053295","article-title":"Public reactions to e-cigarette regulations on Twitter: A text mining analysis","volume":"26","author":"Lazard","year":"2017","journal-title":"Tob. Control"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.2105\/AJPH.2018.304497","article-title":"Toward real-Time infoveillance of twitter health messages","volume":"108","author":"Colditz","year":"2018","journal-title":"Am. J. Public Health"},{"key":"ref_40","unstructured":"Crabtree, B., and Miller, W. (1992). Primary care research: A multimethod typology & qualitative roadmap. Doing Qualitative Research in Primary Care: Multiple Strategies, SAGE Publications Inc."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1108\/QRJ-D-18-00035","article-title":"Qualitative research: Deductive and inductive approaches to data analysis","volume":"18","author":"Azungah","year":"2018","journal-title":"Qual. Res. J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: The kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Med."},{"key":"ref_44","unstructured":"Corbin, J., and Strauss, A. (2015). Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, SAGE Publications Inc.. [4th ed.]."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1111\/1468-0009.12212","article-title":"E-cigarette Policymaking by Local and State Governments: 2009\u20132014","volume":"94","author":"Cox","year":"2016","journal-title":"Milbank Q."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1177\/1940161217704969","article-title":"Intermedia Agenda Setting in the Social Media Age: How Traditional Players Dominate the News Agenda in Election Times","volume":"22","author":"Harder","year":"2017","journal-title":"Int. J. Press\/Politics"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10410236.2018.1536952","article-title":"Electronic Cigarette Themes on Twitter: Dissemination Patterns and Relations with Online News and Search Engine Queries in South Korea","volume":"35","author":"Paek","year":"2020","journal-title":"Health Commun."},{"key":"ref_48","unstructured":"(2021, January 26). U.S. Food and Drug Administration Family Smoking Prevention and Tobacco Control Act\u2014An Overview, Available online: https:\/\/www.fda.gov\/tobacco-products\/rules-regulations-and-guidance\/family-smoking-prevention-and-tobacco-control-act-overview."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"908","DOI":"10.2105\/AJPH.92.6.908","article-title":"Why and How the Tobacco Industry Sells Cigarettes to Young Adults: Evidence From Industry Documents","volume":"92","author":"Ling","year":"2002","journal-title":"Am. J. Public Health"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2115","DOI":"10.1513\/AnnalsATS.201604-253AR","article-title":"Tobacco 21: An important public policy to protect our youth","volume":"13","author":"Farber","year":"2016","journal-title":"Ann. Am. Thorac. Soc."},{"key":"ref_51","unstructured":"JUUL Labs Inc. (2021, February 25). Our Support for T21 Laws. Available online: https:\/\/www.juullabs.com\/t21\/."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"345","DOI":"10.2105\/AJPH.2019.305473","article-title":"Preemption in tobacco control: A framework for other areas of public health","volume":"110","author":"Crosbie","year":"2020","journal-title":"Am. J. Public Health"},{"key":"ref_53","unstructured":"McGuirt, J., Prentice-Dunn, H., Bedno, S., Woodcock, L., Corbo, A., and Ribisl, K. (2020, January 24). Density of tobacco-product retailers surrounding a large military base. Proceedings of the American Public Health Association 2020 Virtual Annual Meeting and Expo, Virtual."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/19\/5\/2613\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:26:14Z","timestamp":1760135174000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/19\/5\/2613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,24]]},"references-count":53,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["ijerph19052613"],"URL":"https:\/\/doi.org\/10.3390\/ijerph19052613","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,24]]}}}