{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T23:58:49Z","timestamp":1785887929937,"version":"3.56.0"},"reference-count":35,"publisher":"American Medical Association (AMA)","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"Importance<\/jats:title>Emergency medicine (EM) physicians experience tremendous emotional health strain, which has been exacerbated during COVID-19, and many have taken to social media to express themselves.<\/jats:p><\/jats:sec>Objective<\/jats:title>To analyze social media content from academic EM physicians and resident physicians to investigate changes in content and language as indicators of their emotional well-being.<\/jats:p><\/jats:sec>Design, Setting, and Participants<\/jats:title>This cross-sectional study used machine learning and natural language processing of Twitter posts from self-described academic EM physicians and resident physicians between March 2018 and March 2022. Participants included academic EM physicians and resident physicians with publicly accessible posts (at least 300 total words across the posts) from the US counties with the top 10 COVID-19 case burdens. Data analysis was performed from June to September 2022.<\/jats:p><\/jats:sec>Exposure<\/jats:title>Being an EM physician or resident physician who posted on Twitter.<\/jats:p><\/jats:sec>Main Outcomes and Measures<\/jats:title>Social media content themes during the prepandemic period, during the pandemic, and across the phases of the pandemic were analyzed. Psychological constructs evaluated included anxiety, anger, depression, and loneliness. Positive and negative language sentiment within posts was measured.<\/jats:p><\/jats:sec>Results<\/jats:title>This study identified 471 physicians with a total of 198\u202f867 posts (mean [SD], 11\u202f403 [18\u202f998] words across posts; median [IQR],\u20093445 [1100-11\u202f591] words across posts). The top 5 prepandemic themes included free open-access medical education (Cohen d<\/jats:italic>, 0.44; 95% CI,\u20090.38-0.50), residency education (Cohen d<\/jats:italic>, 0.43; 95% CI,\u20090.37-0.49), gun violence (Cohen d<\/jats:italic>, 0.37; 95% CI,\u20090.32-0.44), quality improvement in health care (Cohen d<\/jats:italic>, 0.33; 95% CI,\u20090.27-0.39), and professional resident associations (Cohen d<\/jats:italic>, 0.33; 95% CI,\u20090.27-0.39). During the pandemic, themes were significantly related to healthy behaviors during COVID-19 (Cohen d<\/jats:italic>, 0.83; 95% CI,\u20090.77-0.90), pandemic response (Cohen d<\/jats:italic>, 0.71; 95% CI,\u20090.65-0.77), vaccines and vaccination (Cohen d<\/jats:italic>, 0.60; 95% CI,\u20090.53-0.66), unstable housing and homelessness (Cohen d<\/jats:italic>, 0.40; 95% CI,\u20090.34-0.47), and emotional support for others (Cohen d<\/jats:italic>, 0.40; 95% CI,\u20090.34-0.46). Across the phases of the pandemic, thematic content within social media posts changed significantly. Compared with the prepandemic period, there was significantly less positive, and concordantly more negative, language used during COVID-19. Estimates of loneliness, anxiety, anger, and depression also increased significantly during COVID-19.<\/jats:p><\/jats:sec>Conclusions and Relevance<\/jats:title>In this cross-sectional study, key thematic shifts and increases in language related to anxiety, anger, depression, and loneliness were identified in the content posted on social media by academic EM physicians and resident physicians during the pandemic. Social media may provide a real-time and evolving landscape to evaluate thematic content and linguistics related to emotions and sentiment for health care workers.<\/jats:p><\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2023.12708","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T16:25:57Z","timestamp":1683735957000},"page":"e2312708","source":"Crossref","is-referenced-by-count":13,"title":["Investigating Social Media to Evaluate Emergency Medicine Physicians\u2019 Emotional Well-being During COVID-19"],"prefix":"10.1001","volume":"6","author":[{"given":"Anish K.","family":"Agarwal","sequence":"first","affiliation":[{"name":"Penn Medicine Center for Digital Health, Philadelphia, Pennsylvania"},{"name":"Department of Emergency Medicine, University of Pennsylvania, Philadelphia"},{"name":"Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juhi","family":"Mittal","sequence":"additional","affiliation":[{"name":"Computer and Information Science, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annie","family":"Tran","sequence":"additional","affiliation":[{"name":"Perelman School of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raina","family":"Merchant","sequence":"additional","affiliation":[{"name":"Penn Medicine Center for Digital Health, Philadelphia, Pennsylvania"},{"name":"Department of Emergency Medicine, University of Pennsylvania, Philadelphia"},{"name":"Perelman School of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sharath Chandra","family":"Guntuku","sequence":"additional","affiliation":[{"name":"Penn Medicine Center for Digital Health, Philadelphia, Pennsylvania"},{"name":"Computer and Information Science, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2023,5,10]]},"reference":[{"issue":"1","key":"zoi230391r1","doi-asserted-by":"publisher","first-page":"57","DOI":"10.7326\/M20-1141","article-title":"An epidemic in the midst of a pandemic: opioid use disorder and COVID-19.","volume":"173","author":"Alexander","year":"2020","journal-title":"Ann Intern Med"},{"issue":"9","key":"zoi230391r2","doi-asserted-by":"publisher","first-page":"835","DOI":"10.1001\/jama.2020.14797","article-title":"Women physicians and the COVID-19 pandemic.","volume":"324","author":"Brubaker","year":"2020","journal-title":"JAMA"},{"key":"zoi230391r3","doi-asserted-by":"publisher","first-page":"m1211","DOI":"10.1136\/bmj.m1211","article-title":"Managing mental health challenges faced by healthcare workers during covid-19 pandemic.","volume":"368","author":"Greenberg","year":"2020","journal-title":"BMJ"},{"issue":"3","key":"zoi230391r4","doi-asserted-by":"publisher","first-page":"A17","DOI":"10.1016\/j.annemergmed.2013.01.001","article-title":"Physician burnout: emergency physicians see triple risk of career affliction.","volume":"61","author":"Berger","year":"2013","journal-title":"Ann Emerg Med"},{"issue":"2","key":"zoi230391r6","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1136\/emermed-2022-212368","article-title":"Emergency medicine resident perspectives on well-being during COVID-19: a qualitative study.","volume":"40","author":"Agarwal","year":"2023","journal-title":"Emerg Med J"},{"key":"zoi230391r7","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.jad.2020.06.047","article-title":"Prevalence of depression and its impact on quality of life among frontline nurses in emergency departments during the COVID-19 outbreak.","volume":"276","author":"An","year":"2020","journal-title":"J Affect Disord"},{"issue":"1","key":"zoi230391r8","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.annemergmed.2021.01.028","article-title":"Symptoms of anxiety, burnout, and PTSD and the mitigation effect of serologic testing in emergency department personnel during the COVID-19 pandemic.","volume":"78","author":"Rodriguez","year":"2021","journal-title":"Ann Emerg Med"},{"issue":"17","key":"zoi230391r9","doi-asserted-by":"publisher","first-page":"1661","DOI":"10.1056\/NEJMra1501998","article-title":"Workplace violence against health care workers in the United States.","volume":"374","author":"Phillips","year":"2016","journal-title":"N Engl J Med"},{"issue":"5","key":"zoi230391r12","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1097\/ACM.0000000000003998","article-title":"Professional stigma of mental health issues: physicians are both the cause and solution.","volume":"96","author":"Brower","year":"2021","journal-title":"Acad Med"},{"issue":"5","key":"zoi230391r13","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2012-001776","article-title":"Shame! self-stigmatisation as an obstacle to sick doctors returning to work: a qualitative study.","volume":"2","author":"Henderson","year":"2012","journal-title":"BMJ Open"},{"issue":"23","key":"zoi230391r14","doi-asserted-by":"publisher","first-page":"2415","DOI":"10.1001\/jama.2018.18416","article-title":"Protecting the value of medical science in the age of social media and \u201cfake news\u201d.","volume":"320","author":"Merchant","year":"2018","journal-title":"JAMA"},{"issue":"1","key":"zoi230391r15","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1038\/s41746-021-00419-2","article-title":"Social media language of healthcare super-utilizers.","volume":"4","author":"Guntuku","year":"2021","journal-title":"NPJ Digit Med"},{"issue":"9","key":"zoi230391r16","doi-asserted-by":"publisher","first-page":"2798","DOI":"10.1007\/s11606-020-05988-8","article-title":"Tracking mental health and symptom mentions on Twitter during COVID-19.","volume":"35","author":"Guntuku","year":"2020","journal-title":"J Gen Intern Med"},{"issue":"8","key":"zoi230391r17","doi-asserted-by":"publisher","first-page":"573","DOI":"10.7326\/0003-4819-147-8-200710160-00010","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.","volume":"147","author":"von Elm","year":"2007","journal-title":"Ann Intern Med"},{"issue":"9","key":"zoi230391r22","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0273222","article-title":"COVID-19 contact tracing app reviews reveal concerns and motivations around adoption.","volume":"17","author":"Dixon","year":"2022","journal-title":"PLoS One"},{"issue":"11","key":"zoi230391r23","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2019-030355","article-title":"Studying expressions of loneliness in individuals using Twitter: an observational study.","volume":"9","author":"Guntuku","year":"2019","journal-title":"BMJ Open"},{"issue":"3","key":"zoi230391r26","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1002\/ejsp.v51.3","article-title":"Empirically derived guidelines for effect size interpretation in social psychology.","volume":"51","author":"Lovakov","year":"2021","journal-title":"Eur J Soc Psychol"},{"key":"zoi230391r27","doi-asserted-by":"publisher","DOI":"10.1016\/j.pnpbp.2021.110247","article-title":"The prevalence of anxiety and depression among healthcare workers during the COVID-19 pandemic: an umbrella review of meta-analyses.","volume":"107","author":"Sahebi","year":"2021","journal-title":"Prog Neuropsychopharmacol Biol Psychiatry"},{"issue":"9","key":"zoi230391r28","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0273636","article-title":"Understanding the expression of loneliness on Twitter across age groups and genders.","volume":"17","author":"Andy","year":"2022","journal-title":"PLoS One"},{"issue":"1","key":"zoi230391r29","doi-asserted-by":"publisher","DOI":"10.2196\/32449","article-title":"Using natural language processing to explore mental health insights from UK tweets during the COVID-19 pandemic: infodemiology study.","volume":"2","author":"Marshall","year":"2022","journal-title":"JMIR Infodemiology"},{"issue":"4","key":"zoi230391r32","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1080\/07448481.1989.9938410","article-title":"Health consequences of loneliness: a review of the literature.","volume":"37","author":"Blai","year":"1989","journal-title":"J Am Coll Health"},{"issue":"6","key":"zoi230391r33","doi-asserted-by":"publisher","DOI":"10.1001\/jamahealthforum.2020.0631","article-title":"Addressing loneliness in the era of COVID-19.","volume":"1","author":"Trad","year":"2020","journal-title":"JAMA Health Forum"},{"issue":"3","key":"zoi230391r35","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.3976","article-title":"Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019.","volume":"3","author":"Lai","year":"2020","journal-title":"JAMA Netw Open"},{"key":"zoi230391r5","doi-asserted-by":"crossref","unstructured":"Dyrbye? LN, Shanafelt? TD, Sinsky? CA, . Burnout among health care professionals: a call to explore and address this underrecognized threat to safe, high-quality care. National Academy of Medicine. July 5, 2017. Accessed May 12, 2021. https:\/\/nam.edu\/burnout-among-health-care-professionals-a-call-to-explore-and-address-this-underrecognized-threat-to-safe-high-quality-care\/","DOI":"10.31478\/201707b"},{"key":"zoi230391r10","unstructured":"Collins? TR. Clinician well-being a top priority, Surgeon General says. The Hospitalist. May 17, 2021. Accessed April 4, 2023. https:\/\/www.the-hospitalist.org\/hospitalist\/article\/239812\/mixed-topics\/clinician-well-being-top-priority-surgeon-general-says"},{"key":"zoi230391r11","unstructured":"Committee on Systems Approaches to Improve Patient Care by Supporting Clinician Well-Being, National Academy of Medicine, National Academies of Sciences, Engineering, and Medicine. Taking action against clinician burnout: a systems approach to professional well-being. 2019. Accessed May 12, 2021. https:\/\/www.nap.edu\/catalog\/25521"},{"key":"zoi230391r18","unstructured":"Centers for Disease Control and Prevention. Risk for COVID-19 infection, hospitalization, and death by race\/ethnicity. 2020. Accessed September 10, 2020. https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/covid-data\/investigations-discovery\/hospitalization-death-by-race-ethnicity.html"},{"key":"zoi230391r19","unstructured":"New York Times. Coronavirus in the U.S.: latest map and case count. 2020. Accessed October 14, 2022. https:\/\/www.nytimes.com\/interactive\/2021\/us\/covid-cases.html"},{"key":"zoi230391r20","doi-asserted-by":"crossref","unstructured":"Jaidka? K, Guntuku? S, Ungar? L. Facebook versus Twitter: differences in self-disclosure and trait prediction. Proceedings of the International AAAI Conference on Web and Social Media. June 15, 2018. Accessed October 31, 2022. https:\/\/ojs.aaai.org\/index.php\/ICWSM\/article\/view\/15026","DOI":"10.1609\/icwsm.v12i1.15026"},{"key":"zoi230391r21","unstructured":"Truong? C, Oudre? L, Vayatis? N. ruptures: change point detection in Python.? arXiv. Preprint posted online January 2, 2018. Accessed March 21, 2023. https:\/\/arxiv.org\/abs\/1801.00826"},{"key":"zoi230391r24","unstructured":"Guntuku? SC, Preotiuc-Pietro? D, Eichstaedt? JC, Ungar? LH. What Twitter profile and posted images reveal about depression and anxiety.? arXiv. Preprint posted online April 4, 2019. Accessed March 21, 2023. https:\/\/arxiv.org\/abs\/1904.02670"},{"key":"zoi230391r25","doi-asserted-by":"crossref","unstructured":"Schwartz? HA, Eichstaedt? J, Kern? ML, . Towards assessing changes in degree of depression through Facebook. Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality. Association for Computational Linguistics. June 2014. Accessed March 21, 2023. http:\/\/aclweb.org\/anthology\/W14-3214","DOI":"10.3115\/v1\/W14-3214"},{"key":"zoi230391r30","unstructured":"Conger? K, Hirsch? L. Elon Musk completes $44 billion deal to own Twitter. New York Times. October 27, 2022. Accessed March 20, 2023. https:\/\/www.nytimes.com\/2022\/10\/27\/technology\/elon-musk-twitter-deal-complete.html"},{"key":"zoi230391r31","unstructured":"Auxier? B, Anderson? M. Social media use in 2021. Pew Research Center. April 7, 2021. Accessed March 20, 2023. https:\/\/www.pewresearch.org\/internet\/2021\/04\/07\/social-media-use-in-2021\/"},{"key":"zoi230391r34","unstructured":"Wright? R. How loneliness from coronavirus isolation takes its toll. The New Yorker. March 23, 2020. Accessed May 12, 2020. https:\/\/www.newyorker.com\/news\/our-columnists\/how-loneliness-from-coronavirus-isolation-takes-its-own-toll"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2804673\/agarwal_2023_oi_230391_1683052042.81251.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T16:26:09Z","timestamp":1683735969000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2804673"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,10]]},"references-count":35,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,5,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2023.12708","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,10]]}}}