{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T09:35:26Z","timestamp":1766050526790,"version":"3.37.3"},"reference-count":58,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2024,1,13]],"date-time":"2024-01-13T00:00:00Z","timestamp":1705104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM011176"],"award-info":[{"award-number":["R01LM011176"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000026","name":"National Institute on Drug Abuse","doi-asserted-by":"publisher","award":["R01DA057599"],"award-info":[{"award-number":["R01DA057599"]}],"id":[{"id":"10.13039\/100000026","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Google Award for Inclusion Research"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,4,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The aim of the Social Media Mining for Health Applications (#SMM4H) shared tasks is to take a community-driven approach to address the natural language processing and machine learning challenges inherent to utilizing social media data for health informatics. In this paper, we present the annotated corpora, a technical summary of participants\u2019 systems, and the performance results.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>The eighth iteration of the #SMM4H shared tasks was hosted at the AMIA 2023 Annual Symposium and consisted of 5 tasks that represented various social media platforms (Twitter and Reddit), languages (English and Spanish), methods (binary classification, multi-class classification, extraction, and normalization), and topics (COVID-19, therapies, social anxiety disorder, and adverse drug events).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In total, 29 teams registered, representing 17 countries.\u00a0In general, the top-performing systems used deep neural network architectures based on pre-trained transformer models. In particular, the top-performing systems for the classification tasks were based on single models that were pre-trained on social media corpora.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>To facilitate future work, the datasets\u2014a total of 61\u00a0353 posts\u2014will remain available by request, and the CodaLab sites will remain active for a post-evaluation phase.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae010","type":"journal-article","created":{"date-parts":[[2024,1,14]],"date-time":"2024-01-14T03:31:57Z","timestamp":1705203117000},"page":"991-996","source":"Crossref","is-referenced-by-count":5,"title":["Overview of the 8th Social Media Mining for Health Applications (#SMM4H) shared tasks at the AMIA 2023 Annual Symposium"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8281-3464","authenticated-orcid":false,"given":"Ari Z","family":"Klein","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania , Philadelphia, PA 19104, United States"}]},{"given":"Juan M","family":"Banda","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Georgia State University , Atlanta, GA 30302, United States"}]},{"given":"Yuting","family":"Guo","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Emory University , Atlanta, GA 30322, United States"}]},{"given":"Ana Lucia","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Roche Innovation Center , 4070 Basel, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0828-1102","authenticated-orcid":false,"given":"Dongfang","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Computational Biomedicine, Cedars-Sinai Medical Center , Los Angeles, CA 90048, United States"}]},{"given":"Ivan","family":"Flores Amaro","sequence":"additional","affiliation":[{"name":"Department of Computational Biomedicine, Cedars-Sinai Medical Center , Los Angeles, CA 90048, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9494-9609","authenticated-orcid":false,"given":"Raul","family":"Rodriguez-Esteban","sequence":"additional","affiliation":[{"name":"Roche Innovation Center , 4070 Basel, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7358-544X","authenticated-orcid":false,"given":"Abeed","family":"Sarker","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Emory University , Atlanta, GA 30322, United States"}]},{"given":"Graciela","family":"Gonzalez-Hernandez","sequence":"additional","affiliation":[{"name":"Department of Computational Biomedicine, Cedars-Sinai Medical Center , Los Angeles, CA 90048, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,1,13]]},"reference":[{"year":"2021","author":"Auxier","key":"2024040320003238700_ocae010-B1"},{"year":"2023","author":"Dixon","key":"2024040320003238700_ocae010-B2"},{"key":"2024040320003238700_ocae010-B3","doi-asserted-by":"crossref","first-page":"e46484","DOI":"10.2196\/46484","article-title":"Automatically identifying self-reports of COVID-19 diagnosis on Twitter: an annotated data set, deep neural network classifiers, and a large-scale cohort","volume":"25","author":"Klein","year":"2023","journal-title":"J Med Internet Res"},{"key":"2024040320003238700_ocae010-B4","doi-asserted-by":"crossref","first-page":"109618","DOI":"10.1016\/j.dib.2023.109618","article-title":"An aspect-level sentiment analysis dataset for therapies on Twitter","volume":"50","author":"Guo","year":"2023","journal-title":"Data Brief"},{"issue":"10","key":"2024040320003238700_ocae010-B5","doi-asserted-by":"crossref","first-page":"2184","DOI":"10.1093\/jamia\/ocab114","article-title":"DeepADEMiner: a deep learning pharmacovigilance pipeline for extraction and normalization of adverse drug event mentions on Twitter","volume":"28","author":"Magge","year":"2021","journal-title":"J Am Med Inform Assoc"},{"year":"2023","key":"2024040320003238700_ocae010-B6"},{"key":"2024040320003238700_ocae010-B7"},{"year":"2023","key":"2024040320003238700_ocae010-B8"},{"key":"2024040320003238700_ocae010-B9"},{"year":"2023","key":"2024040320003238700_ocae010-B10"},{"key":"2024040320003238700_ocae010-B11","doi-asserted-by":"crossref","first-page":"0078","DOI":"10.34133\/hds.0078","article-title":"#ChronicPain: automated building of a chronic pain cohort from Twitter using machine learning","volume":"3","author":"Sarker","year":"2023","journal-title":"Health Data Sci"},{"first-page":"221","year":"2022","author":"Weissenbacher","key":"2024040320003238700_ocae010-B12"},{"first-page":"21","year":"2021","author":"Magge","key":"2024040320003238700_ocae010-B13"},{"first-page":"27","year":"2020","author":"Klein","key":"2024040320003238700_ocae010-B14"},{"first-page":"21","year":"2019","author":"Weissenbacher","key":"2024040320003238700_ocae010-B15"},{"first-page":"13","year":"2018","author":"Weissenbacher","key":"2024040320003238700_ocae010-B16"},{"issue":"10","key":"2024040320003238700_ocae010-B17","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.1093\/jamia\/ocy114","article-title":"Data and systems for medication-related text classification and concept normalization from Twitter: insights from the Social Media Mining for Health (SMM4H)-2017 shared task","volume":"25","author":"Sarker","year":"2018","journal-title":"J Am Med Inform Assoc"},{"author":"Chavda","key":"2024040320003238700_ocae010-B18"},{"year":"2023","author":"Jiang","key":"2024040320003238700_ocae010-B19"},{"author":"Francis","key":"2024040320003238700_ocae010-B20"},{"year":"2023","author":"Glazkova","key":"2024040320003238700_ocae010-B21"},{"key":"2024040320003238700_ocae010-B22","doi-asserted-by":"crossref","first-page":"1023281","DOI":"10.3389\/frai.2023.1023281","article-title":"COVID-Twitter-BERT: a natural language processing model to analyse COVID-19 content on Twitter","volume":"6","author":"M\u00fcller","year":"2023","journal-title":"Front Artif Intell"},{"year":"2019","author":"Liu","key":"2024040320003238700_ocae010-B23"},{"first-page":"1644","year":"2020","author":"Barbieri","key":"2024040320003238700_ocae010-B24"},{"year":"2023","author":"Yue","key":"2024040320003238700_ocae010-B25"},{"first-page":"9","year":"2020","author":"Nguyen","key":"2024040320003238700_ocae010-B26"},{"first-page":"8342","year":"2020","author":"Gururangan","key":"2024040320003238700_ocae010-B27"},{"year":"2023","author":"Nayel","key":"2024040320003238700_ocae010-B28"},{"year":"2023","author":"Kanagasabai","key":"2024040320003238700_ocae010-B29"},{"first-page":"1877","year":"2020","author":"Brown","key":"2024040320003238700_ocae010-B30"},{"year":"2023","author":"Singh","key":"2024040320003238700_ocae010-B31"},{"year":"2023","author":"Zanwar","key":"2024040320003238700_ocae010-B32"},{"first-page":"3149","year":"2017","author":"Ke","key":"2024040320003238700_ocae010-B33"},{"first-page":"8968","year":"2020","author":"Sun","key":"2024040320003238700_ocae010-B34"},{"first-page":"5753","year":"2019","author":"Yang","key":"2024040320003238700_ocae010-B35"},{"first-page":"7184","year":"2022","author":"Ji","key":"2024040320003238700_ocae010-B36"},{"first-page":"1077","year":"2021","author":"Vajre","key":"2024040320003238700_ocae010-B37"},{"first-page":"10965","year":"2022","author":"Li","key":"2024040320003238700_ocae010-B38"},{"year":"2020","author":"Ca\u00f1ete","key":"2024040320003238700_ocae010-B39"},{"first-page":"2475","year":"2018","author":"Conneau","key":"2024040320003238700_ocae010-B40"},{"year":"2023","author":"Yazdani","key":"2024040320003238700_ocae010-B41"},{"first-page":"4171","year":"2019","author":"Devlin","key":"2024040320003238700_ocae010-B42"},{"issue":"1","key":"2024040320003238700_ocae010-B43","first-page":"5485","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J Mach Learn Res"},{"issue":"4","key":"2024040320003238700_ocae010-B44","doi-asserted-by":"crossref","first-page":"474","DOI":"10.26421\/JDI3.4-5","article-title":"Improved methods to aid unsupervised evidence-based fact checking for online health news","volume":"3","author":"Deka","year":"2022","journal-title":"J Data Intell"},{"first-page":"3982","year":"2019","author":"Reimers","key":"2024040320003238700_ocae010-B45"},{"first-page":"758","year":"2009","author":"Cormack","key":"2024040320003238700_ocae010-B46"},{"journal-title":"J Med Internet Res","article-title":"Using longitudinal Twitter data for digital epidemiology of childhood health outcomes: an annotated data set and deep neural network classifiers","author":"Klein","key":"2024040320003238700_ocae010-B47"},{"issue":"3","key":"2024040320003238700_ocae010-B48","doi-asserted-by":"crossref","first-page":"e39547","DOI":"10.2196\/39547","article-title":"Automatically identifying Twitter users for interventions to support dementia family caregivers: annotated data set and benchmark classification models","volume":"5","author":"Klein","year":"2022","journal-title":"JMIR Aging"},{"issue":"1","key":"2024040320003238700_ocae010-B49","doi-asserted-by":"crossref","first-page":"e0262087","DOI":"10.1371\/journal.pone.0262087","article-title":"ReportAGE: automatically extracting the exact age of Twitter users based on self-reports in tweets","volume":"17","author":"Klein","year":"2022","journal-title":"PLoS One"},{"year":"2023","author":"Klein","key":"2024040320003238700_ocae010-B50"},{"first-page":"19","year":"2017","author":"Zolnoori","key":"2024040320003238700_ocae010-B51"},{"first-page":"32","year":"2017","author":"Sarker","key":"2024040320003238700_ocae010-B52"},{"first-page":"42","year":"2017","author":"Pless","key":"2024040320003238700_ocae010-B53"},{"first-page":"5","year":"2018","author":"Skeppstedt","key":"2024040320003238700_ocae010-B54"},{"first-page":"11","year":"2020","author":"Dirkson","key":"2024040320003238700_ocae010-B55"},{"first-page":"203","year":"2022","author":"Chan","key":"2024040320003238700_ocae010-B56"},{"first-page":"19","year":"2020","author":"Romberg","key":"2024040320003238700_ocae010-B57"},{"first-page":"70","year":"2020","author":"Mo\u00dfburger","key":"2024040320003238700_ocae010-B58"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocae010\/55676892\/ocae010.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/4\/991\/57148409\/ocae010.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/4\/991\/57148409\/ocae010.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T20:00:52Z","timestamp":1712174452000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/4\/991\/7529231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,13]]},"references-count":58,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,1,13]]},"published-print":{"date-parts":[[2024,4,3]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae010","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2024,4,1]]},"published":{"date-parts":[[2024,1,13]]}}}