{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T16:55:50Z","timestamp":1791910550065,"version":"4.3.4"},"reference-count":23,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T00:00:00Z","timestamp":1788998400000},"content-version":"am","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>With the explosion of the internet, cyber aggression has become one of the fastest growing forms of interpersonal violence. Methods used to understand aggressive communications content have been limited primarily to surveys. Here, we present multiple methods\u2014panel surveys, electronic capture of social media, and Ecological Momentary Assessments (EMAs)\u2014to characterize both behavioral and perceptual components of cyber aggression in a study of youth from 2 Iowa middle schools during the 2014-2015 school year. Youth completed a survey, and a subsample of smartphone owners installed an electronic application that collected over 150\u2009000 text messages, Twitter posts, and Facebook posts. The subsample also participated in EMAs to collect self-reported experiences of cyber aggression. To code for aggressive content in this large sample of messages, a case\u2013control sampling strategy was used to identify a series of \u201ccase\u201d messages from youth who reported aggression and \u201ccontrol\u201d messages from youth who reported no aggression. We further present recruitment protocols, data management, and qualitative coding methods as well as descriptive characteristics of the student cohort and nested sample of messages. These methods have potential use in future studies of \u201cbig data\u201d captured from social media.<\/jats:p>\n                  <jats:p>This article is part of a Special Collection on Methods in Social Epidemiology.<\/jats:p>","DOI":"10.1093\/aje\/kwag222","type":"journal-article","created":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T11:48:31Z","timestamp":1789040911000},"source":"Crossref","is-referenced-by-count":0,"title":["Multimode design for studying cyber aggression in texts, Facebook, and Twitter messages among middle school youth"],"prefix":"10.1093","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0830-9841","authenticated-orcid":false,"given":"Marizen R","family":"Ramirez","sequence":"first","affiliation":[{"name":"Department of Environmental and Occupational Health, Wen School of Population and Public Health, University of California at Irvine , Irvine, CA ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2861-7606","authenticated-orcid":false,"given":"Jeanie Santaularia","family":"Gomez","sequence":"additional","affiliation":[{"name":"Department of Epidemiology, School of Public Health, University of Washington , WA ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1296-0493","authenticated-orcid":false,"given":"Andrew","family":"Ryan","sequence":"additional","affiliation":[{"name":"Division of Environmental Health Sciences, School of Public Health, University of Minnesota , Minneapolis, MN ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Octav","family":"Chipara","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Iowa , Iowa ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0530-2062","authenticated-orcid":false,"given":"Karen","family":"Heimer","sequence":"additional","affiliation":[{"name":"Department of Sociology, University of Iowa , Iowa ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9472-2538","authenticated-orcid":false,"given":"Corinne","family":"Peek-Asa","sequence":"additional","affiliation":[{"name":"Division of Epidemiology, Herbert Wertheim School of Public Health and Longevity Science, University of California at San Diego , San Diego, CA ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7589-6281","authenticated-orcid":false,"given":"Shelly","family":"Campo","sequence":"additional","affiliation":[{"name":"Department of Communications Studies, University of Iowa , Iowa ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Padmini","family":"Srinivasan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Iowa , Iowa ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4785-7955","authenticated-orcid":false,"given":"Bao Nhia","family":"Xiong","sequence":"additional","affiliation":[{"name":"Department of Environmental and Occupational Health, Wen School of Population and Public Health, University of California at Irvine , Irvine, CA ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4879-0078","authenticated-orcid":false,"given":"Alexis Grimes","family":"Trotter","sequence":"additional","affiliation":[{"name":"Division of Environmental Health Sciences, School of Public Health, University of Minnesota , Minneapolis, MN ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7078-2800","authenticated-orcid":false,"given":"Anthony","family":"Paik","sequence":"additional","affiliation":[{"name":"Department of Sociology, University of Massachusetts at Amherst , Amherst, MA ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,9,10]]},"reference":[{"issue":"2","key":"2026101312335711800_ref1","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1375\/ajgc.20.2.143","article-title":"Cyber-aggression: definition and concept of cyberbullying","volume":"20","author":"Grigg","year":"2010","journal-title":"Aust J Guid Couns"},{"issue":"2","key":"2026101312335711800_ref2","doi-asserted-by":"publisher","first-page":"245","DOI":"10.3390\/soc5020245","article-title":"Cyberbullying or cyber aggression?: a review of existing definitions of cyber-based peer-to-peer aggression","volume":"5","author":"Corcoran","year":"2015","journal-title":"Societies."},{"issue":"1","key":"2026101312335711800_ref3","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1080\/15388220.2014.949377","article-title":"Cyberbullying via social media","volume":"14","author":"Whittaker","year":"2015","journal-title":"J Sch Violence"},{"key":"2026101312335711800_ref4","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2021.634909","article-title":"Cyberbullying among adolescents and children: a comprehensive review of the global situation, risk factors, and preventive measures","volume":"9","author":"Zhu","year":"2021","journal-title":"Front Public Health"},{"issue":"1","key":"2026101312335711800_ref5","doi-asserted-by":"publisher","first-page":"45","DOI":"10.3390\/ijerph17010045","article-title":"Cyberbullying and psychological well-being in young adolescence: the potential protective mediation effects of social support from family, friends, and teachers","volume":"17","author":"Hellfeldt","year":"2019","journal-title":"Int J Environ Res Public Health"},{"key":"2026101312335711800_ref6","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/j.psychres.2019.02.054","article-title":"Cyberbullying and suicide ideation among Hong Kong adolescents: the mitigating effects of life satisfaction with family, classmates and academic results","volume":"274","author":"Chang","year":"2019","journal-title":"Psychiatry Res"},{"key":"2026101312335711800_ref7","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2021.113730","article-title":"Traditional school bullying and cyberbullying: prevalence, the effect on mental health problems and self-harm behavior","volume":"297","author":"Eyuboglu","year":"2021","journal-title":"Psychiatry Res"},{"issue":"20","key":"2026101312335711800_ref8","doi-asserted-by":"publisher","first-page":"7452","DOI":"10.3390\/ijerph17207452","article-title":"Continuity and overlap of roles in victims and aggressors of bullying and cyberbullying in adolescence: a systematic review","volume":"17","author":"Est\u00e9vez","year":"2020","journal-title":"Int J Environ Res Public Health"},{"issue":"20","key":"2026101312335711800_ref9","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph182010646","article-title":"Relationship between cyberbullying, motivation and learning strategies, academic performance, and the ability to adapt to university","volume":"18","author":"Aparisi","year":"2021","journal-title":"Int J Environ Res Public Health"},{"key":"2026101312335711800_ref10","doi-asserted-by":"publisher","first-page":"70701","DOI":"10.1109\/access.2019.2918354","article-title":"Predicting cyberbullying on social media in the Big Data era using machine learning algorithms: review of literature and open challenges","volume":"7","author":"Al-Garadi","year":"2019","journal-title":"IEEE Access"},{"key":"2026101312335711800_ref11","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1007\/978-3-319-13731-5_69","article-title":"Classification of tweets using text classifier to detect cyber bullying","volume":"338","author":"Nalini","year":"2015","journal-title":"Adv Intell Syst Comput"},{"key":"2026101312335711800_ref12","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.psychres.2018.02.051","article-title":"Use of ecological momentary assessment (EMA) in non-suicidal self-injury (NSSI): a systematic review","volume":"263","author":"Rodr\u00edguez-Blanco","year":"2018","journal-title":"Psychiatry Res"},{"issue":"1","key":"2026101312335711800_ref13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/13811118.2015.1004482","article-title":"Ecological momentary assessment is a neglected methodology in suicidology","volume":"21","author":"Davidson","year":"2017","journal-title":"Arch Suicide Res"},{"key":"2026101312335711800_ref14","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/j.jad.2022.11.014","article-title":"Prompt-level predictors of compliance in an ecological momentary assessment study of young adults\u2019 mental health","volume":"322","author":"Murray","year":"2023","journal-title":"J Affect Disord"},{"issue":"1","key":"2026101312335711800_ref15","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.amepre.2013.02.025","article-title":"A practical approach for content mining of tweets","volume":"45","author":"Yoon","year":"2013","journal-title":"Am J Prev Med"},{"issue":"4","key":"2026101312335711800_ref16","doi-asserted-by":"publisher","DOI":"10.2196\/11215","article-title":"Methodological strategies for ecological momentary assessment to evaluate mood and stress in adult patients using Mobile phones: systematic review","volume":"7","author":"Yang","year":"2019","journal-title":"JMIR Mhealth Uhealth"},{"key":"2026101312335711800_ref17","author":"Facebook"},{"key":"2026101312335711800_ref18","author":"X (formerly Twitter)"},{"key":"2026101312335711800_ref19","volume-title":"Thinking with Theory in Qualitative Research: Viewing Data Across Multiple Perspectives","author":"Jackson","year":"2012"},{"key":"2026101312335711800_ref20","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.cosrev.2017.10.002","article-title":"The evolution of sentiment analysis\u2014a review of research topics, venues, and top cited papers","volume":"27","author":"M\u00e4ntyl\u00e4","year":"2018","journal-title":"Comput Sci Rev"},{"key":"2026101312335711800_ref21","doi-asserted-by":"publisher","DOI":"10.1177\/1609406920984608","article-title":"Methods to integrate natural language processing into qualitative research","volume":"19","author":"Abram","year":"2020","journal-title":"Int J Qual Methods"},{"issue":"6","key":"2026101312335711800_ref22","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9702","article-title":"Augmenting qualitative text analysis with natural language processing: methodological study","volume":"20","author":"Guetterman","year":"2018","journal-title":"J Med Internet Res"},{"issue":"13","key":"2026101312335711800_ref23","doi-asserted-by":"publisher","first-page":"1802","DOI":"10.1177\/1049732316654870","article-title":"Member checking: a tool to enhance trustworthiness or merely a nod to validation?","volume":"26","author":"Birt","year":"2016","journal-title":"Qual Health Res"}],"container-title":["American Journal of Epidemiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/aje\/advance-article-pdf\/doi\/10.1093\/aje\/kwag222\/71019204\/kwag222.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/aje\/advance-article-pdf\/doi\/10.1093\/aje\/kwag222\/71019204\/kwag222.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T16:34:02Z","timestamp":1791909242000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/aje\/advance-article\/doi\/10.1093\/aje\/kwag222\/8789971"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,10]]},"references-count":23,"URL":"https:\/\/doi.org\/10.1093\/aje\/kwag222","relation":{},"ISSN":["0002-9262","1476-6256"],"issn-type":[{"value":"0002-9262","type":"print"},{"value":"1476-6256","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,10]]},"article-number":"kwag222"}}