{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T05:06:17Z","timestamp":1789103177319,"version":"build-2803163510"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T00:00:00Z","timestamp":1788912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005246","name":"U.S. Department of Education, Institute of Education Sciences","doi-asserted-by":"crossref","award":["R305L030065"],"award-info":[{"award-number":["R305L030065"]}],"id":[{"id":"10.13039\/100005246","id-type":"DOI","asserted-by":"crossref"}]},{"award":["R305L030065"],"award-info":[{"award-number":["R305L030065"]}],"id":[{"id":"https:\/\/ror.org\/04et59085","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Behav. Sci.","Behavioral Sciences"],"abstract":"<jats:p>Aggressive behavior in childhood is a major developmental and educational concern, but school discipline records provide limited information about how aggression is identified and managed in everyday settings. This study used direct observation to characterize office discipline referral (ODR) events among kindergarten through fifth-grade students in 2007, with each of 14 schools observed for one designated week near the end of a randomized school-based intervention trial. Observers recorded 348 referrals involving 296 students. Aggressive or destructive behavior\u2014physical aggression, verbal aggression, or property destruction\u2014accounted for 46.8% of referrals, with physical aggression alone accounting for 38.5%. Aggressive\/destructive referrals involved descriptively longer office stays than other referrals, although the within-school difference was smaller and imprecisely estimated after accounting for school-level clustering. Fifth grade had the highest overall referral rate, whereas kindergarten referrals were proportionally most likely to involve aggressive\/destructive behavior. Exploratory matched-pair comparisons provided little evidence of differences between intervention and comparison schools in aggressive\/destructive referral rates, although some differences in referral composition and prolonged office stays remained imprecisely estimated. ODRs capture a consequential but selective subset of childhood aggression: behavior that is observed, interpreted, and formalized through school disciplinary procedures.<\/jats:p>","DOI":"10.3390\/bs16091603","type":"journal-article","created":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T09:24:02Z","timestamp":1788945842000},"page":"1603","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Direct Observations of Office Disciplinary Referrals for Aggressive and Other Disruptive Behaviors in Elementary Schools"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8115-1286","authenticated-orcid":false,"given":"Daniel A.","family":"Waschbusch","sequence":"first","affiliation":[{"name":"Department of Psychiatry and Behavioral Health, Penn State Health, Penn State College of Medicine, 500 University Drive, Hershey, PA 17033, USA"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7340-4215","authenticated-orcid":false,"given":"Pevitr S.","family":"Bansal","sequence":"additional","affiliation":[{"name":"Department of Psychology, Montclair State University, 1 Normal Avenue, Montclair, NJ 07043, USA"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6379-4552","authenticated-orcid":false,"given":"Marcela C.","family":"Ramos","sequence":"additional","affiliation":[{"name":"Center for Children and Families, Department of Psychology, Florida International University, Miami, FL 33199, USA"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3195-4478","authenticated-orcid":false,"suffix":"Jr.","given":"William E.","family":"Pelham","sequence":"additional","affiliation":[{"name":"Center for Children and Families, Department of Psychology, Florida International University, Miami, FL 33199, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3813-9839","authenticated-orcid":false,"given":"Greta M.","family":"Massetti","sequence":"additional","affiliation":[{"name":"Department of Public Health Sciences, Georgia State University, 140 Decatur Street SE, Atlanta, GA 30303, USA"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"methodology","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"conceptualization","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"105873","DOI":"10.1016\/j.jeconom.2024.105873","article-title":"Inference in cluster randomized trials with matched pairs","volume":"245","author":"Bai","year":"2024","journal-title":"Journal of Econometrics"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1177\/10983007241312190","article-title":"The impact of positive behavioral interventions and supports on office discipline referrals in quebec schools: A descriptive analysis","volume":"27","author":"Bocquillon","year":"2025","journal-title":"Journal of Positive Behavior Interventions"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1037\/a0018450","article-title":"Multilevel exploration of factors contributing to the overrepresentation of black students in office disciplinary referrals","volume":"102","author":"Bradshaw","year":"2010","journal-title":"Journal of Educational Psychology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"101309","DOI":"10.1016\/j.jsp.2024.101309","article-title":"Reconceptualizing the approach to supporting students with attention-deficit\/hyperactivity disorder in school settings","volume":"104","author":"Fabiano","year":"2024","journal-title":"Journal of School Psychology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1007\/s10566-017-9410-5","article-title":"Functions of aggression and disciplinary actions among elementary school-age youth","volume":"46","author":"Fite","year":"2017","journal-title":"Child & Youth Care Forum"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1037\/spq0000178","article-title":"The relative contribution of subjective office referrals to racial disproportionality in school discipline","volume":"32","author":"Girvan","year":"2017","journal-title":"School Psychology Quarterly"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1108\/CE-12-2009-0002","article-title":"The social and character development research program: Development, goals, and opportunities","volume":"7","author":"Haegrich","year":"2009","journal-title":"Journal of Research in Character Education"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1214\/08-STS274","article-title":"The essential role of pair matching in cluster-randomized experiments, with application to the Mexican universal health insurance evaluation","volume":"24","author":"Imai","year":"2009","journal-title":"Statistical Science"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1177\/10983007060080010301","article-title":"Using office discipline referral data for decision making about student behavior in elementary and middle schools: An empirical evaluation of validity","volume":"8","author":"Irvin","year":"2006","journal-title":"Journal of Positive Behavior Interventions"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1177\/10983007040060030201","article-title":"Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions","volume":"6","author":"Irvin","year":"2004","journal-title":"Journal of Positive Behavior Interventions"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1177\/1098300708329710","article-title":"Patterns in office referral data by grade, race\/ethnicity and gender","volume":"12","author":"Kaufman","year":"2010","journal-title":"Journal of Positive Behavior Interventions"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/BF00910651","article-title":"The utility of differentiating between mixed and pure forms of antisocial child behavior","volume":"13","author":"Loeber","year":"1985","journal-title":"Journal of Abnormal Child Psychology"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1017\/S0954579400004296","article-title":"Developmental pathways in disruptive child behavior","volume":"5","author":"Loeber","year":"1993","journal-title":"Development and Psychopathology"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"21081","DOI":"10.1029\/97JC01506","article-title":"Internal gravity waves in the upper eastern equatorial pacific: Observations and numerical solutions","volume":"102","author":"Mack","year":"1997","journal-title":"Journal of Geophysical Research: Oceans"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3090","DOI":"10.1175\/1520-0485(1999)029<3090:MSOHFI>2.0.CO;2","article-title":"Mixing structure of high-frequency internal waves in the upper eastern equatorial pacific","volume":"29","author":"Mack","year":"1999","journal-title":"Journal of Physical Oceanography"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1037\/h0100517","article-title":"Positive behavior support: Analysis of consistency between office discipline referrals and teacher recordings of disruptive classroom behaviors","volume":"16","author":"Martella","year":"2010","journal-title":"Behavioral Development Bulletin"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1177\/019874290903400204","article-title":"Concurrent validity of office discipline referrals and cut points used in schoolwide positive behavior support","volume":"34","author":"McIntosh","year":"2009","journal-title":"Behavioral Disorders"},{"key":"ref_18","unstructured":"Jimerson, S., Nickerson, A., Mayer, M. J., and Furlong, M. J. (2011). Using office discipline referrals and school exclusion data to assess school discipline. Handbook of school violence and school safety: International research and practice, Taylor & Francis Group."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1080\/02796015.2010.12087759","article-title":"Establishing research-based trajectories of office discipline referrals for individual students","volume":"39","author":"McIntosh","year":"2010","journal-title":"School Psychology Review"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1177\/10634266020100030601","article-title":"The convergent validity of office discipline referrals with the CBCL-TRF","volume":"10","author":"Nelson","year":"2002","journal-title":"Journal of Emotional and Behavioral Disorders"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"224","DOI":"10.17105\/spr-14-0008.1","article-title":"Relationship between school suspension and student outcomes: A meta-analysis","volume":"44","author":"Noltemeyer","year":"2015","journal-title":"School Psychology Review"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1002\/pits.20577","article-title":"Examining the validity of office discipline referrals as an indicator of student behavior problems","volume":"48","author":"Pas","year":"2011","journal-title":"Psychology in the Schools"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1177\/1087054705281596","article-title":"Implementation of a comprehensive schoolwide behavioral intervention: The ABC program","volume":"9","author":"Pelham","year":"2005","journal-title":"Journal of Attention Disorders"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1080\/07350015.2016.1247004","article-title":"Small-sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models","volume":"36","author":"Pustejovsky","year":"2018","journal-title":"Journal of Business & Economic Statistics"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1086\/653629","article-title":"Office discipline and student behavior: Does race matter?","volume":"116","author":"Rocque","year":"2010","journal-title":"American Journal of Education"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1002\/pits.20226","article-title":"A descriptive study of school discipline referrals in first grade","volume":"44","author":"Rusby","year":"2007","journal-title":"Psychology in the Schools"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1080\/10665684.2014.958965","article-title":"More than a metaphor: The contribution of exclusionary discipline to a school-to-prison pipeline","volume":"47","author":"Skiba","year":"2014","journal-title":"Equity & Excellence in Education"},{"key":"ref_28","unstructured":"Social and Character Development Research Consortium (2010). Efficacy of schoolwide programs to promote social and character development and reduce problem behavior in elementary school children."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1177\/106342660000800205","article-title":"Preventing school violence: The use of office discipline referrals to assess and monitor school-wide discipline interventions","volume":"8","author":"Sugai","year":"2000","journal-title":"Journal of Emotional and Behavioral Disorders"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1146\/annurev-psych-010416-044030","article-title":"Developmental origins of chronic physical aggression: A bio-psycho-social model for the next generation of preventive interventions","volume":"69","author":"Tremblay","year":"2018","journal-title":"Annual Review of Psychology"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1353\/etc.2014.0020","article-title":"Preliminary psychometric properties of an observation system to assess teachers\u2019 use of effective behavior support strategies in preschool classrooms","volume":"37","author":"Vujnovic","year":"2014","journal-title":"Education and Treatment of Children"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/s12310-018-9269-0","article-title":"School-based interventions for aggression and defiance in youth: A framework for evidence-based practice","volume":"11","author":"Waschbusch","year":"2019","journal-title":"School Mental Health"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1177\/1087054705279999","article-title":"The behavior education support and treatment (BEST) school intervention program: Pilot project data examining schoolwide, targeted-school, and targeted-home approaches","volume":"9","author":"Waschbusch","year":"2005","journal-title":"Journal of Attention Disorders"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1080\/02796015.1998.12085904","article-title":"Compiling school base rates for disruptive behaviors from student disciplinary referral data","volume":"27","author":"Wright","year":"1998","journal-title":"School Psychology Review"}],"container-title":["Behavioral Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-328X\/16\/9\/1603\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T04:21:28Z","timestamp":1789100488000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-328X\/16\/9\/1603"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,9]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["bs16091603"],"URL":"https:\/\/doi.org\/10.3390\/bs16091603","relation":{},"ISSN":["2076-328X"],"issn-type":[{"value":"2076-328X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,9]]}}}