{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T04:31:20Z","timestamp":1742358680948,"version":"3.40.1"},"reference-count":39,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T00:00:00Z","timestamp":1742256000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["ZIA MH002969"],"award-info":[{"award-number":["ZIA MH002969"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["ZIC-MH002968"],"award-info":[{"award-number":["ZIC-MH002968"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Irritability and temper outbursts are among the most common reasons youth are referred for psychiatric assessment and care. Identifying in vivo clinical variables that precede the onset of temper outbursts would provide valuable clinical utility. Here, we provide the rationale for a study testing the performance of a classifier trained to predict temper outbursts in a group of clinically-referred youth presenting with symptoms of irritability and temper outbursts. Due to the large sample sizes needed for multivariate classification studies, here, we demonstrated the feasibility of our approach using a relatively large preliminary dataset. Our preliminary data included digital based event sampling from an existing Ecological Momentary Assessment dataset consisting of <jats:italic>n<\/jats:italic>\u2009=\u200954 participants with a total of 932 time points. We used this data to develop a logistic regression-based classifier for predicting the temper outburst prospectively. Our initial evaluation provided encouraging evidence for the possibility of predicting the presence of a temper outburst based on individual\u2019s momentary clinical responses (e.g., whether the participant is feeling grouchy, hungry, happy, sad, anxious, tired, etc.) prior to the outburst event, as well as external features (e.g., time of day, day of week). However, due to the risk of false positive discoveries and overfitting, these preliminary results are insufficient to conclusively establish the discovery of predictive rules for irritability in Ecological Momentary Assessment data. To more rigorously assess this classifier, we will collect a large confirmatory set, consisting of at least an additional 20 subjects with an expected total of 400 time points, in which will perform confirmatory analyses of the precision and recall of the classifier already fit using preliminary data. This work will potentially provide the foundation for the identification of features predictive of risk and future development of novel mobile-device-based interventions in youth affected with severe and impairing psychopathology.<\/jats:p>","DOI":"10.1371\/journal.pone.0289235","type":"journal-article","created":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T17:36:07Z","timestamp":1742319367000},"page":"e0289235","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Multivariate prediction of temper outbursts in a sample of youth enriched for irritability using ecological momentary assessment data: A registered report"],"prefix":"10.1371","volume":"20","author":[{"given":"Dipta","family":"Saha","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reut","family":"Naim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francisco","family":"Pereira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9859-4702","authenticated-orcid":true,"given":"Melissa A.","family":"Brotman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3427-0845","authenticated-orcid":true,"given":"Charles Y.","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2025,3,18]]},"reference":[{"issue":"4","key":"pone.0289235.ref001","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1007\/s10578-021-01301-8","article-title":"Is irritability a top problem in youth mental health care? a multi-informant, multi-method investigation","volume":"54","author":"SC Evans","year":"2023","journal-title":"Child Psychiatry Hum Dev"},{"issue":"9","key":"pone.0289235.ref002","doi-asserted-by":"crossref","first-page":"1162","DOI":"10.1097\/00004583-199609000-00014","article-title":"Risk factors for presenting problems in child psychiatric emergencies","volume":"35","author":"BS Peterson","year":"1996","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"issue":"6","key":"pone.0289235.ref003","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1176\/appi.ajp.2016.16070839","article-title":"Irritability in Youths: A Translational Model","volume":"174","author":"MA Brotman","year":"2017","journal-title":"Am J Psychiatry"},{"issue":"2","key":"pone.0289235.ref004","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1089\/cap.2015.0038","article-title":"Disruptive mood dysregulation disorder at ages 13-18: results from the national comorbidity survey-adolescent supplement","volume":"26","author":"RR Althoff","year":"2016","journal-title":"J Child Adolesc Psychopharmacol"},{"issue":"10","key":"pone.0289235.ref005","doi-asserted-by":"crossref","first-page":"1220","DOI":"10.1111\/jcpp.13402","article-title":"Differential outcomes of tonic and phasic irritability in adolescent girls","volume":"62","author":"J Silver","year":"2021","journal-title":"J Child Psychol Psychiatry"},{"issue":"2","key":"pone.0289235.ref006","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1176\/appi.ajp.2010.10050766","article-title":"Severe mood dysregulation, irritability, and the diagnostic boundaries of bipolar disorder in youths","volume":"168","author":"E Leibenluft","year":"2011","journal-title":"Am J Psychiatry"},{"issue":"9","key":"pone.0289235.ref007","doi-asserted-by":"crossref","first-page":"1048","DOI":"10.1176\/appi.ajp.2009.08121849","article-title":"Adult outcomes of youth irritability: a 20-year prospective community-based study","volume":"166","author":"A Stringaris","year":"2009","journal-title":"Am J Psychiatry"},{"issue":"12","key":"pone.0289235.ref008","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1016\/j.jaac.2020.11.022","article-title":"Phasic versus tonic irritability: differential associations with attention-deficit\/hyperactivity disorder symptoms","volume":"60","author":"EM Cardinale","year":"2021","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"issue":"9","key":"pone.0289235.ref009","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1111\/jcpp.13062","article-title":"Heritability, stability, and prevalence of tonic and phasic irritability as indicators of disruptive mood dysregulation disorder","volume":"60","author":"AA Moore","year":"2019","journal-title":"J Child Psychol Psychiatry"},{"key":"pone.0289235.ref010","doi-asserted-by":"crossref","first-page":"e51125","DOI":"10.2196\/51125","article-title":"Selecting an Ecological Momentary Assessment Platform: Tutorial for Researchers","volume":"26","author":"LM Henry","year":"2024","journal-title":"J Med Internet Res"},{"issue":"12","key":"pone.0289235.ref011","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1002\/da.23293","article-title":"Real-time assessment of positive and negative affective fluctuations and mood lability in a transdiagnostic sample of youth","volume":"39","author":"R Naim","year":"2022","journal-title":"Depress Anxiety"},{"issue":"4","key":"pone.0289235.ref012","doi-asserted-by":"crossref","first-page":"e132","DOI":"10.2196\/jmir.6641","article-title":"Compliance with mobile ecological momentary assessment protocols in children and adolescents: a systematic review and meta-analysis","volume":"19","author":"CKF Wen","year":"2017","journal-title":"J Med Internet Res"},{"issue":"5","key":"pone.0289235.ref013","doi-asserted-by":"crossref","first-page":"1734","DOI":"10.1017\/S0954579421000717","article-title":"Using ecological momentary assessment to enhance irritability phenotyping in a transdiagnostic sample of youth","volume":"33","author":"R Naim","year":"2021","journal-title":"Dev Psychopathol"},{"issue":"3","key":"pone.0289235.ref014","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1080\/13811110903044351","article-title":"Suicide ideation among college students: a multivariate analysis","volume":"13","author":"AM Arria","year":"2009","journal-title":"Arch Suicide Res"},{"issue":"2","key":"pone.0289235.ref015","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.aap.2004.10.006","article-title":"Driving anger, sensation seeking, impulsiveness, and boredom proneness in the prediction of unsafe driving","volume":"37","author":"E Dahlen","year":"2005","journal-title":"Accident analysis & prevention"},{"issue":"7","key":"pone.0289235.ref016","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1176\/appi.ajp.2015.14040509","article-title":"Longitudinal stability of genetic and environmental influences on irritability: from childhood to young adulthood","volume":"172","author":"R Roberson-Nay","year":"2015","journal-title":"Am J Psychiatry"},{"issue":"8","key":"pone.0289235.ref017","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1016\/j.jaac.2015.05.016","article-title":"Clinical Implications of a Dimensional Approach: The Normal:Abnormal Spectrum of Early Irritability","volume":"54","author":"LS Wakschlag","year":"2015","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"issue":"2","key":"pone.0289235.ref018","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1176\/appi.ajp.2012.12010132","article-title":"Prevalence, comorbidity, and correlates of DSM-5 proposed disruptive mood dysregulation disorder","volume":"170","author":"WE Copeland","year":"2013","journal-title":"Am J Psychiatry"},{"issue":"3","key":"pone.0289235.ref019","doi-asserted-by":"crossref","first-page":"191-199.e2","DOI":"10.1016\/j.jaac.2017.12.008","article-title":"Identifying clinically significant irritability in early childhood","volume":"57","author":"JL Wiggins","year":"2018","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"issue":"9","key":"pone.0289235.ref020","doi-asserted-by":"crossref","first-page":"1175","DOI":"10.1111\/jcpp.13959","article-title":"Sleepless nights, sour moods: daily sleep-irritability links in a pediatric clinical sample","volume":"65","author":"JM Meigs","year":"2024","journal-title":"J Child Psychol Psychiatry"},{"issue":"4","key":"pone.0289235.ref021","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1037\/a0038498","article-title":"The validity of the multi-informant approach to assessing child and adolescent mental health","volume":"141","author":"A De Los Reyes","year":"2015","journal-title":"Psychol Bull"},{"issue":"7","key":"pone.0289235.ref022","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1002\/da.22151","article-title":"Irritability in child and adolescent anxiety disorders","volume":"31","author":"J Stoddard","year":"2014","journal-title":"Depress Anxiety"},{"issue":"12","key":"pone.0289235.ref023","doi-asserted-by":"crossref","first-page":"e0278926","DOI":"10.1371\/journal.pone.0278926","article-title":"Ambulatory assessment to predict problem anger in trauma-affected adults: Study protocol","volume":"17","author":"O Metcalf","year":"2022","journal-title":"PLoS One"},{"issue":"11","key":"pone.0289235.ref024","doi-asserted-by":"crossref","first-page":"5146","DOI":"10.1017\/S0033291722002161","article-title":"Predicting states of elevated negative affect in adolescents from smartphone sensors: a novel personalized machine learning approach","volume":"53","author":"B Ren","year":"2023","journal-title":"Psychol Med"},{"key":"pone.0289235.ref025","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.invent.2017.10.001","article-title":"Predicting short term mood developments among depressed patients using adherence and ecological momentary assessment data","volume":"12","author":"A Mikus","year":"2017","journal-title":"Internet Interv"},{"issue":"18","key":"pone.0289235.ref026","doi-asserted-by":"crossref","first-page":"6873","DOI":"10.3390\/ijerph17186873","article-title":"Predicting Daily Sheltering Arrangements among Youth Experiencing Homelessness Using Diary Measurements Collected by Ecological Momentary Assessment","volume":"17","author":"R Suchting","year":"2020","journal-title":"Int J Environ Res Public Health"},{"issue":"9","key":"pone.0289235.ref027","doi-asserted-by":"crossref","first-page":"e2333164","DOI":"10.1001\/jamanetworkopen.2023.33164","article-title":"Ecological momentary assessment and machine learning for predicting suicidal ideation among sexual and gender minority individuals","volume":"6","author":"C Lei","year":"2023","journal-title":"JAMA Netw Open"},{"issue":"2\u20133","key":"pone.0289235.ref028","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.neunet.2007.12.031","article-title":"Training neural network classifiers for medical decision making: the effects of imbalanced datasets on classification performance","volume":"21","author":"MA Mazurowski","year":"2008","journal-title":"Neural Netw"},{"key":"pone.0289235.ref029","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1146\/annurev-clinpsy-032816-044941","article-title":"Irritability in Children and Adolescents","volume":"13","author":"MA Brotman","year":"2017","journal-title":"Annu Rev Clin Psychol"},{"issue":"9","key":"pone.0289235.ref030","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1097\/00004583-200209000-00006","article-title":"The Pediatric Anxiety Rating Scale (PARS): development and psychometric properties","volume":"41","year":"2002","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"issue":"3","key":"pone.0289235.ref031","doi-asserted-by":"crossref","first-page":"e12084","DOI":"10.1002\/jcv2.12084","article-title":"The role of anxiety and gender in anticipation and avoidance of naturalistic anxiety-provoking experiences during adolescence: An ecological momentary assessment study","volume":"2","author":"AR Smith","year":"2022","journal-title":"JCPP Adv"},{"issue":"1","key":"pone.0289235.ref032","first-page":"2653","article-title":"Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysis","volume":"18","author":"A Benavoli","year":"2017","journal-title":"Journal of Machine Learning Research"},{"key":"pone.0289235.ref033","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"F Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research,"},{"issue":"17","key":"pone.0289235.ref034","first-page":"1","article-title":"Imbalanced-learn: A Python toolbox to tackle the curse of imbalanced datasets in machine learning","volume":"18","author":"G Lema\u00eetre","year":"2017","journal-title":"Journal of Machine Learning Research"},{"key":"pone.0289235.ref035","volume-title":"PyMC: A Modern and Comprehensive Probabilistic Programming Framework in Python","author":"O Abril-Pla","year":"2023"},{"issue":"1","key":"pone.0289235.ref036","first-page":"1593","article-title":"The No-U-Turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo","volume":"15","author":"M Hoffman","year":"2014","journal-title":"Journal of Machine Learning Research"},{"issue":"7","key":"pone.0289235.ref037","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1097\/00004583-199707000-00021","article-title":"Schedule for affective disorders and schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data","volume":"36","author":"J Kaufman","year":"1997","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"key":"pone.0289235.ref038","volume-title":"Wechsler abbreviated scale of intelligence","author":"D Wechsler","year":"1999"},{"key":"pone.0289235.ref039","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/978-3-540-31865-1_25","article-title":"A probabilistic interpretation of precision, recall and F-score, with implication for evaluation","volume-title":"Advances in Information Retrieval: 27th European Conference on IR Research, ECIR 2005, Santiago de Compostela, Spain, March 21-23, 2005. Proceedings 27","author":"C Goutte","year":"2005"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0289235","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T17:36:26Z","timestamp":1742319386000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0289235"}},"subtitle":[],"editor":[{"given":"Sandip V","family":"George","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2025,3,18]]},"references-count":39,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3,18]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0289235","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,18]]}}}