{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T01:49:21Z","timestamp":1791856161846,"version":"4.3.4"},"reference-count":98,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T00:00:00Z","timestamp":1746748800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["LU 660\/16-1, LU 660\/20-1, LU 660\/10-1"],"award-info":[{"award-number":["LU 660\/16-1, LU 660\/20-1, LU 660\/10-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>In the context of psychotherapy, emotions play an important role both through their association with symptom severity, as well as their effects on the therapeutic relationship. In this analysis, we aim to train a large language model (LLM) for the detection of emotions in German speech. We want to apply this model on a corpus of psychotherapy transcripts to predict symptom severity and alliance aiming to identify the most important emotions for the prediction of symptom severity and therapeutic alliance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We employed a public labeled dataset of 28 emotions and translated the dataset into German. A pre-trained LLM was then fine-tuned on this dataset for emotion classification. We applied the fine-tuned model to a dataset containing 553 psychotherapy sessions of 124 patients. Using machine learning (ML) and explainable artificial intelligence (AI), we predicted symptom severity and alliance by the detected emotions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Our fine-tuned model achieved modest classification performance (\n                      <jats:italic>\n                        F1\n                        <jats:sub>macro<\/jats:sub>\n                      <\/jats:italic>\n                      =0.45,\n                      <jats:italic>Accuracy<\/jats:italic>\n                      =0.41,\n                      <jats:italic>Kappa<\/jats:italic>\n                      =0.42) across the 28 emotions. Incorporating all emotions, our ML model showed satisfying performance for the prediction of symptom severity (\n                      <jats:italic>r<\/jats:italic>\n                      = .50; 95%-CI:.42,.57) and moderate performance for the prediction of alliance scores (\n                      <jats:italic>r<\/jats:italic>\n                      = .20; 95%-CI:.06,.32). The most important emotions for the prediction of symptom severity were\n                      <jats:italic>approval, anger<\/jats:italic>\n                      , and\n                      <jats:italic>fear<\/jats:italic>\n                      . The most important emotions for the prediction of alliance were\n                      <jats:italic>curiosity, confusion<\/jats:italic>\n                      , and\n                      <jats:italic>surprise<\/jats:italic>\n                      .\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Even though the classification results were only moderate, our model achieved a good performance especially for prediction of symptom severity. The results confirm the role of negative emotions in the prediction of symptom severity, while they also highlight the role of positive emotions in fostering a good alliance. Future directions entail the improvement of the labeled dataset, especially with regards to domain-specificity and incorporating context information. Additionally, other modalities and Natural Language Processsing (NLP)-based alliance assessment could be integrated.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpsyt.2025.1504306","type":"journal-article","created":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T01:35:46Z","timestamp":1746754546000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Employing large language models for emotion detection in psychotherapy transcripts"],"prefix":"10.3389","volume":"16","author":[{"given":"Christopher","family":"Lalk","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kim","family":"Targan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Steinbrenner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jana","family":"Schaffrath","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steffen","family":"Eberhardt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Schwartz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonia","family":"Vehlen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wolfgang","family":"Lutz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julian","family":"Rubel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,5,9]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1111\/j.1468-2850.1995.tb00036.x","article-title":"Emotion regulation and mental health","volume":"2","author":"Gross","year":"1995","journal-title":"Clin psychol: Sci Pract"},{"key":"B2","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1080\/02699939208411068","article-title":"An argument for basic emotions","volume":"6","author":"Ekman","year":"1992","journal-title":"Cogn Emotion"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1177\/1754073915576552","article-title":"An evolutionary approach to emotion in mental health with a focus on affiliative emotions","volume":"7","author":"Gilbert","year":"2015","journal-title":"Emotion Rev"},{"key":"B4","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-476-05353-4_25","article-title":"The Evolutionary Psychology of Anger","volume-title":"Emotionen","author":"Sell","year":"2019"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.1037\/t27734-000","volume-title":"Facial Action Coding System","author":"Ekman","year":"2019"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.2466\/03.20.PR0.114k22w4","article-title":"Relation between emotion regulation and mental health: A meta-analysis review","volume":"114","author":"Hu","year":"2014","journal-title":"psychol Rep"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1097\/YCO.0b013e3283503669","article-title":"Emotion regulation and mental health: Recent findings, current challenges, and future directions","volume":"25","author":"Berking","year":"2012","journal-title":"Curr Opin Psychiatry"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.20252","article-title":"Emotion in psychotherapy: A practice-friendly research review","volume":"62","author":"Greenberg","year":"2006","journal-title":"J Clin Psychol"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1080\/02699930541000057","article-title":"Distinctions between emotion and mood","volume":"19","author":"Beedie","year":"2005","journal-title":"Cogn Emotion"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1016\/j.paid.2010.09.034","article-title":"Differential assessment of emotions and moods: Development and validation of the Emotion and Mood Components of Anxiety Questionnaire","volume":"50","author":"Beedie","year":"2011","journal-title":"Pers Individ Dif"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1002\/da.21888","article-title":"Emotion dysregulation model of mood and anxiety disorders","volume":"29","author":"Hofmann","year":"2012","journal-title":"Depression Anxiety"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2016.05.019","article-title":"The effect of psychotherapeutic interventions on positive and negative affect in depression: A systematic review and meta-analysis","volume":"202","author":"Boumparis","year":"2016","journal-title":"J Affect Disord"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2004.1512","article-title":"The broaden\u2013and\u2013build theory of positive emotions","volume":"359","author":"Fredrickson","year":"2004","journal-title":"Philos Trans R Soc London Ser B: Biol Sci"},{"key":"B14","doi-asserted-by":"publisher","first-page":"495","DOI":"10.4236\/psych.2013.46070","article-title":"Depressive expression and anti-depressive protection in adolescence: stress, positive affect, motivation and self-efficacy","volume":"4","author":"Lindahl","year":"2013","journal-title":"Psychology"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1037\/0278-6133.27.2.230","article-title":"Relationships among depressive symptoms, benefit-finding, optimism, and positive affect in multiple sclerosis patients after psychotherapy for depression","volume":"27","author":"Hart","year":"2008","journal-title":"Health Psychol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1037\/0021-843X.100.3.316","article-title":"Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications","volume":"100","author":"Clark","year":"1991","journal-title":"J Abnormal Psychol"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.54.6.1063","article-title":"Development and validation of brief measures of positive and negative affect: The PANAS scales","volume":"54","author":"Watson","year":"1988","journal-title":"J Pers Soc Psychol"},{"key":"B18","article-title":"The role of negative affect and positive affect in stress, depression, self-esteem, assertiveness, Type A behaviors, psychological health, and physical health","volume":"119","author":"Dua","year":"1993","journal-title":"Genetic social Gen Psychol Monogr"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1080\/02699930500473533","article-title":"The association between rumination and negative affect: A review","volume":"20","author":"Kirkegaard Thomsen","year":"2006","journal-title":"Cogn Emotion"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1007\/s42761-020-00014-w","article-title":"Daily affective dynamics predict depression symptom trajectories among adults with major and minor depression","volume":"1","author":"Panaite","year":"2020","journal-title":"Affect Sci"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291719002691","article-title":"The development and validation of an algorithm to predict future depression onset in unselected youth","volume":"50","author":"Cohen","year":"2020","journal-title":"psychol Med"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1037\/pst0000172","article-title":"The alliance in adult psychotherapy: A meta-analytic synthesis","volume":"55","author":"Fl\u00fcckiger","year":"2018","journal-title":"Psychotherapy"},{"key":"B23","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1037\/14344-011","article-title":"Emotions in relationships","volume-title":"APA handbook of personality and social psychology, Volume 3: Interpersonal relations","author":"Fitness","year":"2015"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1002\/9780470998557.ch10","article-title":"Understanding people\u2019s perceptions of relationships is crucial to understanding their emotional lives","volume":"2","author":"Clark","year":"2001","journal-title":"Blackwell Handb Soc psychol: Interpersonal processes"},{"key":"B25","article-title":"Toward an Integrated Model of Negative Affectivity in Marriage","volume-title":"The Heart of the Matter: Perspectives on Emotion in Marital Therapy","author":"Beach","year":"1994"},{"key":"B26","volume-title":"What Predicts Divorce? The Relationship Between Marital Processes and Marital Outcomes","author":"Gottman","year":"1994"},{"key":"B27","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1023\/A:1009479100305","article-title":"The relationship between client emotional expressions, therapist interventions, and the working alliance: an exploration of eight emotional expression events","volume":"10","author":"Iwakabe","year":"2000","journal-title":"J Psychother Integration"},{"key":"B28","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/0272-7358(90)90108-M","article-title":"Towards a refinement of cognitive therapy in light of interpersonal theory: I. Theory","volume":"10","author":"Safran","year":"1990","journal-title":"Clin Psychol Rev"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jadr.2023.100631","article-title":"The social cost of depression: Investigating the impact of impaired social emotion regulation, social cognition, and interpersonal behavior on social functioning","volume":"14","author":"Kupferberg","year":"2023","journal-title":"J Affect Disord Rep"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2018.1552034","article-title":"Rupture resolution rating system (3RS): development and validation","volume":"29","author":"Eubanks","year":"2019","journal-title":"Psychother Res"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.21959","article-title":"The impact of shame on the therapeutic alliance and intimate relationships: shame, therapeutic alliance, and intimate relationships","volume":"69","author":"Black","year":"2013","journal-title":"J Clin Psychol"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1037\/int0000265","article-title":"Clients\u2019 perceptions of the working alliance as a predictor of increases in positive affect","volume":"32","author":"Bartholomew","year":"2022","journal-title":"J Psychother Integration"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1080\/10503300500485391","article-title":"Client critical incidents in the process of early alliance development: A positive emotion\u2013exploration spiral","volume":"16","author":"Fitzpatrick","year":"2006","journal-title":"Psychother Res"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2022.2124893","article-title":"Enhancing working alliance through positive emotional experience: A cross-lag analysis","volume":"33","author":"Notsu","year":"2023","journal-title":"Psychother Res"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2020.12.009","article-title":"The social functions of positive emotions","volume":"39","author":"Sels","year":"2021","journal-title":"Curr Opin Behav Sci"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1037\/h0085885","article-title":"The generalizability of the psychoanalytic concept of the working alliance","volume":"16","author":"Bordin","year":"1979","journal-title":"Psychother: Theory Res Pract"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.5.4.323","article-title":"Bad is stronger than good","volume":"5","author":"Baumeister","year":"2001","journal-title":"Rev Gen Psychol"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2021.758212","article-title":"Review on emotion recognition based on electroencephalography","volume":"15","author":"Liu","year":"2021","journal-title":"Front Comput Neurosci"},{"key":"B39","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.entcs.2019.04.009","article-title":"Emotion recognition from physiological signal analysis: A review","volume":"343","author":"Egger","year":"2019","journal-title":"Electronic Notes Theor Comput Sci"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2021.3128787","article-title":"Automatic emotion recognition in clinical scenario: A systematic review of methods","volume":"14","author":"Pepa","year":"2023","journal-title":"IEEE Trans Affect Computing"},{"key":"B41","doi-asserted-by":"publisher","first-page":"53","DOI":"10.33969\/AIS.2020.21005","article-title":"Emotion recognition and detection methods: A comprehensive survey","volume":"2","author":"Saxena","year":"2020","journal-title":"J Artif Intell Syst"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.3390\/bioengineering10010054","article-title":"A novel baseline removal paradigm for subject-independent features in emotion classification using EEG","volume":"10","author":"Ahmed","year":"2023","journal-title":"Bioengineering"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2022.10.013","article-title":"In search of a robust facial expressions recognition model: A large-scale visual cross-corpus study","volume":"514","author":"Ryumina","year":"2022","journal-title":"Neurocomputing"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2006.11477","article-title":"wav2vec 2.0: A framework for self-supervised learning of speech representations (arXiv:2006.11477)","author":"Baevski","year":"2020","journal-title":"arXiv"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-024-06158-x","article-title":"Exploring the potential of Wav2vec 2.0 for speech emotion recognition using classifier combination and attention-based feature fusion","volume":"80","author":"Nasersharif","year":"2024","journal-title":"J Supercomputing"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0276367","article-title":"Longitudinal analysis of sentiment and emotion in news media headlines using automated labelling with Transformer language models","volume":"17","author":"Rozado","year":"2022","journal-title":"PloS One"},{"key":"B47","doi-asserted-by":"publisher","first-page":"Article 4","DOI":"10.3390\/mti6040028","article-title":"Emotion classification from speech and text in videos using a multimodal approach","volume":"6","author":"Caschera","year":"2022","journal-title":"Multimodal Technol Interaction"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2850.2007.00092.x","article-title":"Measuring changes in emotion during psychotherapy: Conceptual and methodological issues","volume":"14","author":"Sloan","year":"2007","journal-title":"Clin Psychol: Sci Pract"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1080\/10503300600977800","article-title":"The relationship among emotional productivity, emotional arousal and outcome in experiential therapy of depression","volume":"17","author":"Greenberg","year":"2007","journal-title":"Psychother Res"},{"key":"B50","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1002\/(SICI)1097-4679(199901)55:1<39::AID-JCLP4>3.0.CO;2-V","article-title":"Emotion recognition in psychotherapy: Impact of therapist level of experience and emotional awareness","volume":"55","author":"MaChado","year":"1999","journal-title":"J Clin Psychol"},{"key":"B51","doi-asserted-by":"crossref","DOI":"10.1007\/978-81-322-3972-7_19","article-title":"Natural Language Processing","volume-title":"Fundamentals of Artificial Intelligence","author":"Chowdhary","year":"2020"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0143055","article-title":"\u201c Rate my therapist\u201d: Automated detection of empathy in drug and alcohol counseling via speech and language processing","volume":"10","author":"Xiao","year":"2015","journal-title":"PloS One"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1037\/pst0000221","article-title":"Design feasibility of an automated, machine-learning based feedback system for motivational interviewing","volume":"56","author":"Imel","year":"2019","journal-title":"Psychotherapy"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1037\/pst0000362","article-title":"Using topic models to identify clients\u2019 functioning levels and alliance ruptures in psychotherapy","volume":"58","author":"Atzil-Slonim","year":"2021","journal-title":"Psychotherapy"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1007\/s10488-024-01356-4","article-title":"Measuring alliance and symptom severity in psychotherapy transcripts using bert topic modeling","volume":"51","author":"Lalk","year":"2024","journal-title":"Administration Policy Ment Health Ment Health Serv Res"},{"key":"B56","first-page":"33","article-title":"Is sentiment in movies the same as sentiment in psychotherapy? Comparisons using a new psychotherapy sentiment database","author":"Tanana","year":"2016"},{"key":"B57","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding (arXiv:1810.04805)","author":"Devlin","year":"2019","journal-title":"arXiv"},{"key":"B58","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1177\/0261927X09351676","article-title":"The psychological meaning of words: LIWC and computerized text analysis methods","volume":"29","author":"Tausczik","year":"2010","journal-title":"J Lang Soc Psychol"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-020-01531-z","article-title":"How do you feel? Using natural language processing to automatically rate emotion in psychotherapy","volume":"53","author":"Tanana","year":"2017","journal-title":"Behav Res"},{"key":"B60","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1080\/10503307.2024.2322522","article-title":"Decoding emotions: Exploring the validity of sentiment analysis in psychotherapy","volume":"35","author":"Eberhardt","year":"2024","journal-title":"Psychother Res"},{"key":"B61","article-title":"The Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) and the Structured Clinical Interview for DSM-IV Axis II Disorders (SCID-II)","volume-title":"Comprehensive handbook of psychological assessment, Vol. 2: Personality assessment","author":"First","year":"2004"},{"key":"B62","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1026\/0012-1924.52.1.11","article-title":"Reliabilit\u00e4t von Kurzformen g\u00e4ngiger psychometrischer Instrumente zur Evaluation des therapeutischen Fortschritts in Psychotherapie und Psychiatrie","volume":"52","author":"Lutz","year":"2006","journal-title":"Diagnostica"},{"key":"B63","article-title":"Measuring, predicting and tracking change in psychotherapy","volume-title":"Bergin & Garfield\u2019s handbook of psychotherapy and behavior change (7. Aufl.)","author":"Lutz","year":"2021"},{"key":"B64","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1017\/S0033291700048017","article-title":"The Brief Symptom Inventory: An introductory report","volume":"13","author":"Derogatis","year":"1983","journal-title":"psychol Med"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1046\/j.1525-1497.2001.016009606.x","article-title":"The PHQ-9: Validity of a brief depression severity measure","volume":"16","author":"Kroenke","year":"2001","journal-title":"J Gen Internal Med"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.166.10.1092","article-title":"A brief measure for assessing generalized anxiety disorder: the GAD-7","volume":"166","author":"Spitzer","year":"2006","journal-title":"Arch Internal Med"},{"key":"B67","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.brat.2016.12.007","article-title":"Patients\u2019 in-session experiences and symptom change: Session-to-session effects on a within- and between-patient level","volume":"90","author":"Rubel","year":"2017","journal-title":"Behav Res Ther"},{"key":"B68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/19312458.2020.1718629","article-title":"Use omega rather than cronbach\u2019s alpha for estimating reliability. But\u2026","volume":"14","author":"Hayes","year":"2020","journal-title":"Communication Methods Measures"},{"key":"B69","first-page":"3","article-title":"The Session Rating Scale: Preliminary psychometric properties of a \u201cworking\u201d alliance measure","volume":"3","author":"Duncan","year":"2003","journal-title":"J Brief Ther"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1080\/26408066.2020.1729281","article-title":"The psychometric properties of the session rating scale: A narrative review","volume":"17","author":"Murphy","year":"2020","journal-title":"J Evidence-Based Soc Work"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1037\/a0032522","article-title":"Using client feedback in psychotherapy from an interpersonal process perspective","volume":"50","author":"Reese","year":"2013","journal-title":"Psychotherapy"},{"key":"B72","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2005.00547","article-title":"GoEmotions: A dataset of fine-grained emotions (Version 2)","author":"Demszky","year":"2020","journal-title":"arXiv"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1911.02116","article-title":"Unsupervised cross-lingual representation learning at scale (Version 2)","author":"Conneau","year":"2019","journal-title":"arXiv"},{"key":"B74","unstructured":"DeepL\n          \n          \n          \n          2024"},{"key":"B75","volume-title":"Employing Large Language Models for Emotion Detection in Psychotherapy Transcripts: Supplementary Data","author":"Lalk","year":"2025"},{"key":"B76","volume-title":"huggingface\/datasets: 2.8.0","author":"Lhoest","year":"2022"},{"key":"B77","doi-asserted-by":"publisher","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"B78","volume-title":"XRAI - eXplanable Regression-based Artificial Intelligence","author":"Lalk","year":"2024"},{"key":"B79","volume-title":"Applied multiple regression correlation analysis for the behavioral sciences","author":"Cohen","year":"2015"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.5194\/gmd-7-1247-2014","article-title":"Root mean square error (RMSE) or mean absolute error (MAE)? \u2013 Arguments against avoiding RMSE in the literature","volume":"7","author":"Chai","year":"2014","journal-title":"Geoscientific Model Dev"},{"key":"B81","doi-asserted-by":"publisher","first-page":"79","DOI":"10.3354\/cr030079","article-title":"Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance","volume":"30","author":"Willmott","year":"2005","journal-title":"Climate Res"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J R Stat Society Ser B (Methodological)"},{"key":"B83","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J R Stat Society Ser B (Statistical Methodology)"},{"key":"B84","doi-asserted-by":"crossref","DOI":"10.1145\/2939672.2939785","article-title":"XGBoost: A scalable tree boosting system","author":"Chen","year":"2016"},{"key":"B85","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach Learn"},{"key":"B87","doi-asserted-by":"publisher","first-page":"Article25","DOI":"10.2202\/1544-6115.1309","article-title":"Super learner","volume":"6","author":"van der Laan","year":"2007","journal-title":"Stat Appl Genet Mol Biol"},{"key":"B88","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/978-3-031-04083-2_2","article-title":"Explainable AI Methods\u2014A Brief Overview","volume-title":"xxAI - Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, AUSTRIA, Revised and Extended Papers","author":"Holzinger","year":"2022"},{"key":"B89","doi-asserted-by":"crossref","DOI":"10.1515\/9781400881970-018","article-title":"17. A Value for n-Person Games","volume-title":"Contributions to the Theory of Games (AM-28)","author":"Shapley","year":"1953"},{"key":"B90","article-title":"A unified approach to interpreting model predictions","author":"Lundberg","year":"2017","journal-title":"arXiv:1705.07874 [cs stat]"},{"key":"B91","article-title":"Explainable AI for trees: from local explanations to global understanding","author":"Lundberg","year":"2019","journal-title":"arXiv:1905.04610 [cs stat]"},{"key":"B92","doi-asserted-by":"publisher","DOI":"10.1002\/cpp.v28.4","article-title":"What do these sounds tell us about the therapeutic alliance: Acoustic markers as predictors of alliance","volume":"28","author":"Nof","year":"2021","journal-title":"Clin Psychol Psychother"},{"key":"B93","doi-asserted-by":"publisher","DOI":"10.1007\/s10488-023-01310-w","article-title":"Facing change: using automated facial expression analysis to examine emotional flexibility in the treatment of depression","volume":"51","author":"Slonim","year":"2024","journal-title":"Administration Policy Ment Health Ment Health Serv Res"},{"key":"B94","doi-asserted-by":"publisher","DOI":"10.1007\/s10608-024-10542-5","article-title":"Depression symptoms are associated with frequency of cognitive distortions in psychotherapy transcripts","author":"Lalk","year":"2024","journal-title":"Cogn Ther Res"},{"key":"B95","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrp.2013.05.009","article-title":"At what sample size do correlations stabilize","volume":"47","author":"Sch\u00f6nbrodt","year":"2013","journal-title":"J Res Pers"},{"key":"B96","doi-asserted-by":"publisher","DOI":"10.1159\/000347040","article-title":"Psychologische Flexibilit\u00e4t messen= Measuring psychological flexibility: Der Fragebogen zu Akzeptanz und Handeln\u2013II (FAH-II): The Acceptance and Action Questionnaire\u2013II (AAQ-II)","volume":"23","author":"Hoyer","year":"2013","journal-title":"Verhaltenstherapie"},{"key":"B97","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/1500000011","article-title":"Opinion mining and sentiment analysis","volume":"2","author":"Pang","year":"2008","journal-title":"Foundations Trends\u00ae Inf Retrieval"},{"key":"B98","doi-asserted-by":"publisher","first-page":"Article 23","DOI":"10.3390\/s23239333","article-title":"A hybrid deep learning emotion classification system using multimodal data","volume":"23","author":"Kim","year":"2023","journal-title":"Sensors"}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2025.1504306\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T01:35:54Z","timestamp":1746754554000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2025.1504306\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,9]]},"references-count":98,"alternative-id":["10.3389\/fpsyt.2025.1504306"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2025.1504306","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,9]]},"article-number":"1504306"}}