{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T19:57:02Z","timestamp":1789415822666,"version":"build-2803163510"},"reference-count":91,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,8,7]],"date-time":"2023-08-07T00:00:00Z","timestamp":1691366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["101030608"],"award-info":[{"award-number":["101030608"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>This article discusses the development and preliminary validation of a self-report inventory of the patient\u2019s perception of, and affective reaction to, their therapist during a psychotherapy session. First, we wrote a pool of 131 items, reviewed them based on subject matter experts\u2019 review, and then collected validation data from a clinical sample of adult patients in individual therapy (N = 701). We used exploratory factor analysis and item response theory graded response models to select items, confirmatory factor analysis (CFA) to test the factor structure, and k-fold cross-validation to verify model robustness. Multi-group CFA examined measurement invariance across patients with different diagnoses (unipolar depression, bipolar disorder, and neither of these). Three factors produced short scales retaining the strongest items. The in-Session Patient Affective Reactions Questionnaire (SPARQ) has a two-factor structure, yielding a four-item Negative affect scale and a four-item Positive affect scale. The Relationship In-Session Questionnaire (RISQ) is composed of four items from the third factor with dichotomized responses. Both scales showed excellent psychometric properties and evidence of metric invariance across the three diagnostic groups: unipolar depression, bipolar disorder, and neither of these. The SPARQ and the RISQ scale can be used in clinical or research settings, with particular value for capturing the patient\u2019s perspectives about their therapist and session-level emotional processes.<\/jats:p>","DOI":"10.3390\/jcm12155156","type":"journal-article","created":{"date-parts":[[2023,8,7]],"date-time":"2023-08-07T06:38:48Z","timestamp":1691390328000},"page":"5156","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Development and Initial Validation of the in-Session Patient Affective Reactions Questionnaire (SPARQ) and the Rift In-Session Questionnaire (RISQ)"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4807-7184","authenticated-orcid":false,"given":"Alberto","family":"Stefana","sequence":"first","affiliation":[{"name":"Department of Brain and Behavioral Sciences, University of Pavia, 27100 Pavia, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1096-966X","authenticated-orcid":false,"given":"Joshua A.","family":"Langfus","sequence":"additional","affiliation":[{"name":"Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0548-0053","authenticated-orcid":false,"given":"Eduard","family":"Vieta","sequence":"additional","affiliation":[{"name":"Bipolar and Depressive Disorders Unit, Hospital Clinic, IDIBAPS, CIBERSAM, University of Barcelona, 08028 Barcelona, Catalonia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Fusar-Poli","sequence":"additional","affiliation":[{"name":"Department of Brain and Behavioral Sciences, University of Pavia, 27100 Pavia, Italy"},{"name":"OASIS Service, South London and Maudsley NHS Foundation Trust, London SE5 8AZ, UK"},{"name":"Early Psychosis: Interventions and Clinical-Detection (EPIC) Lab, Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King\u2019s College London, London SE5 8AF, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2251-6860","authenticated-orcid":false,"given":"Eric A.","family":"Youngstrom","sequence":"additional","affiliation":[{"name":"Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"},{"name":"Helping Give Away Psychological Science (HGAPS), 501c3, Chapel Hill, NC 27599, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,7]]},"reference":[{"key":"ref_1","unstructured":"Robinson, M.D., Watkins, E., and Harmon-Jones, E. (2013). Handbook of Cognition and Emotion, Guilford Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1002\/cpp.2719","article-title":"Minding My Brain: Fourteen Neuroscience-based Principles to Enhance Psychotherapy Responsiveness","volume":"29","author":"Faustino","year":"2022","journal-title":"Clin. Psychol. Psychoth"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1037\/int0000244","article-title":"The Role of Enhanced Emotional Awareness in Promoting Change across Psychotherapy Modalities","volume":"32","author":"Lane","year":"2022","journal-title":"J. Psychother. Integr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1037\/pst0000189","article-title":"Countertransference Management and Effective Psychotherapy: Meta-Analytic Findings","volume":"55","author":"Hayes","year":"2018","journal-title":"Psychotherapy"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1080\/10503307.2017.1349350","article-title":"How Clients \u201cChange Emotion with Emotion\u201d: A Programme of Research on Emotional Processing","volume":"28","year":"2018","journal-title":"Psychother. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1037\/pst0000165","article-title":"Therapist and Client Emotional Expression and Psychotherapy Outcomes: A Meta-Analysis","volume":"55","author":"Peluso","year":"2018","journal-title":"Psychotherapy"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1037\/a0029858","article-title":"Emotions, the Great Captains of Our Lives: Their Role in the Process of Change in Psychotherapy","volume":"67","author":"Greenberg","year":"2012","journal-title":"Am. Psychol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1111\/bjp.12231","article-title":"Erotic Transference","volume":"33","author":"Stefana","year":"2017","journal-title":"Br. J. Psychother."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1192\/bjp.186.4.342","article-title":"Transference Patterns in the Psychotherapy of Personality Disorders: Empirical Investigation","volume":"186","author":"Bradley","year":"2005","journal-title":"Br. J. Psychiatry"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1080\/00223891.2016.1272050","article-title":"Patient Personality and Relational Patterns in Psychotherapy: Factor Structure, Reliability, and Validity of the Psychotherapy Relationship Questionnaire","volume":"100","author":"Tanzilli","year":"2018","journal-title":"J. Personal. Assess."},{"key":"ref_11","unstructured":"Gabbard, G.O. (2014). Psychodynamic Psychiatry in Clinical Practice, American Psychiatric Publishing. [5th ed.]."},{"key":"ref_12","unstructured":"McWilliams, N. (2011). Psychoanalytic Diagnosis: Understanding Personality Structure in the Clinical Process, The Guilford Press."},{"key":"ref_13","unstructured":"Lingiardi, V., and McWilliams, N. (2017). Psychodynamic Diagnostic Manual: PDM-2, Guilford Press."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Crisp, H., and Gabbard, G.O. (2022). Gabbard\u2019s Textbook of Psychotherapeutic Treatments, American Psychiatric Publishing.","DOI":"10.1176\/appi.books.9781615375233"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1176\/appi.ajp.2014.14010121","article-title":"Exploration of the Patient-Therapist Relationship in Psychotherapy","volume":"171","year":"2014","journal-title":"AJP"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1037\/a0037093","article-title":"Toward a Common Identity for Relationally Oriented Clinicians: A Place to Hang One\u2019s Hat","volume":"51","author":"Markin","year":"2014","journal-title":"Psychotherapy"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ulberg, R., Hummelen, B., Hersoug, A.G., Midgley, N., H\u00f8glend, P.A., and Dahl, H.-S.J. (2021). The First Experimental Study of Transference Work\u2013in Teenagers (FEST\u2013IT): A Multicentre, Observer- and Patient-Blind, Randomised Controlled Component Study. BMC Psychiatry, 21.","DOI":"10.1186\/s12888-021-03055-y"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1080\/09515070.2017.1302409","article-title":"Therapists\u2019 Perspective on the Therapeutic Relationship: Examining a Tripartite Model","volume":"31","author":"Bhatia","year":"2018","journal-title":"Couns. Psychol. Q."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1037\/ccp0000381","article-title":"Change Mechanisms in Psychotherapy: Both Improved Insight and Improved Affective Awareness Are Necessary","volume":"87","author":"Hagtvet","year":"2019","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1080\/10503307.2012.747013","article-title":"Transference, Countertransference, Emotional Expression, and Session Quality over the Course of Supportive Expressive Therapy: The Raters\u2019 Perspective","volume":"23","author":"Markin","year":"2013","journal-title":"Psychother. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Greenberg, L.S., and Goldman, R.N. (2019). Clinical Handbook of Emotion-Focused Therapy, American Psychological Association.","DOI":"10.1037\/0000112-000"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Greenberg, L.S., and Goldman, R.N. (2019). Clinical Handbook of Emotion-Focused Therapy, American Psychological Association.","DOI":"10.1037\/0000112-000"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1002\/cpp.2455","article-title":"Patient Personality and Psychotherapist Reactions in Individual Psychotherapy Setting: A Systematic Review","volume":"27","author":"Stefana","year":"2020","journal-title":"Clin. Psychol. Psychother."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Stefana, A. (2017). History of Countertransference: From Freud to the British Object Relations School, Routledge. [1st ed.].","DOI":"10.4324\/9781315445601"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1080\/00332828.2021.1851136","article-title":"Racker and Heimann on Countertransference: Similarities and Differences","volume":"90","author":"Stefana","year":"2021","journal-title":"Psychoanal. Q."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Norcross, J.C., and Lambert, M.J. (2019). Psychotherapy Relationships That Work, Volume 1: Evidence-Based Therapist Contributions, Oxford University Press. [3rd ed.].","DOI":"10.1093\/med-psych\/9780190843953.003.0001"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Stefana, A., Fusar-Poli, P., Gnisci, C., Vieta, E., and Youngstrom, E.A. (2022). Clinicians\u2019 Emotional Reactions toward Patients with Depressive Symptoms in Mood Disorders: A Narrative Scoping Review of Empirical Research. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph192215403"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Luborsky, L., and Crits-Christoph, P. (1998). Understanding Transference: The Core Conflictual Relationship Theme Method, American Psychological Association. Subsequent Edition.","DOI":"10.1037\/10250-000"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"B\u00e4nninger-Huber, E., and Salvenauer, S. (2022). Different Types of Laughter and Their Function for Emotion Regulation in Dyadic Interactions. Curr. Psychol.","DOI":"10.1007\/s12144-022-03485-1"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1080\/10503300512331327065","article-title":"Nonverbal Relationship Regulation in Psychotherapy","volume":"15","author":"Benecke","year":"2005","journal-title":"Psychother. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103728","DOI":"10.1016\/j.brat.2020.103728","article-title":"Fundamental Frequency during Cognitive Preparation and Its Impact on Therapy Outcome for Panic Disorder with Agoraphobia","volume":"135","author":"Wieder","year":"2020","journal-title":"Behav. Res. Ther."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1037\/0022-0167.43.3.243","article-title":"Development of the Missouri Identifying Transference Scale","volume":"43","author":"Multon","year":"1996","journal-title":"J. Couns. Psychol."},{"key":"ref_33","unstructured":"Zittel Conklin, C., and Westen, D. (2003). The Countertransference Questionnaire, Emory University Departments of Psychology and Psychiatry and Behavioral Sciences."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1037\/a0034696","article-title":"Patterns of Therapeutic Alliance: Rupture\u2013Repair Episodes in Prolonged Exposure for Posttraumatic Stress Disorder","volume":"82","author":"McLaughlin","year":"2014","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1037\/0022-3514.64.5.847","article-title":"Stability of Emotion Experiences and Their Relations to Traits of Personality","volume":"64","author":"Izard","year":"1993","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1002\/wps.21035","article-title":"The Alliance in Mental Health Care: Conceptualization, Evidence and Clinical Applications","volume":"22","author":"Wampold","year":"2023","journal-title":"World Psychiatry"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1037\/pst0000172","article-title":"The Alliance in Adult Psychotherapy: A Meta-Analytic Synthesis","volume":"55","author":"Wampold","year":"2018","journal-title":"Psychotherapy"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Faul, L., and LaBar, K.S. (2022). Mood-Congruent Memory Revisited. Psychol. Rev.","DOI":"10.1037\/rev0000394"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1097\/ACM.0b013e31823ab7d2","article-title":"ResearchMatch: A National Registry to Recruit Volunteers for Clinical Research","volume":"87","author":"Harris","year":"2012","journal-title":"Acad. Med."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1146\/annurev-clinpsy-021815-093623","article-title":"Conducting Clinical Research Using Crowdsourced Convenience Samples","volume":"12","author":"Chandler","year":"2016","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_41","unstructured":"DeVellis, R.F., and Thorpe, C.T. (2022). Scale Development: Theory and Applications, Sage. [5th ed.]."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"McCoach, D.B., Gable, R.K., and Madura, J.P. (2013). Instrument Development in the Affective Domain: School and Corporate Applications, Springer Science + Business Media. [3rd ed.].","DOI":"10.1007\/978-1-4614-7135-6"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1111\/1467-9280.00157","article-title":"On the Dimensional and Hierarchical Structure of Affect","volume":"10","author":"Tellegen","year":"1999","journal-title":"Psychol. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1037\/pas0000626","article-title":"Constructing Validity: New Developments in Creating Objective Measuring Instruments","volume":"31","author":"Clark","year":"2019","journal-title":"Psychol. Assess."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1037\/a0027503","article-title":"The Dominance Behavioral System and Psychopathology: Evidence from Self-Report, Observational, and Biological Studies","volume":"138","author":"Johnson","year":"2012","journal-title":"Psychol. Bull."},{"key":"ref_46","first-page":"61","article-title":"The Neuropsychology of Anxiety: Reprise","volume":"Volume 43","author":"Hope","year":"1996","journal-title":"Perspectives in Anxiety, Panic and Fear"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/S0165-0327(01)00392-5","article-title":"Relationship of Anhedonia and Anxiety to Social Rank, Defeat and Entrapment","volume":"71","author":"Gilbert","year":"2002","journal-title":"J. Affect. Disord."},{"key":"ref_48","unstructured":"Plutchik, R. (1980). Emotion: A Psychoevolutionary Synthesis, Harper & Row."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Eagle, M.N. (2017). Core Concepts in Contemporary Psychoanalysis: Clinical, Research Evidence and Conceptual Critiques, Routledge. [1st ed.].","DOI":"10.4324\/9781315142111"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1037\/a0034708","article-title":"Transference Interventions and the Process between Therapist and Patient","volume":"51","author":"Ulberg","year":"2014","journal-title":"Psychotherapy"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Racker, H. (2018). Transference and Countertransference, Routledge. [1st ed.].","DOI":"10.4324\/9780429484209"},{"key":"ref_52","first-page":"373","article-title":"The Sister Concepts of the Working Alliance and the Real Relationship: On Their Development, Rupture, and Repair","volume":"22","author":"Gelso","year":"2019","journal-title":"Res. Psychother. Psychopathol. Process Outcome"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Gelso, C.J., Kivlighan, D.M., and Markin, R.D. (2019). Psychotherapy Relationships that Work, Oxford University Press.","DOI":"10.1093\/med-psych\/9780190843953.003.0010"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Streiner, D.L., Norman, G.R., and Cairney, J. (2015). Health Measurement Scales: A Practical Guide to Their Development and Use, Oxford University Press. [5th ed.].","DOI":"10.1093\/med\/9780199685219.001.0001"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1002\/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S","article-title":"The Reliability and Validity of the Outcome Questionnaire","volume":"3","author":"Lambert","year":"1996","journal-title":"Clin. Psychol. Psychother."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1037\/0033-2909.125.1.3","article-title":"On the Bipolarity of Positive and Negative Affect","volume":"125","author":"Russell","year":"1999","journal-title":"Psychol. Bull."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1037\/pas0000754","article-title":"Reliability from \u03b1 to \u03c9: A Tutorial","volume":"31","author":"Revelle","year":"2019","journal-title":"Psychol. Assess."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1428","DOI":"10.1037\/pas0000623","article-title":"Factor Analysis in Psychological Assessment Research: Common Pitfalls and Recommendations","volume":"31","author":"Sellbom","year":"2019","journal-title":"Psychol. Assess."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1080\/15374416.2018.1491006","article-title":"Developing and Validating Short Forms of the Parent General Behavior Inventory Mania and Depression Scales for Rating Youth Mood Symptoms","volume":"49","author":"Youngstrom","year":"2020","journal-title":"J. Clin. Child Adolesc. Psychol."},{"key":"ref_60","unstructured":"Hair, J.F., Black, W.C., Babin, B.J., and Anderson, R.A. (2023). Multivariate Data Analysis, Cenage. [8th ed.]."},{"key":"ref_61","unstructured":"Dinno, A. (2023, August 02). Paran: Horn\u2019s Test of Principal Components\/Factors. Available online: https:\/\/cran.r-project.org\/web\/packages\/paran\/paran.pdf."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"2521","DOI":"10.21105\/joss.02521","article-title":"EFAtools: An R Package with Fast and Flexible Implementations of Exploratory Factor Analysis Tools","volume":"5","author":"Steiner","year":"2020","journal-title":"J. Open Source Softw."},{"key":"ref_63","unstructured":"Nunnally, J.C., and Bernstein, I.H. (1994). McGraw-Hill Series in Psychology, McGraw-Hill. [3rd ed.]."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Raykov, T., and Marcoulides, G.A. (2011). Introduction to Psychometric Theory, Routledge.","DOI":"10.4324\/9780203841624"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Chalmers, R.P. (2012). Mirt: A Multidimensional Item Response Theory Package for the R Environment. J. Stat. Soft., 48.","DOI":"10.18637\/jss.v048.i06"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v048.i02","article-title":"Lavaan: An R Package for Structural Equation Modeling","volume":"48","author":"Rosseel","year":"2012","journal-title":"J. Stat. Soft."},{"key":"ref_67","unstructured":"Nickodem, K., and Halpin, P. (2023, August 02). Kfa: K-Fold Cross Validation for Factor Analysis. Available online: https:\/\/cran.r-project.org\/web\/packages\/kfa\/kfa.pdf."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/BF02289447","article-title":"A Rationale and Test for the Number of Factors in Factor Analysis","volume":"30","author":"Horn","year":"1965","journal-title":"Psychometrika"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1177\/0013164495055003002","article-title":"An Improvement on Horn\u2019s Parallel Analysis Methodology for Selecting the Correct Number of Factors to Retain","volume":"55","author":"Glorfeld","year":"1995","journal-title":"Educ. Psychol. Meas."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1080\/00273171.2011.564527","article-title":"The Hull Method for Selecting the Number of Common Factors","volume":"46","author":"Timmerman","year":"2011","journal-title":"Multivar. Behav. Res."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1037\/a0025697","article-title":"Determining the Number of Factors to Retain in an Exploratory Factor Analysis Using Comparison Data of Known Factorial Structure","volume":"24","author":"Ruscio","year":"2012","journal-title":"Psychol. Assess."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Nering, M.L., and Ostini, R. (2010). Handbook of Polytomous Item Response Theory Models, Routledge.","DOI":"10.4324\/9780203861264"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1037\/0022-006X.59.1.12","article-title":"Clinical Significance: A Statistical Approach to Defining Meaningful Change in Psychotherapy Research","volume":"59","author":"Jacobson","year":"1991","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1097\/01.MLR.0000062554.74615.4C","article-title":"Interpretation of Changes in Health-Related Quality of Life: The Remarkable Universality of Half a Standard Deviation","volume":"41","author":"Norman","year":"2003","journal-title":"Med. Care"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1177\/0011000005285875","article-title":"The Meta-Analysis of Clinical Judgment Project: Fifty-Six Years of Accumulated Research on Clinical Versus Statistical Prediction","volume":"34","author":"White","year":"2006","journal-title":"Couns. Psychol."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1037\/0033-3204.44.3.300","article-title":"Bias in Psychotherapist Ratings of Client Transference and Insight","volume":"44","author":"Markin","year":"2007","journal-title":"Psychother. Theory Res. Pract. Train."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1111\/j.1365-2753.2010.01543.x","article-title":"Routine Outcome Monitoring and Feedback on Physical or Mental Health Status: Evidence and Theory: Feedback on Physical or Mental Health Status","volume":"18","author":"Carlier","year":"2012","journal-title":"J. Eval. Clin. Pract."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1037\/pst0000167","article-title":"Collecting and Delivering Progress Feedback: A Meta-Analysis of Routine Outcome Monitoring","volume":"55","author":"Lambert","year":"2018","journal-title":"Psychotherapy"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Levy, R.A., Ablon, J.S., and K\u00e4chele, H. (2012). Psychodynamic Psychotherapy Research, Humana Press.","DOI":"10.1007\/978-1-60761-792-1"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1037\/a0018679","article-title":"Meta-Analysis of Psychological Assessment as a Therapeutic Intervention","volume":"22","author":"Poston","year":"2010","journal-title":"Psychol. Assess."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"1114","DOI":"10.1097\/CHI.0b013e3181825af8","article-title":"A Measurement Feedback System (MFS) Is Necessary to Improve Mental Health Outcomes","volume":"47","author":"Bickman","year":"2008","journal-title":"J. Am. Acad. Child Adolesc. Psychiatry"},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"293","DOI":"10.2307\/23044045","article-title":"Construct Measurement and Validation Procedures in MIS and Behavioral Research: Integrating New and Existing Techniques","volume":"35","author":"MacKenzie","year":"2011","journal-title":"MIS Q."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1159\/000448623","article-title":"Empirically Derived Relational Pattern Prototypes in the Treatment of Personality Disorders","volume":"49","author":"Colli","year":"2016","journal-title":"Psychopathology"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.2147\/PRBM.S369294","article-title":"Managing Transference and Countertransference in Cognitive Behavioral Supervision: Theoretical Framework and Clinical Application","volume":"15","author":"Prasko","year":"2022","journal-title":"Psychol. Res. Behav. Manag."},{"key":"ref_85","unstructured":"Clarkin, J.F., Yeomans, F.E., and Kernberg, O.F. (1999). Psychotherapy for Borderline Personality, Wiley."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1037\/a0028226","article-title":"Premature Discontinuation in Adult Psychotherapy: A Meta-Analysis","volume":"80","author":"Swift","year":"2012","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1111\/cpsp.12207","article-title":"Evidence-Based Assessment as an Integrative Model for Applying Psychological Science to Guide the Voyage of Treatment","volume":"24","author":"Youngstrom","year":"2017","journal-title":"Clin. Psychol. Sci. Pract."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1037\/0021-843X.90.5.381","article-title":"A Behavioral Paradigm for Identifying Persons at Risk for Bipolar Depressive Disorder: A Conceptual Framework and Five Validation Studies","volume":"90","author":"Depue","year":"1981","journal-title":"J. Abnorm. Psychol."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1176\/appi.ajp.162.5.890","article-title":"Countertransference Phenomena and Personality Pathology in Clinical Practice: An Empirical Investigation","volume":"162","author":"Betan","year":"2005","journal-title":"Am. J. Psychiatry"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1176\/appi.ajp.2013.13020224","article-title":"Patient Personality and Therapist Response: An Empirical Investigation","volume":"171","author":"Colli","year":"2014","journal-title":"Am. J. Psychiatry"},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1080\/10503309712331331933","article-title":"Countertransference Behavior and Management in Brief Counseling: A Field Study","volume":"7","author":"Hayes","year":"1997","journal-title":"Psychother. Res."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/12\/15\/5156\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:27:09Z","timestamp":1760128029000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/12\/15\/5156"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,7]]},"references-count":91,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["jcm12155156"],"URL":"https:\/\/doi.org\/10.3390\/jcm12155156","relation":{"has-preprint":[{"id-type":"doi","id":"10.31234\/osf.io\/jvxs9","asserted-by":"object"}]},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,7]]}}}