{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T19:45:56Z","timestamp":1759693556331,"version":"3.41.0"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2003,9,1]],"date-time":"2003-09-01T00:00:00Z","timestamp":1062374400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2003,9,1]],"date-time":"2003-09-01T00:00:00Z","timestamp":1062374400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Gambl Stud"],"published-print":{"date-parts":[[2003,9]]},"DOI":"10.1023\/a:1024211605799","type":"journal-article","created":{"date-parts":[[2003,9,15]],"date-time":"2003-09-15T15:32:14Z","timestamp":1063639934000},"page":"317-337","source":"Crossref","is-referenced-by-count":16,"title":["How to Design an Effective Treatment Outcome Study"],"prefix":"10.1007","volume":"19","author":[{"given":"Lisa M.","family":"Najavits","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","reference":[{"key":"466137_CR1","first-page":"1","volume":"4","author":"M. Addis","year":"1997","unstructured":"Addis, M. (1997). Evaluating the treatment manual as a means of disseminating empirically validated psychotherapies. Clinical Psychology: Science and Practice, 4, 1-11.","journal-title":"Clinical Psychology: Science and Practice"},{"key":"466137_CR2","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/0149-7189(82)90074-X","volume":"5","author":"C. C. Attkisson","year":"1982","unstructured":"Attkisson, C. C., & Zwick, R. (1982). The Client Satisfaction Questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5, 233-237.","journal-title":"Evaluation and Program Planning"},{"key":"466137_CR3","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/S0376-8716(96)01305-1","volume":"43","author":"J. P. Barber","year":"1996","unstructured":"Barber, J. P., Mercer, D., Krakauer, I., & Calvo, N. (1996). Development of an adherence\/competence rating scale for individual drug counseling. Drug and Alcohol Dependence, 43, 125-132.","journal-title":"Drug and Alcohol Dependence"},{"key":"466137_CR4","volume-title":"The \u2018How To\u2019 Grants Manual: Successful Grantseeking Techniques for Obtaining Public and Private Grants","author":"D. Bauer","year":"1999","unstructured":"Bauer, D. (1999). The \u2018How To\u2019 Grants Manual: Successful Grantseeking Techniques for Obtaining Public and Private Grants. New York: American Council on Education, Oryx Press."},{"key":"466137_CR5","first-page":"229","volume-title":"Handbook of Psychotherapy and Behavior Change","author":"L. E. Beutler","year":"1994","unstructured":"Beutler, L. E., Machado, P. P., & Neufeldt, S. (1994). Therapist variables. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of Psychotherapy and Behavior Change (pp. 229-269). New York: John Wiley & Sons, Inc."},{"key":"466137_CR6","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1037\/h0088206","volume":"54","author":"L. Bickman","year":"1999","unstructured":"Bickman, L. (1999). Practice makes perfect and other myths about mental health services. American Psychologist, 54, 965-977.","journal-title":"American Psychologist"},{"key":"466137_CR7","first-page":"249","volume":"137","author":"T. Borkovec","year":"1993","unstructured":"Borkovec, T. (1993). Between-group therapy outcome research: Design and methodology. NIDA Research Monographs, 137, 249-289.","journal-title":"NIDA Research Monographs"},{"key":"466137_CR8","volume-title":"Experimental and quasi-experimental designs for research","author":"D. Campbell","year":"1966","unstructured":"Campbell, D., & Stanley, J. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally."},{"key":"466137_CR9","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1037\/0022-006X.66.2.290","volume":"66","author":"K. Carroll","year":"1998","unstructured":"Carroll, K., Connors, G., Cooney, N., DiClemente, C., Donovan, D., Kadden, R., Longabaugh, R., Rounsaville, B., Wirtz, P., & Zweben, A. (1998). Internal validity of project MATCH treatments: Discriminability and integrity. Journal of Consulting and Clinical Psychology, 66, 290-303.","journal-title":"Journal of Consulting and Clinical Psychology"},{"key":"466137_CR10","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/S0376-8716(99)00049-6","volume":"57","author":"K. Carroll","year":"2000","unstructured":"Carroll, K., Nich, C., Sifry, R., Nuro, K., Frankforter, T., Ball, S., Fenton, L., & Rounsaville, B. (2000). A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug and Alcohol Dependence, 57, 225-238.","journal-title":"Drug and Alcohol Dependence"},{"issue":"12","key":"466137_CR11","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1001\/archpsyc.1994.03950120061010","volume":"51","author":"K. M. Carroll","year":"1994","unstructured":"Carroll, K. M., Rounsaville, B. J., Nich, C., Gordon, L. T., Wirtz, P. W., & Gawin, F. (1994). One-year follow-up of psychotherapy and pharmacotherapy for cocaine dependence: delayed emergence of psychotherapy effects. Archives of General Psychiatry, 51(12), 989-997.","journal-title":"Archives of General Psychiatry"},{"key":"466137_CR12","volume-title":"Statistical power analysis for the behavioral sciences","author":"J. Cohen","year":"1977","unstructured":"Cohen, J. (1977). Statistical power analysis for the behavioral sciences. (revised edition ed.). New York: Academic Press.","edition":"revised edition"},{"issue":"3","key":"466137_CR13","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/0376-8716(96)01254-9","volume":"41","author":"L. Cottler","year":"1996","unstructured":"Cottler, L., Compton, W. M., Ben-Abdallah, A., Horne, M., Claverie, D. (1996). Achieving a 96.6% completer rate among substance abusers. Drug and Alcohol Dependence. 41(3): 209-217.","journal-title":"Drug and Alcohol Dependence"},{"key":"466137_CR14","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1080\/10503309112331335511","volume":"1","author":"P. Crits-Christoph","year":"1991","unstructured":"Crits-Christoph, P. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81-91.","journal-title":"Psychotherapy Research"},{"key":"466137_CR15","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1001\/archpsyc.1997.01830200053007","volume":"54","author":"P. Crits-Christoph","year":"1997","unstructured":"Crits-Christoph, P., Siqueland, L., Blaine, J., Frank, A., Luborsky, L., Onken, L., Muenz, L., Thase, M., Weiss, R., Gastfriend, D., Woody, G., Barber, J., Butler, S., Daley, D., Bishop, S., Najavits, L. M., Lis, J., Mercer, D., Griffin, M., Beck, A. T., & Moras, K. (1997). The NIDA Cocaine Collaborative Treatment Study: Rationale and methods. Archives of General Psychology, 54, 721-726.","journal-title":"Archives of General Psychology"},{"key":"466137_CR16","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1037\/0022-006X.66.3.484","volume":"66","author":"P. Crits-Christoph","year":"1998","unstructured":"Crits-Christoph, P., Siqueland, L., Chittams, J., Barber, J. P., Beck, A. T., Liese, B. S., Luborsky, L., Mark, D., Mercer, D., Woody, G., Onken, L. S., Frank, A., Thase, M., & Najavits, L. M. (1998). Training in cognitive therapy, supportive-expressive therapy, and drug counseling treatment for cocaine dependence: Results from the NIDA Cocaine Collaborative Treatment Study. Journal of Consulting and Clinical Psychology, 66, 484-492.","journal-title":"Journal of Consulting and Clinical Psychology"},{"key":"466137_CR17","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/S0005-7894(98)80042-7","volume":"29","author":"G. Devilly","year":"1998","unstructured":"Devilly, G., Spence, S., & Rapee, R. (1998). Statistical and reliable change with eye movement desensitization and reprocessing: Treating trauma within a veteran population. Behavior Therapy, 29, 435-455.","journal-title":"Behavior Therapy"},{"key":"466137_CR18","first-page":"190","volume-title":"Handbook of Psychotherapy and Behavior Change","author":"S. Garfield","year":"1994","unstructured":"Garfield, S. (1994). Research on client variables in psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of Psychotherapy and Behavior Change (4th ed., pp. 190-228). New York: John Wiley & Sons, Inc.","edition":"4th ed."},{"key":"466137_CR19","volume-title":"Handbook of Psychotherapy and Behavior Change","author":"S. Garfield","year":"1994","unstructured":"Garfield, S., & Bergin, A. (1994a). Handbook of Psychotherapy and Behavior Change. New York: John Wiley & Sons, Inc."},{"key":"466137_CR20","first-page":"3","volume-title":"Handbook of Psychotherapy and Behavior Change","author":"S. Garfield","year":"1994","unstructured":"Garfield, S., & Bergin, A. (1994b). Introduction and historical overview. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of Psychotherapy and Behavior Change (4th ed., pp. 3-18). New York: John Wiley & Sons, Inc.","edition":"4th ed."},{"key":"466137_CR21","volume-title":"Health care plan design and cost trends\u20141988 through 1998","author":"Hay Group","year":"1999","unstructured":"Hay Group (1999). Health care plan design and cost trends\u20141988 through 1998. Arlington, VA: National Association of Psychiatric Health Systems and Association of Behavioral Group Practices."},{"key":"466137_CR22","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1001\/archpsyc.1994.03950070060011","volume":"51","author":"S. T. Higgins","year":"1994","unstructured":"Higgins, S. T., Budney, A J., Bickel, W. K., Foerg, F. E., Donham, R., & Badger, G. J. (1994). Incentives improve outcome in outpatient behavioral treatment of cocaine dependence, Archives of General Psychiatry, 51, 568-576.","journal-title":"Archives of General Psychiatry"},{"key":"466137_CR23","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1023\/A:1023005115932","volume":"15","author":"D. Korn","year":"1999","unstructured":"Korn, D., & Shaffer, H. (1999). Gambling and the health of the public: Adopting a public health perspective. Journal of Gambling Studies, 15, 289-365.","journal-title":"Journal of Gambling Studies"},{"key":"466137_CR24","first-page":"72","volume-title":"Handbook of Psychotherapy and Behavior Change","author":"M. J. Lambert","year":"1994","unstructured":"Lambert, M. J., & Hill, C. E. (1994). Assessing psychotherapy outcomes and processes. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of Psychotherapy and Behavior Change (4 ed., pp. 72-113). New York: John Wiley & Sons, Inc.","edition":"4 ed."},{"key":"466137_CR25","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1037\/10341-015","volume-title":"Drug abuse: Origins & interventions","author":"M. Linehan","year":"1999","unstructured":"Linehan, M. (1999). Development, evaluation, and dissemination of effective psychosocial treatments: Levels of disorder, stages of care, and stages of treatment research. In M. Glantz & C. Hartel (Eds.), Drug abuse: Origins & interventions (pp. 367-394). Washington, DC: American Psychological Association."},{"key":"466137_CR26","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1080\/105504999305686","volume":"8","author":"M. M. Linehan","year":"1999","unstructured":"Linehan, M. M., Schmidt, H., Dimeff, L. A., Craft, J. C., Kanter, J., & Comtois, K. A. (1999). Dialectical behavior therapy for patients with borderline personality disorder and drug-dependence. American Journal on Addictions, 8, 279-292.","journal-title":"American Journal on Addictions"},{"key":"466137_CR27","first-page":"260","volume":"6","author":"L. Luborsky","year":"1996","unstructured":"Luborsky, L., Barber, J. P., Siqueland, L., Johnson, S., Najavits, L. M., Frank, A., & Daley, D. (1996). The revised Helping Alliance questionnaire (HAq-II): Psychometric properties. Journal of Psychotherapy Practice and Research, 6, 260-271.","journal-title":"Journal of Psychotherapy Practice and Research"},{"key":"466137_CR28","unstructured":"Luborsky, L., & Diguer, L. (June, 1993). A \u2018wild card\u2019 in comparative psychotherapy studies\u2014The researcher's therapeutic alliance. Paper presented at the Paper presented at the annual meeting of the Society for Psychotherapy Research, Pittsburgh PA."},{"issue":"6","key":"466137_CR29","doi-asserted-by":"crossref","first-page":"1526","DOI":"10.1037\/0022-006X.46.6.1526","volume":"46","author":"C. Martindale","year":"1978","unstructured":"Martindale, C. (1978). The therapist-as-fixed-effect fallacy in psychotherapy research. Journal of Consulting and Clinical Psychology, 46(6), 1526-1530.","journal-title":"Journal of Consulting and Clinical Psychology"},{"key":"466137_CR30","doi-asserted-by":"crossref","unstructured":"McLellan, A. T. (1989). Treatment Services Review. Unpublished measure, University of Pennsylvania.","DOI":"10.1037\/t04617-000"},{"key":"466137_CR31","first-page":"1","volume":"2","author":"D. C. Mohr","year":"1995","unstructured":"Mohr, D. C. (1995). Negative outcome in psychotherapy: A critical review. Clinical Psychology: Science and Practice, 2, 1-24.","journal-title":"Clinical Psychology: Science and Practice"},{"key":"466137_CR32","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1080\/713663887","volume":"11","author":"L. M. Najavits","year":"2001","unstructured":"Najavits, L. M. (2001). Early career award paper: Helping difficult patients. Psychotherapy Research, 11, 131-152.","journal-title":"Psychotherapy Research"},{"key":"466137_CR33","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.3109\/10826080009148253","volume":"35","author":"L. M. Najavits","year":"2000","unstructured":"Najavits, L. M., Crits-Christoph, P., & Dierberger, A. E. (2000). Clinicians' impact on substance abuse treatment. Substance Use and Misuse, 35, 2161-2190.","journal-title":"Substance Use and Misuse"},{"key":"466137_CR34","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1037\/0033-3204.32.4.669","volume":"32","author":"L. M. Najavits","year":"1995","unstructured":"Najavits, L. M., Griffin, M. L., Luborsky, L., Frank, A., Weiss, R. D., Liese, B. S., Thompson, H., Nakayama, E., Siqueland, L., Daley, D., & Simon Onken, L. (1995). Therapists' emotional reactions to substance abusers: A new questionnaire and initial findings. Psychotherapy, 32, 669-677.","journal-title":"Psychotherapy"},{"key":"466137_CR35","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1037\/0033-3204.31.1.114","volume":"31","author":"L. M. Najavits","year":"1994","unstructured":"Najavits, L. M., & Strupp, H. H. (1994). Differences in the effectiveness of psychodynamic therapists: A process-outcome study. Psychotherapy, 31, 114-123.","journal-title":"Psychotherapy"},{"key":"466137_CR36","doi-asserted-by":"crossref","first-page":"84","DOI":"10.3109\/10673229409017121","volume":"2","author":"L. M. Najavits","year":"1994","unstructured":"Najavits, L. M., & Weiss, R. D. (1994a). The role of psychotherapy in the treatment of substance use disorders. Harvard Review of Psychiatry, 2, 84-96.","journal-title":"Harvard Review of Psychiatry"},{"key":"466137_CR37","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1111\/j.1360-0443.1994.tb00954.x","volume":"89","author":"L. M. Najavits","year":"1994","unstructured":"Najavits, L. M., & Weiss, R. D. (1994b). Variations in therapist effectiveness in the treatment of patients with substance use disorders: An empirical review. Addiction, 89, 679-688.","journal-title":"Addiction"},{"key":"466137_CR38","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1037\/0735-7028.31.4.404","volume":"31","author":"L. M. Najavits","year":"2000","unstructured":"Najavits, L. M., Weiss, R. D., Shaw, S. R., & Dierberger, A. E. (2000). Psychotherapists' views of treatment manuals. Professional Psychology: Research and Practice, 31, 404-408.","journal-title":"Professional Psychology: Research and Practice"},{"key":"466137_CR39","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1023\/A:1024496427434","volume":"11","author":"L. M. Najavits","year":"1998","unstructured":"Najavits, L. M., Weiss, R. D., Shaw, S. R., & Muenz, L. R. (1998). \u201cSeeking Safety\u201d: Outcome of a new cognitive-behavioral psychotherapy for women with posttraumatic stress disorder and substance dependence. Journal of Traumatic Stress, 11, 437-456.","journal-title":"Journal of Traumatic Stress"},{"key":"466137_CR40","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1001\/archpsyc.1981.01780290015001","volume":"38","author":"L.N. Robins","year":"1981","unstructured":"Robins, L.N., Helzer, J.E., Croughan, J., & Ratcliff, K.S. (1981). National Institute of Mental Health Diagnostic Interview Schedule. Archives of General Psychiatry, 38, 381-389.","journal-title":"Archives of General Psychiatry"},{"key":"466137_CR41","first-page":"133","volume":"8","author":"B. Rousanville","year":"2001","unstructured":"Rousanville, B., Carroll, K., & Onken, L. (2001). A stage model of behavioral therapies research: Getting started and moving on from stage I. Clinical Psychology: Science and Practice, 8, 133-142.","journal-title":"Clinical Psychology: Science and Practice"},{"key":"466137_CR42","unstructured":"Rush, J., Gullion, C., & Prien, R. (1996). A curbstone consult to applicants for National Institute of Mental Health grant support. Psychopharmacology Bulletin, 32."},{"key":"466137_CR43","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1093\/ptr\/8.3.287","volume":"8","author":"L. Siqueland","year":"1998","unstructured":"Siqueland, L., Frank, A., Gastfriend, D., Muenz, L., Crits-Christoph, P., Chittams, J., Thase, M., Mercer, D., & Blaine, J. (1998). The protocol deviation patient: Characterization and implications for clinical trials research. Psychotherapy Research, 8, 287-306.","journal-title":"Psychotherapy Research"},{"key":"466137_CR44","volume-title":"Structured Clinical Interview for DSM-IV-Patient Version","author":"R. L. Spitzer","year":"1997","unstructured":"Spitzer, R. L., Williams, J. B. W., & Gibbon, M. (1997). Structured Clinical Interview for DSM-IV-Patient Version. New York: Biometrics Research Institute."},{"key":"466137_CR45","doi-asserted-by":"crossref","first-page":"361","DOI":"10.4088\/JCP.v61n0507","volume":"61","author":"R. D. Weiss","year":"2000","unstructured":"Weiss, R. D., Griffin, M., Greenfield, S., Najavits, L. M., Wyner, D., Soto, J., & Hennen, A. (2000). Group therapy for patients with bipolar disorder and substance dependence: Results of a pilot study. Journal of Clinical Psychiatry, 61, 361-367.","journal-title":"Journal of Clinical Psychiatry"},{"key":"466137_CR46","first-page":"291","volume-title":"Clinical Textbook of Addictive Disorders","author":"R. D. Weiss","year":"1998","unstructured":"Weiss, R. D., Najavits, L. M., & Mirin, S. M. (1998). Substance abuse and psychiatric disorders. In R. J. Frances & S. I. Miller (Eds.), Clinical Textbook of Addictive Disorders (2nd ed., pp. 291-318). New York: Guilford.","edition":"2nd ed."},{"key":"466137_CR47","first-page":"28","volume":"9","author":"C. Zlotnick","year":"1996","unstructured":"Zlotnick, C. (1996). Therapists' differences in experience. Professional Psychology, 9, 28-34.","journal-title":"Professional Psychology"},{"volume-title":"Strategies for Facilitating Protocol Compliance in Alcoholism Treatment Research","year":"1998","key":"466137_CR48","unstructured":"Zweben, A., Barrett, D., Carty, K., McRee, B., Morse, P., & Rice, C. (Eds.). (1998). Strategies for Facilitating Protocol Compliance in Alcoholism Treatment Research. (Vol. 7). Bethesda, MD: U.S. Department of Health and Human Services."}],"container-title":["Journal of Gambling Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1023\/A:1024211605799.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1023\/A:1024211605799\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1023\/A:1024211605799.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T11:13:05Z","timestamp":1751368385000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1023\/A:1024211605799"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,9]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2003,9]]}},"alternative-id":["466137"],"URL":"https:\/\/doi.org\/10.1023\/a:1024211605799","relation":{},"ISSN":["1050-5350","1573-3602"],"issn-type":[{"type":"print","value":"1050-5350"},{"type":"electronic","value":"1573-3602"}],"subject":[],"published":{"date-parts":[[2003,9]]}}}