The use of propensity score methods in psychotherapy research: A practical application

Psychotherapy and Psychosomatics

Volumn 78, Issue 1, 2008, Pages 26-34

  Bartak, Anna ^a,b   Spreeuwenberg, Marieke D ^c,d   Andrea, Helene ^a,e   Busschbach, Jan J V ^a,e   Croon, Marcel A ^d   Verheul, Roel ^a,b,f   Emmelkamp, Paul M G ^b   Stijnen, Theo ^g  

^a Viersprong Institute for Studies on Personality Disorders VISPD   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^d TILBURG UNIVERSITY   (Netherlands)

^e ERASMUS MEDICAL CENTER   (Netherlands)

^f NETHERLANDS INSTITUTE OF MENTAL HEALTH AND ADDICTION   (Netherlands)

^g LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

Psychotherapy; Quasi experiment; Randomized controlled trials, selection bias; Research design, propensity score

Indexed keywords

ADULT; ARTICLE; CLINICAL RESEARCH; CONTROLLED STUDY; COST EFFECTIVENESS ANALYSIS; FEMALE; HUMAN; INTERMETHOD COMPARISON; LONG TERM CARE; MAJOR CLINICAL STUDY; MALE; NETHERLANDS; PERSONALITY DISORDER; PRIORITY JOURNAL; PROPENSITY SCORE; PSYCHOTHERAPY; REGRESSION ANALYSIS; SCORING SYSTEM; SHORT COURSE THERAPY; TREATMENT DURATION; TREATMENT OUTCOME;

ADULT; COST-BENEFIT ANALYSIS; FEASIBILITY STUDIES; FEMALE; HUMANS; MALE; PERSONALITY DISORDERS; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIALS AS TOPIC; TIME FACTORS;

EID: 53549127264     PISSN: 00333190     EISSN: None     Source Type: Journal    
DOI: 10.1159/000162298     Document Type: Article

References (58)

1. Amberson JB, McMahon BT, Pinner M: A clinical trial of sancrosyn in pulmonary tuberculosis. Am Rev Tuberc 1931;24:401-435.
2. Rubin DB: Estimating causal effects from large data sets using propensity scores. Ann Intern Med 1997;127:757-763.
3. Black N: Why we need observational studies to evaluate the effectiveness of health care. BMJ 1996;312:1215-1218.
4. Westen D, Novotny CM, Thompson-Brenner H: The empirical status of empirically supported psychotherapies: assumptions, findings, and reporting in controlled clinical trials. Psychol Bull 2004;130:631-663.
5. Leichsenring F: Randomized controlled versus naturalistic studies: a new research agenda. Bull Menninger Clin 2004;68:137-151.
6. Castonguay LG, Beutler LE: Principles of Therapeutic Change That Work. New York, Oxford University Press, 2006.
7. de Maat S, Dekker J, Schoevers R, de Jonghe F: The effectiveness of long-term psychotherapy: methodological research issues. Psychother Res 2007;17:59-65.
8. Brewin CR, Bradley C: Patient preferences and randomized clinical trials. BMJ 1989;299:313-315.
9. Forstmeier S, Rueddel H: Improving volitional competence is crucial for the efficacy of psychosomatic therapy: a controlled clinical trial. Psychother Psychosom 2007;76:89-96.
10. Chiesa M, Fonagy P: Prediction of medium-term outcome in cluster B personality disorder following residential and outpatient psychosocial treatment. Psychother Psychosom 2007;76:347-353.
11. Shadish WR, Cook TD, Campbell DT: Experimental and Quasiexperimental Designs for Generalized Causal Inference. Boston, Houghton Mifflin, 2002.
12. Rosenbaum PR: Observational Studies, ed 2. New York, Springer Publishing, 2002.
13. Rosenbaum PR, Rubin DB: Reducing bias in observational studies using subclassification on the propensity score. J Am Stat Assoc 1984;79:516-524.
14. Frangakis CE, Rubin DB: Principal stratification in causal inference. Biometrics 2002;58:21-29.
15. Rubin DB, Thomas N: Matching using estimated propensity scores: relating theory to practice. Biometrics 1996;52:249-264.
16. Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika 1983;70:41-55.
17. Connors AF Jr, Speroff T, Dawson NV, Thomas C, Harrell FE Jr, Wagner D, Desbiens N, Goldman L, Wu AW, Califf RM, Fulkerson WJ Jr, Vidaillet H, Broste S, Bellamy P, Lynn J, Knaus WA: The effectiveness of right heart catheterization in the initial care of critically ill patients. Support investigators. JAMA 1996;276:889-897.
18. Lieberman E, Lang JM, Cohen A, D'Agostino R Jr, Datta S, Frigoletto FD Jr: Association of epidural analgesia with cesarean delivery in nulliparas. Obstet Gynecol 1996;88:993-1000.
19. Lytle BW, Blackstone EH, Loop FD, Houghtaling PL, Arnold JH, Akhrass R, McCarthy PM, Cosgrove DM: Two internal thoracic artery grafts are better than one. J Thorac Cardiovasc Surg 1999;117:855-872.
20. Potosky AL, Legler J, Albertsen PC, Stanford JL, Gilliland FD, Hamilton AS, Eley JW, Stephenson RA, Harlan LC: Health outcomes after prostatectomy or radiotherapy for prostate cancer: results from the prostate cancer outcomes study. J Natl Cancer Inst 2000;92:1582-1592.
21. Stenestrand U, Wallentin L: Early statin treatment following acute myocardial infarction and 1-year survival. JAMA 2001;285:430-436.
22. Chan AW, Bhatt DL, Chew DP, Quinn MJ, Moliterno DJ, Topol EJ, Ellis SG: Early and sustained survival benefit associated with statin therapy at the time of percutaneous coronary intervention. Circulation 2002;105:691-696.
23. Mehta RL, Pascual MT, Soroko S, Chertow GM: Diuretics, mortality, and nonrecovery of renal function in acute renal failure. JAMA 2002;288:2547-2553.
24. Wolfe F, Michaud K: Heart failure in rheumatoid arthritis: rates, predictors, and the effect of anti-tumor necrosis factor therapy. Am J Med 2004;116:305-311.
25. Gibson C: Privileging the participant: the importance of sub-group analysis in social welfare evaluations. Am J Eval 2003;24:443-469.
26. Yoshikawa H, Magnuson KA, Bos JM, Hsueh J: Effects of earnings supplement policies on adult economic and middle-childhood outcomes differ for the 'hardest to employ'. Child Dev 2003;74:1500-1521.
27. Leow C, Marcus S, Zanutto E, Boruch R: Effects of advanced course-taking on math and science achievement: addressing selection bias using propensity scores. Am J Eval 2004;25:461-478.
28. Guo S, Barth R, Gibbons C: Propensity score matching strategies for evaluating substance abuse services for child welfare clients. Child Youth Serv Rev 2006;28:357-383.
29. Lechner M: Earnings and employment effects of continuous off-the-job training in East Germany after unification. J Bus Econ Statist 1999;17:74-90.
30. Jalan J, Ravallion M: Estimating the benefit incidence of an antipoverty program by propensity-score matching. J Bus Econ Statist 2003;21:19-30.
31. Dranove D, Lindrooth R: Hospital consolidation and costs: another look at the evidence. J Health Econ 2003;22:983-997.
32. Jung SH, Chow SC, Chi EM: A note on sample size calculation based on propensity analysis in nonrandomized trials. J Biopharm Stat 2007;17:35-41, discussion 43.
33. Kachele H, Kordy H, Richard M: Therapy amount and outcome of inpatient psychodynamic treatment of eating disorders in Germany: data from a multicenter study. Psychother Res 2001;11:239-257.
34. Robinson WL, Harper GW, Schoeny ME: Reducing substance use among African American adolescents: effectiveness of school-based health centers. Clin Psychol Sci Pract 2003;10:491-504.
35. Hill JL, Waldfogel J, Brooks-Gunn J, Han WJ: Maternal employment and child development: a fresh look using newer methods. Dev Psychol 2005;41:833-850.
36. Golkaramnay V, Bauer S, Haug S, Wolf M, Kordy H: The exploration of the effectiveness of group therapy through an internet chat as aftercare: a controlled naturalistic study. Psychother Psychosom 2007;76:219-225.
37. Viersprong Institute for Studies on Personality Disorders: SCEPTRE study on cost-effectiveness of personality disorder treatment. http://www.vispd.nl/ projects.htm#Sceptre.
38. Arrindell WA, Ettema JHM: SCL-90-R: Herziene Handleiding bij een Multidimensionele Psychopathologie-Indicator. Lisse, Swets & Zeitlinger, 2003.
39. Derogatis LR: SCL-90 (R): Administration, Scoring, and Procedures Manual I for the Revised Version. Baltimore, Johns Hopkins University School of Medicine, Clinical Psychometrics Research Unit, 1977.
40. Derogatis LR: SCL-90-R: Administration, Scoring and Procedure. Manual II for the Revised Version. Townson, Clinical Psychometric Research, 1986.
41. van Kampen D: The DAPP-BQ in The Netherlands: factor structure and relationship with basic personality dimensions. J Personal Disord 2002;16:235-254.
42. Livesley WJ, Jackson DN: Manual for the Dimensional Assessment of Personality Pathology-Basic Questionnaire (DAPP-BQ). Port Huron, Sigma Press, 2002.
43. Lambert MJ, Burlingame GM, Umphress V, Hansen NB, Vermeersch DA, Clouse GC, Yanchar SC: The reliability and validity of the outcome questionnaire. Clin Psychol Psychother 1996;3:249-258.
44. Brooks R, Rabin R, de Charro F: The Measurement and Valuation of Health Status Using EQ-5D: A European Perspective. Evidence from the EuroQoL Biomed Research Programme. Dordrecht, Kluwer Academic Publishers, 2003.
45. Pfohl B, Blum N, Zimmerman M: Structured Interview for DSM-IV Personality (SIDPIV). Washington, American Psychiatric Press, 1997.
46. DeJong CA, Van den Brink W, Harteveld FM, Van der Wielen E: Personality disorders in alcoholics and drug addicts. Compr Psychiatry 1993;34:87-94.
47. DeJong CAJ, Derks FCH, Van Oel CJ, Rinne T: Gestructureerd Interview voor de DSMIV Persoonlijkheidsstoornissen (SIDP-IV). Sint Oedenrode, Stichting Verslavingszorg Oost Brabant, 1996.
48. Andrea H, Verheul R, Berghout CC, Dolan C, Van der Kroft PJA, Busschbach JJV, Bateman AW, Fonagy P: Measuring the core components of maladaptive personality: severity indices of personality problems (SIPP-118). Report of the Viersprong Institute for Studies on Personality Disorders (VISPD) in cooperation with the department of Medical Psychology & Psychotherapy, Erasmus University Rotterdam, The Netherlands, 2007. http://hdl.handle.net/1765/10066.
49. Verheul R, Andrea H, Berghout CC, Dolan C, Busschbach JJV, Van der Kroft PJA, Bateman AW, Fonagy P: Severity Indices of Personality Problems (SIPP-118): development, factor structure, reliability and validity. Psychol Assess 2008;20:23-34.
50. van Beek N, Verheul R: Motivation for treatment in patients with personality disorders. J Personal Disord 2008;22:89-100.
51. Cochran WG: The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics 1968;24:295-313.
52. Quade D: Nonparametric analysis of covariance by matching. Biometrics 1982;38:597-611.
53. Yue LQ: Statistical and regulatory issues with the application of propensity score analysis to nonrandomized medical device clinical studies. J Biopharm Stat 2007;17:1-13, discussion 15-17, 19-21, 23-27 passim.
54. McKee M, Britton A, Black N, McPherson K, Sanderson C, Bain C: Methods in health services research. Interpreting the evidence: choosing between randomised and non-randomised studies. BMJ 1999;319:312-315.
55. Benson K, Hartz AJ: A comparison of observational studies and randomized, controlled trials. N Engl J Med 2000;342:1878-1886.
56. Concato J, Shah N, Horwitz RI: Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000;342:1887-1892.
57. Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Sturmer T: Variable selection for propensity score models. Am J Epidemiol 2006;163:1149-1156.
58. Austin PC, Grootendorst P, Anderson GM: A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Stat Med 2007;26:734-753.