Preference in random assignment: Implications for the interpretation of randomized trials

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 36, Issue 5, 2009, Pages 331-342

  MacIas, Cathaleene ^a   Gold, Paul B ^b   Hargreaves, William A ^c   Aronson, Elliot ^d   Bickman, Leonard ^e   Barreira, Paul J ^f   Jones, Danson R ^g   Rodican, Charles F ^a   Fisher, William H ^h  

^a MCLEAN HOSPITAL   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e VANDERBILT UNIVERSITY   (United States)

^f HARVARD UNIVERSITY   (United States)

^g Wharton County Junior College   (United States)

^h UNIVERSITY OF MASSACHUSETTS MEDICAL SCHOOL   (United States)

Author keywords

Evidence based practice; Program evaluation; Randomized controlled trial; Research design; Supported employment

Indexed keywords

EMPLOYMENT; EVIDENCE BASED PRACTICE; MENTAL HEALTH SERVICE; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL; REVIEW; ARTICLE; CONSUMER; HEALTH SERVICES RESEARCH; HUMAN; ORGANIZATION AND MANAGEMENT; PATIENT; RANDOMIZATION;

CONSUMER SATISFACTION; HEALTH SERVICES RESEARCH; HUMANS; PATIENT DROPOUTS; RANDOM ALLOCATION; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 70349762099     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-009-0224-0     Document Type: Review

References (96)

1. Abelson, R. P. (1995). Statistics as principled argument. Hillsdale, NJ: Lawrence Erlbaum.
2. JG Adair RCL Lindsay J Carlopio 1983 Social artifact research and ethical regulation: Their impact on the teaching of experimental methods Teaching of Psychology 10 159 162 10.1207/s15328023top1003-10 11650670 10.1207/ s15328023top1003-10
3. Aguinis, H. (2004). Regression analysis for categorical moderators. New York: Guilford Press.
4. Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
5. H Alverson M Alverson RE Drake DR Becker 1998 Social correlates of competitive employment among people with severe mental illness Psychosocial Rehabilitation Journal 22 1 34 40
6. M Alverson DR Becker RE Drake 1995 An ethnographic study of coping strategies used by people with severe mental illness participating in supported employment Psychosocial Rehabilitation Journal 18 4 115 127
7. E Aronson 1999 The power of self-persuasion The American Psychologist 54 11 873 875 10.1037/h0088188 10.1037/h0088188
8. Beveridge, W. I. B. (1950). The art of scientific investigation. New York: Vintage Books.
9. Bickman, L. (1987). The functions of program theory. In L. Bickman (Ed.), Using program theory in evaluation. San Francisco: Jossey-Bass.
10. L Bickman 2002 The death of treatment as usual: An excellent first step on a long road Clinical Psychology: Science and Practice 9 2 195 199 10.1093/clipsy/9.2.195 10.1093/clipsy/9.2.195 (Pubitemid 41294384)
11. GR Bond DR Becker RE Drake C Rapp N Meisler AF Lehman 2001 Implementing supported employment as an evidence-based practice Psychiatric Services 52 3 313 322 10.1176/appi.ps.52.3.313 11239097 10.1176/appi.ps.52.3.313 1:STN:280:DC%2BD3M3lvFWgtA%3D%3D (Pubitemid 32259663)
12. GR Bond DR Becker RE Drake K Vogler 1997 A fidelity scale for the individual placement and support model of supported employment Rehabilitation Counseling Bulletin 40 4 265 284
13. GR Bond K Campbell LJ Evans R Gervey A Pascaris S Tice, et al. 2002 A scale to measure quality of supported employment for persons with severe mental illness Journal of Vocational Rehabilitation 17 4 239 250
14. GR Bond R Drake D Becker 2008 An update on randomized controlled trials of evidence-based supported employment Psychiatric Rehabilitation Journal 31 4 280 290 10.2975/31.4.2008.280.290 18407876 10.2975/31.4.2008.280.290 (Pubitemid 351579863)
15. GR Bond RE Drake KT Mueser DR Becker 1997 An update on supported employment for people with severe mental illness Psychiatric Services 48 3 335 346 9057235 1:STN:280:DyaK2s3htVSlsg%3D%3D
16. GR Bond GH McHugo D Becker CA Rapp R Whitley 2008 Fidelity of supported employment: Lessons learned from the national evidence-based practice project Psychiatric Rehabilitation Journal 31 4 300 305 10.2975/31.4.2008.300.305 18407879 10.2975/31.4.2008.300.305 (Pubitemid 351579866)
17. GR Bond MP Salyers RL Roudebush J Dincin RE Drake DR Becker, et al. 2007 A randomized controlled trial comparing two vocational models for persons with severe mental illness Journal of Consulting and Clinical Psychology 75 6 968 982 10.1037/0022-006X.75.6.968 18085913 10.1037/0022-006X.75.6.968
18. GR Bond K Vogler SG Resnick L Evans R Drake D Becker 2001 Dimensions of supported employment: Factor structure of the IPS fidelity scale Journal of Mental Health 10 4 383 393 10.1080/09638230120041146 10.1080/09638230120041146
19. SL Braver MC Smith 1996 Maximizing both external and internal validity in longitudinal true experiments with voluntary treatments: The 'combined modified' design Evaluation and Program Planning 19 287 300 10.1016/S0149- 7189(96)00029-8 10.1016/S0149-7189(96)00029-8 (Pubitemid 126403436)
20. TG Brown P Seraganian J Tremblay H Annis 2002 Matching substance abuse aftercare treatments to client characteristics Addictive Behaviors 27 585 604 10.1016/S0306-4603(01)00195-2 12188594 10.1016/S0306-4603(01)00195-2 (Pubitemid 34763818)
21. T Burns J Catty T Becker RE Drake A Fioritti M Knapp, et al. 2007 The effectiveness of supported employment for people with severe mental illness: A randomised controlled trial Lancet 370 1146 1152 10.1016/S0140-6736(07)61516-5 17905167 10.1016/S0140-6736(07)61516-5 (Pubitemid 47464585)
22. R Calsyn J Winter G Morse 2000 Do consumers who have a choice of treatment have better outcomes? Community Mental Health Journal 36 2 149 160 10.1023/A:1001890210218 10800864 10.1023/A:1001890210218 1:STN:280: DC%2BD3c3lvVyjsA%3D%3D (Pubitemid 30225365)
23. DT Campbell DW Fiske 1959 Convergent and discriminant validation by the multitrait-multimethod matrix Psychological Bulletin 56 81 105 10.1037/h0046016 13634291 10.1037/h0046016 1:STN:280:DyaG1M%2FmtlyqsA%3D%3D
24. ME Collins C Mowbray D Bybee 2000 Characteristics predicting successful outcomes of participants with severe mental illness in supported education Psychiatric Services 51 6 774 780 10.1176/appi.ps.51.6.774 10828109 10.1176/appi.ps.51.6.774 1:STN:280:DC%2BD3czpt1KgsQ%3D%3D (Pubitemid 30354231)
25. JA Cook 1999 Understanding the failure of vocational rehabilitation: What do we need to know and how can we learn it? Journal of Disability Policy Studies 10 1 127 132
26. Cook, T. D. (1999b). Considering the major arguments against random assignment: An analysis of the intellectual culture surrounding evaluation in American schools of education. Paper presented at the Harvard Faculty Seminar on Experiments in Education, Cambridge, MA.
27. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin.
28. JA Cook MA Carey L Razzano J Burke CR Blyler 2002 The pioneer: The employment intervention demonstration program New Directions for Evaluation 94 31 44 10.1002/ev.49 10.1002/ev.49
29. PW Corrigan MS Salzer 2003 The conflict between random assignment and treatment preference: Implications for internal validity Evaluation and Program Planning 26 109 121 10.1016/S0149-7189(03)00014-4 10.1016/S0149-7189(03)00014-4 (Pubitemid 36509149)
30. RE Crowther M Marshall GR Bond P Huxley 2001 Helping people with severe mental illness to obtain work: Systematic review BMJ: British Medical Journal 322 7280 204 208 10.1136/bmj.322.7280.204 11159616 10.1136/bmj.322.7280.204 1:STN:280:DC%2BD3M7ktF2qtw%3D%3D
31. KL Delucchi A Bostrom 2004 Methods for analysis of skewed data distributions in psychiatric clinical studies: Working with many zero values The American Journal of Psychiatry 161 7 1159 1168 10.1176/appi.ajp.161.7.1159 15229044 10.1176/appi.ajp.161.7.1159 (Pubitemid 38859163)
32. RE Drake DR Becker WA Anthony 1994 A research induction group for clients entering a mental health services research project Hospital & Community Psychiatry 45 5 487 489 1:STN:280:DyaK2czitV2gsw%3D%3D
33. RE Drake D Becker GR Bond 2003 Recent research on vocational rehabilitation for persons with severe mental illness Current Opinion in Psychiatry 16 451 455 10.1097/00001504-200307000-00012 10.1097/00001504- 200307000-00012 (Pubitemid 36928491)
34. RE Drake GJ McHugo RR Bebout DR Becher M Harris GR Bond, et al. 1999 A randomized clinical trial of supported employment for inner-city patients with severe mental disorders Archives of General Psychiatry 56 627 633 10.1001/archpsyc.56.7.627 10401508 10.1001/archpsyc.56.7.627 1:STN:280:DyaK1MzivFOmsw%3D%3D (Pubitemid 29315634)
35. RE Drake GJ McHugo D Becker WA Anthony RE Clark 1996 The new Hampshire study of supported employment for people with severe mental illness Journal of Consulting and Clinical Psychology 64 2 391 399 10.1037/0022-006X.64.2.391 8871423 10.1037/0022-006X.64.2.391 1:STN:280:DyaK2s%2FisFajsg%3D%3D (Pubitemid 26131635)
36. SM Essock R Drake RG Frank TG McGuire 2003 Randomized controlled trials in evidence-based mental health care: Getting the right answer to the right question Schizophrenia Bulletin 29 1 115 123 12908666
37. Festinger, L. (1957). A theory of cognitive dissonance. Stanford, CA: Stanford University Press.
38. PB Gold N Meisler AB Santos MA Carnemolla OH Williams J Keleher 2006 Randomized trial of supported employment integrated with assertive community treatment for rural adults with severe mental illness Schizophrenia Bulletin 32 2 378 395 10.1093/schbul/sbi056 16177278 10.1093/schbul/sbi056
39. CM Grilo R Money DH Barlow AW Goddard JM Gorman SG Hofmann, et al. 1998 Pretreatment patient factors predicting attrition from a multicenter randomized controlled treatment study for panic disorder Comprehensive Psychiatry 39 6 323 332 10.1016/S0010-440X(98)90043-8 9829138 10.1016/S0010-440X(98)90043-8 1:STN:280:DyaK1M%2Fks1Gkug%3D%3D
40. SD Halpern 2002 Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials Controlled Clinical Trials 23 274 288 10.1016/S0197-2456(02)00191-5 12057879 10.1016/S0197-2456(02) 00191-5 (Pubitemid 34621208)
41. SG Hofmann DH Barlow LA Papp MF Detweiler SE Ray MK Shear, et al. 1998 Pretreatment attrition in a comparative treatment outcome study on panic disorder The American Journal of Psychiatry 155 1 43 47 9433337 1:STN:280:DyaK1c%2FpsV2isw%3D%3D
42. A Honey 2000 Psychiatric vocational rehabilitation: Where are the customers' views Psychiatric Rehabilitation Journal 23 3 270 279
43. C Kearney W Silverman 1998 A critical review of pharmacotherapy for youth with anxiety disorders: Things are not as they seem Journal of Anxiety Disorders 12 2 83 102 10.1016/S0887-6185(98)00005-X 9560173 10.1016/S0887- 6185(98)00005-X 1:STN:280:DyaK1c3hvFWjsw%3D%3D (Pubitemid 28178418)
44. E Killackey HJ Jackson PD McGorry 2008 Vocational intervention in first-episode psychosis: Individual placement and support versus treatment as usual The British Journal of Psychiatry 193 114 120 10.1192/bjp.bp.107.043109 18669993 10.1192/bjp.bp.107.043109
45. M King I Nazareth F Lampe P Bower M Chandler M Morou, et al. 2005 Impact of participant and physician intervention preferences on randomized trials: A systematic review Journal of the American Medical Association 293 9 1089 1099 10.1001/jama.293.9.1089 15741531 10.1001/jama.293.9.1089 1:CAS:528: DC%2BD2MXitVahtL4%3D (Pubitemid 40300283)
46. MS Krause KI Howard 2003 What random assignment does and does not do Journal of Clinical Psychology 59 751 766 10.1002/jclp.10170 12808582 10.1002/jclp.10170 (Pubitemid 36736707)
47. HV Krell AF Leuchter M Morgan IA Cook M Abrams 2004 Subject expectations of treatment effectiveness and outcome of treatment with an experimental antidepressant The Journal of Clinical Psychiatry 65 9 1174 1179 15367043
48. PA Lachenbruch 2002 Analysis of data with excess zeros Statistical Methods in Medical Research 11 297 302 10.1191/0962280202sm289ra 12197297 10.1191/0962280202sm289ra (Pubitemid 34936469)
49. G Laengle W Welte U Roesger A Guenthner R U'Ren 2000 Chronic psychiatric patients without psychiatric care: A pilot study Social Psychiatry and Psychiatric Epidemiology 35 10 457 462 10.1007/s001270050264 10.1007/s001270050264 (Pubitemid 30809246)
50. MF Lambert J Wood 2000 Incorporating patient preferences into randomized trials Journal of Clinical Epidemiology 53 163 166 10.1016/S0895-4356(99)00146-8 10729688 10.1016/S0895-4356(99)00146-8 1:STN:280:DC%2BD3c7psFKqtQ%3D%3D (Pubitemid 30151221)
51. EA Latimer MD LeCompte DR Becker RE Drake I Duclos M Piat, et al. 2006 Generalizability of the individual placement and support model of supported employment: Results of a canadian randomised controlled trial The British Journal of Psychiatry 189 65 73 10.1192/bjp.bp.105.012641 16816308 10.1192/bjp.bp.105.012641 (Pubitemid 44023332)
52. PW Lavori 2000 Placebo control groups in randomized treatment trials: A statistician's perspective Biological Psychiatry 47 717 723 10.1016/S0006- 3223(00)00838-6 10773178 10.1016/S0006-3223(00)00838-6 1:STN:280: DC%2BD3c3jvVahsg%3D%3D (Pubitemid 30201666)
53. PW Lavori AJ Rush SR Wisniewski J Alpert M Fava DJ Kupfer, et al. 2001 Strengthening clinical effectiveness trials: Equipoise-stratified randomization Biological Psychiatry 50 10 792 801 10.1016/S0006-3223(01)01223-9 11720698 10.1016/S0006-3223(01)01223-9 1:STN:280:DC%2BD3MnnsVOmtw%3D%3D (Pubitemid 33086767)
54. AF Lehman RW Goldberg LB Dixon S NcNary L Postrado A Hackman, et al. 2002 Improving employment outcomes for persons with severe mental illnesses Archives of General Psychiatry 59 2 165 172 10.1001/archpsyc.59.2.165 11825138 10.1001/archpsyc.59.2.165
55. K Lewin 1943 Forces behind food habits and methods of change Bulletin of the National Research Council 108 35 65
56. Y Leykin RJ DeRubeis R Gallop JD Amsterdam RC Shelton SD Hollon 2007 The relation of patients' treatment preferences to outcome in a randomized clinical trial Behavior Therapy 38 209 217 10.1016/j.beth.2006.08.002 17697846 10.1016/j.beth.2006.08.002 (Pubitemid 47223156)
57. R Lilford J Jackson 1995 Equipoise and the ethics of randomisation Journal of the Royal Society of Medicine 88 552 559 8537943 1:STN:280: DyaK287jvVansA%3D%3D
58. RJ Little DB Rubin 2000 Causal effects in clinical and epidemiological studies via potential outcomes: Concepts and analytical approaches Annual Review of Public Health 21 121 145 10.1146/annurev.publhealth.21.1.121 10884949 10.1146/annurev.publhealth.21.1.121 1:STN:280:DC%2BD3M%2FhsVCktg%3D%3D (Pubitemid 30480319)
59. Macias, C., Aronson, E., Hargreaves, W., Weary, G., Barreira, P., Harvey, J.H., et al. (2009). Transforming dissatisfaction with services into self-determination: A social psychological perspective on community program effectiveness. Journal of Applied Social Psychology, 39(7).
60. C Macias P Barreira W Hargreaves L Bickman WH Fisher E Aronson 2005 Impact of referral source and study applicants' preference for randomly assigned service on research enrollment, service engagement, and evaluative outcomes The American Journal of Psychiatry 162 4 781 787 10.1176/appi.ajp.162.4.781 15800153 10.1176/appi.ajp.162.4.781 (Pubitemid 40489143)
61. C Macias CF Rodican WA Hargreaves DR Jones PJ Barreira Q Wang 2006 Supported employment outcomes of a randomized controlled trial of assertive community treatment and clubhouse models Psychiatric Services 57 10 1406 1415 10.1176/appi.ps.57.10.1406 17035557 10.1176/appi.ps.57.10.1406 (Pubitemid 44671648)
62. Magidson, J. (2000). On models used to adjust for preexisting differences. In L. Bickman (Ed.), Research design (Vol. 2). Thousand Oaks, CA: Sage.
63. SM Marcus 1997 Assessing non-consent bias with parallel randomized and nonrandomized clinical trials Journal of Clinical Epidemiology 50 7 823 828 10.1016/S0895-4356(97)00068-1 9253394 10.1016/S0895-4356(97)00068-1 1:STN:280:DyaK2szpslegsQ%3D%3D (Pubitemid 27379793)
64. Mark, M. M., Hofmann, D. A., & Reichardt, C. S. (1992). Testing theories in theory-driven evaluations: Tests of moderation in all things. In H. Chen & P. H. Rossi (Eds.), Using theory to improve program and policy evaluations. New York: Greenwood Press.
65. JH McGrew ME Griss 2005 Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment Psychiatric Rehabilitation Journal 29 1 41 47 10.2975/29.2005.41.47 16075696 10.2975/29.2005.41.47 (Pubitemid 41022408)
66. JH McGrew BA Pescosolido E Wright 2003 Case managers' perspectives on critical ingredients of Assertive Community Treatment and on its implementation Psychiatric Services 54 3 370 376 10.1176/appi.ps.54.3.370 12610246 10.1176/appi.ps.54.3.370 (Pubitemid 36753012)
67. S McGurk K Mueser K Feldman R Wolfe A Pascaris 2007 Cognitive training for supported employment: 2-3 year outcomes of a randomized controlled trial The American Journal of Psychiatry 164 437 441 10.1176/appi.ajp.164.3.437 17329468 10.1176/appi.ajp.164.3.437 (Pubitemid 46513157)
68. GJ McHugo RR Bebout M Harris S Cleghorn G Herring H Xie, et al. 2004 A randomized controlled trial of integrated versus parallel housing services for homeless adults with severe mental illness Schizophrenia Bulletin 30 4 969 982 15957201
69. M McQuilken JH Zahniser J Novak RD Starks A Olmos GR Bond 2003 The work project survey: Consumer perspectives on work Journal of Vocational Rehabilitation 18 59 68
70. B Meyer PA Pilkonis JL Krupnick MK Egan SJ Simmens SM Sotsky 2002 Treatment expectancies, patient alliance and outcome: Further analyses from the national institute of mental health treatment of depression collaborative research program Journal of Consulting and Clinical Psychology 70 4 1051 1055 10.1037/0022-006X.70.4.1051 12182269 10.1037/0022-006X.70.4.1051
71. CT Mowbray M Collins B Deborah 1999 Supported education for individuals with psychiatric disabilities: Long-term outcomes from an experimental study Social Work Research 23 2 89 100
72. KT Mueser RE Clark M Haines RE Drake GJ McHugo B GR, et al. 2004 The Hartford study of supported employment for persons with severe mental illness Journal of Consulting and Clinical Psychology 72 3 479 490 10.1037/0022-006X.72. 3.479 15279531 10.1037/0022-006X.72.3.479 (Pubitemid 38679645)
73. AL Nichols JK Maner 2008 The good-subject effect: Investigating participant demand characteristics The Journal of General Psychology 135 2 151 165 10.3200/GENP.135.2.151-166 18507315 10.3200/GENP.135.2.151-166
74. Noble, J.H., Honberg, R.S., Hall, L.L., & Flynn, L.M. (1997). A legacy of failure: The inability of the federal-state vocational rehabilitation system to serve people with severe mental illness. Arlington: VA: National Alliance for the Mentally Ill.
75. E Quimby R Drake D Becker 2001 Ethnographic findings from the Washington, DC vocational services study Psychiatric Rehabilitation Journal 24 4 368 374 11406987 1:STN:280:DC%2BD3MzksVensw%3D%3D
76. RA Rosenheck 2001 Organizational process: A missing link between research and practice Psychiatric Services 52 12 1607 1612 10.1176/appi.ps.52.12.1607 11726750 10.1176/appi.ps.52.12.1607 1:STN:280:DC%2BD3MnotVygsw%3D%3D (Pubitemid 33104452)
77. CE Schwartz M Sprangers 1999 Methodological approaches for assessing response shift in longitudinal quality of life research Social Science & Medicine 48 1531 1548 10.1016/S0277-9536(99)00047-7 10.1016/S0277-9536(99)00047- 7 1:STN:280:DyaK1MzisFynsA%3D%3D (Pubitemid 29254112)
78. Sechrest, L., Davis, M., Stickle, T., & McKnight, P. (2000). Understanding 'method' variance. In L. Bickman (Ed.), Research design. Thousand Oaks, CA: Sage.
79. J Secker H Membrey B Grove P Seebohm 2002 Recovering from illness or recovering your life? Implications of clinical versus social models of recovery from mental health problems for employment support services Disability & Society 17 4 403 418 10.1080/09687590220140340 10.1080/09687590220140340
80. WR Shadish 2002 Revisiting field experimentation: Field notes for the future Psychological Methods 7 1 3 18 10.1037/1082-989X.7.1.3 11928889 10.1037/1082-989X.7.1.3
81. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin.
82. WR Shadish GE Matt AM Navarro G Phillips 2000 The effects of psychological therapies under clinically representative conditions: A meta-analysis Psychological Bulletin 126 4 512 529 10.1037/0033-2909.126.4.512 10900994 10.1037/0033-2909.126.4.512 1:STN:280:DC%2BD3czovFehtQ%3D%3D
83. SL Shapiro AJ Figueredo O Caspi GE Schwartz RR Bootzin AM Lopez, et al. 2002 Going quasi: The premature disclosure effect in a randomized clinical trial Journal of Behavioral Medicine 25 6 605 621 10.1023/A:1020693417427 12462959 10.1023/A:1020693417427 (Pubitemid 37490063)
84. JR Sneed BR Rutherford D Rindskopf DT Lane HA Sackeim SP Roose 2008 Design makes a difference: A meta-analysis of antidepressant response rates in placebo-controlled versus comparator trials in late-life depression The American Journal of Geriatric Psychiatry 16 65 73 10.1097/JGP.0b013e3181256b1d 17998306 10.1097/JGP.0b013e3181256b1d
85. MR Sosin 2002 Outcomes and sample selection: The case of a homelessness and substance abuse intervention The British Journal of Mathematical and Statistical Psychology 55 1 63 92 10.1348/000711002159707 12034012 10.1348/000711002159707
86. G Staines K McKendrick T Perlis S Sacks G DeLeon 1999 Sequential assignment and treatment as usual: Alternatives to standard experimental designs in field studies of treatment efficacy Evaluation Review 23 1 47 76 10.1177/0193841X9902300103 10346073 10.1177/0193841X9902300103 1:STN:280:DyaK1M7otlCmsQ%3D%3D
87. T TenHave J Coyne M Salzer I Katz 2003 Research to improve the quality of care for depression: Alternatives to the simple randomized clinical trial General Hospital Psychiatry 25 115 123 10.1016/S0163-8343(02)00275-X 12676425 10.1016/S0163-8343(02)00275-X (Pubitemid 36379223)
88. D Torgerson JA Klaber Moffett IT Russell 1996 Including patient preferences in randomized clinical trials Journal of Health Services Research & Policy 1 194 197 1:STN:280:DyaK1czitFeqsA%3D%3D
89. Torgerson, D., & Moffett, J.K. (2005). Patient Preference and Validity of Randomized Controlled Trials: Letter to the Editor. Journal of the American Medical Association, 294(1), 41. doi: 10.1001/jama.294.1.41-b.
90. Trist, E., & Sofer, C. (1959). Exploration in group relations. Leicester: Leicester University Press.
91. EW Twamley JM Narvaez DR Becker SJ Bartels DV Jeste 2008 Supported employment for middle-aged and older people with schizophrenia American Journal of Psychiatric Rehabilitation 11 1 76 89 10.1080/15487760701853326 19212460 10.1080/15487760701853326 (Pubitemid 351323438)
92. K Wahlbeck A Tuunainen A Ahokas S Leucht 2001 Dropout rates in randomised antipsychotic drug trials Psychopharmacology 155 3 230 233 10.1007/ s002130100711 11432684 10.1007/s002130100711 1:CAS:528:DC%2BD3MXkvFShtLY%3D (Pubitemid 32477278)
93. West, S. G., Aiken, L. S., & Todd, M. (2002). Probing the effects of individual components in multiple component prevention programs. In T. Revenson & R. B. D'Agostino (Eds.), Ecological research to promote social change: Methodological advances from community psychology. New York, NY: Kluwer.
94. West, S. G., & Sagarin, B. J. (2000). Participant selection and loss in randomized experiments. In L. Bickman (Ed.), Research design: Donald Campbell's legacy (Vol. II, pp. 117-154). Thousand Oaks, CA: Sage.
95. J Wolf C Coba M Cirella 2001 Education as psychosocial rehabilitation: Supported education program partnerships with mental health and behavioral healthcare certificate programs Psychiatric Rehabilitation Skills 5 3 455 476
96. Wong, K.K., Chiu, R., Tang, B., Mak, D., Liu, J., & Chiu, S.N. (2008). A randomized controlled trial of a supported employment program for persons with long-term mental illness in Hong Kong. Psychiatric Services (Washington, D.C.), 59(1), 84-90. doi: 10.1176/appi.ps.59.1.84.