Appraising evidence for intervention effectiveness in early psychosis: Conceptual framework and review of evaluation approaches

Australian and New Zealand Journal of Psychiatry

Volumn 44, Issue 3, 2010, Pages 195-219

  Catts, Stanley V ^a   O'Toole, Brian I ^b   Carr, Vaughan J ^c,d   Lewin, Terry ^e   Neil, Amanda ^a   Harris, Meredith G ^a   Frost, Aaron D J ^f   Crissman, Belinda R ^a   Eadie, Kathy ^a   Evans, Russell W ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

^c UNIVERSITY OF NEWCASTLE   (Australia)

^d SCHIZOPHRENIA RESEARCH INSTITUTE   (Australia)

^e UNIVERSITY OF NEWCASTLE   (Australia)

^f ROYAL BRISBANE AND WOMEN'S HOSPITAL   (Australia)

Author keywords

Early psychosis; Evaluation; Methodology; Study design

Indexed keywords

AMISULPRIDE; CLOZAPINE; HALOPERIDOL; NEUROLEPTIC AGENT; OLANZAPINE; PLACEBO; QUETIAPINE; RISPERIDONE;

AUSTRALIA AND NEW ZEALAND; CLINICAL ASSESSMENT; CLINICAL EVALUATION; CLINICAL PRACTICE; CLINICAL RESEARCH; CLINICAL TRIAL; CONCEPTUAL FRAMEWORK; CONSENSUS DEVELOPMENT; DATA BASE; DRUG EFFICACY; DRUG SAFETY; EARLY INTERVENTION; ECONOMIC EVALUATION; EXPERIMENTAL STUDY; HEALTH CARE ORGANIZATION; HEALTH CARE QUALITY; HEALTH SERVICE; HEALTH SERVICES RESEARCH; HUMAN; MEDICAL AUDIT; MEDICAL EDUCATION; MESH HEADING; META ANALYSIS; METHODOLOGY; OBSERVATIONAL METHOD; OUTCOME ASSESSMENT; POLYPHARMACY; PSYCHIATRIST; PSYCHOSIS; QUALITY CONTROL; QUASI EXPERIMENTAL STUDY; REVIEW; SCALE UP; SCHIZOPHRENIA; SYSTEMATIC REVIEW; THERAPY EFFECT; TIME SERIES ANALYSIS;

HEALTH SERVICES RESEARCH; HUMANS; PSYCHOTIC DISORDERS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; TERMINOLOGY AS TOPIC; TIME FACTORS; TREATMENT OUTCOME;

EID: 77649085059     PISSN: 00048674     EISSN: 14401614     Source Type: Journal    
DOI: 10.3109/00048670903487167     Document Type: Review

References (362)

1. Harrison G, Hopper K, Craig T et al. Recovery from psychotic illness: a 15-and 25-year international follow-up study. Br J Psychiatry 2001; 178:506-517.
2. Harrison G, Croudace T, Mason P, Glazebrook C, Medley I. Predicting the long-term outcome of schizophrenia. Psychol Med 1996; 26:697-705.
3. Wiersma D, Nienhuis FJ, Slooff CJ, Giel R. Natural course of schizophrenic disorders: a 15-year followup of a Dutch incidence cohort. Schizophr Bull 1998; 24:75-85.
4. Robinson D, Woerner MG, Alvir JMJ et al. Predictors of relapse following response from a first episode of schizophrenia or schizoaffective disorder. Arch Gen Psychiatry 1999; 56:241-247.
5. Kane J, Rifkin A, Quitkin F, Nayak D, Ramos-Lorensi J. Fluphenazine vs placebo in patients with remitted, acute first-episode schizophrenia. Arch Gen Psychiatry 1982; 39:70-73.
6. Crow T, Macmillan J, Johnson A, Johnstone EI. A randomized controlled trial of prophylactic neuroleptic treatment. Br J Psychiatry 1986; 148:120-127.
7. McCreadie R, Wiles D, Grant S. The Scottish first episode schizophrenia study VII. Two-year follow-up. Acta Psychiatr Scand 1989; 80:597-602.
8. Gitlin M, Neuchterlein K, Subotnik KL et al. Clinical outcome following neuroleptic discontinuation in patients with remitted recent-onset schizophrenia. Am J Psychiatry 2001:1835-1842.
9. Lieberman J, Jody D, Geisler S et al. Time-course and biologic correlates of treatment response in first-episode schizophrenia. Arch Gen Psychiatry 1993; 50:369-376.
10. Power P, Elkins K, Adlard S, Curry C, McGorry P, Harrigan S. Analysis of the initial treatment phase in first-episode psychosis. Br J Psychiatry 1998; 172:71-76.
11. Huq ZU. A trial of low doses of risperidone in the treatment of patients with first-episode schizophrenia, schizophreniform disorder, or schizoaffective disorder. J Clin Psychopharmacol 2004; 24:220-224.
12. Emsley R, Rabinowitz J, Medori R. Time course for antipsy-chotic treatment response in first-episode schizophrenia. Am J Psychiatry 2006; 163:743-745.
13. Malla A, Norman R, Schmitz N et al. Predictors of rate and time to remission in first-episode psychosis: a two-year outcome study. Psychol Med 2006; 36:649-658.
14. Lieberman J, Koreen A, Chakos M et al. Factors influencing treatment response and outcome of first-episode schizophrenia: implications for understanding the pathophysiology of schizophrenia. J Clin Psychiatry 1996; 57(Suppl 9):5-9.
15. Merlo MCG, Hofer H, Gekle W et al. Risperidone, 2 mg/day vs. 4 mg/day, in first-episode, acutely psychotic patients: treatment efficacy and effects on fine motor functioning. J Clin Psychiatry 2002; 63:885-891.
16. Oosthuizen P, Emsley R, Turner HJ, Keyter N. A randomized, controlled comparison of the efficacy and tolerability of low and high doses of haloperidol in the treatment of first-episode psychosis. Int J Neuropsychopharmacol 2004; 7:125-131.
17. Kahn RS, Fleischhacker WW, Boter H et al. Effectiveness of antipsychotic drugs in first-episode schizophrenia and schizo-phreniform disorder: an open randomised clinical trial. Lancet 2008; 371(9618):1085-1097.
18. Lieberman JA, Stroup TS, McEvoy JP et al. Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. N Engl J Med 2005; 353:1209-1223.
19. Kavanagh DJ, Young R, White A et al. A brief motivational intervention for substance misuse in recent-onset psychosis. Drug and Alcohol Review 2004; 23:151-155.
20. Bellack AS, Bennett ME, Gearon JS, Brown CH, Yang Y. A randomized clinical trial of a new behavioral treatment for drug abuse in people with severe and persistent mental illness. Arch Gen Psychiatry 2006; 63:426-432.
21. Brunette MF, Mueser KT, Drake RE. A review of research on residential programs for people with severe mental illness and co-occurring substance use disorders. Drug Alcohol Rev 2004; 23:471-481.
22. Jeffery D, Ley A, McLaren S, Siegfried N. Psychosocial treatment programmes for people with both severe mental illness and substance misuse. Cochrane Database Syst Rev 2000; (2): CD001088.
23. Harrigan SM, McGorry PD, Krstev H. Does treatment delay in first-episode psychosis really matter? Psychol Med 2003; 33:97-110.
24. Drake RJ, Haley CJ, Akhtar S, Lewis SW. Causes and consequences of duration of untreated psychosis in schizophrenia. Br J Psychiatry 2000; 177:511-515.
25. Marshall M, Rathbone J. Early intervention for psychosis. Cochrane Database Syst Rev 2006; (4):CD004718.
26. Atkins D, Eccles M, Flottorp S et al. Systems for grading the quality of evidence and the strength of reccommendations 1: critical appraisal of existing approaches. The Grade Working Group. BMC Health Serv Res 2004; 4:38.
27. Black N. Why we need observational studies to evaluate the effectiveness of health care. Br Med J 1996; 312(7040):1215-1218.
28. Mays N, Roberts E, Popay J. Synthesising research evidence. In: Fulop N, Allen P, Clarke A, Black N, eds. Studying the organisation and delivery of health services: research methods. London: Routledge, 2001:188-220.
29. Last JM, ed. A dictionary of epidemiology, 4th edn. New York: Oxford University Press, 2001.
30. Mathison S. Encyclopedia of evaluation. CA: Sage Publications, 2005.
31. Everitt BS, Howell DC. Encyclopedia of statistics in behavioral science, vols 1-4. West Sussex: John Wiley & Sons, 2005.
32. Bates S, Clapton J, Coren E. Systematic maps to support the evidence base in social care. Evidence Policy 2007; 3:539-551.
33. Kleijnen J, Gotzche P, Kunz RA, Ozman AD, Chalmers I. So what's so special about randomisation? In: Maynard A, Chalmers I, eds. Non-random reflections on health services research. London, UK: BMJ Publishing, 1997:93-106.
34. McCulloch CE, Searle SR, Neuhaus JM. Generalized linear and mixed models, 2nd edn. Hoboken, NJ: John Wiley & Sons, 2008.
35. Verbeke G, Molenberghs G. Linear mixed models for longitudinal data. New York: Springer Science+Business Media, 2000.
36. Wells KB. Treatment research at the crossroads: the scientific interface of clinical trials and effectiveness research. Am J Psychiatry 1999; 156:5-10.
37. Kraemer HC, Gibbons RD. Why does the randomized clinical trial methodology so often mislead clinical decision making? Focus on moderators and mediators of treatment. Psychiatr Ann 2009; 39:736-745.
38. Macias C, Jones DR, Hargreaves WA et al. When programs benefit some people more than others: tests of differential service effectiveness. Adm Policy Ment Health Ment Health Serv Res 2008; 35:283-294.
39. Pajonk FG. Clinical trial design in schizophrenia: implications for clinical decisions. Curr Opin Psychiatry 2005; 18: 692-699.
40. Rothwell PM. Treating Individuals 1: external validity of randomised controlled trials: 'To whom do the results of this trial apply?' Lancet 2005; 365(9453):82-93.
41. Riedel M, Strassnig M, Muller N, Zwack P, Moller HJ. How representative of everyday clinical populations are schizophrenia patients enrolled in clinical trials? Eur Arch Psychiatry Clin Neu-rosci 2005; 255:143-148.
42. Hofer A, Hummer M, Huber R, Kurtz M, Walch T, Fleischhacker WW. Selection bias in clinical trials with antipsychotics. J Clin Psychopharmacol 2000; 20:699-702.
43. Leucht S. Translating research into clinical practice: critical interpretation of clinical trials in schizophrenia. Int Clin Psychopharmacol 2006; 21:S1-S10.
44. Wahlbeck K, Tuunainen A, Ahokas A, Leucht S. Dropout rates in randomised antipsychotic drug trials. Psychopharmacology (Berl) 2001; 155:230-233.
45. Heres S, Davis J, Maino K, Jetzinger E, Kissling W, Leucht S. Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsy-chotics. Am J Psychiatry 2006; 163:185-194.
46. Safer DJ. Design and reporting modifications in industry-sponsored comparative psychopharmacology trials. J Nerv Ment Dis 2002; 190:583-592.
47. Davis JM, Chen N, Glick ID. Issues that may determine the outcome of antipsychotic trials: industry sponsorship and extrapyramidal side effect. Neuropsychopharmacology 2008; 33:971-975.
48. Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Health services research: process evaluation in randomised controlled trials of complex interventions. Br Med J 2006; 332(7538): 413-416.
49. Hawe P, Shiell A, Riley T. Complex interventions: how 'out of control' can a randomised controlled trial be? Br Med J 2004; 328(7455):1561-1563.
50. Perera R, Heneghan C, Yudkin P. Graphical methods for depicting randomised trials of complex interventions. BMJ 2007; 334: 127-129.
51. Campbell M, Fitzpatrick R, Haines A et al. Framework for design and evaluation of complex interventions to improve health. Br Med J 2000; 321(7262):694-696.
52. Medical Research Council. A framework for development and evaluation of RCTs for complex interventions to improve health. London, UK: MRC, 2000.
53. van Meijel B, Gamel C, Swieten-Duijfjes B, Grypdonck MHF. The development of evidence-based nursing interventions: methodological considerations. J Adv Nurs 2004; 48:84-92.
54. Bradley F, Wiles R, Kinmonth AL, Mant D, Gantley M. Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). Br Med J 1999; 318(7185):711-715.
55. Donner A, Klar N. Design and analysis of cluster randomization trials in health research. London: Arnold, 2000.
56. Medical Research Council. Cluster randomised trials: methodological and ethical considerations. London, UK: MRC, 2002.
57. Campbell M, Grimshaw J. Cluster randomised trials: time for improvement. Br Med J 1998; 317:1171-1172.
58. Puffer S, Torgerson DJ, Watson J. Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. Br Med J 2003; 327(7418):785-787.
59. Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 2003; 290:1624-1632.
60. Wolff N. Randomised trials of socially complex interventions: promise or peril? J Health Serv Response Policy 2001; 6:123-126.
61. Wolff N. Using randomized controlled trials to evaluate socially complex services: problems, challenges and recommendations. J Ment Health Policy Econ 2000; 3:97-109.
62. Sackett D, Haynes R, Guyatt G, Tugwell P. Clinical epidemiology: a basic science for clinical medicine. Boston, MA: Little, Brown, 1991.
63. Diggle PJ, Heagerty P, Liang K-Y, Zeger SL. Analysis of longitudinal data, 2nd edn. Oxford: Oxford University Press, 2002.
64. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin, 2002.
65. Gibbons RD, Brown CH, Hur K et al. Early evidence on the effects of regulators' suicidality warnings on SSRI prescriptions and suicide in children and adolescents. Am J Psychiatry 2007; 164:1356-1363.
66. Donabedian A. The quality of care: how can it be assessed. JAMA 1988; 260:1743-1748.
67. Chisholm D, Flisher AJ, Lund C et al. Scale up services for mental disorders: a call for action. Lancet 2007; 370(9594):1241-1252.
68. Whiteford H. Can research influence mental health policy? Aust N Z J Psychiatry 2001; 35:428-434.
69. Vladeck BC, Kramer PS. Case mix measures: DRGs and alternatives. Annu Rev Public Health 1988; 9:333-359.
70. Jones J, Amaddeo F, Barbui C, Tansella M. Predicting costs of mental health care: a critical literature review. Psychol Med 2007; 37:467-477.
71. Eagar K, Gaines P, Burgess P. Developing a New Zealand casemix classification for mental health services. World Psychiatry 2004; 3:176-181.
72. Knapp M, Beecham J, Fenyo A, Hallam A. Community mental health care for former hospital inpatients: predicting costs from needs and diagnoses. Br J Psychiatry 1995; 166:10-18.
73. Taiminen T, Ranta K, Karlsson H et al. Comparison of clinical and best-estimate research DSM-IV diagnoses in a Finnish sample of first-admission psychosis and severe affective disorder. Nord J Psychiatry 2001; 55:107-111.
74. Elhai JD, Calhoun PS, Ford JD. Statistical procedures for analyzing mental health services data. Psychiatry Res 2008; 160:129-136.
75. Andrews G, Peters L, Teesson M. The measurement of consumer outcome in mental health: a report to the National Mental Health Information Strategy Committee. Sydney: Clinical Research Unit for Anxiety Disorders, 1994.
76. Wing JK, Beevor AS, Curtis RH, Park SBG, Hadden S, Burns A. Health of the Nation Outcome Scales (HoNOS): research and development. Br J Psychiatry 1998; 172:11-18.
77. Happell B. The value of routine outcome measurement for consumers of mental health services: master or servant? Int J Soc Psychiatry 2008; 54:317-327.
78. Kisely S, Preston N, Rooney M. Pathways and outcomes of psychiatric care: does it depend on who you are, or what you've got? Aust N Z J Psychiatry 2000; 34:1009-1014.
79. Fossey EM, Harvey CA. A conceptual review of functioning: implications for the development of consumer outcome measures. Aust N Z J Psychiatry 2001; 35:91-98.
80. Gilbody SM, House AO, Sheldon TA. Outcomes research in mental health: systematic review. Br J Psychiatry 2002; 181:8-16.
81. Bilsker D, Goldner EM. Routine outcome measurement by mental health-care providers: is it worth doing? Lancet 2002; 360(9346):1689-1690.
82. Slade M, Thornicroft G, Glover G. The feasibility of routine outcome measures in mental health. Soc Psychiatry Psychiatr Epidemiol 1999; 34:243-249.
83. Dickey B, Wagenaar H. Evaluating mental health care reform: including the clinician, client, and family perspective. J Ment Health Adm 1994; 21:313-319.
84. Lloyd-Evans B, Johnson S, Slade M. Assessing the content of mental health services: a review of measures. Soc Psychiatry Psychiatr Epidemiol 2007; 42:673-682.
85. Salize HJ, Kustner BM, Torres-Gonzalez F, Reinhard I, Estevez JFJ, Rossler W. Needs for care and effectiveness of mental health care provision for schizophrenic patients in two European regions: a comparison between Granada (Spain) and Mannheim (Germany). Acta Psychiatr Scand 1999; 100:328-334.
86. De Jong A, Giel R, Tentlom G. International classification of mental health care: a tool for classifying service providing mental health care Part 1. Groningen: Department of Social Psychiatry, University of Groningen and World Health Organisation Regional office for Europe, 1991.
87. Johnson S, Kuhlmann R, EPCAT Group. The European Service Mapping Schedule (ESMS): development of an instrument for the description and classification of mental health services. Acta Psychiatr Scand 2000; 102:14-23.
88. Becker T, Hulsmann S, Knudsen HC et al. Provision of services for people with schizophrenia in five European regions. Soc Psychiatry Psychiatr Epidemiol 2002; 37:465-474.
89. Palmer RH, Reilly MC. Individual and institutional variables which may serve as indicators of quality of medical care. Med Care 1979; 17:693-717.
90. Preston NJ, Stirling ML, Perera K et al. A statewide evaluation system for early psychosis. Aust N Z J Psychiatry 2003; 37: 421-428.
91. Doran T, Fullwood C, Kontopantelis E, Reeves D. Effect of financial incentives on inequalities in the delivery of primary clinical care in England: analysis of clinical activity indicators for the quality and outcomes framework. Lancet 2008; 372(9640): 728-736.
92. Starfield B. Quality and outcomes framework: patient-centred? Lancet 2008; 372(9640):692-694.
93. Minas H, Cohen A. Why focus on mental health systems? Int J Ment Health Syst 2007; 1:1.
94. Rossi PH, Lipsey MW, Freeman HE. Evaluation: a systematic approach, 7th edn. CA: Thousand Oaks, 2004.
95. Smith MF. Evaluability assessment: a practical approach. Boston: Kluwer Academic, 1989.
96. Sadish WR, Cook TD, Leviton LC. Foundations of program evaluation: theories of practice. Newbury Park, CA: Sage Publications, 1991.
97. Nutbeam D, Bauman A. Evaluation in a nutshell. Sydney: McGraw-Hill Australia, 2006.
98. Mowbray CT, Holter MC, Teague GB, Bybee D. Fidelity criteria: development, measurement, and validation. Am J Eval 2003; 24:315-340.
99. Drummond MF, Sculpher MJ, Torrance GW, O'Brien B, J., Stoddart GL. Methods for the economic evaluation of health care programmes, 3rd edn. New York: Oxford University Press, 2005.
100. National Health Medical Research Council. How to compare the costs and benefits: evaluation of the economic evidence. Canberra: 2001.
101. Roberts E, Cumming J, Nelson K. A review of economic evaluations of community mental health care. Med Care Res Rev 2005; 62:503-543.
102. Evers S, Salvador-Carulla L, Halsteinli V, McDaid D, Group TM. Implementing mental health economic evaluation evidence: building a bridge between theory and practice. J Ment Health 2007; 16:223-241.
103. Donaldson C, Mugford M, Vale L. Evidence-based health economics: from effectiveness to efficiency in systematic review. London: BMJ Books, 2002.
104. Hermann RC. Improving mental healthcare: a guide to measurement-based quality improvement. Washington, DC: American Psychiatric Publications, 2005.
105. Buttery Y, Walshe K, Coles J, Bennett J. Evaluating medical audit: the development of audit findings of national survey of healthcare provider units in England. London: Clinical Accountability, Service Planning and Evaluation (CASPE) Research, 1994.
106. Buxton MJ. Achievements of audit in the NHS. Qual Health Care 1994; 1(Suppl):531-534.
107. Nelson EAS. Standardized program for medical audit is needed. Br Med J 1994; 309(6955):672-673.
108. O'Neil D, Hicks D, Smalley S. Central dimensions of clinical practice evaluation: efficiency, appropriateness and effectiveness. J Eval Clin Pract 1996; 2:13-27.
109. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2006; (2):CD000259.
110. Miles A, Lugon M. Effective clinical practice. Oxford: Black-well Science, 1996.
111. Bhopal R, Thompson R. Medical audit and medical research. Qual Health Care 1992; 2:274-275.
112. Walshe K, Coles J. Evaluation audit: a review of initiatives. London: Clinical Accountability, Service Planning and Evaluation (CASPE) Research, 1994.
113. Shaw CD, Costain DW. Guidelines for medical audit: seven principles. Br Med J 1989; 299(6697):498-499.
114. Jenkins R. Towards a system of outcome indicators for mental health care. Br J Psychiatry 1990; 157:500-514.
115. Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care 2003; 15:523-530.
116. Mainz J. Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care 2003; 15: I5-I11.
117. Brugha TS, Lindsay F. Quality of mental health service care: the forgotten pathway from process to outcome. Soc Psychiatry Psychiatr Epidemiol 1996; 31:89-98.
118. Ganju V. Implementation of evidence-based practices in state mental health systems: implications for research and effectiveness studies. Schizophr Bull 2003; 29:125-131.
119. Goldman H, Thelander S, Westrin C-G. Organising mental health services: an evidence-based approach. J Ment Health Policy Econ 2000; 3:69-75.
120. Polcin DL. How health services research can help clinical trials become more community relevant. Int J Drug Policy 2006; 17:230-237.
121. Beinecke RH, Shepard DS, Hurley CL. Implementing evidence-based mental health practices and performance measures in Massachusetts. Adm Policy Ment Health Ment Health Serv Res 2006; 33:623-628.
122. Rubin HR, Pronovost P, Diette GB. The advantages and disadvantages of process-based measures of health care quality. Int J Qual Health Care 2001; 13:469-474.
123. Rubin HR, Pronovost P, Diette GB. From a process of care to a measure: the development and testing of a quality indicator. Int J Qual Health Care 2001; 13:489-496.
124. Tansella M, Thornicroft G. A conceptual framework for mental health services: the matrix model. Psychol Med 1998; 28: 503-508.
125. Meehan TJ, Stedman TJ, Neuendorf KE, Francisco ID, Neilson MG. Benchmarking Australia's mental health services: is it possible and useful? Aust Health Rev 2007; 31:623-627.
126. Juran JM, Gryna FM. Quality control handbook, 4th edn. New York: McGraw Hill, 1988.
127. Deming WE. Out of the crisis. Cambridge: Cambridge University Press, 1982.
128. Berwick DM. Developing and testing changes in delivery of care. Ann Intern Med 1998; 128:651-656.
129. Hart E, Bond M. Action research for health and social care: a guide to practice. Buckingham, UK: Open University Press, 1995.
130. Stringer E, Genat W. Action research in health. New Jersey: Pearson Education, 2004.
131. Reason J. Managing the risks of organizational accidents. Ashgate: Aldershot, 1997.
132. Kaplan R, Norton D. The balanced scorecard: translating strategy into action. Cambridge, MA: Harvard Business School Press, 1996.
133. Camp RC. Benchmarking: the search for industry best practices that lead to superior performance. Portland, OR: Productivity Press, 2006.
134. Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't - it's about integrating individual clinical expertise and the best external evidence. Br Med J 1996; 312(7023):71-72.
135. Lohr KN, Eleazer K, Mauskopf J. Health policy issues and applications for evidence-based medicine and clinical practice guidelines. Health Policy 1998; 46:1-19.
136. Sale D. Understanding clinical governance and quality assurance. Hampshire: Palgrave McMillan, 2005.
137. Brennan TA, Leape IJ, Laird NM et al. Incident of adverse events and negligent care in hospitalised patients. Results of Harvard Medical Practice Study 1. N Engl J Med 1991; 324: 370-376.
138. Wilson RM, Runciuman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD. The Quality in Australian Health Care Study. Med J Aust 1995; 163:458-471.
139. Zarin DA, Pincus HA, West JC, McIntyre JS. Practice-based research in psychiatry. Am J Psychiatry 1997; 154:1199-1208.
140. Pincus HA, Zarin DA, Tanielian TL et al. Psychiatric patients and treatments in 1997: findings from the American Psychiatric Practice Research Network. Arch Gen Psychiatry 1999; 56:441-449.
141. Norquist GS. Practice research networks: promises and pitfalls. Clin Psychol Sci Pract 2001; 8:173-175.
142. Borkovec TD, Echemendia RJ, Ragusea SA, Ruiz M. The Pennsylvania Practice Research Network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy effectiveness research. Clin Psychol Sci Pract 2001; 8: 155-167.
143. National Health and Medical Research Council. How to use the evidence: assessment and application of scientific evidence. Canberra: Commonwealth of Australia, 2000.
144. National Health and Medical Research Council. How to review the evidence: systematic identification and review of the scientific literature. Canberra: Commonwealth of Australia, 2000.
145. National Health and Medical Research Council. How to put the evidence into practice: implementation and dissemination strategies. Canberra: Commonwealth of Australia, 2000.
146. Andrews G. Randomised controlled trials in psychiatry: important but poorly accepted. Br Med J 1999; 319(7209):562-564.
147. National Institute of Clinical Studies. Assessing the implementa-bility of guidelines. Melbourne: National Institute of Clinical Studies, 2006.
148. Cluzeau F, Burgers J, Brouwers M et al. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care 2003; 12:18-23.
149. Yealy DM, Auble TE, Stone RA et al. Effect of increasing the intensity of implementing pneumonia guidelines: a randomized, controlled trial. Ann Intern Med 2005; 143(12):881-894.
150. Campbell H, Hotchkiss R, Bradshaw N, Porteous M. Integrated care pathways. Br Med J 1998; 316(7125):133-137.
151. Evans-Lacko SE, Jarrett M, McCrone P, Thornicroft G. Clinical pathways in psychiatry. Br J Psychiatry 2008; 193:4-5.
152. Yellowlees PM, Emmerson B, Denton M, Wentworth S, Dart J. Clinical pathways in mental health. Brisbane: Royal Australian and New Zealand College of Psychiatrists, 2002.
153. Coffey RJ, Richards JS, Remmert CS, LeRoy SS, Schoville RR, Baldwin PJ. An introduction to critical paths (hospital and quality management). Qual Manag Health Care 2005; 14:46.
154. Huby G, Rees G. The effectiveness of quality improvement tools: joint working in integrated community teams. Int J Qual Health Care 2005; 17:53-58.
155. Emmerson B, Frost A, Fawcett L, Ballantyne E, Ward W, Catts S. Do clinical pathways really improve performance in mental health settings? Australas Psychiatry 2006; 14:395-398.
156. Jones B, Kenward MG. Design and analysis of cross-over trials, 2nd edn. Boca Raton: Chapman & Hall/CRC, 2003.
157. Eccles M, Grimshaw J, Campbell M, Ramsay C. Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care 2003; 12: 47-52.
158. Speer D. Mental health outcome evaluation. San Diego, CA: Academic Press, 1998.
159. Trochim WMK, Donnelly JP. The research methods knowledge base, 3rd edn. Mason, OH: Atomic Dog, 2008.
160. Yin RK. Case study research: design and methods, 3rd edn. Thousand Oaks, CA: Sage Publications, 2003.
161. Speer DC. Clinically significant change: Jacobson and Truax (1991) revisited. J Consult Clin Psychol 1992; 60:402-408.
162. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991; 59:12-19.
163. Farmer A. The demise of the published case report: is resuscitation necessary? Br J Psychiatry 1999; 174:93-94.
164. Dalziel K, Round A, Stein K, Garside R, Castelnuovo E, Payne L. Do the findings of case series studies vary significantly according to methodological characteristics? Health Technol Assess 2005; 9(2):1.
165. Whitaker HJ, Farrington CP, Spiessens B, Musonda P. Tutorial in biostatistics: the self-controlled case series method. Stat Med 2006; 25:1768-1797.
166. Angst J, Sellaro R. Historical perspectives and natural history of bipolar disorder. Biol Psychiatry 2000; 48:445-457.
167. Biederman J, Mick E, Faraone SV, Spencer T, Wilens TE, Wozniak J. Pediatric mania: a developmental subtype of bipolar disorder? Biol Psychiatry 2000; 48:458-466.
168. Walter S, Rey JM, Dekker F. The humble case report. Aust N Z J Psychiatry 2001; 35:240-245.
169. Dattilio FM. Does the case study have a future in the psychiatric literature? Int J Psychiatry Clin Pract 2006; 10:195-203.
170. Stiles WB. When is a case study scientific research? Psychother Bull 2003; 38:6-11.
171. Davies J, Howells K, Jones L. Evaluating innovative treatments in forensic mental health: a role for single case methodology? J Forensic Psychiatry Psychol 2007; 18:353-367.
172. Adams CE, Fenton MKP, Quraishi S, David AS. Systematic meta-review of depot antipsychotic drugs for people with schizophrenia. Br J Psychiatry 2001; 179:290-299.
173. Keech A, Gebski V, Pike R. Interpreting and reporting clinical trials: a guide to the CONSORT statement and the principles of randomised controlled trials. Pyrmont: Australasian Medical Publishing, 2007.
174. Altman DG, Schulz KF, Moher D et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001; 134:663-694.
175. Singer JDA, Willett JB. Applied longitudinal data analysis: modeling change and event occurence. Oxford: Oxford University Press, 2003.
176. Popay J, Roberts J, Sowden H, Petticrew M, Arai M, Rodgers L. Guidance on the conduct of narrative synthesis in systematic reviews: version 2. Lancaster, UK: Lancaster University, 2005.
177. Arai L, Britten N, Popay J et al. Testing methodological developments in the conduct of narrative synthesis: a demonstration review of research on the implementation of smoke alarm interventions. Evidence Policy 2007; 3:361-383.
178. Guyatt G. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA 1992; 268(17):2420-2425.
179. Everitt BS, Wessely S. Clinical trials in psychiatry. Oxford: Oxford University Press, 2004.
180. Friedman LM, Furberg CD, DeMets D. Fundamentals of clinical trials, 3rd edn. New York: Springer-Verlag, 1998.
181. Haynes BR, Sackett DL, Guyatt GH, Tugwell P. Clinical epidemiology: how to do clinical practice research, 3rd edn. Philadelphia: Lippincott Williams & Wilkins, 2005.
182. Grobbee D, Hoes AW. Principles and methods of clinical epidemiology. Sudbury, MA: Jones and Bartlett Publishers, 2008.
183. Levin BL, Petrila J, Hennessy KD, eds. Mental health services: a public health perspective, 2nd edn. New York: Oxford University Press, 2004.
184. Thornicroft G, Tansella M. The mental health matrix: a manual to improve services. Cambridge: Cambridge University Press, 1999.
185. Orwin RG, Goldman HH. Evaluating alcohol, drug abuse, and mental health services. In: Levin BL, Petrila J, Hennessy KD, eds. managing mental health systems, 2nd edn. Oxford: Oxford University Press; 2004:419-466.
186. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res 2005; 8:19-32.
187. Emsley RA. Risperidone in the treatment of first-episode psychotic patients: a double-blind multicenter study. Schizophr Bull 1999; 25:721-729.
188. Lieberman JA, Tollefson G, Tohen M et al. Comparative efficacy and safety of atypical and conventional antipsychotic drugs in first-episode psychosis: a randomized, double-blind trial of olanzapine versus haloperidol. Am J Psychiatry 2003; 160: 1396-1404.
189. Green AI, Lieberman JA, Hamer RM et al. Olanzapine and haloperidol in first episode psychosis: two-year data. Schizophr Res 2006; 86:234-243.
190. Schooler N, Rabinowitz J, Davidson M et al. Risperidone and haloperidol in first-episode psychosis: a long-term randomized trial. Am J Psychiatry 2005; 162:947-953.
191. Lieberman JA, Phillips M, Gu HB et al. Atypical and conventional antipsychotic drugs in treatment-naive first-episode schizophrenia: a 52-week randomized trial of clozapine vs chlorpromazine. Neuropsychopharmacology 2003; 28:995-1003.
192. McGorry PD, Yung AR, Phillips LJ et al. Randomized controlled trial of interventions designed to reduce the risk of progression to first-episode psychosis in a clinical sample with subthreshold symptoms. Arch Gen Psychiatry 2002; 59:921-928.
193. McGlashan TH, Zipursky RB, Perkins D et al. Randomized, double-blind trial of olanzapine versus placebo in patients prodromally symptomatic for psychosis. Am J Psychiatry 2006; 163:790-799.
194. Catts SV, Frost ADJ, Gifford S, Scott J. Real-world use of quetiapine in early psychosis: an acute inpatient and community follow-up effectiveness study. Int J Psychiatry Clin Pract 2008; 12:65-73.
195. Kumra S, Oberstar JV, Sikich L et al. Efficacy and tolerability of second-generation antipsychotics in children and adolescents with schizophrenia. Schizophr Bull 2008; 34:60-71.
196. Strassnig M, Miewald J, Keshavan M, Ganguli R. Weight gain in newly diagnosed first-episode psychosis patients and healthy comparisons: one-year analysis. Schizophr Res 2007; 93:90-98.
197. Leucht S, Barnes TRE, Kissling W, Engel RR, Correll C, Kane JM. Relapse prevention in schizophrenia with new-generation antipsychotics: a systematic review and exploratory meta-analysis of randomized, controlled trials. Am J Psychiatry 2003; 160:1209-1222.
198. Kumra S, Kranzler H, Gerbino-Rosen G et al. Clozapine and 'high-dose' olanzapine in refractory early-onset schizophrenia: a 12-week randomized and double-blind comparison. Biol Psychiatry 2008; 63:524-529.
199. Power P, Iacoponi E, Reynolds N et al. The Lambeth early onset crisis assessment team study: general practitioner education and access to an early detection team in first-episode psychosis. Br J Psychiatry 2007;
200. Tait L, Lester H, Birchwood M, Freemantle N, Wilson S. Design of the BiRmingham Early Detection In untREated psyChosis Trial (REDIRECT): cluster randomised controlled trial of general practitioner education in detection of first episode psychosis [ISRCTN87898421]. BMC Health Serv Res 2005; 5:19.
201. Harvey P-O, Lepage M, Malla A. Benefits of enriched intervention compared with standard care for patients with recent-onset Psychosis, a metaanalytic approach. Can J Psychiatry 2007; 52:464-472.
202. Edwards J, McGorry P. Implementing early intervention in psychosis: a guide to establishing early psychosis services. London: Martin Dunitz, 2002.
203. Grawe RW, Falloon IRH, Widen JH, Skogvoll E. Two years of continued early treatment for recent-onset schizophrenia: a randomised controlled study. Acta Psychiatr Scand 2006; 114: 328-336.
204. Thorup A, Petersen L, Jeppesen P et al. Integrated treatment ameliorates negative symptoms in first episode psychosis: results from the Danish OPUS trial. Schizophr Res 2005; 79: 95-105.
205. Bertelsen M, Jeppesen P, Petersen L et al. Five-year follow-up of a randomized multicenter trial of intensive early intervention vs standard treatment for patients with a first episode of psychotic illness. Arch Gen Psychiatry 2008; 65:762-771.
206. March JS, Silva SG, Compton S, Shapiro M, Califf R, Krishnan R. The case for practical clinical trials in psychiatry. Am J Psychiatry 2005; 162:836-846.
207. Fleischhacker WW, Widschwendter CG. Treatment of schizophrenia patients: comparing new-generation antipsychotics to each other. Curr Opin Psychiatry 2006; 19:128-134.
208. Stroup TS, Alves WM, Hamer RM, Lieberman JA. Clinical trials for antipsychotic drugs: design conventions, dilemmas and innovations. Nat Rev Drug Discov 2006; 5:133-146.
209. Kasper S, Winkler D. Addressing the limitations of the CATIE study. World J Biol Psychiatry 2006; 7:126-127.
210. Ragins M. Should the CATIE study be a wake-up call? Psychi-atr Serv 2005; 56:1489.
211. Davis JM, Chen N, Glick ID. A meta-analysis of the efficacy of second-generation antipsychotics. Arch Gen Psychiatry 2003; 60:553-564.
212. Leucht S, Corves C, Arbter D, Engel RR, Li CB, Davis JM. Second-generation versus first-generation antipsychotic drugs for schizophrenia: a meta-analysis. Lancet 2009; 373(9657):31-41.
213. Nasrallah HA, Meyer JM, Goff DC et al. Low rates of treatment for hypertension, dyslipidemia and diabetes in schizophrenia: data from the CATIE schizophrenia trial sample at baseline. Schizophr Res 2006; 86:15-22.
214. McEvoy JP, Lieberman JA, Perkins DO et al. Efficacy and tolerability of olanzapine, quetiapine, and risperidone in the treatment of early psychosis: a randomized, double-blind 52-week comparison. Am J Psychiatry 2007; 164:1050-1060.
215. Hotopf M, Churchill R, Lewis G. Pragmatic randomised controlled trials in psychiatry. Br J Psychiatry 1999; 175:217-223.
216. Hotopf M. The pragmatic randomised control trial. Adv Psychiatr Treat 2002; 8:326-333.
217. Rosenheck RA. Pharmacotherapy of first-episode schizophrenia. Lancet 2008; 371(9618):1048-1049.
218. D'Agostino RB. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998; 17(19):2265-2281.
219. Rubin DB. Estimating causal effects from large data sets using propensity scores. Ann Intern Med 1997; 127:757-763.
220. Sturmer T, Joshi M, Glynn RJ, Avorn J, Rothman KJ, Schneeweiss S. A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. J Clin Epidemiol 2006; 59:437-447.
221. McMahon AD. Approaches to combat with confounding by indication in observational studies of intended drug effects. Pharmacoepidemiol Drug Saf 2003; 12:551-558.
222. Foster EM. Propensity score matching: an illustrative analysis of dose response. Med Care 2003; 41:1183-1192.
223. Newhouse JP, McClellan M. Econometrics in outcomes research: the use of instrumental variables. Annu Rev Public Health 1998; 19:17-34.
224. Martens EP, Pestman WR, de Boer A, Belitser SV, Klungel OH. Instrumental variables application and limitations. Epidemiology 2006; 17:260-267.
225. Stukel TA, Fisher ES, Wennberg DE, Alter DA, Gottlieb DJ, Vermeulen MJ. Analysis of observational studies in the presence of treatment selection bias: effects of invasive cardiac management on AMI survival using propensity score and instrumental variable methods. JAMA 2007; 297:278-285.
226. McClellan M, McNeil BJ, Newhouse JP. Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? JAMA 1994; 272:859-866.
227. Fortney J, Rost K, Zhang ML, Warren J. The impact of geographic accessibility on the intensity and quality of depression treatment. Med Care 1999; 37:884-893.
228. Goldstein H. Multilevel statistical models, 2nd edn. New York: Halstead Press, 1995.
229. Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. London: Sage Publications, 2002.
230. Streiner D. The case of the missing data: methods of dealing with dropouts and other research vagaries. Res Methods Psychiatry 2002; 47:70-77.
231. Rosenbaum PR. Observational studies 2nd edn. New York: Springer-Verlag, 2002.
232. Scharfstein DO, Rotnitzky A, Robins JM. Adjusting for non-ignorable drop-out using semiparametric nonresponse models. J Am Stat Assoc 1999; 94(448):1096-1120.
233. Beunckens C, Molenberghs G, Thijs H, Verbeke G. Incomplete hierarchical data. Stat Methods Med Res 2007; 16:457-492.
234. Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. N Engl J Med 2000; 342(25): 1878-1886.
235. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000; 342(25):1887-1892.
236. Jablensky A, Sartorius N, Ernberg G et al. Schizophrenia: manifestations, incidence and course in different cultures. Psychol Med 1992; (Suppl 20):1-97.
237. Kirkbride JB, Fearon P, Morgan C et al. Heterogeneity in incidence rates of schizophrenia and other psychotic syndromes: findings from the 3-center AESOP study. Arch Gen Psychiatry 2006; 63:250-258.
238. Bebbington P, Ramana R. The epidemiology of bipolar affective disorder. Soc Psychiatry Psychiatr Epidemiol 1995; 30:279-292.
239. Peraala J, Suvisaari J, Saarni SI et al. Lifetime prevalence of psychotic and bipolar I disorders in a general population. Arch Gen Psychiatry 2007; 64:19-28.
240. Saha S, Chant D, Welham J, McGrath J. A systematic review of the prevalence of schizophrenia. PLoS Med 2005; 2:413-433.
241. Baldwin P, Browne D, Scully PJ et al. Epidemiology of first-episode psychosis: illustrating the challenges across diagnostic boundaries through the Cavan-Monaghan study at 8 years. Schiz-ophr Bull 2005; 31:624-638.
242. Singh SP, Burns T, Amin S, Jones PB, Harrison G. Acute and transient psychotic disorders: precursors, epidemiology, course and outcome. Br J Psychiatry 2004; 185:452-459.
243. Sajith SG, Chandrasekaran R, Unni KES, Sahai A. Acute polymorphic psychotic disorder: diagnostic stability over 3 years. Acta Psychiatr Scand 2002; 105:104-109.
244. Jorgensen P, Bennedsen B, Christensen J, Hyllested A. Acute and transient psychotic disorder: a 1-year follow-up study. Acta Psychiatr Scand 1997; 96:150-154.
245. Morgan C, Mallett R, Hutchinson G et al. Pathways to care and ethnicity. I: sample characteristics and compulsory admission - report from the AESOP study. Br J Psychiatry 2005; 186: 281-289.
246. Morgan C, Fearon P, Hutchinson G et al. Duration of untreated psychosis and ethnicity in the AESOP first-onset psychosis study. Psychol Med 2006; 36:239-247.
247. Hafner H, Maurer K, Ruhrmann S et al. Early detection and secondary prevention of psychosis: facts and visions. Eur Arch Psychiatry Clin Neurosci 2004; 254:117-128.
248. Hafner H, Maurer K, Trendler G, an der Heiden W, Schmidt M, Konnecke R. Schizophrenia and depression: challenging the paradigm of two separate diseases - a controlled study of schizophrenia, depression and healthy controls. Schizophr Res 2005; 77:11-24.
249. Friis S, Larsen TK, Melle I et al. Methodological pitfalls in early detection studies: the NAPE Lecture 2002. Acta Psychiatr Scand 2003; 107:3-9.
250. O'Toole BI. Screening for low prevalence disorders. Aust N Z J Psychiatry 2000; 34:S39-S46.
251. Jablensky A. Prevalence and incidence of schizophrenia spectrum disorders: implications for prevention. Aust N Z J Psychiatry 2000; 34:S26-S34.
252. Amminger GP, Harris MG, Conus P et al. Treated incidence of first-episode psychosis in the catchment area of EPPIC between 1997 and 2000. Acta Psychiatr Scand 2006; 114:337-345.
253. Lieberman JA, Perkins D, Belger A et al. The early stages of schizophrenia: speculations on pathogenesis, pathophysiology, and therapeutic approaches. Biol Psychiatry 2001; 50:884-897.
254. Hafner H, Loffler W, Maurer K, Hambrecht M, an der Heiden W. Depression, negative symptoms, social stagnation and social decline in the early course of schizophrenia. Acta Psychiatr Scand 1999; 100:105-118.
255. Job DE, Whalley HC, Johnstone EC, Lawrie SM. Grey matter changes over time in high risk subjects developing schizophrenia. Neuroimage 2005; 25:1023-1030.
256. Bilder RM, Reiter G, Bates J et al. Cognitive development in schizophrenia: follow-back from the first episode. J Clin Exp Neuropsychol 2006; 28:270-282.
257. McGorry PD, Yung AR, Bechdolf A, Amminger P. Back to the future: predicting and reshaping the course of psychotic disorder. Arch Gen Psychiatry 2008; 65:25-27.
258. Catts S. Identifying the young person at risk of psychosis. Med Today 2008; 9:961-965.
259. Phillips CD. What do you do for a living? Toward a more succinct definition of health services research. BMC Health Serv Res 2006; 6:117.
260. Scott I, Campbell D. Health services research: what is it and what does it offer? Intern Med J 2002; 32:91-99.
261. Scallet LJ, Robinson GK. Opportunities in mental health services research. Health Aff (Millwood) 1993; 12:240-250.
262. Wells K, Miranda J, Bruce ML, Alegria M, Wallerstein N. Bridging community intervention and mental health services research. Am J Psychiatry 2004; 161:955-963.
263. Burns T, Creed F, Fahy T, Thompson S, Tyrer J, White I for the UK 700 Group. Intensive versus standard case management for severe psychotic illness: a randomised trial. Lancet 1999; 354:1128.
264. Marshall M, Gray A, Lockwood A, Green R. Case management for people with severe mental disorders. Cochrane Database Syst Rev 1998; (2):CD000050.
265. Burns T, Creed F, Fahy T et al. Intensive versus standard case management for severe psychotic illness: a randomised trial. Lancet 1999; 353(9171):2185-2189.
266. Wykes T, Leese M, Taylor R, Phelan M. Effects of community services on disability and symptoms: PRiSM Psychosis Study 4. Br J Psychiatry 1998; 173:385-390.
267. McGovern D, Owen A. Intensive case management for severe psychotic illness. Lancet 1999; 354(9187):1384.
268. Marshall M, Bond G, Stein LI et al. PRiSM psychosis study: design limitations, questionable conclusions. Br J Psychiatry 1999; 175:501-503.
269. Slade M, Kuipers E, Priebe S. Mental health services research methodology. Int Rev Psychiatry 2002; 14:12-18.
270. Kazdin AE. Almost clinically significant (p < .10): current measures may only approach clinical significance. Clin Psychol Sci Pract 2001; 8:455-462.
271. Scheirer MA. A user's guide to program templates: a new tool for evaluating program content. San Francisco, CA: Jossey-Bass, 1996.
272. Sechrest L, Phillips MA, Redner R, Yeaton W. Some neglected problems in evaluation research: strength and integrity of treatments. Beverly Hills, CA: Sage Publications, 1979.
273. Yeaton WH, Sechrest L. Critical dimensions in the choice and maintenance of successful treatments: strength, integrity, and effectiveness. J Consult Clin Psychol 1981; 49:156-167.
274. Teague GB, Bond GR, Drake RE. Program fidelity in assertive community treatment: development and use of a measure. Am J Orthopsychiatry 1998; 68:216-232.
275. McGrew JH, Bond GR, Dietzen L, Salyers M. Measuring the fidelity of implementation of a mental health program model. J Consult Clin Psychol 1994; 62:670-678.
276. McGrew JH, Bond GR. Critical ingredients of assertive community treatment: judgments of the experts. J Ment Health Adm 1995; 22:113-125.
277. Bond GR, Williams J, Evans L, Salyers M, Kim H-W, Sharpe H. Psychiatric rehabilitation fidelity toolkit. Cambridge, MA: Evaluation Centre, Human Services Research Institute, 2000.
278. Teague GB, Drake RE, Ackerson TH. Evaluating use of continuous treatment teams for persons with mental illness and substance abuse. Psychiatr Serv 1995; 46:689-695.
279. Mueser KT, Fox L, Bond GR, Salyers M, Yamamoto K, Williams J. Dual-disorder Treatment Fidelity Scale. In: Mueser KT, Noordsy DL, Drake RE, Fox L, eds. Integrated treatment for dual disorder. New York: Guilford Press, 2003:337-354.
280. Substance Abuse and Mental Health Services Administration. Co-occurring disorders: integrated dual disorders treatment. US Dept Health and Human Services, 2003. [cited 5/1/10.] Available from URL: http://mentalhealth.samhsa.gov/cmhs/communitysupport/toolkits/cooccurring
281. McFarlane WR, Dixon L, Lukens E, Lucksted A. Family psych-oeducation and schizophrenia: a review of the literature. J Marital Fam Ther 2003; 29:223-245.
282. Madson MB, Campbell TC Measures of fidelity in motivational enhancement: a systematic review. J Subst Abuse Treat 2006; 31:67-73.
283. Bruns EJ, Suter JC, Leverentz-Brady KM. Relations between program and system variables and fidelity to the wraparound process for children and families. Psychiatr Serv 2006; 57:1586-1593.
284. Nordness P, Epstein M. Reliability of the Wraparound Observation Form - second version: an instrument designed to assess the fidelity of the wraparound approach. Ment Health Serv Res 2003; 5:89-96.
285. Walker J, Bruns E. Building on practice-based evidence: using expert perspectives to define the wraparound process. Psychiatr Serv 2006; 57:1579-1585.
286. Marshall M, Lockwood A, Lewis S, Fiander M. Essential elements of an early intervention service for psychosis: the opinions of expert clinicians. BMC Psychiatry 2004; 4:17.
287. McCrone P, Knapp M. Economic evaluation of early intervention services. Br J Psychiatry 2007; 191:S19-S22.
288. Nordentoft M, Jeppesen P, Petersen L et al. Opus project: a randomised, controlled trial of integrated psychiatric treatment in first episode psychosis. Schizophr Res 2003; 60:297.
289. Kuipers E, Holloway F, Rabe-Hesketh S, Tennakoon L. An RCT of early intervention in psychosis: Croydon Outreach and Assertive Support Team (COAST). Soc Psychiatry Psychiatr Epidemiol 2004; 39:358-363.
290. Mihalopoulos C, McGorry PD, Carter RC. Is phase-specific, community-oriented treatment of early psychosis an economically viable method of improving outcome? Acta Psychiatr Scand 1999; 100:47-55.
291. Salvador-Carulla L, Haro JM, Cabases J, Madoz V, Sacristan JA, Vazquez-Barquero JL. Service utilization and costs of first-onset schizophrenia in two widely differing health service areas in North-East Spain. Acta Psychiatr Scand 1999; 100: 335-343.
292. Valmaggia L, McCrone P, Knapp M et al. Economic impact of an early intervention in people at high risk of psychosis. Psychol Med 2009; 39:1617-1626.
293. Cullberg J, Mattsson M, Levander S et al. Treatment costs and clinical outcome for first episode schizophrenia patients: a 3-year follow-up of the Swedish 'Parachute Project' and Two Comparison Groups. Acta Psychiatr Scand 2006; 114:274-281.
294. Goldberg K, Norman R, Hoch J et al. Impact of a specialized early intervention service for psychotic disorders on patient characteristics, service use, and hospital costs in a defined catchment area. Can J Psychiatry 2006; 51:895-903.
295. Mihalopoulos C, Harris M, Henry L, Harrigan S, McGorry P. Is early intervention in psychosis cost-effective over the long term? Schizophr Bull 2009; 35:909-918.
296. Access Economics. Cost effectiveness of early intervention for psychosis. Melbourne: Access Economics for ORYGEN Research Centre, 2008.
297. Institute of Medicine of the National Academies. To err is human: building a safer health system. Washington, DC: National Academies Press, 2000.
298. Institute of Medicine of the National Academies. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: Institute of Medicine, 2002.
299. Berwick DM. A user's manual for the IOM's 'quality chasm' report. Health Aff (Millwood) 2002; 21(3):80-90.
300. World Health Organization. Quality improvement for mental health, Report No.: 9241545976. Geneva: World Health Organization, 2003.
301. Institute of Medicine of the National Academies. Improving the quality of health care for mental and substance-use conditions. Washington, DC: National Academies Press, 2006.
302. Skok A, Swerissen H, Macmillan J. Standards and quality improvement processes in health and community services: a review of the literature. Canberra: Commonwealth Department of Health and Aged Care, 2000.
303. Lynn J, Baily MA, Bottrell M et al. The ethics of using quality improvement methods in health care. Ann Intern Med 2007; 146:666-673.
304. NHMRC. When does quality assurance in health care require independent ethical review? Canberra: Commonwealth of Australia, 2003.
305. Leyland AH, Goldstein H. Multilevel modelling of health statistics. Chichester: John Wiley and Sons, 2001.
306. Rogosa D, Brandt D, Zimowski M. A growth curve approach to the measurement of change. Psychol Bull 1982; 92:726-748.
307. Glover G, Kamis-Gould E. Performance indicators in mental health services. In: Thornicroft G, Strathdee G, eds. Commissioning mental health services. London: HMSO, 1996:265-272.
308. Arya D, Callay T. Using continuous quality improvement to implement a clinical governance framework in a mental health service. Australas Psychiatry 2005; 13:241-246.
309. Tobin M, Yeo F, Chen L. The beginning of a structural reform: reorganizing the front line of a mental health system. Aust Health Rev 2000; 23:64-76.
310. Berk M, Callaly T, Hyland M. The evolution of clinical audit as a tool for quality improvement. J Eval Clin Pract 2003; 9:251-257.
311. McFarland D, Harmann L, Lhotak C, Wieselthier VF. The quest for TQM in a community mental health center: using the Bald-rige criteria as a framework. Jt Comm J Qual Improv 1996; 22:37-47.
312. Hermann RC, Regner JL, Erickson P, Yang DW. Developing a quality management system for behavioral health care: the Cambridge health alliance experience. Harv Rev Psychiatry 2000; 8:251-260.
313. Coop CF. Balancing the balanced scorecard for a New Zealand mental health service. Aust Health Rev 2006; 30:174.
314. Tobin MJ, Hickie IB, Yeo FM, Chen L. Discussing the impact of first onset psychosis programs on public sector health services. Australas Psychiatry 1998; 6:181-182.
315. Chong SA, Verma S, Mythily S, Poon LY, McGorry PD. The Early Psychosis Intervention Programme in Singapore: a balanced scorecard approach to quality care. J Ment Health 2008; 17:79-91.
316. Addington D, McKenzie E, Addington J, Patten S, Smith H, Adair C. Performance measures for early psychosis treatment services. Psychiatr Serv 2005; 56:1570-1582.
317. Chong SA, Lee C, Bird L, Verma S. A risk reduction approach for schizophrenia: the early psychosis intervention programme. Ann Acad Med Sing 2004; 33:630-635.
318. Catts SV, O'Donnell M, Spencer EA et al. Early psychosis intervention in routine service environments: implications for case management and service evaluation. In: Kashima H, Falloon IRH, Mizuno M, Asai M, eds. Comprehensive treatment of schizophrenia. Tokyo: Springer-Verlag, 2002.
319. Yung AR, Harris M. Management of early psychosis in a generic adult mental health service. Aust N Z J Psychiatry 2003; 37:429-436.
320. Turner M, Smith-Hamel C, Mulder R. Pathways to care in a New Zealand first-episode of psychosis cohort. Aust N Z J Psychiatry 2006; 40:421-428.
321. Malla A, Schmitz N, Norman R et al. A multisite Canadian study of outcome of first-episode psychosis treated in publicly funded early intervention services. Can J Psychiatry 2007; 52:563-571.
322. O'Kearney R, Garland G, Welch M, Kanowski L, Fitzgerald S. Factors predicting program fidelity and delivery of an early intervention program for first episode psychosis in rural Australia. Aust e-J Adv Ment Health 2004; 3(2):1-9.
323. Field MJ, Lohr KN. Clinical practice guidelines: directions for a new program. Washington, DC: Institute of Medicine, National Academy Press, 1990.
324. Lehman AF, Steinwachs DM. Patterns of usual care for schizophrenia: initial results from the Schizophrenia Patient Outcomes Research Team (PORT) client survey. Schizophr Bull 1998; 24: 11-20.
325. Bauer MS. A review of quantitative studies of adherence to mental health clinical practice guidelines. Harv Rev Psychiatry 2002; 10:138-153.
326. Gorrell J, Cornish A, Tennant C et al. Changes in early psychosis service provision: a file audit. Aust N Z J Psychiatry 2004; 38:687-693.
327. Hanson LA, Grypma M, Tee KA, MacEwan GW. Evaluation of a community mental health carepath for early psychosis. J Eval Clin Pract 2006; 12:112-119.
328. Reilly J, Newton R, Dowling R. Implementation of a first presentation psychosis clinical pathway in an area mental health service: the trials of a continuing quality improvement process. Australas Psychiatry 2007; 15:14-18.
329. Mental Health Research Network. A national evaluation of early intervention for psychosis services: DUP, service engagement and outcome. UK National Institute for Health Research, 2005. [cited 5 January 2010.] Available from URL: www.mhrn.info/index/portfolio/Studies/Psychosis/NationalEDEN.html
330. Fisher H, Theodore K, Power P et al. Routine evaluation in first episode psychosis services: feasibility and results from the MiData Project. Soc Psychiatry Psychiatr Epidemiol 2008; 43:960-967.
331. Catts SV, Carr VC, O'Toole BI et al. Variance components model predicting outcome in a multi-site, multilevel study of early psychosis treatment. Schizophr Bull 2007; 33:584-585.
332. Haro JM, Edgell ET, Novick D et al. Effectiveness of antipsy-chotic treatment for schizophrenia: 6-month results of the Pan-European Schizophrenia Outpatient Health Outcomes (SOHO) study. Acta Psychiatr Scand 2005; 111:220-231.
333. Haro JM, Salvador-Carulla L. The SOHO (schizophrenia outpatient health outcome) study: implications for the treatment of schizophrenia. CNS Drugs 2006; 20:293-301.
334. Gasquet I, Haro JM, Novick D, Edgell ET, Kennedy L, Lepine JP. Pharmacological treatment and other predictors of treatment outcomes in previously untreated patients with schizophrenia: results from the European Schizophrenia Outpatient Health Outcomes (SOHO) study. Int Clin Psychopharmacol 2005; 20:199-205.
335. McGorry P, Edwards J, Mihalopolous C, Harrigan S, Jackson H. EPPIC: An evolving system of early detection and optimal management. Schizophr Bull 1996:305-326.
336. Cassidy CM, Schmitz N, Norman R, Manchanda R, Malla A. Long-term effects of a community intervention for early identification of first-episode psychosis. Acta Psychiatr Scand 2008; 117:440-448.
337. Joa I, Johannessen JO, Auestad B et al. The key to reducing duration of untreated first psychosis: information campaigns. Schizophr Bull 2008; 34:466-472.
338. Larsen TK, McGlashan TH, Johannessen JO et al. Shortened duration of untreated first episode of psychosis: changes in patient characteristics at treatment. Am J Psychiatry 2001; 158:1917-1919.
339. Rosenbaum B, Valbak K, Harder S et al. The Danish National Schizophrenia Project: prospective, comparative longitudinal treatment study of first-episode psychosis. Br J Psychiatry 2005; 186:394-399.
340. Melle I, Larsen TK, Haahr U et al. Prevention of negative symptom psychopathologies in first-episode schizophrenia. Arch Gen Psychiatry 2008; 65:634-640.
341. Schultze-Lutter F, Picker H, Ruhrmann S, Klosterkotter J. The Cologne early recognition and intervention center for mental crises (FETZ). Evaluation of service use. Med Klin 2008; 103(2):81-89.
342. Fossey E, Harvey C, McDermott F, Davidson L. Understanding and evaluating qualitative research. Aust N Z J Psychiatry 2002; 36:717-732.
343. Judge AM, Estroff SE, Perkins DO, Penn DL. Recognizing and responding to early psychosis: a qualitative analysis of individual narratives. Psychiatr Serv 2008; 59:96-99.
344. Larsen TK, Johannesen JO, McGlashan T, Horneland M, Mardal S, Vaglum P. Can duration of untreated illness be reduced? In: Birchwood M, Fowler D, Jackson C, eds. Early intervention in psychosis. Chichester: John Wiley and Sons, 2000:143-165.
345. Melle I, Larsen TK, Haahr U et al. Reducing the duration of untreated first-episode psychosis: effects on clinical presentation. Arch Gen Psychiatry 2004; 61:143-150.
346. Johannessen JO, McGlashan TH, Larsen TK et al. Early detection strategies for untreated first-episode psychosis. Schizophr Res 2001; 51:39-46.
347. Larsen TK, Melle I, Auestad B et al. Early detection of first-episode psychosis: the effect on 1-year outcome. Schizophr Bull 2006; 32:758-764.
348. Larsen TK, Melle I, Friis S et al. One-year effect of changing duration of untreated psychosis in a single catchment area. Br J Psychiatry 2007; 191:S128-S32.
349. Maclure M. Taxonomic axes of epidemiologic study designs: a refutationist perspective. J Clin Epidemiol 1991; 44:1045-1053.
350. Garety PA, Craig TKJ, Dunn G et al. Specialised care for early psychosis: symptoms, social functioning and patient satisfaction: randomised controlled trial. Br J Psychiatry 2006; 188:37-45.
351. Amminger GP, Schafer MR, Papageorgiou K et al. Relationship between erythrocyte membrane fatty acids and transition to psychosis in ultra-high risk individuals: basic research findings from a RCT. Schizophr Bull 2009; 35:375.
352. Berk M, Copolov D, Dean O et al. N-acetyl cysteine as a glutath-ione precursor for schizophrenia: a double-blind, randomized, placebo-controlled trial. Biol Psychiatry 2008; 64:361-368.
353. Patil ST, Zhang L, Martenyi F et al. Activation of mGlu2/3 receptors as a new approach to treat schizophrenia: a randomized Phase 2 clinical trial. Nat Med 2007; 13:1102-1107.
354. Vonkorff M, Nestadt G, Romanoski A et al. Prevalence of treated and untreated DSM-III schizophrenia: results of a two-stage community survey. J Nerv Ment Dis 1985; 173:577-581.
355. Kessler RC, Berglund PA, Bruce ML et al. The prevalence and correlates of untreated serious mental illness. Health Serv Res 2001; 36:987-1007.
356. Alvarez-Jimenez M, Parker A, Hetrick SE, McGorry PD, Gleeson JF. Preventing the second episode: a systematic review and meta-analysis of psychosocial and pharmacological trials in first-episode psychosis. Schiz Bull, DOI: 10.1093/schbul/sbp129
357. Wright A, McGorry PD, Harris MG, Jorm AF, Pennell K. Development and evaluation of a youth mental health community awareness campaign: the Compass Strategy. BMC Public Health 2006; 6:215.
358. International Early Psychosis Association Writing Group. International Clinical Practice Guidelines for early psychosis. Br J Psychiatry 2005; 187(Suppl 48):120-124.
359. Truswell A. Levels and kinds of evidence for public-health nutrition. Lancet 2001; 357(9262):1061-1062.
360. Naylor CD. Grey zones of clinical practice: some limits to evidence-based medicine. Lancet 1995; 345(8953):840-842.
361. Evans R, Catts SV, O'Toole BI et al. Is a national framework for implementing early psychosis services necessary? Results of a survey of Australian mental health service directors. Early Interv Psychiatry (in press).
362. Hay P, Mulder R, Boyce P. The scientific practitioner in psychiatry for the 21st century. Australas Psychiatry 2003; 11:442-445.