The end of the primary outcome measure: A research agenda for constructing its replacement

Clinical Psychology Review

Volumn 31, Issue 5, 2011, Pages 829-838

  De Los Reyes, Andres ^a   Kundey, Shannon M A ^b   Wang, Mo ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b HOOD COLLEGE   (United States)

Author keywords

Controlled trial; Efficacy; Primary outcome measure; Standardized replication rate; Treatment

Indexed keywords

CLINICAL EFFECTIVENESS; CONTROLLED CLINICAL TRIAL (TOPIC); HUMAN; MEDICAL RESEARCH; MENTAL DISEASE; METHODOLOGY; OUTCOME ASSESSMENT; REVIEW;

CLINICAL TRIALS AS TOPIC; HUMANS; RESEARCH DESIGN; TREATMENT OUTCOME;

EID: 79955519078     PISSN: 02727358     EISSN: 18737811     Source Type: Journal    
DOI: 10.1016/j.cpr.2011.03.011     Document Type: Review

References (78)

1. Achenbach T.M. As others see us: Clinical and research implications of cross-informant correlations for psychopathology. Current Directions in Psychological Science 2006, 15:94-98.
2. Achenbach T.M., Rescorla L.A. Manual for the ASEBA school-age forms & profiles 2001, University of Vermont, Research Center for Children, Youth, & Families, Burlington.
3. American Psychiatric Association Diagnostic and statistical manual of mental disorders 2000, Author, Washington, DC. 4th ed., text rev.
4. American Psychological Association Interdivisional Task Force on Child and Adolescent Mental Health Links for finding evidence-based interventions Retrieved April 10, 2011, from. http://ucoll.fdu.edu/apa/lnksinter.html.
5. Arseneault L., Moffitt T., Caspi A., Taylor A., Rijsdijk F., Jaffee S., et al. Strong genetic effects on cross-situational antisocial behaviour among 5-year-old children according to mothers, teachers, examiner-observers, and twins' self-reports. Journal of Child Psychology and Psychiatry 2003, 44:832-848.
6. Birmaher B., Axelson D.A., Monk K., Kalas C., Clark D.B., Ehmann M., et al. Fluoxetine for the treatment of childhood anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry 2003, 42:415-423.
7. Blue Cross and Blue Shield of Texas (BCBSTX) BCBSTX evidence based measures program Retrieved April 10, 2011, from. http://www.bcbstx.com/bluecompare/ebm.htm.
8. Borsboom D. Measuring the mind 2005, Cambridge University Press, New York.
9. Boutron I., Dutton S., Ravaud P., Altman D.G. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. Journal of the American Medical Association 2010, 303:2058-2064.
10. Bowden C.L., Calabrese J.R., McElroy S.L., Gyulai L., Wassef A., Petty F., et al. A randomized, placebo-controlled 12-month trial of divalproex and lithium in treatment of outpatients with bipolar I disorder. Archives of General Psychiatry 2000, 57:481-489.
11. Casey R.J., Berman J.S. The outcomes of psychotherapy with children. Psychological Bulletin 1985, 98:388-400.
12. Caspi A., Hariri A.R., Holmes A., Uher R., Moffitt T.E. Genetic sensitivity to the environment: The case of the serotonin transporter gene and its implications for studying complex diseases and traits. American Journal of Psychiatry 2010, 167:509-527.
13. Chambless D.L., Ollendick T.H. Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology 2001, 52:685-716.
14. Clark D.B., Birmaher B., Axelson D., Monk K., Kalas C., Ehmann M., et al. Fluoxetine for the treatment of childhood anxiety disorders: Open-label, long-term extension to a controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry 2005, 44:1263-1270.
15. Cohen J. Statistical power analysis for the behavioral sciences 1988, Erlbaum, Mahwah, NJ. 2nd ed.
16. Cuijpers P., Li J., Hofman S.G., Andersson G. Self-reported versus clinician-rated symptoms of depression as outcome measures in psychotherapy research on depression: A meta-analysis. Clinical Psychology Review 2010, 30:768-778.
17. De Angelis C., Drazen J.M., Frizelle F.A., Haug C., Hoey J., Horton R., et al. Clinical trial registration: A statement from the International Committee of Medical Journal Editors. New England Journal of Medicine 2004, 351:1250-1251.
18. De Los Reyes A. Introduction to the special section. More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology 2011, 40:1-9.
19. De Los Reyes A., Alfano C.A., Beidel D.C. The relations among measurements of informant discrepancies within a multisite trial of treatments for childhood social phobia. Journal of Abnormal Child Psychology 2010, 38:395-404.
20. De Los Reyes A., Alfano C.A., Beidel D.C. Are clinicians' assessments of improvements in children's functioning "global"?. Journal of Clinical Child and Adolescent Psychology 2011, 40:281-294.
21. De Los Reyes A., Henry D.B., Tolan P.H., Wakschlag L.S. Linking informant discrepancies to observed variations in young children's disruptive behavior. Journal of Abnormal Child Psychology 2009, 37:637-652.
22. De Los Reyes A., Kazdin A.E. Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin 2005, 131:483-509.
23. De Los Reyes A., Kazdin A.E. Conceptualizing changes in behavior in intervention research: The range of possible changes model. Psychological Review 2006, 113:554-583.
24. De Los Reyes A., Kazdin A.E. When the evidence says, "Yes, no, and maybe so": Attending to and interpreting inconsistent findings among evidence-based interventions. Current Directions in Psychological Science 2008, 17:47-51.
25. De Los Reyes A., Kazdin A.E. Identifying evidence-based interventions for children and adolescents using the range of possible changes model: A meta-analytic illustration. Behavior Modification 2009, 33:583-617.
26. De Los Reyes A., Youngstrom E.A., Pabón S.C., Youngstrom J.K., Feeny N.C., Findling R.L. Internal consistency and associated characteristics of informant discrepancies in clinic referred youths age 11 to 17years. Journal of Clinical Child and Adolescent Psychology 2011, 40:36-53.
27. Frank E., Prien R.F., Jarrett R.B., Keller M.B., Kupfer D.J., Lavori P.W., et al. Conceptualization and rationale for consensus definitions of terms in major depressive disorder. Archives of General Psychiatry 1991, 48:851-855.
28. Gizer I., Waldman I., Abramowitz A., Barr C., Feng Y., Wigg K., et al. Relations between multi-informant assessments of ADHD symptoms, DAT1, and DRD4. Journal of Abnormal Psychology 2008, 117:869-880.
29. Goodman S., Lahey B., Fielding B., Dulcan M., Narrow W., Regier D. Representativeness of clinical samples of youths with mental disorders: A preliminary population-based study. Journal of Abnormal Psychology 1997, 106:3-14.
30. Groth-Marnat G. Handbook of psychological assessment 2009, Wiley & Sons, Hoboken. 5th ed.
31. Guy W. ECDEU assessment manual for psychopharmacology 1976, DHEW, Washington, DC.
32. Hamilton M. A rating scale for depression. Journal of Neurology, Neurosurgery, and Psychiatry 1960, 23:56-62.
33. Hartley A.G., Zakriski A.L., Wright J.C. Probing the depths of informant discrepancies: Contextual influences on divergence and convergence. Journal of Clinical Child and Adolescent Psychology 2011, 40:54-66.
34. Hawley K.M., Weisz J.R. Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist's dilemma and its implications. Journal of Consulting and Clinical Psychology 2003, 71:62-70.
35. Hazell P.L., Stuart J.E. A randomized controlled trial of clonidine added to psychostimulant medication for hyperactive and aggressive children. Journal of the American Academy of Child and Adolescent Psychiatry 2003, 42:886-894.
36. Hempel C.G. Philosophy of natural science 1966, Prentice-Hall, Englewood Cliffs, NJ.
37. Holmbeck G., Li S., Schurman J., Friedman D., Coakley R. Collecting and managing multisource and multimethod data in studies of pediatric populations. Journal of Pediatric Psychology 2002, 27:5-18.
38. Hunsley J., Mash E.J. Evidence-based Assessment. Annual Review of Clinical Psychology 2007, 3:29-51.
39. Joiner T.E., Walker R.L., Pettit J.W., Perez M., Cukrowicz K.C. Evidence-based assessment of depression in adults. Psychological Assessment 2005, 17:267-277.
40. Kazdin A.E. Research design in clinical psychology 2003, Allyn & Bacon, Boston. 4th ed.
41. Kazdin A.E. Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist 2008, 63:146-159.
42. Knopman D.S., Knapp M.J., Gracon S.I., Davis C.S. The Clinician Interview-Based Impression (CIBI): A clinician's global change rating scale in Alzheimer's disease. Neurology 1994, 44:2315-2321.
43. Koenig K., De Los Reyes A., Cicchetti D., Scahill L., Klin A. Group intervention to promote social skills in school-age children with pervasive developmental disorders: Reconsidering efficacy. Journal of Autism and Developmental Disorders 2009, 39:1163-1172.
44. Kraemer H.C., Measelle J.R., Ablow J.C., Essex M.J., Boyce W.T., Kupfer D.J. A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. The American Journal of Psychiatry 2003, 160:1566-1577.
45. Kramer T.L., Phillips S.D., Hargis M.B., Miller T.L., Burns B.J., Robbins J.M. Disagreement between parent and adolescent reports of functional impairment. Journal of Child Psychology and Psychiatry 2004, 45:248-259.
46. Lambert M.J., Hatch D.R., Kingston M.D., Edwards B.C. Zung, Beck, and Hamilton Rating Scales as measures of treatment outcome: A meta-analytic comparison. Journal of Consulting and Clinical Psychology 1986, 54:54-59.
47. Loeber R., Green S.M., Lahey B.B. Mental health professionals' perception of the utility of children, mothers, and teachers as informants of childhood psychopathology. Journal of Clinical Child Psychology 1990, 19:136-143.
48. Lofthouse N., Fristad M., Splaingard M., Kelleher K. Parent and child reports of sleep problems associated with early-onset bipolar spectrum disorders. Journal of Family Psychology 2007, 21:114-123.
49. Lord C.G., Ross L., Lepper M.R. Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence. Journal of Personality and Social Psychology 1979, 37:2098-2109.
50. Developing guidelines for the evidence-based assessment of child and adolescent disorders [Special issue]. Journal of Clinical Child and Adolescent Psychology 2005, 34. E.J. Mash, J. Hunsley (Eds.).
51. Monroe S.M., Reid M.W. Gene-environment interactions in depression research. Psychological Science 2008, 19:947-956.
52. Multimodal Treatment Study of Children with Attention-Deficit/Hyperactivity Disorder Cooperative Group A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Archives of General Psychiatry 1999, 56:1073-1086.
53. Niederhofer H., Staffen W., Mair A. A placebo-controlled study of lofexidine in the treatment of children with tic disorders and attention deficit hyperactivity disorder. Journal of Psychopharmacology 2003, 17:113-119.
54. Offord D., Boyle M., Racine Y., Szatmari P., Fleming J.E., Sanford M., et al. Integrating assessment data from multiple informants. Journal of the American Academy of Child and Adolescent Psychiatry 1996, 35:1078-1085.
55. Ogles B.M., Lambert M.J., Weight D.G., Payne I.R. Agoraphobia outcome measurement: A review and meta-analysis. Psychological Assessment 1990, 2:317-325.
56. Papakostas G.I., Mischoulon D., Shyu I., Alpert J.E., Fava M. S-Adenosyl methionine (SAMe) augmentation of serotonin reuptake inhibitors for antidepressant nonresponders with major depressive disorder: A double-blind, randomized clinical trial. American Journal of Psychiatry 2010, 167:942-948.
57. Pettinati H.M., Oslin D.W., Kampman K.M., Dundon W.D., Xie H., Gallis T.L., et al. A double-blind, placebo-controlled trial combining sertraline and naltrexone for treating co-occurring depression and alcohol dependence. Archives of General Psychiatry 2010, 167:668-675.
58. Piacentini J., Cohen P., Cohen J. Combining discrepant diagnostic information from multiple sources: Are complex algorithms better than simple ones?. Journal of Abnormal Child Psychology 1992, 20:51-63.
59. Rosenthal R., DiMatteo M.R. Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology 2001, 52:59-82.
60. Rubio-Stipec M., Fitzmaurice G., Murphy J., Walker A. The use of multiple informants in identifying the risk factors of depressive and disruptive disorders: Are they interchangeable?. Social Psychiatry and Psychiatric Epidemiology 2003, 38:51-58.
61. Sagan, C. (Writer/Host). (1980, December 14). Cosmos (12): Encyclopaedia galactica [Television Broadcast]. Arlington, VA: PBS. Viewed October 14, 2010.
62. Scahill L., Riddle M.A., McSwiggin-Hardin M., Ort S.I., King R.A., Goodman W.K., et al. Children's Yale-Brown Obsessive Compulsive Scale: Reliability and validity. Journal of the American Academy of Child and Adolescent Psychiatry 1997, 36:844-852.
63. Shear M.K., Rucci P., Williams J., Frank E., Grochocinski V., Bilt J.V., et al. Reliability and validity of the Panic Disorder Severity Scale: Replication and extension. Journal of Psychiatric Research 2001, 35:293-296.
64. Spearing M.K., Post R.M., Leverich G.S., Brandt D., Nolen W. Modification of the Clinical Global Impressions (CGI) Scale for use in bipolar illness (BP): The CGI-BP. Psychiatry Research 1997, 73:159-171.
65. Thurstone C., Riggs P.D., Salomonsen-Sautel S., Mikulich-Gilbertson S.K. Randomized, controlled trial of atomoxetine for attention-deficit/hyperactivity disorder in adolescents with substance use disorder. Journal of the American Academy of Child and Adolescent Psychiatry 2010, 49:573-582.
66. Wagner K.D., Berard R., Stein M.B., Wetherhold E., Carpenter D.J., Perera P., et al. A multicenter, randomized, double-blind, placebo-controlled trial of paroxetine in children and adolescents with social anxiety disorder. Archives of General Psychiatry 2004, 61:1153-1162.
67. Wechsler D. Wechsler Adult Intelligence Scale 2008, Pearson, San Antonio. 4th ed.
68. Wechsler D. Wechsler Intelligence Scale for Children 2008, Pearson, San Antonio. 4th ed.
69. Weisz J.R., Hawley K.M., Jensen Doss A. Empirically tested psychotherapies for youth internalizing and externalizing problems and disorders. Child and Adolescent Psychiatric Clinics of North America 2004, 13:729-815.
70. Weisz J.R., Jensen Doss A., Hawley K.M. Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology 2005, 56:337-363.
71. Weisz J.R., Jensen Doss A., Hawley K.M. Evidence-based youth psychotherapies versus usual clinic care: A meta-analysis of direct comparisons. American Psychologist 2006, 61:671-689.
72. Weisz J.R., McCarty C.A., Valeri S.M. Effects of psychotherapy for depression in children and adolescents: A meta-analysis. Psychological Bulletin 2006, 132:132-149.
73. Young R.C., Biggs J.T., Ziegler V.E., Meyer D.A. A rating scale for mania: Reliability, validity, and sensitivity. The British Journal of Psychiatry 1978, 133:429-435.
74. Youngstrom E., Findling R., Calabrese J. Who are the comorbid adolescents? Agreement between psychiatric diagnosis, youth, parent, and teacher report. Journal of Abnormal Child Psychology 2003, 31:231-245.
75. Zaider T.I., Heimberg R.G., Fresco D.M., Schneier F.R., Liebowitz M.R. Evaluation of the Clinical Global Impression Scale among individuals with social anxiety disorder. Psychological Medicine 2003, 33:611-622.
76. Zhou Q., Lengua L., Wang Y. The relations of temperament reactivity and effortful control to children's adjustment problems in China and the United States. Developmental Psychology 2009, 45:724-739.
77. Zimmerman M., McGlinchey J.B., Posternak M.A., Friedman M., Attiullah N., Boerescu D. How should remission from depression be defined? The depressed patient's perspective. American Journal of Psychiatry 2006, 163:148-150.
78. Zlomke K., Davis T.E. One-session treatment of specific phobias: A detailed description and review of treatment efficacy. Behavior Therapy 2008, 39:207-223.