Empirically Supported Assessment of Children and Adolescents

Clinical Psychology: Science and Practice

Volumn 23, Issue 4, 2016, Pages 327-347

  Youngstrom, Eric A ^a   Van Meter, Anna ^b  

^a The University of North Carolina at Chapel Hill   (United States)

^b YESHIVA UNIVERSITY   (United States)

Author keywords

children and adolescents; clinical decision making; evidence based assessment; outcome evaluation; sensitivity and specificity; treatment matching

Indexed keywords

ADOLESCENT; CHILD; CLINICAL DECISION MAKING; CONFIDENTIALITY; DIAGNOSIS; EVIDENCE BASED PRACTICE CENTER; HUMAN; JUVENILE; MONITORING; PREDICTION; PRESCRIPTION; PSYCHOMETRY; RISK FACTOR; SENSITIVITY AND SPECIFICITY; SYMPTOM;

EID: 84995812841     PISSN: 09695893     EISSN: 14682850     Source Type: Journal    
DOI: 10.1111/cpsp.12172     Document Type: Article

References (85)

1. Achenbach, T. M. (2006). As others see us: Clinical and research implications of cross-informant correlations for psychopathology. Current Directions in Psychological Science, 15, 94–98. doi:10.1111/j.0963-7214.2006.00414.x
2. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implication of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. doi:10.1037/0033-2909.101.2.213
3. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington, VT: University of Vermont.
4. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
5. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
6. Beidas, R. S., Stewart, R. E., Walsh, L., Lucas, S., Downey, M. M., Jackson, K., & Mandell, D. S. (2015). Free, brief, and validated: Standardized instruments for low-resource mental health settings. Cognitive & Behavioral Practice, 22, 5–19. doi:10.1016/j.cbpra.2014.02.002
7. Brighton, H. (2011). The future of diagnostics: From optimizing to satisficing. In G. Gigerenzer & J. A. Muir Gray (Eds.), Better doctors, better patients, better decisions (pp. 281–294). Cambridge, MA: MIT Press.
8. Bruchmuller, K., Margraf, J., Suppiger, A., & Schneider, S. (2011). Popular or unpopular? Therapists’ use of structured interviews and their estimation of patient acceptance. Behavior Therapy, 42, 634–643. doi:10.1016/j.beth.2011.02.003
9. Camara, W. J., Nathan, J. S., & Puente, A. E. (2000). Psychological test usage: Implications in professional psychology. Professional Psychology: Research and Practice, 31, 141. doi:10.1037/0735-7028.31.2.141
10. Childs, R. A., & Eyde, L. D. (2002). Assessment training in clinical psychology doctoral programs: What should we teach? What do we teach? Journal of Personality Assessment, 78, 130–144. doi:10.1207/S15327752JPA7801_08
11. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Hillsdale, NJ: Erlbaum.
12. Croskerry, P. (2003). The importance of cognitive errors in diagnosis and strategies to minimize them. Academic Medicine, 78, 775–780. doi:10.1097/00001888-200308000-00003
13. De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. doi:10.1037/a0038498
14. Dubicka, B., Carlson, G. A., Vail, A., & Harrington, R. (2008). Prepubertal mania: Diagnostic differences between US and UK clinicians. European Child & Adolescent Psychiatry, 17, 153–161. doi:10.1007/s00787-007-0649-5
15. Elmquist, J. M., Melton, T. K., Croarkin, P., & McClintock, S. M. (2010). A systematic overview of measurement-based care in the treatment of childhood and adolescent depression. Journal of Psychiatric Practice, 16, 217–234. doi:10.1097/01.pra.0000386908.07160.91
16. Embretson, S. E., & Reise, S. P. (2000). IRT applications: DIF, CAT, and scale analysis. In S. E. Embretson & S. P. Reise (Eds.), Item response theory for psychologists (pp. 249–272). Mahwah, NJ: Erlbaum.
17. Evans, S. W., Brady, C. E., Harrison, J. R., Bunford, N., Kern, L., State, T., & Andrews, C. (2013). Measuring ADHD and ODD symptoms and impairment using high school teachers’ ratings. Journal of Clinical Child and Adolescent Psychology, 42, 197–207. doi:10.1080/15374416.2012.738456
18. Exner, J. E., Jr. (1999). The Rorschach: Measurement concepts and issues of validity. In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement: What every psychologist and educator should know (pp. 159–184). Mahwah, NJ: Erlbaum.
19. Farrington, D. P., & Loeber, R. (2000). Some benefits of dichotomization in psychiatric and criminological research. Criminal Behaviour and Mental Health, 10, 100–122. doi:10.1002/cbm.349
20. Faurholt-Jepsen, M., Vinberg, M., Frost, M., Christensen, E. M., Bardram, J. E., & Kessing, L. V. (2015). Smartphone data as an electronic biomarker of illness activity in bipolar disorder. Bipolar Disorders, 17, 715–728. doi:10.1111/bdi.12332
21. Ford, T., Goodman, R., & Meltzer, H. (2003). The British Child and Adolescent Mental Health Survey 1999: The prevalence of DSM-IV disorders. Journal of American Academy of Child and Adolescent Psychiatry, 42, 1203–1211. doi:10.1097/00004583-200310-00011
22. Frazier, T. W., & Youngstrom, E. A. (2006). Evidence-based assessment of attention-deficit/hyperactivity disorder: Using multiple sources of information. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 614–620. doi:10.1097/01.chi.0000196597.09103.25
23. Freeman, A. J., Youngstrom, E. A., Frazier, T. W., Youngstrom, J. K., Demeter, C., & Findling, R. L. (2012). Portability of a screener for pediatric bipolar disorder to a diverse setting. Psychological Assessment, 24, 341–351. doi:10.1037/a0025617
24. Galanter, C. A., & Patel, V. L. (2005). Medical decision making: A selective review for child psychiatrists and psychologists. Journal of Child Psychology and Psychiatry, 46, 675–689. doi:10.1111/j.1469-7610.2005.01452.x
25. Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
26. Gawande, A. (2010). The checklist manifesto. New York, NY: Penguin.
27. Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103, 650–669. doi:10.1037/0033-295X.103.4.650
28. Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2003). Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. International Review of Psychiatry, 15, 166–172. doi:10.1080/0954026021000046128
29. Guyatt, G. H., & Rennie, D. (Eds.). (2002). Users’ guides to the medical literature. Chicago, IL: AMA Press.
30. Hasselbad, V., & Hedges, L. V. (1995). Meta-analysis of screening and diagnostic tests. Psychological Bulletin, 117, 167–178. doi:10.1037/0033-2909.117.1.167
31. Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999). Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives. Journal of Consulting and Clinical Psychology, 67, 300–307. doi:10.1037/0022-006X.67.3.300
32. Jenkins, M. M., & Youngstrom, E. A. (2016). A randomized controlled trial of cognitive debiasing improves assessment and treatment selection for pediatric bipolar disorder. Journal of Consulting and Clinical Psychology, 84, 323–333. doi:10.1037/ccp0000070
33. Jenkins, M. M., Youngstrom, E. A., Washburn, J. J., & Youngstrom, J. K. (2011). Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Professional Psychology: Research and Practice, 42, 121–129. doi:10.1037/a0022506
34. Jenkins, M. M., Youngstrom, E. A., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2012). Generalizability of evidence-based assessment recommendations for pediatric bipolar disorder. Psychological Assessment, 24, 269–281. doi:10.1037/a0025775
35. Jensen-Doss, A., Youngstrom, E. A., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2014). Predictors and moderators of agreement between clinical and research diagnoses for children and adolescents. Journal of Consulting and Clinical Psychology, 82, 1151–1162. doi:10.1037/a0036657
36. Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., & Ryan, N. (1997). Schedule for Affective Disorders and Schizophrenia for School-age Children-Present and Lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 980–988. doi:10.1097/00004583-199707000-00021
37. Kazdin, A. E. (1999). The meanings and measurement of clinical significance. Journal of Consulting and Clinical Psychology, 67, 332–339. doi:10.1037/0022-006X.67.3.332
38. Kennedy, M. L., Faust, D., Willis, W. G., & Piotrowski, C. (1994). Social-emotional assessment practices in school psychology. Journal of Psychoeducational Assessment, 12, 228–240. doi:10.1177/073428299401200302
39. Kraemer, H. C. (1992). Evaluating medical tests: Objective and quantitative guidelines. Newbury Park, CA: Sage.
40. Kraemer, H. C., Kazdin, A. E., Offord, D. R., Kessler, R. C., Jensen, P. S., & Kupfer, D. J. (1999). Measuring the potency of risk factors for clinical or policy significance. Psychological Methods, 4, 257. doi:10.1037/1082-989X.4.3.257
41. Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160, 1566–1577. doi:10.1176/appi.ajp.160.9.1566
42. Kruschke, J. K. (2011). Doing Bayesian data analysis: A tutorial with R and BUGS. New York, NY: Academic Press.
43. Lambert, M. J. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288–301. doi:10.1093/clipsy.bpg025
44. Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159–172. doi:10.1037/0022-006x.69.2.159
45. Langer, D. A., McLeod, B. D., & Weisz, J. R. (2011). Do treatment manuals undermine youth-therapist alliance in community clinical practice? Journal of Consulting and Clinical Psychology, 79, 427–432. doi:10.1037/a0023821
46. Lubke, G., & Neale, M. (2008). Distinguishing between latent classes and continuous factors with categorical outcomes: Class invariance of parameters of factor mixture models. Multivariate Behavioral Research, 43, 592–620. doi:10.1080/00273170802490673
47. Marchand, W. R., Wirth, L., & Simon, C. (2006). Delayed diagnosis of pediatric bipolar disorder in a community mental health setting. Journal of Psychiatric Practice, 12, 128–133. doi:10.1097/00131746-200603000-00011
48. Markon, K. E., & Krueger, R. F. (2005). Categorical and continuous models of liability to externalizing disorders: A direct comparison in NESARC. Archives of General Psychiatry, 62, 1352–1359. doi:10.1001/archpsyc.62.12.1352
49. Mash, E. J., & Hunsley, J. (2007). Assessment of child and family disturbance: A developmental-systems approach. In E. J. Mash & R. A. Barkley (Eds.), Assessment of childhood disorders (4th ed., pp. 3–52). New York, NY: Guilford Press.
50. McDermott, P. A., Fantuzzo, J. W., & Glutting, J. J. (1990). Just say no to subtest analysis: A critique on Wechsler theory and practice. Journal of Psychoeducational Assessment, 8, 290–302. doi:10.1177/073428299000800307
51. McDermott, P. A., & Weiss, R. V. (1995). A normative typology of healthy, subclinical, and clinical behavior styles among American children and adolescents. Psychological Assessment, 7, 162–170. doi:10.1037/1040-3590.7.2.162
52. Meats, E., Brassey, J., Heneghan, C., & Glasziou, P. (2007). Using the Turning Research Into Practice (TRIP) database: How do clinicians really search? Journal of the Medical Library Association: JMLA, 95, 156–163. doi:10.3163/1536-5050.95.2.156
53. Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota Press.
54. Merikangas, K. R., He, J. P., Brody, D., Fisher, P. W., Bourdon, K., & Koretz, D. S. (2010). Prevalence and treatment of mental disorders among US children in the 2001–2004 NHANES. Pediatrics, 125, 75–81. doi:10.1542/peds.2008-2598
55. Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2013). The validity of individual Rorschach variables: Systematic reviews and meta-analyses of the comprehensive system. Psychological Bulletin, 139, 548–605. doi:10.1037/a0029406
56. Miklowitz, D. J., Axelson, D. A., George, E. L., Taylor, D. O., Schneck, C. D., Sullivan, A. E., & Birmaher, B. (2009). Expressed emotion moderates the effects of family-focused treatment for bipolar adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 48, 643–651. doi:10.1097/CHI.0b013e3181a0ab9d
57. Morrison, J. (2014). Diagnosis made easier: Principles and techniques for mental health clinicians (2nd ed.). New York, NY: Guilford Press.
58. Norcross, J. C., Beutler, L. E., & Levant, R. F. (Eds.). (2006). Evidence-based practices in mental health. Washington, DC: American Psychological Association.
59. Nottelmann, E., Biederman, J., Birmaher, B., Carlson, G. A., Chang, K. D., Fenton, W. S., & Weller, E. (2001). National Institute of Mental Health research roundtable on prepubertal bipolar disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 871–878. doi:10.1097/00004583-200108000-00007
60. Poston, J. M., & Hanson, W. E. (2010). Meta-analysis of psychological assessment as a therapeutic intervention. Psychological Assessment, 22, 203–212. doi:10.1037/a0018679
61. Ready, R. E., & Veague, H. B. (2014). Training in psychological assessment: Current practices of clinical psychology programs. Professional Psychology: Research and Practice, 45, 278–282. doi:10.1037/a0037439
62. Rettew, D. C., Lynch, A. D., Achenbach, T. M., Dumenci, L., & Ivanova, M. Y. (2009). Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews. International Journal of Methods in Psychiatric Research, 18, 169–184. doi:10.1002/mpr.289
63. Richters, J. E. (1992). Depressed mothers as informants about their children: A critical review of the evidence for distortion. Psychological Bulletin, 112, 485–499. doi:10.1037//0033-2909.112.3.485
64. Silver, N. (2015). The signal and the noise: Why so many predictions fail–But some don't. New York, NY: Penguin.
65. Stedman, J. M., Hatch, J. P., & Schoenfeld, L. S. (2001). The current status of psychological assessment training in graduate and professional schools. Journal of Personality Assessment, 77, 398–407. doi:10.1207/S15327752JPA7703_02
66. Straus, S. E., Glasziou, P., Richardson, W. S., & Haynes, R. B. (2011). Evidence-based medicine: How to practice and teach EBM (4th ed.). New York, NY: Churchill Livingstone.
67. Streiner, D. L., & Norman, G. R. (1995). Health measurement scales: A practical guide to their development and use (2nd ed.). New York, NY: Oxford University Press.
68. Suppiger, A., In-Albon, T., Hendriksen, S., Hermann, E., Margraf, J., & Schneider, S. (2009). Acceptance of structured diagnostic interviews for mental disorders in clinical practice and research settings. Behavior Therapy, 40, 272–279
69. Van Meter, A., Youngstrom, E., Youngstrom, J. K., Ollendick, T., Demeter, C., & Findling, R. L. (2014). Clinical decision making about child and adolescent anxiety disorders using the Achenbach System of Empirically Based Assessment. Journal of Clinical Child and Adolescent Psychology, 43, 552–565. doi:10.1080/15374416.2014.883930
70. Vollmer, T. R., & Northup, J. (1996). Some implications of functional analysis for school psychology. School Psychology Quarterly, 11, 76–92. doi:10.1037/h0088922
71. Waller, N. G., & Meehl, P. E. (1998). Multivariate taxometric procedures: Distinguishing types from continua (Vol. 9). Thousand Oaks, CA: Sage.
72. Wechsler, D. (2014). Wechsler Intelligence Scale for Children (5th ed.). San Antonio, TX: NCS Pearson.
73. Weersing, V. R., & Weisz, J. R. (2002). Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials. Journal of Consulting and Clinical Psychology, 70, 299–310. doi:10.1037/0022-006X.70.2.299
74. Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., & Hoagwood, K. E. (2011). Youth Top Problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79, 369–380. doi:10.1037/a0023307
75. Yates, B. T., & Taub, J. (2003). Assessing the costs, benefits, cost-effectiveness, and cost-benefit of psychological assessment: We should, we can, and here's how. Psychological Assessment, 15, 478–495. doi:10.1037/1040-3590.15.4.478
76. Youngstrom, E. A. (2013). Future directions in psychological assessment: Combining evidence-based medicine innovations with psychology's historical strengths to enhance utility. Journal of Clinical Child and Adolescent Psychology, 42, 139–159. doi:10.1080/15374416.2012.736358
77. Youngstrom, E. A. (2014). A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC. Journal of Pediatric Psychology, 39, 204–221. doi:10.1093/jpepsy/jst062
78. Youngstrom, E. A., Ackerman, B. P., & Izard, C. E. (1999). Dysphoria-related bias in maternal ratings of children. Journal of Consulting and Clinical Psychology, 67, 905–916. doi:10.1037/0022-006X.67.6.905
79. Youngstrom, E. A., & Duax, J. (2005). Evidence-based assessment of pediatric bipolar disorder, part 1: Base rate and family history. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 712–717. doi:10.1097/01.chi.0000162581.87710.bd
80. Youngstrom, E. A., Findling, R. L., Calabrese, J. R., Gracious, B. L., Demeter, C., DelPorto Bedoya, D., & Price, M. (2004). Comparing the diagnostic accuracy of six potential screening instruments for bipolar disorder in youths aged 5 to 17 years. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 847–858. doi:10.1097/01.chi.0000125091.35109.1e
81. Youngstrom, E. A., & Frazier, T. W. (2013). Evidence-based strategies for the assessment of children and adolescents: Measuring prediction, prescription, and process. In D. J. Miklowitz, W. E. Craighead, & L. Craighead (Eds.), Developmental psychopathology (2nd ed., pp. 36–79). New York, NY: Wiley.
82. Youngstrom, E. A., Genzlinger, J. E., Egerton, G. A., & Van Meter, A. R. (2015). Multivariate meta-analysis of the discriminative validity of caregiver, youth, and teacher rating scales for pediatric bipolar disorder: Mother knows best about mania. Archives of Scientific Psychology, 3, 112–137. doi:10.1037/arc0000024
83. Youngstrom, E. A., Meyers, O. I., Youngstrom, J. K., Calabrese, J. R., & Findling, R. L. (2006). Diagnostic and measurement issues in the assessment of pediatric bipolar disorder: Implications for understanding mood disorder across the life cycle. Development and Psychopathology, 18, 989–1021. doi:10.1017/S0954579406060494
84. Youngstrom, E. A., Youngstrom, J. K., Freeman, A. J., De Los Reyes, A., Feeny, N. C., & Findling, R. L. (2011). Informants are not all equal: Predictors and correlates of clinician judgments about caregiver and youth credibility. Journal of Child and Adolescent Psychopharmacology, 21, 407–415. doi:10.1089/cap.2011.0032
85. Youngstrom, E., Zhao, J., Mankoski, R., Forbes, R. A., Marcus, R. M., Carson, W., & Findling, R. L. (2013). Clinical significance of treatment effects with aripiprazole versus placebo in a study of manic or mixed episodes associated with pediatric bipolar I disorder. Journal of Child and Adolescent Psychopharmacology, 23, 72–79. doi:10.1089/cap.2012.0024