Applications of generalizability theory to clinical child and adolescent psychology Research

Journal of Clinical Child and Adolescent Psychology

Volumn 38, Issue 1, 2009, Pages 144-165

  Lakes, Kimberley D ^a   Hoyt, William T ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ARTICLE; CHARACTER; CHILD; CONTROL; HUMAN; NONVERBAL COMMUNICATION; OBSERVER VARIATION; PERSONALITY TEST; PSYCHOLOGICAL THEORY; PSYCHOMETRY; REPRODUCIBILITY; RESEARCH; STATISTICS; VERBAL BEHAVIOR;

ADOLESCENT; CHARACTER; CHILD; HUMANS; INTERNAL-EXTERNAL CONTROL; NONVERBAL COMMUNICATION; OBSERVER VARIATION; PERSONALITY ASSESSMENT; PSYCHOLOGICAL THEORY; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RESEARCH; VERBAL BEHAVIOR;

EID: 61449090486     PISSN: 15374416     EISSN: None     Source Type: Journal    
DOI: 10.1080/15374410802575461     Document Type: Article

References (46)

1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213-232.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3. Borkenau, P., Riemann, R., Angleitner, A., & Spinath, F. M. (2001). Genetic and environmental influences on observed personality: Evidence from the German Observational Study of Adult Twins. Journal of Personality and Social Psychology, 80, 655-668.
4. Brennan, R. L. (2001). Generalizability theory. New York: Springer.
5. Brooks, S. J., & Kutcher, S. (2001). Diagnosis and measurement of adolescent depression: A review of commonly utilized instruments. Journal of Child and Adolescent Psychopharmacology, 11, 341-376.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed). Hillsdale, NJ: Erlbaum.
7. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
8. Conger, A. J. (1981). A comparison of multi-attribute generalizability strategies. Educational and Psychological Measurement, 41, 121-130.
9. Crick, J. E., & Brennan, R. L. (1982). GENOVA: A generalized analysis of variance system (FORTRAN IV computer program and manual). Dorchester, MA: Computer Facilities, University of Massachusetts, Boston. Available from http://www.education.uiowa.edu/casma/computer-programs.htm#genova
10. Cronbach, L. J, (1947). Test reliability: Its meaning and determination, Psychometrika, 12, 1-16.
11. Cronbach. L. J. (1951). Coefficient alpha and the internal structure of tests, Psychometrika, 16, 297-334.
12. Cronbach, L. J., Gleser, G. C, Nanda, A. N., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
13. Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. The British Journal of Statistical Psychology, 16, 137-163.
14. Elliot, S. N., Busse, R. T., & Gresham, F. M. (1993). Behavioral assessment of children: School psychology. School Psychology Review, 22, 313-321.
15. Epstein, S. (1980). The stability of behavior: II. Implications for psychological research. American Psychologist, 35, 790-806.
16. Frick, P. J., & Loney, B. R. (2000). The use of laboratory and performance-based measures in the assessment of children and adolescents with conduct disorders. Journal of Clinical Child Psychology, 29, 540-564.
17. Gleser, G. C, Cronbach, L. J., & Rajaratnam, N. (1965). Generalizability of scores influenced by multiple sources of variance. Psychometrika, 30, 395-418.
18. Hoyt, W. T. (2000). Rater bias in psychological research: When is it a problem and what can we do about it? Psychological Methods. 5, 64-86.
19. Hoyt, W. T., & Kems, M. D. (1999). Magnitude and moderators of bias in observer ratings: A meta-analysis. Psychological Methods. 4. 403-424.
20. Hoyt, W. T., & McCullough, M. E. (in press). Issues in the multimodal measurement of forgiveness. In E. L. Worthington, Jr. (Ed.), Handbook of forgiveness (pp. 109-123). New York: Brunner-Routledge.
21. Hoyt, W. T., & Melby, J. N. (1999). Dependability of measurement in counseling psychology: An introduction to generalizability theory. The Counseling Psychologist, 27, 325-352.
22. Hoyt, W. T., Warbasse, R. E., & Chu, E. Y. (2006). Construct validation in counseling psychology research. The Counseling Psychologist, 34, 769-805.
23. Hunter, J. E., & Schmidt, F. L. (1990) Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
24. Hunter, J. E., & Schmidt, F. L, (1994), Correcting for sources of artificial variation across studies. In H. Cooper & L, V. Hedges (Eds.), The handbook of research synthesis (pp. 323-336). New York: Russell Sage.
25. Kelley, H. H., Holmes, J. G., Kerr, N. L., Reis, H. T., Rusbult, C. E., & Van Lange, P, A. M. (2003), An atlas of interpersonal situations. Cambridge, UK: Cambridge University Press.
26. Kenny, D. A. (1994). Interpersonal perception: A social relations analysis. New York: Guilford.
27. Kenny, D. A., & Zautra, A. (1995). The state-trait-error model for multiwave data. Journal of Consulting and Clinical Psychology, 63, 52-59.
28. Kirk, R. E. (1982). Experimental design: Procedures for the behavioral sciences (2nd ed.). Belmont, CA: Brooks/Cole.
29. Kolko, D. J, (1993), Further evaluation of inpatient child behavior ratings: Consistency across settings, time, and sources. Journal of Emotional and Behavioral Disorders, 1, 251-259.
30. Lakes, K. D., & Hoyt, W. T. (2004). Promoting self-regulation through school-based martial arts training. Journal of Applied Developmental Psychology, 25, 283-302.
31. Lakes, K. D., & Hoyt, W. T. (2008). What sources contribute to variance in observer ratings? Using generalizability theory to assess construct validity of psychological measures. Infant and Child Development, 17, 269-284.
32. Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
33. Longford, N, T, (1994). Reliability of essay rating and score adjustment. Journal of Educational and Behavioral Statistics, 19, 171-200.
34. Mischel, W., & Shoda, Y. (1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102, 246-268.
35. Patterson, G. R., & Forgatch, M. S. (1995). Predicting future clinical adjustment from treatment outcome and process variables. Psychological Assessment, 7, 275-285,
36. Phares, V., Compas, B. E., & Howell, D. C. (1989). Perspectives on child behavior problems: Comparisons of children's self-reports with parent and teacher reports. Psychological Assessment, 1, 68-71.
37. Rushton, J. P., Brainerd, C. J., & Pressley, M. (1983). Behavioral development and construct validity: The principle of aggregation. Psychological Bulletin, 94, 18-38.
38. Schmidt, F. L., & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199-223,
39. Schmidt, F. L., Le, H., & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual difference constructs. Psychological Methods, 8, 206-224,
40. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
41. Shavelson, R. J., & Webb, N. M. (1991). Generalizability Theory: A primer. Newbury Park, CA: Sage.
42. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
43. Smith, P. L. (1978). Sampling errors of variance components in small sample multifacet generalizability studies. Journal of Educational Statistics, 4, 319-346.
44. Stanley, J. C, (1971). Reliability. In R, L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 359-442). Washington, DC: American Council on Education.
45. Steyer, R., Ferring, D., & Schmitt, M. J, (1992). States and traits in psychological assessment. European Journal of Psychological Assessment, 8, 79-98,
46. Wilkinson, L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.