Research design and methodology section: Measurement Myths and Misconceptions

School Psychology Quarterly

Volumn 14, Issue 4, 1999, Pages 408-427

  Coodwin, Laura D ^a   Goodwin, William L ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 1842813944     PISSN: 10453830     EISSN: None     Source Type: Journal    
DOI: 10.1037/h0089017     Document Type: Article

References (89)

1. Aaronson, L. S. (1989). A cautionary note on the use of stepwise regression. Nursing Research, 38, 309-311.
2. American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1985). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
3. American Psychological Association (APA), American Educational Research Association (AERA), & National Council on Measurement in Education (NCME). (1966). Standards for educational and psychological teats and manuals. Washington, DC: American Psychological Association.
4. Boyle, G. J. (1991). Does item homogeneity indicate internal consistency or item redundancy in psychometric scales? Personality and Individual Differences, 3, 309-319.
5. Brennan, R. L. (1998). Misconceptions at the intersection of measurement theory and practice. Educational Measurement: Issues and Practice, 17(1), 5-9, 30.
6. Brigance, A. (1992). Brigance K& Screen (3rd ed.). North Billerica, MA: Curriculum Associates.
7. Buchanan, H.H., McDermott, P. A., & Schaefer, B. A. (1998). Agreement among classroom observers of children's stylistic learning behaviors. Psychology in the Schools, 35, 355-361.
8. Bun, C. (1952). Tests of significance in factor analysis. British Journal of Psychology, 5, 109-133.
9. Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989). MMPI-2: Manual for administration and scoring. Minneapolis: University of Minnesota Press.
10. Caro, T. M., Roper, R., Young, M., & Dank, G. R. (1979). Interobserver reliability. Behaviour, 69, 303-315.
11. Carroll, K.M., Nich, C., Frankfurter, T. L., & Bisighini, R. M. (1999). Do patients change in the ways we intend? Assessing acquisition of coping skills among cocaine-dependent patients. Psychological Assessment, 11, 71-85.
12. Carver, R. P. (1993). The case against statistical significance testing, revisited. The Journal of Experimental Education, 61, 287-292.
13. Cattell, R. B. (1952). Factor analysis. New York: Harper.
14. Cattell, R. B. (1966). The scree test for the number of factors. Mullivariate Behavioral Research, 1, 245-276.
15. Chancy, E. F.,O'Lcary, M. R., & Mariait, G. A. (1978). Skill training with problem drinkers. Journal of Consulting and Clinical Psychology, 46, 1092-1104.
16. Child, D. (1970). The essentials of factor analysis. London: Holt, Rinehart and Winston.
17. Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319.
18. Cliff, N., & Hamburger, C. D. (1967). The study of sampling errors in factor analysis by means of artificial experiments. Psychological Bulletin, 68, 430-445.
19. Cocco, K. M., & Carey, K. B. (1998). Psychometric properties of the Drug Abuse Screening Test in psychiatric outpatients. Psychological Assessment, 10, 408-414.
20. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
21. Convey, A. L. (1988). Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology, 56, 754-761.
22. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory'. New York: Holt, Rinehart, and Winston.
23. Cronbach, L. J. (1980). Validity on parole: How can we go straight? New directions for testing and measurement: Measuring achievement, progress over a decade, no. 5 (pp. 99-108). San Francisco, CA: Jossey-Bass.
24. Cronbach, L. J. (1988). Five perspectives on validity argument. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 3-17). Hillsdale, NJ: Erlbaum.
25. Cronbach, L. J., Gleser, C. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: Wiley.
26. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
27. Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8, 341-349.
28. Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286-299.
29. Frick, T., & Semmel, M. I. (1978). Observer agreement and reliabilities of classroom observational measures. Review of Educational Research, 48, 157-184.
30. Geisingcr, K. F. (1992). The metamorphosis of test validation. Educational Psychologist, 27, 197-222.
31. Goodwin, L. D. (1997). Changing conceptions of measurement validity. Journal of Nursing Education, 36, 102-107.
32. Goodwin, L. D. (1999). The role of factor analysis in the estimation of construct validity. Measurement in Physical Education and Exercise Science, 3, 85-100.
33. Goodwin, L. D., & Goodwin, W. L. (1991a). Estimating construct validity. Research in Nursing & Health, 14, 235-243.
34. Goodwin, L. D., & Goodwin, W. L. (1991b). Using generalizability theory in early childhood special education. Journalof Early Intervention, 15, 193-204.
35. Goodwin, L. D., & Prescott, P. A. (1981). Issues and approaches to estimating interrater reliability in nursing research. Research in Nursing & Health, 4, 323-327.
36. Goodwin, L. D., & Sandall, S. R. (1988). Interrater reliability of parent-infant interaction scales. Diagnostique, 13, 106-119.
37. Gorsuch, R. L. (1983). Factor analysis. Hillsdale, NJ: Erlbaum.
38. Gorsuch, R. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68, 532-560.
39. Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis (5th ed.). Upper Saddle River, NJ: Prentice Hall.
40. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
41. Hopkins, K. D. (1998). Educational and psychological measurement and evaluation (8th ed.). Needham Heights, MA: Allyn & Bacon.
42. Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185.
43. Hotelling, H. (1933). Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology, 24, 27-35.
44. Kaiser, H. F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23, 187-200.
45. Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141-151.
46. Kane, M. T. (1994). Validating interpretive arguments for licensure and certification examinations. Evaluation & the Health Professions, 17, 133-159.
47. Kerlinger, F. N. (1986). Foundations of behavioral research (3rd ed.). New York: Holt, Rinehart, and Winston.
48. Knapp, T. R., & Brown, J. K. (1995). Ten measurement commandments that often should be broken. Research in Nursing & Health, 18, 465-469.
49. Knoff, H. M., Mines, C. V., & Kromrey, J. D. (1995). Finalizing the Consultant Effectiveness Scale: An analysis and validation of the characteristics of effective consultants. School Psychology Review. 24, 480-496.
50. Lambert, N., Nihira, K., & Leland, H. (1993) AAMR A daptive Behavior Scale-School (2nd ed.). Austin, TX: PRO-FD.
51. Langenfeld, T. F., & Crocker, L. M. (1994). The evolution of validity theory: Public school testing, the courts, and incompatible interpretations. Educational Assessment, 2, 149-165.
52. Lewis, T. J., & Sugai, G. (1996). Functional assessment of problem behavior: A pilot investigation of the comparative and interactive effects of teacher and peer social attention on students in general education settings. School Psychology Quarterly, 11, 1-19.
53. Linn, R. L. (1994). Performance assessment: Policy promises and technical measurement standards. Educational Researcher, 23(9), 4-14.
54. Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use. Educational Measurement: Issues and Practice, 16(2), 14-16.
55. Linn, R. L., & Gronlund, N. E. (1995). Measurement and assessment in teaching (7th ed.). Englewood Cliffs, NJ: Prentice Hall.
56. Loevinger, J. (1954). The attenuation paradox in test theory. Psychological Bulletin, 51, 493-504.
57. Mamzicopoulos, P. (1999). Reliability and validity estimates of the Brigance K&1 Screen based on a sample of disadvantaged preschoolers. Psychology in the Schools, 36, 11-19
58. Martin, P., & Bateson, P. (1993). Measuring behaviour: An introductory guide (2nd ed.). Cambridge, UK: Cambridge University Press.
59. Mehrens, W. A. (1997). The consequences of consequential validity. Educational Measurement: Issues and Practice, 16(2), 16-18.
60. Merenda, P. F. (1997). A guide to the proper use of factor analysis in the conduct and reporting of research: Pitfalls to avoid. Measurement and Evaluation in Counseling and Development, 30, 156-164.
61. Messick, S. (1975). The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30, 955-966.
62. Messick, S.(1980). Test validity and the ethics of assessment. American Psychologist,35, 1012-1027.
63. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: American Council on Education and Macmillan.
64. Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13-23.
65. Miller, M. A. (1995). Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling. Structural Equation Modeling, 13, 255-273.
66. Moss. P. A. (1992). Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 62, 229-258.
67. Moss, P. A. (1994). Can there be validity without reliability? Educational Researcher, 23(2), 5-12.
68. Mulaik, S. A. (1972). The foundations of factor analysis. New York: McGraw-Hill.
69. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
70. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
71. Passarello, D. J., Hintze, J. M., Owen, S. V., & Gable, R. K. (1999). Exploratory factor analysis of parent ratings of child and adolescent anxiety: A preliminary investigation Psychology in the Schools, 36, 89-102.
72. Popham, W. J. (1997). Consequential validity: Right concern-wrong concept. Educational Measurement: Issues and Practice, 16(2), 9-13.
73. Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Hulletin, 114, 552-566.
74. Santor, D. A., & Ramsay, J. O. (1998). Progress in the technology of measurement: Applications of item response models. Psychological Assessment, 10, 345-359.
75. Shepard, L. A. (1993). Evaluating test validity. Review of Research in Education, 19, 405-450.
76. Shepard, L. A. (1997). Thecentrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16(2), 58, 13, 24.
77. Smith, D. C., Furlong, M., Bates, M., & Laughlin, J. C. (1998). Development of the Multidimensional School Anger Inventory formales. Psychology in the Schools, 35, 1-15.
78. Snyder, P. (1991). Three reasons why stepwise regression methods should not be used by researchers. In B. Thompson (Ed.), Advances in educational research: Substantive findings, methodological developments (Vol. 1, pp. 99-105). Greenwich, CT: JA1 Press.
79. Stinnett, T. A., Fuqua, D. R., & Coombs, W. T. (1999). Construct validity of the AAMR Adaptive Behavior Scale-School: 2. School Psychology Review, 28, 31-43.
80. Swanson, H. L. (1995). Using the Cognitive Processing Test to assess ability: Development of a dynamic assessment measure. School Psychology Review, 24, 672-693.
81. Thompson, B. (1989). Statistical significance, result importance, and result generalizahility: Three noteworthy but somewhat different issues. Measurement and Evaluation in Counseling and Development, 22, 2-6.
82. Thurstone, L. L. (1947). Multiple factor analysis. Chicago: University of Chicago Press.
83. Traub, R. H., & Rowley, G. L. (1991). Understanding reliability. Educational Measurement: Issues and Practice, 70(1), 37-45.
84. Vacha-Haase, T., & Nilsson, J. E. (1998). Statistical significance reporting: Current trends and uses in MECD. Measurement and Evaluation in Counseling and Development, 31, 46-57.
85. Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika,41, 321-327.
86. Walker, L. S., Smith, C. A.,Garber, J., & Van Slyke, D. A. (1997). Development and validation of the Pain Response Inventory' for children. Psychological Assessment, 9, 392-405.
87. Ward, L. C., Kersh, B. C., & Waxmonsky, J. A. (1998). Factor structure of the Paranoia Scale of the MMP1-2 in relation to the Harris-Lingoes subscales and Comrey factor analysis. Psychological Assessment, 10, 292-296.
88. Zoski, K. W., & Jurs, S. (1996). An objective counterpart to the visual scree test for factor analysis: The standard error scree. Educational and Psychological Measurement, 56, 443-451.
89. Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin. 99, 432-442.