Psychometric assessment and reporting practices: Incongruence between theory and practice

Journal of Psychoeducational Assessment

Volumn 27, Issue 6, 2009, Pages 465-476

  Slaney, Kathleen L ^a   Tkatchouk, Masha ^a   Gabriel, Stephanie M ^a   Maraun, Michael D ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

Author keywords

External score validity; Internal score validity; Psychometric assessment; Psychometric reporting practices; Test analysis

Indexed keywords

EID: 70649084905     PISSN: 07342829     EISSN: None     Source Type: Journal    
DOI: 10.1177/0734282909335781     Document Type: Article

References (17)

1. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2. Cronbach, L.J., & Meehl, P.E. (1955). Construct validity and psychological tests. Psychological Bulletin, 52, 281-302.
3. Fidler, F., Thomason, N., Cumming, G., Finch, S., & Leeman, J. (2004). Editors can lead researchers to confidence intervals, but can't make them think: Statistical reform lessons from medicine. Psychological Science, 15, 119-126.
4. Hogan, T.P., Benjamin, A., & Brezinski, K.L. (2000). Reliability methods: A note on the frequency of various types. Educational and Psychological Measurement, 60, 523-531.
5. Hogan, T.P., & Agnello, J. (2004). An empirical study of reporting practices concerning measurement validity. Educational and Psychological Measurement, 64, 802-812.
6. Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 634-694.
7. Peak, H. (1953). Problems of objective observation. In L. Festinger & D. Katz (Eds.), Research methods in the behavioral sciences (pp. 243-299). New York: Holt, Rinehart & Winston.
8. Qualls, A.L., & Moss, A.D. (1996). The degree of congruence between test standards and test documentation within journal publications. Educational and Psychological Measurement, 56, 209-214.
9. Slaney, K.L., & Maraun, M.D. (2008). A proposed framework for conducting data-based test analysis. Psychological Methods, 13, 376-390.
10. Thompson, B., & Synder, P.A. (1998). Statistical significance and reliability analyses in recent Journal of Counseling & Development research articles. Journal of Counseling & Development, 76, 436-441.
11. Vacha-Haase, T., Henson, R.K., & Caruso, J.C. (2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.
12. Vacha-Haase, T., Kogan, L.R., & Thompson, B. (2000). Sample compositions and variabilities in published studies versus those in test manuals: Validity and score reliability inductions. Educational and Psychological Measurement, 60, 509-522.
13. Vacha-Haase, T., Ness, C., Nilsson, J., & Reetz, D. (1999). Practices regarding reporting of reliability coefficients: A review of three journals. Journal of Experimental Education, 67, 335-341.
14. Vacha-Haase, T., Nilsson, J., Reetz, D., Lance, T., & Thompson, B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory and Psychology, 10, 413-425.
15. Whittington, D. (1998). How well do researchers report their measures? An evaluation of measurement in published educational research. Educational and Psychological Measurement, 58, 21-37.
16. Wilkinson, L., & The APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
17. Willson, V.L. (1980). Research techniques in AERJ articles: 1969-1978. Educational Researcher, 9(6), 5-10.