Statistical significance and reliability analyses in recent Journal of Counseling & Development research articles

Journal of Counseling and Development

Volumn 76, Issue 4, 1998, Pages 436-441

  Thompson, Bruce ^a,b   Snyder, Patricia A ^c  

^a TEXAS A AND M UNIVERSITY   (United States)

^b BAYLOR COLLEGE OF MEDICINE   (United States)

^c LOUISIANA STATE UNIV MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0032352330     PISSN: 07489633     EISSN: None     Source Type: Journal    
DOI: 10.1002/j.1556-6676.1998.tb02702.x     Document Type: Article

References (45)

1. American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
2. Azar, B. (1997). APA task force urges a harder look at data. The APA Monitor, 28(3), 26.
3. Borders, L. D. (1996). The Journal of Counseling & Development: On its purpose, function, and goals. Journal of Counseling & Development, 75, 3-4.
4. Carver, R. (1978).The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
5. Carver, R. (1993). The case against statistical significance testing, revisited. Journal of Experimental Education, 61, 287-292.
6. Cohen, J. (1988). Statistical power analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
7. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
8. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
9. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston.
10. Dawis, R. V. (1987). Scale construction. Journal of Counseling Psychology, 34, 481-489.
11. Gronlund, N. E., & Linn, R. L. (1990). Measurement and evaluation in teaching (6th ed.). New York: Macmillan.
12. Hays, W. L. (1981). Statistics (3rd ed.). New York: Holt, Rinehart and Winston.
13. Heldref Foundation. (1997). Guidelines for contributors. Journal of Experimental Education, 65, 287-288.
14. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
15. Kupfersmid, J. (1988). Improving what is published: A model in search of an editor. American Psychologist, 43, 635-642.
16. Locke, L. F., Spirduso, W. W., & Silverman, S. J. (1993). Proposals that work: A guide for planning dissertations and grant proposals (3rd ed.). Newbury Park, CA: Sage.
17. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
18. Meier, S. T., & Davis, S. R. (1990). Trends in reporting psychometric properties of scales used in counseling psychology research. Journal of Counseling Psychology, 37, 113-115.
19. Morrison, D. E., & Henkel, R. E. (Eds.). (1970). The significance test controversy. Chicago: Aldine.
20. Murphy, K. R. (1997). Editorial. Journal of Applied Psychology, 82, 3-5.
21. Nunnally, J. (1960). The place of statistics in psychology. Educational and Psychological Measurement, 20, 641-650.
22. Rosenthal, R. (1991). Effect sizes: Pearson's correlation, its display via the BESD, and alternative indices. American Psychologist, 46, 1086-1087.
23. Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
24. Rowley, G. L. (1976). The reliability of observational measures. American Educational Research Journal, 13, 51-59.
25. Rozeboom, W. W. (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428.
26. Saunders, S. M., Howard, K. I., & Newman, F. L. (1988). Evaluating the clinical significance of treatment effects: Norms and normality. Behavioral Assessment, 10, 207-218.
27. Schmidt, F. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129.
28. Schneider, A. L., & Darcy, R. E. (1984). Policy implications of using significance test in evaluation research. Evaluation Review, 8, 573-582.
29. Sexton, T. L. (1996). The relevance of counseling outcome research: Current trends and practical implications. Journal of Counseling & Development, 74, 590-600.
30. Shaver, J. (1985), Chance and nonsense. Phi Delta Kappan, 67, 57-60.
31. Shaver, J. (1993). What statistical significance testing is, and what it is not. Journal of Experimental Education, 61, 293-316.
32. Shea, C. (1996). Psychologists debate accuracy of "significance test." Chronicle of Higher Education, 42(49), A12, A16.
33. Snyder, P.A., & Lawson, S. (1993). Evaluating results using corrected and uncorrected effect size estimates. Journal of Experimental Education, 61, 334-349.
34. Snyder, P. A., & Thompson, B. (1997, January). Use of tests of statistical significance and other analytic choices in a school psychology journal: Review of practices and suggested alternatives. Paper presented at the annual meeting of the Southwest Educational Research Association, Austin, TX. (ERIC Document Reproduction Service No. ED 408 302)
35. Thompson, B. (1992). Two and one-half decades of leadership in measurement and evaluation. Journal of Counseling & Development, 70, 434-438.
36. Thompson, B. (1993). The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61, 361-377.
37. Thompson, B. (1994a). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.
38. Thompson, B. (1994b, January). It is incorrect to say "The test is reliable": Bad language habits can contribute to incorrect or meaningless research conclusions. Paper presented at the annual meeting of the Southwest Educational ResearchAssociation, San Antonio, TX. (ERIC Document Reproduction Service No. ED 367 707)
39. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25(2), 26-30.
40. Thompson, B. (1997a). Editorial policies regarding statistical significance tests: Further comments. Educational Researcher, 26(5), 29-32.
41. Thompson, B. (1997b, August). If statistical significance tests are broken/misused, what practices should supplement or replace them? Invited paper presented at the annual meeting of the American Psychological Association, Chicago. (ERIC Document Reproduction Service No. ED 413 342)
42. Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.
43. Vacha-Haase, T., & Nilsson, J. E. (1998). Statistical significance reporting: Current trends and uses in MECD. Measurement and Evaluation in Counseling and Development, 31, 46-57.
44. Whiston, S. C. (1996). Accountability through action research: Research methods for practitioners. Journal of Counseling & Development, 74, 616-623.
45. Willson, V. L. (1980). Research techniques in AERJ articles: 1969 to 1978. Educational Researcher, 9(6), 5-10.