Statistical conclusion validity for organizational science researchers: A review

Organizational Research Methods

Volumn 1, Issue 2, 1998, Pages 164-208

  Austin, James T ^a,d   Boyle, Kristin A ^a,b   Lualhati, Joselito C ^c,e  

^a OHIO STATE UNIVERSITY   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^c NOKIA RESEARCH CENTER   (United States)

^d VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^e UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001993719     PISSN: 10944281     EISSN: None     Source Type: Journal    
DOI: 10.1177/109442819812002     Document Type: Review

References (346)

1. Abelson, R. P. (1985). A variance explanation paradox: When a little is a lot Psychological Bulletin, 97, 129-133.
2. Abelson, R. P. (1995). Statistics as principled argument. Hillsdale, NJ: Lawrence Erlbaum.
3. Aguinas, H. (1995). Statistical power problems with moderated multiple regression in management research. Journal of Management, 21, 1141-1158.
4. Aguinas, H., Pierce, C. A., & Stone-Romero, E. F. (1994). Estimating the power to detect dichotomous moderators with moderated multiple regression. Educational and Psychological Measurement, 54, 690-692.
5. Aguinas, H., & Stone-Romero, E. F. (1997). Methodological artifacts in moderated multiple regression and their effects on statistical power. Journal of Applied Psychology, 82, 192-206.
6. Ahadi, S., & Diener, E. (1989). Multiple determinants and effect size. Journal of Personality and Social Psychology, 56, 398-406.
7. Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R. (1990). Graduate training in statistics, methodology, and measurement in psychology (with commentary). American Psychologist, 45, 721-734.
8. Allison, D. B., Gorman, B. S., & Primavera, L. H. (1993). Some of the most common questions asked of statistical consultants: Our favorite responses and recommended readings. Genetic, Social, and General Psychology Monographs, 117, 155-185.
9. American Psychological Association, Board of Scientific Affairs, Task Force on Statistical Inference. (1997, March/April). Report of the Task Force on Statistical Inference. Psychological Science Agenda, 9-10.
10. Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modelling in practice: A review and recommended two-step procedure. Psychological Bulletin, 103, 411-423.
11. Andrews, D.W.K. (1989). Power in econometric applications. Econometrica, 57, 1059-1090.
12. Arvey, R. D., Cole, D. A. (1989). Evaluating change due to training. In I. Goldstein & Associates (Eds.). Training and development in organizations (pp. 89-117). San Francisco, CA: Jossey-Bass.
13. Arvey, R. D., Maxwell, S. E., & Salas, E. (1992). The relative power of training evaluation designs under different cost configurations. Journal of Applied Psychology, 77, 155-160.
14. Ashworth, S. D., Osburn, H. G., Callender, J., & Boyle, K. (1992). The effects of unrepresented studies on the robustness of validity generalization studies. Personnel Psychology, 45, 341-361.
15. Austin, J. T., & Calderón, R. F. (1996). Theoretical and technical work on structural equation modeling: An updated annotated bibliography. Structural Equation Modeling, 3, 105-170.
16. Austin, J. T., & Wolfle, L. M. (1991). Annotated bibliography of structural equation modelling: Technical work. British Journal of Mathematical and Statistical Psychology, 44, 93-152.
17. Bagozzi, R. P., & Yi, Y. (1989). On the use of structural equation models in experimental designs. Journal of Marketing Research, 26, 271-284.
18. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
19. Barcikowski, R. S., & Holthouse, N. (1972). A computer program for calculating the power of F tests in analysis of variance and covariance for specified alpha levels, sample sizes, and effect sizes [Computer program]. Educational and Psychological Measurement, 32, 169-172.
20. Becker, B. J., & Hedges, L. V. (Eds.). (1992). Meta-analysis [Special issue]. Journal of Educational Statistics, 17, 277-374.
21. Bentler, P. (1980). Multivariate analysis with latent variables: Causal modeling. Annual Review of Psychology, 31, 419-456.
22. Berger, J. O. (1985). Statistical decision theory and Bayesian analysis (Rev. ed.). New York: Springer-Verlag.
23. Berkson, J. (1942). Tests of significance considered as evidence. Journal of the American Statistical Association, 37, 325-335.
24. Bielby, W. T., & Kluegel, J. R. (1977). Statistical inference and statistical power in applications of the general linear model. In D. Heise (Ed.), Sociological methodology 1977 (pp. 283-312). San Francisco: Jossey-Bass.
25. Bielby, W. T., & Matsueda, R. (1991). Statistical power in nonrecursive linear models. In P. V. Marsden (Ed.), Sociological methodology 1991 (pp. 167-197). New York: Basil Blackwell.
26. Blair, R. C., & Higgins, J. J. (1985). Comparison of the power of the paired samples t test to that of Wilcoxon's signed-ranks test under various population shapes. Psychological Bulletin, 97, 119-128.
27. Blattberg, R. C. (1979). The design of advertising experiments using statistical decision theory. Journal of Marketing Research, 16, 191-202.
28. Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley.
29. Borenstein, M., & Cohen, J. (1988). Statistical power analysis [Computer program]. Hillsdale, NJ: Lawrence Erlbaum.
30. Borenstein, M., Cohen, J., Rothstein, H. R., Pollack, S., & Kane, J. (1992). A visual approach to statistical power analysis on the microcomputer [Computer program]. Behavior Research Methods, Instruments, & Computers, 24, 565-572.
31. Boudreau, J. W. (1991). Utility analysis for decisions in human resource management. In M. D. Dunnette & L. Hough (Eds.), Handbook of industrial-organizational psychology (2nd ed., Vol. 2, pp. 621-745). Palo Alto, CA: Consulting Psychologists Press.
32. Box, G.E.P., & Tiao, G. C. (1973). Bayesian inference in statistical analysis. Reading, MA: Addison-Wesley.
33. Bracht, G. H., & Glass, G. V. (1968). The external validity of experiments. American Educational Research Journal, 5, 437-474.
34. Bradley, D. R. (1989). Computer simulation with DATASIM [Computer program]. Behavior Research Methods, Instruments, & Computers, 21, 99-112.
35. Bradley, D. R., Russell, R. L., & Reeve, C. P. (1996). Statistical power in complex experimental designs. Behavior Research Methods, Instruments, & Computers, 28, 319-326.
36. Brenner-Golomb, N. (1993). R. A. Fisher's philosophical approach to inductive inference. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences (pp. 283-307). Hillsdale, NJ: Lawrence Erlbaum.
37. Brent, E. E., Spencer, J. C, & Scott, J. K. (1989). EX-SAMPLE: An expert system program to assist in determining sample size [Computer program]. Social Science Computer Review, 7, 314-319.
38. Brewer, J. K. (1972). On the power of statistical tests in the American Educational Research Journal. American Educational Research Journal, 9, 381-401.
39. Brinberg, D., & Kidder, L. (Eds.). (1982). Forms of validity in research. San Francisco, CA: Jossey-Bass.
40. Brinberg, D., & McGrath, J. (1985). Validity and the research process. Beverly Hills, CA: Sage.
41. Browne, M. W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.
42. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
43. Browne, M. W., Mels, G., & Cowan, M. (1994). Path analysis: RAMONA. In SYSTAT for DOS: Advanced applications (Version 6, pp. 167-224). Evanston, IL: SYSTAT.
44. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
45. Carroll, R. M., & Nordholm, L. A. (1975). Sampling characteristics of Kelley's epsilon-squared and Hays' omega-squared. Educational and Psychological Measurement, 35, 541-554.
46. Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 278-299.
47. Cascio, W. F., Valenzi, E. R., & Silbey, V. (1978). Validation and statistical power. Implications for applied research. Journal of Applied Psychology, 63, 589-595.
48. Cascio, W. F., Valenzi, E. R., & Silbey, V. (1980). More on validation and statistical power. Journal of Applied Psychology, 65, 135-138.
49. Cascio, W. F., & Zedeck, S. (1983). Open a new window in rational research planning: Adjust alpha to maximize power. Personnel Psychology, 36, 517-526.
50. Cattin, P. (1980). Estimation of the predictive power of a regression model. Journal of Applied Psychology, 65, 407-414.
51. Chase, L. J., & Baran, S. J. (1976). An assessment of quantitative research in mass communication. Journalism Quarterly, 53, 308-311.
52. Chase, L. J., & Chase, R. B. (1976). A statistical power analysis of applied psychological research. Journal of Applied Psychology, 61, 234-237.
53. Chase, L. J., & Tucker, R. K. (1976). Statistical power: Derivation, development, and data-analytic implications. Psychological Record, 26, 473-486.
54. Chihara, C. S. (1987). Some problems for Bayesian confirmation theory. British Journal for the Philosophy of Science, 38, 551-560.
55. Chow, S. L. (1988). Significance test or effect size? Psychological Bulletin, 103, 105-110.
56. Chow, S. L. (1989). Significance tests and deduction: Reply to Folger (1989). Psychological Bulletin, 106, 161-165.
57. Chow, S. L. (1997). Statistical significance: Rationale, validity, and utility. Thousand Oaks, CA: Sage.
58. Cleary, T. A., & Linn, R. L. (1969). Error of measurement and the power of a statistical test. British Journal of Mathematical and Statistical Psychology, 22, 49-55.
59. Cohen, J. (1962). The statistical power of abnormal and social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
60. Cohen, J. (1965). Some statistical issues in psychological research. In B. B. Wolman (Ed.)., Handbook of clinical psychology (pp. 95-121). New York: McGraw-Hill.
61. Cohen, J. (1968). Multiple regression as a general data-analytic system. Psychological Bulletin, 70, 426-443.
62. Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
63. Cohen, J. (1973). Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educational and Psychological Measurement, 33, 107-112.
64. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (Rev. ed.). New York: Academic Press.
65. Cohen, J. (1983). The costs of dichotomization. Applied Psychological Measurement, 7, 249-253.
66. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
67. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
68. Cohen, J. (1992a). A power primer. Psychological Bulletin, 112, 155-164.
69. Cohen, J. (1992b). Power analysis. Current Directions in Psychological Science, 1, 98-105.
70. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
71. Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
72. Cohen, J., & Nee, J. (1987). A comparison of two noncentral F approximations with applications to power analysis in set correlation. Multivariate Behavioral Research, 22, 438-490.
73. Cohen, P. (1983). To be or not to be: Control and balancing of Type I and Type II errors. Evaluation and Program Planning, 5, 247-253.
74. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally.
75. Cook, T. D., Campbell, D. T., & Peracchio, L. (1990). Quasi-experimentation. In M. D. Dunnette & L. A. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 491-576). Palo Alto, CA: Consulting Psychologists Press.
76. Cook, T. D., Grader, C. L., Hennigan, K. M., & Flay, B. R. (1979). The history of the sleeper effect: Some logical problems of accepting the null hypothesis. Psychological Bulletin, 86, 662-679.
77. Cook, T. J., & Poole, W. K. (1982). Treatment implementation and statistical power. Evaluation Review, 6, 425-430.
78. Cooper, H. M. (1981). On the effects of significance and the significance of effects. Journal of Personality and Social Psychology, 41, 1013-1018.
79. Cooper, H. M., & Hedges, L. V. (Eds.). (1994). The handbook of research synthesis. New York: Russell Sage.
80. Coursol, A., & Wagner, E. E. (1986). Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias. Professional Psychology: Research and Practice, 17, 136-137.
81. Cowger, C. D. (1984). Statistical significance tests: Scientific ritualism or scientific method? Social Service Review, 58, 358-372.
82. Cowles, M., & Davis, C. (1982a). On the origins of the .05 level of significance. American Psychologist, 37, 553-558.
83. Cowles, M., & Davis, C. (1982b). Is the .05 level subjectively reasonable?. Canadian Journal of Behavioral Science, 14, 248-252.
84. Cramer, E. M., & Nicewander, W. A. (1979). Some symmetric, invariant measures of multivariate association. Psychometrika, 44, 43-54.
85. Cronbach, L. J., & Gleser, G. (1965). Psychological tests and personnel decisions (2nd ed.). Urbana: University of Illinois Press.
86. Darlington, R. (1990). Regression and linear models. New York: McGraw-Hill
87. 2-test. Journal of the American Statistical Association, 69, 174-180.
88. Dodd, D. H., & Schultz, R. F. (1973). Computational procedures for estimating magnitude of effect for some analysis of variance designs. Psychological Bulletin, 79, 391-395.
89. Donner, A., & Wells, G. (1986). A comparison of confidence interval methods for the intraclass correlation coefficient Biometrics, 42, 401-412.
90. Dorans, N. J., & Drasgow, F. (1980). A note on cross-validating prediction equations. Journal of Applied Psychology, 65, 728-730.
91. Drasgow, F., & Kang, T. (1984). Statistical power of differential validity and differential prediction analyses for detecting measurement nonequivalence. Journal of Applied Psychology, 69, 498-508.
92. Dwyer, J. H. (1974). Analysis of variance and the magnitude of effects: A general approach. Psychological Bulletin, 81, 731-737.
93. Edgington, E. S. (1974). A new tabulation of statistical procedures in APA journals. American Psychologist, 29, 25-26.
94. Edgington, E. S. (1987). Randomization tests (2nd ed.). New York: Dekker.
95. Edwards, W., Lindman, H., & Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193-242.
96. Efron, B. (1986). Why isn't everyone a Bayesian? The American Statistician, 40, 1-5.
97. Erdfelder, E., Faul, F., & Buchner, A. (1996). GPOWER: A general power analysis program. Behavior Research Methods, Instruments, & Computers, 28, 1-11.
98. Fagley, N. S. (1985). Applied statistical power analysis and the interpretation of nonsignificant results by research consumers. Journal of Counseling Psychology, 32, 391-396.
99. Favreau, O. E. (1993). Do the Ns justify the means? Null hypothesis testing applied to sex and other differences. Canadian Psychology, 34, 64-78.
100. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). New York: Macmillan.
101. Feldt, L. S., & Mahmoud, M. W. (1958). Power function charts for specification of sample size in analysis of variance. Psychometrika, 23, 201-210.
102. Fenech, A., & Westfall, P. (1988). The power function for conditional loglinear model tests. Journal of the American Statistical Association, 83, 198-203.
103. Fienberg, S. (1980). The analysis of cross-classified categorical data (2nd ed.). Cambridge, MA: MIT Press.
104. Fisher, R. A. (1938). Statistical methods for research workers (7th ed.). Edinburgh, Scotland: Oliver & Boyd.
105. Fisher, R. A. (1966). Design of experiments (8th ed.). Edinburgh, Scotland: Oliver & Boyd.
106. Fleishman, A. I. (1980). Confidence intervals for correlation ratios. Educational and Psychological Measurement, 40, 659-670.
107. Folger, R. (1989). Significance tests and the duplicity of binary decisions. Psychological Bulletin, 106, 155-160.
108. Fowler, R. L. (1984). Approximating probability levels for testing null hypotheses with noncentral F distributions. Educational and Psychological Measurement, 44, 275-281.
109. Fowler, R. L. (1985a). Testing for substantive significance in applied research by specifying nonzero effect null hypotheses. Journal of Applied Psychology, 70, 215-218.
110. Fowler, R. L. (1985b). Point estimates and confidence intervals in measures of association. Psychological Bulletin, 98, 160-165.
111. Frick, R. W. (1995). Accepting the null hypothesis. Memory & Cognition, 23, 132-138.
112. Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 1, 179-190.
113. Gaebelein, J. W., & Soderquist, D. R. (1978). The utility of within-subjects variables: Estimates of strength. Educational and Psychological Measurement, 38, 351-360.
114. Gaither, N., & Glorfeld, L. (1985). An evaluation of the use of tests of significance in organizational behavior research. Academy of Management Review, 10, 787-793.
115. Gans, D. J. (1984). The search for significance: Different tests on the same data. Journal of Statistical Computation and Simulation, 19, 1-21.
116. Gatsonis, C., & Sampson, A. R. (1989). Multiple correlation: Exact power and sample size calculations. Psychological Bulletin, 106, 516-524.
117. Gibbons, J. D., & Pratt, J. W. (1975). P-values: Interpretation and methodology. The American Statistician, 29, 20-25.
118. Giere, R. N. (1972). The significance test controversy (Review of D. E. Morrison and R. E. Henkel The significance test controversy). British Journal for the Philosophy of Science, 23, 170-181.
119. Gigerenzer, G. (1991). From tools to theories: A heuristic of discovery in cognitive psychology. Psychological Review, 98, 254-267.
120. Gigerenzer, G. (1992). Discovery in cognitive psychology: New tools inspire new theories. Science in Context, 5, 329-350.
121. Gigerenzer, G., & Murray, D. J. (1987). Cognition as intuitive statistics. Hillsdale, NJ: Lawrence Erlbaum.
122. Gillett, R. (1994). Post hoc power analysis. Journal of Applied Psychology, 79, 783-785.
123. Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
124. Glass, G. V., & Hakstian, A. R. (1969). Measures of association in comparative experiments: Their development and interpretation. American Educational Research Journal, 6, 403-414.
125. Glass, G. V., & Hopkins, K. D. (1984). Statistical methods in educational psychology (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.
126. Goldstein, R. (1989). Power and sample size via MS/PC-DOS computers. American Statistician, 43, 253-260.
127. Good, I. J. (1980). The diminishing significance of a P-value as the sample size increases. Journal of Statistical Computation and Simulation, 11, 307-309.
128. Good, I. J. (1981). Some logic and history of hypothesis testing. In J. C. Pitt (Ed.), Philosophy of economics (pp. 149-174). Dordrecht, The Netherlands: Reidel.
129. Goodwin, L. D., & Goodwin, W. L. (1985a). Statistical techniques in AERJ articles, 1979-1983: The preparation of graduate students to read the educational research literature. Educational Researcher, 14, 5-11.
130. Goodwin, L. D., & Goodwin, W. L. (1985b). An analysis of statistical techniques used in the Journal of Educational Psychology, 1979-1983. Educational Psychologist, 20, 13-21.
131. Grant, D. A. (1962). Testing the null hypothesis and the strategy and tactics of investigating theoretical models. Psychological Review, 69, 54-61.
132. Graybill, F. A. (1976). Theory and application of the linear model. North Scituate, MA: Duxbury.
133. Grazer, W. F., & Stiff, M. R. (1987). Statistical analysis and design in marketing journal articles. Journal of the Academy of Marketing Science, 15, 70-73.
134. Green, S. B. (1991). How many subjects does it take to do a regression analysis? Multivariate Behavioral Research, 26, 499-510.
135. Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1-19.
136. 2 tests. Multivariate Behavioral Research, 26, 227-245.
137. Haase, R. F. (1993). POWER: An SPSS matrix program for performing univariate and multivariate power analysis. Applied Psychological Measurement, 17, 295.
138. Haase, R. F., Waechter, D. M., & Solomon, G. S. (1982). How significant is a significant difference? Average effect size of research in counseling psychology. Journal of Counseling Psychology, 29, 58-65.
139. 2 test for multidimensional contingency tables. Metrika, 31, 195-202.
140. Hacking, I. (1965). Logic of statistical inference. Cambridge, UK: Cambridge University Press.
141. Hays, W. L. (1963). Statistics for psychologists. New York: Holt, Rinehart & Winston.
142. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
143. Henkel, R. E. (1976). Tests of significance. Beverly Hills, CA: Sage.
144. 2 noncentrality parameter for power analyses. Behavior Genetics, 18, 105-108.
145. Hopkins, K. D., & Hester, P. R. (1995). The noncentrality parameter for the F distribution, mean squares, and effect size: An examination of some mathematical relationships. Educational & Psychological Measurement, 55, 998-999.
146. Huberty, C. J. (1972). Multivariate indices of strength of association. Multivariate Behavioral Research, 7, 523-526.
147. Huberty, C. J. (1993). Historical origins of statistical testing practices: The treatment of Fisher versus Neyman-Pearson views in textbooks. Journal of Experimental Education, 61, 317-333.
148. Huck, S. W., Cormier, W. H., & Bounds, W. G. (1974). Reading statistics and research. New York: Harper & Row.
149. Hulin, C. L., Henry, R. A., & Noon, S. (1990). Adding a dimension: Time as a factor in the generalizability of predictive relationships. Psychological Bulletin, 107, 328-340.
150. Humphreys, L. G. (1980). The statistics of failure to replicate: A comment on Buriel's (1978) conclusions. Journal of Educational Psychology, 72, 71-75.
151. Humphreys, L. G. (1985). Correlations in psychological research. In D. K. Detterman (Ed.), Current topics in human intelligence (Vol. 1, pp. 3-24). Norwood, NJ: Ablex.
152. Humphreys, L. G. (1987). Quantitative methodology: Then, now, and the future. In J. A. Glover & R. R. Roning (Eds.), Historical foundations of educational psychology (pp. 403-414). New York: Plenum.
153. Humphreys, L. G. (1993). Further comments on reliability and power of significance tests. Applied Psychological Measurement, 17, 11-14.
154. Humphreys, L. G., & Drasgow, F. (1989a). Some comments on the relation between reliability and statistical power. Applied Psychological Measurement, 13, 419-425.
155. Humphreys, L. G., & Drasgow, F. (1989b). Paradoxes, contradictions, and illusions. Applied Psychological Measurement, 13, 429-431.
156. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis. Newbury Park, CA: Sage.
157. Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis: Cumulating research results across studies.Thousand Oaks, CA: Sage.
158. Jackson, P. H. (1976). The philosophy and methodology of Bayesian inference. In D.N.M. De Gruijter & L. J.Th. van der Kamp (Eds.), Advances in psychological and educational measurement (pp. 3-16), New York: John Wiley.
159. Jain, A. K., & Dubes, R. C. (1988). Algorithms for clustering data. Englewood Cliffs, NJ: Prentice Hall.
160. James, L. R., & James, L. A. (1989). Causal modelling in organizational research. In C. L. Cooper & I. Robertson (Eds.), International review of industrial and organizational psychology 1989 (Vol. 4, pp. 371-404). Chichester, UK: John Wiley.
161. James, L. R., Mulaik, S. A., & Brett; J. M. (1982). Causal analysis: Assumptions, models, and data. Beverly Hills, CA: Sage.
162. Johnson, B. T., Mullen, B., & Salas, E. (1995). Comparison of three major meta-analytic approaches. Journal of Applied Psychology, 80, 94-106.
163. Judd, C. M., & Kenny, D. A. (1982). Research design and research validity. In D. Brinberg & L. Kidder (Eds.), Forms of validity in research (pp. 23-39). San Francisco: Jossey-Bass.
164. Julnes, G., & Mohr, L. B. (1989). Analysis of no-difference findings in evaluation research. Evaluation Review, 13, 628-655.
165. Kaiser, H. F. (1960). Directional statistical hypotheses. Psychological Review, 67, 160-167.
166. Kelley, T. L. (1935). An unbiased correlation ratio measure. Proceedings of the National Academy of Sciences, 21, 554-559.
167. Keppel, G. (1991). Design and analysis: A researcher's handbook (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
168. Keren, G., & Lewis, C. (1979). Partial omega-squared for ANOVA designs. Educational and Psychological Measurement, 39, 119-128.
169. Keselman, H. J. (1975). A Monte Carlo investigation of three estimates of treatment magnitude. Canadian Psychological Review, 16, 44-48.
170. Kiefer, J. C. (1987). Introduction to statistical inference. New York: Springer-Verlag.
171. Kimble, A. W. (1957). Errors of the third kind in statistical consulting. Journal of the American Statistical Association, 52, 133-142.
172. Kimmel, H. D. (1957). Three criteria for the use of one-tailed tests. Psychological Bulletin, 54, 351-353.
173. Kirk, R. E. (1995). Experimental design: Procedures for the behavioral sciences (3rd ed.). Pacific Grove, CA: Brooks/Cole.
174. Kirk, R. E. (1996). Practical significance: An idea whose time has come. Educational and Psychological Measurement, 56, 746-759.
175. Koele, P. (1982). Calculating power in analysis of variance. Psychological Bulletin, 92, 513-516.
176. Kraemer, H. C. (1985). A strategy to teach the concept and application of power of statistical tests. Journal of Educational Statistics, 10, 173-195.
177. Kraemer, H. C., & Thiemann, S. (1987). How many subjects? Statistical power analysis in research. Newbury Park, CA: Sage.
178. 2. The American Statistician, 39, 279-285.
179. Kyburg, H. E. (1987). The basic Bayesian blunder. In I. MacNeil & G. Umphrey (Eds.), Foundations of statistical inference (pp. 219-232). Dordrecht, The Netherlands: Reidel.
180. Lahey, M. A., Downey, R. G., & Saal, F. E. (1983). Intraclass correlations: There's more there than meets the eye. Psychological Bulletin, 93, 586-595.
181. Lane, D. M., & Dunlap, W. P. (1978). Estimating effect size: Bias resulting from the significance criterion in editorial decisions. British Journal of Mathematical and Statistical Psychology, 31, 107-112.
182. LaTour, S. (1981a). Effect-size estimation: A commentary on Wolf and Bassler. Decision Sciences, 12, 136-141.
183. LaTour, S. (1981b). Variance explained: It measures neither importance nor effect size. Decision Sciences, 12, 150-160.
184. Laubscher, N. J. (1960). Normalizing the noncentral t and F distributions. Annals of Mathematical Statistics, 31, 1105-1112.
185. Laudan, L. (1984). Science and values. Berkeley: University of California Press.
186. Lehmann, E. L. (1958). Significance level and power. Annals of Mathematical Statistics, 29, 1167-1176.
187. Lehmann, E. L. (1985). The Neyman-Pearson theory after fifty years. In L. LeCam & R. A. Olshen (Eds.), Proceedings of the Berkeley conference in honor of Jerzy Neyman and Jack Kiefer (pp. 1-14). New York: Wadsworth.
188. Lehmann, E. L. (1986). Testing statistical hypotheses (Rev. ed.). New York: John Wiley.
189. Lenth, R. V. (1987). Powerpack: A microcomputer package for power aad sample size problems [Computer program]. American Statistician, 41, 239-240.
190. Lenth, R. V. (1988). Algorithm AS 226: Computing noncentral beta probabilities [Computer program]. Applied Statistics, 36, 241-244.
191. Leventhal, L. (1993). Nudging aside Meehl's paradox. Canadian Psychology, 35, 283-298.
192. Leventhal, L., & Huynh, C-L. (1996). Directional decisions for two-tailed tests: Power, error rates, and sample size. Psychological Methods, 1, 278-292.
193. Levin, H. M. (1991). Cost-effectiveness at quarter-century. In M. W. McLaughlin & D. C. Phillips (Eds.), Evaluation and education: At quarter century (90th Yearbook National Society for the Study of Education, Part II, pp. 189-209). Chicago: University of Chicago Press.
194. Levin, J. R. (1967). Misinterpreting the significance of "explained variation." American Psychologist, 22, 675-676.
195. Levin, J. R. (1997). Overcoming feelings of powerlessness in "aging" researchers: A primer on statistical power in analysis of variance designs. Psychology and Aging, 12, 84-106.
196. Levin, J. R., & Subkoviak, M. J. (1977). Planning an experiment in the company of measurement error. Applied Psychological Measurement, 1, 331-338.
197. Levy, K. J., & Narula, S. C. (1974). Probability density plots of the non-central t-distribution. International Statistical Review, 42, 305-306.
198. Lewis, C. (1993). Bayesian methods for the analysis of variance. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences (Vol. 1, pp. 233-256). Hillsdale, NJ: Lawrence Erlbaum.
199. Lindsay, R. M. (1993). Incorporating statistical power into the test of significance procedure: A methodological and empirical inquiry. Behavioral Research in Accounting, 5, 211-236.
200. Lipsey, M. W. (1990). Design sensitivity: Statistical power for experimental research. Newbury Park, CA: Sage.
201. Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
202. Locke, E. A. (1968). Toward a theory of task motivation and incentives. Organizational Behavior and Human Performance, 3, 157-189.
203. Loftus, G. R. (1993). A picture is worth a thousand p values: On the irrelevance of hypothesis testing in the microcomputer age. Behavior Research Methods, Instruments, & Computers, 25, 250-256.
204. Loftus, G. R. (1996). Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 5, 161-171.
205. MacCallum, R. A. (1988). Multidimensional scaling. In J. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed.). New York: Plenum.
206. MacCallum, R. C., Browne, M. W., & Sugawara, H. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149.
207. Maiti, S. S., & Mukherjee, B. N. (1990). A note on distributional properties of the Joreskog-Sorbom fit indices. Psychometrika, 55, 721-726.
208. Marascuilo, L. A., & Levin, J. R. (1970). Appropriate post hoc comparisons for interaction and nested hypotheses in analysis of variance designs: The elimination of Type IV errors. American Educational Research Journal, 7, 397-421.
209. Marcoulides, G. A. (1993). Maximizing power in generalizability studies under budget constraints. Journal of Educational Statistics, 18, 197-206.
210. Mark, M. M. (1983). Treatment implementation, statistical power, and internal validity. Evaluation Review, 7, 543-549.
211. Mason, C. H., & Perreault, W. D. Jr. (1991). Collinearity, power, and interpretation of multiple regression analysis. Journal of Marketing Research, 28, 268-280.
212. Mathieu, J. E., & Zajac, D. M. (1990). A review and meta-analysis of the antecedents, correlates, and consequences of organizational commitment. Psychological Bulletin, 108, 171-194.
213. Matsueda, R. L., & Bielby, W. T. (1986). Statistical power in covariance structure models. In N. B. Tuma (Ed.), Sociological methodology 1986 (pp. 120-158). Washington, DC: American Sociological Association.
214. Maxwell, S. E. (1980). Dependent variable reliability and determination of sample size. Applied Psychological Measurement, 4, 253-260.
215. Maxwell, S. E., Camp, C. J., & Arvey, R. D. (1981). Measures of strength of association: A comparative examination. Journal of Applied Psychology, 66, 525-534.
216. Maxwell, S. E., Cole, D. A., Arvey, R. D., & Salas, E. (1991). A comparison of methods for increasing power in randomized between-subjects designs. Psychological Bulletin, 110, 328-337.
217. Mayo, D. G. (1985). Behavioristic, evidentialist, and learning models of statistical testing. Philosophy of Science, 52, 493-516.
218. Mazen, A. M., Graf, L. A., Kellogg, C. E., & Hemmasi, M. (1987). Statistical power in contemporary management research. Academy of Management Journal, 30, 369-380.
219. McDonald, R. P. (1989). An index of goodness-of-fit based on noncentrality. Journal of Classification, 6, 97-103.
220. Medsker, G. M., Williams, L. J., & Holohan, P. (1994). A review of current practices for evaluating causal models in organizational behavior and human resources management research. Journal of Management, 20, 439-464.
221. Meehl, P. E. (1967). Theory testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115.
222. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
223. Meehl, P. E. (1990). Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it (with commentary). Psychological Inquiry, 1, 108-141.
224. Meehl, P. E. (1991). Why summaries of research on a psychological theory are often uninterpretable. In R. Snow & D. E. Wiley (Eds.), Improving inquiry in the social sciences: A volume in honor of Lee J. Cronbach (pp. 13-59). Hillsdale, NJ: Lawrence Erlbaum.
225. Meyer, D. L., & Collier, R. O. (Eds.). (1970). Bayesian statistics. Itasca, IL: F. E. Peacock.
226. Milligan, G. W., & McFillen, J. M. (1984). Statistical conclusion validity in experimental designs used in business research. Journal of Business Research, 12, 437-462.
227. 2 test. Annals of Mathematical Statistics, 21, 1221-1233.
228. Mohr, L. B. (1990). Understanding significance testing. Newbury Park, CA: Sage.
229. Mone, M. A., Mueller, G. C., & Mauland, W. (1996). The perception and usage of statistical power in applied psychology and management research. Personnel Psychology, 49, 103-120.
230. Montgomery, D. C. (1991). Design and analysis of experiments. New York: John Wiley.
231. Morris, C. N. (1986). Comment on Efron. American Statistician, 40, 7-8.
232. Morrison, D. E., & Henkel, R. E. (Eds.). (1970). The significance test controversy. Hawthorne, NY: Aldine.
233. Mulaik, S. A., James, L. R., Alstine, J., Bennett, N., Lind, S., & Stillwell, C. D. (1989). An evaluation of goodness of fit indices for structural equation models. Psychological Bulletin, 105, 430-445.
234. Muller, K. E., LaVange, L. M., Ramey, S. L., & Ramey, C. T. (1992). Power calculations for general linear model multivariate models including repeated measures applications. Journal of the American Statistical Association, 87, 1209-1226.
235. Murphy, K. R. (1983). Fooling yourself with cross-validation: Single sample designs. Personnel Psychology, 36, 111-118.
236. Murray, L., & Dosser, D. (1987). How significant is a significant difference? Problems with the measurement of magnitude of effect. Journal of Counseling Psychology, 34, 68-72.
237. 2 and non-central F distributions. International Statistical Review, 43, 79-82.
238. Narula, S. C., & Weistroffer, H. R. (1986). Computation of the probability and noncentrality parameter of a non-central F-distribution. Communications in Statistics and Simulation, 15, 871-878.
239. Nesselroade, J. B., & Cattell, R. B. (Eds.). (1988). Handbook of multivariate experimental psychology (2nd ed.). New York: Plenum.
240. Neuliep, J. (Ed.). (1991). Replication research in the social sciences. Newbury Park, CA: Sage.
241. Neyman, J., & Pearson, E. S. (1933). On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society, A, 231, 289-337.
242. Norton, V. (1983). A simple algorithm for computing the non-central F distribution. Applied Statistician, 32, 84-85.
243. Novick, M. R., & Jackson, P. H. (1974). Statistical methods for educational and psychological research. New York: McGraw-Hill.
244. Oakes, M. R. (1986). Statistical inference: A commentary for the social and behavioural sciences. Chichester, UK: John Wiley.
245. O'Brien, R. G. (1986). Using the SAS system to perform power analyses for log-linear models. Proceedings of the 11th SAS Users Group International Conference (pp. 778-784). Cary, NC: SAS Institute.
246. O'Brien, R. G. (1988). Review of Powerpack. American Statistician, 42, 266-270.
247. Odeh, R. E., & Fox, M. (1975). Sample size choice. New York: Dekker.
248. O'Grady, K. E. (1982). Measures of explained variation: Cautions and limitations. Psychological Bulletin, 92, 766-777.
249. Olkin, I., & Pratt, J. W. (1958). Unbiased estimation of certain correlation coefficients. Annals of Mathematical Statistics, 29, 201-211.
250. Olson, C. A. (1974). Comparative robustness of six tests in multivariate analysis of variance. Journal of the American Statistical Association, 69, 894-908.
251. Orwin, D. G., & Cordray, D. S. (1985). Effects of deficient reporting on meta-analysis: A conceptual framework and reanalysis. Psychological Bulletin, 97, 134-147.
252. Overall, I. E. (1969). Classical statistical hypothesis testing within the context of Bayesian theory. Psychological Bulletin, 71, 285-292.
253. Overall, J. E. (1989a). Contradictions can never a paradox resolve. Applied Psychological Measurement, 13, 426-428.
254. Overall, J. E. (1989b). Distinguishing between measurements and dependent variables. Applied Psychological Measurement, 13, 432-433.
255. Overall, J. E., & Dalal, S. N. (1965). Design of experiments to maximize power relative to cost. Psychological Bulletin, 64, 339-350.
256. Overall, J. E., & Woodward, J. A. (1975). Unreliability of difference scores: A paradox for the measurement of change. Psychological Bulletin, 82, 85-86.
257. Ozer, D. J. (1985). Correlation and the coefficient of determination. Psychological Bulletin, 97, 307-315.
258. Pearson, K. (1905). On the theory of skew correlations and nonlinear regression. Mathematical contributions to the theory of evolution (Biometric Laboratory Publications, University of London). Cambridge, UK: Cambridge University Press.
259. Pearson, K. (1911). On a correction needful in the case of the correlation ratio. Biometrika, 8, 254-256.
260. Pearson, E. S. (1955). Statistical concepts in their relation to reality. Journal of the Royal Statistical Society, B, 17, 204-207.
261. Pearson, E. S., & Hartley, H. O. (1951). Charts of the power function for analysis of variance derived from the noncentral F distribution. Biometrika, 38, 112-130.
262. Peters, C., & Van Voorhis, W. (1940). Statistical procedures and their mathematical bases. New York: McGraw-Hill.
263. Phillips, L. D. (1974). Bayesian statistics for social scientists. New York: Crowell.
264. Pollard, P., & Richardson, J.T.E. (1987). On the probability of making Type I errors. Psychological Bulletin, 102, 159-163.
265. Ramsey, P. H. (1982). Empirical power of procedures for comparing two groups on p variables. Journal of Educational Statistics, 7, 139-156.
266. Richardson, J.T.E. (1996). Measures of effect size. Behavior Research Methods, Instruments, & Computers, 28, 12-22.
267. Rodgers, J. L. (1988). Structural models of the American Psychological Association: A taxonomy for reorganization. American Psychologist, 43, 372-382.
268. Rodgers, R., & Hunter, J. E. (1991). Impact of Management by Objectives on organizational productivity. Journal of Applied Psychology, 76, 322-336.
269. Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775-777.
270. Rosenthal, R. (1991). Meta-analytic procedures for social research. Newbury Park, CA: Sage.
271. Rosenthal, R., & Rubin, D. R. (1978). Interpersonal expectancy effects: The first 345 studies [with commentary]. The Behavioral and Brain Sciences, 3, 377-415.
272. Rosenthal, R., & Rubin, D. R. (1979). A note on percent variance explained as a measure of the importance of effects. Journal of Applied Social Psychology, 9, 395-396.
273. Rosenthal, R., & Rubin, D. R. (1982). A simple general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169.
274. Rosnow, R. L., & Rosenthal, R. (1988). Focused tests of significance and effect size estimation in counseling psychology. Journal of Counseling Psychology, 35, 203-208.
275. Rothstein, H. R., Borenstein, M., Cohen, J., & Pollack, S. (1990). Statistical power analysis for multiple regression/correlation: A computer program. Educational and Psychological Measurement, 50, 819-830.
276. Rouanet, H. (1996). Bayesian methods for assessing importance of effects. Psychological Bulletin, 119, 149-158.
277. Rozeboom, W. W. (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428.
278. Rust, R. T., Lehmann, D. R., & Parley, J. U. (1990). Estimating publication bias in meta-analysis. Journal of Marketing Research, 27, 220-236.
279. Sackett, P. R., & Mullen, E. J. (1993). Beyond formal experimental design: Towards an expanded view of the training evaluation process. Personnel Psychology, 46, 613-627.
280. Sackett, P. R., & Wade, B. E. (1983). On the feasibility of criterion related validity: The effects of range restriction assumptions on needed sample size. Journal of Applied Psychology, 68, 374-381.
281. Salmon, W. (1980). Bayes' theorem and the history of science. In R. H. Steuwer (Ed.), Minnesota studies in the philosophy of science (Vol. 6, pp. 75-90). Minneapolis: University of Minnesota Press.
282. Saris, W. E., & Satorra, A. (1993). Power evaluations in structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 181-204). Newbury Park, CA: Sage.
283. Saris, W., & Stronkhorst, H. (1984). Causal modeling in nonexperimental research. Amsterdam, The Netherlands: Sociometric Research Foundation.
284. Sauley, K. S., & Bedeian, A. G. (1989). .05: A case of the tail wagging the distribution. Journal of Management, 15, 335-344.
285. Sawyer, A. G., & Ball, A. D. (1981). Statistical power and effect size in marketing research. Journal of Marketing Research, 18, 275-290.
286. Sawyer, A. G., & Peter, J. P. (1983). The significance of statistical significance tests in marketing research. Journal of Marketing Research, 20, 122-133.
287. Scheffé, H. (1959). The analysis of variance. New York: John Wiley.
288. Schmidt, F. L. (1992). What do data really mean? American Psychologist, 47, 1173-1181.
289. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129.
290. Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
291. Schmidt, F. L., Hunter, J. E., & Outerbridge, A. (1986). Impact of job experience and ability on job knowledged, work sample performance, and supervisory ratings of job performance. Journal of Applied Psychology, 71, 432-439.
292. Schmidt, F. L., Hunter, J. E., & Urry, V. W. (1976). Statistical power in criterion related validation studies. Journal of Applied Psychology, 61, 473-485.
293. Schmitt, N., Gooding, R. Z., Noe, R. A., & Kirsch, M. (1984). Metaanalyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407-422.
294. Sechrest, L., & Yeaton, W. (1982). Magnitudes of experimental effects in social science research. Evaluation Review, 6, 579-600.
295. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
296. Self, S. G., & Mauritsen, R. H. (1988). Power/sample size calculations for generalized linear models. Biometrics, 44, 79-86.
297. Selvin, H. C. (1957). A critique of tests of significance in survey research. American Sociological Review, 22, 519-527.
298. Serlin, R. C. (1982). A multivariate measure of association based on the Pillai-Bartlett procedure. Psychological Bulletin, 91, 413-417.
299. Singer, B. R., Lovie, A. D., & Lovie, P. (1986). Sample size and power. In A. D. Lovie (Ed.), New developments in statistics for psychology and the social sciences (pp. 129-142). London: British Psychological Society and Methuen.
300. Smith, C.A.B. (1956). On the estimation of the intraclass correlation. Annals of Human Genetics, 21, 363-373.
301. Smith, P.L. (1982). Measures of variance accounted for: Theory and practice. In G. Keren (Ed.), Statistical and methodological issues in psychology and social sciences research (pp. 101-129). Hillsdale, NJ: Lawrence Erlbaum.
302. Spielman, S. (1974). The logic of tests of significance. Philosophy of Science, 41, 211-226.
303. Stallings, W. M. (1985). Mind your p's and alphas. Educational Researcher, 14, 19-20.
304. Steiger, J. H., & Lind, A. (1980, June). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
305. Steiger, J. H., & Ward, L. M. (1987). Factor analysis and the coefficient of determination. Psychological Bulletin, 101, 471-474.
306. Steiner, D. D., Lane, I. M., Dobbins, G. H., Schnur, A., & McConnell, S. (1991). A review of meta-analyses in organizational behavior and human resources management: An empirical assessment. Educational and Psychological Measurement, 51, 609-627.
307. Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn for tests of significance - or vice versa. Journal of the American Statistical Association, 54, 30-34.
308. Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995). Publication decisions revisited: The effect of statistical tests on the decision to publish and vice versa. American Statistician, 49, 108-112.
309. Stevens, J. P. (1972). Four methods of analyzing between variation for the k-group MANOVA problem. Multivariate Behavioral Research, 7, 499-522.
310. Stevens, J. P. (1979). Comment on Olson: Choosing a test statistic in multivariate analysis of variance. Psychological Bulletin, 86, 355-360.
311. Stevens, J. P. (1980). Power of the multivariate analysis of variance tests. Psychological Bulletin, 88, 728-737.
312. Stevens, J. P. (1992). Applied multivariate statistics for the social sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
313. Stone-Romero, E. F., & Anderson, L. E. (1994). Relative power of moderated multiple regression and the comparison of subgroup correlation coefficients for detecting moderating effects. Journal of Applied Psychology, 79, 354-359.
314. Strube, M. J. (1985). ICC: A BASIC program for the calculation of intraclass correlations based on fixed effects and random effects models. Behavior Research Methods, Instruments, & Computers, 17, 578.
315. Strube, M. J. (1988). Some comments on the use of magnitude-of-effect estimates. Journal of Counseling Psychology, 35, 342-345.
316. Stuart, A., & Ord, J. K. (1991). Kendall's advanced theory of statistics (Vol. 2, Classical inference and relationship, 5th ed.). Oxford, UK: Oxford University Press.
317. Subkoviak, M. J., & Levin, J. R. (1977). Fallibility of measurement and the power of a statistical test. Journal of Educational Measurement, 14, 47-52.
318. Susskind, E. C., & Howland, E. W. (1980). Measuring effect magnitude in repeated measures ANOVA designs: Implications for gerontological research. Journal of Gerontology, 35, 867-876.
319. Sutcliffe, J. P. (1958). Error of measurement and the sensitivity of a test of significance. Psychometrika, 23, 9-17.
320. Tang, P. C. (1938). The power function of the analysis of variance tests with tables and illustrations of their use. Statistical Research Memoirs, 2, 126-149.
321. Tatsuoka, M. M. (1988). Multivariate analysis: Techniques for educational and psychological research. New York: Macmillan.
322. Thomas, L., & Krebs, C. J. (1997). A review of statistical power analysis software. Bulletin of the Ecological Society of America, 78, 128-139.
323. Thompson, B. (Ed.). (1993). Statistical significance testing in contemporary practice: Some proposed alternatives with comments from journal editors [Special issue]. Journal of Experimental Education, 61, 285-393.
324. Thompson, B. (1994). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality, 62, 157-176.
325. Thurstone, L. L. (1937). Psychology as a quantitative rational science. Science, 85, 227-232.
326. Tiku, M. L. (1967). Tables of the power of the F test. Journal of the American Statistical Association, 62, 525-539.
327. Tukey, J. W. (1962). The future of data analysis. Annals of Mathematical Statistics, 33, 1-67.
328. Vaughan, G. M., & Corballis, M. C. (1969). Beyond tests of significance: Estimating strength of effects in selected ANOVA designs. Psychological Bulletin, 72, 204-213.
329. Venables, W. (1975). Calculation of confidence intervals for noncentrality parameters. Journal of the Royal Statistical Society, B, 37, 406-412.
330. Wald, A. (1950). Statistical decision functions. New York: John Wiley.
331. Wanous, J., Sullivan, S. E., & Malinak, J. (1989). The role of judgment calls in meta-analysis. Journal of Applied Psychology, 74, 259-264.
332. Webb, N. M., Shavelson, R. J., & Maddahian, E. (1983). Multivariate generalizability theory. In L. J. Fyans (Ed.), Generalizability theory: Inferences and practical applications (pp. 67-81). San Francisco: Jossey-Bass.
333. Westermann, R., & Hager, W. (1986). Error probabilities in educational and psychological research. Journal of Educational Statistics, 11, 117-146.
334. Wickens, T. D. (1989). Multiway contingency tables analysis for the social sciences. Hillsdale, NJ: Lawrence Erlbaum.
335. Williams, L., & James, L. R. (1994). Causal models in organizational behavior research: From path analysis to LISREL and beyond. In J. Greenberg (Ed.), Organizational behavior: The state of the science (pp. 181-205). Hillsdale, NJ: Lawrence Erlbaum.
336. Winch, R. F., & Campbell, D. T. (1969). Proof? No. Evidence? Yes. The significance of tests of significance. American Sociologist, 4, 140-143.
337. Winkler, R. L. (1993). The Bayesian approach: A general review. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences (pp. 201-232). Hillsdale, NJ: Lawrence Erlbaum.
338. Yang, H., Sackett, P. R., & Arvey, R. D. (1996). Statistical power and cost in training evaluation: Some new considerations. Personnel Psychology, 49, 651-668.
339. Yeaton, W., & Sechrest, L. (1981). Meaningful measures of effect. Journal of Consulting and Clinical Psychology, 49, 766-767.
340. Yeaton, W. H., & Sechrest, L. (1986). Use and misuse of no-difference findings in eliminating threats to validity. Evaluation Review, 10, 836-852.
341. Yeaton, W. H., & Sechrest, L. (1987). No-difference research. In D. S. Cordray, H. S. Bloom, & R. J. Light (Eds.), Evaluation practice in review (New Directions for Program Evaluation, No. 34). San Francisco: Jossey-Bass.
342. Zimmerman, D. W., & Williams, R. (1986). Note on the reliability of experimental measures and the power of significance tests. Psychological Bulletin, 100, 123-124.
343. Zimmerman, D. W., Williams, R., & Zumbo, B. D. (1993a). Reliability of measurement and power of significance tests based on differences. Applied Psychological Measurement, 17, 1-9.
344. Zimmerman, D. W., Williams, R., & Zumbo, B. D. (1993b). Reliability, power, functions, and relations: A reply to Humphreys. Applied Psychological Measurement, 17, 15-16.
345. Zimmerman, D. W., & Zumbo, B. D. (1993). The relative power of parametric and nonparametric statistical methods. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences (pp. 481-517). Hillsdale, NJ: Lawrence Erlbaum.
346. Zuckerman, M., Hodgins, H. S., Zuckerman, A., & Rosenthal, R. (1993). Contemporary issues in the analysis of data: A survey of 551 psychologists. Psychological Science, 4, 49-57.