More powerful tests of predictor subsets in regression analysis under nonnormality

Psychological Methods

Volumn 9, Issue 4, 2004, Pages 492-509

  Serlin, Ronald C ^a   Harwell, Michael R ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; PREDICTION AND FORECASTING; PSYCHOLOGIC TEST; PSYCHOLOGICAL MODEL; REGRESSION ANALYSIS;

HUMANS; MODELS, PSYCHOLOGICAL; PREDICTIVE VALUE OF TESTS; PSYCHOLOGICAL TESTS; REGRESSION ANALYSIS;

EID: 10844263325     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.9.4.492     Document Type: Article

References (100)

1. Adichie, J. N. (1978). Rank tests of sub-hypotheses in the general linear regression. Annals of Statistics, 6, 1012-1026.
2. Akritas, M. G. (1990). The rank transform method in some two-factor designs. Journal of the American Statistical Association, 85, 73-78.
3. Akritas, M. G. (1991). An alternative derivation of aligned rank tests for regression. Journal of Statistical Planning and Inference, 27, 171-186.
4. Akritas, M. G., & Arnold, S. F. (1994). Fully nonparametric hypotheses for factorial designs: I. Multivariate repeated measures designs. Journal of the American Statistical Association, 89, 336-343.
5. Anderson, T. W. (1984). An introduction to multivariate statistical analysis (2nd ed.). New York: Wiley.
6. Anscombe, F. J. (1948). The transformation of Poisson, binomial, and negative-binomial data. Biometrika, 35, 246-254.
7. Aubuchon, J. C., & Hettmansperger, T. P. (1984). On the use of rank tests and estimates in the linear model. In P. R. Krishnaiah & P. K. Sen (Eds.), The handbook of statistics (Vol. 4, pp. 259-274). New York: Elsevier.
8. Babakus, E., Ferguson, C. E., & Joreskog, K. G. (1987). The sensitivity of confirmatory maximum likelihood factor analysis to violations of measurement scale and distributional assumptions. Journal of Marketing Research, 37, 72-141.
9. 2. Technometrics, 13, 198.
10. Blackman, R. B., & Tukey, J. W. (1958). The measurement of power spectra. New York: Dover.
11. Blair, R. C., & Higgins, J. J. (1985). Comparison of the power of the paired samples t-test to that of Wilcoxon's signed-ranks test under various population shapes. Psychological Bulletin, 97, 119-128.
12. Bollen, K. A., & Barb, K. H. (1981). Pearson's r and coarsely categorized measures. American Sociological Review, 46, 232-239.
13. Box, G. E. P., & Andersen, S. L. (1955). Permutation theory in the derivation of robust criteria and the study of departures from assumption. Journal of the Royal Statistical Society, Series B, 17, 1-34.
14. Box, G. E. P., & Muller, M. E. (1958). A note on the generation of random normal deviates. Annals of Mathematical Statistics, 28, 610-611.
15. Budescu, D. V., & Appelbaum, M. I. (1981). Variance stabilizing transformations and the power of the F test. Journal of Educational Statistics, 6, 55-74.
16. Chen, T.-Y., & Serlin, R. C. (1999, April). A Monte Carlo study comparing power rates and Type I error rates of the Wilcoxon test and Student's t-test on transformed data. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada.
17. Clogg, C. C., & Shihadeh, E. S. (1994). Statistical models for ordinal variables. Thousand Oaks, CA: Sage.
18. Cobham, I., & Applegate, B. (1999, April). The effects of subject-to-variable ratio, measurement scale, and number of factors on the stability of the factor model. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada.
19. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
20. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
21. Cohen, P., Cohen, J., West, S. G., & Aiken, L. S. (2003). Applied multiple regression: Correlation analysis for the behavioral sciences. Mahwah, NJ: Erlbaum.
22. Conover, W. J., & Iman, R. L. (1976). On some alternative procedures using ranks for the analysis of variance of experimental designs. Communications in Statistics - Theories and Methods, 14, 1349-1368.
23. Draper, D. (1981). Rank-based robust analysis of linear models. Unpublished doctoral dissertation, University of California - Berkeley.
24. Draper, D. (1988). Rank-based robust analysis of linear models: I. Exposition and review. Statistical Science, 3, 239-271.
25. Draper, N. R., & Smith, H. (1981). Applied regression analysis (2nd ed.). New York: Wiley.
26. Embretson, S. E. (1996). Item response theory and spurious interaction effects in factorial ANOVA designs. Applied Psychological Measurement, 20, 201-212.
27. Fawcett, R. F., & Salter, K. (1984). A Monte Carlo study of the F test and three tests based on ranks of treatment effects in randomized block designs. Communications in Statistics - Simulation and Computation, 13, 213-225.
28. Fleishman, A. (1978). A method for simulating nonnormal distributions. Psychometrika, 43, 521-532.
29. Games, P. A. (1983). Curvilinear transformations of the dependent variable. Psychological Bulletin, 93, 382-387.
30. Games, P. A. (1984). Data transformations, power, and skew: A rebuttal to Levine and Dunlap. Psychological Bulletin, 95, 345-347.
31. Good, I. J. (1987). Ordinal data and LISREL: A note on significance level. Journal of Statistical Computing and Simulation, 28, 179-183.
32. Gorham, J. L. (1998). The effects on Type I error rate and power of selected competitors to the ANOVA F test in the randomized block designs under non-normality and variance heterogeneity. Unpublished doctoral dissertation, Rutgers, the State University of New Jersey.
33. Gregoire, T. G., & Driver, B. L. (1987). Analysis of ordinal data to detect population differences. Psychological Bulletin, 101, 159-165.
34. Groggel, D. J. (1987). A Monte Carlo study of rank tests for block design. Communication in Statistics - Simulation and Computation, 16, 601-620.
35. Guilford, J. P. (1954). Psychometric methods (2nd ed.). New York: McGraw-Hill.
36. Harwell, M. R. (1991). Completely randomized factorial analysis of variance using ranks. British Journal of Mathematical and Statistical Psychology, 44, 383-401.
37. Harwell, M. R., & Gatti, G. G. (2001). Rescaling ordinal data into interval data in educational research. Review of Educational Research, 71, 105-131.
38. Harwell, M. R., & Serlin, R. C. (1994). A Monte Carlo study of the Friedman test and some competitors in the single-factor, repeated measures design with unequal covariances. Computational Statistics & Data Analysis, 17, 35-49.
39. Harwell, M. R., & Serlin, R. C. (1997). An empirical study of five multivariate tests for the single-factor repeated measures model. Communication in Statistics - Simulation and Computation, 26, 605-618.
40. Hays, W. L. (1973). Statistics for the social sciences (2nd ed.). New York: Holt, Rinehart, & Winston.
41. Hettmansperger, T. P. (1984). Statistical inference based on ranks. New York: Wiley.
42. Hettmansperger, T. P., & McKean, J. W. (1977). A robust alternative based on ranks to least squares in analyzing general linear models. Technometrics, 19, 275-284.
43. Hettmansperger, T. P., & McKean, J. W. (1983). A geometric interpretation of inferences based on ranks in the linear model. Journal of the American Statistical Association, 78, 885-893.
44. Hettmansperger, T. P., & McKean, J. W. (1998). Robust nonparametric statistical methods. London: Arnold.
45. Hill, M., & Dixon, W. J. (1982). Robustness in real life: A study of clinical laboratory data. Biometrics, 38, 377-396.
46. Hoaglin, D. C., & Andrews, D. F. (1975). The reporting of computation-based results in statistics. The American Statistician, 29, 122-126.
47. Hodges, J. L., & Lehmann, E. L. (1962). Rank methods for combination of independent experiments in analysis of variance. Annals of Mathematical Statistics, 33, 482-497.
48. Hu, L. T., Bentler, P. M., & Kano, Y. (1992). Can statistics in covariance structure analysis be trusted? Psychological Bulletin, 112, 351-362.
49. Jaeckel, L. A. (1972). Estimating regression coefficients by minimizing the dispersion of the residuals. Annals of Mathematical Statistics, 43, 1449-1458.
50. Kaiser, H. F., & Dickman, K. (1962). Sample and population score matrices and sample correlation matrices from an arbitrary population correlation matrix. Psychometrika, 27, 179-182.
51. Kendall, M., & Stuart, A. (1979). The advanced theory of statistics (Vol. 2, 4th ed.). New York: Macmillan.
52. Knapp, T. (1978). Canonical correlation analysis: A general parametric significance-testing system. Psychological Bulletin, 85, 410-416.
53. Lehmann, E. L. (1975). Nonparametrics: Statistical methods based on ranks. San Francisco: Holden-Day.
54. Levine, D. W., & Dunlap, W. P. (1982). Power of the F test with skewed data: Should one transform or not? Psychological Bulletin, 92, 272-280.
55. Levine, D. W., & Dunlap, W. P. (1983). Data transformation, power, and skew: A rejoinder to Games. Psychological Bulletin, 93, 596-599.
56. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
57. Mansouri, M. (1996, August). Analysis of variance based on ranks using computing packages. Paper presented at the Joint Statistical Meetings, Chicago.
58. Mansouri, H., & Chang, G. H. (1995). A comparative study of some rank tests for interaction. Computational Statistics and Data Analysis, 19, 85-96.
59. Marascuilo, L. A., & McSweeney, M. (1977). Nonparametric and distribution-free methods for the social sciences. Monterey, CA: Brooks/Cole.
60. Maritz, J. S. (1995). Distribution-free statistical methods. London: Chapman & Hall.
61. Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods, 9, 147-163.
62. McKean, J. W., & Hettmansperger, T. P. (1976). Tests of hypotheses based on ranks in the general linear model. Communications in Statistics - Theory and Methods, 8, 693-709.
63. McKean, J. W., & Hettmansperger, T. P. (1978). A robust analysis of the general linear model based on one step R-estimates. Biometrika, 65, 571-579.
64. McKean, J. W., & Sheather, S. J. (1991). Small sample properties of robust of linear models based on R-estimates: A survey. In W. Stahel & S. Weisberg (Eds.), Directions in robust statistics and diagnostics (Pt. 2, pp. 1-20). New York: Springer-Verlag.
65. McKean, J. W., Sheather, S. J., & Hettmansperger, T. P. (1990). Regression diagnostics for rank-based methods. Journal of the American Statistical Association, 85, 1018-1028.
66. McKean, J. W., & Sievers, G. L. (1989). Rank scores suitable for the analysis of linear models under asymmetric error distributions. Technometrics, 31, 207-218.
67. McKean, J. W., Vidmar, T. J., & Sievers, G. L. (1989). A robust two-stage multiple comparison procedure with application to a random drug screen. Biometrics, 45, 1281-1297.
68. McSweeney, M. (1967). An empirical comparison of two proposed nonparametric tests for main effects and interaction. Unpublished doctoral dissertation, University of California - Berkeley.
69. Mehra, K. L., & Sarangi, J. (1967). Asymptotic efficiency of certain rank tests for comparative experiments. Annals of Mathematical Statistics, 38, 90-107.
70. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
71. Myers, J. L. (1979). Fundamentals of experimental design (3rd ed.). Boston: Allyn & Bacon.
72. Nanna, M. J., & Sawilowsky, S. S. (1998). Analysis of Likert data in disability and medical rehabilitation research. Psychological Methods, 3, 55-67.
73. Naranjo, J. D., & McKean, J. W. (1997). Rank regression with estimated scores. Statistics & Probability Letters, 33, 209-216.
74. Natrella, M. G. (1960). The relation between confidence intervals and tests of significance - A teaching aid. The American Statistician, 14, 20-22, 38.
75. Pearson, E. S., & Please, N. W. (1975). Relation between the shape of population distribution and the robustness of four simple test statistics. Biometrika, 62, 223-242.
76. Pedhazur, E. J. (1997). Multiple regression in behavioral research. New York: Harcourt Brace.
77. Policello, G. E., & Hettmansperger, T. P. (1976). Adaptive robust procedures for the one-sample location model. Journal of the American Statistical Association, 71, 624-633.
78. Press, W. H., Flannery, S. A., Teukolsky, W. T., & Vetterling, W. T. (1992). Numerical recipes in Fortran. New York: Cambridge University Press.
79. Puri, M. L., & Sen, P. K. (1971). Nonparametric methods in multivariate analysis. New York: Wiley.
80. Puri, M. L., & Sen, P. K. (1985). Nonparametric methods in general linear models. New York: Wiley.
81. Revesz, P. (1984). Density estimation. In P. R. Krishnaiah & P. K. Sen (Eds.), The handbook of statistics (Vol. 4, pp. 531-549). New York: Elsevier.
82. Russell, C. J., Pinto, J. K., & Bobko, P. (1991). Appropriate moderated regression and inappropriate research strategy: A demonstration of information loss due to scale coarseness. Applied Psychological Measurement, 15, 257-266.
83. Salter, K. C., & Fawcett, R. F. (1993). The ART test of interaction: A robust and powerful rank test of interaction in factorial models. Communications in Statistics - Simulation and Computation, 22, 137-153.
84. Sampson, A. R. (1974). A tale of two regressions. Journal of the American Statistical Association, 74, 682-689.
85. Scheffé, H. (1959). The analysis of variance. New York: Wiley.
86. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
87. Sen, P. K. (1968). On a class of aligned rank tests in two-way layouts. Annals of Mathematical Statistics, 39, 1115-1124.
88. Serlin, R. C. (2000). Testing for robustness in Monte Carlo studies. Psychological Methods, 5, 230-240.
89. Serlin, R. C., & Harwell, M. R. (2001, April). A review of non-parametric tests for complex experimental designs in educational research. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
90. Sievers, G. L., & McKean, J. W. (1986). On the robust rank analysis of linear models with non-symmetric error distributions. Journal of Statistical Inference and Planning, 13, 215-230.
91. Stigler, S. (1977). Do robust estimators work with real data? The Annals of Statistics, 5, 1055-1098.
92. Stine, W. W. (1989). Meaningful inference: The role of measurement in statistics. Psychological Bulletin, 105, 147-155.
93. Tapia, R. A., & Thompson, J. R. (1978). Nonparametric probability density estimation. Baltimore: Johns Hopkins University Press.
94. Toothaker, L. E., & Newman, D. A. (1994). Nonparametric competitors to the two-way ANOVA. Journal of Educational and Behavioral Statistics, 19, 237-273.
95. Vale, C. D., & Maurelli, V. A. (1983). Simulating multivariate nonnormal distributions. Psychometrika, 48, 465-471.
96. Wilcox, R. R. (1997). Introduction to robust estimation and hypothesis testing. San Diego, CA: Academic Press.
97. Wilkinson, G. N. (1977). On resolving the controversy in statistical inference. Journal of the Royal Statistical Society, 39(Series B), 119-144.
98. Wilkinson, L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
99. Yohai, V. J., & Ferretti, N. E. (1987). Tests based on weighted rankings in complete blocks: Exact distribution and Monte Carlo simulation. Communications in Statistics - Simulation and Computation, 16, 333-347.
100. Zimmerman, D. W., & Zumbo, B. D. (1993). Relative power of parametric and nonparametric statistical methods. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Vol. 1, Methodological issues (pp. 481-517). Hillsdale, NJ: Erlbaum.