Univariate and multivariate omnibus hypothesis tests selected to control type I error rates when population variances are not necessarily equal

Review of Educational Research

Volumn 66, Issue 2, 1996, Pages 137-179

  Coombs, William T ^a   Algina, James ^b   Oltman, Debra Olson ^c  

^a OKLAHOMA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF FLORIDA   (United States)

^c ORAL ROBERTS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0038877633     PISSN: 00346543     EISSN: None     Source Type: Journal    
DOI: 10.3102/00346543066002137     Document Type: Article

References (215)

1. Alexander, R. A., & Govern, D. M. (1994). A new and simpler approximation for ANOVA under variance heterogeneity. Journal of Educational Statistics, 19, 91-101.
2. 2 to variance-covariance heteroscedasticity when sample sizes are unequal or in small ratios. Psychological Bulletin, 108, 308-313.
3. Algina, J., Oshima, T. C., & Lin, W.-Y. (1994). Type I error rates for Welch's test and James's second-order test under nonnormality and inequality of variance when there are two groups. Journal of Educational and Behavioral Statistics, 19, 275-291.
4. Algina, J., Oshima, T. C., & Tang, K. L. (1991). Robustness of Yao's, James', and Johansen's tests under variance-covariance heteroscedasticity and nonnormality. Journal of Educational Statistics, 16, 125-139.
5. Algina, J., & Tang, K. L. (1988). Type I error rates for Yao's and James' tests of equality of mean vectors under variance-covariance heteroscedasticity. Journal of Educational Statistics, 13, 281-290.
6. Anderson, T. W. (1958). An introduction to multivariate statistical analysis. New York: Wiley.
7. Aspin, A. A. (1948). An examination and further development of a formula arising in the problem of comparing two mean values. Biometrika, 35, 88-96.
8. Aspin, A. A. (1949). Tables for use in comparisons whose accuracy involves two variances, separately estimated (with Appendix by B. L. Welch). Biometrika, 36, 290-296.
9. Banerjee, S. K. (1960). Approximate confidence interval for linear functions of means of k populations when the population variances are not equal. Sankhya, 22, 357-358.
10. Banerjee, S. K. (1961). On confidence interval for two-means problem based on separate estimates of variances and tabulated values of t-table. Sankhya, 23, 359-378.
11. Barcikowski, R. S., & Elliott, R. (1991, October). Exploratory multivariate analysis of variance: Contrasts and variables. Paper presented at the meeting of the Midwestern Educational Research Association, Chicago, IL.
12. Barcikowski, R., & Stevens, J. P. (1975). A Monte Carlo study of the stability of canonical correlations, canonical weights and canonical variate-variable correlations. Multivariate Behavioral Research, 10, 353-364.
13. Bartlett, M. S. (1935). The effect of non-normality on the t distribution. Proceedings of the Cambridge Philosophical Society, 31, 223-231.
14. Bartlett, M. S. (1939). A note on tests of significance in multivariate analysis. Proceedings of the Cambridge Philosophical Society, 35, 180-185.
15. Becker, B. (1987). Applying tests of combined significance in meta-analysis. Psychological Bulletin, 102, 164-171.
16. Behrens, W. V. (1929). Ein Beitrag zur Fehlerberechnung bei wenigen Beobachtungen. Landwirtsch, Jahrbucher, 68, 807-837.
17. Belli, G. M. (1989, March). Parameters in MANOVA robustness studies: Comparability to empirical research. Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA.
18. Bennett, B. M. (1951). Note on a solution of the generalized Behrens-Fisher problem. Annals of the Institute of Statistical Mathematics, 25, 87-90.
19. Bennett, C. A., & Franklin, N. L. (1954). Statistical analysis in chemistry and the chemical industry. New York: Wiley.
20. Best, D. J., & Rayner, J. C. W. (1987). Welch's approximate solution for the Behrens-Fisher problem. Technometrics, 29(2), 205-210.
21. Bird, K. D. (1975). Simultaneous contrast testing procedures for multivariate experiments. Multivariate Behavioral Research, 10, 343-352.
22. Bird, K. D., & Hadzi-Pavlovic, D. (1983). Simultaneous test procedures and the choice of a test statistic in MANOVA. Psychological Bulletin, 93(1), 167-178.
23. Blair, R. C. (1981). A reaction to "Consequences of failure to meet assumptions underlying the fixed effects analysis of variance and covariance." Review of Educational Research, 51, 499-507.
24. Bock, R. D. (1966). Contributions of multivariate statistical methods to educational research. In R. B. Cattell (Ed.), Handbook of multivariate experimental psychology (pp. 820-840). Skokie, IL: Rand McNally.
25. Boneau, C. A. (1960). The effects of violations of assumptions underlying the t test. Psychological Bulletin, 57(1), 49-64.
26. Boneau, C. A. (1962). A comparison of the power of the U and t-tests. Psychological Review, 69, 246-256.
27. Borgan, F. H., & Selig, M. J. (1978). Uses of discriminate analysis following MANOVA: Multivariate statistics for multivariate purposes. Journal of Applied Psychology, 63, 689-697.
28. Bose, R. C. (1977). Early history of multivariate statistical analysis. In P. R. Krishnaiah (Ed.), Multivariate analysis-IV (pp. 3-22). New York: North-Holland.
29. 2-statistic. Sankhya, 4, 19-38.
30. Box, G. E. P. (1954). Some theorems on quadratic forms applied in the study of analysis of variance problems, I. Effect of inequality of variance in the one-way classification. Annals of Mathematical Statistics, 25, 290-302.
31. Box, G. E. P., & Andersen, S. L. (1955). Permutation theory in the derivation of robust criteria and the study of departures from assumption. Journal of the Royal Statistical Society (Series B), 17, 1-34.
32. Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 34, 144-152.
33. Bray, J. H., & Maxwell, S. E. (1982). Analyzing and interpreting significant MANOVAs. Review of Educational Research, 52, 340-367.
34. Bray, J. H., & Maxwell, S. E. (1985). Multivariate analysis of variance. Newbury Park, CA: Sage.
35. Brown, M. B., & Forsythe, A. B. (1974). The small sample behavior of some statistics which test the equality of several means. Technometrics, 16(1), 129-132.
36. Budescu, D. V. (1982). The power of the F test in normal populations with heterogeneous variances. Educational and Psychological Measurement, 42, 409-416.
37. Budescu, D. V., & Appelbaum, W. G. (1981). Variance stabilizing transformations and the power of the F test. Journal of Educational Statistics, 6, 55-74.
38. Carter, E. M., Khatri, C. G., & Srivastava, M. S. (1979). The effect of inequality of variances on the t-test. Sankhya, 41, 216-225.
39. Christensen, W. F., & Rencher, A. C. (1995, August). A comparison of Type I error rates and power levels for seven solutions to the multivariate Behrens-Fisher problem. Paper presented at the meeting of the American Statistical Association, Orlando, FL.
40. Clinch, J. J., & Keselman, H. J. (1982). Parametric alternatives to the analysis of variance. Journal of Educational Statistics, 7, 207-214.
41. Cochran, W. G. (1947). Some consequences when the assumptions for the analysis of variance are not satisfied. Biometrics, 2, 22-38.
42. Cochran, W. G. (1964). Approximate significance levels of the Behrens-Fisher problem. Biometrics, 20, 191-195.
43. Cochran, W. G., & Cox, G. M. (1950). Experimental designs. New York: Wiley.
44. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
45. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
46. Coombs, W. T., & Algina, J. (in press-a). New test statistics for MANOVA/descriptive discriminant analysis. Educational and Psychological Measurement.
47. Coombs, W. T., & Algina, J. (in press-b). On sample size requirements for Johansen's test. Journal of Educational and Behavioral Statistics.
48. Cressie, N. A. C., & Whitford, H. J. (1986). How to use the two-sample t-test. Biometrical Journal, 28, 131-148.
49. Daniels, H. E. (1938). The effect of departures from ideal conditions other than non-normality on the t and z tests of significance. Proceedings of the Cambridge Philosophical Society, 34, 321-328.
50. Darlington, R. B., Weinberg, S., & Walberg, H. (1973). Canonical variate analysis and related techniques. Review of Educational Research, 43, 433-451.
51. Davenport, J. M., & Webster, J. R. (1975). The Behrens-Fisher problem, an old solution revisited. Metrika, 22, 47-54.
52. David, F. N., & Johnson, N. L. (1951). The effect of non-normality on the power function of the F-test in the analysis of variance. Biometrika, 38, 43-57.
53. de la Rey, N., & Nel, D. G. (1993). A comparison of the significance levels and power functions of several solutions to the multivariate Behrens-Fisher problem. South African Statistical Journal, 27, 129-148.
54. Dijkstra, J. B., & Werter, S. P. J. (1981). Testing the equality for several means when the population variances are unequal. Communication in Statistics: Simulation and Computation, B10, 557-569.
55. Donaldson, T. S. (1968). Robustness of the F-test to errors of both kinds and the correlation between the numerator and denominator of the F-ratio. American Statistical Journal, 63, 660-676.
56. Elliott, R. S., & Barcikowski, R. S. (1994). Investigation of power using F approximations for the Hotelling-Lawley trace and Pillai's trace. Mid-Western Educational Researcher, 7, 2-6.
57. Emmons, N. J., Stallings, W. M., & Layne, B. H. (1990, April). Statistical methods used in the American Educational Research Journal, Journal of Educational Psychology, and Sociology of Education from 1972 through 1987. Paper presented at the Annual Meeting of the American Educational Research Association, Boston, MA.
58. 2 test. Journal of the American Statistical Association, 74, 48-51.
59. Fenstad, G. U. (1983). A comparison between the U and V tests in the Behrens-Fisher problem. Biometrika, 70, 300-302.
60. Fisher, R. A. (1935). The fiducial argument in statistical inference. Annals of Eugenics, 6, 391-398.
61. Fisher, R. A. (1939). The comparison of samples with possible unequal variances. Annals of Eugenics, 9, 174-180.
62. Folks, J. L. (1981). Ideas of statistics. New York: Wiley.
63. Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978). The importance of beta, the Type II error and sample size in the design and interpretation of the randomized control trial. The New England Journal of Medicine, 299, 690-694.
64. Gabriel, K. R. (1968). Simultaneous test procedures in multivariate analysis of variance. Biometrika, 55(3), 489-504.
65. Gamage, J. K. (1995, August). Generalized p-values and an exact solution to the multivariate Behrens-Fisher problem. Paper presented at the meeting of the American Statistical Association, Orlando, FL.
66. Games, P. A., & Lucas, P. A. (1966). Power of the analysis of variance of independent groups on non-normal and normally transformed data. Educational and Psychological Measurement, 26, 311-327.
67. Gans, D. J. (1981). Use of a preliminary test in comparing two sample means. Communications in Statistics: Simulation and Computation, B10, 163-174.
68. Gayen, A. K. (1950). Significance of difference between the means of two non-normal samples. Biometrika, 37, 399-408.
69. Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972). Consequences of failure to meet assumptions underlying the fixed effects analysis of variance. Review of Educational Research, 42, 237-288.
70. Gnanadesikan, R., Lauh, E., Snyder, M., & Yao, Y. (1965). Efficiency comparisons of certain multivariate analysis of variance test procedures (Abstract). Annals of Mathematical Statistics, 36, 356-357.
71. Gronow, D. G. C. (1951). Test for the significance of the difference between means in two normal populations having unequal variances. Biometrika, 38, 252-256.
72. 2 procedure and the assumption of homogeneous covariance matrices. Psychological Bulletin, 86, 1255-1263.
73. Hall, P., & Padmanabhan, A. R. (1992). On bootstrap and the trimmed mean. Journal of Multivariate Analysis, 41, 132-153.
74. Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J., & Stahel, W. A. (1986). Robust statistics: The approach based on influence functions. New York: Wiley.
75. Harris, R. J. (1985). A primer of multivariate statistics (2nd ed.). Orlando, FL: Academic Press.
76. Harwell, M. R., Rubinstein, E. N., Hayes, W. S., & Olds, C. C. (1992). Summarizing Monte Carlo results in methodological research: The one- and two-factor fixed effects ANOVA cases. Journal of Educational Statistics, 17, 315-339.
77. Havlicek, L. L., & Peterson, N. L. (1974). Robustness of the t test: A guide for researchers on effect of violations of assumptions. Psychological Reports, 34, 1095-1114.
78. Hoaglin, D. C., Mosteller, F., & Tukey, J. W. (1983). Understanding robust and exploratory data analysis. New York: Wiley.
79. Hoaglin, D. C., Mosteller, F., & Tukey, J. W. (1985). Exploring data tables, trends, and shapes. New York: Wiley.
80. Hoaglin, D. C., Mosteller, F., & Tukey, J. W. (1991). Fundamentals of exploratory analysis of variance. New York: Wiley.
81. 2. Journal of the American Statistical Association, 62, 124-136.
82. 2 and homoscedasticity criterion M under unequal variance and leptokurtosis. Journal of the American Statistical Association, 58, 1048-1053.
83. Horsnell, G. (1953). The effect of unequal group variances on the F-test for the homogeneity of group means. Biometrika, 40, 128-136.
84. Hotelling, H. (1931). The generalization of Student's ratio. Annals of Mathematical Statistics, 2, 360-378.
85. Hotelling, H. (1951). A generalized T test and measure of multivariate dispersion. In J. Neyman (Ed.), Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability (pp. 23-41). Berkeley: University of California Press.
86. Hsiung, T.-H., Olejnik, S., & Huberty, C. J. (1994). Comment on a Wilcox test statistic for comparing means when variances are unequal. Journal of Educational Statistics, 19, 111-118.
87. Hsu, P. L. (1938a). Contributions to the theory of 'Student's' t-test as applied to the problem of two samples. Statistical Research Memoirs, 2, 1-24.
88. 2. Annals of Mathematical Statistics, 9, 231-243.
89. Hsu, P. L. (1940). On generalized analysis of variance (I). Biometrika, 31, 221-237.
90. Huber, P. J. (1981). Robust statistics. New York: Wiley.
91. Huber, P. J. (1993). Projection pursuit and robustness. In S. Morgenthaler, E. Ronchetti, & W. A. Stahel (Eds.), New directions in statistical data analysis and robustness (pp. 139-146). Basel, Switzerland: Birkhauser.
92. Huberty, C. J. (1975). Discriminant analysis. Review of Educational Research, 45, 543-598.
93. Huberty, C. J. (1976). The stability of three indices of relative variable contribution in discriminant analysis. Journal of Experimental Education, 45, 59-64.
94. Huberty, C. J. (1984). Issues in the use and interpretation of discriminant analysis. Psychological Bulletin, 95, 156-171.
95. Huberty, C. J., & Morris, J. D. (1989). Multivariate analysis versus multiple univariate analyses. Psychological Bulletin, 105(2), 302-308.
96. Hummel, T. J., & Sligo, J. (1971). Empirical comparison of univariate and multivariate analysis of variance procedures. Psychological Bulletin, 76, 49-57.
97. Hwang, H. L., & Paulson, A. S. (1986). Some methods for the multivariate two-sample location problem. Unpublished manuscript, Oak Ridge National Laboratory, Oak Ridge, TN.
98. 2 statistic, II. Annals of Mathematical Statistics, 31, 1148-1153.
99. Ito, K. (1962). A comparison of the powers of two MANOVA tests. Biometrika, 49, 455-462.
100. Ito, K. (1969). On the effect of heteroscedasticity and non-normality upon some multivariate test procedures. In P. R. Krishnaiah (Ed.), Multivariate analysis - II (pp. 87-120). New York: Academic Press.
101. 2 test in multivariate analysis of variance when variance-covariance matrices are not equal. Biometrika, 38, 324-329.
102. James, A. T. (1965). Distributions of matrix variates and latent roots derived from normal samples. Annals of Mathematical Statistics, 35, 475-501.
103. James, G. S. (1951). The comparison of several groups of observations when the ratios of population variances are unknown. Biometrika, 38, 324-329.
104. James, G. S. (1954). Tests of linear hypotheses in univariate and multivariate analysis when the ratios of the population variances are unknown. Biometrika, 41, 19-43.
105. Johansen, S. (1980). The Welch-James approximation to the distribution of the residual sum of squares in a weighted linear regression. Biometrika, 67, 85-92.
106. Kafadar, K. (1982). Using biweight M-estimates in the two sample problem: Part 1. Symmetric populations. Communications in Statistics: Theory and Methods, 11, 1883-1901.
107. Kendall, M. G., & Stuart, A. (1973). The advanced theory of statistics (Vol. 2). New York: Hafner.
108. Keselman, H. J., Rogan, J. C., & Feir-Walsh, B. J. (1977). The evaluation of some non-parametric and parametric tests for location equality. British Journal of Mathematical and Statistical Psychology, 30, 213-221.
109. Kim, S.-J. (1992). A practical solution to the multivariate Behrens-Fisher problem. Biometrika, 79(1), 171-176.
110. Koele, P. (1982). Calculating power in analysis of variance. Psychological Bulletin, 92, 513-516.
111. Kohr, R. L., & Games, P. A. (1974). Robustness of the analysis of variance, the Welch procedure and a Box procedure to heterogeneous variables. Journal of Experimental Education, 43, 61-69.
112. Korin, B. P. (1972). Some comments of the homoscedasticity criterion M and the multivariate analysis of variance tests T, W, and R. Biometrika, 59, 215-216.
113. 2 test of MANOVA (tables for one-way classification). Biometrical Journal, 20, 389-406.
114. Lawley, D. N. (1938). A generalization of Fisher's z-test. Biometrika, 30, 180-187.
115. Lee, A. F. S., & Gurland, J. (1975). Size and power of tests for equality of means of two normal populations with unequal variances. Journal of the American Statistical Association, 70, 933-941.
116. Lee, Y. (1971). Asymptotic formulae for the distribution of a multivariate test statistic: Power comparisons of certain multivariate tests. Biometrika, 58, 647-651.
117. Levin, J. R., Serlin, R. C., & Seaman, M. A. (1994). A controlled, powerful multiple-comparison strategy for several situations. Psychological Bulletin, 115(1), 153-159.
118. Levy, K. J. (1978a). An empirical comparison of the ANOVA F-test with alternatives which are more robust against heterogeneity of variance. Journal of Statistical Computing and Simulation, 8, 49-57.
119. Levy, K. J. (1978b). Some empirical power results associated with Welch's robust analysis of variance technique. Journal of Statistical Computing and Simulation, 8, 43-48.
120. Lin, W.-Y. (1991). Robustness of two multivariate tests to variance-covariance heteroscedasticity and nonnormality when total-sample-size-to-variable ratio is small (Doctoral dissertation, University of Florida, 1991). Dissertation Abstracts International, 52, 2899A.
121. Lindquist, E. F. (1953). Design and analysis of experiments in psychology and education. Boston: Houghton-Mifflin.
122. Marascuilo, L. A. (1971). Statistical methods for behavioral science research. New York: McGraw Hill.
123. Mardia, K. V. (1971). The effect of nonnormality on some multivariate tests and robustness to nonnormality in the linear model. Biometrika, 58, 105-121.
124. 2 test. Applied Statistics, 24, 163-171.
125. Maxwell, S. E. (1992). Recent developments in MANOVA applications. In Advances in social science methodology (Vol. 2, pp. 137-168). Greenwich, CT: JAI Press.
126. McCullough, R. S., Gurland, J., & Rosenberg, L. (1960). Small-sample behavior of certain tests of the hypothesis of equal means under variance heterogeneity. Biometrika, 47, 345-353.
127. McFatter, R. M., & Gollob, H. F. (1986). The power of hypothesis tests for comparisons. Educational and Psychological Measurement, 46, 883-886.
128. McKay, R. J., & Campbell, N. A. (1982). Variable selection techniques in discriminant analysis. British Journal of Mathematical and Statistical Psychology, 35, 1-29.
129. Meredith, W. (1964). Canonical correlation with fallible data. Psychometrika, 29, 55-65.
130. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166.
131. Miller, J. P., Wette, R., & Parks, R. P. (1981). Type I error rates for the unequal variance t test. Proceedings of the Sixth Annual SAS User's Group Conference, 156-165.
132. Moher, D., Dulberg, C. S., & Wells, G. A. (1994). Statistical power, sample size, and their reporting in randomized controlled trials. Journal of the American Medical Association, 272, 122-124.
133. Mood, A. M., Graybill, F. A., & Boes, D. C. (1974). Introduction to the theory of statistics (3rd ed.). New York: McGraw-Hill.
134. 2. Paper presented at the meeting of the American Statistical Association, Orlando, FL.
135. Mudholkar, H., Mudholkar, G. S., & Srivastava, D. K. (1991). A construction and appraisal of pooled trimmed-t statistics. Communications in Statistics: Theory and Methods, 20(4), 1345-1359.
136. Nath, R., & Duran, B. S. (1983). A robust test in the multivariate two-sample location problem. American Journal of Mathematical and Management Sciences, 3, 225-249.
137. Neave, H. R., & Granger, C. W. J. (1968). A Monte Carlo study comparing various two-sample tests for differences in means. Technometrics, 10, 509-529.
138. Nel, D. G., & van der Merwe, C. A. (1986). A solution to the multivariate Behrens-Fisher problem. Communications in Statistics: Theory and Methods, 15(12), 3475-3487.
139. Nel, D. G., van der Merwe, C. A., & Moser, B. K. (1990). The exact distributions of the univariate and multivariate Behrens-Fisher statistics with a comparison of several solutions in the univariate case. Communications in Statistics: Theory and Methods, 79(1), 279-298.
140. Olson, C. L. (1974). Comparative robustness of six tests in multivariate analysis of variance. Journal of the American Statistical Association, 69, 894-908.
141. Olson, C. L. (1976). On choosing a test statistic in multivariate analysis of variance. Psychological Bulletin, 83(4), 579-586.
142. Olson, C. L. (1979). Practical considerations in choosing a MANOVA test statistic: A rejoinder to Stevens. Psychological Bulletin, 86(6), 1350-1352.
143. Oshima, T. C., & Algina, J. (1992a). A SAS program for testing the hypothesis of the equal means under heteroscedasticity: James's second-order test. Educational and Psychological Measurement, 52, 117-118.
144. Oshima, T. C., & Algina, J. (1992b). Type I error rates for James's second-order test and Wilcox's Hm test under heteroscedasticity and non-normality. British Journal of Mathematical and Statistical Psychology, 45, 255-263.
145. Ostle, B., & Mensing, R. W. (1975). Statistics in research (3rd ed.). Ames: Iowa State University Press.
146. Pearson, E. S. (1931). The analysis of variance in cases of non-normal variation. Biometrika, 23, 114-133.
147. Pillai, K. C. S. (1955). Some new test criteria in multivariate analysis. Annals of Mathematical Statistics, 26, 117-121.
148. Pillai, K. C. S., & Dotson, C. O. (1969). Power comparisons of tests of two multivariate hypotheses based on individual characteristic roots. Annals of the Institute of Statistical Mathematics, 21, 49-66.
149. Pillai, K., & Jayachandran, K. (1967). Power comparisons of tests of two multivariate hypotheses based on four criteria. Biometrika, 54, 195-210.
150. Pillai, K. C. S., & Sudjana. (1975). Exact robustness studies of tests of two multivariate hypotheses based on four criteria and their distribution problems under violations. The Annals of Statistics, 3, 617-636.
151. Porebski, O. R. (1966). Discriminatory and canonical analysis of technical college data. British Journal of Mathematical and Statistical Psychology, 19, 215-236.
152. Posten, H. O., Yeh, H. C., & Owen, D. B. (1982). Robustness of the two-sample t-test under violations of the homogeneity of variance assumption. Communications in Statistics: Theory and Methods, 11(2), 109-126.
153. Pratt, J. W. (1964). Robustness of some procedures for the two-sample location problem. Journal of the American Statistical Association, 59, 665-680.
154. Pruzek, R. M. (1971). Methods and problems in the analysis of multivariate data. Review of Educational Research, 41, 163-190.
155. Pulver, A. E., Bartko, J. J., & McGrath, J. A. (1988). The power of analysis: Statistical perspectives (Part 1). Psychiatry Review, 23, 295-299.
156. Ramsey, P. H. (1980). Exact Type I error rates for robustness of Student's t test with unequal variances. Journal of Educational Statistics, 5, 337-349.
157. Ramsey, P. H. (1982). Empirical power of procedures for comparing two groups on p variables. Journal of Educational Statistics, 7, 139-156.
158. Rogan, J. C., & Keselman, H. J. (1977). Is then ANOVA F-test robust to variance heterogeneity when sample sizes are equal?: An investigation via coefficient of variation. American Educational Research Journal, 14, 493-498.
159. Rossi, J. S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646-656.
160. Roy, J. (1958). Step-down procedure in multivariate analysis. Annals of Mathematical Statistics, 29, 1177-1187.
161. Roy, S. N. (1945). The individual sampling distribution of the maximum, the minimum, and any intermediate of the p-statistics on the null-hypothesis. Sankhya, 7, Part 2, 133-158.
162. Roy, S. N., & Bose, R. C. (1953). Simultaneous confidence interval estimation. Annals of Mathematical Statistics, 24, 513-536.
163. Rubin, A. S. (1983). The use of weighted contrasts in analysis of models with heterogeneity of variance. American Statistical Association: Proceedings of the Business and Economic Statistics Section, 347-352.
164. Ryan, J. A., Joiner, B. L., & Ryan, B. F. (1982). MINITAB reference manual. Boston: Duxbury Press.
165. Satterthwaite, F. E. (1941). Synthesis of variance. Psychometrika, 6, 309-316.
166. Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics, 2, 110-114.
167. Schatzoff, M. (1966). Sensitivity comparisons among tests of the general linear hypothesis. Journal of the American Statistical Association, 61, 415-435.
168. Scheffe, H. (1943). On solutions of the Behrens-Fisher problem based on t-distribution. Annals of Mathematical Statistics, 10, 129-137.
169. Scheffe, H. (1953). A method for judging all contrasts in the analysis of variance. Biometrika, 40, 87-104.
170. Scheffe, H. (1959). The analysis of variance. New York: Wiley.
171. Scheffe, H. (1970). Practical solutions to the Behrens-Fisher problem. Journal of the American Statistical Association, 65, 1051-1058.
172. Sen, P. K. (1982). On M tests in linear models. Biometrika, 69, 245-248.
173. Shaffer, J. P. (1986). Modified sequentially rejective multiple test procedures. Journal of the American Statistical Association, 81, 826-831.
174. Sheehan, J. K. (1995, April). A comparison of the Type I error and power of selected MANOVA simultaneous test procedures. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, CA.
175. Smith, H. (1936). The problem of comparing the results of two experiments with unequal errors. Journal of the Council of Scientific and Industrial Research, 9, 211-212.
176. Snedecor, G. W. (1934). Calculation and interpretation of analysis of variance and covariance. Ames, IA: Collegiate Press.
177. Srivastava, A. B. L. (1959). Effect of non-normality on the power of the analysis of variance test. Biometrika, 46, 114-122.
178. Stevens, J. P. (1979). Comment to Olson: Choosing a test statistic in multivariate analysis of variance. Psychological Bulletin, 86(2), 355-360.
179. Stevens, J. P. (1980). Power of the multivariate analysis of variance tests. Psychological Bulletin, 88, 728-737.
180. Stevens, J. P. (1996). Applied multivariate statistics for the social sciences (3rd ed.). Mahwah, NJ: Erlbaum.
181. Subrahmaniam, K., & Subrahmaniam, K. (1973). On the multivariate Behrens-Fisher problem. Biometrika, 60, 107-111.
182. Tan, W. Y. (1982). Sampling distributions and robustness of t, F, and variance-ratio in the two samples and ANOVA models with respect to departure from normality. Communications in Statistics: Theory and Methods, 11, 2485-2511.
183. Tang, K. L., & Algina, J. (1993). Performance of four multivariate tests under variance-covariance heteroscedasticity. Multivariate Behavioral Research, 28(4), 391-405.
184. Tiku, M. L. (1971). Power function of the F-test under non-normal situations. Journal of the American Statistical Association, 66, 913-916.
185. Tiku, M. L. (1980). Robustness of MML estimators based on censored samples and robust test statistics. Journal of Statistical Planning and Inference, 4, 123-143.
186. Tiku, M. L. (1982). Testing linear contrasts of means in experimental design without assuming normality and homogeneity of variances. Biometrical Journal, 24, 613-627.
187. Tiku, M. L., Gill, P. S., & Balakrishnan, N. (1989). A robust procedure for testing the equality of mean vectors of two bivariate populations with unequal covariance matrices. Communications in Statistics: Theory and Methods, 18, 3249-3265.
188. Tiku, M. L., & Singh, M. (1981). Robust tests for means when population variances are unequal. Communications in Statistics: Theory and Methods, 10, 2057-2071.
189. Tomarken, A., & Serlin, R. (1986). Comparison of ANOVA alternatives under variance heterogeneity and specific noncentrality structures. Psychological Bulletin, 99, 90-99.
190. Tsui, K.-W., & Weerahandi, S. (1989). Generalized p-values in significance testing of hypotheses in the presence of nuisance parameters. Journal of the American Statistical Association, 84, 602-607.
191. Tukey, J. W., & McLaughlin, D. H. (1963). Less vulnerable confidence and significance procedures for location based on a single sample: Trimming/Winsorizing. Sankhya, A25, 331-352.
192. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105-110.
193. van der Vaart, H. R. (1961). On the robustness of Wilcoxon's two-sample test. In H. de Jonge (Ed.), Quantitative methods in pharmacology (pp. 140-158). New York: Interscience.
194. Wald, A. (1955). Testing the difference between the means of two normal populations with unknown standard deviations. In T. W. Anderson et al. (Eds.), Selected papers in statistics and probability (pp. 669-695). New York: McGraw-Hill.
195. Wang, Y. Y. (1971). Probabilities of the Type I errors of the Welch tests for the Behrens-Fisher problem. Journal of the American Statistical Association, 66, 605-608.
196. Welch, B. L. (1938). The significance of the difference between two means when the population variances are unequal. Biometrika, 29, 350-362.
197. Welch, B. L. (1947). The generalization of 'Students' problem when several different population variances are involved. Biometrika, 34, 23-35.
198. Welch, B. L. (1951). On the comparison of several mean values: An alternative approach. Biometrika, 38, 330-336.
199. Wilcox, R. R. (1987). New designs analysis of variance. Annual Review of Psychology, 38, 29-60.
200. Wilcox, R. R. (1988). A new alternative to the ANOVA F and new results on James' second-order method. British Journal of Mathematical and Statistical Psychology, 41, 109-117.
201. Wilcox, R. R. (1990). Comparing the means of two independent groups. Biometric Journal, 32, 771-780.
202. Wilcox, R. R. (1992). Comparing one-step m-estimators of location corresponding to two independent groups. Psychometrika, 57(1), 141-154.
203. Wilcox, R. R. (1993a). Comparing one-step m-estimators of location when there are more than two groups. Psychometrika, 58(1), 71-78.
204. Wilcox, R. R. (1993b). Robustness in ANOVA: In L. K. Edwards (Ed.), Applied analysis of variance in behavioral science (pp. 345-374). New York: Marcel Dekker.
205. Wilcox, R. R. (1994). Some results on the Tukey-McLaughlin and Yuen methods for trimmed means when distributions are skewed. Biometrical Journal, 36, 259-273.
206. Wilcox, R. R. (1995). ANOVA: A paradigm for lower power and misleading measures of effect size? Review of Educational Research, 65, 51-77.
207. Wilcox, R. R. (in press). Statistics for the social sciences. New York: Academic Press.
208. Wilcox, R. R., Charlin, V. L., & Thompson, K. L. (1986). New Monte Carlo results on the robustness of the ANOVA F, W, and F* statistics. Communications in Statistics: Simulation and Computation, 15(4), 933-944.
209. Wilks, S. S. (1932) Certain generalizations in the analysis of variance. Biometrika, 24, 471-494.
210. Wilks, S. S. (1962). Mathematical statistics. New York: Wiley.
211. Yao, Y. (1965). An approximate degrees of freedom solution to the
212. Young, R. K., & Veldman, D. J. (1963). Heterogeneity and skewness in analysis of variance. Perceptual and Motor Skills, 16, 588.
213. Yuen, K. K. (1974). The two-sample trimmed t for unequal population variances. Biometrika, 61, 165-170.
214. Yuen, K. K., & Dixon, W. J. (1973). The approximate behavior and performance of the two-sample trimmed t. Biometrika, 60, 369-374.
215. Zimmerman, D. W., & Zumbo, B. D. (1993). Rank transformations and the power of the Student t and Welch t′ test for non-normal populations with unequal variances. Canadian Journal of Experimental Psychology, 47, 523-539.