Resampling methods revisited: Advancing the understanding and applications in educational research

International Journal of Research and Method in Education

Volumn 31, Issue 1, 2008, Pages 45-62

  Bai, Haiyan ^a   Pan, Wei ^b  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

^b UNIVERSITY OF CINCINNATI   (United States)

Author keywords

Bootstrap; Cross validation; Jackknife; Permutation test; Randomization test; Resampling

Indexed keywords

EID: 41749097241     PISSN: 1743727X     EISSN: 17437288     Source Type: Journal    
DOI: 10.1080/17437270801919909     Document Type: Review

References (110)

1. Adcock, C. J. (1997) Sample size determination: A review. Statistician, 46, pp. 261-283.
2. Ang, R. P. (1998) Use of jackknife statistic to evaluate result replicability. Journal of General Psychology, 125, pp. 218-228.
3. Barndorff-Nielsen, O. E. and Cox, D. R. (1994) Inference and asymptotics, Chapman and Hall, London
4. Beran, R. J. (1987) Prepivoting to reduce level error of confidence sets. Biometrika, 74, pp. 457-468.
5. Beran, R. J. (1997) Diagnosing bootstrap success. Annals of the Institute of Statistical Mathematics, 49, pp. 1-24.
6. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. (1984) Classification and regression trees, Wadsworth and Brooks/Cole, Pacific Grove, CA
7. Brown, B. M. (1982) Cramer-von Mises distributions and permutation tests. Biometrika, 69, pp. 619-624.
8. Burman, P. (1989) A comparative study of ordinary cross-validation, v-fold cross-validation, and the repeated learning-testing methods. Biometrika, 76, pp. 503-514.
9. Carlstein, E. (1986) The use of subseries values for estimating the variance of a general statistic from a stationary sequence. Annals of Statistics, 14, pp. 1171-1179.
10. Chen, Z., Bai, Z. and Sinha, B. (2004) Ranked set sampling: Theory and applications, Springer, New York
11. Cheng, R. C. H. (1995) Bootstrap methods in computer simulation experiments. Proceedings of the 1995 Winter Simulation Conference Association for Computing Machinery, pp. 171-177. Arlington, VA
12. Chernick, M. R. (1999) Bootstrap methods: A practitioner's guide, Wiley, New York
13. Cureton, E. E. (1950) Validity, reliability and boloney. Educational and Psychological Measurement, 10, pp. 94-96.
14. Daniel, L. G. (1992) Bootstrap methods in the principal component case. Paper presented at the annual meeting for the American Educational Research Association San Francisco, CA
15. Davison, A. C. and Hall, P. (1993) On studentizing and blocking methods for implementing the bootstrap with dependent data. Australian Journal of Statistics, 35, pp. 215-224.
16. Davison, A. C. and Hinkley, D. V. (1997) Bootstrap methods and their application, Cambridge University Press, New York
17. Davison, A. C., Hinkley, D. V. and Schechtman, E. (1986) Efficient bootstrap simulation. Biometrika, 73, pp. 555-566.
18. Davison, A. C., Hinkley, D. V. and Young, G. A. (2003) Recent developments in bootstrap methodology. Statistical Science, 18:2, pp. 141-157.
19. de Angelis, D. and Young, G. A. (1992) Smoothing the bootstrap. International Statistical Review, 60, pp. 45-56.
20. Diaconis, P. and Efron, B. (1983) Computer-intensive methods in statistics. Scientific American, 248, pp. 116-130.
21. Diaconis, P. and Holmes, S. (1994) Gray codes for randomization procedures. Statistics and Computing, 4:4, pp. 287-302.
22. DiCiccio, T. J. and Romano, J. P. (1988) A review of bootstrap confidence intervals (with discussion). Journal of the Royal Statistical Society, Series B, 50, pp. 338-370.
23. Duckworth, W. M. and Stephenson, W. R. (2003) Resampling methods: Not just for statisticians anymore. Paper presented at the Joint Statistical Meetings 2003 San Francisco, CA
24. Edgington, E. S. (1987) Randomization tests, Marcel Dekker, New York
25. Efron, B. (1979) Bootstrap methods: Another look at the jackknife. Annual of Statistics, 7, pp. 1-26.
26. Efron, B. (1979) Computers and the theory of statistics: Thinking the unthinkable. SIAM Review, 21:4, pp. 460-468.
27. Efron, B. (1982) The jackknife, the bootstrap, and other resampling plans. CBMS-NSF Regional Conference Series in Applied Mathematics SIAM, Philadelphia, PA
28. Efron, B. (1994) Missing data, imputation, and the bootstrap (with discussion). Journal of the American Statistical Association, 89, pp. 463-470.
29. Efron, B. (2003) Second thoughts on bootstrap. Statistical Science, 18:2, pp. 135-140.
30. Efron, B. and Gong, G. (1983) A leisurely look at the bootstrap, the jackknife, and cross-validation. American Statistician, 37:1, pp. 36-48.
31. Efron, B. and Tibshirani, R. J. (1986) Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science, 1, pp. 54-77.
32. Efron, B. (1998) An introduction to the bootstrap, Chapman and Hall, New York
33. Fan, X. (1994) Do bootstrap methods give biased estimates? An empirical investigation for a case of multiple regression. Paper presented at the annual meeting for the American Educational Research Association New Orleans, LA
34. Finifter, M. B. (1972) The generation of confidence: Evaluating research findings by random subsample replication. Sociological Methodology, 4, pp. 112-175.
35. Fisher, R. A. (1935) The design of experiments, Oliver and Boyd, Edinburgh
36. Freedman, D. (1984) On bootstrapping two-stage least-squares estimates in stationary linear models. Annals of Statistics, 12:3, pp. 827-842.
37. Friedl, H. and Stampfer, E. (2002) Resampling methods. Encyclopedia of Environmetrics, pp. 1768-1770. Chichester, Wiley
38. Goldstein, H. (1995) Multilevel statistical models, Halstead Press, New York
39. Good, P. (2000) Permutation tests: A practical guide to resampling methods for testing hypotheses, Springer-Verlag, New York
40. Good, P. (2006) Resampling methods: A practical guide to data analysis, Birkhauser, Boston, MA
41. Götze, F. and Künsch, H. R. (1996) Second order correctness of the blockwise bootstrap for stationary observations. Annals of Statistics, 24, pp. 1914-1933.
42. Graham, R. L., Hinkley, D. V., John, P. W. M. and Shi, S. (1990) Balanced design of bootstrap simulations. Journal of the Royal Statistical Society, Series B, 52:1, pp. 185-202.
43. Hall, P. (1985) Resampling a coverage pattern. Stochastic Processes and Their Applications, 20, pp. 231-246.
44. Hall, P. (1992) On bootstrap confidence intervals in nonparametric regression. Annals of Statistics, 20, pp. 695-711.
45. Hall, P. (2003) A short prehistory of the bootstrap. Statistical Science, 18:2, pp. 158-167.
46. Hall, P., DiCiccio, T. J. and Romano, J. P. (1989) On smoothing and the bootstrap. Annals Statistics, 17, pp. 692-704.
47. Hall, P., Horowitz, J. and Jing, B. Y. (1995) On blocking rules for the bootstrap with dependent data. Biometrika, 82:3, pp. 516-574.
48. Hall, P. and Presnell, B. (1999) Intentionally biased bootstrap methods. Journal of the Royal Statistical Society, Series B, 61, pp. 143-158.
49. Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J. and Stahel, W. A. (1986) Robust statistics: The approach based on influence functions, Wiley, New York
50. Hardle, W. (1990) Smoothing techniques with implementation in S, Springer-Verlag, New York
51. Harris, D. J. and Kolen, M. J. (1989) Examining the stability of Angoff's delta item bias statistic using the bootstrap. Educational and Psychological Measurement, 49, pp. 81-87.
52. Hesterberg, T. C. (1998) Simulation and bootstrapping for teaching statistics. 1998 Proceedings of the American Statistical Association, Section on Statistical Education American Statistical Association, pp. 44-52. Alexandria, VA
53. Hesterberg, T. C., Monaghan, S., Moore, S. D., Clipson, A. and Epstein, R. (2003) Bootstrap methods and permutation tests, W.H. Freeman and Company, New York
54. Hinkley, D. V. (1977) Jackknife confidence limits using student t approximations. Biometrika, 64:1, pp. 21-28.
55. Hinkley, D. V. (1988) Bootstrap methods (with discussion). Journal of the Royal Statistical Society, Series B, 50, pp. 321-337.
56. Hinkley, D. V. and Shi, S. (1989) Importance sampling and nested bootstrap. Biometrika, 76, pp. 435-446.
57. Kish, L. and Frankel, M. R. (1970) Balanced repeated replications for standard errors. Journal of the American Statistical Association, 65:331, pp. 1071-1094.
58. Knoke, J. D., Anderson, C. M. and Koch, G. G. (2006) Analyzing repeated measures marginal models on sample surveys with resampling methods. Journal of Statistical Software, 15:8, pp. 1-13.
59. Krus, D. J. and Fuller, E. A. (1982) Computer-assisted multicross-validation in regression analysis. Educational and Psychological Measurement, 42, pp. 187-193.
60. Künsch, H. R. (1989) The jackknife and bootstrap for general stationary observations. Annals of Statistics, 17, pp. 1217-1241.
61. Kurtz, A. K. (1948) A research test of Rorschach test. Personnel Psychology, 1, pp. 41-53.
62. Lahiri, S. N. (2003) Resampling methods for dependent data, Springer-Verlag, New York
63. Lahiri, S. N. and Zhu, J. (2006) Resampling methods for spatial regression models under a class of stochastic designs. Annals of Statistics, 34:4, pp. 1774-1813.
64. Lambert, Z. V., Wildt, A. R. and Durand, R. M. (1991) Approximating confidence interval for factor loadings. Multivariate Behavioral Research, 26, pp. 421-434.
65. Lee, S. M. S. and Young, G. A. (2003) Prepivoting by weighted bootstrap iteration. Biometrika, 90, pp. 393-410.
66. Lunneborg, C. E. (2000) Data analysis by resampling: Concept and applications, Duxbury, Pacific Grove, CA
67. Mendoza, J. L., Hart, D. E. and Powell, A. (1991) A bootstrap confidence interval based on a correlation corrected for range restriction. Multivariate Behavioral Research, 26, pp. 255-269.
68. Meraviglia, C., Massini, G., Croce, D. and Buscema, M. (2006) GenD-An evolutionary system for resampling in survey research. Quality and Quantity, 40:5, pp. 825-859.
69. Miller, R. G. (1974) The jackknife-A review. Biometrika, 61, pp. 1-17.
70. Modarres, R., Hui, T. P. and Zheng, G. (2006) Resampling methods for ranked set samples. Computational Statistics and Data Analysis, 51:2, pp. 1039-1050.
71. Monbet, V. and Marteau, P. F. (2006) Non parametric resampling for stationary Markov processes: The local grid bootstrap approach. Journal of Statistical Planning and Inference, 136:10, pp. 3319-3338.
72. Nordgaard, A. and Grimvall, A. (2006) A resampling technique for estimating the power of non-parametric trend tests. Environmetrics, 17:3, pp. 257-267.
73. Noreen, E. W. (1989) Computer-intensive methods for testing hypotheses: An introduction, Wiley, New York
74. Peligrad, M. (1998) On the blockwise bootstrap for empirical processes for stationary sequences. Annals of Probability, 26, pp. 877-901.
75. Peterson, I. (1991) Pick a sample. Science News, 140, pp. 56-58.
76. Pitman, E. J. G. (1937) Significance tests which may be applied to samples from any populations. Journal of the Royal Statistical Society, Series B, 4, pp. 119-130.
77. Politis, D. N. and Romano, J. P. (1994) Large sample confidence regions based on subsamples under minimal assumptions. Annals of Statistics, 22, pp. 2031-2050.
78. Politis, D. N., Romano, J. P. and Wolf, M. (1999) Subsampling, Springer, New York
79. Quenouille, M. G. (1949) Approximate tests of correlation in time-series. Journal of the Royal Statistical Society, Series B, 11, pp. 68-84.
80. Quenouille, M. G. (1956) Note on bias in estimation. Biometrika, 43, pp. 353-360.
81. Resampling Stats (2003) Resampling Stats, Arlington, VA
82. Ricketts, C. and Berry, J. (1994) Teaching statistics through resampling. Teaching Statistics, 16, pp. 41-44.
83. Rodgers, J. L. (1999) The bootstrap, the jackknife, and the randomization test: A sampling taxonomy. Multivariate Behavioral Research, 34:4, pp. 441-456.
84. Romano, J. P. (1990) On the behavior of randomization tests without a group invariance assumption. Journal of the American Statistical Association, 85, pp. 686-692.
85. Rubin, D. B. (1980) Using empirical Bayes techniques in the law school validity studies. Journal of the American Statistical Association, 75:372, pp. 801-816.
86. Rubin, D. B. (1981) The Bayesian bootstrap. Annals of Statistics, 9, pp. 130-134.
87. Rubin, D. B. (1987) Multiple imputation for nonresponse in surveys, Wiley, New York
88. SAS Institute (2007)
89. SAS Institute (2007)
90. Severini, T. A. (2000) Likelihood methods in statistics, Clarendon, Oxford
91. Shao, J. (1991) Consistency of jackknife variance estimators. Statistics, 22, pp. 49-57.
92. Shao, J. and Wu, C. F. J. (1989) A general theory for jackknife variance estimation. Annals of Statistics, 17, pp. 1176-1197.
93. Shao, J. and Wu, C. F. J. (1992) Asymptotic properties of the balanced repeated replication method for sample quantiles. Annals of Statistics, 20:2, pp. 1571-1593.
94. Silverman, B. W. and Young, G. A. (1987) The bootstrap: To smooth or not to smooth?. Biometrika, 74, pp. 469-479.
95. Simon, J. L. (1993) Resampling: The new statistics, Duxbury, Belmont, CA
96. Simon, J. L. and Bruce, P. (1991) Resampling: A tool for everyday statistical work. Chance, 4:1, pp. 22-32.
97. Simonoff, J. S. (1996) Smoothing methods in statistics, Springer, New York
98. Sprent, P. (1993) Applied nonparametric statistical methods, Chapman and Hall, New York
99. Sprent, P. and Smeeton, N. C. (2000) Applied nonparametric statistical methods, Chapman and Hall, New York
100. Stine, R. (1989) An introduction to bootstrap methods. Sociological Methods and Research, 18:2, pp. 243-291.
101. Stone, M. (1974) Cross-validatory choice and assessment of statistical predictions (with discussion). Journal of the Royal Statistical Society, Series B, 36, pp. 111-147.
102. Thompson, B. (1993) The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61:4, pp. 361-377.
103. Thomson Corporation (2007)
104. Troendle, J. F., Korn, E. L. and McShane, L. M. (2004) An example of show convergence of the bootstrap in high dimensions. American Statistician, 58, pp. 25-29.
105. Tukey, J. W. (1958) Bias and confidence in not quite large samples. Abstract. Annals of Mathematical Statistics, 29, p. 614.
106. Wu, C. F. J. (1986) Jackknife bootstrap and other resampling plans in regression analysis (with discussion). Annals of Statistics, 14, pp. 1261-1350.
107. Young, G. A. (1989) Alternative smoothed bootstraps. Journal of the Royal Statistical Society, Series B, 52:3, pp. 477-484.
108. Young, G. A. (1994) Bootstrap: More than a stab in the dark?. Statistical Science, 9:3, pp. 382-415.
109. Yu, C. H. (2003) Resampling methods: Concepts, applications, and justification. Practical Assessment, Research and Evaluation, 8:9
110. Zerbe, G. O. and Walker, S. H. (1997) A randomization test for comparison of groups of curves with different polynomial design matrices. Biometrics, 33, pp. 653-657.