Accuracy in parameter estimation for a general class of effect sizes: A sequential approach

Psychological Methods

Volumn 23, Issue 2, 2018, Pages 226-243

  Kelley, Ken ^a   Darku, Francis Bilson ^b   Chattopadhyay, Bhargab ^b,c  

^a UNIVERSITY OF NOTRE DAME   (United States)

^b UNIVERSITY OF TEXAS AT DALLAS   (United States)

^c Indian Institute of Information Technology Vadodara (IIITV)   (India)

Author keywords

AIPE; Power; Research design; Sample size planning; Sequential estimation

Indexed keywords

CHEMICAL BINDING; CONFIDENCE INTERVAL; EFFECT SIZE; POPULATION MODEL; PSYCINFO; SAMPLE SIZE; HUMAN; MEDICAL RESEARCH; METHODOLOGY; PROCEDURES; STANDARDS; STATISTICAL MODEL;

BIOMEDICAL RESEARCH; CONFIDENCE INTERVALS; HUMANS; MODELS, STATISTICAL; RESEARCH DESIGN; SAMPLE SIZE;

EID: 85017181464     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000127     Document Type: Article

References (57)

1. Abbasi, N., Hemati, S., & Jafarei, A. (2010). Simple proof of the theorem: Tending U-statistics to central moments of sample. International Journal of Contemporary Mathematical Sciences, 5, 1807-1811
2. Albrecher, H., Ladoucette, S. A., & Teugels, J. L. (2010). Asymptotics of the sample coefficient of variation and the sample dispersion. Journal of Statistical Planning and Inference, 140, 358-368
3. American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: American Psychological Association
4. American Statistical Association. (2016, March). American statistical association releases statement on statistical significance and P-values: Provides principles to improve the conduct and interpretation of quantitative science. Retrieved from http://www.amstat.org/newsroom/ pressreleases/P-ValueStatement.pdf
5. Anscombe, F. J. (1952). Large-sample theory of sequential estimation. Proceedings of the Cambridge Philosophical Society, 48, 600-607.
6. Armitage, P. (1960). Sequential medical trials. Hoboken, NJ: Blackwell Scientific Publications
7. Association for Psychological Science. (2014). Submission guidelines. Retrieved from http://www.psychologicalscience.org/index.php/ publications/journals/psychological_sc
8. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437
9. Bandyopadhyay, U., & Biswas, A. (2015). Sequential and two-stage fixedwidth confidence interval estimation in response-adaptive designs. Sequential Analysis, 34, 350-363
10. Chang, H.-H., & Ying, Z. (2009). Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests. The Annals of Statistics, 37, 1466-1488
11. Chattopadhyay, B., & De, S. K. (2016). Estimation of gini index within pre-specified error bound. Econometrics, 4, 30. http://dx.doi.org/10. .3390/econometrics4030030
12. Chattopadhyay, B., & Kelley, K. (2016). Estimation of the coefficient of variation with minimum risk: A sequential method for minimizing sampling error and cost with a stopping rule. Multivariate Behavioral Research, 51, 627-648. http://dx.doi.org/10.1080/00273171.2016. .1203279
13. Chattopadhyay, B., & Kelley, K. (2017). Estimating the standardardized mean difference with minimum risk: Maximizing accuracy and minimizing cost with sequential estimation. Psychological Methods, 22, 94-113. http://dx.doi.org/10.1037/met0000089
14. Chattopadhyay, B., & Mukhopadhyay, N. (2013). Two-stage fixed-width confidence intervals for a normal mean in the presence of suspect outliers. Sequential Analysis, 32, 134-157. http://dx.doi.org/10.1080/ 07474946.2013.774609
15. Cliff, N. (1993). Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114, 494-509
16. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum
17. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003
18. De, S. K., & Chattopadhyay, B. (2015, March). Minimum risk point estimation of gini index. Retrieved from http://arxiv.org/abs/1503.08148
19. Fieller, E. C. (1954). Some problems in interval estimation. Journal of the Royal Statistical Society: Series B, 16, 175-185
20. Gut, A. (2009). Stopped random walks: Limit theorems and applications. New York, NY/London, United Kingdom: Springer
21. Ghosh, B. K., & Sen, P. K. (1991). Handbook of sequential analysis. New York, NY: CRC Press
22. Heffernan, P. M. (1997). Unbiased estimation of central moments by using U-statistics. Journal of the Royal Statistical Society: Series B, 59, 861-863. http://dx.doi.org/10.1111/1467-9868.00102
23. Hoeffding, W. (1948). A class of statistics with asymptotically normal distribution. The Annals of Mathematical Statistics, 19, 293-325. Retrieved from http://www.jstor.org/stable/2235637
24. Kelley, K. (2007a). Confidence intervals for standardized effect sizes: Theory, application, and implementation. Journal of Statistical Software, 20, 1-24. http://dx.doi.org/10.18637/jss.v020.i08
25. Kelley, K. (2007b). Sample size planning for the coefficient of variation from the accuracy in parameter estimation approach. Behavior Research Methods, 39, 755-766
26. Kelley, K. (2008). Sample size planning for the squared multiple correlation coefficient: Accuracy in parameter estimation via narrow confidence intervals. Multivariate Behavioral Research, 43, 524-555
27. Kelley, K., & Lai, K. (2011). Accuracy in parameter estimation for the root mean square error of approximation: Sample size planning for narrow confidence intervals. Multivariate Behavioral Research, 46, 1-32
28. Kelley, K., & Maxwell, S. E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods, 8, 305-321
29. Kelley, K., & Preacher, K. J. (2012). On effect size. Psychological Methods, 17, 137-152
30. Kelley, K., & Rausch, J. R. (2006). Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals. Psychological Methods, 11, 363-385
31. Kumar, N., & Chattopadhyay, B. (2013). On the class of U-statistics based two-sample test for location. Journal of Combinatorics, Information & System Sciences, 38, 191-201
32. Lai, K., & Kelley, K. (2011). Accuracy in parameter estimation for targeted effects in structural equation modeling: Sample size planning for narrow confidence intervals. Psychological Methods, 16, 127-148
33. Lai, T. L. (1998). Sequential analysis. New York, NY: Wiley Online Library
34. Lee, A. J. (1990). U-statistics: Theory and practice. New York, NY: CRC Press
35. Lehmann, E. L., & Romano, J. P. (2005). Testing statistical hypotheses. New York, NY: Springer
36. Lipsey, M. W. (1990). Design sensitivity: Statistical power for experimental research. Newbury Park, CA: Sage
37. Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537-563
38. Meehl, P. E. (1997). The problem is epistemology, not statistics: Replace significance tests by confidence intervals and quantify accuracy of risky numerical predictions. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there where no significance tests? (pp. 393-426). Mahwah, NJ: Erlbaum
39. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166
40. Morrison, D. E., & Henkel, R. E. (Eds.). (1970). The significance test controversy. New Brunswick, CT: Aldine Transaction
41. Mukhopadhyay, N., & Chattopadhyay, B. (2012). A tribute to Frank Anscombe and random central limit theorem from 1952. Sequential Analysis, 31, 265-277. http://dx.doi.org/10.1080/07474946.2012.694344
42. Mukhopadhyay, N., & De Silva, B. M. (2009). Sequential methods and their applications. Boca Raton, FL: CRC Press
43. Murphy, K. R., & Myors, B. (2004). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests (2nd ed.). Mahwah, NJ: Erlbaum
44. Pornprasertmanit, S., & Schneider, W. J. (2014). Accuracy in parameter estimation in cluster randomized designs. Psychological Methods, 356-379
45. Preacher, K. J., & Kelley, K. (2011). Effect size measures for mediation models: Effect size measures for mediation models: Quantitative strategies for communicating indirect effects. Psychological Methods, 16, 93-115
46. Schwawrtz, B. (2004). The paradox of choice: How the culture of abundance robs us of satisfaction. New York, NY: Harper Perennial
47. Sen, P. K. (1981). Sequential nonparametrics: Invariance principles and statistical inference. New York, NY: Wiley New York
48. Sen, P. K., & Ghosh, M. (1981). Sequential point estimation of estimable parameters based on U-statistics. Sankhyfia: The Indian Journal of Statistics, Series A, 331-344. Retrieved from http://www.jstor.org/stable/ 25050282
49. Sproule, R. N. (1985). Sequential nonparametric fixed-width confidence intervals for u-statistics. The Annals of Statistics, 13, 228-235
50. Task Force on Reporting of Research Methods in AERA Publications. (2006). Standards for reporting on empirical social science research in AERA publications, American educational. Washington, DC: American Educational Research Association
51. Terry, L. J., & Kelley, K. (2012). Sample size planning for composite reliability coefficients: Accuracy in parameter estimation via narrow confidence intervals. British Journal of Mathematical and Statistical Psychology, 65, 371-401
52. Thompson, B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25-32
53. Vapnyarskii, I. (2001). Lagrange multipliers. In M. Hazewinkel (Ed.), Encyclopedia of mathematics. New York, NY: Springer
54. Wald, A. (1943). Tests of statistical hypotheses concerning several parameters when the number of observations is large. Transactions of the American Mathematical Society, 54, 426-482
55. Wald, A. (1945). Sequential tests of statistical hypotheses. Annals of Mathematical Statistics, 16, 117-186
56. Wasserstein, R., & Lazar, N. A. (2016). ASA statement on statistical significance and P-values. The American Statistician, 70, 129-133
57. Wilcox, R. (2012). Introduction to robust estimation and hypothesis testing (3rd ed.). New York, NY: Elsevier