Computing confidence intervals for standardized regression coefficients

Psychological Methods

Volumn 18, Issue 4, 2013, Pages 435-453

  Jones, Jeff A ^a   Waller, Niels G ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Confidence intervals; Delta method; Multiple regression; Standard errors

Indexed keywords

CONFIDENCE INTERVAL; STATISTICAL ANALYSIS; STATISTICAL MODEL;

CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; MODELS, STATISTICAL;

EID: 84892447190     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0033269     Document Type: Article

References (76)

1. Abadir, K. M., and Magnus, J. R. (2005). Matrix algebra. New York, NY: Cambridge University Press.
2. Achen, C. H. (1977). Measuring representation: Perils of the correlation coefficient. American Journal of Political Science, 21, 805-815. doi: 10.2307/2110737
3. Algina, J., and Moulder, B. C. (2001). Sample sizes for confidence intervals on the increase in the squared multiple correlation coefficient. Educational and Psychological Measurement, 61, 633-649. doi:10.1177/ 00131640121971400
4. Anderson, T. W. (2003). An introduction to multivariate statistical analysis (3rd ed.). Hoboken, NJ: Wiley.Beasley, W. H., Deshea, L., Toothaker, L. E., Mendoza, J. L., Bard, D. E., and Rodgers, J. L. (2007). Bootstrapping to test for nonzero population correlation coefficients using univariate sampling. Psychological Methods, 12, 414-433. doi:10.1037/1082-989X.12.4.414
5. Bentler, P. M., and Lee, S. Y. (1983). Covariance structures under polynomial constraints: Applications to correlations and alpha-type structural models. Journal of Educational Statistics, 8, 207-222. doi:10.2307/ 1164760
6. Bollen, K. A., and Stine, R. (1990). Direct and indirect effects: Classical and bootstrap estimates of variability. Sociological Methodology, 20, 115- 140. doi:10.2307/271084
7. Bring, J. (1994). How to standardize regression coefficients. The American Statistician, 48, 209-213. doi:10.2307/2684719
8. Browne, M. W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.
9. Browne, M. W., and Du Toit, S. (1992). Automated fitting of nonstandard models. Multivariate Behavioral Research, 27, 269-300. doi:10.1177/ 0049124192021002005
10. Browne, M. W., Mels, G., and Cowan, M. (1994). Path analysis: RAMONA: SYSTAT for DOS advanced applications (Version 6, pp. 167-224) [Computer software]. Evanston, IL: SYSTAT.
11. Canty, A., and Ripley, B. (2011). boot: Bootstrap R (S-plus) functions: R package (Version 1.3-9). Retrieved from http://cran.us.r-project.org/src/ contrib/boot_1.3-9.tar.gz
12. Carpenter, J., and Bithell, J. (2000). Bootstrap confidence intervals: When, which, what? A practical guide for medical statisticians. Statistics in Medicine, 19, 1141-1164. doi:10.1002/(SICI)1097-0258(20000515)19: 9_1141::AID-SIM479_3.0.CO;2-F
13. Casella, G., and Berger, R. L. (2001). Statistical inference. Belmont, CA: Wadsworth.Cohen, J., Cohen, P., West, S. G., and Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
14. Cox, D., and Hinkley, D. (1974). Theoretical statistics (2nd ed.). Boca Raton, FL: Chapman and Hall.
15. Cudeck, R. (1989). Analysis of correlation matrices using covariance structure models. Psychological Bulletin, 105, 317-327. doi:10.1037/ 0033-2909.105.2.317
16. Cumming, G., and Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 532-574. doi:10.1177/00131640121971374
17. Davison, A. C., and Hinkley, D. V. (1997). Bootstrap methods and their application. Cambridge, England: Cambridge University Press.
18. DiCiccio, T., and Tibshirani, R. (1987). Bootstrap confidence intervals and bootstrap approximations. Journal of the American Statistical Association, 82, 163-170. doi:10.2307/2289143
19. Efron, B. (1979). Bootstrap methods: Another look at the jackknife. The Annals of Statistics, 7, 1-26. doi:10.1214/aos/1176344552
20. Efron, B. (1982). The jackknife, the bootstrap, and other resampling plans. Philadelphia, PA: Society for Industrial and Applied Mathematics.
21. Efron, B. (1987). Better bootstrap confidence intervals. Journal of the American Statistical Association, 82, 171-185. doi:10.2307/2289144
22. Efron, B. (1988). Bootstrap confidence intervals: Good or bad? Psychological Bulletin, 104, 293-296. doi:10.1037/0033-2909.104.2.293
23. Efron, B., and Tibshirani, R. (1998). An introduction to the bootstrap. Boca Raton, FL: Chapman and Hall.
24. Evans, M. J., and Rosenthal, J. S. (2004). Probability and statistics: The science of uncertainty. New York, NY: W. H. Freeman.
25. Fidler, F., and Thompson, B. (2001). Computing correct confidence intervals for ANOVA fixed- and random-effects effect sizes. Educational and Psychological Measurement, 61, 575- 604. doi:10.1177/ 00131640121971383
26. Fisher, R. A. (1915). Frequency distribution of the values of the correlation coefficient in samples of an indefinitely large population. Biometrika, 10, 507-521. doi:10.1093/biomet/10.4.507
27. Fleishman, A. E. (1980). Confidence intervals for correlation ratios. Educational and Psychological Measurement, 40, 659-670. doi:10.1177/ 001316448004000309
28. Fox, J. (1997). Applied regression analysis, linear models, and related methods. Thousand Oaks, CA: Sage.
29. Fox, J. (2009). A mathematical primer for social statistics. Thousand Oaks, CA: Sage.
30. Freedman, D. A. (1981). Bootstrapping regression models. The Annals of Statistics, 9, 1218-1228. doi:10.1214/aos/1176345638
31. Gelman, A. (2008). Scaling regression inputs by dividing by two standard deviations. Statistics in Medicine, 27, 2865-2873. doi:10.1002/sim.3107
32. Graybill, F. A. (1976). Theory and application of the linear model. Belmont, CA: Wadsworth.
33. Greene, W. H. (2003). Econometric analysis (5th ed.). Upper Saddle River, NJ: Prentice-Hall. Greenland, S., Maclure, M., Schlesselman, J. J., Poole, C., and Morgenstern
34. H. (1991). Standardized regression coefficients: A further critique and review of some alternatives. Epidemiology, 2, 387-392. doi:10.1097/ 00001648-199109000-00015
35. Harris, R. J. (2001). A primer on multivariate statistics (3rd ed.). Mahwah, NJ: Erlbaum.
36. Hays, W. L. (1994). Statistics (5th ed.). Fort Worth, TX: Harcourt Brace College.
37. Hedges, L. V., and Olkin, I. (1985). Statistical methods for meta-analysis. New York, NY: Academic Press.
38. Howell, D. C. (2010). Statistical methods for psychology (7th ed.). Belmont, CA: Wadsworth Cengage.Hunter, J. E., and Hamilton, M. A. (2002). The advantages of using standardized scores in causal analysis. Human Communication Research, 28, 552-561. doi:10.1111/j.1468-2958.2002.tb00823.x
39. Jamshidian, M., and Bentler, P. M. (2000). Improved standard errors of standardized parameters in covariance structure models: Implications for construct explication. In R. D. Goffin and E. Helmes (Eds.), Problems and solutions in human assessment (pp. 73-94). Dordrecht, the Netherlands: Kluwer Academic.
40. Johnson, N. L., and Welch, B. L. (1940). Applications of the non-central t-distribution. Biometrika, 3/4, 362-389. doi:10.2307/2332616
41. Johnson, R. (2001). An introduction to the bootstrap. Teaching Statistics, 23, 49-54. doi:10.1111/1467-9639.00050
42. Jones, J. A. (2010). GenCorr: An R routine to generate correlation matrices from a user-defined eigenvalue structure. Applied Psychological Measurement, 34, 68-69. doi:10.1177/0146621609339727
43. Kelley, K. (2007). Confidence intervals for standardized effect sizes: Theory, application, and implementation. Journal of Statistical Software, 20, 1-24.
44. Kelley, K., and Lai, K. (2011). MBESS: R package (Version 3.2.1). Retrieved from http://CRAN.R-project.org/package_MBESS.
45. Kelley, K., and Maxwell, S. E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods, 8, 305-321. doi:10.1037/1082-989X.8.3.305
46. Kendall, M., and Stuart, A. (1977). The advanced theory of statistics (Vol. 2). New York, NY: Macmillan.
47. King, G. (1985). How not to lie with statistics: Avoiding common mistakes in quantitative political science. American Journal of Political Science, 30, 666-687. doi:10.2307/2111095
48. MacCallum, R. C., and Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51, 201-226. doi: 10.1146/annurev. psych. 51.1.201
49. Marsaglia, G., and Olkin, I. (1984). Generating correlation matrices. SIAM Journal on Scientific and Statistical Computing, 5, 470-475. doi: 10.1137/0905034
50. Meehl, P. E. (1995). Bootstrap taxometrics: Solving the classification problem in psychopathology. American Psychologist, 50, 266-275. doi: 10.1037/0003-066X.50.4.266
51. Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166. doi:10.1037/0033-2909.105.1.156
52. Mood, A. M., Graybill, F. A., and Boes, D. C. (1974). Introduction to the theory of statistics. New York, NY: McGraw-Hill.
53. Oehlert, G. W. (1992). A note on the delta method. The American Statistician, 46, 27-29. doi:10.2307/2684406
54. Owen, D. B. (1968). A survey of properties and applications of the noncentral t- distribution. Technometrics, 10, 445-478. doi:10.2307/ 1267101
55. Rasmussen, J. L. (1987). Estimating correlation coefficients: Bootstrap and parametric approaches. Psychological Bulletin, 101, 136-139. doi: 10.1037/0033-2909.101.1.136
56. Raspe, R. E. (2003). The surprising adventures of Baron Munchhausen. Rockville, MD: Wildside Press.
57. R Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.Rencher, A. C. (2008). Linear models in statistics (2nd ed.). Hoboken, NJ:Wiley.
58. Sampson, A. R. (1974). A tale of two regressions. Journal of the American Statistical Association, 69, 682-689. doi:10.2307/2286002
59. Shaffer, J. P. (1991). The Gauss-Markov theorem and random regressors. The American Statistician, 45, 269-273. doi:10.2307/2684451
60. Shieh, G. (2006). Exact interval estimation, power, calculation, and sample size determination in normal correlation analysis. Psychometrika, 71, 529-540. doi:10.1007/s11336-04-1221-6
61. Sievers, W. (1996). Standard and bootstrap confidence intervals for the correlation coefficient. British Journal of Mathematical and Statistical Psychology, 49, 381-396. doi:10.1007/s11336-04-1221-6
62. Steiger, J. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173- 180. doi:10.1207/s15327906mbr2502_4
63. Steiger, J. (2004). Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods, 9, 164 -182. doi:10.1037/1082-989X.9.2.164
64. Steiger, J., and Fouladi, R. (1997). Noncentrality interval estimation and the evaluation of statistical methods. In L. L. Harlow, S. A. Mulaik, and J. H. Steiger (Eds.), What if there were no significance tests? (pp. 221-257). Mahwah, NJ: Erlbaum.
65. Steiger, J. H., and Lind, J. C. (1980). Statistically-based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
66. Stein, S., and Barcellos, A. (1992). Calculus and analytic geometry (5th ed.). McGraw-Hill.
67. Strube, M. J. (1988). Bootstrap type I error rates for the correlation coefficient: An examination of alternate procedures. Psychological Bulletin, 104, 290-292. doi:10.1037/0033-2909.104.2.290
68. Tierney, L., Rossini, A. J., Li, N., and Sevcikova, H. (2012). snow: Simple network of workstations: R package (Version 0.3-10). Retrieved from http://CRAN.R-project.org/package_snow
69. Tukey, J. W. (1954). Causation, regression, and path analysis. In O. Kempthorne, T. A. Bancroft, J. W. Gowen, and J. L. Lush (Eds.), Statistics and mathematics in biology (pp. 35- 66). Ames: Iowa State College Press.
70. Waller, N. G. (2011). The geometry of enhancement in multiple regression. Psychometrika, 76, 634-649. doi:10.1007/s11336-011-9220-x
71. Waller, N. G., and Jones, J. A. (2010). Correlation weights in multiple regression. Psychometrika, 75, 58-69. doi:10.1007/s11336-009-9127-y
72. Waller, N. G., and Jones, J. A. (2011). Investigating the performance of alternate regression weights by studying all possible criteria in regression models with a fixed set of predictors. Psychometrika, 76, 410-439. doi:10.1007/s11336-011-9209-5
73. Weisberg, S. (2005). Applied linear regression. Hoboken, NJ: Wiley.
74. West, S. G., Aiken, L. S., Wu, W., and Taylor, A. B. (2007). Multiple regression: Applications of the basics and beyond in personality research. In R. Robins, R. C. Fraley, and R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 573-601). New York, NY: Guilford Press.
75. Yu, H. (2002). Rmpi: Parallel statistical computing in R. R News, 2, 10-14.
76. Yuan, K. H., and Chan, W. (2011). Biases and standard errors of standardized regression coefficients. Psychometrika, 76, 670-690. doi:10.1007/ s11336-011-9224-6