Multiple Regression and Correlation Techniques: Recent Controversies and Best Practices

Rehabilitation Psychology

Volumn 53, Issue 3, 2008, Pages 321-339

  Hoyt, William T ^a   Imel, Zac E ^a   Chan, Fong ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

confidence intervals; data analysis; mediation; multiple regression; research methods

Indexed keywords

ARTICLE; BIVARIATE ANALYSIS; CONFIDENCE INTERVAL; CORRELATIONAL STUDY; DEPENDENT VARIABLE; EMPIRICISM; HYPOTHESIS; INDEPENDENT VARIABLE; MEDIATOR; METHODOLOGY; MULTIPLE REGRESSION; PREDICTIVE VALIDITY; SOCIAL SUPPORT; STATISTICAL ANALYSIS; THEORY CONSTRUCTION; THEORY VALIDATION;

EID: 54949146784     PISSN: 00905550     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0013021     Document Type: Article

References (76)

1. Aiken L.S., and West S.G. Multiple regression: Testing and interpreting interactions (1991), Sage, Newbury Park, CA
2. Aiken L.S., and West S.G. Multiple regression. Encyclopedia of psychology 5 (2000), Oxford University Press, New York 350-352
3. American Psychological Association. Publication manual of the American Psychological Association. 5th ed. (2001), Author, Washington, DC
4. Azen R., and Budescu D.V. The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods 8 (2003) 129-148
5. Bandura A. Social learning theory (1977), Prentice Hall, Englewood Cliffs, NJ
6. Banks S., and Kerns R. Explaining high rates of depression in chronic pain: A diathesis-stress framework. Psychological Bulletin 119 (1996) 95-110
7. Baron R.M., and Kenny D.A. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology 51 (1986) 1173-1182
8. Bauer D.J., and Curran P.J. Probing interactions in fixed and multilevel regression: Inferential and graphical techniques. Multivariate Behavioral Research 40 (2005) 373-400
9. Beck A.T. Depression: Clinical, experimental, and theoretical aspects (1967), Harper & Row, New York
10. Cohen J. The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology 65 (1962) 145-153
11. Cohen J. Statistical power analysis for the behavioral sciences (1988), Erlbaum, Hillsdale, NJ
12. Cohen J. The earth is round (p < .05). American Psychologist 49 (1994) 997-1003
13. Cohen J., Cohen P., West S.G., and Aiken L.S. Applied multiple regression/correlation analysis for the behavioral sciences. 3rd ed. (2003), Erlbaum, Mahwah, NJ
14. Cumming G., and Finch S. Inference by eye: Confidence intervals and how to read pictures of data. American Psychologist 60 (2005) 170-180
15. Duncan O.D. Introduction to structural equation models (1975), Academic Press, New York
16. Frazier P.A., Tix A.P., and Barron K.E. Testing moderator and mediator effects in counseling psychology research. Journal of Counseling Psychology 51 (2004) 115-134
17. Geisser M.E., Robinson M.E., and Riley J.L. Pain beliefs, coping and adjustment to chronic pain: Let's focus more on the negative. Pain 8 (1999) 161-168
18. Hancock, G. R., & Mueller, R. O. (Eds.). (in press). Quantitative methods in the social and behavioral sciences: A guide for researchers and reviewers. Mahwah, NJ: Erlbaum.
19. Hays W.L. Statistics. 5th ed. (1994), Harcourt Brace, Orlando, FL
20. Hedges L.V., and Olkin I. Statistical methods for meta-analysis (1985), Academic Press, Orlando, FL
21. Hoyt W.T., Leierer S., and Millington M.J. Analysis and interpretation of findings using multiple regression techniques. Rehabilitation Counseling Bulletin 49 (2006) 223-233
22. Hoyt W.T., Warbasse L.E., and Chu E.Y. Construct validation in counseling psychology research. The Counseling Psychologist 34 (2006) 769-805
23. Hunter J.E. Needed: A ban on the significance test. Psychological Science 8 (1997) 3-7
24. International Association for the Study of Pain. Classification of chronic pain: Descriptions of chronic pain syndromes and definitions of pain terms-The International Association for the Study of Pain, Subcommittee on Taxonomy. Pain 3 Suppl. (1986) S1-S226
25. Jaccard J., Guilamo-Ramos V., Johansson M., and Bouris A. Multiple regression analyses in clinical child and adolescent psychology. Journal of Clinical Child and Adolescent Psychology 35 (2006) 456-479
26. Johnson P.O., and Neyman J. Tests of certain linear hypotheses and their application to some educational problems. Statistical Research Memoirs 1 (1936) 57-93
27. Jones D.A., Rollman G.B., White K.P., Hill M.L., and Brooke R.I. The relationship between cognitive appraisal, affect, and catastrophizing in patients with chronic pain. The Journal of Pain 4 (2003) 267-277
28. Judd C., and McClelland G. Data analysis: A model comparison approach (1989), Harcourt Brace Jovanovich, New York
29. Keefe F.J., Brown G.K., Wallston K.A., and Caldewell D.S. Coping with rheumatoid arthritis: Catastrophizing as a maladaptive strategy. Pain 37 (1989) 51-56
30. Keefe F.J., Rumble M.E., Scipio C.D., Giordano L.A., and Perri L.M. Psychological aspects of persistent pain: Current state of the science. The Journal of Pain 5 (2004) 195-211
31. Kelley K. Confidence intervals for standardized effect sizes: Theory, application, and implementation. Journal of Statistical Software 20 (2007) 1-24
32. Kelley K. Methods for the Behavioral, Educational, and Social Sciences: An R package. Behavior Research Methods 39 (2007) 979-984
33. Kelley K., and Maxwell S.E. Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods 8 (2003) 305-321
34. Kelley, K., & Maxwell, S. E. (in press). Multiple regression: A guide for researchers and reviewers. In G. R. Hancock & R. O. Mueller (Eds.), Quantitative methods in the social and behavioral sciences: A guide for researchers and reviewers. Mahwah, NJ: Erlbaum.
35. Kenny D.A. Correlation and causality (1979), Wiley, New York
36. Kenny D.A., Kashy D.A., and Bolger N. Data analysis in social psychology. Handbook of social psychology. 4th ed. 1 (1998), McGraw-Hill, New York 233-265
37. Kirk R.E. Practical significance: A concept whose time has come. Educational and Psychological Measurement 56 (1996) 746-759
38. Kline R.B. Beyond significance testing: Reforming data analysis methods in behavioral research (2004), American Psychological Association, Washington, DC
39. Kraemer H.C., Kiernan M., Essex M., and Kupfer D.J. How and why criteria defining moderators and mediators differ between the Baron & Kenny and MacArthur approaches. Health Psychology 27 Suppl. (2008) S101-S108
40. Kraemer H.C., Wilson G.T., Fairburn C.G., and Agras W.S. Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry 59 (2002) 877-884
41. Kwok O.-M., Underhill A.T., Berry J.W., Luo W., Elliott T.R., and Yoon M. Analyzing longitudinal data with multilevel models: An example with individuals living with lower extremity intra-articular fractures. Rehabilitation Psychology 53 (2008) 370-386
42. Lee G.K., Chan F., and Berven N.L. Factors affecting depression among people with chronic musculoskeletal pain: A structural equation model. Rehabilitation Psychology 52 (2007) 33-43
43. Lewinsohn P.M., Hoberman H.M., Teri L., and Hautzinger M. An integrative theory of depression. In: Reiss S., and Bootzin R.R. (Eds). Theoretical issues in behavior therapy (1985), Academic Press, New York 331-359
44. MacCallum R.C., Wegener D.T., Uchino B.N., and Fabrigar L.R. The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin 114 (1993) 185-199
45. MacCallum R.C., Zhang S., Preacher K.J., and Rucker D.D. On the practice of dichotomization of quantitative variables. Psychological Methods 7 (2002) 19-40
46. MacKinnon D.P., Lockwood C.M., Hoffman J.M., West S.G., and Sheets V. A comparison of methods to test mediation and other intervening variable effects. Psychological Methods 7 (2002) 83-104
47. Mallinckrodt B., Abraham W.T., Wei M., and Russell D.W. Advances in testing the statistical significance of mediation effects. Journal of Counseling Psychology 53 (2006) 372-378
48. Maxwell S.E., and Cole D.A. Bias in cross-sectional analyses of longitudinal mediation. Psychological Methods 12 (2007) 23-44
49. Maxwell S.E., and Delaney H.D. Bivariate median splits and spurious statistical significance. Psychological Bulletin 113 (1993) 181-190
50. Maxwell S.E., and Delaney H.D. Designing experiments and analyzing data: A model comparison perspective. 2nd ed. (2004), Erlbaum, Mahwah, NJ
51. McCullough M.E., Hoyt W.T., Larson D.B., Koenig H., and Thoresen C. Religious involvement and mortality: A meta-analytic review. Health Psychology 19 (2000) 211-222
52. Meehl P.E. High school yearbooks: A reply to Schwarz. Journal of Abnormal Psychology 77 (1971) 143-148
53. Mueller R.O. Structural equation modeling: Back to basics. Structural Equation Modeling 4 (1997) 353-369
54. Muller D., Judd C.M., and Yzerbyt V.Y. When moderation is mediated and mediation is moderated. Journal of Personality and Social Psychology 89 (2005) 852-863
55. Nielsen M.S. Prevalence of posttraumatic stress disorder in persons with spinal cord injuries: The mediating effect of social support. Rehabilitation Psychology 48 (2003) 289-295
56. Pedhazur E.J. Multiple regression in behavioral research: Explanation and prediction. 2nd ed. (1982), Harcourt Brace, Fort Worth, TX
57. Petrocelli J.V. Hierarchical multiple regression in counseling research: Common problems and possible remedies. Measurement and Evaluation in Counseling and Development 36 (2003) 9-22
58. Preacher K.J., and Hayes A.F. SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers 36 (2004) 717-731
59. Preacher K.J., Rucker D.D., and Hayes A.F. Addressing moderated mediation hypotheses: Theory, methods, and prescriptions. Multivariate Behavioral Research 42 (2007) 185-227
60. Schmidt F.L. What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist 47 (1992) 1173-1181
61. Schmidt F.L., and Hunter J.E. Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods 1 (1996) 199-223
62. Schmidt F.L., and Hunter J.E. The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin 124 (1998) 262-274
63. Sedlmeier P., and Gigerenzer G. Do studies of statistical power have an effect on the power of studies?. Psychological Bulletin 105 (1989) 309-316
64. Shrout P.E., and Bolger N. Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods 7 (2002) 422-445
65. Smithson M. Correct confidence intervals for various regression effect sizes and parameters: The importance of noncentral distributions in computing intervals. Educational and Psychological Measurement 61 (2001) 605-632
66. Sobel M.E. Asymptotic confidence intervals for indirect effects in structural equations models. In: Leinhart S. (Ed). Sociological methodology 1982 (1982), Jossey-Bass, San Francisco 290-312
67. Steiger J.H., and Fouladi R.T. Noncentrality interval estimation and the evaluation of statistical methods. In: Harlow L.L., Mulaik S.A., and Steiger J.H. (Eds). What if there were no significance tests? (1997), Erlbaum, Mahwah, NJ 221-257
68. Turk D.C. Continuity and change. Clinical Journal of Pain 15 (1999) 163-165
69. Turk D.C. Chronic pain and whiplash associated disorders: Rehabilitation and secondary prevention. Pain Research and Management 8 (2003) 40-43
70. Turk D.C., and Okifuji A. Psychological factors in chronic pain: Evolution and revolution. Journal of Consulting and Clinical Psychology 70 (2002) 678-690
71. Turner J.A., Mancl L., and Aaron L.A. Pain-related catastrophizing: A daily process study. Pain 110 (2004) 103-111
72. Wampold B.E., Davis B., and Good R.H. Hypothesis validity of clinical research. Journal of Consulting and Clinical Psychology 58 (1990) 360-367
73. Wampold B.E., and Serlin R.C. The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods 5 (2000) 425-433
74. Wilkinson L., and the Task Force on Statistical Inference. Statistical methods in psychology journals: Guidelines and explanations. American Psychologist 54 (1999) 594-604
75. Wolfle L.M. Applications of causal models in higher education. In: Smart J.C. (Ed). Higher education: Handbook of theory and research 1 (1985), Agathon, New York 381-413
76. Zou G.Y. Toward using confidence intervals to compare correlations. Psychological Methods 12 (2007) 399-413