On the (In)Validity of Tests of Simple Mediation: Threats and Solutions

Social and Personality Psychology Compass

Volumn 10, Issue 3, 2016, Pages 150-163

  Pek, Jolynn ^a   Hoyle, Rick H ^b  

^a YORK UNIVERSITY   (Canada)

^b DUKE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN; MODEL; PSYCHOLOGY; STATISTICAL MODEL; VALIDITY;

EID: 84959357910     PISSN: None     EISSN: 17519004     Source Type: Journal    
DOI: 10.1111/spc3.12237     Document Type: Article

References (62)

1. Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444-455. doi: 10.1080/01621459.1996.10476902
2. Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182. doi: 10.1037/0022-3514.51.6.1173
3. Bauer, D. J., Preacher, K. J., & Gil, K. M. (2006). Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: New procedures and recommendations. Psychological Methods, 11, 142-163. doi: 10.1037/1082-989X.11.2.142
4. Bentler, P. M., & Satorra, A. (2010). Testing model nesting and equivalence. Psychological Methods, 15, 111-123. doi: 10.1037/a0019625
5. Biesanz, J. C., Falk, C. F., & Savalei, V. (2010). Assessing mediational models: Testing and interval estimation for indirect effects. Multivariate Behavioral Research, 45, 661-701. doi: 10.1080/00273171.2010.498292
6. Bollen, K. A. (1989). Structural equation models with latent variables. New York: Wiley.
7. Bollen, K. A., & Stine, R. (1990). Direct and indirect effects: Classical and bootstrap estimates of variability. Sociological Methodology, 20, 15-140. doi: 10.1177/0049124192021002004
8. Bullock, J. G., Green, D. P., & Ha, S. E. (2010). Yes, but what's the mechanism? (Don't expect an easy answer). Journal of Personality and Social Psychology, 98, 550-558. doi: 10.1037/a0018933
9. Coffman, D. L. (2011). Estimating causal effects in mediation analysis using propensity scores. Structural Equation Modeling, 18, 357-369. doi: 10.1080/10705511.2011.582001
10. Coffman, D. L., & Zhong, W. (2012). Assessing mediation using marginal structural models in the presence of confounding and moderation. Psychological Methods, 17, 642-664. doi: 10.1037/a0029311
11. Cole, D. A., & Maxwell, S. E. (2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558-577. doi: 10.1037/0021-843X.112.4.558
12. Davis, M. D. (1985). The logic of causal order. Beverly Hills, CA: Sage.
13. Fuemmeler, B. F., Mâsse, L. C., Yaroch, A. L., Resnicow, K., Campbell, M. K., Carr, C., ... Williams, A. (2006). Psychosocial mediation of fruit and vegetable consumption in the body and soul effectiveness trial. Health Psychology, 25, 474-483. doi: 10.1037/0278-6133.25.4.474
14. Garcia, D., Kerekes, N., & Archer, T. (2012). A will and a proper way leading to happiness: Self-directedness mediates the effect of persistence on positive affectivity. Personality and Individual Differences, 53, 1034-1038. doi: 10.1016/j.paid.2012.07.025
15. Gelfand, L. A., Mensinger, J. L., & Tenhave, T. (2009). Mediation analysis: A retrospective snapshot of practice and more recent directions. The Journal of General Psychology, 136, 153-178. doi: 10.3200/GENP.136.2.153-178
16. Gollob, H. F., & Reichardt, C. S. (1991). Interpreting and estimating indirect effects assuming time lags really matter. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change: Recent advances, unanswered questions, future directions (pp. 243-259). Washington, DC: American Psychological Association.
17. Hershberger, S. L. (2006). The problem of equivalent structural models. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course. (pp. 13-41). Charlotte, NC: Information Age.
18. Hoyle, R. H., & Kenny, D. A. (1999). Sample size, reliability, and tests of statistical mediation. In R. H. Hoyle (Ed.), Statistical strategies for small sample research. (pp. 195-222). Thousand Oaks, CA: Sage.
19. Iacobucci, D., Saldanha, N., & Deng, X. (2007). A meditation on mediation: Evidence that structural equations models perform better than regressions. Journal of Consumer Psychology, 17, 139-153. doi: 10.1016/S1057-7408(07)70020-7
20. Imai, K., Keele, L., & Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309-334. doi: 10.1037/a0020761
21. Jo, B. (2008). Causal inference in randomized experiments with mediational processes. Psychological Methods, 13, 314-336. doi: 10.1037/a0014207
22. Judd, C. M., & Kenny, D. A. (1981). Process analysis estimating mediation in treatment evaluations. Evaluation Review, 5, 602-619. doi: 10.1177/0193841X8100500502
23. Kashy, D. A., Donnellan, M. B., Ackerman, R. A., & Russell, D. W. (2009). Reporting and interpreting research in PSPB: Practices, principles, and pragmatics. Personality and Social Psychology Bulletin, 35, 1131-1142. doi: 10.1177/0146167208331253
24. Kenny, D. A., Kashy, D., & Bolger, N. (1998). Data analysis in social psychology. In D. Gilbert, S. Fiske & G. Lindzey (Eds.), Handbook of Social Psychology (4th edn., pp. 233-265). New York, NY: McGraw-Hill.
25. Kenny, D. A., Korchmaros, J. D., & Bolger, N. (2003). Lower level mediation in multilevel models. Psychological Methods, 8, 115-128. doi: 10.1037/1082-989X.8.2.115
26. Ledgerwood, A., & Shrout, P. E. (2011). The trade-off between accuracy and precision in latent variable models of mediation processes. Journal of Personality and Social Psychology, 101, 1174-1188. doi: 10.1037/a0024776
27. Lee, S., & Hershberger, S. (1990). A simple rule for generating equivalent models in covariance structure modeling. Multivariate Behavioral Research, 25, 313-334. doi: 10.1207/s15327906mbr25034
28. Long, J. S., & Ervin, L. H. (2000). Using heteroscedasticity consistent standard errors in the linear regression model. The American Statistician, 54, 217-224. doi: 10.1080/00031305.2000.10474549
29. MacCallum, R. C. (2003). 2001 presidential address: Working with imperfect models. Multivariate Behavioral Research, 38, 113-139. doi: 10.1207/S15327906MBR3801_5
30. MacCallum, R. C., Wegener, D. T., Uchino, B. N., & Fabrigar, L. R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114, 185-199. doi: 10.1037/0033-2909.114.1.185
31. MacKinnon, D. P. (2008). Introduction to Statistical Mediation Analysis. New York, NY: Lawrence Erlbaum Associates.
32. MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007). Mediation analysis. Annual Review of Psychology, 58, 593-614. doi: 10.1146/annurev.psych.58.110405.085542
33. MacKinnon, D. P., Fritz, M. S., Williams, J., & Lockwood, C. M. (2007). Distribution of the product confidence limits for the indirect effect: Program PRODCLIN. Behavior Research Methods, 39, 384-389. doi: 10.3758/BF03193007
34. MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000). Equivalence of the mediation, confounding and suppression effect. Prevention Science, 1, 173-181. doi: 10.1023/A:1026595011371
35. MacKinnon, D. P., Lockwood, C. M., Brown, C. H., Wang, W., & Hoffman, J. M. (2007). The intermediate endpoint effect in logistic and probit regression. Clinical Trials, 4, 499-513. doi: 10.1177/1740774507083434
36. MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7, 83-104. doi: 10.1037/1082-989X.7.1.83
37. MacKinnon, D. P., & Pirlott, A. G. (2015). Statistical approaches for enhancing causal interpretation of the M to Y relation in mediation analysis. Personality and Social Psychology Review, 19, 30-43. doi: 10.1177/1088868314542878
38. Maier, M. A., Elliot, A. J., & Lichtenfeld, S. (2008). Mediation of the negative effect of red on intellectual performance. Personality and Social Psychology Bulletin, 34, 1530-1540. doi: 10.1177/0146167208323104
39. Maxwell, S. E., & Cole, D. A. (2007). Bias in cross-sectional analyses of longitudinal mediation. Psychological Methods, 12, 23-44. doi: 10.1037/1082-989X.12.1.23
40. Maxwell, S. E., Cole, D. A., & Mitchell, M. A. (2011). Bias in cross-sectional analyses of longitudinal mediation: Partial and complete mediation under an autoregressive model. Multivariate Behavioral Research, 46, 816-841. doi: 10.1080/00273171.2011.606716
41. Muller, D., Judd, C. M., & Yzerbyt, V. Y. (2005). When moderation is mediated and mediation is moderated. Journal of Personality and Social Psychology, 89, 852-863. doi: 10.1037/0022-3514.89.6.852
42. Murnane, R. J., & Willett, J. B. (2011). Methods matter: Improving causal inference in educational and social science research. New York, NY: Oxford University Press.
43. Muthén, L. K., & Muthén, B. O. (2012). Mplus user's guide (7th ed.) [Computer software manual]. Los Angeles, CA: Muthén & Muthén.
44. Neale, M. C., Hunter, M. D., Pritkin, J., Zahery, M., Brick, T. R., Kirkpatrick, R. M., ... Boker, S. M. (2015). OpenMx 2.0: Extended structural equation and statistical modeling. Psychometrika. doi: 10.1007/s11336-014-9435-8
45. Pearl, J. (2014). Interpretation and identification of causal mediation. Psychological Methods, 19, 459-481. doi: 10.1037/a0036434
46. Preacher, K. J. (2015). Advances in mediation analysis: A survey and synthesis of new developments. Annual Review of Psychology, 66, 825-852. doi: 10.1146/annurev-psych-010814-015258
47. Preacher, K. J., Rucker, D. D., & Hayes, A. F. (2007). Addressing moderated mediation hypotheses: Theory, methods, and prescriptions. Multivariate Behavioral Research, 42, 185-227. doi: 10.1080/00273170701341316
48. Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010). A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15, 209-233. doi: 10.1037/a0020141
49. Raykov, T., & Marcoulides, G. A. (2001). Can there be infinitely many models equivalent to a given covariance structure model? Structural Equation Modeling, 8, 142-149. doi: 10.1207/S15328007SEM08018
50. Rodgers, J. L. (2010). The epistemology of mathematical and statistical modeling: A quiet methodological revolution. American Psychologist, 65, 1-12. doi: 10.1037/a0018326
51. Rucker, D. D., Preacher, K. J., Tormala, Z. L., & Petty, R. E. (2011). Mediation analysis in social psychology: Current practices and new recommendations. Social and Personality Psychology Compass, 5, 359-371. doi: 10.1111/j.1751-9004.2011.00355.x
52. Savalei, V. (2014). Understanding robust corrections in structural equation modeling. Structural Equation Modeling, 21, 149-160. doi: 10.1080/10705511.2013.824793
53. Selig, J. P., & Preacher, K. J. (2009). Mediation models for longitudinal data in developmental research. Research in Human Development, 6, 144-164. doi: 10.1080/15427600902911247
54. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
55. Sobel, M. E. (1982). Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology, 13, 290-312. doi: 10.2307/270723
56. Sobel, M. E. (1986). Some new results on indirect effects and their standard errors in covariance structure models. Sociological Methodology, 16, 159-186. Retrieved on 16 March 2015 from: http://www.jstor.org/stable/270922
57. Spencer, S. J., Zanna, M. P., & Fong, G. T. (2005). Establishing a causal chain: Why experiments are often more effective than mediational analyses in examining psychological processes. Journal of Personality and Social Psychology, 89, 845-851. doi: 10.1037/0022-3514.89.6.845
58. Tein, J.-Y., Sandler, I. N., MacKinnon, D. P., & Wolchik, S. A. (2004). How did it work? Who did it work for? Mediation in the context of a moderated prevention effect for children of divorce. Journal of Consulting and Clinical Psychology, 72, 617-624. doi: 10.1037/0022-006X.72.4.617
59. Thoemmes, F. (2015). Reversing arrows in mediation models does not distinguish plausible models. Basic and Applied Social Psychology, 37, 226-234. doi: 10.1080/01973533.2015.1049351
60. Tukey, J. W. (1969). Analyzing data: Sanctification or detective work? American Psychologist, 24, 83-91.
61. Wampold, B. E., Davis, B., & Good, R. H. (1990). Hypothesis validity of clinical research. Journal of Consulting and Clinical Psychology, 58, 360-367. doi: 10.1037/0022-006X.58.3.360
62. Winship, C., & Morgan, S. L. (1999). The estimation of causal effects from observational data. Annual Review of Sociology, 25, 659-706. Retrieved on 26 April 2015 from http://www.jstor.org/stable/22352