Moderated multiple regression, spurious interaction effects, and IRT

Applied Psychological Measurement

Volumn 29, Issue 2, 2005, Pages 87-105

  Kang, Sun Mee ^a   Waller, Niels G ^b  

^a CALIFORNIA STATE UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY   (United States)

Author keywords

Item response theory; Moderated multiple regression; Spurious interaction; Type I error

Indexed keywords

EID: 14544271939     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/0146621604272737     Document Type: Review

References (72)

1. Aguinis, H., & Stone-Romero, E. F. (1997). Methodological artifacts in moderated multiple regression and their effects on statistical power. Journal of Applied Psychology, 82, 192-206.
2. Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
3. Anderson, L. E., Stone-Romero, E. F., & Tisak, J. (1996). A comparison of bias and mean squared error in parameter estimates of interaction effects: Moderated multiple regression versus-error-in-variables regression. Multivariate Behavioral Research, 31, 61-94.
4. Anderson, N. H. (1961). Scales and statistics: Parametric and nonparametric. Psychological Bulletin, 55, 305-316.
5. Anderson, N. H. (1970). Functional measurement and psychophysical judgment. Psychological Review, 77, 153-170.
6. Baker, B. O., Hardyck, C. D., & Petrinovich, L. F. (1966). Weak measurements vs. strong statistics: An empirical critique of S. S. Stevens' proscriptions on statistics. Educational and Psychological Measurement, 16, 291-309.
7. Baker, F. B. (1992). Item response theory: Parametric estimation techniques. New York: Marcel Dekker.
8. Bissonnette, V., Ickes, W., Bernstein, I., & Knowles, E. (1990). Personality moderating variables: A warning about statistical artifact and a comparison of analytic techniques. Journal of Personality, 58, 567-587.
9. Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431-444.
10. Bogartz, R. S. (1976). On the meaning of statistical interactions. Journal of Experimental Child Psychology, 22, 178-183.
11. Breiman, L., & Friedman, J. H. (1985). Estimating optimal transformations for multiple regression and correlation. Journal of the American Statistical Association, 80, 580-598.
12. Busemeyer, J. R. (1980). Importance of measurement theory, error theory, and experimental design for testing the significance of interactions. Psychological Bulletin, 88, 237-244.
13. Busemeyer, J. R., & Jones, L. E. (1983). Analysis of multiplicative combination rules when the causal variables are measured with error. Psychological Bulletin, 93, 549-562.
14. Champoux, J. E., & Peters, W. S. (1987). Form, effect size, and power in moderated regression analysis. Journal of Occupational Psychology, 60, 243-255.
15. Cliff, N. (1989). Ordinal consistency and ordinal true scores. Psychometrika, 54, 75-91.
16. Cliff, N. (1992). Abstract measurement theory and the revolution that never happened. Psychological Science, 3, 186-190.
17. Cohen, J. (1983). The cost of dichotomization. Applied Psychological Measurement, 7, 249-253.
18. Cohen, J., & Cohen, P. (1983). Applied multiple regression/ correlation for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
19. Cronbach, L. J. (1987). Statistical tests for moderator variables: Flaws in analyses recently proposed. Psychological Bulletin, 102, 414-417.
20. Davison, A. C., & Hinkley, D. V. (1997). Bootstrap methods and their applications. New York: Cambridge University Press.
21. Davison, M. L., & Sharma, A. R. (1988). Parametric statistics and levels of measurement. Psychological Bulletin, 104, 137-144.
22. Davison, M. L., & Sharma, A. R. (1990). Parametric statistics and levels of measurement: Factorial designs and multiple regression. Psychological Bulletin, 107, 394-400.
23. Drasgow, F. (1989). An evaluation of marginal maximum likelihood estimation for the two-parameter logistic model. Applied Psychological Measurement, 13, 77-90.
24. Dunlap, W. P., & Kemery, E. R. (1988). Effects of predictor intercorrelations and reliabilities on moderated multiple regression. Organizational Behavior and Human Decision Processes, 41, 248-258.
25. Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. New York: Chapman & Hall.
26. Embretson, S. E. (1994). Comparing changes between groups: Some perplexities arising from psychometrics. In D. Laveault, B. D. Zumbo, M. E. Gessaroli, & M. W. Boss (Eds.), Modern theories of measurement: Problems and issues (pp. 213-248). Ottawa, Ontario: University of Ottawa.
27. Embretson, S. E. (1996). Item response theory models and spurious interaction effects in factorial ANOVA designs. Applied Psychological Measurement, 20, 201-212.
28. Fisicaro, S. A., & Tisak, J. (1994). A theoretical note on the stochastics of moderated multiple regression. Educational and Psychological Measurement, 54, 32-41.
29. Gaito, J. (1980). Measurement scales and statistics: Resurgence of an old misconception. Psychological Bulletin, 87, 564-567.
30. Gaito, J. (1986). Some issues in the measurement-statistics controversy. Canadian Psychology, 27, 63-68.
31. Ganzach, Y. (1997). Misleading interaction and curvilinear terms. Psychological Methods, 2, 235-247.
32. Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff.
33. Hays, W. L. (1994). Statistics (5th ed.). New York: Harcourt, Brace.
34. Ihaka, R., & Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics, 5, 299-314.
35. Jaccard, J., Turrisi, R., & Wan, C. K. (1990). Interaction effects in multiple regression. Newbury Park, CA: Sage.
36. Jaccard, J., & Wan, C. K. (1995). Measurement error in the analysis of interaction effects between continuous predictors using multiple regression: Multiple indicator and structural equation approaches. Psychological Bulletin, 117, 348-357.
37. Kenny, D. A., & Judd, C. M. (1984). Estimating the nonlinear and interactive effects of latent variables. Psychological Bulletin, 90, 201-210.
38. Krantz, D. H., & Tversky, A. (1971). Conjoint-measurement analysis of composition rules in psychology. Psychological Review, 78, 151-169.
39. Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151-160.
40. Loftus, G. R. (1978). On interpretation of interactions. Memory and Cognition, 6, 312-319.
41. Lord, F. M. (1953). On the statistical treatment of football numbers. American Psychologist, 8, 750-751.
42. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillside, NJ: Lawrence Erlbaum.
43. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
44. Lubinski, D., & Humphreys, L. G. (1990). Assessing spurious "moderator effect": Illustrated substantively with the hypothesized ("synergistic") relation between spatial and mathematical ability. Psychological Bulletin, 107, 385-393.
45. MacCallum, R. C., & Mar, C. M. (1995). Distinguishing between moderator and quadratic effects in multiple regression. Psychological Bulletin, 118, 405-421.
46. MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19-40.
47. Maxwell, S. E., & Delaney, H. D. (1985). Measurement and statistics: An examination of construct validity. Psychological Bulletin, 97, 85-93.
48. Maxwell, S. E., & Delaney, H. D. (1993). Bivariate median splits and spurious statistical significance. Psychological Bulletin, 113, 181-190.
49. McClelland, G. H., & Judd, C. M. (1993). Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin, 114, 376-390.
50. Michell, J. (1986). Measurement scales and statistics: A clash of paradigms. Psychological Bulletin, 100, 398-407.
51. Michell, J. (1999). Measurement in psychology: Critical history of a methodological concept. Cambridge, UK: Cambridge University Press.
52. Paunonen, S. V., & Jackson, D. N. (1988). Type I error rates for moderated multiple regression analysis. Journal of Applied Psychology, 73, 569-573.
53. Perline, R., Wright, B., & Wainer, H. (1979). The Rasch model as additive conjoint measurement. Applied Psychological Measurement, 3, 237-255.
54. Peters, C. C., & Van Voorhis, W. R. (1940). Statistical procedures and their mathematical bases. New York: McGraw-Hill.
55. Ping, R. A. (1996). Latent variable regression: A technique for estimating interaction and quadratic coefficients. Multivariate Behavioral Research, 31, 95-120.
56. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press.
57. Reise, S. P., & Waller, N. G. (2003). How many IRT parameters does it take to model psychopathology items? Psychological Methods, 8(2), 164-184.
58. Russell, C. J., Pinto, J. K., & Bobko, P. (1991). Appropriate moderated regression and inappropriate research strategy: A demonstration of information loss due to scale coarseness. Applied Psychological Measurement, 15, 257-266.
59. Seong, T. J. (1990). Sensitivity of marginal maximum likelihood estimation of item and ability parameters to the characteristics of the prior ability distributions. Applied Psychological Measurement, 14, 299-311.
60. Shapiro, S. S., & Wilks, M. B. (1965). An analysis of variance test for normality (complete samples). Biometrika, 52, 591-611.
61. Shepperd, J. A. (1991). Cautions in assessing spurious "moderator effects." Psychological Bulletin, 100, 315-317.
62. Stevens, S. (1946). On the theory of scales of measurement. Science, 103, 677-680.
63. Stine, W. W. (1989). Meaningful inference: The role of measurement in statistics. Psychological Bulletin, 105, 147-155.
64. Stocking, M. (1987). Two simulated feasibility studies in computerized adaptive testing. Applied Psychology: An International Review, 36, 263-277.
65. Stone, C. A. (1992). Recovery of marginal maximum likelihood estimates in the two-parameter logistic response model: An evaluation of MULTILOG. Applied Psychological Measurement, 16, 1-6.
66. Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Boston: Allyn & Bacon.
67. Takane, Y., & De Leeuw, J. (1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52, 392-408.
68. Tellegen, A., Kamp, J., & Watson, D. (1982). Recognizing individual differences in predictive structure. Psychological Review, 89, 95-105.
69. Tibshirani, R. (1988). Estimating transformations for regression via additivity and variance stabilization. Journal of the American Statistical Association, 83, 394-405.
70. Tisak, J. (1994). Determination of the regression coefficients and their associated standard errors in hierarchical regression analysis. Multivariate Behavioral Research, 29, 185-201.
71. Townsend, J., & Ashby, F. G. (1984). Measurement scales and statistics: The misconception misconceived. Psychological Bulletin, 96, 394-401.
72. Velleman, P. F., & Wilkinson, L. (1993). Nominal, ordinal, interval, and ratio typologies are misleading. The American Statistician, 47, 65-72.