Common methods bias: Does common methods variance really bias results?

Organizational Research Methods

Volumn 1, Issue 4, 1998, Pages 374-406

  Doty, D Harold ^a,c,d   Glick, William H ^b,e  

^a SYRACUSE UNIVERSITY   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^d SYRACUSE UNIVERSITY   (United States)

^e ASU Faculty

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001548448     PISSN: 10944281     EISSN: None     Source Type: Journal    
DOI: 10.1177/109442819814002     Document Type: Article

References (84)

1. Anderson, J. C. (1987). An approach for confirmatory measurement and structural equation modeling of organizational properties. Management Science, 33, 525-544.
2. Arora, R. (1982). Validation of an S-O-R model for situation, enduring, and response components of involvement. Journal of Marketing Research, 19, 505-516.
3. Bagozzi, R. P., & Phillips, L. W. (1982). Representing and testing organizational theories: A holistic construal. Administrative Science Quarterly, 27, 459-489.
4. Bagozzi, R. P., & Yi, Y. (1990). Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology, 75, 547-560.
5. Becker, T. E., & Cote, J. A. (1994). Additive and multiplicative methods effects in applied psychological research: An empirical assessment of three models. Journal of Management, 20, 625-641.
6. Becker, T. E., & Vance, R. J. (1993). Construct validity of three types of organizational citizenship behavior: An illustration of the direct product model with refinements. Journal of Management, 19, 663-682.
7. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness fit in the analysis of covariance. Psychological Bulletin, 88, 588-606.
8. Berlinger, L. R., Glick, W. H., & Rodgers, R. C. (1988). Job enrichment and performance improvement. In J. P. Campbell & R. J. Campbell (Eds.), Productivity in organizations: New perspectives from industrial and organizational psychology (pp. 219-254). San Francisco: Jossey-Bass.
9. Birnbaum, P. H., Farh, J. L., & Wong, G. Y. (1986). The job characteristics model in Hong Kong. Journal of Applied Psychology, 71, 598-605.
10. Boyd, B. K., Dess, G. G., & Rasheed, M. A. (1993). Divergence between archival and perceptual measures of the environment: Causes and consequences. Academy of Management Review, 18, 204-226.
11. Brannick, M. T., & Spector, P. E. (1990). Estimation problems in the block-diagonal model of the multitrait-multimethod matrix. Journal of Applied Psychological Measurement, 14, 325-339.
12. Brass, D. J. (1979). Effects of relationships among task positions on job characteristics, interpersonal variables, and employee satisfaction and performance. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.
13. Brief, A. P., Burke, M. J., George, J. M., Robinson, B. S., & Webster, J. (1988). Should negativity affectivity remain an unmeasured variable in the study of job stress? Journal of Applied Psychology, 73, 193-198.
14. Cadotte, E. R., Woodruff, R. B., & Jenkins, R. L. (1987). Expectations and norms in models of consumer satisfaction. Journal of Marketing Research, 24, 305-314.
15. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
16. Campbell, D. T., & O'Connell E. J. (1982). Methods as diluting trait relationships rather than adding irrelevant systematic variance. In D. Brinberg & L. Kidder (Eds.), New directions for methodology of social and behavioral science: Forms of validity in research (pp. 93-111). San Francisco: Jossey-Bass.
17. Chen, P. Y., & Spector, P. E. (1991). Negative affectivity as the underlying caused of correlations between Stressors and strains. Journal of Applied Psychology, 76, 398-407.
18. Cote, J. A., & Buckley, M. R. (1987). Estimating trait, method, and error variance: Generalizing across 70 construct validation studies. Journal of Marketing Research, 24, 315-318.
19. Crampton, S. M., & Wagner, J. A. III. (1994). Percept-percept inflation in microorganizational research: An investigation of prevalence and effect. Journal of Applied Psychology, 79, 67-76.
20. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
21. Cronbach, L. E., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16, 137-163.
22. Dickinson, T. L., & Zellinger, P. M. (1980). A comparison of the behaviorally anchored rating and mixed standard scale formats. Journal of Applied Psychology, 65, 147-154.
23. Doty, D. H., & Glick, W. H. (1988, April). Method variance in I/O research: Major effect of mythical beast? Paper presented at the Annual Meetings of the Society of Industrial and Organizational Psychology, Dallas, TX.
24. Doty, D. H., & Glick, W. H. (1989, August). Construct validity in organizational research: Good news-bad news. Paper presented at the National Meetings of the Academy of Management, Washington, DC.
25. Dunham, R. B., Smith, F. J., & Blackburn, R. S. (1977). Validation of the index of organizational reactions with the JDI, the MSQ, and faces scales. Academy of Management Journal, 20, 420-432.
26. Eden, D., & Leviatan, U. (1975). Implicit leadership theory as a determinant of the factor structure underlying supervisory behavior scales. Journal of Applied Psychology, 60, 736-741.
27. Fields, M. W., & Thacker, J. W. (1992). Influence of quality of work life on company and union commitment. Academy of Management Journal, 35, 439-450.
28. Fichman, M. (1982). Attribution processes in the use of performance feedback in an organization. Dissertation Abstracts International, 43, 2028B. (University Microfilms No. DA82-24, 948)
29. Fiske, D. W. (1982). Convergent-discriminant validation in measurements and research strategies. In D. Brinberg & L. Kidder (Eds.), New directions for methodology of social and behavioral science: Forms of validity in research (pp. 77-92). San Francisco: Jossey-Bass.
30. Gillet, B., & Schwab, D. P. (1975). Convergent and discriminant validities of corresponding job descriptive index and Minnesota satisfaction questionnaire scales. Journal of Applied Psychology, 60, 313-317.
31. Glick, W. H., Jenkins, G. D., Jr., & Gupta, N. (1986). Method versus substance: How strong are underlying relationships between job characteristics and attitudinal outcomes? Academy of Management Journal, 29, 441-464.
32. Greene, C. N., & Schriesheim, C. A. (1980). Leader-group interactions: A longitudinal field investigation. Journal of Applied Psychology, 65, 50-59.
33. Gupta, N., & Beehr, T. A. (1982). A test of the correspondence between self-reports and alternative data sources about work organizations. Journal of Vocational Behavior, 20, 1-13.
34. Hackman, J. R., & Oldham, G. R. (1976). Motivation through the design of work: Test of a theory. Organizational Behavior and Human Performance, 16, 250-279.
35. Hackman, J. R., & Oldham, G. R. (1980). Work redesign. Reading, MA: Addison-Wesley.
36. Hayduk, L. A. (1987). Structural equation modeling with LISREL: Essentials and advances. Baltimore: Johns Hopkins University Press.
37. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
38. Holzbach, R. L. (1978). Rater bias in performance ratings: Superior, self, and peer ratings. Journal of Applied Psychology, 63, 579-588.
39. Huber, G. P., Miller, C. C., & Glick, W. H. (1990). Developing more encompassing theories about organizations: The centralization-effectiveness relationship as an example. Organization Science, 1, 11-40.
40. Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis: Cumulating research findings across studies. Beverly Hills, CA: Sage.
41. Jaffe, E. D., & Nebenzahl, I. D. (1984). Alternative questionnaire formats for country image studies. Journal of Marketing Research, 21, 463-471.
42. John, G., & Reve, T. (1982). The reliability and validity of key informant data from dyadic relationships in marketing channels. Journal of Marketing Research, 19, 517-524.
43. Johnson, S. M., Smith, P. C., & Tucker, S. M. (1982). Response format of the job descriptive index: Assessment of reliability and validity by the multitrait-multimethod matrix. Journal of Applied Psychology, 67, 500-505.
44. Jöreskog, K. G., & Sörbom, D. (1996). LISREL 8: User's reference guide. Chicago: Scientific Software International.
45. Landy, F. J., Rastegary, H., Thayer, J., & Colvin, C. (1991). Time urgency: The construct and its measurement. Journal of Applied Psychology, 76, 644-657.
46. Lawler, E. E. (1967). The multitrait-multirater approach to measuring managerial job performance. Journal of Applied Psychology, 51, 369-381.
47. Markus, H., & Zajonc, R. B. (1985). The cognitive perspective in social psychology. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology (Vol. 1, 3rd. ed., pp. 137-230). New York: Random House.
48. McCabe, D. J., Dalessio, A., Briga, J., & Sasaki, J. (1980). The convergent and discriminant validities between the IOR and the JDI: English and Spanish forms. Academy of Management Journal, 23, 778-786.
49. Medsker, G. J., Williams, L. J., & Holahan, P. J. (1994). A review of current practices for evaluating causal models in organizational behavior and human resource management research. Journal of Management, 20, 439-464.
50. Meier, S. T. (1984). The construct validity of burnout. Journal of Occupational Psychology, 57, 211-219.
51. Miller, C. C., Glick, W. H., Wang, Y., & Huber, G. P. (1991). Understanding technology-structure relationships: Theory development and meta-analytic theory testing. Academy of Management Journal, 34, 370-399.
52. Mitchell, T. R. (1985). An evaluation of the validity of correlational research conducted in organizations. Academy of Management Review, 10, 192-205.
53. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
54. Pennings, J. (1972). Measures of organizational structure: A methodological note. American Journal of Sociology, 79, 686-704.
55. Phillips, L. W. (1981). Assessing measurement error in key informant reports: A methodological note on organizational analysis in marketing. Journal of Marketing Research, 18, 395-415.
56. Pierce, J. L., & Dunham, R. B. (1978). The measurement of perceived job characteristics: The job diagnostic survey versus the job characteristics inventory. Academy of Management Journal, 21, 123-128.
57. Rentz, J. O. (1987). Generalizability theory: A comprehensive method for assessing and improving the dependability of marketing measures. Journal of Marketing Research, 24, 19-28.
58. Roberts, K. H., & Glick, W. H. (1981). The job characteristics approach to task design: A critical review. Journal of Applied Psychology, 66, 193-217.
59. Salancik, G. R. (1984). On priming, consistency, and order effects in job attitude assessment: With a note on current research. Journal of Management, 10, 250-254.
60. Salancik, G. R., & Pfeffer, J. (1977). An examination of the need-satisfaction models of job attitudes. Administrative Science Quarterly, 22, 427-456.
61. Salancik, G. R., & Pfeffer, J. (1978). A social information processing approach to job attitudes and task design. Administrative Science Quarterly, 23, 224-253.
62. Sathe, V. (1978). Institutional versus questionnaire measures of organizational structure. Academy of Management Journal, 21, 227-238.
63. Schmitt, N. (1994). Method bias: The importance of theory and measurement. Journal of Organizational Behavior, 15, 393-398.
64. Schmitt, N., & Stults, D. M. (1986). Methodology review: Analysis of multitrait-multimethod matrices. Journal of Applied Psychological Measurement, 10(1), 1-22.
65. Schneider, J. R., & Schmitt, N. (1992). An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology, 77, 32-41.
66. Seidler, J. (1974). On using informants: A technique for collecting quantitative data and controlling measurement error in organization analysis. American Sociological Review, 39, 816-831.
67. Shavelson, R. J., & Webb, N. M. (1981). Generalizability theory: 1973-1980. British Journal of Mathematical and Statistical Psychology, 34, 133-166.
68. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
69. Silverman, W. H., Pargament, K. I., Johnson, S. M., Echemendia, R. J., & Snyder, S. (1983). Measuring member satisfaction with the church. Journal of Applied Psychology, 68, 664-677.
70. Sims, H. P., Jr., Szilagyi, A. D., & Keller, R. T. (1976). The measurement of job characteristics. Academy of Management Journal, 19, 195-212.
71. Soutar, G. N., & Weaver, J. R. (1982). The measurement of shop-floor job satisfaction: The convergent and discriminant validity of the Worker Opinion Survey. Journal of Occupational Psychology, 55, 27-33.
72. Spector, P. E. (1985). Measurement of human service staff satisfaction: Development of the job satisfaction survey. American Journal of Community Psychology, 13, 693-713.
73. Spector, P. E. (1987). Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? Journal of Applied Psychology, 72, 438-443.
74. Spector, P. E., & Brannick, M. T. (1995). The nature and effects of method variance in organizational research. In C. L. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (pp. 249-274). West Sussex, England: John Wiley.
75. Spector, P. E., Dwyer, D. J., & Jex S. M. (1988). Relation of job Stressors to affective, health, and performance outcomes: A comparison of multiple data sources. Journal of Applied Psychology, 73, 11-19.
76. Spector, P. E., & Jex, S. M. (1991). Relations of job characteristics from multiple data sources with employee affect, absence, turnover intentions, and health. Journal of Applied Psychology, 76, 46-53.
77. Sudman, S., & Bradburn, N. M. (1974). Response effects in surveys: A review and synthesis. Chicago: Aldine.
78. Vance, R. J., MacCallum, R. C., Coovert, M. D., & Hedge, J. W. (1988). Construct validity of multiple job performance measures using confirmatory factor analysis. Journal of Applied Psychology, 73, 74-80.
79. Werts, C. E., & Linn, R. L. (1970). Path analysis: Psychological examples. Psychological Bulletin, 74, 193-212.
80. Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Journal of Applied Psychological Measurement, 9(1), 1-26.
81. Williams, L. J., & Anderson, S. E. (1994). An alternative approach to method effects by using latent-variable models: Applications in organizational behavior research. Journal of Applied Psychology, 79, 323-331.
82. Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? Journal of Applied Psychology, 74, 462-468.
83. Wolfe, J., & Jackson, C. (1987). Creating models of strategic decision making process via participant recall: A free simulation examination. Journal of Management, 13, 123-134.
84. Youngblood, S. A. (1984). Work, nonwork, and withdrawal. Journal of Applied Psychology, 69, 106-117.