The analysis of mean differences using mean and covariance structure analysis: Effect size estimation and error rates

Organizational Research Methods

Volumn 15, Issue 1, 2012, Pages 75-102

  Sharma, Subhash ^a   Durvasula, Srinivas ^b   Ployhart, Robert E ^a  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b MARQUETTE UNIVERSITY   (United States)

Author keywords

mean and covariance structure analysis; measurement; measurement equivalency

Indexed keywords

EID: 84055214059     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428111403154     Document Type: Article

References (54)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education.Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999:.
2. Amine L. S.Linking consumer behavior constructs to international marketing strategy: A comment on Wills, Samli, and Jacobs and an extension.Journal of the Academy of Marketing Science. 1993;21:71-77.
3. Andrews J. C.,Durvasula S.,Akhter S.A framework for conceptualizing and measuring the involvement construct in advertising research.Journal of Advertising. 1990;19:27-40.
4. Baumgartner H.,Steenkamp J. F. M.Response styles in marketing research: A cross-national investigation.Journal of Marketing Research. 2001;38:143-156.
5. Bobko P.,Roth P.,Bobko C.Correcting the effect size of d for range restriction and unreliability.Organizational Research Methods. 2001;4:46-61.
6. Byrne B. M.Structural equation modeling with LISREL, PRELIS, and SIMPLIS. Mahwah, NJ: Lawrence Erlbaum; 1998:.
7. Byrne B. M.,Shavelson R. J.,Muthen B.Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance.Psychological Bulletin. 1989;105:456-466.
8. Cheung G. W.,Rensvold R. B.Assessing extreme and acquiescence response sets in cross-cultural research using structural equation modeling.Journal of Cross-Cultural Psychology. 2000;31:187-212.
9. Cheung G. W.,Rensvold R. B.Evaluating goodness-of-fit indexes for testing measurement invariance.Structural Equation Modeling. 2002;9:233-255.
10. Choi J.,Fan W.,Hancock G. R.A note on confidence intervals for two group latent mean effect size measures.Multivariate Behavioral Research. 2009;44:396-406.
11. Cohen J.Statistical power analysis for the behavioral sciences.2nd ed.).New York, NY: Academic Press; 1988:.
12. Craig C. S.,Douglas S. P.International marketing research.(2nd ed.).New York, NY: John Wiley; 2000:.
13. De Jong M. G.,Steenkamp J. E. M.,Fox P.Relaxing measurement invariance in cross-national consumer research using a hierarchical IRT model.Journal of Consumer Research. 2007;34:260-278.
14. DeShon R. P.A cautionary note on measurement error corrections in structural equation modeling.Psychological Methods. 1998;3:412-423.
15. Durvasula S.,Andrews J. C.,Lysonski S.,Netemeyer R. G.Assessing the cross-national applicability of consumer behavior models: A model of attitude toward advertising in general.Journal of Consumer Research. 1993;19:626-636.
16. Durvasula S.,Netemeyer R. G.,Andrews C. J.,Lysonski S.Examining the cross-national applicability of multi-item, multi-dimensional measures using generalizability theory.Journal of International Business Studies. 2006;37:469-483.
17. Goldsamt M. R.Effects of scoring method and rating scale length in extreme response style measurement. Unpublished doctoral dissertation University of Maryland: Baltimore; 1971:.
18. Grunert S. C.,Muller T. E.Measuring values in international settings: Are respondents thinking "real" life or "ideal" life?.Journal of International Consumer Marketing. 1996;8:169-185.
19. He Y.,Merz M. A.,Alden D. L.Diffusion of measurement invariance assessment in cross-national empirical marketing research: Perspectives from the literature and a survey of researchers.Journal of International Marketing. 2008;16:64-83.
20. Horn J. L.,McArdle J. J.A practical guide to measurement invariance in research on aging.Experimental Aging Research. 1992;18:117-144.
21. Hough L. M.Effects of intentional distortion on in personality measurement and evaluation of suggested palliatives.Human Performance. 1998;11:209-244.
22. Hough L. M.,Oswald F. L.,Ployhart R. E.Determinants, detection, and amelioration of adverse impact in personnel selection procedures: Issues, evidence, and lessons learned.International Journal of Selection and Assessment. 2001;9:152-194.
23. Hui C. H.,Triandis H. C.Measurement in cross-cultural psychology: A review and comparison of strategies.Journal of Cross-Cultural Psychology. 1985;16:131-152.
24. Hult T. G.,Ketchen D. J.,Griffith D. A.,Finnegan C. A.,Gonzalez-Padron T.,Harmancioglu N.,Cavusgil S. T.Data equivalence in cross-cultural international business research: Assessment and guidelines.Journal of International Business Studies. 2008;39:1064-1080.
25. Irvine S. H.,Carroll W. K.Testing and assessment across cultures: Issues in methodology and theory.The handbook of cross-cultural psychology. Triandis H. C.Berry J. W., ed. Boston, MA: Allyn & Bacon; 1980:127-180.
26. Li L.Effect of collectivist orientation and ecological attitude on actual environmental commitment: The moderating role of consumer demographics and product involvement.Journal of International Consumer Marketing. 1997;9 (4): 31-53.
27. Little T. D.Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues.Multivariate Behavioral Research. 1997;32:53-76.
28. Little T. D.On the comparability of constructs in cross-cultural research: A critique of Cheung and Rensvold.Journal of Cross-Cultural Psychology. 2000;31:213-219.
29. Lutz R. J.Affective and cognitive antecedents of attitude toward the ad: A conceptual framework.Psychological processes and advertising effects. Alwitt L.Mitchell A., ed. Hillsdale, NJ: Lawrence Erlbaum; 1985:45-63.
30. Marin G.,Gamba R. J.,Marin B. V.Extreme response style and acquiescence among Hispanics.Journal of Cross-Cultural Psychology. 1992;23:498-509.
31. McQuarrie E. F.,Munson J. M.A revised product involvement inventory: Improved usability and validity.Advances in consumer research. Sherry J. F.Sternthal B., ed. Provo, UT: Association for Consumer Research; Vol. 19,1992:108-115.
32. Meredith W.Measurement invariance, factor analysis, and factorial invariance.Psychometrika. 1993;58:525-543.
33. Mullen M. R.Diagnosing measurement equivalence in cross-national research.Journal of International Business Studies. 1995;26:573-596.
34. Murphy K. R.,Cleveland J. N.Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage; 1995:.
35. Murphy K. R.,Myors B.Statistical power analysis. Mahwah, NJ: Lawrence Erlbaum; 2004:.
36. Noe R.Employee training and development.5th ed.).New York, NY: McGraw-Hill Irwin; 2009:.
37. Petty R. E.,Cacioppo J. T.Communication and persuasion: Central and peripheral routes to attitude change. New York, NY: Springer-Verlag; 1986:.
38. Ployhart R. E.,Holtz B. C.The diversity-validity dilemma: Strategies for reducing racioethnic and sex subgroup differences and adverse impact in selection.Personnel Psychology. 2008;61:153-172.
39. Ployhart R. E.,Oswald F. L.Applications of mean and covariance structure analysis: Integrating correlational and experimental approaches.Organizational Research Methods. 2004;7:27-65.
40. Reise S.,Widaman K.,Pugh R.Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance.Psychological Bulletin. 1993;114:552-566.
41. Roth P. L.,Bevier C. A.,Bobko P.,Switzer F. S., III,thnic group differences in cognitive ability in employment and educational settings: A meta-analysis.Personnel Psychology. 2001;54:297-330.
42. Rungtusanatham M.,Ng C. H.,Zhao X.,Lee T. S.Pooling data across transparently different groups of key informants: Measurement equivalence and survey research.Decision Sciences. 2008;39:115-145.
43. Sackett P. R.,Wilk S. L.Within-group norming and other forms of score adjustment in preemployment testing.American Psychologist. 1994;49:929-954.
44. Schmidt F. L.,Hunter J. E.Measurement error in psychological research: Lessons from 26 research scenarios.Psychological Methods. 1996;1:199-223.
45. Schmitt N.,Kuljanin G.Measurement invariance: Review of practice and implications.Human Resources Management Review. 2008;18:210-222.
46. Schmitt N.,Mills A.Traditional tests and job simulations: Minority and majority performance and test validities.Journal of Applied Psychology. 2001;86:421-458.
47. Sharma S.,Mukherjee S.,Kumar A.,Dillon W. R.A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure analysis.Journal of Business Research. 2005;58:935-943.
48. Sharma S.,Weathers D.Assessing generalizability of scales used in cross-national research.International Journal of Research in Marketing. 2003;20:287-295.
49. Singh J.Measurement issues in cross-national research.Journal of International Business Studies. 1995;26:597-619.
50. Steenkamp J. E. M.,Baumgartner H.Assessing measurement invariance in cross-national consumer research.Journal of Consumer Research. 1998;25:78-90.
51. Tucker L. R.,Lewis C.A reliability coefficient for maximum likelihood factor analysis.Psychometrika. 1973;39:1-10.
52. Vandenberg R. J.Toward a further understanding of and improvement in measurement invariance methods and procedures.Organizational Research Methods. 2002;5:139-158.
53. Vandenberg R. J.,Lance C. E.A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research.Organizational Research Methods. 2000;3:4-69.
54. Williams L. J.,Anderson S. E.An alternative approach to method effects by using latent-variable models: Applications in organizational behavior research.Journal of Applied Psychology. 1994;79:323-331.