Cross-cultural validity and measurement invariance of the Organizational Stressor Indicator for Sport Performers (OSI-SP) across three countries

Scandinavian Journal of Medicine and Science in Sports

Volumn 27, Issue 8, 2017, Pages 895-903

  Arnold, R ^a   Ponnusamy, V ^b   Zhang, C Q ^c   Gucciardi, D F ^d  

^a University of Bath   (United Kingdom)

^b Institut Sukan Negara Malaysia   (Malaysia)

^c HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^d CURTIN UNIVERSITY   (Australia)

Author keywords

Confirmatory factor analysis; demand; generalizability; occupational; psychometric; stress

Indexed keywords

CONFIRMATORY FACTOR ANALYSIS; COVARIANCE; HUMAN; MAJOR CLINICAL STUDY; MODEL; PRACTICE GUIDELINE; SPORT; STRESS; VALIDITY; ADOLESCENT; ADULT; AGED; ATHLETE; ATHLETIC PERFORMANCE; CHILD; CHINA; CULTURAL FACTOR; FEMALE; MALAYSIA; MALE; MENTAL STRESS; MIDDLE AGED; ORGANIZATION; PSYCHOLOGY; PSYCHOMETRY; QUESTIONNAIRE; STANDARDS; UNITED KINGDOM; VALIDATION STUDY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; ATHLETES; ATHLETIC PERFORMANCE; CHILD; CHINA; CROSS-CULTURAL COMPARISON; FEMALE; HUMANS; MALAYSIA; MALE; MIDDLE AGED; ORGANIZATIONAL CULTURE; PSYCHOMETRICS; STRESS, PSYCHOLOGICAL; SURVEYS AND QUESTIONNAIRES; UNITED KINGDOM; YOUNG ADULT;

EID: 85021873660     PISSN: 09057188     EISSN: 16000838     Source Type: Journal    
DOI: 10.1111/sms.12688     Document Type: Article

References (78)

1. Agger B. Cultural studies as critical theory. Abingdon, UK: Routledge, 2014.
2. Albinson JG, Pearce W. The athlete daily hassle scale. 4th edn. Ontario, Canada: Queens University, 1998.
3. Araki K, Balasekaran G. Singaporean athletes in a multicultural society. In: Schinke RJ, Hanrahan SJ, eds. Cultural sport psychology. Champaign, IL: Human Kinetics, 2009: 193–203.
4. Arnold R, Fletcher D. Psychometric issues in organizational stressor research: a review and implications for sport psychology. Meas Phys Educ Exerc Sci 2012a: 16: 81–100: doi:10.1080/1091367x.2012.639608.
5. Arnold R, Fletcher D. A research synthesis and taxonomic classification of the organizational stressors encountered by sport performers. Journal of Sport and Exercise Psychology 2012b: 34: 397–429.
6. Arnold R, Fletcher D. Confirmatory factor analysis of the Sport Emotion Questionnaire in organizational environments. J Sports Sci 2015: 33: 169–179: doi:10.1080/02640414.2014.955520.
7. Arnold R, Fletcher D, Daniels K. Development and validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP). Journal of Sport and Exercise Psychology 2013: 35: 180–196.
8. Arnold R, Fletcher D, Daniels K. Demographic differences in sport performers' experiences of organizational stressors. Scandinavian Journal of Science and Medicine in Sport 2015: doi:10.1111/sms.12439.
9. Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990: 107: 238–246: doi:10.1037/0033-2909.107.2.238.
10. Bentler PM. On the fit of models to covariances and methodology to the Bulletin. Psychol Bull 1992: 112: 400–404: doi:10.1037//0033-2909.112.3.400.
11. Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull 1980: 88: 588–606: doi:10.1037//0033-2909.88.3.588.
12. Bentler PM, Wu EJC. EQS 6 for windows: user's guide. Encino, CA: Multivariate Software, 2002.
13. Bond MH, Smith PB. Cross-cultural social and organizational psychology. Annu Rev Psychol 1996: 47: 205–235: doi:10.1146/annurev.psych.47.1.205.
14. Brown TA. Confirmatory factor analysis for applied research. New York, NY: Guildford Press, 2006.
15. Byrne BM. Structural equation modelling with EQS: basic concepts, applications, and programming. London, UK: Lawrence Erlbaum, 2006.
16. Byrne BM, Oakland T, Leong FTL, van de Vijver FJR, Hambleton RK, Cheung FM, Bartram D. A critical analysis of cross-cultural research and testing practices: implications for improved education and training in psychology. Training and Education in Professional Psychology 2009: 3: 94–105: doi:10.1037/a0014516.
17. Byrne BM, Shavelson RJ, Muthén B. Testing the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol Bull 1989: 105: 456–466: doi:10.1037//0033-2909.105.3.456.
18. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Eq Model Multi J 2007: 14: 464–504: doi:10.1080/10705510701301834.
19. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model 2002: 9: 233–255: doi:10.1207/s15328007sem0902_5.
20. DiBartolo PM, Shaffer C. A comparison of female college athletes and non-athletes: eating disorder symptomatology and psychological well-being. Journal of Sport and Exercise Psychology 2002: 24: 33–42.
21. Fayers PM, Aaronson NK. “It ain't over till the fat lady sings”: a response to Cameron N. McIntosh, improving the evaluation of model fit in confirmatory factor analysis. Qual Life Res 2012: 21: 1623–1624: doi:10.1007/s11136-012-0112-z.
22. Fletcher D, Arnold R. Stress in sport: the role of the organizational environment. In: Wagstaff CRD, ed. An organizational psychology of sport: key issues and practical applications. London, UK: Routledge, 2016: In press.
23. Fletcher D, Hanton S. Sources of organizational stress in elite sports performers. The Sport Psychologist 2003: 17: 175–195.
24. Fletcher D, Hanton S, Mellalieu SD. An organizational stress review: conceptual and theoretical issues in competitive sport. In: Hanton S, Mellalieu SD, eds. Literature reviews in sport psychology. Hauppauge, NY: Nova Science Publishers, 2006: 321–373.
25. Fletcher D, Hanton S, Mellalieu SD, Neil R. A conceptual framework of organizational stressors in sport performers. Scand J Med Sci Sports 2012a: 22: 545–557: doi:10.1111/j.1600-0838.2010.01242.x.
26. Fletcher D, Hanton S, Wagstaff CRD. Performers' responses to stressors encountered in sport organizations. J Sports Sci 2012b: 30: 349–358: doi:10.1080/02640414.2011.633545.
27. Gould D, Guinan D, Greenleaf C, Medbery R, Peterson K. Factors affecting Olympic performance: perceptions of athletes and coaches from more and less successful teams. The Sport Psychologist 1999: 13: 371–394.
28. Grice JW. Computing and evaluating factor scores. Psychol Methods 2001: 6: 430–450: doi:10.1037//1082-989X.6.4.430.
29. Hagger MS, Lindwall FH, Hein V, Mülazumoğlu-Ball O, Tarrant M, Pastor Ruiz Y, Sell V. Cross-cultural validity and measurement invariance of The Social Physique Anxiety Scale in five European nations. Scand J Med Sci Sports 2007: 17: 703–719: doi:10.1111/j.1600-0838.2006.00615.x.
30. Hanton S, Fletcher D, Coughlan G. Stress in elite sport performers: a comparative study of competitive and organizational stressors. J Sports Sci 2005: 23: 1129–1141: doi:10.1080/02640410500131480.
31. Harrington D. Confirmatory factor analysis. Oxford, UK: Oxford University Press, 2008.
32. Heene M, Hilbert S, Draxler C, Ziegler M, Bühner M. Masking misfit in confirmatory factor analysis by increasing unique variances: a cautionary note on the usefulness of cutoff values of fit indices. Psychol Methods 2011: 16: 319–336: doi:10.1037/a0024917.
33. Ho DY, Chiu C. Component ideas of individualism, collectivism, and social organization: an application in the study of Chinese culture. In: Kim U, Triandis HC, Katitcibasi C, Choi S, Yoon G, eds. Individualism and collectivism: theory, method, and applications. Thousand Oaks, CA: Sage, 1994: 137–156.
34. Hofstede G. Culture's consequences: international differences in work related values. Beverly Hills, CA: Sage, 1980.
35. Hofstede G, Hofstede GJ, Minkov M. Cultures and organizations: software of the mind. 3rd edn. New York, NY: McGraw-Hill, 2010.
36. Hu LT, Bentler PM. Fit indices in covariance structural modeling: Sensitivity to underparameterized model misspecification. Psychological Methods: 3: 424–453: doi: 10.1037/1082-989X.3.4.424.
37. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 1999: 6: 1–55: doi:10.1080/10705519909540118.
38. Hurley AE, Scandura TA, Schriesheim CA, Brannick MT, Seers A, Vandenberg RJ, Williams LJ. Exploratory and confirmatory factor analysis: guidelines, issues, and alternatives. Journal of Organizational Behavior 1997: 18: 667–683: doi:10.1002/(sici)1099-1379(199711)18:6%3C667:aid-job874%3E3.0.co;2-t.
39. Jöreskog KG. Testing structural equation models. In: Bollen KA, Long JS, eds. Testing structural equation models. Newbury Park, CA: Sage, 1993: 294–316.
40. Kristiansen E, Halvari H, Roberts GC. Organizational and media stress among professional football players: testing an achievement goal theory model. Scand J Med Sci Sports 2012: 22: 569–579: doi:10.1111/j.1600-0838.2010.01259.x.
41. Kristiansen E, Roberts GC. Young elite athletes and social support: coping with competitive and organizational stress in “Olympic” competition. Scand J Med Sci Sports 2010: 20: 686–695: doi:10.1111/j.1600-0838.2009.00950.x.
42. Lane AM, Harwood C, Terry PC, Karageorghis CI. Confirmatory factor analysis of the Test of Performance Strategies (TOPS) among adolescent athletes. J Sports Sci 2004: 22: 803–812: doi:10.1080/02640410410001716689.
43. Lidor R, Blumenstein B. Working with elite athletes in Israel. In: Schinke RJ, Hanrahan SJ, eds. Cultural sport psychology. Champaign, IL: Human Kinetics, 2009: 141–152.
44. Lu D. Opportunities and challenges: Chinese women athletes in the twenty-first century. Asia Pacific Journal of Sport and Social Science 2014: 3: 32–50: doi:10.1080/21640599.2014.881138.
45. MacCallum RC, Browne MW, Sugawara HM. Power analysis and determination of sample size for covariance structure modeling. Psychol Methods 1996: 1: 130–149: doi:10.1037//1082-989X.1.2.130.
46. Marsh HW, Hau KT, Grayson D. Goodness of fit evaluation in structural equation modeling. In: Maydeu-Olivares A, McArdle J, eds. Psychometrics. A Festschrift for Roderick P. McDonald. Hillsdale, NJ: Erlbaum, 2005: 275–340.
47. Marsh HW, Hau KT, Wen Z. In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Model 2004: 11: 320–341: doi:10.1207/s15328007sem1103_2.
48. Marsh HW, Marco IT, Abcy FH. Cross-cultural validity of the Physical Self Description Questionnaire: comparison of factor structures in Australia, Spain, and Turkey. Res Q Exerc Sport 2002: 73: 257–270: doi:10.1080/02701367.2002.10609019.
49. McGannon KR, Johnson CR. Strategies for reflective cultural sport psychology research. In: Schinke RJ, Hanrahan SJ, eds. Cultural sport psychology. Champaign, IL: Human Kinetics, 2009: 57–75.
50. McIntosh CN. Improving the evaluation of model fit in confirmatory factor analysis: a commentary on Gundy, C. M., Fayers, P. M., Groenvold, M., Petersen, M. Aa., Scott, N. W., Sprangers, M. A. J., Velikov, G., Aaronson, N. K. (2011). Comparing higher-order models for the EORTC QLQ-C30. Quality of Life Research. Qual Life Res 2012: 21: 1619–1621. doi:10.1007/s11136-011-0084-4.
51. Mulaik S. There is a place for approximate fit in structural equation modelling. Personality Individ Differ 2007: 42: 883–891: doi:10.1016/j.paid.2006.10.024.
52. Mullan E, Markland D, Ingledew DK. A graded conceptualisation of self-determination in the regulation of exercise behaviour: development of a measure using confirmatory factor analytic procedures. Personality Individ Differ 1997: 23: 745–752: doi:10.1016/s0191-8869(97)00107-4.
53. Noblet AJ, Gifford SM. The sources of stress experienced by professional Australian footballers. Journal of Applied Sport Psychology 2002: 14: 1–13: doi:10.1080/104132002753403799.
54. Noblet A, Rodwell J, McWilliams J. Predictors of the strain experienced by professional Australian footballers. Journal of Applied Sport Psychology 2003: 15: 184–193: doi:10.1080/10413200305394.
55. Oyserman D, Coon HM, Kemmelmeier M. Rethinking individualism and collectivism: evaluation of theoretical assumptions and meta-analyses. Psychol Bull 2002: 128: 3–72: doi:10.1037//0033-2909.128.1.3.
56. Satorra A, Bentler PM. A scales difference chi-square test statistic for moment structure analysis. Psychometrika 2001: 66: 507–514: doi:10.2139/ssrn.199064.
57. Schinke RJ, McGannon KR, Parham WD, Lane AM. Toward cultural praxis and cultural sensitivity: strategies for self-reflexive sport psychology practice. Quest 2012: 64: 34–46: doi:10.1080/00336297.2012.653264.
58. Si G, Duan Y, Li HY, Zhang CQ, Su N. The influence of the Chinese sport system and Chinese cultural characteristics on the Olympic sport psychology services. Psychol Sport Exerc 2015: 17: 56–67: doi:10.1016/j.psychsport.2014.08.0081469-0292.
59. Si G, Duan Y, Lo HY, Jiang X. An exploration into socio-cultural meridians of Chinese athletes' psychological training. Journal of Clinical Sport Psychology 2011: 5: 325–338.
60. Sohal D, Gervis M, Rhind D. Exploration of organizational stressors in Indian elite female athletes. International Journal of Sport Psychology 2013: 44: 565–585.
61. Steiger JH. Structural model evaluation and modification: an interval estimation approach. Multivar Behav Res 1990: 25: 173–180: doi:10.1207/s15327906mbr2502_4.
62. Stone CA, Ye F, Zhu X, Lane S. Providing subscale scores for diagnostic information: a case study when the test is essentially unidimensional. Appl Measur Educ 2009: 23: 63–86: doi:10.1080/08957340903423651.
63. Sue S. Science, ethnicity and bias: where have we gone wrong? Am Psychol 1999: 54: 1070–1077: doi:10.1037/e511712004-001.
64. Sumathipala A, Murray J. New approach to translating instruments for cross-cultural research: a combined qualitative and quantitative approach for translation and consensus generation. International Journal of Methods in Psychiatric Research 2000: 9: 87–95: doi:10.1002/mpr.83.
65. Tabachnick BG, Fidell LS. Using multivariate statistics. London, UK: Allyn and Bacon, 2001.
66. Tabei Y, Fletcher D, Goodger K. The relationship between organizational stressors and athlete burnout in soccer players. Journal of Clinical Sport Psychology 2012: 6: 146–165.
67. Terry PC. Strategies for reflective cultural sport psychology practice. In: Schinke RJ, Hanrahan SJ, eds. Cultural sport psychology. Champaign, IL: Human Kinetics, 2009: 79–89.
68. Thelwell R, Weston N, Greenlees I. Coping at the crease: sources of stress and coping strategies for professional batsmen. J Sports Sci 2005: 23: 1273.
69. Tian Y, He Z, Zhao J, Tao D, Xu K, Midgley A. An 8-year longitudinal study of overreaching in 114 elite female Chinese wrestlers. Journal of Athletic Training 2015: 50: 217–223: doi:10.4085/1062-6050-49.3.57.
70. Triandis HC. Individualism and collectivism. Boulder, CO: Westview, 1995.
71. Vandenberg RJ, Lance CE. A review and synthesis of the measurement invariance literature: suggestions, practice, and recommendations for organizational research. Organizational Research Methods 2000: 3: 4–70: doi:10.1177/109442810031002.
72. Vernon T, Eysenck S, eds. Structural equation modelling [Special issue]. Personality Individ Differ 2007: 42: 811–898.
73. van de Vijver FJR, Leung K. Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage, 1997.
74. Wei F, Hong F, Zhouxiang L. Chinese state sports policy: pre- and post- Beijing 2008. The International Journal of the History of Sport 2010: 27: 2380–2402: doi:10.1080/09523367.2010.504583.
75. West SG, Finch JF, Curran PJ. Structural equation models with non-normal variables problems and remedies. In: Hoyle RH, ed. Structural equation modelling: concepts, issues, and applications. Newbury Park, CA: Sage, 1995: 56–75.
76. Williams LJ, Vandenberg RJ, Edwards JR. Structural equation modelling in management research: a guide for improved analysis. The Academy of Management Annals 2009: 3: 543–604: doi:10.1080/19416520903065683.
77. Woodman T, Hardy L. The relative impact of cognitive anxiety and self-confidence upon sport performance: a meta-analysis. J Sports Sci 2003: 21: 443–457: doi:10.1080/0264041031000101809.
78. Yang SX, Jowett S. Psychometric properties of the Coach-Athlete Relationship Questionnaire (CART-Q) in seven countries. Psychol Sport Exerc 2012: 13: 36–43: doi:10.1016/j.psychsport.2011.07.010.