A Critical Analysis of Cross-Cultural Research and Testing Practices: Implications for Improved Education and Training in Psychology

Training and Education in Professional Psychology

Volumn 3, Issue 2, 2009, Pages 94-105

  Byrne, Barbara M ^a   Oakland, Thomas ^b   Leong, Frederick T L ^c   van de Vijver, Fons J R ^d   Hambleton, Ronald K ^e   Cheung, Fanny M ^f   Bartram, David ^g  

^a UNIVERSITY OF OTTAWA   (Canada)

^b UNIVERSITY OF FLORIDA   (United States)

^c MICHIGAN STATE UNIVERSITY   (United States)

^d TILBURG UNIVERSITY   (Netherlands)

^e UNIVERSITY OF MASSACHUSETTS   (United States)

^f CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^g SHL Group Ltd   (United Kingdom)

Author keywords

education and training in cross cultural assessment; psychometric training; quantitative training; test use across culture; testing practices across culture

Indexed keywords

EID: 65649146864     PISSN: 19313918     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0014516     Document Type: Article

References (61)

1. Aiken L.S., West S.G., and Millsap R.E. Doctoral training in statistics, measurement, and methodology in psychology: Replication and extension of Aiken, West, Sechrest, and Reno's (1990) survey of PhD programs in North America. American Psychologist 63 (2008) 32-50
2. Aiken L.S., West S.G., Sechrest L., and Reno R.R. Graduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America. American Psychologist 45 (1990) 721-734
3. American Educational Research Association, American Psychological Association, and the National Council on Measurement in Education. Standards for educational and psychological testing (1999), Author, Washington DC
4. American Psychological Association. Ethical principles of psychologists and codes of conduct (2002), Author, Washington DC
5. American Psychological Association. Guidelines on multicultural education, training, research, practice, and organizational change for psychologists. American Psychologist 58 (2003) 377-402
6. Baddeley A. Human memory: Theory and practice. Rev. ed. (1997), Psychology Press, Hove, England
7. Bartram D. International guidelines for test use. International Journal of Testing 1 (2001) 93-114
8. Bartram D., Brown A., Fleck S., Inceoglu I., and Ward K. Technical manual (Pt. 1, chapters 1-6) (2006), SHL Group, Thames-Ditton, England
9. Bartram D., and Hambleton R. Computer-based testing and the Internet (2006), Wiley, West Sussex, England
10. Butcher J.N. International adaptations of the MMPI-2: A handbook of research and applications (1996), University of Minnesota Press, Minneapolis
11. Butcher J.N. Personality assessment without borders: Adaptation of the MMPI-2 across cultures. Journal of Personality Assessment 83 (2004) 90-104
12. Butcher J.N., Graham J.R., Ben-Porath Y.S., Tellegen A., Dahlstrom W.G., and Kaemmer B. Minnesota Multiphasic Personality Inventory-2: Manual for administration and scoring. Rev.ed. (2001), University of Minnesota Press, Minneapolis, MN
13. Byrne B.M. Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming (1998), Erlbaum, Mahwah, NJ
14. Byrne B.M. Structural equation modeling with AMOS: Basic concepts, applications, and programming (2001), Erlbaum, Mahwah, NJ
15. Byrne B.M. Structural equation modeling with EQS (2nd ed.): Basic concepts, applications, and programming (2006), Erlbaum, Mahwah, NJ
16. Byrne B.M. Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psichothema 20 (2008) 872-882
17. Byrne B.M., Stewart S.M., Kennard B.D., and Lee P. The Beck Depression Inventory II: Testing for measurement equivalence and factor mean differences across Hong Kong and American Adolescents. International Journal of Testing 7 (2007) 1-17
18. Byrne B.M., Stewart S.M., and Lee P.W.H. Validating the Beck Depression Inventory-II for Hong Kong Community Adolescents. International Journal of Testing 4 (2004) 199-216
19. Byrne B.M., and Watkins D. The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology 34 (2003) 155-175
20. Camilli G., and Shepard L.A. Methods for identifying biased items (1994), Sage, Thousand Oaks, CA
21. Cheung F.M. Use of Western- and indigenously-developed personality tests in Asia. Applied Psychology: An International Review 53 (2004) 173-191
22. Cheung F.M. A combined emic-etic approach to cross-cultural personality test development: The case of the CPAI. In: Jing Q., Zhang H., and Zhang K. (Eds). Psychological science around the world 2 (2006), Psychology Press, London 91-103
23. Cheung F.M., Cheung S.F., Zhang J.X., Leung K., Leong F.T.L., and Yeh K.H. Relevance of openness as a personality dimension in Chinese culture. Journal of Cross-Cultural Psychology 39 (2008) 81-108
24. Cheung F.M., Leong F.T.L., and Ben-Porath Y. Psychological assessment in Asia: Introduction to the special section. Psychological Assessment 15 (2003) 243-247
25. Cheung F.M., Leung K., Fan R., Song W.Z., Zang J.X., and Zhang J.P. Development of the Chinese Personality Assessment Inventory (CPAI). Journal of Cross-Cultural Psychology 27 (1996) 181-199
26. Cheung F.M., Leung K., Zhang J.X., Sun H.F., Gan Y.Q., Song W.Z., et al. Indigenous Chinese personality construct: Is the Five Factor Model complete?. Journal of Cross-Cultural Psychology 32 (2001) 407-433
27. Cheung M.W.-L., and Au K. Applications of multilevel structural equation modeling to cross-cultural research. Structural Equation Modeling 12 (2005) 598-619
28. Cheung M.W.-L., Leung K., and Au K. Evaluating multilevel models in cross-cultural research: An illustration with social axioms. Journal of Cross-Cultural Psychology 37 (2006) 522-541
29. Church A.T., and Lonner W.J. The cross-cultural perspective in the study of personality. Journal of Cross-Cultural Psychology 29 (1998) 32-62
30. Clauser B.E., and Mazor K.M. Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice 17 (1998) 31-44
31. Coyne, I., & Bartram, D. (Eds.). (2006). ITC guidelines on computer-based and internet-delivered testing [Special issue]. International Journal of Testing, 6(2).
32. Cronbach L.J. Essentials of psychological testing. 5th ed. (1990), Harper Row, New York
33. Embretson S.E., and Reise S.P. Item response theory for psychologists (2000), Erlbaum, Mahwah, NJ
34. Faucheux C. Cross-cultural research in experimental social psychology. European Journal of Social Psychology 6 (1976) 269-322
35. Geisinger K.F. Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment 6 (1994) 304-312
36. Hambleton R., Merenda P., and Spielberger C. Adapting educational and psychological tests for cross-cultural assessment (2005), Erlbaum, Mahwah, NJ
37. Hambleton R.K., Swaminathan H., and Rogers H.J. Fundamentals of item response theory (1991), Sage, Newbury Park, CA
38. Hofstede G. Culture's consequences. 2nd ed. (2001), Sage, Thousand Oaks, CA
39. Holland P.W., and Wainer H. Differential item functioning (1993), Erlbaum, Hillsdale, NJ
40. Johnson T.P. Approaches to equivalence in cross-cultural and cross-national research. Zuma Nachrichten Spezial 3 (1998) 1-40
41. Julian M.W. The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Structural Equation Modeling 8 (2001) 325-352
42. Koocher G., and Keith-Spiegel P. Ethics in psychology. 3rd ed. (2007), Oxford University Press, New York
43. Leach M., and Oakland T. Ethics standards impacting test development and use: A review of 31 ethics codes impacting practices in 35 countries. International Journal of Testing 7 (2007) 71-88
44. Leung K. Cross-cultural differences: Individual-level vs. culture-level. International Journal of Psychology 24 (1989) 703-719
45. McCrae R.R., and Terracciano A. Universal features of personality traits from the observer's perspective: Data from 50 cultures. Journal of Personality and Social Psychology 88 (2005) 547-561
46. Oakland T. Selected ethical issues relevant to test adaptations. In: Hambleton R.K., Merenda P.F., and Spielberger C.D. (Eds). Adapting educational and psychological tests for cross-cultural assessment (2005), Erlbaum, Mahwah, NJ 65-92
47. Poortinga Y. Use of tests across culture. In: Oakland T., and Hambleton R.K. (Eds). Interpersonal perspectives on academic assessment (1995), Kluwer, Norwell, MA 187-206
48. Rossen E., and Oakland T. Graduate preparation in research methods: The current status of APA-accredited professional programs in psychology. Training and Education in Professional Psychology 2 (2008) 42-49
49. Sam D.L., and Berry J.W. The Cambridge handbook of acculturation psychology (2006), Cambridge University Press, Cambridge, England
50. Sattler J. Clinical and forensic interviewing of children and families (1998), Author, Seattle, WA
51. Schmitt M.J., Kihm J.A., and Robie C. Development of a global measure of personality. Personnel Psychology 53 (2000) 153-193
52. Segall M.H., Lonner W.J., and Berry J.W. Cross-cultural psychology as a scholarly discipline: On the flowering of culture in behavioral research. American Psychologist 53 (1998) 1101-1110
53. Shebani M.F.A., van de Vijver F.J.R., and Poortinga Y.H. Memory development in Libyan and Dutch school children. European Journal of Developmental Psychology 5 (2008) 419-438
54. van de Vijver F.J.R. Toward the next generation of instruments in cross-cultural testing: Recent developments in translations and adaptations (2006, July) Invited address at the ITC Conference on Test Adaptations, Brussels, Belgium
55. van de Vijver F.J.R., and Leung K. Methods and data analysis for cross-cultural research (1997), Sage, Thousand Oaks, CA
56. van de Vijver F.J.R., and Leung K. Methodological issues in psychological research on culture. Journal of Cross-Cultural Research 31 (2000) 33-51
57. van de Vijver F.J.R., and Poortinga Y.H. Structural equivalence in multilevel research. Journal of Cross-Cultural Research 33 (2002) 141-156
58. van de Vijver F.J.R., and Poortinga Y.H. Conceptual and methodological issues in adapting tests. In: Hambleton R.K., Merenda P.F., and Spielberger C.D. (Eds). Adapting educational and psychological tests for cross-cultural assessment (2005), Erlbaum, Mahwah, NJ
59. van de Vijver F.J.R., and Tanzer N.K. Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology 47 (1997) 263-279
60. van de Vijver F.J.R., van Hemert D.A., and Poortinga Y.H. Conceptual issues in multilevel models. In: van de Vijver F.J.R., Hermert D.A., and Poortinga Y.H. (Eds). Multilevel analysis of individuals and cultures (2008), Erlbaum, Mahwah, NJ
61. van de Vijver F.J.R., and Watkins D. Assessing similarity of meaning at the individual and country level: An investigation of a measure of independent and interdependent self. European Journal of Psychological Assessment 22 (2006) 69-77