Developing equivalent Chinese and English scale-point labels for rating scales used in survey research

Asian Journal of Social Psychology

Volumn 14, Issue 2, 2011, Pages 91-111

  Au, Wing tung ^a   Rohrmann, Bernd ^b   Taylor, Paul ^c   Ho, Jane Ming chun ^a   Yeung, Siu wai ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b Venture 'Roman Research Road'   (Australia)

^c UNIVERSITY OF WAIKATO   (New Zealand)

Author keywords

Agreement; Frequency; Intensity rating scale; Scale point label

Indexed keywords

EID: 79955782461     PISSN: 13672223     EISSN: 1467839X     Source Type: Journal    
DOI: 10.1111/j.1467-839X.2010.01333.x     Document Type: Article

References (59)

1. Aiken, L. R. (1997). Questionnaires and Inventories: Surveying Opinions and Assessing Personality. Chichester: Wiley.
2. Auer, S., Hampel, H., Moeller, H.-J. & Reisberg, B. (2000). Translations of measurements and scales: Opportunities and diversities. International Psychogeriatrics, 12 (Suppl. 1), 391-394.
3. Babbie, E. (1989). The Practice of Social Research. Belmont, CA: Wadsworth.
4. Bonnefon, J. F., Feeney, A. & Villejoubert, G. (2009). When some is actually all: Scalar inferences in face-threateningcontexts. Cognition, 112 (2), 249-258.
5. Budescu, D. V., Broomell, S. & Por, H. H. (2009). Improving communication of uncertainty in the reports of the Intergovernmental Panel on Climate Change. Psychological Science, 20 (3), 299-308.
6. Budescu, D. V. & Wallsten, T. S. (1985). Consistency in interpretation of probabilistic phrases. Organizational Behavior and Human Decision Processes, 36, 391-405.
7. Budescu, D. V. & Wallsten, T. S. (1994). Processing linguistic probabilities: General principles and empirical evidence. In: J. R. Busemeyer, R. Hastie & D. L. Medin, eds. Decision Making from the Perspective of Cognitive Psychology, pp. 275-318. New York: Academic Press.
8. Budescu, D. V., Weinberg, S. & Wallsten, T. S. (1988). Decisions based on numerically and verbally expressed uncertainties. Journal of Experimental Psychology. Human Perception and Performance, 14, 281-294.
9. Clarke, V. A., Ruffin, C. L., Hill, D. J., & Beamen, A. L. (1992). Ratings of orally presented verbal expressions of probability by a heterogeneous sample. Journal of Applied Social Psychology, 22, 638-657.
10. Chen, C., Lee, S. & Stevenson, H. W. (1995). Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Science, 6, 170-175.
11. Chun, K. T., Campbell, J. B. & Yoo, J. H. (1974). Extreme response style in cross-cultural research. Journal of Cross-Cultural Psychology, 5, 465-479.
12. Cohn, L. D., Vázquez, M. E. C. & Alvarez, A. (2009). Quantifying risk: Verbal probability expressions in Spanish and English. American Journal of Health Behaviour, 33 (3), 244-255.
13. Crystal, D. (2003). English as a Global Language. Cambridge, UK: Cambridge University Press.
14. Diefenbach, M. A., Weinstein, N. D. & O'Reilly, J. (1993). Scales for assessing perceptions of health hazard susceptibility. Health Education Research, 8, 181-192.
15. Dillman, D. (2007). Mail and Internet Surveys: The Tailored Design Method, (2nd edn, updated). New Jersey: John Wiley & Sons.
16. Felscher-Suhr, U., Guski, R. & Schuemer, R. (1998). Entwicklung einer international vergleichbaren belästigungsskala [Development of an internationally comparable annoyance scale]. DAGA Zurich (1998), pp. 80-81 (in German).
17. Felscher-Suhr, U., Guski, R. & Schuemer, R. (1998). Some results of an international scaling study and their implications for noise research. In: N. Carter & R. F. S. Job, eds. 7th International Congress on Noise as a Public Health Problem, pp. 733-737. Sydney: Noise Effects.
18. Fields, J. M., De Jong, R. G., Gjestland, T., Flindell, I. H., Job, R. F. S., Kurra, S., etal. (2001). Standardized general-purpose noise reaction questions for community noise surveys: Research and recommendation. Journal of Sound and Vibration, 242 (4), 641-679.
19. Foddy, W. (1992). Constructing Questions for Interviews and Questionnaires: Theory and Practice in Social Research. Cambridge: Cambridge University Press.
20. IELTS (2009). Overall and individual band scores achieved by 2008 academic and general training candidates according to their place of origin. [Cited 20 Oct 2010.] Available from URL.
21. Johnson, E. M. (1973). Numerical Encoding of Qualitative Expressions of Uncertainty (Technical Rep. No. 250). U.S. Army Research Institute for the Behavioral & Social Sciences. Arlington, VA: Author.
22. Karelitz, T. M. & Budescu, D. V. (2004). You say 'probable' and I say 'likely': Improving interpersonal communication with verbal probability phrases. Journal of Experimental Psychology: Applied, 10, 25-41.
23. Kerlinger, F. N. & Lee, H. B. (2000). Foundations of Behavioural Research. Fort Worth: Harcourt College.
24. Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50, 537-567.
25. Krosnick, J. A. & Fabrigar, L. R. (1997). Designing rating scales for effective measurement in surveys. In: L. Lyberg, P. Biemer, M. Collins, E. deLeeuw, C. Dippo, N. Schwarz, etal., eds. Survey Measurement and Process Quality, pp. 141-164. New York: Wiley.
26. Lau, L. Y. & Ranyard, R. (1999). Chinese and English speakers' linguistic expression of probability and probabilistic thinking. Journal of Cross-Cultural Psychology, 30, 411-421.
27. Levine, T. R. (1994). Do individuals make interval/ratio level responses to magnitude scaled items? Journal of Social Behavior and Personality, 9, 377-338.
28. Lodge, M. & Tursky, B. (1979). Comparison between category and magnitude scaling of political opinion employing SRC/CPS items. American Political Science Review, 73, 50-66.
29. Miller, D. C. (1991). Handbook of Research Design and Social Measurement. London: Sage.
30. Moxey, L. M. & Sanford, A. J. (1993). Communicating Quantities: A Psychological Perspective. Hillsdale: Erlbaum.
31. Mullet, E. & Rivet, I. (1991). Comprehension of verbal probability expressions in children and adolescents. Language & Communication, 11, 217-225.
32. Myers, K. & Winters, N. C. (2002). Ten-year review of rating scales. I: Overview of scale functioning, psychometric properties and selection. Journal of the American Academy of Child and Adolescent Psychiatry, 41, 114-122.
33. Oppenheim, A. N. (1992). Questionnaire Design, Interviewing and Attitude Measurement. New York: Basic Books.
34. Presser, S. & Blair, J. (1994). Survey pretesting: Do different methods produce different results? Sociological Methodology, 24, 73-104.
35. Purdy, S. C. & Pavlovic, C. V. (1992). Reliability, sensitivity and validity of magnitude estimation, category scaling and paired-comparison judgments of speech intelligibility by older listeners. Audiology, 31, 254-271.
36. Reagan, R., Mosteller, F. & Youtz, C. (1989). Quantitative meanings of verbal probability expressions. Journal of Applied Psychology, 74, 433-442.
37. Reid, R. (1995). Assessment of ADHD with culturally different groups: The use of behavioral rating scales. School Psychology Review, 24, 537-560.
38. Renooija, S. & Witteman, C. (1999). Talking probabilities: Communicating probabilistic information with words and numbers. International Journal of Approximate Reasoning, 22, 169-194.
39. Rohrmann, B. (1978). Empirische Studien zur Entwicklung von Antwortskalen fuer die sozialwissenschaftliche Forschung [Empirical studies to develop standardized rating scales for the social sciences]. Zeitschrift fuer Sozialpsychologie, 222-245 (in German).
40. Rohrmann, B. (1998). The use of verbal scale point labels in annoyance scales. In: C. Norman & S. R. F. Job, eds. 7th International Congress on Noise as a Public Health Problem, vol. 2, pp. 523-527. Sydney: Noise Effects.
41. Rohrmann, B. (2006). Verbal qualifiers for rating scales: Sociolinguistic considerations and psychometric data. Available on website. [Cited 17 May 2008.] Available from URL.
42. Rohrmann, B., Au, W. & Taylor, P. (2010). Verbal qualifiers for rating scales: Cross-cultural study in Hong Kong. [Cited 3 May 2010.] Available from URL.
43. Sapsford, R. (2007). Survey Research. London: Sage.
44. Schaeffer, N. C. & Bradburn, N. M. (1989). Respondent behavior in magnitude estimation. Journal of the American Statistical Association, 84, 402-413.
45. Schuman, H. (1996). Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context. Newbury Park: Sage.
46. Schwarz, N., Knauper, B., Hippler, H.-J., Noelle-Neumann, E. & Clark, L. (1991). Rating scales: Numeric values may change the meaning of scale labels. Public Opinion Quarterly, 55, 570-582.
47. Theil, M. (2002). The role of translations of verbal into numerical probability expressions in risk management: A meta analysis. Journal of Risk Research, 5, 177-186.
48. Van de Vijver, F. (2001). The evolution of cross-cultural research methods. In: D. Matsumoto, ed. The Handbook of Culture and Psychology, pp. 77-97. New York: Oxford University Press.
49. Van de Vijver, A. & Leung, K. (1997). Methods and Data Analysis for Cross-Cultural Research. Thousand Oaks: Sage.
50. Vaus, D. A. (2002). Surveys in Social Research, 5th edn. London: Unwin.
51. Wegener, B. (1983). Category-rating and magnitude estimation scaling techniques: An empirical comparison. Sociological Methods & Research, 12, 31-75.
52. Weinfurt, K. P. & Moghaddam, F. M. (2001). Culture and social distance: A case study of methodological cautions. Journal of Social Psychology, 141, 101-110.
53. Weng, L. J. (1998). Scale values on anchor labels in Chinese rating scales: Responses on frequency and agreement. Chinese Journal of Psychology, 40, 73-86.
54. Wills, C. E. & Moore, C. F. (1994). A controversy in scaling of subjective states: Magnitude estimation versus category rating methods. Research in Nursing & Health, 17, 231-237.
55. Windschitl, P. D. & Wells, G. L. (1996). Measuring psychological uncertainty: Verbal versus numeric methods. Journal of Experimental Psychology. Applied, 2, 343-364.
56. Wright, D. B., Gaskell, G. D. & O'Muircheartaigh, C. A. (1994). How much is 'quite a bit'? Mapping between numerical values and vague quantifiers. Applied Cognitive Psychology, 8, 479-496.
57. Xu, J. H. & Li, S. (2007). An exploratory research on the numerical translation of Chinese verbal probabilistic expression. Chinese Journal of Ergonomics, 12, 15-19.
58. [Xing, F. Y. & [Wang, G. S.] (2003). [Xian dai Han yu]. [Wuhan: Central China Normal University Press].
59. [Zhuang, J. Y.] (2002). [Han yu xu ci xue xi shou ce]A Student Handbook for Chinese Function Words. Hong Kong: The Chinese University Press.