Asking Good Survey Questions

Journal of Travel Research

Volumn 52, Issue 5, 2013, Pages 551-574

  Dolnicar, Sara ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

BIT; DLF IIST; Likert scale; measurement; questionnaire design; scale development; survey questions; survey research

Indexed keywords

QUESTIONNAIRE SURVEY; RESEARCH; SURVEY DESIGN; TOURISM;

EID: 84880979517     PISSN: 00472875     EISSN: 15526763     Source Type: Journal    
DOI: 10.1177/0047287513479842     Document Type: Article

References (104)

1. Aaker D. A.Managing Brand Equity: Capitalizing on the Value of the Brand Name. New York: Free Press; 1991:.
2. Albaum G.The Likert Scale Revisited: An Alternative Version.Journal of the Market Research Society. 1997;39 (2): 331-48.
3. Albaum G.,Roster C.,Yu J. H.,Rogers R. D.Simple Rating Scale Formats.International Journal of Market Research. 2007;49 (5): 633-50.
4. Bagozzi R. P.Measurement and Meaning in Information Systems and Organizational Research: Methodological and Philosophical Foundations.MIS Quarterly. 2011;35 (2): 261-92.
5. Bednell D. H. B.,Shaw M.Changing Response Rates in Australian Market Research.Australasian Journal of Market Research. 2003;11 (1): 31-41.
6. Bendig A. W.Reliability and the Number of Rating Scale Categories.Journal of Applied Psychology. 1954;38 (1): 38-40.
7. Bergkvist L.,Rossiter J. R.The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs.Journal of Marketing Research. 2007;44 (2): 175-84.
8. Bergkvist L.,Rossiter J. R.Tailor-Made Single-Item Measures of Doubly Concrete Constructs.International Journal of Advertising. 2009;28 (4): 607-21.
9. Bojanic D. C.,Warnick R. B.The Role of Purchase Decision Involvement in a Special Event.Journal of Travel Research. 2012;51 (3): 357-66.
10. Cantril H.Gauging Public Opinion. Princeton, NJ: Princeton University Press; 1940:.
11. Chang L.A Psychometric Evaluation of Four-Point and Six-Point Likert-Type Scales in Relation to Reliability and Validity.Applied Psychological Measurement. 1994;18:205-215.
12. Choi S.,Lehto X. Y.,Morrison A. M.,Jang S.Structure of Travel Planning Processes and Information Use Patterns.Journal of Travel Research. 2012;51 (1): 26-40.
13. Churchill G. A.A Paradigm for Developing Better Measures of Marketing Constructs.Journal of Marketing Research. 1979;16:64-73.
14. Churchill G. A.Paul D. Converse Symposium. Hess James D.Monroe Kent B., ed. Chicago: American Marketing Association; 1998:25-41.
15. Converse J. M.,Presser S.Sage series on Quantitative Applications in the Social Sciences, Number 63. Newbury Park: Sage; 1986:.
16. Cronbach L. J.Further Evidence on Response Sets and Test Design.Educational and Psychological Measurement. 1950;10:3-31.
17. Cunningham W. H.,Cunningham I. C. M.,Green R. T.The Ipsative Process to Reduce Response Set Bias.Public Opinion Quarterly. 1977;41 (3): 379-84.
18. Dall'Olmo Riley F.,Ehrenberg A. S. C.,Castleberry S. B.,Barwise T. P.,Barnard N. R.The Variability of Attitudinal Repeat-Rates.International Journal of Research in Marketing. 1997;14 (5): 437-50.
19. Delavande A.,Rohwedder S.Eliciting Subjective Probabilities in Internet Surveys.Public Opinion Quarterly. 2008;72 (5): 866-91.
20. Dolnicar S.Simplifying Three-Way Questionnaires-Do the Advantages of Binary Answer Categories Compensate for the Loss of Information?. ANZMAC CD Proceedings; 2003; 2003.
21. Dolnicar S.,Grün B.Validly Measuring Destination Image in Survey Studies.Journal of Travel Research. 2013;52 (1): 3-12.
22. Dolnicar S.,Grün B.How Constrained a Response: A Comparison of Binary, Ordinal and Metric Answer Formats.Journal of Retailing and Consumer Services. 2007a;14:108-22.
23. Dolnicar S.,Grün B.User-Friendliness of Answer Formats-An Empirical Comparison.Australasian Journal of Market & Social Research. 2007b;15 (1): 19-28.
24. Dolnicar S.,Grün B.Assessing Analytical Robustness in Cross-Cultural Comparisons.International Journal of Tourism, Culture, and Hospitality Research. 2007c;1 (2): 140-60.
25. Dolnicar S.,Grün B.Question Stability in Brand Image Measurement-Comparing Alternative Answer Formats and Accounting for Heterogeneity in Descriptive Models.Australasian Marketing Journal. 2007d;15 (2): 26-41.
26. Dolnicar S.,Grün B.Does One Size Fit All? The Suitability of Answer Formats for Different Constructs Measured.Australasian Marketing Journal. 2009;17 (1): 58-64.
27. Dolnicar S.,Grün B.Including Don't Know Answer Options in Brand Image Surveys Improves Data Quality.International Journal of Market Research. Forthcoming;:.
28. Dolnicar S.,Grün B.,Leisch F.Quick, Simple and Reliable: Forced Binary Survey Questions.International Journal of Market Research. 2011;53 (2): 231-52.
29. Dolnicar S.,Laesser C.,Matus K.Online Versus Paper-Format Effects in Tourism Surveys.Journal of Travel Research. 2009;47 (3): 295-316.
30. Dolnicar S.,Rossiter J. R.The Low Stability of Brand-Attribute Associations Is Partly Due to Measurement Factors.International Journal of Research in Marketing. 2008;25 (2): 104-8.
31. Dolnicar S.,Grün B.,Yanamandram V.New Ways of Asking Survey Questions-More Fun, More Valid Data.Journal of Travel & Tourism Marketing. Forthcoming;:.
32. Dolnicar S.,Rossiter J. R.,Grün B.Pick-Any Measures Contaminate Brand Image Studies.International Journal of Market Research. 2012;54 (6): 821-34.
33. Driesener C.,Romaniuk J.Comparing Methods of Brand Image Measurement International Journal of Market Research. 2006;48 (6): 681-98.
34. Drolet A. L.,Morrison D. G.Do We Really Need Multiple-Item Measures in Service Research?.Journal of Service Research. 2001;3 (3): 196-204.
35. Finn R. H.Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings.Educational and Psychological Measurement. 1972;32 (2): 255-65.
36. Garland R.The Mid-Point on a Rating Scale: Is It Desirable?.Marketing Bulletin. 1991;2:66-70.
37. Gilljam M.,Granberg D.Should We Take Don't Know for an Answer?.Public Opinion Quarterly. 1993;57:348-57.
38. Grassi M.,Nucera A.,Zanolin E.,Omenaas E.,Anto J. M.,Leynaert B.Performance Comparison of Likert and Binary Formats of SF-36 Version 1.6 across ECRHS II Adult Populations.Value in Health. 2007;10 (6): 478-88.
39. Green P. E.,Rao V. R.Rating Scales and Information Recovery-How Many Scales and Response Categories to Use?.Journal of Marketing. 1970;34:33-39.
40. Greenleaf E. A.Improving Rating-Scale Measures by Detecting and Correcting Bias Components in Some Response Styles.Journal of Marketing Research. 1992a;29 (2): 176-88.
41. Greenleaf E. A.Measuring Extreme Response Style.Public Opinion Quarterly. 1992b;56 (3): 328-51.
42. Hancock G. R.,Klockars A. J.The Effect of Scale Manipulations on Validity: Targeting Frequency Rating Scales for Anticipated Performance Levels.Applied Ergonomics. 1991;22 (3): 147-54.
43. Hardie T.,Kosomitis N.The F Word in Market Research: High Impact Public Relations in the 21st Century. CD Proceedings from the AMSRS Conference 2005: Impact; 2005Sydney: Australian Market & Social Research Society; 2005.
44. Hawkins D. I.,Coney K. A.Uninformed Response Error in Survey Research.Journal of Marketing Research. 1981;18 (3): 370-74.
45. Heide M.,Gronhaug K.The Impact of Response Styles in Surveys: A Stimulation Study.Journal of the Market Research Society. 1992;34 (3): 215-30.
46. Hippler H. J.,Schwarz N.'No Opinion'-Filters: A Cognitive Perspective.International Journal of Public Opinion Research. 1989;1 (1): 77-87.
47. Horng J.-S.,Liu C.-H.,Chou H.-Y.,Tsai C.-Y.Understanding the Impact of Culinary Brand Equity and Destination Familiarity on Travel Intentions.Tourism Management. 2012;33 (4): 815-24.
48. Hsu C. H. C.,Oh H.,Assaf A. G.A Customer-Based Brand Equity Model for Upscale Hotels.Journal of Travel Research. 2012;51 (1): 81-93.
49. Jacoby J.Consumer Research: How Valid and Useful Are All Our Consumer Behaviour Research Findings? A State of the Art Review.Journal of Marketing. 1978;42 (2): 87-95.
50. Jacoby J.,Matell M. S.Three-Point Likert Scales Are Good Enough.Journal of Marketing Research. 1971;8:495-500.
51. Johnson M. D.,Lehmann D. R.,Horne D. R.The Effects of Fatigue on Judgments of Interproduct Similarity.International Journal of Research in Marketing. 1990;7 (1): 35-43.
52. Jones R. R. Proceedings of the 76th Annual Convention of the American Psychological Association; 1968; 1968. 247.
53. Kahane H.Logic and Philosophy: A Modern Introduction. 1982). Logic and Philosophy: A Modern Introduction. 4th edition.Belmont, CA: Wadsworth.Belmont, CA: Wadsworth; 1982:.
54. Kampen J.,Swyngedouw M.The Ordinal Controversy Revisited.Quality and Quantity. 2000;34 (1): 87-102.
55. Kollat D. T.,Blackwell R. D.,Engel J. E.Proceedings of the 3rd Annual Conference of the Association of Consumer Research. Venkatesan M., ed. 1972:576-84.
56. Komorita S. S.Attitude Content, Intensity, and the Neutral Point on a Likert Scale.Journal of Social Psychology. 1963;61:327-34.
57. Komorita S. S.,Graham W. K.Number of Scale Points and the Reliability of Scales.Educational and Psychological Measurement. 1965;25 (4): 987-95.
58. Krosnick J. A.Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys.Applied Cognitive Psychology. 1991;5:213-36.
59. Krosnick J. A.Survey Research.Annual Review of Psychology. 1999;50:537-67.
60. Krosnick J. A.,Berent M. K.Comparisons of Party Identification and Policy Preferences: The Impact of Survey Question Format.American Journal of Political Science. 1993;37 (3): 941-64.
61. Lee J. A.,Soutar G. N.,Louviere J.,Daly T. M.An Examination of the Relationship between Values and Holiday Benefits across Cultures Using Ratings Scales and Best-Worst Scaling. ANZMAC CD Proceedings; 2006; 2006.
62. Lehmann D. R.,Hulbert J.Are Three Point Scales Always Good Enough?.Journal of Marketing Research. 1972;9 (4): 444-46.
63. Likert R.A Technique for the Measurement of Attitudes.Archives of Psychology. 1932;36 (2): 44-53.
64. Loken B.,Pirie P.,Virnig K. A.,Hinkle R. L.,Salmon C. T.The Use of 0-10 Scales in Telephone Surveys.Journal of the Market Research Society. 1987;29 (3): 353-62.
65. Martin W. S.The Effects of Scaling on the Correlation Coefficient: A Test of Validity.Journal of Marketing Research. 1973;10 (3): 316-18.
66. Martin W. S.Effects of Scaling on the Correlation Coefficient: Additional Considerations.Journal of Marketing Research. 1978;15 (2): 304-8.
67. Martin W. S.,Fruchter B.,Mathis W. J.An Investigation of the Effect of the Number of Scale Intervals on Principal Components Factor Analysis.Educational and Psychological Measurement. 1974;34:537-45.
68. Matell M. S.,Jacoby J.Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity.Educational and Psychological Measurement. 1971;31:657-74.
69. Nam J.,Ekinci Yuksel,Whyatt G.Brand Equity, Brand Loyalty and Consumer Satisfaction.Annals of Tourism Research. 2011;38 (3): 1009-30.
70. Nunnally J. C.Psychometric Theory. New York: McGraw-Hill; 1967:.
71. Nunnally J. C.Psychometric Theory. 1978). Psychometric Theory. 3rd edition.New York: McGraw-Hill.New York: McGraw-Hill; 1978:.
72. Nunnally J. C.Introduction to Psychological Measurement. New York: McGraw-Hill; 1970:.
73. Oaster T. R. F.Number of Alternatives per Choice Point and Stability of Likert-Type Scales.Perceptual and Motor Skills. 1989;68:549-50.
74. Oliver R. L.Whence Consumer Loyalty?.Journal of Marketing. 1999;63:33-44.
75. Paulhus D. L.Measures of Personality and Social Psychological Attitudes. Robinson J. P.Shaver P. R.Wrightsman L. S., ed. San Diego: Academic Press; 1991:17-59.
76. Payne S. L.The Art of Asking Questions. 1980). The Art of Asking Questions, 13th edition. Princeton: Princeton University Press.Princeton: Princeton University Press; 1980:.
77. Peabody D.Two Components in Bipolar Scales: Direction and Extremeness.Psychological Review. 1962;69 (2): 65-73.
78. Percy L.Advances in Consumer Research. Anderson B., ed. Ann Arbor, MI: Association for Consumer Research; 1976:143-48.
79. Peters D. L.,McCormick E. J.Comparative Reliability of Numerically Anchored versus Job-Task Anchored Rating Scales.Journal of Applied Psychology. 1966;50 (1): 92-96.
80. Poe G. S.,Seeman I.,McLaughlin J.,Mehl E.,Dietz M.Don't Know Boxes in Factual Questions in a Mail Questionnaire.Public Opinion Quarterly. 1988;52:212-22.
81. Poynter R.The Handbook of Online and Social Media Research. Tools and Techniques for Market Researchers. Chichester, UK: Wiley; 2010:.
82. Prayag G.,Ryan C.Antecedents of Tourists' loyalty to Mauritius: the role and influence of destination image, place attachment, personal involvement and satisfaction.Journal of Travel Research. 2012;51 (3): 342-356.
83. Preston C. C.,Colman A. M.Optimal Number of Response Categories in Rating Scales: Reliability, Validity, Discriminating Power, and Respondent Preferences.Acta Psychologica. 2000;104:1-15.
84. Puleston J.,Sleep D.Measuring the Value of Respondent Engagement: Innovative Techniques to Improve Panel Quality. ESOMAR Congress; 2008 2008; 2008 2008.
85. Rapoport R. B.Sex Differences in Attitude Expression: A Generational Explanation.Public Opinion Quarterly. 1982;46:86-96.
86. Reid J.,Morden M.,Reid A.Maximizing Respondents Engagement. Proceedings of the ESOMAR Congress 2007; 2007Amsterdam: Esomar; 2007.
87. Remington M.,Tyrer P. J.,Newson-Smith J.,Cicchetti D. V.Comparative Reliability of Categorical and Analogue Rating Scales in the Assessment of Psychiatric Symptomatology.Psychological Medicine. 1979;9:765-70.
88. Rossiter J. R.The C-OAR-SE Procedure for Scale Development in Marketing.International Journal of Research in Marketing. 2002;19 (4): 305-35.
89. Rossiter J. R.Measurement for the Social Sciences: The C-OAR-SE Method and Why It Must Replace Psychometrics. New York: Springer; 2011:.
90. Rossiter J. R.,Bergkvist L.Tailor-Made Single-Item Measures of Doubly Concrete Constructs.International Journal of Advertising. 2009;28 (4): 607-21.
91. Rossiter J. R.,Dolnicar S.,Grün B.;. Australia: Working Paper, Faculty of Commerce, University of Wollongong; 2010:.
92. Rungie C.,Laurent G.,Dall'Olmo Riley F.,Riley Morrison D. G.,Roy T.Measuring and Modeling the (Limited) Reliability of Free Choice Attitude Questions.International Journal of Research in Marketing. 2005;22 (3): 309-18.
93. Ryan C.,Garland R.The Use of a Specific Non-response Option on Likert-Type Scales.Tourism Management. 1999;20:107-13.
94. Schuman H.,Presser S.Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context. New York: Academic Press; 1981:.
95. Sleep D.,Puleston J."Panel Quality: Leveraging Interactive Techniques to Engage Online Respondents." ARF Convention & Expo; 2009 2009:.
96. Strube S. N.,Zdanowicz Y.,Ryan C.,Tough K. CASRO Panel Conference Miami; 2008; 2008.
97. Symonds P. M.On the Loss of Reliability in Ratings Due to Coarseness of the Scale.Journal of Experimental Psychology. 1924;7:456-61.
98. Van de Vijver F. J. R.,Poortinga Y. H.On the Study of Culture in Developmental Science.Human Development. 2002;45 (4): 246-56.
99. Van der Eijk C.Measuring Agreement in Ordered Rating Scales.Quality & Quantity. 2001;35:325-41.
100. Vriens M.,Wedel M.,Sandor Z.Split-Questionnaire Designs: A New Tool in Survey Design and Panel Management.Marketing Research. 2001;13 (1): 14-19.
101. Watson D.Correcting for Acquiescent Response Bias in the Absence of a Balanced Scale: An Application to Class Consciousness.Sociological Methods & Research. 1992;21 (1): 52-88.
102. Welkenhuysen-Gybels J.,Billiet J.,Cambré B.Adjustment for Acquiescence in the Assessment of the Construct Equivalence of Likert-Type Score Items.Journal of Cross-Cultural Psychology. 2003;34 (6): 702-22.
103. Worcester R. M.,Burns T. R.A Statistical Examination of the Relative Precision of Verbal Scales.Journal of the Market Research Society. 1975;17 (3): 181-97.
104. Yu J. H.,Albaum G.,Swenson M.Is a Central Tendency Error Inherent in the Use of Semantic Differential Scales in Different Cultures?.International Journal of Market Research. 2003;45 (2): 213-28.