Designing scalar questions for web srveys

Sociological Methods and Research

Volumn 37, Issue 3, 2009, Pages 393-425

  Christian, Leah Melani ^a   Parsons, Nicholas L ^b   Dillman, Don A ^c  

^a Pew Research Center for the People and the Press   (United States)

^b EASTERN CONNECTICUT STATE UNIVERSITY   (United States)

^c WASHINGTON STATE UNIVERSITY   (United States)

Author keywords

Measurement; Scalar questions; Visual design; Web surveys

Indexed keywords

EID: 59949098778     PISSN: 00491241     EISSN: 15528294     Source Type: Journal    
DOI: 10.1177/0049124108330004     Document Type: Article

References (36)

1. Christian, L.M. 2007. "How Mixed-Mode Surveys Are Transforming Social Research: The Influence of Survey Mode on Measurement in Web and Telephone Surveys." PhD dissertation, Washington State University, Pullman, WA.
2. Christian, Leah M. and Don A. Dillman. 2004. " The Influence of Symbolic and Graphical Language Manipulations on Answers to Paper Self-Administered Questionnaires." Public Opinion Quarterly 68: 57-80.
3. Christian, Leah Melani, Don A. Dillman, and Jolene D. Smyth. 2007 a. " The Effects of Mode and Format on Answers to Scalar Questions in Telephone and Web Surveys." Pp. 250-75 in Advances in Telephone Survey Methodology, edited by James M. Lepkowski, Clyde Tucker, J. Michael Brick, Edith de Leeuw, Lilli Japec, Paul. J. Lavrakas, Michael W. Link, and Roberta L. Sangster. New York: John Wiley.
4. - -. 2007 b. "Helping Respondents Get It Right the First Time: The Influence of Words, Symbols, and Graphics in Web Surveys. " Public Opinion Quarterly 71: 113-25.
5. Couper, Mick P. 2005. " Technology Trends in Survey Data Collection." Social Science Computer Review 23: 486-501.
6. Couper, Mick P., Roger Tourangeau, Fred G. Conrad, and Scott D. Crawford. 2004. " What They See Is What We Get: Response Options for Web Surveys." Social Science Computer Review 22: 111-27.
7. Couper, Mick P., Roger Tourangeau, Fred G. Conrad, and Eleanor Singer. 2006. " Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment." Social Science Computer Review 24: 227-45.
8. Dillman, Don A., Tommy L. Brown, John Carlson, Edwin H. Carpenter, Frederick O. Lorenz, Robert Mason, John Saltiel, and Roberta L. Sangster. 1995. " Effects of Category Order on Answers to Mail and Telephone Surveys." Rural Sociology 60: 674-87.
9. Dillman, Don A., Glenn Phelps, Robert Tortora, Karen Swift, Julie Kohrell, Jodi Berck, and Benjamin L. Messer. Forthcoming. " Response Rate and Measurement Differences in Mixed Mode Surveys Using Mail, Telephone, Interactive Voice Response (IVR) and the Internet." Social Science Research.
10. Dillman, Don A., Roberta L. Sangster, John Tarnai, and Todd Rockwood. 1996. " Understanding Differences in People's Answers to Telephone and Mail Surveys." Pp. 45-62 in Current Issues in Survey Research, edited by Marc T. Braverman and Jana Kay Slater. San Francisco: Jossey-Bass.
11. Dillman, Don A., Jolene D. Smyth, and Leah Melani Christian. 2009. Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method. 3 rd ed. New York: John Wiley.
12. Fuchs, Marek. 2008. " Gender of Interviewer Effects in Video-Enhanced Web Surveys: Results From a Randomized Field-Experiment." Presented at the Annual General Online Research Conference, Hamburg, Germany.
13. Heerwegh, Dirk. 2003. "Explaining Response Latency and Changing Answers Using Client Side Paradata From a Web Survey. " Social Science Computer Review 21: 360-73.
14. Heerwegh, Dirk and G. Loosveldt. 2002. "An Evaluation of the Effects of Response Formats on Data Quality in Web Surveys. " Social Science Computer Review 20: 469-82.
15. Israel, Glen D. and C.L. Taylor. 1990. " Can Response Order Bias Evaluations? " Evaluation and Program Planning 13: 1-7.
16. Jenkins, Cleo and Don A. Dillman. 1997. "Towards a Theory of Self-Administered Questionnaire Design." Pp. 165-96 in Survey Measurement and Process Quality, edited by Lars E. Lyberg, Paul Biemer, Martin Collins, Edith D. de Leeuw, Cathryn Dippo, Norbert Schwarz, and Dennis Trewin. New York: Wiley InterScience.
17. Johnson, Martin. 2004. "Timepieces: Components of Survey Question Response Latencies. " Political Psychology 25: 679-702.
18. Krosnick, Jon A. and Duane F. Alwin. 1987. " An Evaluation of a Cognitive Theory of Response Order Effects in Survey Measurement." Public Opinion Quarterly 51: 201-19.
19. Krosnick, Jon A. and L.R. Fabrigar. 1997. " Designing Rating Scales for Effective Measurement in Surveys." Pp. 141-64 in Survey Measurement and Process Quality, edited by Lars E. Lyberg, Paul Biemer, Martin Collins, Edith D. de Leeuw, Cathryn Dippo, Norbert Schwarz, and Dennis Trewin. New York: Wiley InterScience.
20. Krysan, Maria and Mick P. Couper. 2003. " Race in the Live and Virtual Interviewer: Racial Deference, Social Desirability, and Activation Effects in Attitude Surveys." Social Psychology Quarterly 66: 364-83.
21. Mahon-Haft, Taj and Don A. Dillman. 2007. "Isolating Primacy-Inducing Conditions in Web Surveys. 2007." Presented at the American Association for Public Opinion Research Annual Conference, Anaheim, CA.
22. Redline, Cleo and Don A. Dillman. 2002. " The Influence of Alternative Visual Designs on Respondents' Performance With Branching Instructions in Self-Administered Questionnaires." Pp. 179-93 in Survey Nonresponse, edited by Robert M. Groves, Don A. Dillman, John L. Eltinge, and Roderick J. A. Little. New York: John Wiley.
23. Redline, Cleo, Don A. Dillman, Aref N. Dajani, and Mary Ann Scaggs. 2003. " Improving Navigational Performance in U.S. Census 2000 by Altering the Visually Administered Languages of Branching Instructions." Journal of Official Statistics 19: 403-20.
24. Schober, Michael F. and Fred G. Conrad. 2007. "Dialogue Capability and Perceptual Realism in Survey Interviewing Agents." Presented at the annual meeting of the American Association for Public Opinion Research, Montreal, Canada.
25. Schwarz, Norbert. 1996. Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation. Mahwah, NJ: Lawrence Erlbaum.
26. Schwarz, Norbert, C.E. Grayson, and B. Knauper. 1998. " Formal Features of Rating Scales and the Interpretation of Question Meaning." International Journal of Public Opinion Research 10: 177-83.
27. Schwarz, Norbert, B. Knauper, H.J. Hippler, E. Noelle-Neumann, and F. Clark. 1991. " Rating Scales: Numeric Values May Change the Meaning of Scale Labels." Public Opinion Quarterly 55: 570-82.
28. Smith, Tom W. 1995. " Little Things Matter: A Sample of How Differences in Questionnaire Format Can Affect Survey Responses." Presented at the American Association for Public Opinion Research Annual Conference, Ft. Lauderdale, FL.
29. Smyth, Jolene D., Don A. Dillman, Leah Melani Christian, and Michael J. Stern. 2006. " Comparing Check-All and Forced-Choice Question Formats in Web Surveys." Public Opinion Quarterly 70: 66-77.
30. Stern, Michael J. 2008. " The Use of Client Side Paradata in Analyzing the Effects of Visual Layout on Changing Responses in Web Surveys." Field Methods 20: 377-98.
31. Stern, Michael J., Don A. Dillman, and Jolene D. Smyth. 2007. " Visual Design, Order Effects, and Respondent Characteristics in a Self-Administered Survey." Survey Research Methods 1: 121-38.
32. Thomas, Randall K. and Mick P. Couper. 2007. " A Comparison of Visual Analog and Graphic Ratings Scales." Presented at the General Online Research Conference, Leipzig, Germany.
33. Toepoel, Vera. 2008. A Closer Look at Web Questionnaire Design. The Netherlands Dissertation Series, Center for Economic Research, Tilburg University.
34. Tourangeau, Roger, Mick P. Couper, and Fred G. Conrad. 2004. " Spacing, Position, and Order. Interpretive Heuristics for Visual Features of Survey Questions." Public Opinion Quarterly 68: 368-93.
35. - -. 2007. "Color, Labels, and Interpretive Heuristics for Response Scales. " Public Opinion Quarterly 71: 91-112.
36. Ware, Colin. 2004. Information Visualization: Perception for Design. San Francisco: Morgan Kaufmann.