Designing input fields for non-narrative open-ended responses in web surveys

Journal of Official Statistics

Volumn 27, Issue 1, 2011, Pages 65-85

  Couper, Mick P ^a   Kennedy, Courtney ^b   Conrad, Frederick G ^a   Tourangeau, Roger ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b Abt SRBI   (United States)

Author keywords

Currency questions; Date questions; Input field design; Open ended responses; Web surveys

Indexed keywords

EID: 79953134753     PISSN: 0282423X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (34)

1. Burton, S. and Blair, E. (1991). Task Conditions, Response Formulations Processes, and Response Accuracy for Behavioral Frequency Questions in Surveys. Public Opinion Quarterly, 55, 50-79.
2. Callegaro, M. and DiSogra, C. (2008). Computing Response Metrics for Online Panels. Public Opinion Quarterly, 72, 1008-1032.
3. Christian, L.M. and Dillman, D.A. (2004). The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions. Public Opinion Quarterly, 68, 57-80.
4. Christian, L.M., Dillman, D.A., and Smyth, J.D. (2007). Helping Respondents Get it Right the First Time: The Influence of Words, Symbols, and Graphics in Web Surveys. Public Opinion Quarterly, 71, 113-125.
5. Conrad, F.G., Brown, N.R., and Cashman, E.R. (1998). Strategies for Estimating Behavioral Frequency in Survey Interviews. Memory, 6, 339-366.
6. Couper, M.P. (2008). Technology and the Survey Interview/Questionnaire. In Envisioning the Survey Interview of the Future, M.F. Schober and F.G. Conrad (eds). New York: Wiley, 58-76.
7. Couper, M.P., Tourangeau, R., Conrad, F.G., and Crawford, S. (2004). What They See Is What We Get: Response Options for Web Surveys. Social Science Computer Review, 22, 111-127.
8. Couper, M.P., Traugott, M.W., and Lamias, M. (2001). Web Survey Design and Administration. Public Opinion Quarterly, 65, 230-253.
9. DeMay, C.C., Kurlander, J.L., Lundby, K.M., and Fenlason, K.J. (2002). Web Survey Comments: Does Length Impact "Quality"? Paper presented at the International Conference on Questionnaire Development, Evaluation and Testing Method, Charleston, SC, November.
10. Dennis, M., deRouvray, C., and Couper, M.P. (2000). Questionnaire Design for Probability-Based Web Surveys. Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Portland, OR, May.
11. Elig, T. and Waller, V. (2001). Internet versus Paper Survey Administration: Impact on Qualitative Responses. Arlington, VA: Defense Manpower Data Center, unpublished paper.
12. Fowler, F.J. (1995). Improving Survey Questions; Design and Evaluation. Thousand Oaks, CA: Sage.
13. Frazis, H. and Stewart, J. (1998). Keying Errors Caused by Unusual Keypunch Codes: Evidence from a Current Population Survey Test. Proceedings of the American Statistical Association, Survey Research Methods Section, 131-133.
14. Fuchs, M. (2007). Asking for Numbers and Quantities: Visual Design Effects in Web Surveys and Paper & Pencil Surveys. Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Anaheim, CA, May.
15. Fuchs, M. (2009). Differences in the Visual Design Language of Paper-and-Pencil Surveys Versus Web Surveys: A Field Experimental Study on the Length of Response Fields in Open-Ended Frequency Questions. Social Science Computer Review, 27, 213-227.
16. Hansen, S.E., Beatty, P., and Couper, M.P. (2000). The Effects of CAI Screen Design on User Performance. Paper presented at the Fifth International Conference on Logic and Methodology, Cologne, October.
17. Jenkins, C.R. and Dillman, D.A. (1997). Towards a Theory of Self-Administered Questionnaire Design. In Survey Measurement and Process Quality, L. Lyberg, P. Biemer, M Collins, E. de Leeuw, C. Dippo, N. Schwarz, and D. Trewin (eds). New York: Wiley, 165-196.
18. MacElroy, B., Mikucki, J., and McDowell, P. (2002). A Comparison of Quality in Open-Ended Responses and Response Rates Between Web-Based and Paper and Pencil Survey Modes. Journal of Online Research, 1, http://ijor.mypublicsquare.com/.
19. Menon, G. (1993). The Effects of Accessibility of Information on Judgments of Behavioral Frequencies. Journal of Consumer Research, 20, 431-460.
20. Redline, C.D. and Dillman, D.A. (2002). The Influence of Alternative Visual Designs on Respondents' Performance with Branching Instructions in Self-Administered Questionnaires. In Survey Nonresponse, R.M. Groves, D.A. Dillman, J.A. Eltinge, and R.J.A. Little (eds). New York: Wiley, 179-193.
21. Sanchez, M.E. (1992). Effect of Questionnaire Design on the Quality of Survey Data. Public Opinion Quarterly, 56, 206-217.
22. Schaeffer, N.C. and Presser, S. (2003). The Science of Asking Questions. Annual Review of Sociology, 29, 65-88.
23. Schuman, H. and Presser, S. (1979). The Open and Closed Question. American Sociological Review, 44, 692-712.
24. Schuman, H. and Presser, S. (1981). Questions and Answers in Attitude Surveys. New York: Academic Press.
25. Schwarz, N. and Hippler, H.-J. (1987). What Response Scales May Tell Your Respondents: Information Functions of Response Alternatives. In Social Information Processing and Survey Methodology, H.-J. Hippler, N. Schwarz, and S. Sudman (eds). New York: Springer-Verlag, 163-178.
26. Smith, T.W. (1995). Little Things Matter; A Sampler of How Differences in Questionnaire Format Can Affect Survey Responses. Proceedings of the American Statistical Association, Survey Research Methods Section, 1046-1051.
27. Smyth, J.D., Dillman, D.A., Christian, L.M., and McBride, M. (2009). Open-Ended Questions in Web Surveys; Can Increasing the Size of Answer Boxes and Providing Extra Verbal Instructions Improve Response Quality? Public Opinion Quarterly, 73, 325-337.
28. Speizer, H. and Buckley, P. (1998). Automated Coding of Survey Data. In Computer Assisted Survey Information Collection, M.P. Couper, R.P. Baker, J. Bethlehem, C.Z.F. Clark, J. Martin, W.L. Nicholls, II, and J. O'Reilly (eds). New York: Wiley, 223-243.
29. Sudman, S. and Bradburn, N.M. (1982). Asking Questions: A Practical Guide to Questionnaire Design. San Francisco: Jossey-Bass.
30. Sudman, S., Bradburn, N.M., and Schwarz, N. (1996). Thinking About Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass.
31. Tourangeau, R., Couper, M.P., and Conrad, F.G. (2004). Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions. Public Opinion Quarterly, 68, 368-393.
32. Tourangeau, R., Couper, M.P., and Conrad, F. (2007). Color, Labels, and Interpretive Heuristics for Response Scales. Public Opinion Quarterly, 71, 91-112.
33. Tourangeau, R., Couper, M.P., Galesic, M., and Givens, J. (2004). A Comparison of Two Web-Based Surveys: Static vs Dynamic Versions of the NAMCS Questionnaire. Paper presented at the RC33 International Conference on Social Science Methodology, Amsterdam, August.
34. Tourangeau, R., Rips, L., and Rasinski, K. (2000). The Psychology of Survey Response. Cambridge, England: Cambridge University Press.