Methodological issues surrounding the application of cognitive psychology in survey research

Bulletin de Méthodologie Sociologique

Volumn 55, Issue 1, 1997, Pages 67-92

  Tucker, Clyde ^a  

^a BUREAU OF LABOR STATISTICS   (United States)

Author keywords

Construction de questionnaire; Design Measurement Error; Erreur de mesure; Experimental Design; M thodes d'enqu te; Plan d'exp rience; Survey Methods Questionnaire

Indexed keywords

EID: 84996156283     PISSN: 07591063     EISSN: None     Source Type: Journal    
DOI: 10.1177/075910639705500106     Document Type: Article

References (72)

1. Agresti, A. (1990). Categorical Data Analysis, New York: John Wiley.
2. Aronson, E., Ellsworth, P.C., Carlsmith, J.M., and Gonzales, M.H. (1990). Methods of Research in Social Psychology, New York: McGraw-Hill.
3. Bailar, B.A. (1983). The Quality of Statistical Data. Proceedings of the International Statistical Institute, Meeting of the International Association of Survey Statisticians, Madrid.
4. Bassili, J.N. (1995). The How and Why of Response Latency Measurement in Telephone Surveys. In N. Schwarz and S. Sudman (Eds.) Answering Questions (pp.319-346). San Francisco: Jossey-Bass.
5. Beatty, P. (1995). Understanding the Standardized/Nonstandardized Interviewing Controversy. Journal of Official Statistics, 11, 147-160.
6. Bishop, Y.V.V., Fienberg, S.E., and Holland, P.W. (1975). Discrete Multivariate Analysis, Cambridge, MA: MIT Press.
7. Blair, J. and Presser, S. (1993). Survey Procedures for Conducting Cognitive Interviews to Pretest Questionnaires: A Review of Theory and Practice. Proceedings of the Section on Survey Methods Research, American Statistical Association.
8. Brewer, M.B. and Lui, L.J. (1995). Use of Sorting Tasks to Assess Cognitive Structures. In N. Schwarz and S. Sudman (Eds.) Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research (pp. 373-385). San Francisco: Jossey-Bass.
9. Cannell, C.F., Lawson, S.A., and Hausser, D.L. (1975). A Technique for Evaluating Interviewer Performance, Ann Arbor, MI: Survey Research Center, University of Michigan.
10. Cannell, C., Oksenberg, L., Fowler, F.J., Kalton, G., and Bischoping, K. (1989). New Techniques for Pretesting Survey Questions, Final Report for Grant Number HS 05616 from the National Center for Health Services Research and Health Care Technology Assessment, Ann Arbor, MI: Survey Research Center, University of Michigan.
11. Conrad, F. and Brown, N. (1995). Estimating Frequency: A Multiple Strategy Perspective. Paper presented at the annual conference of the Association for Consumer Research, Minneapolis, MN.
12. Conrad, F. and Blair, J. (1996). From Impressions to Data: Increasing the Objectivity of Cognitive Interviews. Paper presented at the annual meeting of the American Statistical Association, Chicago, IL.
13. Conrad, F. and Schober, M. (1996). How Interviewers’ Conversational Flexibility Affects the Accuracy of Survey Data. Paper presented at the annual conference of the American Association for Public Opinion Research, Salt Lake City, UT.
14. Conrad, F. and Tonn, B. (1993). Intuitive Classification of Occupation. Proceedings of the International Conference on Occupational Classification, Washington, DC: Bureau of Labor Statistics.
15. Cox, D.R. and Snell, E.J. (1989). Analysis of Binary Data, New York: Chapman and Hall.
16. DerSimonian, R., Charette, L.J., McPeek, B., and Mosteller, F. (1982). Reporting on Methods in Clinical Trials. The New England Journal of Medicine, 306, 1332-1337.
17. Dippo, C.S., Tucker, C., and Valliant, R. (1993). Survey Methods Research at the US Bureau of Labor Statistics. Journal of Official Statistics, 9, 121-135.
18. Dippo, C.S. (1995). Survey Measurement and Process Improvement: Concepts and Integration. Paper presented at the International Conference on Survey Measurement and Process Quality, Bristol, UK.
19. Dippo, C., Polivka, A., Creighton, K., Kostanich, D., and Rothgeb, J. (1996). Redesigning a Questionnaire for Computer-Assisted Data Collection: The Current Population Survey Experience. Under review.
20. Eisenhart, C. (1952). The Reliability of Measured Values-Part I: Fundamental Concepts. Photogrammetric Engineering, 18, 542-561.
21. Ericsson, K.A. and Simon, H.A. (1993). Protocol Analysis: Verbal Reports as Data. Cambridge, MA: MIT Press.
22. Esposito, J.L., Campanelli, P.C., Rothgeb, J., Polivka, A.E. (1991). Determining Which Questions Are Best: Methodologies for Evaluating Survey Questions. Proceedings of the Section on Survey Methods Research, American Statistical Association, pp.46-55.
23. Festinger, L. (1955). Laboratory Experiments. In L. Festinger and D. Katz (Eds) Research Methods in the Behavioral Sciences (pp. 136-172). New York: Holt, Rienhart & Winston.
24. Fienberg, S.E. and Tanur, J.M. (1989). Combining Cognitive and Statistical Approaches to Survey Design. Science, 243, 1017-1022.
25. Forsyth, B.H., Lessler, J.T., and Hubbard, M.L. (1992). Cognitive Evaluation of the Questionnaire. In C. F. Turner, J. T. Lessler, and J. C. Gfroerer (Eds.) Survey Measurements of Drug Use: Methodological Studies (pp. 13-52), DHHS Publication No. 92-1929, Washington, DC: US Government Printing Office.
26. Fowler, F.J. and Mangione, T.W. (1990). Standardized Survey Interviewing: Minimizing Interviewer-Related Error. Newbury Park, CA: Sage Publications, Inc.
27. Goodman, L.A. (1978). Analyzing Qualitative/Categorical Data. Cambridge, MA: ABT Associates. Inc.
28. Goodman, L.A. (1984). The Analysis of Cross-Classified Data Having Ordered Categories. Cambridge, MA: Harvard University Press.
29. Kaplan, A. (1964). The Conduct of Inquiry. Scranton, PA: Chandler Publishing Company.
30. King, G., Keohane, R.O., and Verba, S. (1994). Designing Social Inquiry. Princeton University Press.
31. Kojetin, B. and Miller, L.A. (1993). The Intrahousehold Communication Study: Estimating the Accuracy of Proxy Responses at the Dyadic Level. Paper presented at the annual conference of the American Association for Public Opinion Research, Pheasant Run, IL.
32. Kojetin, B. and Mullin, P.A. (1995). The Quality of Proxy Reports on the Current Population Survey. Paper presented at the annual conference of the American Association for Public Opinion Research, Fort Lauderdale, FL.
33. Kritzer, H.M. (1996). The Data Puzzle: The Nature of Interpretation in Quantitative Research. American Journal of Political Science, 40, 1-32.
34. Kruskal, W. (1978). Taking Data Seriously. In Y. Elkana, J. Lederberg, R. Merton, R. Thackray, and H. Zukerman (Eds.) Toward a Metric of Science: The Advent of Science Indicators (pp. 139-169). New York: Wiley.
35. Mandel, J. (ca 1958). The Measuring Process. Source unknown.
36. Martin, E.A., Campanelli, P.C., and Fay, R.E. (1991). An Application of Rasch Analysis to Questionnaire Design: Using Vignettes to Study the Meaning of ‘Work’ in the Current Population Survey. Statistician, 40, 265-276.
37. Martin, E. and Polivka, A.E. (1995). Diagnostics for Redesigning Questionnaires. Public Opinion Quarterly, 59, 547-567.
38. Mathiowetz, N.A. and Cannell, C.F. (1980). Coding Interviewer Behavior as a Method of Evaluating Performance. Proceedings of the Section on Survey Research Methods, American Statistical Association, pp. 525-528.
39. Menon, G. (1994). Judgments of Behavioral Frequencies: Memory Search and Retrieval Strategies. In N. Schwarz and S. Sudman (Eds.) Autobiographical Memory and the Validity of Retrospective Reports (pp. 161-172). New York: Springer-Verlag.
40. Milgram, S. (1974). Obedience to Authority. New York: Harper & Row.
41. Moore, J. and Marquis, K. (1989). Using Administrative Record Data to Evaluate the Quality of Survey Estimates. Survey Methodology, 15, 129-143.
42. Mullin, P. and Miller, L. (1994). Review of Completed Research on Global Categories. BLS memorandum.
43. Nargundkar, M.S. and Gower, A.R. (1991). Cognitive Aspects of Questionnaire Design: Business Surveys Versus Household Surveys. Proceedings of the 1991 Census Annual Research Conference, pp. 299-312.
44. Poister, T.H. (1978). Public Program Analysis. Baltimore, MD: University Park Press.
45. Popper, K.R. (1968). The Logic of Scientific Discovery. New York: Harper and Row.
46. Presser, S. and Blair, J. (1994). Survey Pretesting: Do Different Methods Produce Different Results? In P. Marsden (Ed.) Sociological Methodology 1994 (pp. 73-104). New York: Blackwell.
47. Przeworski, A. and Teune, H. (1982). The Logic of Comparative Social Inquiry. Lalabar, FL Krieger Publishing Company.
48. Schaeffer, N.C. and Maynard, D.W. (1996). From Paradigm to Prototype and Back Again: Interactive Aspects of Cognitive Processing in Standardized Survey Interviews. In N. Schwarz, and S. Sudman (Eds.) Answering Questions (pp. 65-88). San Francisco: Jossey-Bass.
49. Sidman, M. (1960). Tactics of Scientific Research. New York: Basic Books.
50. Silberstein, A.R. (1989). Recall Effects in the US Consumer Expenditure Interview Survey. Journal of Official Statistics, 5. 125-142.
51. Silberstein, A.R. (1991). Response Performance in the Consumer Expenditure Diary Survey. Proceedings of the Section on Survey Research Methods. American Statistical Association, pp. 338-343.
52. Silberstein, A.R. (1993). Part-set Cuing in Diary Surveys. Proceedings of the Section on Research Methods, American Statistical Association, pp. 398-403.
53. Siegel, S. (1956). Nonparametric Statistics for the Behavioral Sciences, New York: McGraw-Hill.
54. Skinner, B.F. (1953). Science and Human Behavior. New York: Free Press.
55. Suchman, L. and Jordan, B. (1990). Interactional Troubles in Faceto-Face Survey Interviews. Journal of the American Statistical Association, 85, 232-241.
56. Sudman, S. and Schwarz, N. (1989). Contributions of Cognitive Psychology to Advertising Research. Journal of Advertising Research, 29, 43-53.
57. Sudman, S., Bradburn, N.M., and Schwarz, N. (1996). Thinking About Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass.
58. Suen, H.K. and Ary, D. (1989). Analyzing Quantitative Behavioral Observation Data. Hilldale, NJ: Lawrence Erlbaum Associates.
59. Tanur, J. M. (Ed.). (1992). Questions about Questions: Inquiries into the Cognitive Bases of Surveys. New York: Russell Sage Foundation.
60. Tucker, C. (1988). Estimating Measurement Error in Surveys. Paper presented at the annual conference of the American Association for Public Opinion Research, Toronto.
61. Tucker, C. (1992). The Estimation of Instrument Effects on Data Quality in the Consumer Expenditure Diary Survey. Journal of Official Statistics, 8, 41-61.
62. Tucker, C., Casady, R., and Lepkowski, J. (1991). An Evaluation of the 1988 Current Point-of-Purchase CATI Feasibility Test. Proceedings of the Section on Survey Research Methods, American Statistical Association, pp. 508-513.
63. Tucker, C. and Miller, L.A. (1993). The Intrahousehold Communication Study: Family Cohesion and the Level of Knowledge About Expenses. Proceedings of the Section on Survey Research Methods, American Statistical Association, pp. 942-947.
64. Tucker, C. (1993). The Effects of Format Changes on Reporting in the 1991 Consumer Expenditure Survey. Proceedings of the Section on Survey Research Methods, American Statistical Association, pp. 410-415.
65. Tucker, C. (1996). Improving Field Testing. Paper presented at the annual Field Directors Conference, Snow Bird, UT.
66. Tucker, C., McKay, R., Kojetin, B., Harrison, R., de la Puente, M., Stinson, L., and Robison, E. (1996). Testing Methods of Collecting Racial and Ethnic Information: Results of the Current Population Survey Supplement on Race and Ethnicity. BLS Statistical Notes, No. 40.
67. Tukey, J.W. (1977). Exploratory Data Analysis, Reading, MA: Addison-Wesley.
68. Turban, E. and Meredith, J.R. (1994). Fundamentals of Management Science, Boston: Irwin.
69. Van der Zouwen, J., Dijkstra, W., and Smit, J.H. (1991). Studying Respondent-Interviewer Interaction: The Relationship Between Interviewing Style, Interviewer Behavior, and Response Behavior. In P. P. Biemer et al. (Eds.) Measurement Errors in Surveys (pp. 419-437). New York: Wiley.
70. Wentland, E.J. with Smith, K.W. (1993). Survey Responses: An Evaluation of Their Validity. San Diego: Academic Press, Inc.
71. Willis, G.S., Royston, P., and Bercini, D. (1991). The Use of Verbal Report Methods in the Development and Testing of Survey Questionnaires. Applied Cognitive Psychology, 5, 251-267.
72. Willis, G. (1996). Personal communication.