Comparing questions with agree/disagree response options to questions with item-specific response options

Survey Research Methods

Volumn 4, Issue 1, 2010, Pages 45-59

  Saris, Willem E ^a   Revilla, Melanie ^a   Krosnick, Jon A ^b   Shaeffer, Eric M ^c  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b STANFORD UNIVERSITY   (United States)

^c OHIO STATE UNIVERSITY   (United States)

Author keywords

Item Specific scales; Quality of Agree Disagree scales; Split Ballot MTMM

Indexed keywords

EID: 84914164996     PISSN: None     EISSN: 18643361     Source Type: Journal    
DOI: None     Document Type: Article

References (66)

1. Aderman, D., & Brehm, S. S. (1976). On the recall of initial attitudes following counterattitudinal advocacy: An experimental reexamination. Personality and Social Psychology Bulletin, 2, 59-62.
2. Allison, P. D. (1987). Estimation of linear models with incomplete data. In C. C. Clogg (Ed.), Sociological methodology 1987 (p. 71-102). Washington, DC: American Sociological Association.
3. Alwin, D. F. (1974). Approaches to the interpretation of relationships in the multitrait-multimethod matrix. In H. L. Costner (Ed.), Sociological methodology 1973-1974 (p. 79-105). San Francisco, CA: Jossey Bass.
4. Andrews, F. M. (1984). Construct validity and error components of survey measures: A Converse structural modeling approach. Public Opinion Quarterly, 48, 409-422.
5. Bem, D. J., & McConnell, H. K. (1970). Testing the self-perception explanation of dissonance phenomena: On the salience of premanipulation attitudes. Journal of Personality and Social Psychology, 14, 23-31.
6. Berkowitz, N. H., & Wolken, G. H. (1964). A forced choice form of the F scale-Free of acquiescent response set. Sociometry, 27, 54-65.
7. Billiet, J., Koch, A., & Philippens, M. (2007). Understanding and improving response rates. In R. F. R. Jowell C. Roberts & G. Eva (Eds.), Measuring attitudes cross-nationally: Lessons from the european social survey (p. 113-139). London: Sage.
8. Billiet, J., Loosveldt, G., & Waterplas, L. (1985). Het Survey-Interview Onderzocht: Effecten Van Het Ontwerp En Gebruik Van Vragenlijsten Op De Kwaliteit Van De Antwoorden. [Research on Surveys: Effects of the Design and Use of Questionnaires on the Quality of the Response]. Leuven, Belgium: Sociologisch Onderzoeksinstituut KU Leuven.
9. Browne, M. W. (1984). The decomposition of multitraitmultimethod matrices. British Journal of Mathematical and Statistical Psychology, 37, 1-21.
10. Carpenter, P. A., & Just, M. A. (1975). Sentence comprehension: A psycholinguistic processing model of verification. Psychological Review, 82, 45-73.
11. Carr, L. G. (1971). The Srole items and acquiescence. American Sociological Review, 36, 287-293.
12. Clark, H. H., & Clark, E. V. (1977). Psychology and language. New York: Harcourt Brace.
13. Coenders, G., & Saris, W. E. (2000). Testing additive and multiplicative MTMM models. Structural Equation Modeling, 7, 219-251.
14. Corten, I. W., Saris, W. E., Coenders, G., M. van der Veld, W. Aalberts, Kornelis, C. (2002). Fit of different models for multitrait-multimethod experiments. Structural Equation Modeling, 9(2), 213-232.
15. Costa, P. T., & McCrae, R. R. (1988). From catalog to classification: Murray’s needs and the five-factor model. Journal of Personality and Social Psychology, 55, 258-265.
16. Counte, M. A. (1979). An examination of the convergent validity of three measures of patient satisfaction in an outpatient treatment center. Journal of Chronic Diseases, 32, 583-588.
17. Davis, J. A., & Smith, T. M. (1996). General social surveys, 1972-1996: Cumulative codebook. Chicago: National Opinion Research Center.
18. Eid, M. (2000). A Multitrait-multimethod model with minimal assumptions. Psychometrika, 65, 242-261.
19. Fowler, F. J. (1995). Improving Survey Questions: Design and Evaluation. Applied Social Research Methods Series, 38, 56-57.
20. Goethals, G. R., & Reckman, R. F. (1973). The perception of consistency in attitudes. Journal of Experimental Social Psychology, 9, 491-501.
21. Goldberg, L. R. (1990). An alternative “description of personality”: The big-five factor structure. Journal of Personality and Social Psychology, 59, 1216-1229.
22. Hader, S., & Lynn, P. (2007). How representative can a multi-nation survey be? In R. Jowell, C. Roberts, R. Fitzgerald, & G. Eva (Eds.), Measuring attitudes cross-nationally: Lessons from the European Social Survey (p. 33-53). London: Sage.
23. Harkness, J. (2007). Improving the comparability of translations. In R. Jowell, C. Roberts, R. Fitzgerald, & G. Eva (Eds.), Measuring attitudes cross-nationally: Lessons from the European Social Survey (p. 79-95). London: Sage.
24. Jarvis, W. B. G., & Petty, R. E. (1996). The need to evaluate. Journal of Personality and Social Psychology, 70, 172-194.
25. Joreskog, K. G., & Sorbom, D. (1991). LISREL VII: A guide to the program and applications. Chicago, IL: SPSS.
26. Kenny, D. A., & Kashy, D. A. (1992). The analysis of the multitraitmultimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172.
27. Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-236.
28. Krosnick, J. A., & Alwin, D. F. (1988). A test of the form-resistant correlation hypothesis: Ratings, rankings, and the measurement of values. Public Opinion Quarterly, 52, 526-538.
29. Krosnick, J. A., & Fabrigar, L. R. (Forthcoming). Designing great questionnaires: Insights from psychology. New York: Oxford University Press.
30. Leech, G. N. (1983). Principles of pragmatics. New York: Longman.
31. Lenski, G. E., & Leggett, J. C. (1960). Caste, class, and deference in the research interview. American Journal of Sociology, 65, 463-467.
32. Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 140, 1-55.
33. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental scores. MA: Addison-Wesley.
34. Marsh, H. W., & Bailey, M. (1991). Confirmatory factor analyses of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement, 15, 47-70.
35. Miller, W. E., & Traugott, S. (1989). American national election studies data sourcebook, 1952-1986. Cambridge, MA: Harvard University Press.
36. Ray, J. J. (1979). A quick measure of achievement motivation - validated in Australia and reliable in Britain and South Africa. Australian Psychologist, 14, 337-344.
37. Ray, J. J. (1980). The comparative validity of Likert, projective, and forced-choice indices of achievement motivation. Journal of Social Psychology, 111, 63-72.
38. Revilla, M., Saris, W. E., & Krosnick, J. A. (2009). Choosing the number of categories in agree/disagree scales. RECSM working paper number 5.
39. Richardson, S. A., Dohrenwend, B. S., & Klein, D. (1965). Expectations and premises: The socalled ”leading question”. In S. A. Richardson, B. S. Dohrenwend, & D. Klein (Eds.), Interviewing: Its forms and functions. New York: Basic Books.
40. Rindskopf, D. (1984). Structural equation models: empirical identification, Heywood cases, and related problems. Sociological Methods & Research, 13, 109-119.
41. Robinson, J. P., & Shaver, P. R. (1973). Measures of social psychological attitudes. Ann Arbor, Michigan: Institute for Social Research.
42. Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (1991). Measures of personality and social psychological attitudes. San Diego, CA: Academic Press, Inc.
43. Robinson, J. P., & Wrightsman, L. S. (1999). Measures of political attitudes. San Diego, CA: Academic Press.
44. Ross, C. K., Steward, C. A., & Sinacore, J. M. (1995). A comparative study of seven measures of patient satisfaction. Medical Care, 33, 392-406.
45. Ross, M., & Shulman, R. F. (1973). Increasing the salience of initial attitudes: Dissonance versus self-perception theory. Journal of Personality and Social Psychology, 28, 138-144.
46. Saris, W. E. (1986). Variation in response functions: a source of measurement error in attitude research. Amsterdam Sociometric Research Foundation.
47. Saris, W. E. (1990). The choice of a research design for MTMM studies. In W. E. Saris & A. van Meurs (Eds.), Evaluation of measurement instruments by meta-analysis of multitraitmultimethod studies. Amsterdam: North Holland.
48. Saris, W. E., & Aalberts, C. (2003). Different explanantions for correlated disturbance terms in MTMM studies. Structural Equation Modeling, 10, 193-214.
49. Saris, W. E., & Andrews, F. M. (1991). Evaluation of measurement instruments using a structural modeling approach. In P. P. Biemer, R. M. Groves, L. Lyberg, N. Mathiowetz,&S. Sudman (Eds.), Measurement errors in surveys (p. 575-597). New York: Wiley.
50. Saris, W. E., & Munnich, A. (1995). The multitrait-multimethod approach to evaluate measurement instruments. Budapest, Hungary: Eotvos University Press.
51. Saris, W. E., & N. Gallhofer (2007). Design, evaluation and analysis of questionnaires for survey research. Hoboken: Wiley.
52. Saris, W. E., Satorra, A., & Coenders, G. (2004). A new approach to evaluating the quality of measurement instruments: The splitballot MTMM design. Sociological Methodology 2004.
53. Saris, W. E., Satorra, A., & Van der Veld, W. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561-582.
54. Satorra, A. (1990). Robustness issues in the analysis ofMTMMand RMM models. In W. E. Saris & A. van Meurs (Eds.), Evaluation of measurement instruments by meta-analysis of multitraitmultimethod studies. Amsterdam: North Holland.
55. Satorra, A. (1992). Asymptotic robust inferences in the analysis of mean and covariance structures. Sociological Methodology, 22, 249-278.
56. Scherpenzeel, A. C. (1995). A question of quality. Evaluating survey questions by multitraitmultimethod studies. Leidschendam: PTT Nederland NV, KPN Research.
57. Scherpenzeel, A. C., & Saris, W. E. (1997). The validity and reliability of survey questions: A meta analysis of MTMM studies. Sociological Methods and Research, 25, 341-383.
58. Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys: Experiments on question form, wording, and context. New York: Academic Press.
59. Shaffer, D. R. (1975a). Another look at the phenomenological equivalence of pre- and postmanipulation attitudes in the forcedcompliance experiment. Personality and Social Psychology Bulletin, 1, 497-500.
60. Shaffer, D. R. (1975b). Some effects of consonant and dissonant attitudinal advocacy on initial attitude salience and attitude change. Journal of Personality and Social Psychology, 32, 160-168.
61. Shaw, M. E., & Wright, J. M. (1967). Scales for the measurement of attitudes. New York: McGraw Hill.
62. Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The Psychology of Survey Response :. Cambridge: Cambridge University Press.
63. Trabasso, T., Rollins, H., & Shaughnessey, E. (1971). Storage and verification stages in processing concepts. Cognitive Psychology, 2, 239-289.
64. Van der Veld, W., Saris, W. E., & Satorra, A. (2008). JRule 2.0: User manual. Unpublished document.
65. van Meurs, A., & Saris, W. E. (1990). Memory effects in MTMM studies. In W. E. Saris & A. van Meurs (Eds.), Evaluation of measurement instruments by meta-analysis of multitraitmultimethod studies. Amsterdam: North Holland.
66. Wixon, D. R., & Laird, J. D. (1976). Awareness and attitude change in the forced-compliance paradigm: The importance of when. Journal of Personality and Social Psychology, 34, 376-384.