Ineffectiveness of Reverse Wording of Questionnaire Items: Let's Learn from Cows in the Rain

PLoS ONE

Volumn 8, Issue 7, 2013, Pages

  van Sonderen, Eric ^a   Sanderman, Robbert ^a   Coyne, James C ^a,b  

^a UNIVERSITY MEDICAL CENTER GRONINGEN   (Netherlands)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CONFUSION; DISEASE CLASSIFICATION; DISEASE SEVERITY; ENTERITIS; FATIGUE; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; MEDICAL INFORMATION; MULTIDIMENSIONAL FATIGUE INVENTORY; PREVALENCE; PSYCHOMETRY; QUALITY OF LIFE; QUESTIONNAIRE; SYSTEMATIC ERROR;

ANIMALS; BIAS (EPIDEMIOLOGY); CATTLE; FATIGUE; HUMANS; INFLAMMATORY BOWEL DISEASES; PSYCHOMETRICS; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS;

EID: 84881134843     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0068967     Document Type: Article

References (29)

1. Rorer LG, (1965) The great response-style myth. Psychol Bull 63: 129-156.
2. Baumgartner H, Steenkamp JBEM, (2001) Response styles in marketing research: A cross-national investigation. J Marketing Res 38: 143-156.
3. Tourangeau R, Rips LJ, Rasinski K (2000) The psychology of survey response. Cambridge, England: Cambridge University Press.
4. Paulhus DL (1991) Measurement and control of response bias. In: Robinson JP, Shaver PR, Wrightsman LS, editors. Measures of Personality and Social Psychological Attitudes, 17-59. San Diego, CA: Academic Press.
5. Weijters B (2006) Response styles in consumer research. Doctoral dissertation, Ghent University, Ghent, Belgium.
6. Swain SD, Weathers D, Niedrich RW, (2008) Assessing three sources of misresponse to reversed Likert items. J Marketing Res 45: 116-131.
7. Krosnick JA, (1999) Survey research. Annu Rev Psychol 50: 537-567.
8. Weijters B, Baumgartner H, Schillewaert N (2013, May 6) Reversed Item Bias: An Integrative Model. Psychological Methods. Advance online publication. doi: 10.1037/a0032121.
9. Drolet AL, Morrison DG, (2001) Do we really need multiple-item measures in service research? J Serv Res-US 3: 196-204.
10. Schriesheim CA, Hill KD, (1981) Controlling acquiescence response bias by item reversals: The effect on questionnaire validity. Educ Psychol Meas 41, no. 4: 1101-14.
11. Meyer JP, Allen NJ (1991) A three-component conceptualization of organizational commitment. Hum Resour Manage R, 1, 61-89.
12. Merritt SM (2012) The Two-Factor Solution to Allen and Meyer's (1990) Affective Commitment Scale: Effects of Negatively Worded Items. J Bus Psychol, Volume 27, issue 4, 421-436.
13. Roszkowski MJ, Soven J (2010) Shifting gears: Consequences of including two negatively worded items in the middle of a positively worded questionnaire. Assess Eval High Educ, 35, 113-130.
14. Meyer TJ, Miller ML, Metzger RL, Borkovec TD (1990) Development and validation of the Penn State Worry Questionnaire. Behav Res Ther, 28, 487-495.
15. Fresco DM, Heimberg RG, Mennin DS, Turk CL (2002) Confirmatory factor analysis of the Penn State Worry Questionnaire. Behav Res Ther, 40, 313-323.
16. Hazlett-Stevens H, Ullman JB, Craske MG (2004) Factor structure of the Penn State Worry Questionnaire: Examination of a method factor. Assessment, 11(4), 361-370.
17. Bradley KD, Royal KD, Bradley JW (2008) An investigation of 'honesty check' items in higher education course evaluations. J Coll Teach Learn, 5(8), 39-48.
18. Hinz A, Michalski D, Schwarz R, Herzberg PY, (2007) The acquiescence effect in responding to a questionnaire. GMS Psychosoc Med 4: Doc07.
19. Woods CM, (2006) Careless responding to reverse-worded items: Implications for confirmatory factor analysis. J Psychopathol Behav 28: 189-194.
20. Spector PE, VanKatwyk PT, Brannick MT, Chen PY, (1997) When two factors don't reflect two constructs: How item characteristics can produce artifactual factors. J Manage 23: 659-677.
21. Schmitt N, Stults DM, (1985) Factors defined by negatively keyed items- the result of careless respondents. Appl Psych Meas 9: 367-373.
22. Watson D, Tellegen A, (1999) Issues in the dimensional structure of affect- Effects of descriptors, measurement error, and response formats: Comment on Russell and Carroll (1999). Psychol Bull 125: 601-610.
23. Russell JA, Carroll JM, (1999) On the bipolarity of positive and negative affect. Psychol Bull 125: 3-30.
24. Russell JA, Carroll JM, (1999) The phoenix of bipolarity: Reply to Watson and Tellegen (1999). Psychol Bull 125: 611-617.
25. Segura SL, Gonzalez-Roma V, (2003) How do respondents construe ambiguous response formats of affect items? J Pers Soc Psychol 85: 956-968.
26. Romberg-Camps M, Bol Y, Dagnelie PC, van der Hesselink-Kruijs MAM, Kester AD, et al. (2010) Fatigue and health-related quality of life in inflammatory bowel disease: Results from a population-based study in the Netherlands: The IBD-South Limburg cohort. Inflamm Bowel Dis, 16(12), 2137-2147.
27. Smets EM, Garssen B, Cull A, de Haes JC, (1996) Application of the multidimensional fatigue inventory (MFI-20) in cancer patients receiving radiotherapy. Brit J Cancer 73: 241-245.
28. Smets EM, Garssen B, Bonke B, de Haes JC, (1995) The Multidimensional Fatigue Inventory (MFI) psychometric qualities of an instrument to assess fatigue. J Psychosom Res 39: 315-325.
29. Campbell DT, Fiske DW, (1959) Convergent and discriminant validation by the Multitrait-Multimethod Matrix. Psychol Bull 56: 81-105.