Characteristics of respondents who respond differently to positively and negatively Worded items on Rating Scales

Assessment and Evaluation in Higher Education

Volumn 28, Issue 6, 2003, Pages 587-606

  Weems, Gail H ^a   Onwuegbuzie, Anthony J ^b   Schreiber, James B ^c   Eggers, Sandy J ^d  

^a UNIVERSITY OF ARKANSAS AT LITTLE ROCK   (United States)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

^c School of Dental Medicine   (India)

^d Emmanuel United Methodist Kindergarten   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33746742921     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/0260293032000130234     Document Type: Article

References (62)

1. ALLPORT, G. W. & ROSS, J. M. (1967) Personal religious orientation and prejudice, Journal of Personality and Social Psychology, 5, pp. 432-443.
2. ANDERSON, J. P., ANDERSON, P. A. & JENSON, A. D. (1979) The measurement of nonverbal immediacy, Paper presented at the Annual Meeting of the Eastern Communication Association, Philadelphia, PA (ERIC Document Reproduction Service no. ED 203409).
3. BARNETTE, J. J. (1999) Likert response alternative direction: SA to SD or SD to SA: does it make a difference?, Paper presented at the Annual Meeting of the American Educational Research Association, Montreal, Canada (ERIC Document Reproduction Service no. ED 429125).
4. BARNETTE, J. J. (2000) Effects of stem and Likert response option reversals on survey internal consistency: if you feel the need, there is a better alternative to using those negatively worded stems, Educational and Psychological Measurement, 60 (3), pp. 361-370.
5. BENSON, J. & HOCEVAR, D. (1985) The impact of item phrasing on the validity of attitude scales for elementary school children, Journal of Educational Measurement, 22, pp. 231-240.
6. BERGSTROM, B. A & LUNZ, M. E. (1998) Rating scale analysis: gauging the impact of positively and negatively worded items, Paper presented at the Annual Meeting of the American Educational Research Association, San Diego, CA (ERIC Document Reproduction Service no. ED 423289).
7. CAMPBELL, N. J. & GRISSOM, S. (1979) Influence of item direction on student responses in attitude assessment, Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, CA (ERIC Document Reproduction Service no. ED 170366).
8. CHANG, L. (1995) Connotatively consistent and reversed connotatively inconsistent items are not fully equivalent: generalizability study, Educational and Psychological Measurement, 55 (6), pp. 991-997.
9. COHEN, J. (1988) Statistical Power Analysis for the Behavioral Sciences (Hillsdale, NJ, Erlbaum).
10. COUCH, A. & KENISTON, K. (1960) Yea sayers and nay sayers: agreeing response set as a personality variable, Journal of Abnormal and Social Psychology, 60, pp. 151-174.
11. CRONBACH, L. J. (1946) Response sets and test validity, Educational and Psychological Measurement, 6, pp. 475-494.
12. CRONBACH, L. J. (1950) Further evidence on response sets and test design, Educational and Psychological Measurement, 10, pp. 3-31.
13. DALY, J. A. & MILLER, M. D. (1975) The empirical development of an instrument to measure writing apprehension, Research in the Teaching of English, 9, pp. 242-249.
14. DEEMER, S. A. & MINKE, K. M. (1999) An investigation of the factor structure of the teacher efficacy scale, Journal of Educational Research, 93 (1), pp. 3-10.
15. DONAHUE, M. J. (1985) Intrinsic and extrinsic religiousness: review and meta analysis, Journal of Personality and Social Psychology, 48, pp. 400-419.
16. DUELL, O. K. & SCHOMMER-AIKINS, M. (2001) Measures of peoples' beliefs about knowledge and learning, Educational Psychological Review, 13, pp. 419-449.
17. DUNN, R., DUNN, K. & PRICE, G. (1991) Productivity Environmental Preference Survey (Lawrence, KS, Price Systems).
18. EGGERS, S. J. (2000) Spirituality in mid-life and late adulthood (Doctoral dissertation, The University of Memphis, 2000), Dissertation Abstracts International, 61 (3A), p. 878.
19. ELLISON, C. W. & SMITH, J. (1991) Toward an integrative measure of health and well-being, Journal of Psychology and Theology, 19, pp. 35-48.
20. FOLLMAN, F., LUCOFF, M., SMALL, L. & POWER, F. (1974) Kinds of keys of student rating of faculty effectiveness, Paper presented at the Annual Meeting of the American Educational Research Association, Chicago, IL (ERIC Document Reproduction Service no. ED 093985).
21. HEWITT, P. L. & FLETT, G. L. (1991) Perfectionism in self and social contexts: conceptualization, assessment, and association with psychopathology, Journal of Personality and Social Psychology, 60, pp. 456-470.
22. HOYT, D. & CREECH, J. (1983) The Life Satisfaction Index: a methodological and theoretical critique, Journal of Gerontology, 10, pp. 339-356.
23. JOHANSON, G. A. & OSBORN, C. J. (2000) Acquiescence as differential person functioning, Paper presented at the Annual Meeting of the American Education Research Association, New Orleans, LA (ERIC Document Reproduction Service no. ED 441022).
24. JONES, C. H. & SLATE, J. R. (1992) Technical manual for the Study Habits Inventory, unpublished manuscript, Arkansas State University, Jonesboro, AR.
25. KROSNICK, J. A., NARAYAN, S. & SMITH, W. R. (1996) Satisficing in surveys: initial evidence, in: M. T. BRAVERMAN & J. K. Slater (Eds) Advances in Survey Research (San Francisco, CA, Sage).
26. LAMBERT, Z. V. & DURAND, R. M. (1975) Some precautions in using canonical analysis, Journal of Market Research, XII, pp. 468-475.
27. LIANG, J. (1984) Dimensions of the Life Satisfaction Index A: a structural formulation, Journal of Gerontology, 5, pp. 613-622.
28. MAGAZINE, S. L., WILLIAMS, L. J. & WILLIAMS, M. L. (1996) A confirmatory factor analysis examination of reverse coding effects in Meyer and Allen's Affective and Continuance Commitment Scales, Educational and Psychological Measurement, 56 (2), pp. 241-250.
29. MARSH, H. W. (1984) The bias of negatively worded items in rating scales for preadolescent children: a cognitive-developmental phenomenon, ERIC Document Reproduction Service no. ED 242772.
30. MARSH, H. W. (1986) Multidimensional self concepts: do positively and negatively worded items measure substatively different components of self, ERIC Document Reproduction Service no. ED 278716.
31. MCINERNEY, V., MCINERNEY, D. & ROCHE, L. (1994) Definitely not just another computer anxiety instrument: the development and validation of CALM: computer anxiety and learning measure, Paper presented at the Annual Stress and Anxiety Research Conference, Madrid, Spain (ERIC Document Reproduction Service no. ED 386161).
32. MYERS, R. H. (1986) Classical and Modern Regression with Applications (Boston, MA, Duxbury Press).
33. NARDI, P.M. (2003) Doing Survey Research: a guide to quantitative methods (Bostion, MA, Allyn and Bacon).
34. NEEMANN, J. & HARTER, S. (1986) Manual for the self-perception profile for college students, unpublished manuscript, University of Denver, Denver, CO.
35. NEUGARTEN, B. L., HAVIGHURST, R. J. & TOBIN, S. S. (1961) The measurement of life satisfaction, Journal of Gerontology, 16, pp. 134-143.
36. NUNNALLY, J. C. & BERNSTEIN, I. H. (1994) Psychometric Theory, 3rd edition (New York, McGraw-Hill).
37. ONWUEGBUZIE, A. J. (1996) Development of the research anxiety rating scale, unpublished manuscript, University of Central Arkansas.
38. ONWUEGBUZIE, A. J. (2000) Attitudes toward statistics assessments, Assessment & Evaluation in Higher Education, 25, pp. 321-339.
39. ONWUEGBUZIE, A. J. & DANIEL, L. G. (2002) A framework for reporting and interpreting internal consistency reliability estimates, Measurement and Evaluation in Counseling and Development, 35, pp. 89-103.
40. ONWUEGBUZIE, A. J. & DANIEL, L. G. (2003) Typology of analytical and interpretational errors in quantitative and qualitative educational research. Current Issues in Education, 6 (2), available at: http://cie.ed.asu.edu/volume6/number2/
41. ONWUEGBUZIE, A. J. & DANIEL, L. G. (in press) Reliability generalization: the importance of considering sample specificity, confidence intervals, and subgroup differences, Research in the Schools.
42. ONWUEGBUZIE, A. J., SLATE, J., PATERSON, F., WATSON, M. & SCHWARTZ, R. (2000) Factors associated with underachievement in educational research courses. Research in the Schools, 7, pp. 53-65.
43. ORY, J. C. (1982) Item placement and wording effects on overall ratings, Educational and Psychological Measurement, 42, pp. 767-775.
44. RAPPAPORT, R. B. (1982) Sex differences in attitude expression: a generational explanation, Public Opinion Quarterly, 57, pp. 305-313.
45. ROBERTS, J. K. & ONWUEGBUZIE, A. J. (2003) Alternative approaches for interpreting alpha with homogeneous subsamples, Research in the Schools, 10, pp. 63-69.
46. SANDOVAL, J. & LAMBERT, N. M. (1978) Reliability and validity of teacher rating procedures in the assessment of hyperactivity as a function of rating scale format, Paper presented at the Annual Meeting of the American Educational Research Association, Toronto, Canada (ERIC Document Reproduction Service no. ED 160614).
47. SCHMECK, R. R., GEISLER-BRENSTEIN, E. & CERCY, S. P. (1991) Self-concept and learning: the revised inventory of learning processes, Educational Psychology, 11 (3), pp. 343-362.
48. SCHOMMER, M. (1995) The influence of age and schooling on epistemological beliefs, Bristish Journal of Educational Psychology, 68, pp. 551-562.
49. SCHRIESHEIM, C. A. & HILL, K. D. (1981) Controlling acquiescence response bias by item reversals: the effect on questionnaire validity, Educational and Psychological Measurement, 41, pp. 1101-1114.
50. SEN, A. K. & SRIVASTAVA, M. (1990) Regression analysis: theory, methods, and applications (New York, Springer-Verlag).
51. SHAPIRO, S. S. & WILK, M. B. (1965) An analysis of variance test, for normality and complete samples, Biometrika, 52, pp. 592-611.
52. SHAPIRO, S. S., WILK, M. B. & CHEN, H. J. (1968) A comparative study of various tests for normality, Journal of the American Statistical Association, 63, pp. 1343-1372.
53. SNYDER, C. R., HARRIS, C., ANDERSON, J. R., HOLLERAN, S. A., IRVING, L. M., SIGMON, S. T., YOSHINOBU, L. GIBB J., LANGELLE, C. & HARNEY, P. (1991) The will and the ways: development and validation of an individual-differences measure of hope, Journal of Personality and Social Psychology, 60, pp. 570-585.
54. TABACHNICK, B. G. & FIDELL, L. S. (1996) Using Multivariate Statistics, 3rd edition (New York, HarperCollins College Publishers).
55. THOMPSON, B. (1995) Stepwise regression and stepwise discriminant analysis need not apply here: a guidelines editorial, Educational and Psychological Measurement, 55, pp. 525-534.
56. THOMPSON, B. (1998) Five methodology errors in educational research: the pantheon of statistical significance and other faux pas, Invited address presented at the Annual Meeting of the American Educational Research Association, San Diego, CA.
57. THOMPSON, B. & BORRELLO, G. M. (1985) The importance of structure coefficients in regression research, Educational and Psychological Measurement, 45, pp. 203-209.
58. WEEMS, G. H. & ONWUEGBUZIE, A. J. (2001) The impact of midpoint responses and reverse coding on survey data, Measurement and Evaluation in Counseling and Development, 34, pp. 166-176.
59. WILLIAMS, R. L., BUSH, V. J., PARK, S. H., MALONE, Y. & JESSUP, K. (2001) Work ethic scale for middle school students, ERIC Document Reproduction Service no. ED 452 257.
60. WILSON, G., ELIAS, J. & BROWNLEE, L. (1985) Factor invariance and the Life Satisfaction Index, Journal of Gerontology, 40, pp. 344-346.
61. WRIGHT, B. D. & MASTERS, G. N. (1982) Rating Scale Analysis (Chicago, IL, Mesa Press).
62. ZUSMAN, B. J. & DUBY, P. B. (1984) An evaluation of the use of token monetary incentives in enhancing the utility of post-secondary survey research techniques, Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA.