Measure Twice, Cut Down Error: A Process for Enhancing the Validity of Survey Scales

Review of General Psychology

Volumn 15, Issue 4, 2011, Pages 380-387

  Gehlbach, Hunter ^a   Brinkworth, Maureen E ^a  

^a HARVARD GRADUATE SCHOOL OF EDUCATION   (United States)

Author keywords

Assessment; Measurements; Research methodology; Scales; Survey research; Validity reliability

Indexed keywords

EID: 83255187726     PISSN: 10892680     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0025704     Document Type: Article

References (32)

1. Ang R.P. Development and validation of the Teacher-Student Relationship Inventory using exploratory and confirmatory factor analysis. Journal of Experimental Education 2005, 74:55-73. doi: 10.3200/JEXE.74.1.55-74.
2. Benson J., Hocevar D. The impact of item phrasing on the validity of attitudes scales for elementary school children. Journal of Educational Measurement 1985, 22:231-240. doi: 10.1111/j.1745-3984.1985.tb01061.x.
3. Birch S.H., Ladd G.W. The teacher-child relationship and children's early school adjustment. Journal of School Psychology 1997, 35:61-79. doi: 10.1016/S0022-4405(96)00029-5.
4. Birch S.H., Ladd G.W. Children's interpersonal behaviors and the teacher-child relationship. Developmental Psychology 1998, 34:934. doi: 10.1037/0012-1649.34.5.934.
5. Bradburn N.M., Sudman S., Wansink B. Asking questions: The definitive guide to questionnaire design - for market research, political polls, and social and health questionnaires 2004, Jossey-Bass, San Francisco, CA. Rev. 1st ed.
6. Cacioppo J.T., Berntson G.G. Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. Psychological Bulletin 1994, 115:401-423. doi: 10.1037/0033-2909.115.3.401.
7. Clark L.A., Watson D. Constructing validity: Basic issues in objective scale development. Psychological Assessment 1995, 7:309-319. doi: 10.1037/1040-3590.7.3.309.
8. Comrey A.L. Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology 1988, 56:754-761. doi: 10.1037/0022-006X.56.5.754.
9. DeVellis R.F. Scale development: Theory and applications 2003, Sage, Newbury Park, CA. 2nd ed.
10. Dillman D.A., Smyth J.D., Christian L.M. Internet, mail, and mixed-mode surveys: The tailored design method 2009, Wiley, Hoboken, NJ. 3rd ed.
11. Fowler F.J. Survey research methods 2009, Sage, Thousand Oaks, CA. 4th ed.
12. Goodenow C. Classroom belonging among early adolescent students: Relationships to motivation and achievement. The Journal of Early Adolescence 1993, 13:21-43. doi: 10.1177/0272431693013001002.
13. Hinkin T.R. A review of scale development practices in the study of organizations. Journal of Management 1995, 21:967-988. doi: 10.1177/014920639502100509.
14. Karabenick S.A., Woolley M.E., Friedel J.M., Ammon B.V., Blazevski J., Bonney C.R., Kelly K.L. Cognitive processing of self-report items in educational research: Do they think what we mean?. Educational Psychologist 2007, 42:139-151. doi: 10.1080/00461520701416231.
15. Krosnick J.A. Survey research. Annual Review of Psychology 1999, 50:537-567. doi: 10.1146/annurev.psych.50.1.537.
16. McIver J.P., Carmines E.G. Unidimensional scaling 1981, Sage, Beverly Hills, CA.
17. McKenzie J.F., Wood M.L., Kotecki J.E., Clark J.K., Brey R.A. Establishing content validity: Using qualitative and quantitative steps. American Journal of Health Behavior 1999, 23:311-318.
18. Messick S. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist 1995, 50:741-749. doi: 10.1037/0003-066X.50.9.741.
19. Murdock T.B., Anderman L.H., Hodge S.A. Middle-grade predictors of students' motivation and behavior in high school. Journal of Adolescent Research 2000, 15:327-351. doi: 10.1177/0743558400153002.
20. Pianta R.C. Enhancing relationships between children and teachers 1999, American Psychological Association, doi: 10.1037/10314-000.
21. Pianta R.C. Student-Teacher Relationship Scale (STRS): Professional manual 2001, Psychological Assessment Resources, Lutz, FL.
22. Presser S., Couper M.P., Lessler J.T., Martin E., Martin J., Rothgeb J.M., Singer E. Methods for testing and evaluating survey questionnaires 2004, Wiley, Hoboken, NJ, doi: 10.1002/0471654728.
23. Rubio D.M., Berg-Weger M., Tebb S.S., Lee E.S., Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Social Work Research 2003, 27:94-104.
24. Simms L.J. Classical and modern methods of psychological scale construction. Social and Personality Psychology Compass 2008, 2:414-433. doi: 10.1111/j.1751-9004.2007.00044.x.
25. Simms L.J., Watson D. The construct validation approach to personality scale construction. Handbook of research methods in personality psychology 2007, 240-258. Guilford Press, New York, NY. R.W. Robins, R.C. Fraley, R.F. Krueger (Eds.).
26. Swain S.D., Weathers D., Niedrich R.W. Assessing three sources of misresponse to reversed Likert items. Journal of Marketing Research 2008, 45:116-131. doi: 10.1509/jmkr.45.1.116.
27. Tourangeau R., Rips L.J., Rasinski K.A. The psychology of survey response 2000, Cambridge University Press, New York, NY.
28. Veneziano L., Hooper J. Research notes. A method for quantifying content validity of health-related questionnaires. American Journal of Health Behavior 1997, 21:67-70.
29. Weng L.-J. Impact of the number of response categories and anchor labels on coefficient alpha and test-retest reliability. Educational and Psychological Measurement 2004, 64:956-972. doi: 10.1177/0013164404268674.
30. Wentzel K.R. Student motivation in middle school: The role of perceived pedagogical caring. Journal of Educational Psychology 1997, 89:411-419. doi: 10.1037/0022-0663.89.3.411.
31. Wentzel K.R. Are effective teachers like good parents? Teaching styles and student adjustment in early adolescence. Child Development 2002, 73:287-301. doi: 10.1111/1467-8624.00406.
32. Willis G.B. Cognitive interviewing: A tool for improving questionnaire design 2005, Sage, Thousand Oaks, CA.