Construct Validation in Social and Personality Research: Current Practice and Recommendations

Social Psychological and Personality Science

Volumn 8, Issue 4, 2017, Pages 370-378

  Flake, Jessica K ^a   Pek, Jolynn ^a   Hehman, Eric ^b  

^a YORK UNIVERSITY   (Canada)

^b RYERSON UNIVERSITY   (Canada)

Author keywords

applied social psychology; measurement; personality; research methods

Indexed keywords

EID: 85021772639     PISSN: 19485506     EISSN: 19485514     Source Type: Journal    
DOI: 10.1177/1948550617693063     Document Type: Article

References (46)

1. Aiken L. S., West S. G., Millsap R. E., (2008). Doctoral training in statistics, measurement, and methodology in psychology. 63, 32–50. doi:10.1037/0003-066X.63.1.32
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: Joint Committee on Standards for Educational and Psychological Testing.
3. Benson J., (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17, 10–17.
4. Borsboom D., Mellenbergh G. J., (2004). The concept of validity. Psychological Review, 111, 1061–1071. doi:10.1037/0033-295X.111.4.1061
5. Campbell D. T., Fiske D. W., (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
6. Cheng J. T., Tracy J. L., (2014). Toward a unified science of hierarchy: Dominance and prestige are two fundamental pathways to human social rank. In Anderson C., (Ed.), The psychology of social status (pp. 3–28). New York, NY: Springer. Retrieved from http://doi.org/10.1007/978-1-4939-0867-7
7. Chmielewski M., Sala M., Tang R., Baldwin A., (2016). Examining the construct validity of affective judgments of physical activity measures. Psychological Assessment, 28, 1128–1141.
8. Chmielewski M., Watson D., (2009). What is being assessed and why it matters: The impact of transient error on trait research. Journal of Personality and Social Psychology, 97, 186–202. doi:10.1037/a0015618
9. Clark L. A., Watson D., (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309–309.
10. Cortina J. M., (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98–104.
11. Crocker L. M., Algina J., (2006). Introduction to classical and modern test theory. Belmont, CA: Wadsworth Publishing Company.
12. Cronbach L. J., (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
13. Cronbach L. J., Meehl P. E., (1955). Construct validity in psychological science. Psychological Bulletin, 52, 281–302.
14. Cumming G., (2014). The new statistics: Why and how. doi:10.1177/0956797613504966
15. Dawis R. V., (1987). Scale construction. Journal of Counseling Psychology, 34, 481–489. doi:10.1037//0022-0167.34.4.481
16. Diamantopoulos A., Sarstedt M., Fuchs C., Wilczynski P., Kaiser S., (2012). Guidelines for choosing between multi-item and single-item scales for construct measurement: A predictive validity perspective. Journal of the Academy of Marketing Science, 40, 434–449. doi:10.1007/s11747-011-0300-3
17. Diener E. D., Emmons R. A., Larsen R. J., Griffin S., (1985). The satisfaction with life scale. Journal of Personality Assessment, 49, 71–75.
18. Eisinga R., Grotenhuis M., Pelzer B., (2013). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58, 637–642. doi:10.1007/s00038-012-0416-3
19. Fabrigar L. R., Wegener D. T., (2016). Conceptualizing and evaluating the replication of research results. Journal of Experimental Social Psychology, 66, 68–80. doi:10.1016/j.jesp.2015.07.009
20. Gehlbach H., Brinkworth M. E., (2011). Measure twice, cut down error: A process for enhancing the validity of survey scales. Review of General Psychology, 15, 380–387. doi:10.1037/a0025704
21. Graham J. M., (2006). Congeneric and (essentially) tau-equivalent estimates of score reliability. Educational and Psychological Measurement, 66, 930–944. doi:10.1177/0013164406288165
22. Hulleman C. S., Schrager S. M., Bodmann S. M., Harackiewicz J. M., (2010). A meta-analytic review of achievement goal measures: Different labels for the same constructs or different constructs with similar labels? Psychological Bulletin, 136, 422–449. doi:10.1037/a0018947
23. Kane M. T., (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1–73. doi:10.1111/jedm.12000
24. Loevinger J., (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694.
25. McCrae R. R., Kurtz J. E., Yamagata S., Terracciano A., (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15, 28–50. doi:10.1177/1088868310366253
26. Mcdonald R. P., (1999). Test homogeneity, reliability, and generalizability. In Test theory: A unified approach (pp. 76–120). Mahwah, NJ: Lawrence Erlbaum Associates.
27. Messick S., (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.
28. Millsap R. E., (2011). Statistical approaches to measurement invariance. Florence, KY: Routledge.
29. Moore D. A., (2016). Pre-register if you want to. American P Manuscript Manuscript, 71, 238–239. doi:10.1037/a0040195
30. Nosek B. A., Alter G., Banks G. C., Borsboom D., Bowman S. D., Breckler S. J., …Yarkoni T., (2015). Promoting an open research culture. Science, 348, 1422–1425. doi:10.1126/science.aab2374
31. Nunnally J., (1978). Psychometric methods. New York, NY: McGraw-Hill.
32. Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716–aac4716. doi:10.1126/science.aac4716
33. Pashler H., Wagenmakers E. J., (2012). Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science, 7, 528–530. doi:10.1177/1745691612465253
34. Raykov T., Marcoulides G. A., (2011). Introduction to psychometric theory. New York, NY: Routledge.
35. Robins R. W., Hendin H. M., Trzesniewski K. H., (2001). Measuring global self-esteem: Construct validation of a single-item measure and the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin, 27, 151–161. doi:10.1177/0146167201272002
36. Schmitt N., (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350–353.
37. Sijtsma K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika, 74, 107–120.
38. Sijtsma K., (2016). Playing with data: Or how to discourage questionable research practices and stimulate researchers to do things right. Psychometrika, 81, 1–15. doi:10.1007/s11336-015-9446-0
39. Simmons J. P., Nelson L. D., Simonsohn U., (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. doi:10.1177/0956797611417632
40. Sireci S. G., (1998). The construct of content validity. Social Indicators Research, 45, 83–117.
41. Strauss M. E., Smith G. T., (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 25. doi:10.1146/annurev.clinpsy.032408.153639
42. Van Bavel J. J., Mende-siedlecki P., Brady W. J., Reinero D. A., (2016). Contextual sensitivity in scientific reproducibility. Proceedings of the National Academy of Sciences of the United States of America, I, 6454–6459. doi:10.1073/pnas.1521897113
43. Weidman A. C., Steckler C. M., Tracy J. L., (2016). The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research. Emotion. Advance online publication. doi:10.1037/emo0000226
44. Wilkinson L., & Task Force on Statisical Inference. (1999). Statistical methods in psychology journals. American Psychologist, 54, 594–604. doi:10.1037/0003-066X.54.8.594
45. Willis G. B., (2004). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage.
46. Yang Y., Green S. B., (2011). Coefficient alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29, 377–392. doi:10.1177/0734282911406668