Big data and the challenge of construct validity

Industrial and Organizational Psychology

Volumn 8, Issue 4, 2015, Pages 521-527

  Braun, Michael T ^a   Kuljanin, Goran ^b  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b DEPAUL UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84964584490     PISSN: 17549426     EISSN: 17549434     Source Type: Journal    
DOI: 10.1017/iop.2015.77     Document Type: Article

References (27)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
2. Anderson, T.W., & Rubin, H. (1956). Statistical inference in factor analysis. In J. Newman (Ed.), Proceedings of the third Berkeley Symposium onMathematical Statistics and Probability: Vol. 5. Contributions to econometrics, industrial research, and psychometry (pp. 111-150). Berkeley, CA: University of California Press.
3. Bagozzi, R. P., Yi, Y., & Phillips, L.W. (1991). Construct validity in organizational research. Administrative Science Quarterly, 36, 421-458.
4. Campbell, D. T., & Fiske, D.W. (1959). Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
5. Caputo, P., & Boyce, A. (2015, April). Data science in human capital research and analytics. Symposium presented at the 30th Annual Conference of the Society for Industrial and Organizational Psychology, Philadelphia, PA.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.).Hillsdale, NJ: Erlbaum.
7. Cronbach, L. J.,&Meehl, P. E. (1955).Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
8. Guzzo, R. A., Fink, A. A., King, E., Tonidandel, S., & Landis, R. S. (2015). Big data recommendations for industrial-organizational psychology. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8(4), 491-508.
9. Hernandez, I., Newman, D., & Jeon, G. (2015). Twitter analysis: Methods for data management and validation of aword count dictionary tomeasure city-level job satisfaction. In S. Tonidandel, E. King, & J. Cortina (Eds.), Big data at work:The data science revolution and organizational psychology. NewYork, NY: Routledge.
10. Hu, L., & Bentler, P. M. (1999). Cutoffcriteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
11. Ilgen, D. R., Hollenbeck, J. R., Johnson, M., & Jundt, D. (2005). Teams in organizations: From input-process-output models to IMOI models. Annual Review of Psychology, 56, 517-543.
12. Kennedy, D. M.,&McComb, S. A. (2014).When teams shift among processes: Insights from simulation and optimization. Journal of Applied Psychology, 99, 784-815.
13. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563-575.
14. Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26, 356-376.
15. Marsh, H.W., Hau, K., Balla, J. R., & Grayson, D. (1998). Is more ever too much: The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181-220.
16. McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
17. McGrath, J. E. (1964). Social psychology: A brief introduction. NewYork, NY:Holt, Rinehart andWinston.
18. Morgeson, F. P., DeRue, S., & Karam, E. P. (2010). Leadership in teams: A functional approach to understanding leadership structures and processes. Journal of Management, 36, 5-39.
19. Peter, J. P. (1981). Construct validity: A review of basic issues andmarketing practices. Journal of Marketing Research, 18, 133-145.
20. Roth, P. L. (1994). Missing data: A conceptual review for applied psychologists. Personnel Psychology, 47, 537-560.
21. Schwab, D., Heneman, H., & DeCotiis, T. (1975). Behaviorally anchored rating scales: A review of the literature. Personnel Psychology, 28, 549-562.
22. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
23. Smith, P. C., & Kendall, L. M. (1963). Re translation of expectations: An approach to the construction of unambiguous anchors to rating scales. Journal of Applied Psychology, 47, 149-155.
24. Thorndike, E. L. (1920). A constant error in psychological ratings. Journal of Applied Psychology, 4, 25-29.
25. Westen, D., & Rosenthal, R. (2003). Quantifying construct validity: Two simple measures. Journal of Personality and Social Psychology, 84, 608-618.
26. Widaman, K. F. (1985). Hierarchically nested covariance models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1-26.
27. Zwick, W. R.,&Velicer, W. F. (1986).Acomparison of five rules for determining the number of components to retain. Psychological Bulletin, 22, 432-442.