The critical role of the research question, inclusion criteria, and transparency in meta-analyses of integrity test research: A Reply to Harris et al. (2012) and Ones, Viswesvaran, and Schmidt (2012)

Journal of Applied Psychology

Volumn 97, Issue 3, 2012, Pages 543-549

  Van Iddekinge, Chad H ^a   Roth, Philip L ^b   Raymark, Patrick H ^b   Odle Dusseau, Heather N ^c  

^a FLORIDA STATE UNIVERSITY   (United States)

^b CLEMSON UNIVERSITY   (United States)

^c GETTYSBURG COLLEGE   (United States)

Author keywords

Honesty; Integrity; Meta analysis; Personality tests; Personnel selection

Indexed keywords

ARTICLE; ETHICS; HUMAN; META ANALYSIS (TOPIC); METHODOLOGY; PERSONALITY TEST; PERSONNEL MANAGEMENT; STANDARD;

ETHICS; HUMANS; META-ANALYSIS AS TOPIC; PERSONALITY ASSESSMENT; PERSONNEL SELECTION; RESEARCH DESIGN;

EID: 84867069690     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0026551     Document Type: Letter

References (34)

1. Billings, S. W. (2001). Clarifications of the relationship between conscientiousness and integrity (Unpublished doctoral dissertation). Wayne State University.
2. Bobko, P., & Stone-Romero, E. F. (1998). Meta-analysis may be another useful research tool, but it is not a panacea. Research in Personnel and Human Resources Management, 16, 359-397.
3. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, England: Wiley.
4. Camara, W. J., & Schneider, D. L. (1995). Questions of construct breadth and openness of research in integrity testing. American Psychologist, 50, 459-460. doi:10.1037/0003-066X.50.6.459
5. Dalton, D. R., & Metzger, M. B. (1993). Integrity testing for personnel selection: An unsparing perspective. Journal of Business Ethics, 12, 147-156. doi:10.1007/BF00871934
6. Hakstian, A. R., Farrell, S., & Tweed, R. G. (2002). The assessment of counterproductive tendencies by means of the California Psychological Inventory. International Journal of Selection and Assessment, 10, 58- 86. doi:10.1111/1468-2389.00194
7. Harris, W. G., Jones, J. W., Klion, R., Arnold, D. W., Camara, W., & Cunningham, M. R. (2012). Test publishers' perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012). Journal of Applied Psychology, 97, 531-536. doi:10.1037/a0024767
8. Huffcutt, A. I., & Arthur, W., Jr. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184-190. doi:10.1037/0021-9010.79.2.184
9. Hurtz, G. M., & Donovan, J. J. (2000). Personality and job performance: The Big Five revisited. Journal of Applied Psychology, 85, 869-879. doi:10.1037/0021-9010.85.6.869
10. Jones, J. W. (1980, October). Correlates of police misconduct: Violence and alcohol use on the job. Paper presented at the meeting of the Society of Police and Criminal Psychology, Atlanta, GA.
11. Karren, R. J., & Zacharias, L. (2007). Integrity tests: Critical issues. Human Resource Management Review, 17, 221-234. doi:10.1016/ j.hrmr.2007.03.007
12. Kpo, W. R., & Harris, W. G. (1986). Generalizability of an attitudinal behavioral measure of integrity. Paper presented at the meeting of the New England Psychological Association, Boston, MA.
13. Lilienfeld, S. O., Alliger, G., & Mitchell, K. (1995). Why integrity testing remains so controversial. American Psychologist, 50, 457-458. doi: 10.1037/0003-066X.50.6.457
14. McDaniel, M. A., & Jones, J. W. (1988). Predicting employee theft: A quantitative review of the validity of a standardized measure of dishonesty. Journal of Business and Psychology, 2, 327-345. doi:10.1007/ BF01013765
15. McDaniel, M. A., Rothstein, H. R., & Whetzel, D. L. (2006). Publication bias: A case study of four test vendors. Personnel Psychology, 59, 927-953. doi:10.1111/j.1744-6570.2006.00059.x
16. Morgeson, F. P., Campion, M. A., Dipboye, R. L., Hollenbeck, J. R., Murphy, K. R., & Schmitt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, 683-729. doi:10.1111/j.1744-6570.2007.00089.x
17. Murphy, K. R. (2000). What constructs underlie measures of honesty or integrity? In R. Goffin & E. Helmes (Eds.), Problems and solutions in human assessment: A festschrift to Douglas N. Jackson at seventy (pp. 265-283). London, England: Kluwer.
18. O'Bannon, R. M., Goldinger, L. A., & Appleby, G. S. (1989). Honesty and integrity testing: A practical guide. Atlanta, GA: Applied Information Resources.
19. Ones, D. S. (1993). The construct validity of integrity tests (Unpublished doctoral dissertation). University of Iowa.
20. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validates: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78, 679-703. doi:10.1037/0021-9010.78.4.679
21. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (2012). Integrity tests predict counterproductive work behaviors and job performance well: Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012). Journal of Applied Psychology, 97, 537-542. doi:10.1037/a0024825
22. Pollack, J. M., & McDaniel, M. A. (2008, April). An examination of the PreVisor Employment Inventory for publication bias. Paper presented at the convention of the Society for Industrial and Organizational Psychology, San Francisco, CA.
23. Roth, P. L., Bobko, P., & McFarland, L. A. (2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature. Personnel Psychology, 58, 1009 -1037. doi:10.1111/j.1744-6570.2005.00714.x
24. Rothstein, H. R. (1990). Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-327. doi:10.1037/0021-9010.75.3.322
25. Sackett, P. R. (2011). Integrity testing for personnel selection: The role of research methods. In M. A. Gernsbacher, R. W. Pew, L. M. Hough, & J. A. Pomerantz (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society (pp. 17-21). New York, NY: Worth.
26. Sackett, P. R., Burris, L. R., & Callahan, C. (1989). Integrity testing for personnel selection: An update. Personnel Psychology, 42, 491-529. doi:10.1111/j.1744-6570.1989.tb00666.x
27. Sackett, P. R., & Harris, M. M. (1984). Honesty testing for personnel selection: A review and critique. Personnel Psychology, 37, 221-245. doi:10.1111/j.1744-6570.1984.tb01447.x
28. Schmidt, F. L., Shaffer, J. A., & Oh, I.-S. (2008). Increased accuracy for range restriction corrections: Implications for the role of personality and general mental ability in job and training performance. Personnel Psychology, 61, 827-868. doi:10.1111/j.1744-6570.2008.00132.x
29. Schneider, B. M. (2002). Using the Big Five personality factors in the Minnesota Multiphasic Personality Inventory, California Psychological Inventory, and Inwald Personality Inventory to predict police performance (Unpublished doctoral dissertation). Florida International University, Miami.
30. Slora, K. B., Joy, D. S., Jones, J. W., & Terris, W. (1991). The prediction of on-the-job violence. In J. W. Jones (Ed.), Pre-employment honesty testing: Current research and future directions (pp. 171-183). Westport, CT: Quorum Books.
31. U.S. Congress, Office of Technology Assessment. (1990). The use of integrity tests for pre-employment screening (OTA-SET-442). Washington, DC: Government Printing Office.
32. Van Iddekinge, C. H., Roth, P. L., Raymark, P. H., & Odle-Dusseau, H. N. (2012). The criterion-related validity of integrity tests: An updated meta-analysis. Journal of Applied Psychology, 97, 499 -530. doi: 10.1037/a0021196
33. Wanek, J. E., Sackett, P. R., & Ones, D. S. (2003). Towards an understanding of integrity test similarities and differences: An item-level analysis of seven tests. Personnel Psychology, 56, 873- 894. doi: 10.1111/j.1744-6570.2003.tb00243.x
34. Wanous, J. P., Sullivan, S. E., & Malinak, J. (1989). The role of judgment calls in meta-analysis. Journal of Applied Psychology, 74, 259-264. doi:10.1037/0021-9010.74.2.259