Using G-Theory to Enhance Evidence of Reliability and Validity for Common Uses of the Paulhus Deception Scales

Assessment

Volumn 25, Issue 1, 2018, Pages 69-83

  Vispoel, Walter P ^a   Morris, Carrie A ^a   Kilinc, Murat ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

generalizability theory; PDS; reliability; socially desirable responding; validity

Indexed keywords

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; DECEPTION; FEMALE; HUMAN; IOWA; MALE; PERSONALITY TEST; PROBABILITY THEORY; PROCEDURES; PSYCHOMETRY; REPRODUCIBILITY; SOCIAL DESIRABILITY; STANDARDS; STUDENT; UNIVERSITY; YOUNG ADULT;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; DECEPTION; FEMALE; HUMANS; IOWA; MALE; PERSONALITY INVENTORY; PROBABILITY THEORY; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SOCIAL DESIRABILITY; STUDENTS; UNIVERSITIES; YOUNG ADULT;

EID: 85034986732     PISSN: 10731911     EISSN: 15523489     Source Type: Journal    
DOI: 10.1177/1073191116641182     Document Type: Article

References (52)

1. Alleyne E., Gannon T. A., Ciardha C. Ó., Wood J. L., (2014). Community males show multiple-perpetrator rape proclivity: Development and preliminary validation of an interest scale. Sexual Abuse: A Journal of Research and Treatment, 26, 82-104.
2. Becker G., (2000). How important is transient error in estimating reliability? Going beyond simulation studies. Psychological Methods, 5, 370-379.
3. Brennan R. L., (2001a). Generalizability theory. New York, NY: Springer.
4. Brennan R. L., (2001b). Manual for mGENOVA (Ver. 2.1). Iowa City: Iowa Testing Programs, University of Iowa.
5. Brennan R. L., (2001c). Manual for urGENOVA (Ver. 2.1). Iowa City: Iowa Testing Programs, University of Iowa.
6. Byrne B., (1996). Measuring self-concept across the lifespan. Washington, DC: American Psychological Association.
7. Cervellione K. L., Lee Y-S., Bonanno G. A., (2009). Rasch modeling of the Self-Deception Scale of the Balanced Inventory of Desirable Responding. Educational and Psychological Measurement, 69, 438-458.
8. Christopherson K-A., Helseth S., Lund T., (2008). A generalizability study of the Norwegian version of KINDL® in a sample of healthy adolescents. Quality of Life Research, 17, 87-93.
9. Crocker L., Algina J., (1986). Introduction to classical and modern test theory. Orlando, FL: Holt, Rinehart and Winston.
10. Cronbach L. J., Gleser G. C., Nanda H., Rajaratnam N., (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: Wiley.
11. Dunn T. J., Baguley T., Brunsden V., (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399-412.
12. Edwards A. L., (1957). The social desirability variable in personality assessment and research. New York, NY: Dryden.
13. Feldt L. S., Brennan R. L., (1989). Reliability. In Linn R. L., (Ed.), Educational measurement (3rd ed., pp. 105-146). New York, NY: Macmillan.
14. Freeman A. J., Schumacher J. A., Coffey S. F., (2015). Social desirability and partner agreement of men’s reporting of intimate partner violence in substance abuse treatment settings. Journal of Interpersonal Violence, 30, 565-579.
15. Gendreau P., Irvine M., Knight S., (1973). Evaluating response set styles on the MMPI with prisoners: Faking good adjustment and maladjustment. Canadian Journal of Behavioral Science, 5, 183-194.
16. Green S. B., Yang Y., (2009). Commentary on coefficient alpha: A cautionary tale. Psychometrika, 74, 121-135.
17. Haertel E., (2006). Reliability. In Brennan R. L., (Ed.), Educational measurement (4th ed., pp. 65-110). Westport, CT: Praeger.
18. Holden R. R., Kroner D. G., Fekken G. C., Popham S. M., (1992). A model of personality test item response dissimulation. Journal of Personality and Social Psychology, 63, 272-279.
19. Huang C., (2013). Relation between self-esteem and socially desirable responding and the role of socially desirable responding in the relation between self-esteem and performance. European Journal of Psychology of Education, 28, 663-683.
20. Kuentzel J. G., Henderson M. J., Melville C. L., (2008). The impact of social desirability biases on self-report among college student and problem gamblers. Journal of Gambling Studies, 24, 307-319.
21. Lowery A. E., Greenberg M. A., Foster S. L., Clark K., Casden D. R., Loscalzo M., Bardwell W. A., (2012). Validation of a need-based biopsychosocial distress instrument for cancer patients. Psycho-Oncology, 21, 1099-1106.
22. MacCallum R. C., Zhang S., Preacher K. J., Rucker D. D., (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19-40.
23. Mushquash C., O’Connor B. P., (2006). SPSS and SAS programs for generalizability theory analyses. Behavior Research Methods, 38, 542-547.
24. Neemann J., Harter S., (1986). Self-Perception Profile for College Students: Manual and questionnaires. Denver, CO: University of Denver.
25. Neemann J., Harter S., (2012). Self-Perception Profile for College Students: Manual and questionnaires (Rev. ed.). Denver, CO: University of Denver.
26. Nugent W. R., (2006). A psychometric study of the MPSI suicidal thoughts subscale. Stress, Trauma, and Crisis, 9, 1-15.
27. Paulhus D. L., (1991). Measurement and control of response bias. In Robinson J. P., Shaver P. R., Wrightsman L. S., (Eds.), Measures of personality and social psychological attitudes (pp. 17-59). San Diego, CA: Academic Press.
28. Paulhus D. L., (1999). Paulhus Deception Scales (PDS): The Balanced Inventory of Desirable Responding-7 (User’s manual). Toronto, Ontario, Canada: Multi-Health Systems.
29. Paulhus D. L., (2002). Socially desirable responding: The evolution of a construct. In Braun H., Jackson D., Wiley D., (Eds.), The role of constructs in psychological and educational measurement (pp. 39-69). Mahwah, NJ: Lawrence Erlbaum.
30. Paulhus D. L., Trapnell P. D., (2008). Self-presentation: An agency-communion framework. In John O. P., Robins R. W., Pervin L. A., (Eds.), Handbook of personality psychology (pp. 492-517). New York, NY: Guilford.
31. Paulhus D. L., Vazire S., (2007). The self-report method. In Robins R. W., Fraley R. C., Krueger R., (Eds.), Handbook of research methods in personality psychology (pp. 224-239). New York, NY: Guilford Press.
32. Penney S. R., Skilling T. A., (2012). Moderators of informant agreement in the assessment of adolescent psychopathology: Extension to a forensic sample. Psychological Assessment, 24, 386-401.
33. Posey C. D., Hess A. K., (1984). The fakability of subtle and obvious measures of aggression by male prisoners. Journal of Personality Assessment, 48, 137-144.
34. Reeve C. L., Heggestad E. D., George E., (2005). Estimation of transient error in cognitive ability scales. International Journal of Selection and Assessment, 13, 316-320.
35. Rulon P. J., (1939). A simplified procedure for determining the reliability of a test by split-halves. Harvard Educational Review, 9, 99-103.
36. Schmidt F. L., Le H., Ilies R., (2003). Beyond alpha: An empirical investigation of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206-224.
37. Schmitt N., (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350-353.
38. Schretlen D., Arkowitz H., (1990). A psychological test battery to detect prison inmates who fake insanity or mental retardation. Behavioral Sciences & the Law, 8, 75-84.
39. Shavelson R. J., Webb N. M., (1991). Generalizability theory: A primer (Vol. 1). Newbury Park, CA: Sage.
40. Shavelson R. J., Webb N. M., Rowley G. L., (1989). Generalizability theory. American Psychologist, 44, 922-932.
41. Sijtsma K., (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107-120.
42. Smith P. L., (1978). Sampling error of variance components in small sample multifacet generalizability designs. Journal of Educational Measurement, 3, 319-346.
43. Spearman C., (1904). The proof and measurement of association between two things. American Journal of Psychology, 15, 72-101.
44. Stöber J., Dette D. E., Musch J., (2002). Comparing continuous and dichotomous scoring of the balanced inventory of desirable responding. Journal of Personality Assessment, 78, 370-389.
45. Thorndike R. L., (1951). Reliability. In Lindquist E. F., (Ed.), Educational measurement (pp. 560-620). Washington, DC: American Council on Education.
46. Ting N., Burdick R. K., Graybill F. A., Jeyaratnam S., Lu T. F. C., (1990). Confidence intervals on linear combinations of variance components that are unrestricted in sign. Journal of Statistical Computation and Simulation, 35, 135-143.
47. Vispoel W. P., Forte Fast E. E., (2000). Response biases and their relations to sex differences in multiple domains of self-concept. Applied Measurement in Education, 13, 79-97.
48. Vispoel W. P., He Y., (2010, May). Evaluating the multifaceted, hierarchical structure of self-concept using the Self Description Questionnaire III (SDQ-III), Self-Perception Profile for College Students (SPPCS), and Arts Self-Perception Inventory (ASPI). Paper presented at the Annual Meeting of the American Educational Research Association, Denver, CO.
49. Vispoel W. P., Kim H. Y., (2014). Psychometric properties for the Balanced Inventory of Desirable Responding: Dichotomous versus polytomous conventional and IRT scoring. Psychological Assessment, 26, 878-891.
50. Vispoel W. P., Tao S., (2013). A generalizability analysis of score consistency for the Balanced Inventory of Desirable Responding. Psychological Assessment, 25, 94-104.
51. Webb N. M., Rowley G. L., Shavelson R. J., (1988). Using generalizability theory in counseling and development. Measurement and Evaluation in Counseling and Development, 21, 81-90.
52. Wiley E. W., Webb N. M., Shavelson R. J., (2013). The generalizability of test scores. In Geisinger K. F., Bracken B. A., Carlson J. F., Hansen J. I. C., Kuncel N. R., Reise S. P., Rodriguez M. C., (Eds.), APA handbook of testing and assessment in psychology: Vol 1: Test theory and testing and assessment in industrial and organizational psychology (3rd ed., pp. 43-60). Washington, DC: American Psychological Association.