Performance appraisal of behavior-based competencies: A reliable and valid procedure

Personnel Psychology

Volumn 60, Issue 1, 2007, Pages 201-230

  Catano, Victor M ^a   Darr, Wendy ^b   Campbell, Catherine A ^b  

^a SAINT MARY S UNIVERSITY   (Canada)

^b ROYAL CANADIAN MOUNTED POLICE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33847129666     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2007.00070.x     Document Type: Article

References (51)

1. Arvey RD, Murphy KR. (1998). Performance evaluations in work settings. Annual Review of Psychology, 49, 141-168.
2. Atkins PWB, Wood RW. (2002). Self- versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. PERSONNEL PSYCHOLOGY, 55, 871-904.
3. Beehr TA, Ivanitskaya L, Hansen CP, Erofeev D, Gudanowski DM. (2001). Evaluation of 360 degree feedback ratings: Relationships with each other and with performance and selection predictors. Journal of Organizational Behavior, 22, 775-788.
4. Blau G. (1999). Testing the longitudinal impact of work variables and performance appraisal satisfaction on subsequent overall job satisfaction. Human Relations, 52, 1099-1113.
5. Bowman JS. (1999). Performance appraisal: Verisimilitude trumps veracity. Public Personnel Management, 28, 557-576.
6. Campion MA, Palmer DK, Campion JE. (1998). Structuring employment interviews to improve reliability, validity, and users' reactions. Current Directions in Psychological Science, 7, 77-82.
7. Catano & Associates. (1997). The RCMP NCO promotion system: Report of the external review team. Ottawa, ON: RCMP.
8. Cawley BD, Keeping LM, Levy PE. (1998). Participation in the performance appraisal process and employee reactions: A meta-analytic review of field investigations. Journal of Applied Psychology, 83, 615-633.
9. Cleveland JN, Murphy KR. (1992). Analyzing performance appraisals as goal-directed behavior. Research in Personnel and Human Resources Management, 10, 121-185.
10. Conway JM, Peneno GM. (1999). Comparing structured interview question types: Construct validity and applicant reactions. Journal of Business and Psychology, 13, 485-506.
11. Day DV, Sulsky LM. (1995). Effects of frame-of-reference training and rate information configuration on memory organization and rater accuracy. Journal of Applied Psychology, 80, 156-167.
12. Dubois D. (1993). Competency-based performance: A strategy for organizational change. Boston: HRD Press.
13. Farrell JN, McDaniel MA. (2001). The stability of validity coefficients over time: Ackerman's (1988) model and the general aptitude test battery. Journal of Applied Psychology, 86, 60-79.
14. Fletcher C. (2001). Performance appraisal and management: The developing research agenda. Journal of Occupational and Organizational Psychology, 74, 473-487.
15. Fletcher C, Baldry C, Cunningham-Snell N. (1998). The psychometric properties of 360 degree feedback: An empirical study and cautionary tale. International Journal of Selection and Assessment, 6, 19-34.
16. Fletcher C, Perry EL. (2001). Performance appraisal and feedback: A consideration of national culture and a review of contemporary research and future trends. In Anderson ND, Ones DS, Sinangil HK, Viswesvaran C (Eds.). Handbook of industrial, work and organizational psychology (pp. 127-144). London: Sage.
17. Gilliland SW, Langdon JC. (1998). Creating performance management systems that promote perceptions of fairness. In Smither JW (Ed.), Performance appraisal: State of the art in practice (pp. 209-243). San Francisco: Jossey-Bass.
18. Gorsline K. (1996). A competency profile for human resources: No more shoemaker's children. Human Resource Management, 35, 53-66.
19. Himelfarb F. (1996). Training and executive development in the RCMP. Ottawa: RCMP.
20. Hough LM. (1984). Development and evaluation of the "accomplishment record" method of selecting and promoting professionals. Journal of Applied Psychology, 69, 135-146.
21. Huffcutt AI, Weekley JA, Wiesner WH, DeGroot TG, Jones C. (2001). Comparison of situational and behavior description interview questions for higher level positions. PERSONNEL PSYCHOLOGY, 54, 619-644.
22. Klein AL. (1996). Validity and reliability for competency-based systems: Reducing litigation risks. Compensation and Benefits Review, 28, 31-37.
23. Latham GP, Almost J, Mann S, Moore C. (2005). New developments in performance management. Group Dynamics, 34, 77-87.
24. Latham GP, Mann S. (2006). Advances in the science of performance appraisal: Implications for practice. International Review of Industrial and Organizational Psychology, 21, 295-337.
25. Lievens F, Sanchez JI, De Corte W. (2004). Easing the inferential leap in competency modeling: The effects of task-related information and subject matter expertise. PERSONNEL PSYCHOLOGY, 57, 881-905.
26. Malos SB. (1998). Current legal issues in performance appraisal. In Smither JW (Ed.), Performance appraisal: State of the art in practice (pp. 49-94). San Francisco: Jossey-Bass.
27. McDaniel MA, Morgeson FP, Bruhn Finnegan E, Campion MA, Braverman EP. (2001). Use of situational judgement tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730-740.
28. Meyer HH. (1987). Predicting supervisory ratings versus promotional progress in test validation studies. Journal of Applied Psychology, 72, 696-697.
29. Milliman J, Nason S, Zhu C, De Cieri H. (2002). An exploratory assessment of the purposes of performance appraisals in North and Central America and the Pacific Rim. Asia Pacific Journal of Human Resources, 40, 105-122.
30. Motowildo SJ, Dunnette MD, Carter GW. (1990). An alternative selection procedure: The low fidelity simulation. Journal of Applied Psychology, 75, 640-647.
31. Motowidlo SJ, Tippins N. (1993). Further studies of the low-fidelity simulation in the form of a situational inventory. Journal of Occupational and Organizational Psychology, 66, 337-344.
32. Murphy KR, Cleveland JN. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.
33. st century workplace or just smoke. Paper presented at the 26th Annual IPMAAC Conference on Personnel Assessment, New Orleans.
34. Pulakos ED. (1991). Behavioral performance measures. In Jones J, Steffy BD, Bray DW (Eds.). Applying psychology in business: The handbook for managers and human resource professionals (pp. 307-313). New York: Lexington Books.
35. Pulakos E. (1997). Ratings of job performance. In Whetzell DL, Wheaton GR (Eds.), Applied measurement methods in industrial psychology (pp. 291-318) Palo Alto, CA: Davis-Black.
36. Pulakos ED, Schmitt N. (1995). Experience-based and situational interview questions: Studies of validity. PERSONNEL PSYCHOLOGY, 48, 289-308.
37. RCMP Human Resource Directorate. (1997). RCMP core competencies. Ottawa, ON: Royal Canadian Mounted Police.
38. RCMP Research Branch. (1999). RCMP corporal job simulation exercise: Cycle 3 (Technical Report). Ottawa, ON: RCMP.
39. Schmitt N, Gooding RZ, Noe RA, Kirsch M. (1984). Meta-analyses of validity studies between 1964 and 1982 and the investigation of study characteristics. PERSONNEL PSYCHOLOGY, 37, 407-422.
40. Schippmann JS, Ash RA, Battista M, Carr L, Eyde LD, Hesketh B, et al. (2000). The practice of competency modeling. PERSONNEL PSYCHOLOGY, 53, 703-740.
41. Shaw DG, Schneier CE, Beatty RW. (1991). Managing performance with a behaviorally based appraisal system. In Jones J, Steffy BD, Bray DW (Eds.), Applying psychology in business: The handbook for managers and human resource professionals (pp. 314-325). New York: Lexington Books.
42. Shrout PE, Fleiss JL. (1979). Intraclass correlations: Uses in assessing rater reliability. Journal of Applied Psychology, 86, 420-428.
43. Slivinski L, Donoghue E, Chadwick M, Ducharme FA, Gavin DW, Lorimer A, et al. (1996). The wholistic competency profile: A model. Ottawa, ON: Staffing Policy and Program Development Directorate, Public Service Commission of Canada.
44. Smither JW. (1998). Lessons learned: Research implications for performance appraisal and management practice. In Smither JW(Ed.), Performance appraisal: State of the art in practice (pp. 537-547). San Francisco: Jossey-Bass.
45. Sturman MC, Cheramie RA, Cashen LH. (2005). The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings. Journal of Applied Psychology, 90, 269-283.
46. Tabachnik BG, Fidell LS. (2001). Using multivariate statistics, 4th ed. Boston: Allyn and Bacon.
47. Trainor NL. (1997). Five levels of competency. Canadian HR Reporter, 10, 12-13.
48. Tziner A, Latham GP, Price BS, Haccoun R. (1996). Development and validation of a questionnaire for measuring perceived political considerations in performance appraisal. Journal of Organizational Behavior, 17, 179-190.
49. Tziner A, Murphy KR. (1999). Additional evidence of attitudinal influences in performance appraisal. Journal of Business and Psychology, 13, 407-419.
50. Viswesvaran C, Ones DS, Schmidt FL. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-574.
51. Viswesvaran C, Schmidt FL, Ones DS. (2005). Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90, 108-131.