When performance improvement is the goal: A new set of criteria for criteria

Journal of Applied Behavior Analysis

Volumn 31, Issue 2, 1998, Pages 263-280

  Komaki, Judith L ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Assessment; Dependent variable; Feedback; Measurement; Observation; Performance appraisal; Target behavior

Indexed keywords

EID: 0346992797     PISSN: 00218855     EISSN: None     Source Type: Journal    
DOI: 10.1901/jaba.1998.31-263     Document Type: Article

References (118)

1. After critical inquiry. (1992, April 7). The New York Times, p. A18.
2. Austin, J. T., Villanova, P., Kane, J. S., & Bernardin, H. J. (1991). Construct validation of performance measures: Definitional issues, development, and evaluation of indicators. Research in Personnel and Human Resources Management, 9, 159-233.
3. Ayllon, T., & Azrin, N. H. (1968). The token economy: A motivational system for therapy and rehabilitation. New York: Appleton-Century-Crofts.
4. Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91-97.
5. Baker, G., Gibbons, R., & Murphy, K. (1992). Subjective performance measures in optimal incentive contracts. Paper presented at Columbia University Workshop in Applied Microeconomics, New York.
6. Barron, F. (1955). The disposition toward originality. Journal of Abnormal and Social Psychology, 51, 478-485.
7. Bechtoldt, H. P. (1959). Construct validity: A critique. American Psychologist, 14, 619-629.
8. Bellack, A. S., & Hersen, M. (Eds.). (1988). Behavioral assessment: A practical handbook (3rd ed.). New York: Pergamon Press.
9. Bem, D. J., & Funder, D. C. (1978). Predicting more of the people more of the time: Assessing the personality of situations. Psychology Review, 85, 485-501.
10. Bernard, H. R., Killworth, P. D., & Sailer, L. (1979-1980). Informant accuracy in social network data IV: A comparison of clique-level structure in behavioral and cognitive network data. Social Network, 2, 191-218.
11. Bernardin, H. J., & Beatty, R. W. (1984). Performance appraisal: Assessing human behavior at work. Boston: Kent.
12. Binning, J. F., & Barrett, G. V. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478-494.
13. Bitner, M. J., Booms, B. H., & Tetreault, M. S. (1990). The service encounter: Diagnosing favorable and unfavorable incidents. Journal of Marketing, 54, 71-84.
14. Bloom, B. (1988). Health psychology: A psychological perspective. Englewood Cliffs, NJ: Prentice Hall.
15. Blum, M. L., & Naylor, J. C. (1968). Industrial psychology (rev. ed.). New York: Harper & Row.
16. Borman, W. C. (1991). Job behavior, performance, and effectiveness. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 271-326). Palo Alto, CA: Consulting Psychologists' Press.
17. Bormuth, J. R. (1970). On the theory of achievement test items. Chicago: University of Chicago Press.
18. Bridgman, P. W. (1927). The logic of modern physics. New York: Macmillan.
19. Brito v. Zia Co., 478 F.2d 1200 (10th Cir. 1973).
20. Brothers, K. J., Krantz, P. J., & McClannahan, L. E. (1994). Office paper recycling: A function of container proximity. Journal of Applied Behavior Analysis, 27, 153-160.
21. Bryant, A. (1995, October 15). Poor training and discipline at F.A.A. linked to 6 crashes. The New York Times, pp. A1, A16.
22. Burns, T. (1954). The directions of activity and communication in a departmental executive group. Human Relations, 7, 73-97.
23. Campbell, J. P. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 687-732). Palo Alto, CA: Consulting Psychologists Press.
24. Cardy, R. L., & Dobbins, G. H. (1994). Performance appraisal: Alternative perspectives. Florence, KY: South Western.
25. Cascio, W. F., & Bernardin, H. J. (1981). Implications of performance appraisal litigation for personnel decisions. Personnel Psychology, 34, 211-225.
26. Ciminero, A. R., Calhoun, K. S., & Adams, H. E. (Eds.). (1986). Handbook of behavioral assessment. New York: Wiley-Interscience.
27. Cone, J. D. (1980). Template matching procedures for idiographic behavioral assessment. Paper presented at the meeting of the Association for Advancement of Behavior Therapy, New York.
28. Cowan, G. S., Conger, J. C., & Conger, A. J. (1989). Social competency and social perceptivity in self and others. Journal of Psychopathology and Behavior Assessment, 11, 129-142.
29. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajarathnam, N. (1972). The dependability of behavioral measures. New York: Wiley.
30. Cushman, J. H., Jr. (1992, November 26). Delta given 2nd-largest fine for lax maintenance. The New York Times, p. A17.
31. Daniels, A. C. (1989). Performance management. Improving quality productivity through positive reinforcement. Tucker, GA: Performance Management Publications.
32. Datel, W. E., & Legters, L. (1971). The psychology of the Army recruit. Journal of Biological Psychology, 12(2), 34-40.
33. DeNisi, A. S. (1996). A cognitive approach to performance appraisal: A program of research. London: Routledge.
34. DeVries, D. L., Morrison, A. M., Shullman, S. L., & Gerlach, M. L. (1980). Performance appraisal on the line. Greensboro, NC: Center for Creative Leadership.
35. Doran, K. J. (1997, October 10). No equal candidates. Letter to editor; Merit test is divisive in affirmative action case. The New York Times, p. A22.
36. Dunnette, M. D. (1963). A note on the criterion. Journal of Applied Psychology, 47, 251-254.
37. Eichenwald, K. (1996, November 10). The two faces of Texaco. The New York Times, pp. E2, F10-11.
38. Finney, J. W. (1991). Selection of target behavior and interactions: A case study of necessary but insufficient choices. Journal of Applied Behavior Analysis, 24, 713-715.
39. Fisher, C. D. (1979). Transmission of positive and negative feedback to subordinates: A laboratory investigation. Journal of Applied Psychology, 64, 533-540.
40. Fleishman, E. A., & Quaintance, M. K. (1984). Taxonomies of human performance. The description of human tasks. New York: Academic Press.
41. Foster, S. L., & Cone, J. D. (1986). Design and use of direct observation procedures. In A. R. Ciminero, K. S. Calhoun, of H. E. Adams (Eds.), Handbook of behavioral assessment (2nd ed., pp. 253-324). New York: Wiley-Interscience.
42. Frederiksen, L. W. (Ed.). (1982). Handbook of organizational behavior management. New York: Wiley.
43. Geller, E. S. (1991). Where's the validity in social validity? Journal of Applied Behavior Analysis, 24, 179-184.
44. Ghiselli, E. E., Campbell, J. P., & Zedeck, S. (1981). Measurement theory for the behavioral sciences. San Francisco: Freeman.
45. Gilbert, T. F. (1978). Human competence. New York: McGraw-Hill.
46. Goldfried, M. R., & Kent, R. N. (1972). Traditional versus behavioral personality assessment: A comparison of methodological and theoretical assumptions. Psychological Bulletin, 77(6), 409-420.
47. Gottman, J. M. (1981). Time series analysis: A comprehensive introduction for social scientists. Cambridge, England: Cambridge University.
48. Green, C. W., & Reid, D. H. (1996). Defining, validating, and increasing indices of happiness among people with disabilities. Journal of Applied Behavior Analysis, 29, 67-78.
49. Hammer, M. (1985). Implications of behavioral and cognitive reciprocity in social data. Social Networks, 1, 189-201.
50. Hawkins, R. P. (1991). Is social validity what we are interested in? Argument for a functional approach. Journal of Applied Behavior Analysis, 24, 205-213.
51. Higgins, L. R. (1988). Maintenance engineering handbook. New York: McGraw-Hill.
52. Holmes, M. R., Hansen, D. J., & St. Lawrence, J. S. (1984). Conversational skill training with after care patients in the community: Social validation and generalization. Behavior Therapy, 15, 84-100.
53. Ilgen, D. R., & Knowlton, W. A., Jr. (1980). Performance attributional effects on feedback from superiors. Organizational Behavior and Human Performance, 25, 441-456.
54. James, L. R. (1973). Criterion models and construct validity for criteria. Psychological Bulletin, 80, 75-83.
55. Johnson, M. D., & Fawcett, S. B. (1994). Courteous service: Its assessment and modification in a human service organization. Journal of Applied Behavior Analysis, 27, 145-152.
56. Johnston, J. M., & Pennypacker, H. S. (1993). Strategies and tactics of human behavioral research (2nd ed.). Hillsdale, NJ: Erlbaum.
57. Kane, J. S., & Lawler, E. E. (1979). Performance appraisal effectiveness: Its assessment and determinants. In B. M. Staw (Ed.), Research in organizational behavior (Vol. 1, pp. 425-478). Greenwich, CT: JAI Press.
58. Kent, R. N., & Foster, S. L. (1977). Direct observational procedures: Methodological issues in naturalistic settings. In A. R. Ciminero, K. S. Calhoun, & H. E. Adams (Eds.), Handbook of behavioral assessment (pp. 279-328). New York: Wiley-Interscience.
59. Kerr, S. (1975). On the folly of rewarding A, while hoping for B. Academy of Management Journal, 18, 769-782.
60. Komaki, J. L. (1998). Leadership from an operant perspective. London: Routledge.
61. Komaki, J., Barwick, K. D., & Scott, L. R. (1978). A behavioral approach to occupational safety: Pinpointing and reinforcing safe performance in a food manufacturing plant. Journal of Applied Psychology, 63, 434-445.
62. Komaki, J., Blood, M. R., & Holder, D. (1980). Fostering friendliness in a fast-foods franchise. Journal of Organizational Behavior Management, 2, 151-164.
63. Komaki, J., & Collins, R. L. (1982). Motivation of preventive maintenance performance. In R. M. O'Brien, A. M. Dickinson, & M. Rosow (Eds.), Industrial behavior modification: A learning-based approach to business management (pp. 243-265). New York: Pergamon.
64. Komaki, J., Collins, R. L., & Penn, P. (1982). Role of performance antecedents and consequences in work motivation. Journal of Applied Psychology, 67, 334-340.
65. Komaki, J., Collins, R. L., & Temlock, S. (1987). An alternative performance measurement approach: Applied operant measurement in the service sector. Applied Psychology: International Review, 36, 71-89.
66. Komaki, J. L., Coombs, T., & Schepman, S. (1991). Motivational implications of reinforcement theory. In R. M. Steers & L. W. Porter (Eds.), Motivation and work behavior (5th ed., pp. 87-105). New York: McGraw-Hill.
67. Komaki, J. L., & Penn, P. (1982). Better business through behaviorism: Welcome to the real world of preventive maintenance. Behavior Therapist, 5, 159-163.
68. Landy, F. J., Barnes, J. L., & Murphy, K. R. (1978). Correlates of perceived fairness and accuracy of performance evaluation. Journal of Applied Psychology, 63, 751-754.
69. Landy, F. J., & Farr, J. L. (1983). The measurement of work performance: Methods, theory, and applications. New York: Academic Press.
70. Larson, J. R., Jr. (1986). Supervisors' performance feedback to subordinates: The impact of subordinate performance valence and outcome dependence. Organizational Behavior and Human Decision Processes, 37, 391-408.
71. Latham, G. P., & Wexley, K. N. (1994). Increasing productivity through performance appraisal (2nd ed.). Reading, MA: Addison-Wesley.
72. Lewis, D. R., & Dahl, T. (1976). Time management in higher education administration: A case study. Higher Education, 5, 49-66.
73. Liebert, R. M., & Liebert, L. L. (1995). Science and behavior: An introduction to methods of research (4th ed.). Englewood Cliffs, NJ: Prentice Hall.
74. Longenecker, C. O., Sims, H. P., Jr., & Gioia, D. A. (1987). Behind the mask: The politics of employee appraisal. The Academy of Management Executive, 1, 183-193.
75. Maggard, B. N., & Rhyne, D. M. (1992, fourth quarter). Total productive maintenance: A timely integration of production and maintenance. Production and Inventory Management Journal, pp. 6-10.
76. March, J. G., & Simon, H. (1958). Organizations. New York: Wiley.
77. Mash, E. J., & Terdal, L. G. (1981). Behavioral assessment of childhood disturbance. In E. J. Mash & L. G. Terdal (Eds.), Behavioral assessment of childhood disorders (pp. 3-78). New York: Guilford.
78. McCann, J. E., & Ferry, D. L. (1979). An approach for assessing and managing inter-unit interdependence. Academy of Management Review, 4, 113-119.
79. McClelland, D. C., Atkinson, J. W., Clark, R. A., & Lowell, E. L. (1953). The achievement motive. New York: Appleton-Century-Crofts.
80. Meyers, J. (1972). Fundamentals of experimental design. Boston: Allyn & Bacon.
81. Miller, L. K. (1997). Principles of everyday behavior analysis (3rd ed.). Pacific Grove, CA: Brooks/Cole.
82. Murphy, K. R., & Cleveland, J. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.
83. National Transportation Safety Board. (1994). National Transportation Safety Board annual report to Congress, 1993. Washington, DC: U.S. Government Printing Office.
84. Ola d'Aulaire, E., & Ola d'Aulaire, P. (1986). Their mission: Make damn sure nothing comes unraveled in the air. Smithsonian, 17, 48-54.
85. Price Waterhouse v. Hopkins, 490 U.S. 228 (1989).
86. Pritchard, R. D., Jones, S. D., Roth, P. L., Stuebing, K. K., & Ekeberg, S. E. (1988). Effects of group feedback, goal setting, and incentives on organizational productivity. Journal of Applied Psychology, 73, 337-358.
87. Reber, R. A., & Wallin, J. A. (1983). Validation of a behavioral measure of occupational safety. Journal of Organizational Behavior Management, 5(2), 69-77.
88. Salpukas, A. (1991, March 2). Eastern air admits to conspiracy. The New York Times, pp. 31, 42.
89. Schmitt, N. W., & Klimoski, R. J. (1991). Research methods in human resources management. Cincinnati: South-Western.
90. Schwartz, I. S., & Baer, D. M. (1991). Social validity assessments: Is current practice state of the art? Journal of Applied Behavior Analysis, 24, 189-204.
91. Selltiz, C., Wrightsman, L. S., & Cook, S. W. (Eds.). (1976). Research methods in social relations (3rd ed.). New York: Holt, Rinehart, and Winston.
92. Shaw, D. G., Schneier, C. E., Beatty, R. W, & Baird, L. S. (1995). The performance measurement, management, and appraisal sourcebook. Amherst, MA: Human Resource Development Press.
93. Shaw, M. E. (1973). Scaling group tasks: A method for dimensional analysis. JSAS Catalog of Selected Documents in Psychology, 3, 8.
94. Shore, B. A., Lerman, D. C., Smith, R. G., Iwata, B., & DeLeon, I. G. (1995). Direct assessment of quality of care in a geriatric nursing home. Journal of Applied Behavior Analysis, 28, 435-448.
95. Smith, P. C. (1976). Behaviors, results, and organizational effectiveness: The problem of criteria. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 745-776). Chicago: Rand McNally.
96. Southard, D. R., Winett, R. A., Walbert-Rankin, J. L., Neubauer, T. E., Donckers-Roserveare, K., Burkett, P. A., Gould, R. A., Lombard, D., & Moore, J. F. (1992). Increasing the effectiveness of the national cholesterol education program: Dietary and behavioral interventions for clinical settings. The Society of Behavioral Medicine, 14, 21-30.
97. Stone, E. F. (1978). Research methods in organizational behavior. Santa Monica, CA: Goodyear Publishing Co.
98. Sulzer-Azaroff, B., & Fellner, D. (1984). Searching for performance targets in the behavioral analysis of occupational health and safety. An assessment strategy. Journal of Organizational Behavior Management, 6, 53-65.
99. Tesser, A., & Rosen, S. (1975). The reluctance to transmit bad news (1). Athens: University of Georgia, Department of Psychology.
100. Thayer, P. W. (1992). Construct validation: Do we understand our criteria? Human Performance, 5, 97-108.
101. Thompson, J. D. (1967). Organizations in action. New York: McGraw-Hill.
102. Thorndike, R. L. (1949). Personnel selection. New York: Wiley.
103. Underwood, B. J. (1957). Psychological research. New York: Appleton-Century-Crofts.
104. Uniform Guidelines on Employee Selection Procedures, 43 Fed. Reg., 38290-38315 (1978).
105. U.S.A. v. City of Chicago, 573 F.2d 416 (7th Cir. 1978).
106. Victor, B., & Blackburn, R. S. (1987). Interdependence: An alternative conceptualization. Academy of Management Review, 12, 486-497.
107. Wald, M. L. (1996, May 5). No-frills airline safety. The New York Times, p. E22.
108. Weiner, E. (1990, December 15). Eastern airlines data said to be still falsified. The New York Times p. 21.
109. Weist, M. D., Ollendick, T. H., & Finney, J. W. (1991). Toward the empirical validation of treatment targets in children. Clinical Psychology Review, 11, 515-538.
110. Weitz, J. (1961). Criteria for criteria. American Psychologist, 16, 228-232.
111. Wilkinson, J. J. (1968, March-April). How to manage maintenance. Harvard Business Review, 46, pp. 100-111.
112. Williams, M. E. (Ed.). (1997). Discrimination: Opposing viewpoints. San Diego, CA: Greenhaven Press.
113. Winett, R. A., Moore, J. F., & Anderson, E. S. (1991). Extending the concept of social validity: Behavior analysis for disease prevention and health promotion. Journal of Applied Behavior Analysis, 24, 215-230.
114. Winett, R. A., & Winkler, R. C. (1972). Current behavior modification in the classroom: Be still, be quiet, be docile. Journal of Applied Behavior Analysis, 5, 499-504.
115. Wolf, M. M. (1978). Social validity: The case for subjective measurement, or how behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203-214.
116. Wolf, M. M., Kirigin, K. A., Fixsen, D. L., Blase, K. A., & Braukmann, C. J. (1995). The teaching-family model: A case study in data-based program development and refinement (and dragon wrestling). Journal of Organizational Behavior Management, 15, 11-68.
117. Zagat New York City restaurant survey: 1997. (1996). New York: Zagat Survey.
118. Zipser, A. (1996, August 26). Sunnier skies for TWA. Barrons, p. 10.