From the work one knows the worker: A systematic review of the challenges, solutions, and steps to creating synthetic validity

International Journal of Selection and Assessment

Volumn 14, Issue 1, 2006, Pages 16-36

  Steel, Piers D G ^a   Huffcutt, Allen I ^b   Kammeyer Mueller, John ^c  

^a UNIVERSITY OF CALGARY   (Canada)

^b BRADLEY UNIVERSITY   (United States)

^c UNIVERSITY OF FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33845398300     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2006.00331.x     Document Type: Article

References (152)

1. Adler, P.S. (2004) The human resource business process outsourcing industry: The BP-exult partnership. Retrieved November 25, 2004, from http://ssrn.com/abstract=317502
2. Arthur, W. Jr., Spike, D.D. and Barrett, G.V. (1996) Development of a job-analysis based procedure for weighting and combining content-related tests into a single test battery score. Personnel Psychology, 49, 971-985.
3. Arvey, R.D., Salas, E. and Gialluca, K.A. (1992) Using task inventories to forecast skills and abilities. Human Performance, 5, 171-190.
4. Ashton, R.H. (2000) A review and analysis of research on the test-retest reliability of professional judgment. Journal of Behavioral Decision Making, 13, 277-294.
5. Avis, J.M., Kudisch, J.D. and Fortunato, V.J. (2002) Examining the incremental validity and adverse impact of cognitive ability and conscientiousness on job performance. Journal of Business and Psychology, 17, 87-105.
6. Balma, J.J. (1959) The development of processes for indirect or synthetic validity (a symposium): I. The concept of synthetic validity. Personnel Psychology, 12, 395-396.
7. Bar-On, R. (1997) The emotional quotient inventory (EQ-i): Technical manual. Toronto: Multi-Health Systems.
8. Barrick, M.R. and Mount, M.K. (1991) The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
9. Barrick, M.R., Mount, M.K. and Judge, T.A. (2001) The FFM personality dimensions and job performance: Meta-analysis of meta-analyses. International Journal of Selection and Assessment, 9, 9-30.
10. Beatty, R.W., Coleman, S.C. and Schneier, C.E. (1988) Human resource planning and staffing. In S. Gael (Ed.), The job analysis handbook for business, industry, and government (pp. 138-156). Toronto: John Wiley & Sons.
11. Blakely, B.R., Quińones, M.A., Crawford, M.S. and Jago, I.A. (1994) The validity of isometric strength tests. Personnel Psychology, 47, 247-274.
12. Bliesener, T. (1996) Methodological moderators in validating biographical data in personnel selection. Journal of Occupational and Organizational Psychology, 69, 107-120.
13. Borman, W.C. (1996) The occupational information network: An updated dictionary of occupational titles. Military Psychology, 8, 263-265.
14. Borzak, S. and Ridker, P.M. (1995) Discordance between meta-analyses and large-scale randomized, controlled trials. Annals of Internal Medicine, 123, 873-877.
15. Brannick, M.T. and Levine, E.L. (2002) Job analysis: Methods, research, and applications for human resource management in the new millennium. Thousand Oaks, CA: Sage.
16. Burke, M.J. (1993) Computerized psychological testing: Impacts on measuring predictor constructs and job behavior. In N. Schmitt and W.C. Borman (Eds.), Personnel selection: New perspectives from industrial and organizational psychology (pp. 203-239). San Francisco: Jossey-Bass.
17. Burke, M.J. and Pearlman, K. (1988) Recruiting, selecting, and matching people with jobs. In J.P. Campbell and R.J. Campbell (Eds.), Productivity in organizations (pp. 97-142). San Francisco: Jossey-Bass.
18. Camic, P.M. and Rhodes, J.E. (September, 2003) Blending and bending paradigms in large scale multi-site educational research. Paper presented at the British Educational Research Association Annual Conference, Heriot-Watt University, Edinburgh.
19. Campbell, J.P. (1990) Modeling the performance prediction problem in industrial and organizational psychology. In M.D. Dunnette and L.M. Houghs (Eds.), Handbook of industrial and organizational psychology (Vol. 1, pp. 687-732). Palo Alto, CA: Consulting Psychologist Press.
20. Campbell, J.P. (1999) The definition and measurement of performance in the new age. In D.R. Ilgen and E.D. Pulakos (Eds.), The changing nature of performance (pp. 399-429). San Francisco: Jossey-Bass.
21. Cappelli, P. (1995) Conceptual issues in developing a system for classifying occupations. Prepared for the U.S. Department of Labor, Washington DC. Unpublished manuscript.
22. Cascio, W.F. (1995) Whither industrial and organizational psychology in a changing world of work? American Psychologist, 50, 928-939.
23. Cascio, W.F., Alexander, R.A. and Barrett, G.V. (1988) Setting cutoff scores: Legal, psychometric, and professional issues and guidelines. Personnel Psychology, 41, 1-24.
24. Collins, L.M. and Horn, J.L. (1991) Best methods for the analysis of change. Washington, DC: American Psychological Association.
25. Converse, P.D., Oswald, F.L., Gillespie, M.A., Field, K.A. and Bizot, E.B. (2004) Matching individuals to occupations using abilities and the O * NET: Issues and an application in career guidance. Personnel Psychology, 57, 451-487.
26. Crocker, L.M. and Algina, J. (1986) Introduction to classical and modern test theory. Orlando, FL: Harcourt Brace Jovanovich.
27. Cummins, R.A. and Ballentine, R.D. (1996) Ability-requirement factors for general job elements. Military Psychology, 8, 219-234.
28. Cunningham, J.W. (1996) Generic job descriptors: A likely direction in occupational analysis. Military Psychology, 8, 247-262.
29. Cunningham, J.W., Powell, T.E., Wimpee, WE., Wilson, M.A. and Ballentine, R.D. (1996) Ability-requirement factors for general job elements. Military Psychology, 8, 219-234.
30. Dawson, R.I. (1948) A new approach to test validation for clerical jobs. Unpublished doctoral dissertation, Purdue University, West Lafayette, Indiana.
31. D'Egidio, E.L. (2001) Building a job component validity model using job analysis data from the Occupational Information Network. Unpublished doctoral dissertation, University of Houston, Texas.
32. Dierdorff, E.C. and Wilson, M.A. (2003) A meta-analysis of job analysis reliability. Journal of Applied Psychology, 88, 635-646.
33. Dingfelder, S.F. (2005) The funding climate for behavioral science research is changing. How can psychological scientists adapt? Monitor on Psychology, 36(3), 22.
34. Dunnette, M.D. (1976) Aptitudes, abilities, and skill. In M.D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 473-520). Chicago: Rand McNally.
35. Eaton, L. (2002) Early periods and late childbearing increase risk of breast cancer, study confirms. British Medical Journal, 324, 386.
36. Field, A.P. (2001) Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed- and random-effects methods. Psychological Methods, 6, 161-180.
37. Fleishman, E.A. (1975) Toward a taxonomy of human performance. American Psychologist, 30, 725-747.
38. Fleishman, E.A. (1992) Fleishman-job analysis survey (F-JAS). Bethesda, MD: Management Research Institute.
39. Fleishman, E.A. (1999) Linking components of functional capacity domains with work requirements. In G.S. Wunderlich (Ed.), Measuring functional capacity and work requirements: Summary of a workshop (pp. 36-39). Washington, DC: National Academy Press.
40. Fleishman, E.A., Gebhardt, D.L. and Hogan, J.C. (1984) The measurement of effort. Ergonomics, 27, 947-954.
41. Friedman, L. (1990) Degree of redundancy between time, importance, and frequency task ratings. Journal of Applied Psychology, 75, 748-752.
42. Gatewood, R.D. and Feild, H.S. (1994) Human resource selection (3rd Edn.). New York: Harcourt Brace.
43. Gibson, S.G., Harvey, R.J. and Quintela, Y. (2004, April) Holistic versus decomposed ratings of general dimensions of work activity. Paper presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
44. Guion, R.M. (1965) Synthetic validity in a small company: A demonstration. Personnel Psychology, 18, 49-63.
45. Gutenberg, R.L., Arvey, R.D., Osburn, H.G. and Jeanneret, P.R. (1983) Moderating effects of decision-making/information-processing job dimensions on test validities. Journal of Applied Psychology, 68, 602-608.
46. Hamilton, J.W. (1981) Options for small sample sizes: A case for the J-coefficient. Personnel Psychology, 34, 805-816.
47. Handler, C.A. (March, 2001) Internet-based personality testing as an employee selection tool: Context, trends, and recommendations. Presented at the Annual Conference of the Society for Personality Assessment, Philadelphia, PA.
48. Harvey, R.J. (1991) Job analysis. In M.D. Dunnette and L. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 2, pp. 71-163). Palo Alto, CA: Consulting Psychologists Press.
49. Harvey, R.J. (1993) Research monograph: The development of the Common Metric Questionnaire (CMQ). Retrieved December 5, 2003, from http://harvey.psyc.vt.edu/Documents/monograph.pdf
50. Harvey, R.J. (2003a) The Common-Metric Questionnaire [Computer software]. Retrieved December 5, 2003 from http://cmqonline.com/index.html
51. Harvey, R.J. (2003b) Applicability of binary IRT models to job analysis data. In A. Meade (Chair), Applications of IRT for measurement in organizations. Symposium presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
52. Harvey, R.J. and Wilson, M.A. (2000) Yes Virginia, there is an objective reality in job analysis. Journal of Organizational Behavior, 21, 829-854.
53. Harvey, R.J., Wilson, M.A. and Blunt, J.H. (1994) Rational/holistic versus empirical/decomposed methods of rating general work behaviors. Paper presented at the Annual Meeting of the Society for Industrial and Organizational Psychology.
54. Hoffman, C.C. (1999) Generalizing physical ability test validity: A case study using test transportability, validity generalization, and construct-related validity evidence. Personnel Psychology, 52, 1019-1041.
55. Hoffman, C.C. and McPhail, S.M. (1998) Exploring options for supporting test use in situations precluding local validation. Personnel Psychology, 51, 987-1003.
56. Hogan Selection Systems (2000) Validity of Hogan personality inventory for selecting sales people at [company]. Retrieved April 7, 2005, from http://www.assessmentsystems.cz/2004/KNIHOVNA/Validity_sales_0800.doc
57. Hollander, E. and Harvey, R.J. (2002) Comparison of O * NET holistic versus graphic rating formats. In M.A. Wilson (Chair), The O * NET; Mend it, or end it? Symposium presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Toronto, ON.
58. Hollenbeck, J.R. and Whitener, E.M. (1988) Criterion-related validation for small sample contexts: An integrated approach to synthetic validity. Journal of Applied Psychology, 73, 536-544.
59. Huffcutt, A.I., Roth, P.L. and McDaniel, M.A. (1996) A meta-analytic investigation of cognitive ability in employment interview evaluations moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459-473.
60. Hugh, G.L. and Prien, E.P. (1989) Evaluation of task and job skill linkage judgments used to develop test specifications. Personnel Psychology, 42, 283-292.
61. Hulin, C.L., Henry, R.A. and Noon, S.L. (1990) Adding a dimension: Time as a factor in the generalizability of predictive relationships. Psychological Bulletin, 107, 328-340.
62. Hunter, J.E. and Hunter, R.F. (1984) Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
63. Hunter, J.E. and Schmidt, F.L. (1982) Fitting people to jobs: The impact of personnel selection on national productivity. In M.D. Dunnette and E.A. Fleishman (Eds.), Human performance and productivity: Vol. 1. Human capability assessment (pp. 223-272). Beverly Hills, CA: Sage.
64. Hunter, J.E. and Schmidt, F.L. (1990) Methods of meta-analysis: Correcting for error and bias in research findings across studies. Beverly Hills, CA: Sage.
65. Hunter, J.E. and Schmidt, F.L. (1994) Correcting for sources of artificial variation across studies. In H. Cooper and L.V. Hedges (Eds.), The handbook of research synthesis (pp. 323-337). New York: Russell Sage Foundation.
66. Hunter, J.E. and Schmidt, F.L. (1996) Intelligence and job performance: Economic and social implications. Psychology, Public Policy, and Law, 2, 447-472.
67. Hunter, J.E., Schmidt, F.L. and Judiesch, M.K. (1990) Individual differences in output variability as a function of job complexity. Journal of Applied Psychology, 75, 28-42.
68. Hunter, J.E., Schmidt, F.L. and Le, H. (in press) Implications of direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology.
69. Hurtz, G.M. and Donovan, J.J. (2000) Personality and job performance: The Big Five revisited. Journal of Applied Psychology, 85, 869-879.
70. Insel, T.R., Volkow, N.D., Landis, S.C., Li, T.-K., Battery, J.E Jr. and Sieving, P. (2004) Limits to growth: Why neuroscience needs large-scale science. Nature Neuroscience, 7, 426-427.
71. Jako, R.A. and Murphy, K.R. (1990) Distributional ratings, judgment decomposition, and their impact on interrater agreement and rating accuracy. Journal of Applied Psychology, 75, 500-505.
72. Jeanneret, P.R. (1992) Applications of job component/synthetic validity to construct validity. Human Performance, 5, 81-96.
73. Jeanneret, P.R., Borman, W.C., Kubisiak, U.C. and Hanson, M.A. (1999) Generalized work activities. In N.G. Peterson, M.D. Mumford, W.C. Borman, P.R. Jeanneret and E.A. Fleishman (Eds.), An occupational information systems for the 21st century: The development of the O * NET (pp. 105-125). Washington, DC: American Psychological Association.
74. Jeanneret, P.R. and Strong, M.H. (2003) Linking O * Net job analysis information to job requirement predictors: An O * Net application. Personnel Psychology, 56, 465-492.
75. Johnson, J.W. (2000) Factor analysis of importance ratings in job analysis: Note on the misinterpretation of Cranny and Doherty (1988). Organizational Research Methods, 3, 267-284.
76. Johnson, J.W., Carter, G.W. and Dorsey, D.W. (2004) Linking O * NET descriptors to occupational aptitudes using job component validation. Unpublished manuscript, Personnel Decisions Research Institutes, Inc.
77. Johnson, J.W., Carter, G.W., Davison, H.K. and Oliver, D.H. (2001) A synthetic validity approach to testing differential prediction hypotheses. Journal of Applied Psychology, 86, 774-780.
78. th Annual Conference of the Society of Industrial Organizational Psychology, San Diego, CA.
79. Jones, J.W. and Dages, K.D. (2003) Technology trends in staffing and assessment: A practical note. International Journal of Selection and Assessment, 11, 247-252.
80. Jones, B.E. and Malcolm, J.R. (1998) Aptitude test score validity: No moderating effect due to job ability requirement differences. Educational and Psychological Measurement, 58, 284-295.
81. Jöreskog, K.G. and Sörbom, D. (1993) LISREL 8: Structural equation modeling with the SIMPLIS command language. Chicago: Scientific Software International, Inc.
82. Kwiatkowski, R. (2003) Trends in organizations and selection: An introduction. Journal of Managerial Psychology, 18, 382-394.
83. Latham, G.P. and Sue-Chan, C. (1998) Selecting employees in the 21st century: Predicting the contribution of I-O psychology to Canada. Canadian Psychology, 39, 14-22.
84. Lawshe, C.H. (1952) What can industrial psychology do for small business? (a symposium). Personnel Psychology, 5, 31-34.
85. Lewis, J. (2000) Funding social science research in academia. Social Policy and Administration, 34, 365-376.
86. WG (J) indexes. Journal of Applied Psychology, 84, 640-647.
87. McCormick, E.J. (1959) The development of processes for indirect or synthetic validity: III. Application of job analysis to indirect validity (a symposium). Personnel Psychology, 12, 402-413.
88. McCormick, E.J. (1976) Job and task analysis. In M.D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 651-696). Chicago: Rand McNally.
89. McCormick, E.J., DeNisi, A.S. and Shaw, J.G. (1979) Use of the Position Analysis Questionnaire for establishing job component validity of tests. Journal of Applied Psychology, 63, 51-56.
90. Minnesota Department of Economic Security, Research and Statistics Office (2000) Minnesota's most marketable skills: The contribution of occupational skill requirements to wages and employment growth. Retrieved June 17, 2005, from http://www.deed.state.mn.us/lmi/publications/mms.htm
91. Morgeson, F.P. and Campion, M.A. (1997) Social and cognitive sources of potential inaccuracy in job analysis. Journal of Applied Psychology, 82, 627-655.
92. Morgeson, F.P. and Campion, M.A. (2000) Accuracy in job analysis: Towards an inference-based model. Journal of Organizational Behavior, 21, 819-827.
93. Morris, D.C., Hoffman, C.C. and Schulz, K.S. (2003) A comparison of job component validity estimates to meta-analytic validity estimates. Paper presented at the Annual Meeting of the Society for Industrial and Organizational Psychology.
94. Mossholder, K.W. and Arvey, R.D. (1984) Synthetic validity: A conceptual and comparative review. Journal of Applied Psychology, 69, 322-333.
95. Murphy, K.R. (2000) Impact of assessment of validity generalization and situational specificity on the science and practice of personnel selection. International Journal of Selection and Assessment, 8, 194-206.
96. Nicholls, R.W. (April, 2001) Research staff deserve better: Crucial long-term professionals at Canadian Universities face poor career prospects. University Affairs, 31, 38.
97. Nunnally, J.C. (1978) Psychometric theory (2nd Edn.). New York: McGraw-Hill.
98. Ones, D.S. and Viswesvaran, C. (2003) Job-specific applicant pools and national norms for personality scales: Implications for range-restriction corrections in validation research. Journal of Applied Psychology, 88, 570-577.
99. Outerbridge, A.N. (1979) A survey of test validation study costs (Technical Memorandum TM-79-18). Washington, DC: U.S. Office of Personnel Management, Personnel Research and Development Center (NTIS No. 80-127319).
100. Parker, S.K. and Wall, T.D. (2001) Work design: Learning from the past and mapping a new terrain. In N. Anderson, D.S. Ones, H.K. Sinangil and C. Viswesvaran (Eds.), Handbook of industrial, work & organizational psychology: Vol. 1, Personnel Psychology (pp. 90-109). Thousand Oaks, CA: Sage.
101. Peterson, N.G. and Bownas, D.A. (1982) Skill, task structure, and performance acquisition. In M.D. Dunnette and E.A. Fleishman (Eds.), Human performance and productivity: Vol. 1, Human capability assessment (pp. 49-105). Hillsdale, NJ: Lawrence Erlbaum.
102. Peterson, N.G., Wise, L.L., Arabian, J. and Hoffman, R.G. (2001) Synthetic validation and validity generalization: When empirical validation is not possible. In J.P. Campbell and D.J. Knapp (Eds.), Exploring the limits in personnel selection and classification (pp. 411-451). Washington, DC: American Institute for Research in Behavioral Sciences.
103. Phelps, R.P. (April, 1999) Education establishment bias? A look at the National Research Council's critique of test utility studies. Retrieved May 15, 2005 from http://siop.org/tip/backissues/Tipapr99/4Phelps.htm
104. Primoff, E.S. (1957) The J-coefficient approach to jobs and tests. Personnel Administration, 20, 31-40.
105. Primoff, E.S. and Fine, S.A. (1988) A history of job analysis. In S. Gael (Ed.), The job analysis handbook for business, industry, and government (pp. 14-29). Toronto: John Wiley & Sons.
106. Pritchard, R.D., Jones, S.D., Roth, P.J., Stuebing, K.J. and Ekeberg, S.E. (1988) Effects of group feedback, goal setting, and incentives on organizational productivity. Journal of Applied Psychology, 73, 337-358.
107. Rashkovsky, B. and Hoffman, C.C. (2005) Examining a potential extension of the JCV model to include personality predictors. Paper presented at the Annual Meeting of the Society for Industrial and Organizational Psychology.
108. Ratchford, J.T. and Colombo, U. (1996) Megascience. In H. Moore (Ed.), World science report 1996 (pp. 214-224). New York: UNESCO Publishing.
109. Robertson, I.T. and Smith, M. (2001) Personnel selection. Journal of Occupational and Organizational Psychology, 74, 441-472.
110. Rosenthal, R. and DiMatteo, M.R. (2001) Meta analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59-70.
111. Rotundo, M. and Sackett, P.R. (2002) The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: A policy-capturing approach. Journal of Applied Psychology, 87, 66-80.
112. Sackett, P. (1991) Exploring strategies for clustering military occupations. In A.K. Widgor and B.F. Green Jr. (Eds.), Performance assessment for the workplace: Vol. 2, Technical issues (pp. 305-332). Washington, DC: National Academy Press.
113. Sackett, P. and Dreher, G. (1981) Some misconceptions about content-oriented validation: A rejoinder to Norton. Academy of Management Review, 6, 567-568.
114. Sackett, P.R. and Ostgaard, D.J. (1994) Job-specific applicant pools and national norms for cognitive ability tests: Implications for range restriction corrections in validation research. Journal of Applied Psychology, 79, 680-684.
115. Salgado, J.F. (1998) Sample size in validity studies of personnel selection. Journal of Occupational and Organizational Psychology, 71, 161-164.
116. Salgado, J.F., Anderson, N., Moscoso, S., Bertua, C. and de Fruyt, F. (2003a) International validity generalization of GMA & cognitive abilities: A European Community meta-analysis. Personnel Psychology, 56, 573-605.
117. Salgado, J.E, Anderson, N., Moscoso, S., Bertua, C., de Fruyt, F. and Rolland, J.P. (2003b) A meta-analytic study of general mental ability validity for different occupations in the European community. Journal of Applied Psychology, 88, 1068-1081.
118. Salgado, J.F., Viswesvaran, C. and Ones, D.S. (2002) Predictors used for personnel selection: An overview of constructs, methods and techniques. In N. Anderson, D.S. Ones, H.K. Sinangil and C. Viswesvaran (Eds.), Handbook of industrial, work and organizational psychology: Vol. 1, Personnel psychology (pp. 165-199). London: Sage.
119. Sanchez, J.I. and Fraser, S.L. (1992) On the choice of scales for task analysis. Journal of Applied Psychology, 77, 545-553.
120. Scherbaum, C.A. (2005) Synthetic validity: Past, present, and future. Personnel Psychology, 58, 481-515.
121. Schmidt, EL. and Hunter, J. (1998) The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
122. Schmitt, N. and Fine, S.A. (1983) Inter-rater reliability of judgments of functional levels and skill requirements of jobs based on written task statements. Journal of Occupational Psychology, 56, 121-127.
123. Schmitt, N. and Landy, F.J. (1992) The concept of validity. In N. Schmitt and W.C. Borman (Eds.), Personnel selection (pp. 275-309). San Francisco: Jossey-Bass.
124. Schmitt, N. and Robertson, I. (1990) Personnel selection. Annual Review of Psychology, 41, 289-319.
125. Schneider, B., Smith, D.B. and Sipe, W.P. (2000) Personnel selection psychology: Multilevel considerations. In K.J. Kein and S.W.J. Koslowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 91-120). San Francisco: Jossey-Bass.
126. Sharpe, D. (1997) Of apples and oranges, file drawers and garbage: Why validity issues in meta-analysis will not go away. Clinical Psychology Review, 17(8), 881-901.
127. Shultz, K.S., Riggs, M.L. and Kottke, J.L. (1999) The need for an evolving concept of validity in industrial and personnel psychology: Psychometric, legal, and emerging issues. Current Psychology, 17, 265-286.
128. Smith, P.C. (1976) Behavior; results, and organizational effectiveness: The problem of criteria. In M.D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 745-775). Palo Alto, CA: Consulting Psychologists Press.
129. Society for Industrial and Organizational Psychology, Inc. (2003) Principles for the validation and use of personnel selection procedures (4th Edn.). Retrieved April 12, 2004, from http://www.siop.org/_Principles/ principlesdefault.htm
130. Sparrow, J. (1989) The utility of PAW in relating jobs behavior to traits. Journal of Occupational Psychology, 62, 151-162.
131. Steel, P. and Kammeyer-Mueller, J.D. (2002) Comparing meta-analytic moderator estimation techniques under realistic conditions. Journal of Applied Psychology, 87, 96-111.
132. Tabachnick, B.G. and Fidell, L.S. (1989) Using multivariate statistics (2nd Edn.). New York; HarperCollins.
133. Tenopyr, M.L. (1996) The complex interaction between measurement and national employment policy. Psychology, Public Policy, and Law, 2, 348-362.
134. Thoresen, C.J., Kaplan, S.A., Barsky, A.P., Warren, C.R. and de Chermont, K. (2003) The affective underpinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129, 914-945.
135. Trattner, N.H. (1982) Synthetic validity and its application to the uniform guidelines validation requirements. Personnel Psychology, 35, 383-397.
136. Trattner, N.H., Fine, S.A. and Kubis, J.F. (1955) A comparison of worker requirement ratings made by reading job descriptions and by direction observation. Personnel Psychology, 8, 183-194.
137. Uniform guidelines on employee selection procedures. (1978) Federal Register, 43(166), 38290-39309.
138. Viswesvaran, C. (2002) Assessment of individual job performance: A review of the past century and a look ahead. In N. Anderson, D.S. Ones, H.K. Sinangil and C. Viswesvaran (Eds.), Handbook of industrial, work and organizational psychology: Vol. 1, Personnel psychology (pp. 110-126). London: Sage.
139. Viswesvaran, C. (2003) Introduction to special issue: Role of technology in shaping the future of staffing and assessment. International Journal of Assessment, 11, 107-112.
140. Viswesvaran, C. and Ones, D.S. (2000) Perspectives on models of job performance. International Journal of Selection and Assessment, 8, 216-226.
141. Viswesvaran, C., Ones, D.S. and Schmidt, F. (1996) Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-560.
142. Viswesvaran, C., Schmidt, F. and Ones, D.S. (2002) The moderating influence of job performance dimensions on convergence of supervisory and peer ratings of job performance: Unconfounding construct-level convergence and rating difficulty. Journal of Applied Psychology, 87, 345-354.
143. Voskuijl, O.F. and Sliedregt, T. (2002) Determinants of interrater reliability of job analysis: A meta-analysis. European Journal of Psychological Assessment, 18, 52-62.
144. Wagner, T.A. and Harvey, R.J. (2004) Job-component validity using CMQ and O * NET: Assessing the additivity assumption. Poster session presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
145. Wagner, T.A. and Harvey, R.J. (2005) JCV predicting DOT workertrait requirements from CMQ job analysis ratings. Poster session presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA.
146. Wall, T.D. and Wood, S.J. (2005) The romance of HRM and business performance, and the case for big science. Unpublished manuscript, Institute of Work Psychology, University of Sheffield, UK.
147. Wenglinsky, H. (2003) Using large-scale research to gauge the impact of instructional practices on student reading comprehension: An exploratory study [Electronic Version]. Education Policy Analysis Archives, 11 (19). Retrieved April 6, 2005, from http://epaa.asu.edu/epaa/v11n19/
148. Wilk, S.L., Desmarais, L.B. and Sackett, P.R. (1995) Gravitation to jobs commensurate with ability: Longitudinal and cross-sectional tests. Journal of Applied Psychology, 80, 79-85.
149. Wilson, M.A., Harvey, R.J. and Macy, B. (1990) Repeating items to estimate the test-retest reliability of task inventory ratings. journal of Applied Psychology, 75, 158-163.
150. Wong, C. and Campion, M.A. (1991) Development and test of a task level model of motivational job design. Journal of Applied Psychology, 76, 825-837.
151. Wright, P.M. (1990) Operationalization of goal difficulty as a moderator of the goal difficulty/performance relationship. Journal of Applied Psychology, 75, 227-234.
152. Wykes, T. (2004) What kind of mental health research should we be doing in the 21st century? Mental health research networks. Journal of Mental Health, 13, 5-9.