Empirical assessment of expertise

Human Factors

Volumn 45, Issue 1, 2003, Pages 104-114

  Weiss, David J ^a   Shanteau, James ^b  

^a CALIFORNIA STATE UNIVERSITY   (United States)

^b KANSAS STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MAN MACHINE SYSTEMS; PERFORMANCE; PERSONNEL TRAINING; PSYCHOLOGY COMPUTING;

EXPERT JUDGEMENT;

EXPERT SYSTEMS;

ACCURACY; BEHAVIOR; DECISION MAKING; EVALUATION; HUMAN; MEASUREMENT; REVIEW;

EID: 0037815338     PISSN: 00187208     EISSN: None     Source Type: Journal    
DOI: 10.1518/hfes.45.1.104.27233     Document Type: Review

References (37)

1. Ashby, F. G., & Maddox, W. T (1992). Complex decision rules in categorization: Contrasting novice and experienced performance. Journal of Experimental Psychology: Human Perception & Performance, 18, 50-71.
2. Ashton, A. H. (1985). Does consensus imply accuracy in accounting studies of decision making? Accounting Review, 60, 175-185.
3. Ashton, R. H. (2000). A review and analysis of research on the test-retest reliability of professional judgment. Journal of Behavioral Decision Making, 13, 277-294.
4. Bolger, E, & Wright, G. (1992). Reliability and validity in expert judgment. In G. Wright & F. Bolger (Eds.), Expertise and decision support (pp. 47-76). New York: Plenum.
5. Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78, 1-3.
6. Campbell, D. T, & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
7. Cochran, W. G. (1943). The comparison of different scales of measurement for experimental results. Annals of Mathematical Statistics, 14, 205-216.
8. Einhorn, H. J. (1972). Expert measurement and mechanical combination. Organizational Behavior and Human Performance, 7, 86-106.
9. Einhorn, H. J. (1974). Expert judgment: Some necessary conditions and an example, Journal of Applied Psychology, 59, 562-571.
10. Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptation to task constraints. Annual Review of Psychology, 47, 273-305.
11. Ericsson, K. A., & Smith, J. (1991). Prospects and limits in the empirical study of expertise: An introduction. In K. A. Ericsson & J. Smith (Eds.), Toward a general theory of expertise: Prospects and limits (pp. 1-38). Cambridge, UK: Cambridge University Press.
12. Ettenson, R. (1984). A schematic approach to the examination of the search for and use of information in expert decision making. Unpublished doctoral dissertation, Kansas State University, Manhattan, KS.
13. Ettenson, R., Shanteau, J., & Krogstad, J. (1987). Expert judgment: Is more information better? Psychological Reports, 60, 227-238.
14. Friel, B. M., Thomas, R. P., Shanteau, J., & Raacke, J. (2001). CWS applied to an air traffic control simulation task (CTEAM). In Proceedings of the 2001 International Symposium on Aviation Psychology [CD-ROM]. Columbus: Ohio State University.
15. Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103, 650-669.
16. Grubbs, F. E. (1973). Errors of measurement, precision, accuracy and the statistical comparison of measuring instruments. Technometrics, 15, 53-66.
17. Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevitable error, unavoidable injustice. New York: Oxford University Press.
18. Hoffrage, U., & Gigerenzer, G. (1998). Using natural frequencies to improve diagnostic inferences. Academic Medicine, 73, 538-540.
19. Lunney, G. H. (1970). Using analysis of variance with a dichotomous dependent variable: An empirical study. Journal of Educational Measurement, 7, 263-269.
20. Nagy, G. F. (1981). How are personnel selection decisions made? An analysis of decision strategies in a simulated personnel selection task. Unpublished doctoral dissertation, Kansas State University, Manhattan, KS.
21. O'Grady, K. E. (1982). Measures of explained variance: Cautions and limitations. Psychological Bulletin, 92, 766-777.
22. Phelps, R. H., & Shanteau, J. (1978). Livestock judges: How much information can an expert use? Organizational Behavior and Human Performance, 21, 209-219.
23. Russell, B. (1993). Sceptical essays. London: Routledge.
24. Schumann, D. E. W., & Bradley, R. A. (1959). The comparison of the sensitivities of similar experiments: Model II of the analysis of variance. Biometrics, 15, 405-416.
25. Shanteau, J. (1995). Expert judgment and financial decision making. In B. Green (Ed.), Risky business (pp. 16-32). Stockholm: University of Stockholm School of Business.
26. Shanteau, J. (2001). What does it mean when experts disagree? In E. Salas & G. Klein (Eds.), Linking expertise and naturalistic decision making (pp. 229-244). Mahwah, NJ: Erlbaum.
27. Shanteau, J., & Nagy, G. F. (1984). Information integration in person perception: Theory and application. In M. Cook (Ed.), Issues in person perception (pp. 48-86). London: Methuen.
28. Skånér, Y., Strender, L., & Bring, J. (1998). How do GPs use clinical information in the judgements of heart failure? Scandinavian Journal of Primary Health Care, 16, 95-100.
29. Swets, J. A. (1986). Indices of discrimination or diagnostic accuracy: Their ROC's and implied models. Psychological Bulletin, 99, 110-117.
30. Swets, J. A., Dawes, R. M., & Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1, 1-26.
31. Taylor, L. W. (1959). Physics: The pioneer science (Vol. 2). New York: Dover.
32. Thomas, R. P., & Pounds, J. (2002). Identifying performance in complex dynamic environments. Washington, DC: Federal Aviation Administration Office of Aviation Medicine.
33. Thomas, R. P., Willems, B., Shanteau, J., Raacke, J., & Friel, B. (2001). CWS applied to controllers in a high-fidelity simulation of air traffic control. In Proceedings of the 2001 International Symposium on Aviation Psychology [CD-ROM]. Columbus: Ohio State University.
34. Uebersax, J. S. (1993). Statistical modeling of expert ratings on medical treatment appropriateness. Journal of the American Statistical Association, 88, 421-427.
35. Weiss, D. J. (1985). SCHUBRAD: The comparison of the sensitivities of similar experiments. Behavior Research Methods, Instrumentation, and Computers, 17, 572.
36. Weiss, D. J. (1986). The discriminating power of ordinal data. Journal of Social Behavior and Personality, 1, 381-389.
37. Weiss, D. J., & Shanteau, J. (in press). The vice of consensus and the virtue of consistency. In K. Smith, J. Shanteau, & P. Johnson (Eds.), Psychological explorations of competent decision making. New York: Cambridge University Press.