Observed consultation: Confidence and accuracy of assessors

Advances in Health Sciences Education

Volumn 15, Issue 1, 2010, Pages 31-43

  Tweed, Mike ^a   Ingham, Christopher ^a  

^a UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

Accuracy; Assessment; Confidence; Consultation

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; DECISION MAKING; EDUCATION; HUMAN; MEDICAL EDUCATION; METHODOLOGY; OBSERVER VARIATION; RECALL; REPRODUCIBILITY; VIDEORECORDING;

CLINICAL COMPETENCE; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; JUDGMENT; MENTAL RECALL; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; VIDEOTAPE RECORDING;

EID: 75749152934     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-009-9163-5     Document Type: Article

References (36)

1. Adams, J. K. (1957). A confidence scale defined in terms of expected percentages. The American Journal of Psychology, 70(3), 432-436. doi: 10. 2307/1419580.
2. Adams, P. A., & Adams, J. K. (1960). Confidence in the recognition and reproduction of words difficult to spell. The American Journal of Psychology, 73(4), 544-552. doi: 10. 2307/1419942.
3. Adams, J. K., & Adams, P. A. (1961). Realism of confidence judgments. Psychological Review, 68(1), 33-45. doi: 10. 1037/h0040274.
4. Altman, D. G. (1991). Practical statistics for medical research. Boca Raton, Fla: Chapman & Hall/CRC.
5. Brenner, L. A., Koehler, D. J., Liberman, V., & Tversky, A. (1996). Overconfidence in probability and frequency judgments: A critical examination. Organizational Behavior and Human Decision Processes, 65(3), 212-219. doi: 10. 1006/obhd. 1996. 0021.
6. Busey, T. A., Tunnicliff, J., Loftus, G. R., & Loftus, E. F. (2000). Accounts of the confidence-accuracy relation in recognition memory. Psychonomic Bulletin & Review, 7(1), 26-48.
7. Cohen, L., Manion, L., & Morrison, K. (2000). Research methods in education. London: Routledge.
8. Dawes, R. M. (1979). Robust beauty of improper linear-models in decision-making. The American Psychologist, 34(7), 571-582. doi: 10. 1037/0003-066X. 34. 7. 571.
9. Einhorn, H. J. (1972). Expert measurement and mechanical combination. Organizational Behavior and Human Performance, 7(1), 86-106. doi: 10. 1016/0030-5073(72)90009-8.
10. Einhorn, H. J., & Hogarth, R. M. (1978). Confidence in judgment-persistence of illusion of validity. Psychological Review, 85(5), 395-416. doi: 10. 1037/0033-295X. 85. 5. 395.
11. Garb, H. N. (1986). The appropriateness of confidence ratings in clinical judgment. Journal of Clinical Psychology, 42(1), 190-197. doi: 10. 1002/1097-4679(198601)42: 1< 190:: AID-JCLP2270420133> 3. 0. CO; 2-6.
12. Gigerenzer, G., Hoffrage, U., & Kleinbolting, H. (1991). Probabilistic mental models-a brunswikian theory of confidence. Psychological Review, 98(4), 506-528. doi: 10. 1037/0033-295X. 98. 4. 506.
13. Grbich, C. (1999). Qualitative research in health: An introduction. St. Leonards, NSW: Allen & Unwin.
14. Hall, C. C., Ariss, L., & Todorov, A. (2007). The illusion of knowledge: When more information reduces accuracy and increases confidence. Organizational Behavior and Human Decision Processes, 103(2), 277-290. doi: 10. 1016/j. obhdp. 2007. 01. 003.
15. Harvey, N. (1997). Confidence in judgment. Trends in Cognitive Sciences, 1(2), 78-82. doi: 10. 1016/S1364-6613(97)01014-0.
16. Howley, L. D. (2004). Performance assessment in medical education-where we've been and where we're going. Evaluation & The Health Professions, 27(3), 285-303. doi: 10. 1177/0163278704267044.
17. Kahneman, D., & Tversky, A. (1973). Psychology of prediction. Psychological Review, 80(4), 237-251. doi: 10. 1037/h0034747.
18. Koehler, D. J., Brenner, L. A., Liberman, V., & Tversky, A. (1996). Confidence and accuracy in trait inference: Judgment by similarity. Acta Psychologica, 92(1), 33-57. doi: 10. 1016/0001-6918(95)00005-4.
19. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6(2), 107-118. doi: 10. 1037/0278-7393. 6. 2. 107.
20. Kramer, A., Muijtjens, A., Jansen, K., Dusman, H., Tan, L., & van der Vleuten, C. (2003). Comparison of a rational and an empirical standard setting procedure for an OSCE. Medical Education, 37(2), 132-139. doi: 10. 1046/j. 1365-2923. 2003. 01429. x.
21. Krug, K. (2007). The relationship between confidence and accuracy: Current thoughts of the literature and a new area of research. Applied Psychology in Criminal Justice, 3(1), 7-41.
22. Kunimoto, C., Miller, J., & Pashler, H. (2001). Confidence and accuracy of near-threshold discrimination responses. Consciousness and Cognition, 10(3), 294-340. doi: 10. 1006/ccog. 2000. 0494.
23. Lyle, J. (2003). Stimulated recall: A report on its use in naturalistic research. British Educational Research Journal, 29(6), 861-878.
24. McKinley, R. K., Fraser, R. C., & Baker, R. (2001). Model for directly assessing and improving clinical competence and performance in revalidation of clinicians. British Medical Journal, 322, 712-715.
25. Mirels, H. L., Greblo, P., & Dean, J. B. (2002). Judgmental self-doubt: Beliefs about one's judgmental prowess. Personality and Individual Differences, 33(5), 741-758.
26. Nelson, T. O. (1984). A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin, 95(1), 109-133.
27. Ng, C. S., & Palmer, C. R. (2007). Analysis of diagnostic confidence and diagnostic accuracy: A unified framework. British Journal of Radiology, 80(951), 152-160.
28. Norman, G., Bordage, G., Pages, G., & Keane, D. (2006). How specific is case specificity? Medical Education, 40(7), 618-623.
29. Oskamp, S. (1965). Overconfidence in case-study judgments. Journal of Consulting Psychology, 29(3), 261-265.
30. Paese, P. W., & Sniezek, J. A. (1991). Influences on the appropriateness of confidence in judgment-practice, effort, information, and decision-making. Organizational Behavior and Human Decision Processes, 48(1), 100-130.
31. Patterson, M. L., Foster, J. L., & Bellmer, C. D. (2001). Another look at accuracy and confidence in social judgments. Journal of Nonverbal Behavior, 25(3), 207-219.
32. Sawyer, J. (1966). Measurement and prediction clinical and statistical. Psychological Bulletin, 66(3), 178-200.
33. Shaughnessy, J. J. (1979). Confidence-judgment accuracy as a predictor of test-performance. Journal of Research in Personality, 13(4), 505-514.
34. Shynkaruk, J. M., & Thompson, V. A. (2006). Confidence and accuracy in deductive reasoning. Memory & Cognition, 34(3), 619-632.
35. Tweed, M., & Devadas, R. (2006). Factors to consider when assessing progress in observed consultation. Focus on Health Professional Education: A Multi-disciplinary Journal, 8(1), 64-75.
36. Wood, T. M., Humphrey-Murto, S., & Norman, G. (2006). Standard setting in a small scale OSCE: A comparison of the modified borderline-group method and the borderline regression method. Advances in Health Sciences Education, 11(2), 115-122.