Assessing diagnostic expertise of counselors using the Cochran-Weiss- Shanteau (CWS) index

Journal of Counseling and Development

Volumn 90, Issue 1, 2012, Pages 30-34

  Witteman, Cilia ^a   Weiss, David ^b   Metzmacher, Martin ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84857753459     PISSN: 07489633     EISSN: 15566676     Source Type: Journal    
DOI: 10.1111/j.1556-6676.2012.00005.x     Document Type: Article

References (32)

1. Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., & Nichols, C. S. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34, 341-382. doi:10.1177/0011000005285875 (Pubitemid 43537136)
2. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
3. Bachmann, L. M., Mühleisen, A., Bock, A., Ter Riet, G., Held, U., & Kessels, A. G. H. (2008). Vignette studies of medical choice and judgment to study caregivers' medical decision behaviour: Systematic review. BMC Medical Research Methodology, 8, 50-58. doi:10.1186/1471-2288-8-50
4. Cochran, W. G. (1943). The comparison of differential scales of measurement for experimental results. Annals of Mathematical Statistics, 14, 205-216.
5. Custers, E. J., Regehr, G., & Norman, G. R. (1996). Mental representations of medical diagnostic knowledge: A review. Academic Medicine, 71, S55-S61.
6. Dawson, V. L., Zeitz, C. M., & Wright, J. C. (1989). Expert-novice differences in person perception: Evidence of experts' sensitivities to the organization of behavior. Social Cognition, 7, 1-30.
7. Dougherty, M. R. P., Gronlund, S. D., & Gettys, C. F. (2003). Memory as a fundamental heuristic in decision making. In S. L. Schneider & J. Shanteau (Eds.), Emerging perspectives on judgment and decision research (pp. 125-164). Cambridge, England: Cambridge University Press.
8. Gaines, B. R. (1988). Positive feedback processes underlying the formation of expertise. IEEE Transactions on Systems, Man & Cybernetics, 18, 1016-1020. doi:10.1109/21.23101
9. Garb, H. N. (1989). Clinical judgment, clinical training, and professional experience. Psychological Bulletin, 105, 387-396.
10. Garb, H. N. (2005). Clinical judgment and decision making. Annual Review of Clinical Psychology, 1, 67-89. doi:10.1146/annurev.clinpsy.1.102803.143810 (Pubitemid 43843946)
11. Goodyear, R. K. (1997). Psychological expertise and the role of individual differences: An exploration of issues. Educational Psychology Review, 9, 251-265. doi:10.1023/A:1024787208551 (Pubitemid 127502365)
12. Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevitable error, unavoidable injustice. New York, NY: Oxford University Press.
13. Hasin, D. S., Goodwin, R. D., Stinson, F. S., & Grant, B. F. (2005). Epidemiology of major depressive disorder. Archives of General Psychiatry, 62, 1097-1106.
14. Hauser, S., Spada, H., Rummel, N., & Meier, A. (2006). Expertise development in clinical psychology. In R. Sun, N. Miyake, & C. D. Schunn (Eds.), Proceedings of the 28th annual conference of the Cognitive Science Society (pp. 1458-1463). Mahwah, NJ: Erlbaum.
15. Hillerbrand, E., & Claiborn, C. D. (1990). Examining reasoning skill differences between expert and novice counselors. Journal of Counseling & Development, 68, 684-691.
16. Hohenshil, T. H. (1996). Role of assessment and diagnosis in counseling. Journal of Counseling & Development, 75, 64-67. (Pubitemid 127002990)
17. Inquisit (Web version) [Computer software]. Seattle, WA: Millisecond Software.
18. Lambie, G. W., & Sias, S. M. (2009). An integrative psychological developmental model of supervision for professional school counselors-in- training. Journal of Counseling & Development, 87, 349-356.
19. Payton, M. E., Greenstone, M. H., & Schenker, N. (2003). Overlapping confidence intervals or standard error intervals: What do they mean in terms of statistical significance? Journal of Insect Science, 3, 34-40.
20. Rassafiani, M., Ziviani, J., Rodger, S., & Dalgleish, L. (2009). Identification of occupational therapy clinical expertise: Decision-making characteristics. Australian Occupational Therapy Journal, 56, 156-166. doi:10.1111/j.1440-1630.2007.00718.x
21. Renooij, S., & Witteman, C. L. M. (1999). Talking probabilities: Communicating probabilistic information with words and numbers. International Journal of Approximate Reasoning, 22, 169-194. doi:10.1016/S0888-613X(99)00027-4 (Pubitemid 129551146)
22. Shanteau, J. (1992). The psychology of experts: An alternative view. In G. Wright & F. Bolger (Eds.), Expertise and decision support (pp. 11-23). New York, NY: Plenum.
23. Shanteau, J., Friel, B., Thomas, R. P., Raacke, J., & Weiss, D. J. (2010). Assessing expertise when performance exceeds perfection. In E. S. Patterson & J. Miller (Eds.), Macrocognition metrics and scenarios: Design and evaluation for real-world teams (pp. 85-93). Burlington, VT: Ashgate.
24. Shanteau, J., Weiss, D. J., Thomas, R., & Pounds, J. (2002). Performance-based assessment of expertise: How can you tell if someone is an expert? European Journal of Operational Research, 136, 253-263. doi:10.1016/S0377-2217(01)00113-8 (Pubitemid 33018961)
25. Skånér, Y., Strender, L., & Bring, J. (1998). How do GPs use clinical information in the judgment of heart failure? Scandinavian Journal of Primary Health Care, 16, 95-100. doi:10.1080/028134398750003241 (Pubitemid 28346281)
26. Spengler, P. M., White, M. J., Ægisdóttir, S., Maugherman, A. S., Anderson, L. A., Cook, R. S., ? Rush, J. D. (2009). The meta-analysis of clinical judgment project: Effects of experience on judgment accuracy. The Counseling Psychologist, 37, 350-399. doi:10.1177/0011000006295149
27. Strasser, J., & Gruber, H. (2004). The role of experience in professional training and development of psychological counsellors. In H. P. A. Boshuizen, R. Bromme, & H. Gruber (Eds.), Professional learning: Gaps and transitions on the way from novice to expert (pp. 11-28). Dordrecht, The Netherlands: Kluwer Academic.
28. Weiss, D. J., Brennan, K., Thomas, R., Kirlik, A., & Miller, S. M. (2009). Criteria for performance evaluation. Judgment and Decision Making, 4, 164-174.
29. Weiss, D. J., & Shanteau, J. (2003). Empirical assessment of expertise. Human Factors, 45, 104-116. doi:10.1518/hfes.45.1.104.27233
30. Williams, C. A., Haslam, R. A., & Weiss, D. J. (2008). The Cochran-Weiss-Shanteau performance index as an indicator of upper limb risk assessment expertise. Ergonomics, 51, 1219-1237. doi:10.1080/00140130802087094
31. Witteman, C. L. M., Renooij, S., & Koele, P. (2007). Medicine in words and numbers: A cross-sectional survey comparing probability assessment scales. BMC Medical Informatics and Decision Making, 7, 1-8. doi:10.1186/1472-6947-7-13 (Pubitemid 47019836)
32. Witteman, C. L. M., & Van den Bercken, J. H. L. (2007). Intermediate effects in psychodiagnostic classification. European Journal of Psychological Assessment, 23, 56-61. doi:10.1027/1015-5759.23.1.56