Clinical psychology trainees' self versus supervisor assessments of practitioner competencies

Clinical Psychologist

Volumn 24, Issue 1, 2020, Pages 18-29

  Hitzeman, Cortney ^a   Gonsalvez, Craig J ^a   Britt, Eileen ^b   Moses, Karen ^a  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

clinical psychology competencies; therapist self assessment

Indexed keywords

ARTICLE; CLINICAL PSYCHOLOGY; HUMAN; MENTAL CAPACITY; PHYSICIAN; POSTGRADUATE STUDENT; RATING SCALE; RELIABILITY; SELF EVALUATION;

EID: 85066020323     PISSN: 13284207     EISSN: 17429552     Source Type: Journal    
DOI: 10.1111/cp.12183     Document Type: Article

References (66)

1. Belar, C. D., Brown, R. A., Hersch, L. E., Hornyak, L. M., Rozensky, R. H., Sheridan, E. P., … Reed, G. W. (2001). Self-assessment in clinical health psychology: A model for ethical expansion of practice. Professional Psychology: Research and Practice, 32(2), 135–141. https://doi.org/10.1037//0735-7028.32.2.135
2. Bernard, J. M., & Goodyear, R. K. (2014). Fundamentals of clinical supervision (5th ed.). New York, NY: Pearson.
3. Binks, C., Jones, F. W., & Knight, K. (2013). Facilitating reflective practice groups in clinical psychology training: A phenomenological study. Reflective Practice, 14(3), 305–318. https://doi.org/10.1080/14623943.2013.767228
4. Bol, L., & Hacker, D. J. (2012). Calibration research: Where do we go from here? Frontiers in Psychology, 3, 229. https://doi.org/10.3389/fpsyg.2012.00229
5. Borders, L. D. (2012). Dyadic, triadic, and group models of peer supervision/consultation: What are their components, and is there evidence of their effectiveness? Clinical Psychologist, 16(2), 59–71. https://doi.org/10.1111/j.1742-9552.2012.00046.x
6. Boud, D. (2013). Enhancing learning through self-assessment. London: Kogan Page. https://doi.org/10.4324/9781315041520
7. Boud, D., Keogh, R., & Walker, D. (2013). Reflection: Turning experience into learning. London: Kogan Page. https://doi.org/10.4324/9781315059051
8. Brosan, L., Reynolds, S., & Moore, R. G. (2008). Self-evaluation of cognitive therapy performance: Do therapists know how competent they are? Behavioural and Cognitive Psychotherapy, 36(05), 581–587. https://doi.org/10.1017/S1352465808004438
9. Cassidy, S. (2007). Assessing ‘inexperienced' students' ability to self-assess: Exploring links with learning style and academic personal control. Assessment & Evaluation in Higher Education, 32(3), 313–330. https://doi.org/10.1080/02602930600896704
10. Cooper, Z., Doll, H., Bailey-Straebler, S., Kluczniok, D., Murphy, R., O'Connor, M. E., & Fairburn, C. G. (2015). The development of an online measure of therapist competence. Behaviour Research and Therapy, 64, 43–48. https://doi.org/10.1016/j.brat.2014.11.007
11. Creed, T. A., Wolk, C. B., Feinberg, B., Evans, A. C., & Beck, A. T. (2016). Beyond the label: Relationship between community therapists' self-report of a cognitive behavioral therapy orientation and observed skills. Administration and Policy in Mental Health and Mental Health Services Research, 43(1), 36–43. https://doi.org/10.1007/s10488-014-0618-5
12. Deane, F. P., Gonsalvez, C., Joyce, C., & Britt, E. (2018). Developmental trajectories of competency attainment amongst clinical psychology trainees across field placements. Journal of Clinical Psychology, 74(9), 1641–1652. https://doi.org/10.1002/jclp.22619
13. Dunn, D. S., McEntarffer, R., & Halonen, J. S. (2004). Empowering psychology students through self-assessment. In D. S. Dunn, C. M. Mehrotra, & J. S. Halonen (Eds.), Measuring up: Assessment challenges and practices for psychology (pp. 171–186). Washington, DC: American Psychological Association. https://doi.org/10.1037/10807-000
14. Esposito, G., Freda, M. F., & Bosco, V. (2015). Examining perception of competency through practicum competencies outline. European Journal of Training and Development, 39(8), 700–720. https://doi.org/10.1108/EJTD-05-2015-0037
15. Eva, K. W., & Regehr, G. (2008). “I'll never play professional football” and other fallacies of self-assessment. Journal of Continuing Education in the Health Professions, 28(1), 14–19. https://doi.org/10.1002/chp.150
16. Faculty, A. C., & Loacker, G. (2000). Self assessment at Alverno College. Milwaukee, WI: Alverno College Institute. https://doi.org/10.1037/a0019654
17. Falender, C. A., & Shafranske, E. P. (2004). Clinical supervision: A competency-based approach. Washington, DC: American Psychological Association. https://doi.org/10.1037/10806-000
18. Falender, C. A., & Shafranske, E. P. (2007). Competence in competency-based supervision practice: Construct and application. Professional Psychology: Research and Practice, 38, 232–240. https://doi.org/10.1037/0735-7028.38.3.232
19. Falender, C. A., & Shafranske, E. P. (2017). Competency-based clinical supervision: Status, opportunities, tensions, and the future. Australian Psychologist, 52, 86–93. https://doi.org/10.1111/ap.12265
20. Field, A. (2009). Discovering statistics using SPSS. London, England: Sage Publications. https://doi.org/10.1002/bjs.7040
21. Fitzgerald, J. T., Gruppen, L. D., & White, C. B. (2000). The influence of task formats on the accuracy of medical students' self-assessments. Academic Medicine, 75(7), 737, 1040–741, 2446.
22. Fouad, N. A., & Grus, C. L. (2014). Competency-based education and training in professional psychology. New York, NY: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199874019.013.0
23. Fouad, N. A., Grus, C. L., Hatcher, R. L., Kaslow, N. J., Hutchings, P. S., Madson, M. B., … Crossman, R. E. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3(4 Suppl), S5–S26. https://doi.org/10.1037/a0015832
24. Gonsalvez, C. J., Brockman, R., & Hill, H. R. M. (2016). Video feedback in CBT supervision: Review and illustration of two specific techniques. Cognitive Behaviour Therapist, 9, 1–15. https://doi.org/10.1017/S1754470X1500029X
25. Gonsalvez, C. J., Bushnell, J., Blackman, R., Deane, F., Bliokas, V., Nicholson-Perry, K., … Knight, R. (2013). Assessment of psychology competencies in field placements: Standardized vignettes reduce rater bias. Training and Education in Professional Psychology, 7(2), 99–111. https://doi.org/10.1037/a0031617
26. Gonsalvez, C. J., & Calvert, F. L. (2014). Competency-based models of supervision: Principles and applications, promises and challenges. Australian Psychologist, 49(4), 200–2008. https://doi.org/10.1111/ap.12265
27. Gonsalvez, C. J., & Crowe, T. P. (2014). Evaluation of psychology practitioner competence in clinical supervision. American Journal of Psychotherapy, 68(2), 177–193. https://doi.org/10.1080/10503307.2014.996795
28. Gonsalvez, C. J., Deane, F. P., Blackman, R., Matthias, M., Knight, R., Nasstasia, Y., … Bliokas, V. (2015). The hierarchical clustering of clinical psychology practicum competencies: A multisite study of supervisor ratings. Clinical Psychology: Science and Practice, 22(4), 390–403. https://doi.org/10.1111/cpsp.12123
29. Gonsalvez, C. J., Deane, F. P., & Caputi, P. (2016). Consistency of supervisor and peer ratings of assessment interviews conducted by psychology trainees. British Journal of Guidance & Counselling, 44(5), 516–529. https://doi.org/10.1080/03069885.2015.1068927
30. Gruppen, L. D., White, C., Fitzgerald, J. T., Grum, C. M., & Woolliscroft, J. O. (2000). Medical students' self-assessments and their allocations of learning time. Academic Medicine, 75(4), 374–379. https://doi.org/10.1097/00001888-200004000-00018
31. Haggerty, G., & Hilsenroth, M. J. (2011). The use of video in psychotherapy supervision. British Journal of Psychotherapy, 27, 193–210. https://doi.org/10.1111/j.1752-0118.2011.01232.x
32. Halonen, J. S., Bosack, T., Clay, S., McCarthy, M., Dunn, D. S., Hill, G. W., IV, … Weaver, K. A., IV. (2003). A rubric for learning, teaching, and assessing scientific inquiry in psychology. Teaching of Psychology, 30(3), 196–208. https://doi.org/10.1207/S15328023TOP3003_01
33. Hatcher, R. L., & Lassiter, K. D. (2007). Initial training in professional psychology: The practicum competencies outline. Training and Education in Professional Psychology, 1(1), 49–63. https://doi.org/10.1037/1931-3918.1.1.49
34. Hatcher, R. L., & Wise, E. H. (2014). In W. B. Johnson & N. J. Kaslow (Eds.), Practicum training in professional psychology. New York, NY: Oxford University Press. https://doi.org/10.1037/1931-3918.1.1.49
35. Hills, A. (2011). Foolproof guide to statistics using IBM SPSS (2nd ed.). Frenchs Forest: Pearson Australia.
36. Janke, K. (2012). Preparing health professional students for continuing education and continuing professional development. In Continuing professional development: Issues, impacts and outcomes (pp. 3–12). New York, NY: Nova Publishers. https://doi.org/10.1002/9780470690314.ch1
37. Juhani, T., Mika, H., & Esko, K. (2008). Psychology students' self-assessment of their professional skills: A Finnish case. Nordic Psychology, 60(4), 267–282. https://doi.org/10.1027/1901-2276.60.4.267
38. Kaslow, N. J., Celano, M. P., & Stanton, M. (2009). Training in family psychology: A competencies-based approach. Family Process, 44(3), 112–128. https://doi.org/10.1111/j.1545-5300.2005.00063
39. Kaslow, N. J., Grus, C. L., Campbell, L. F., Fouad, N. A., Hatcher, R. L., & Rodolfa, E. R. (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology, 3(4S), S27–S45. https://doi.org/10.1037/a0015833
40. Kaslow, N. J., Rubin, N. J., Bebeau, M. J., Leigh, I. W., Lichtenberg, J. W., Nelson, P. D., … Smith, I. L. (2007). Guiding principles and recommendations for the assessment of competence. Professional Psychology: Research and Practice, 38(5), 441–451. https://doi.org/10.1037/0735-7028.38.5.441
41. Knight, K., Sperlinger, D., & Maltby, M. (2010). Exploring the personal and professional impact of reflective practice groups: A survey of 18 cohorts from a UK clinical psychology training course. Clinical Psychology & Psychotherapy, 17(5), 427–437. https://doi.org/10.1002/cpp.660
42. Kun, A. I. (2016). A comparison of self versus tutor assessment among Hungarian undergraduate business students. Assessment & Evaluation in Higher Education, 41(3), 350–367. https://doi.org/10.1080/02602938.2015.1011602
43. Laitila, A., & Oranen, M. (2013). Focused dialogues in training contexts: A model for enhancing reflection in therapist's professional practice. Contemporary Family Therapy, 35(3), 599–612. https://doi.org/10.1007/s10591-013-9235-9
44. Lane, J. L., & Gottlieb, R. P. (2004). Improving the interviewing and self-assessment skills of medical students: Is it time to readopt videotaping as an educational tool? Ambulatory Paediatrics, 4(3), 244–248. https://doi.org/10.1367/A03-122R1.1
45. Loades, M. E., & Armstrong, P. (2016). The challenge of training supervisors to use direct assessments of clinical competence in CBT consistently: A systematic review and exploratory training study. The Cognitive Behaviour Therapist, 9(27), 1–20. https://doi.org/10.1017/S1754470X15000288
46. Loades, M. E., & Myles, P. J. (2016). Does a therapist's reflective ability predict the accuracy of their self-evaluation of competence in cognitive behavioural therapy? The Cognitive Behaviour Therapist, 9, 1–14. https://doi.org/10.1017/S1754470X16000027
47. Martin, P. R., Cairns, R., Lindner, H., Milgrom, J., Morrissey, S., & Ricciardelli, L. A. (2014). The training crisis in health psychology in Australia. Australian Psychologist, 49(2), 86–95. https://doi.org/10.1111/ap.12042
48. Mathieson, F. M., Barnfield, T., & Beaumont, G. (2010). Are we as good as we think we are? Self-assessment versus other forms of assessment of competence in psychotherapy. The Cognitive Behaviour Therapist, 2(1), 43–50. https://doi.org/10.1017/S1754470X08000081
49. McManus, F., Rakovshik, S., Kennerley, H., Fennell, M., & Westbrook, D. (2012). An investigation of the accuracy of therapists' self-assessment of cognitive-behaviour therapy skills. British Journal of Clinical Psychology, 51(3), 292–306. https://doi.org/10.1111/j.2044-8260.2011.02028.x
50. Milne, D. L., & Reiser, R. P. (2011). Observing competence in CBT supervision: A systematic review of the available instruments. The Cognitive Behaviour Therapist, 4(3), 89–100. https://doi.org/10.1017/S1754470X11000067
51. Neimeyer, G. J., Taylor, J. M., Rozensky, R. H., & Cox, D. R. (2014). The diminishing durability of knowledge in professional psychology: A second look at specializations. Professional Psychology: Research and Practice, 45(2), 92. https://doi.org/10.1037/a0020450
52. Orchowski, L., Evangelista, N. M., & Probst, D. R. (2010). Enhancing supervisee reflectivity in clinical supervision: A case study illustration. Psychotherapy: Theory, Research, Practice, Training, 47(1), 51–67. https://doi.org/10.1037/a0018844
53. Pope, K. S., Sonne, J. L., & Greene, B. (2006). What therapists don't talk about and why: Understanding taboos that hurt us and our clients. Washington, DC: American Psychological Association. https://doi.org/10.1037/11413-000
54. Rodolfa, E., Bent, R., Eisman, E., Nelson, P., Rehm, L., & Ritchie, P. (2005). A cube model for competency development: Implications for psychology educators and regulators. Professional Psychology: Research and Practice, 36(4), 347–354. https://doi.org/10.1037/0735-7028.36.4.347
55. Scaife, J. (2014). Supervising the reflective practitioner: An essential guide to theory and practice. London: Routledge. https://doi.org/10.1080/0312407X.2014.902352
56. Schön, D. A. (1995). Knowing-in-action: The new scholarship requires a new epistemology. Change: The Magazine of Higher Learning, 27(6), 27–34. https://doi.org/10.1080/00091383.1995.10544673
57. Stevens, B., Hyde, J., Knight, R., Shires, A., & Alexander, R. (2015). Competency-based training and assessment in Australian postgraduate clinical psychology education. Clinical Psychologist, 21, 174–185. https://doi.org/10.1111/cp.12061
58. Stoltenberg, C. D., Bailey, K. C., Cruzan, C. B., Hart, J. T., & Ukuku, U. (2014). The integrative developmental model of supervision. Oxford, England: Wiley. https://doi.org/10.1002/9781118846360.ch28
59. Sutton, L., Townend, M., & Wright, J. (2007). The experiences of reflective learning journals by cognitive behavioural psychotherapy students. Reflective Practice, 8(3), 387–404. https://doi.org/10.1080/14623940701425048
60. Terry, J., Gonsalvez, C., & Deane, F. P. (2017). Brief online training with standardised vignettes reduces inflated supervisor ratings of trainee practitioner competencies. Australian Psychologist, 52(2), 130–139. https://doi.org/10.1111/ap.12250
61. Tiuraniemi, J., Läärä, R., Kyrö, T., & Lindeman, S. (2011). Medical and psychology students' self-assessed communication skills: A pilot study. Patient Education and Counseling, 83(2), 152–157. https://doi.org/10.1016/j.pec.2010.05.013
62. Walfish, S., McAlister, B., O'donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644. https://doi.org/10.2466/02.07.17.PR0.110.2.639-644
63. Waltman, S. H., Frankel, S. A., & Williston, M. A. (2016). Improving clinician self-awareness and increasing accurate representation of clinical competencies. Practice Innovations, 1(3), 178–188. https://doi.org/10.1037/pri0000026
64. Ward, M., Gruppen, L., & Regehr, G. (2002). Measuring self-assessment: Current state of the art. Advances in Health Sciences Education, 7(1), 63–80. https://doi.org/10.1023/A:1014585522084
65. Williams, J. D., & Erickson Cornish, J. A. (2015). Responding to clinical psychology practicum competencies: An APPIC perspective. Clinical Psychology: Science and Practice, 22(4), 410–413. https://doi.org/10.1111/cpsp.12127
66. Wise, E. H., Sturm, C. A., Nutt, R. L., Rodolfa, E., Schaffer, J. B., & Webb, C. (2010). Life-long learning for psychologists: Current status and a vision for the future. Professional Psychology: Research and Practice, 41(4), 288–297. https://doi.org/10.1037/a0020424