The development, content validity and inter-rater reliability of the SMART-Goal Evaluation Method: A standardised method for evaluating clinical goals

Australian Occupational Therapy Journal

Volumn 62, Issue 6, 2015, Pages 420-427

  Bowman, Julia ^a,c   Mogensen, Lise ^b   Marsland, Elisabeth ^b   Lannin, Natasha ^c,d,e  

^a JUSTICE HEALTH AND FORENSIC MENTAL HEALTH NETWORK   (Australia)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

^c LA TROBE UNIVERSITY   (Australia)

^d Occupational Therapy Department   (Australia)

^e UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Goal; Occupational therapy; Outcome assessment (health care); Rehabilitation

Indexed keywords

HUMAN; OBSERVER VARIATION; OCCUPATIONAL THERAPY; OUTCOME ASSESSMENT; PATIENT CARE PLANNING; PROCEDURES; REPRODUCIBILITY; STANDARDS;

HUMANS; OBSERVER VARIATION; OCCUPATIONAL THERAPY; OUTCOME ASSESSMENT (HEALTH CARE); PATIENT CARE PLANNING; REPRODUCIBILITY OF RESULTS;

EID: 84955353399     PISSN: 00450766     EISSN: 14401630     Source Type: Journal    
DOI: 10.1111/1440-1630.12218     Document Type: Article

References (32)

1. Benson, J. & Schell, B. A. (1997). Measurement theory: Application to occupational and physical therapy. In: J. Van Deusen & D. Brunt (Eds.), Assessment in occupational therapy and physical therapy (pp. 3-24). Philadelphia: W.B Saunders.
2. Berk, R. A. (1979). Generalizability of behavioural observations: A clarification of interobserver agreement and interobserver reliability. American Journal of Mental Deficiency, 10, 205-212.
3. Bovend'Eerdt, T. J., Botell, R. E. & Wade, D. (2009). Writing SMART rehabilitation goals and achieving goal attainment scaling: A practical guide. Clinical Rehabilitation 23, 352-361.
4. Bowman, J. (2006). Challenges to measuring outcomes in occupational therapy: A qualitative focus group study. British Journal of Occupational Therapy, 69, 464-472.
5. Clarke, S. P., Crowe, T. P., Oades, L. G. & Deane, F. P. (2009). Do goal-setting interventions improve the quality of goals in mental health services? Psychiatric Rehabilitation Journal, 32, 292-299.
6. Dimitrov, D., Rumrill, D., Fitzgerald, S. & Hennessey, M. (2001). Reliability in rehabilitation measurement. Work, 16, 159-164.
7. Duff, J., Evans, M. J. & Kennedy, P. (2004). Goal planning: A retrospective audit of rehabilitation process and outcome. Clinical Rehabilitation, 18, 275-286.
8. Fleiss, J. L. (1981). Statistical method for rates and proportions (2nd ed.). New York: John Wiley and Sons.
9. Hambleton, R. K., Swaminathon, H., Algina, J. & Coulson, D. B. (1978). Criterion-referenced testing and measurement: Review of technical issues and developments. Review of Educational Research, 48 (1), 1-47.
10. Hart, T. & Evans, J. (2006). Self-regulation and goal theories in brain injury rehabilitation. Journal of Head and Trauma Rehabilitation, 21, 142-155.
11. Hurn, J., Kneebone, I. & Cropley, M. (2006). Goal setting as an outcome measure: A systematic review. Clinical Rehabilitation, 20, 756-772.
12. Knowles, M. S., Holton, E. F. & Swanson, R. A. (2005). The adult learner: The definitive classic in adult education and human resource development (6th ed.). Amsterdam: Elsevier Butterworth Heinemann.
13. Landis, J. R. & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
14. Law, M. (1987). Measurement in occupational therapy: Scientific criteria for evaluation. Canadian Journal of Occupational Therapy, 54, 133-138.
15. Leach, M. J. (2008). Planning: A necessary step in clinical care. Journal of Clinical Nursing, 17, 1728-1734.
16. Levack, W. M. M., Dean, S. G., Siegert, R. J. & McPherson, K. M. (2006). Purposes and mechanisms of goal planning in rehabilitation: The need for a critical distinction. Disability and Rehabilitation, 28 (12), 741-749.
17. Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382-385.
18. Marsland, E. & Bowman, J. (2010). An interactive education session and follow up support as a strategy to improve clinicians' goal writing skills: A randomized controlled trial. Journal of Evaluation in Clinical Practice, 16, 3-13.
19. McClain, C. (2005). Collaborative rehabilitation goal setting. Topics in Stroke Rehabilitation, 12, 56-60.
20. McGartland Rubio, D., Berg-Weger, M., Tebb, S. S., Lee, E. S. & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27, 94-104.
21. Pimentel, S., Tanner, B. & Finney, L. (2008). Goal setting and outcome measurement in a wheelchair service: A client centred approach. International Journal of Therapy and Rehabilitation, 15 (11), 491-499.
22. Polit, D. F. & Beck, C. T. (2006). The content validity index: Are you sure you know what is being reported? Critique and recommendations. Research in Nursing and Health, 29, 489-497.
23. Poppes, P., Vlaskamp, C., De Geeter, K. I. & Nakken, H. (2002). The importance of setting goals: The effect of instruction and training on the technical and intrinsic quality of goals. European Journal of Special Needs Education, 17 (3), 241-250.
24. Portney, L. G. & Watkins, M. P. (2000). Foundations of clinical practice: Applications to clinical practice (3rd ed.). Upper Saddle River, NJ: Pearson/Prentice Hall.
25. Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S. & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27, 94-104.
26. Scobbie, L., Wyke, S. & Dixon, D. (2009). Identifying and applying psychological theory to setting and achieving rehabilitation goals. Clinical Rehabilitation, 23, 321-333.
27. Shrout, P. E. & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
28. Siegel, S. & Castellan, J. N. (1988). Nonparametric statistics for the behavioural sciences (2nd ed.). New York: McGraw Hill.
29. Siegert, R. J. & Taylor, W. (2004). Theoretical aspects of goal-setting and motivation in rehabilitation. Disability and Rehabilitation, 26 (1), 1-8.
30. Wade, D. (2009). Goal setting in rehabilitation: An overview of what, why, how? Clinical Rehabilitation, 23, 291-295.
31. Watkins, M. W. & Pacheco, M. (2001). Interobserver agreement in behavioral research: Importance and calculation. Journal of Behavioral Education, 10, 205-212.
32. Welch, A. & Foster, S. (2003). A clinical audit of the outcome of occupational therapy assessment and negotiated patient goals in the acute setting. British Journal of Occupational Therapy, 66, 363-368.