Developing a new system to measure outcomes in a service coordination program for youth with severe emotional disturbance

Evaluation and Program Planning

Volumn 32, Issue 2, 2009, Pages 109-118

  Shannon, Lisa M ^a   Walker, Robert ^a   Blevins, Michele ^b  

^a UNIVERSITY OF KENTUCKY   (United States)

^b Developmental Disabilities and Addiction Services   (United States)

Author keywords

Outcome evaluation; Service coordination; Youth case management services

Indexed keywords

CONCEPTUAL FRAMEWORK; IMPLEMENTATION PROCESS; MANAGEMENT PRACTICE;

ADOLESCENT; AGE; ARTICLE; CASE MANAGEMENT; CHILD HEALTH CARE; COMMUNITY CARE; EMOTIONAL DISORDER; HEALTH CARE QUALITY; HUMAN; INFORMATION PROCESSING; MENTAL HEALTH SERVICE; MICROCOMPUTER; NONBIOLOGICAL MODEL; OUTCOME ASSESSMENT; PROGRAM DEVELOPMENT; UNITED STATES; AFFECTIVE SYMPTOMS; PROGRAM EVALUATION;

ADOLESCENT; ADOLESCENT HEALTH SERVICES; AFFECTIVE SYMPTOMS; AGE FACTORS; CASE MANAGEMENT; COMMUNITY MENTAL HEALTH SERVICES; COMMUNITY NETWORKS; COMPUTERS, HANDHELD; DATA COLLECTION; HUMANS; MODELS, ORGANIZATIONAL; OUTCOME ASSESSMENT (HEALTH CARE); PROGRAM DEVELOPMENT; PROGRAM EVALUATION; UNITED STATES;

EID: 60949092705     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.evalprogplan.2008.09.006     Document Type: Article

References (87)

1. Anderson A. The community builder's approach to theory of change: A practical guide to theory and development (2005), The Aspen Institute Roundtable on Community Change, New York
2. Angold A., Costello E.J., Burns B.J., Erkanli A., and Farmer E. Effectiveness of nonresidential specialty mental health services for children and adolescents in the "real world". Journal of the Academy of Child & Adolescent Psychiatry 39 2 (2000) 154-160
3. Babor, T. F., Higgins-Biddle, J. C., Saunders, J. B., & Monteiro, M. G. (2001). The alcohol use disorders identification test: Guidelines for use in primary care (2nd ed.). World Health Organization: Department of Mental Health and Substance Dependence. whqlibdoc.who.int/hq/2001/WHO_MSD_MSB_01.6a.pdf Retrieved 05.03.07.
4. Bagnato S.J., Neisworth J.T., Salvia J., and Hunt F. Temperament and atypical behavior scale (TABS): TABS Screener (1999), Paul H. Brookes Publishing Co., Inc., Baltimore
5. Behar L.B. The Fort Bragg evaluation: A snapshot in time. American Psychologist 52 5 (1997) 557-559
6. Bickman L. Designing outcome evaluations for children's mental health services: Improving internal validity. New Directions for Program Evaluation 54 (1992) 57-68
7. Bickman L., Guthrie P.R., Foster E.M., Lambert E.W., Summerfelt W.T., Breda C.S., et al. Evaluating managed mental health services: The Fort Bragg experiment. New York: Plenum Press (1995)
8. Bickman L., Lambert E.W., Andrade A.R., and Penaloza R.V. The Fort Bragg continuum of care for children and adolescents: Mental health outcomes over 5 years. Journal of Consulting and Clinical Psychology 68 4 (2000) 710-716
9. Bickman L., and Noser K. Meeting the challenges in the delivery of child and adolescent mental health services in the next millennium: The continuous quality improvement approach. Applied & Preventive Psychology 8 (1999) 247-255
10. Bickman L., Noser K., and Summerfelt W.T. Long-term effects of a system of care on children and adolescents. The Journal of Behavioral Health Services & Research 26 2 (1999) 185-202
11. Bickman L., Rosof-Williams J., Salzer M.S., Summerfelt W.T., Noser K., Wilson S.J., et al. What information do clinicians value for monitoring adolescent progress and outcomes. Professional Psychology: Research and Practice 31 1 (2000) 70-74
12. Bickman L., Smith C.M., Lambert E.W., and Andrade A.R. Evaluation of a congressionally mandated wraparound demonstration. Journal of Child and Family Studies 12 2 (2003) 135-156
13. Bobula J.A., Anderson L.S., Riesch S.K., Canty-Mitchell J., Duncan A., Kaiser-Krueger H.A., et al. Enhancing survey data collection among youth and adults. CIN: Computer, Informatics, Nursing 22 5 (2004) 255-265
14. Briggs-Gowan M.J., and Carter A.S. Brief infant-toddler social and emotional assessment (2006), PsychCorp, San Antonio
15. Bronfenbrenner U. The ecology of human development: Experiments by nature and design (1979), Harvard University Press, Cambridge, MA
16. Brophy-Herb H., Schiffman R., McKelvey L., Cunningham-DeLuca M., and Hawver M. Quality improvement: Lessons learned from an infant mental health-based early head start program. Infants and Young Children 14 2 (2001) 77-85
17. Burchard J.D., Bruns E.J., and Burchard S.N. The wraparound approach. In: Burns B.J., and Hoagwood K. (Eds). Community treatment for youth: Evidence-based interventions for severe emotional and behavioral disorders (2002), Oxford University Press, New York 69-90
18. Burns B.J. What drives outcomes for emotional and behavioral disorders in children and adolescents?. New Directions for Mental Health Services 71 (1996) 89-102
19. Burns B.J., Farmer E.M., Angold A., Costello E.J., and Behar E.J. A randomized trial of case management for youths with serious emotional disturbance. Journal of Clinical Child Psychology 25 4 (1996) 476-486
20. Cauce A.M., and Morgan C.J. Effectiveness of intensive case management for homeless adolescents: Results of a 3-month follow-up. Journal of Emotional and Behavioral Disorders 2 4 (1994) 219-228
21. Center for Mental Health Services. (1998). Mental, emotional, and behavior disorders in children and adolescents. Retrieved 31.05.07.
22. Clark H.B., Lee B., Prange M.E., Stewart E.S., McDonald B., and Boyd A. An individualized wraparound process for children in foster care with emotional/behavioral disturbances: Follow-up findings and implication from a controlled study. In: Epstein M.H., Kutash K., and Duchnowski A. (Eds). Outcomes for children & youth with behavioral and emotional disorders and their families: Programs and evaluations best practices (1998), Pro-Ed, Austin, TX 513-542
23. Clark H.B., and Prange M.E. Improving adjustment outcomes for foster children with emotional and behavioral disorders: Early findings from a controlled study on individualized services. Journal of Emotional and Behavioral Disorders 2 4 (1994) 207-219
24. DeLeon P.H., and Williams J.G. Evaluation research and public policy formation: Are psychologists collectively willing to accept unpopular findings. American Psychologist 52 5 (1997) 551-552
25. Duhig A.M., Renk K., Epstein M.K., and Phares V. Interparental agreement on internalizing, externalizing, and total behavior problems: A meta-analysis. Clinical Psychology: Science and Practice 7 4 (2000) 435-453
26. Dunst C.J., and Leet H.E. Measuring the adequacy of resources in households with young children. Child: Care, Health and Development 13 (1987) 111-125
27. Embi P.J. Information at hand: Using handheld computers in medicine. Cleveland Clinic Journal of Medicine 68 10 (2001) 840-853
28. Evans M., and Armstrong M. What is case management. In: Burns B.J., and Hoagwood K. (Eds). Community treatment for youth: Evidence-based interventions for severe emotional and behavioral disorders (2002), Oxford University Press, New York 41-68
29. Evans M.E., Boothroyd R.A., Armstrong M.I., Greenbaum P.E., Brown E.C., and Kuppinger A.D. An experimental study of the effectiveness of intensive in-home crisis services for children and their families: Program outcomes. Journal of Emotional and Behavioral Disorders 11 2 (2003) 92-102
30. Feldhaus K.M., Koziol-McLain J., Amsbury H.L., Norton I.M., Lowenstein S.R., and Abbott J.T. Accuracy of 3 brief screening questions for detecting partner violence in the emergency department. Journal of the American Medical Association 277 17 (1997) 1357-1361
31. Feldman S. The Fort Bragg demonstration and evaluation. American Psychologist 52 5 (1997) 560-561
32. Ferguson C. Wraparound: Definition, context for development, and emergence of child welfare. Journal of Public Child Welfare 1 2 (2007) 91-110
33. Glisson C. The effect of services coordination teams on outcomes for children in state custody. Administration in Social Work 18 4 (1994) 1-23
34. Goodman R.M. Principles and tools for evaluating community-based prevention and health promotion programs. Journal of Public Health Management & Practice 4 2 (1998) 37-47
35. Guadagno L., VandeWeerd C., Stevens D., Abraham I., Paveza G.J., and Fulmer T. Using PDAs for data collection. Applied Nursing Research 17 4 (2004) 283-291
36. Harvey M.R. An ecological view of psychological trauma and trauma recovery. Journal of Traumatic Stress 9 1 (1996) 3-23
37. Hoagwood K. Interpreting nullity: The Fort Bragg experiment-A comparative success or failure?. American Psychologist 52 5 (1997) 546-550
38. Hoagwood K., Jensen P.S., Petti T., and Burns B.J. Outcomes of mental health care for children and adolescents. I. A comprehensive conceptual model. Journal of the American Academy of Child and Adolescent Psychiatry 35 8 (1996) 1055-1063
39. Hodges S.P., and Hernandez M. How organizational culture influences outcome information utilization. Evaluation and Program Planning 22 (1999) 183-197
40. Hodges K., and Wotring J. The role of monitoring outcomes in initiating implementation of evidence-based treatments at the state level. Psychiatric Services 55 4 (2004) 396-400
41. Huffine C. Current trends in the community treatment of seriously emotionally disturbed youth. Psychiatric Services 53 7 (2002) 809-811
42. Hufford M.R., and Shields A.L. Electronic diaries: Applications that work in the field. Applied Clinical Trials April (2002) 46-59
43. Hyde K.L., Burchard J.D., and Woodworth K. Wrapping services in an urban setting. Journal of Child and Family Services 5 1 (1996) 67-82
44. Ichinose C.K., Kingdon D.W., and Feltman R. Systems of care in California: Current status of the Ventura planning model. In: Epstein M.H., Kutash K., and Duchnowski A. (Eds). Outcomes for children and youth with emotional and behavioral disorders and their families (1998), Pro-Ed, Austin, TX 173-204
45. Illback R.J., Neill T.K., Call J., and Andis P. Description and formative evaluation of the Kentucky IMPACT program for children with serious emotional disturbance. Special Services in the Schools 7 2 (1993) 87-109
46. Illback R.J., Nelson C.M., and Sanders D. Community-based services in Kentucky: Description and 5-year evaluation of Kentucky IMPACT. In: Epstein M.H., Kutash K., and Duchnowski A. (Eds). Outcomes for children and youth with emotional and behavioral disorders and their families (1998), Pro-Ed, Austin, TX 141-172
47. Illback R.J., and Sanders D. Updating the evaluation of Kentucky IMPACT: Analyses of selected demographic, service delivery, and outcome data (2001), Kentucky Department of Mental Health, Frankfort, KY
48. Israel B.A., Schulz A.J., Parker E.A., and Becker A.B. Review of community-based research: Assessing partnership approaches to improve public health. Annual Review of Public Health 19 (1998) 173-202
49. Jacobson N.S., and Truax P. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Clinical and Consulting Psychology 59 1 (1991) 12-19
50. Jensen E.W., James S.A., Boyce W.T., and Hartnett S.A. The family routines inventory: Development and validation. Social Science & Medicine 17 4 (1983) 201-211
51. Jensen P.S., Hoagwood K., and Petti T. Outcomes of mental health care for children and adolescents. II. Literature review and application of a comprehensive model. Journal of the American Academy of Child and Adolescent Psychiatry 35 8 (1996) 1064-1077
52. Julian D.A. Enhancing quality of practice through theory of change-based evaluation: Science or practice?. American Journal of Community Psychology 35 3/4 (2005) 159-168
53. Kazdin A.E., and Kendall P.C. Current progress and future plans for developing effective treatments: Comments and perspectives. Journal of Clinical Child Psychology 27 2 (1998) 217-226
54. Kutash K., and Rivera V.R. What works in children's mental health services? Uncovering answers to critical questions (1996), Paul H. Brooks Publishing Co., Baltimore, MD
55. Lambert W., Salzer M.S., and Bickman L. Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children's mental health. Journal of Consulting and Clinical Psychology 66 2 (1998) 270-279
56. Main D., Quintela J., Araya-Guerra R., Holcomb S., and Pace W. Exploring patient reactions to pen-tablet computers: A report of CaReNet. Annals of Family Medicine 2 5 (2004) 421-424
57. McGlynn E.A. Setting the context for measuring patient outcomes. In: Steinwachs D.M., Flynn L.M., Norquist G.S., and Skinner E.A. (Eds). Using client outcomes information to improve mental health and substance abuse treatment: New directions for mental health services (no. 71) (1996), Jossey-Bass Publishers, San Francisco 19-32
58. Miller, W. R. & Brown, J. M. (1994). What I want from treatment (2.0). .
59. Munger R.L. The ecology of troubled children: Changing children's behavior by changing the places, activities, and people in their lives (1998), Brookline Books, Cambridge, MA
60. Nathan P.E., Stuart S.P., and Dolan S.L. Research on psychotherapy efficacy and effectiveness: Between Scylla and charybdis?. In: Kazdin A.E. (Ed). Methodological issues & strategies in clinical research. 3rd ed. (2003), American Psychological Association, Washington, DC
61. Newman F.L., and Tejeda M.J. The need for research that is designed to support decisions in the delivery of mental health services. American Psychologist 51 10 (1996) 1040-1049
62. Pace W.D., and Staton E.W. Electronic data collection options for practice-based research networks. Annals of Family Medicine 3 Suppl 1 (2005) 521-529
63. Pedhazur E.J., and Schmelkin L.P. Measurement, design, and analysis: An integrated approach (1991), Lawrence Erlbaum Associates, Publishers, Hillsdale
64. Phelps R., Eisman E.J., and Kohout J. Psychological practice and managed care: Results of the CAPP Practitioner Survey. Professional Psychology: Research and Practice 29 1 (1998) 31-36
65. Pottick K.J., Warner L.A., Isaacs M., Henderson M.J., Milazzo-Sayre L., and Manderscheid R.W. Children and adolescents treated in specialty mental health care programs in the United States: 1986 and 1997. In: Manderscheid R.W., and Henderson M.J. (Eds). Mental Health, United States, 2002, DHHS Pub No. (SMA) 3938 (2004), Substance Abuse and Mental Health Services Administration, Rockville, MD 314-326
66. Rahdert E. Problem oriented screening instrument for parents (1991), National Institute on Drug Abuse (NIDA), National Institutes of Health, Maryland
67. Rahdert E. Problem oriented screening instrument for teenagers (1991), National Institute on Drug Abuse (NIDA), National Institutes of Health, Maryland
68. Roberts R.E., Alegria M., Roberts C.R., and Chen I.R. Concordance of reports of mental health functioning by adolescents and their caregivers. The Journal of Nervous and Mental Disease 193 8 (2005) 528-534
69. Rosenblatt A. Assessing the child and family outcomes of systems of care for youth with serious emotional disturbance. In: Epstein M.H., Kutash K., and Duchnowski A. (Eds). Outcomes for children and youth with emotional and behavioral disorders and their families (1998), Pro-Ed, Austin, TX 329-362
70. Rosenblatt A. Conceiving the self. New York: Basic Books. In: Fischer J., and Corcoran K. (Eds). Measures for clinical practice: A sourcebook (Vol. 1, 2nd ed.). Couples, families and children (1979), Free Press, New York
71. Rosenthal R., and Rosnow R.L. Essentials of behavioral research: Methods and data analysis. 2nd ed. (1991), McGraw Hill, Boston
72. Santarcangelo S., Bruns E.J., and Yoe J.T. New directions: Evaluating Vermont's statewide model of individualized care. In: Epstein M.H., Kutash K., and Duchnowski A. (Eds). Outcomes for children and youth with emotional and behavioral disorders and their families (1998), Pro-Ed, Austin, TX 117-139
73. Speer D.C. Clinically significant change: Jacobson and Truax (1991) revisited. Journal of Consulting and Clinical Psychology 60 3 (1992) 400-408
74. Stambaugh L.F., Mustillo S.A., Burns B.J., Stephens R.L., Baxter B., Edwards D., et al. Outcomes from wraparound and multisystemic therapy in a center for mental health services system-of-care demonstration site. Journal of Emotional and Behavioral Disorders 15 3 (2007) 143-155
75. Stevenson, E., Walker, R., Shannon, L., Newell, J., & Jackson, T. (submitted for publication). Views of treatment outcomes data collection using a personal digital assistant (PDA).
76. Stokols D. Establishing and maintaining healthy environments: Toward a social ecology of health promotion. American Psychologist 47 1 (1992) 6-22
77. Stroul B.A., and Friedman R.M. A system of care for children and youth with severe emotional disturbances (Revised Edition) (1986), Georgetown University Child Development Center, CASSP Technical Assistance Center, Washington, DC
78. Treutler C.M., and Epkins C.C. Are discrepancies among child, mother, and father reports on children's behavior related to parents' psychological symptoms and aspects of parent-child relationships?. Journal of Abnormal Child Psychology 31 1 (2003) 13-27
79. Weber B.A., and Roberts B.L. Data collection using handheld computers. Nursing Research 49 3 (2000) 173-175
80. Weisz J.R., Han S.S., and Valeri S.M. More of what? Issues raised by the Fort Bragg study. American Psychologist 52 5 (1997) 541-545
81. Weisz J.R., Hawley K.M., Pilkonis P.A., Woody S.A., and Follette W.C. Stressing the (other) three Rs in the search for empirically supported treatments: Review procedures, research quality, relevance to practice and the public interest. Clinical Psychology: Science and Practice 7 3 (2000) 243-258
82. Wells K.B. Treatment research at the crossroads: The scientific interface of clinical trials and effectiveness research. American Journal of Psychiatry 156 1 (1999) 5-10
83. Wolraich M.L., Lambert E.W., Bickman L., Simmons T., Doffing M.A., and Worley K.A. Assessing the impact of parent and teacher agreement on diagnosing attention-deficit hyperactivity disorder. Developmental and behavioral pediatrics 25 1 (2004) 41-47
84. Yoe J.T., Santarcangelo S., Atkins M., and Burchard J.D. Wraparound care in Vermont: Program development, implementation, and evaluation of a statewide system of individualized services. Journal of Child and Family Studies 5 1 (1996) 23-39
85. Zeman L.L., Johnson D., Arfken C., Smith T., and Opoku P. Lessons learned: Challenges implementing a personal digital assistant (PDA) to assess behavioral health in primary care. Families, Systems, & Health 24 3 (2006) 286-298
86. Zimet G.D., Dahlem N.W., Zimet S.G., and Farley G.K. The multidimensional scale of perceived social support. Journal of Personality Assessment 52 1 (1988) 30-41
87. Zweben J.E., Cohen J.B., Obert J., Vandersloot D., and Marinelli-Casey P. Conducting trials in community settings: The provider perspective. Journal of Psychoactive Drugs 32 2 (2000) 193-199