Measurement properties of indirect assessment methods for functional behavioral assessment: A review of research

School Psychology Review

Volumn 34, Issue 1, 2005, Pages 58-73

  Floyd, Randy G ^a,c   Phaneuf, Robin L ^a   Wilczynski, Susan M ^b  

^a UNIVERSITY OF MEMPHIS   (United States)

^b UNIVERSITY OF NEBRASKA MEDICAL CENTER   (United States)

^c University of Memphis   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 17544369311     PISSN: 02796015     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (100)

1. Achenbach, T. M. (1991). Integrate guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.
2. Aiken, L. R. (1997). Psychological testing and assessment (9th ed.). Needham Heights, MA: Allyn & Bacon.
3. Akande, A. (1994). The motivation assessment profiles of low-functioning children. Early Child Development and Care, 101, 101-107.
4. Akande, A. (1998). Some South African evidence of the inter-rater reliability of the Motivation Assessment Scale. Educational Psychology, 18, 111-115.
5. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
6. Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice-Hall.
7. Arndorfer, R. E., Miltenberger, R. G., Woster, S. H., Rortvedt, A. K., & Gaffaney, T. (1994). Home-based descriptive and experimental analysis of problem behaviors in children. Topics in Early Childhood Special Education, 14, 64-87.
8. Barnett, D. W., Lentz, F. E., Jr., & Macmann, G. (2000). Psychometric qualities of professional practice. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Theory, research, and clinical foundations (2nd ed., pp. 355-386). New York: Guilford Press.
9. Barton-Arwood, S. M., Wehby, J. H., Gunter, P. L., & Lane, K. L. (2003). Functional behavior assessment rating scales: Intrarater reliability with students with emotional or behavioral disorders. Behavioral Disorders, 28, 386-400.
10. Beaver, B. R., & Busse, R. T. (2000). Informant reports: Conceptual and research bases of interviews with parents and teachers. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Theory, research, and clinical foundations (2nd ed., pp. 257-287). New York: Guilford Press.
11. Bergan, J. R., & Kratochwill, T. R. (1990). Behavioral consultation and therapy. New York: Plenum Press.
12. Bergan, J. R., & Tombari, M. L. (1971). The analysis of verbal interactions occurring during consultation. Journal of School Psychology, 13, 209-225.
13. Bihm, E. M., Kienlen, T. L., Ness, M. E., & Poindexter, A. R. (1991). Factor structure of the Motivation Assessment Scale for persons with mental retardation. Psychological Reports, 68, 1235-1238.
14. Bird, F., Dores, P., Moniz, D., & Robinson, F. (1989). Reducing severe aggression and self-injurious behavior with functional communication training: Direct, collateral and generalized results. American Journal of Mental Retardation, 94, 37-48.
15. Bracken, B. A. (1987). Limitations of preschool instruments and standards for minimal levels of technical adequacy. Journal of Psychoeducational Assessment, 5, 313-326.
16. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
17. Cone, J. D. (1977). The relevance of reliability and validity for behavioral assessment. Behavior Therapy, 8, 427-430.
18. Cone, J. D. (1978). The behavioral assessment grid (BAG): A conceptual framework and a taxonomy. Behavior Therapy, 9, 882-888.
19. Cone, J. D. (1997). Issues in functional analysis in behavioral assessment. Behavioral Research and Therapy, 35, 259-275.
20. Cone, J. D. (1998). Psychometric considerations: Concepts, contents, and methods. In M. Hersen & A. S. Bellack (Eds.), Behavioral assessment: A practical handbook (4th ed., pp. 22-46). Boston: Allyn & Bacon.
21. Conroy, M. A., Fox, J. J., Bucklin, A., & Good, W. (1996). An analysis of the reliability and stability of the Motivation Assessment Scale in assessing the challenging behaviors of persons with developmental disabilities. Education and Training in Mental Retardation and Developmental Disabilities, 31, 243-250.
22. Cooper, H. M. (1998). Synthesizing research: A guide for literature reviews (3rd. ed). Thousand Oaks, CA: Sage.
23. Crawford, J., Brockel, B., Schauss, S., & Miltenberger, R. G. (1992). A comparison of methods for the functional assessment of stereotypic behavior. Journal of the Association for Persons with Severe Handicaps, 17, 77-86.
24. Crone, D. A., & Horner, R. H. (2003). Building positive behavior support systems in schools: Functional behavioral assessment. New York: Guilford Press.
25. Cunningham, E., & O'Neill, R. E. (2000). Comparison of results of functional assessment and analysis methods with young children with autism. Education and Training in Mental Retardation and Developmental Disabilities, 35, 406-414.
26. Duker, P. C., & Sigafoos, J. (1998). The Motivation Assessment Scale: Reliability and construct validity across three topographies of behavior. Research in Developmental Disabilities, 19, 131-141.
27. Dunlap, G., Newton, J., S., Fox, L., Benito, N., & Vaughn, B. (2001). Family involvement in functional assessment and positive behavior support. Focus on Autism and Other Developmental Disabilities, 16, 215-221.
28. Dunlap, G., White, R., Vera, A., Wilson, D., & Panacek, L. (1996). The effects of multi-component, assessment-based curricular modifications on the classroom behavior of children with emotional and behavioral disorders. Journal of Behavioral Education, 4, 481-500.
29. Durand, V. M. (1997). Motivation Assessment Scale II: Test version. Unpublished instrument.
30. Durand, V. M., & Carr, E. G. (1991). Functional communication training to reduce challenging behavior: Maintenance and application in new settings. Journal of Applied Behavior Analysis, 24, 251-264.
31. Durand, V. M., & Crimmins, D. B. (1988). Identifying the variables maintaining self-injurious behavior. Journal of Autism and Developmental Disorders, 18, 99-117.
32. Durand, V. M., & Crimmins, D. B. (1992). The Motivation Assessment Scale administrative guide. Topeka, KS: Monaco & Associates.
33. Durand, V. M., Crimmins, D. B., Caulfield, M., & Taylor, J. (1989). Reinforcer assessment: I. Using problem behavior to select reinforcers. Journal of the Association for Persons With Severe Handicaps, 14, 113-126.
34. Durand, V. M., & Kishi, G. (1987). Reducing severe behavior problems among persons with dual sensory impairments: An evaluation of a technical assistance model. Journal of the Association for Persons with Severe Handicaps, 12, 2-10.
35. Ebel, R. (1961). Must all tests be valid? American Psychologist, 15, 546-553.
36. Eckert, T. L., & Hintze, J. M. (2000). Behavioral conceptions and applications of acceptability: Issues related to service delivery and research methodology. School Psychology Quarterly, 15, 123-148.
37. Edwards, R. P. (2002). A tutorial for using the Functional Assessment Informant Record for Teachers. Proven Practice: Prevention and Remediation Solutions for Schools, 4, 31-33.
38. Ehrhardt, K. E., Barnett, D. W., Lentz, F. E., Jr., Stollar, S. A., & Reifin, L. H. (1996). Innovative methodology in ecological consultation: Use of scripts to promote treatment acceptability and integrity. School Psychology Quarterly, 11, 149-168.
39. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (rev. ed.). Cambridge, MA: MIT Press.
40. Floyd, R. G., & Bose, J. E. (2003). A critical review of rating scales assessing emotional disturbance. Journal of Psychoeducational Assessment, 21, 43-78.
41. Foster, S. L., & Cone, J. D. (1995). Validity issues in clinical assessment. Psychological Assessment, 7, 248-260.
42. Gibson, A. K., Hetrick, W. P., Taylor, D. V., Sandman, C. A., & Touchette, P. (1995). Relating the efficacy of naltrexone in treating self-injurious behavior to the Motivation Assessment Scale. Journal of Developmental and Physical Disabilities, 7, 215-220.
43. Gresham, F. M. (1984). Behavioral interviews in school psychology: Issues in psychometric adequacy and research. School Psychology Review, 13, 17-25.
44. Gresham, F. M. (2003). Establishing the technical adequacy of functional behavioral assessment: Conceptual and measurement challenges. Behavioral Disorders, 28, 282-298.
45. Gresham, F. M., & Davis, C. J. (1988). Behavioral interviews with teachers and parents. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Conceptual foundations and practical applications (pp. 455-493). New York: Guilford Press.
46. Gresham, F. M., & Lopez, M. F. (1996). Social validation: A unifying concept for school-based consultation research and practice. School Psychology Quarterly, 11, 204-227.
47. Haim, A. (2003). The analysis and validation of the Motivation Assessment Scale-II Test Version: A structural equation model. Dissertation Abstracts International: Section B: The Sciences and Engineering, 65(10-B): 4903.
48. nd ed.). Austin, TX: PRO-ED.
49. Haring, T. G., & Kennedy, C. H. (1990). Contextual control of problem behavior in students with severe disabilities. Journal of Applied Behavior Analysis, 23, 235-243.
50. Hartman, D. P., Roper, B. L., & Bradford, C. C. (1979). Some relationships between behavioral and traditional assessment. Journal of Behavioral Assessment, 1, 3-21.
51. Hayes, S. C., Nelson, R. O., & Jarrett, R. B. (1987). The treatment utility of assessment: A functional approach to evaluating assessment quality. American Psychologist, 42, 963-974.
52. Haynes, S. N., & O'Brien, W. H. (2000). Principals and practice of behavioral assessment. New York: Kluwer Academic/Plenum.
53. Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238-247.
54. Individuals with Disabilities Education Act Amendments of 1997, (Pub L No. 105-17. 20 USC Chapter 33, Sections 1400 et seq. (Statute)
55. Johnston, J. M., & Pennypacker, H. S. (1993). Strategies and tactics of behavioral research (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
56. Kearney, C. A. (1994). Interrater reliability of the Motivation Assessment Scale: Another, closer look. Journal of the Association for Persons with Severe Handicaps, 19, 139-142.
57. Kern, L., Dunlap, G., Clarke, S., & Childs, K. E. (1994). Student-assisted functional assessment interview. Diagnostique, 19(2,3), 29-39.
58. Kinch, C., Lewis-Palmer, T., Hagan-Burke, S., & Sugai, G. (2001). A comparison of teacher and student functional behavior assessment interview information from low-risk and high-risk classrooms. Education and Treatment of Children, 24, 480-494.
59. Kraemer, H. C., Periyakoil, V. S., & Noda, A. (2002). Kappa coefficients in medical research. Statistics in Medicine, 21, 2109-2129.
60. Kratochwill, T. R., & Shapiro, E. S. (2000). Conceptual foundations of behavioral assessment in schools. In E. S. Shapiro & T. R. Kratochwill (Eds.), Behavioral assessment in schools: Theory, research, and clinical foundations (2nd ed., pp. 3-15). New York: Guilford Press.
61. Kratochwill, T. R., & Stoiber, K. C. (2002). Evidence-based interventions in school psychology: Conceptual foundations of the Procedural and Coding Manual of Division 16 and the Society for the Study of School Psychology Task Force. School Psychology Quarterly. 17, 341-389.
62. Lawry, J. R., Storey, K., & Danko, C. D. (1993). Analyzing problem behaviors in the classroom: A case study of functional analysis. Intervention in School and Clinic, 29, 96-100.
63. Lennox, D. B., & Miltenberger, R. G. (1989). Conducting a functional assessment of problem behavior in applied settings. Journal of the Association of Persons with Severe Handicaps, 14, 304-311.
64. Lewis, T. J., Scott, T., & Sugai, G. (1994). The Problem Behavior Questionnaire: A teacher-based assessment instrument to develop interventions to develop functional hypotheses of problem behavior in general education classrooms. Diagnostique, 19, 103-115.
65. Lewis, T. J., & Sugai, G. (1996). Functional assessment of problem behaviors: A pilot investigation of the comparative and interactive effects of teacher and peer social attention on students in general education settings. School Psychology Quarterly, 11, 1-19.
66. Li, M. F., & Lautenschlager, G. (1997). Generalizability theory applied to categorical data. Educational and Psychological Measurement, 57, 813-822.
67. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
68. Merrell, K. W. (2003). Behavioral, social, and emotional assessment of children and adolescents. Mahwah, NJ: Lawrence Erlbaum.
69. rd ed., pp. 13-103). Washington, DC: American Council on Education.
70. Messick, S. (1995). Validity of psychological assessment: Validity of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
71. Nelson, R. O. (1983). Behavioral assessment: Past, present, and future. Behavioral Assessment, 5, 195-206.
72. Nelson, R. O., Hay, I. R., & Hay, W. M. (1977). Comments on Cone's "The relevance of reliability and validity for behavioral assessment." Behavior Therapy, 8, 427-430.
73. Nelson-Gray, R. O. (2003). Treatment utility of psychological assessment. Psychological Assessment, 15, 521-531.
74. Newton, J. T., & Sturmey, P. (1991). The Motivation Assessment Scale: Interrater reliability and internal consistency in a British sample. Journal of Mental Deficiency Research, 35, 472-474.
75. rd ed.). New York: McGraw Hill.
76. O'Neill, R. E., Horner, R. H., Ablin, R. W., Storey, K., & Sprague, J. R. (1990). Functional analysis of problem behaviors: A practical guide. Sycamore, IL: Sycamore.
77. O'Neill, R. E., Horner, R. H., Ablin, R. W., Sprague, J. R., Storey, K., & Newton, J. S. (1997). Functional assessment and program development for problem behaviors: A practical handbook. New York: Brooks/ Cole.
78. Paclawskyj, T. R., Matson, J. L., Rush, K. S., Smalls, Y., & Vollmer, T. R. (2001). Assessment of the convergent validity of the Questions About Behavioral Function scale with analogue functional analysis and the Motivation Assessment Scale. Journal of Intellectual Disability Research, 45, 484-494.
79. Powers, D. A., & Xie, Y. (2000). Statistical methods for categorical data analysis. San Diego, CA: Academic Press.
80. Reese, R. M., Richman, D. M., Zarcone, J., & Zarcone, T. (2003). Individualizing functional assessments for children with autism: The contribution of perseverative behavior and sensory disturbances to disruptive behavior. Focus on Autism and Other Developmental Disabilities, 18, 89-94.
81. Reich, W. (2000). Diagnostic Interview for Children and Adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 59-66.
82. Scotti, J. R., Schulman, D. E., & Hojnacki, R. M. (1994). Functional analysis and unsuccessful treatment of Tourette's syndrome in a man with profound mental retardation. Behavior Therapy, 25, 721-738.
83. Shogren, K. A., & Rojahn, J. (2003). Convergent reliability and validity of the Questions About Behavioral Function and the Motivation Assessment Scale: A replication study. Journal of Developmental and Physical Disabilities, 15, 367-375.
84. Shriver, M. D., Anderson, C. M., & Proctor, B. (2001). Evaluating the validity of functional behavior assessment. School Psychology Review, 30, 180-192.
85. Shriver, M. D., & Proctor, B. (2005). Social validity in disseminating functional behavior assessment technology: Research directions for meeting consumer needs. Manuscript submitted for publication.
86. Sigafoos, J., Kerr, M., & Roberts, D. (1994). Interrater reliability of the Motivation Assessment Scale: Failure to replicate with aggressive behavior. Research in Developmental Disabilities, 15, 333-342.
87. Silva, F. (1993). Psychometric foundations and behavioral assessment. Newbury Park, CA: Sage.
88. Singh, N. N., Donatelli, L. S., Best, A., Williams, E. E., Barrera, F. J., Lenz, M. W., Landrum, T. J., Ellis, C. R., & Moe, T. L. (1993). Factor structure of the Motivation Assessment Scale. Journal of Intellectual Disabilities Research, 37, 65-75.
89. Spreat, C., & Connelly, L. (1996). Reliability analysis of The Motivation Assessment Scale. American Journal of Mental Retardation, 100, 528-532.
90. Sturmey, P. (1994a). Assessing the function of aberrant behaviors: A review of psychometric instruments. Journal of Autism and Developmental Disorders, 24, 293-304.
91. Sturmey, P. (1994b). Assessing the functions of self-injurious behavior: A case of assessment failure. Journal of Behavior Therapy and Experimental Psychiatry, 25, 331-336.
92. Sugai, G., Lewis-Palmer, T., & Hagan-Burke, S. (2000). Overview of the functional behavioral assessment process. Exceptionality, 8(3), 149-160.
93. Thompson, S., & Emerson, E. (1995). Inter-informant agreement on the Motivation Assessment Scale: Another failure to replicate. Mental Handicap Research, 8, 203-208.
94. Vollmer, T. R., & Matson, J. L. (1999). Questions About Behavioral Function manual. Baton Rouge, LA: Scientific Publishers.
95. Witt, J. C., Daly, E. M., & Noell, G. (2000). Functional assessments: A step-by-step guide to solving academic and behavior problems. Longmont, CO: Sopris West.
96. th Annual International Conference on Young Children with Special Needs and Their Families, Washington, DC.
97. Wolf, M. M. (1978). The case of subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203-214.
98. Yarbrough, S. C., & Carr, E. G. (2000). Some relationships between informant assessment and functional analysis of problem behavior. American Journal of Mental Retardation, 105, 130-151.
99. Yates, B. T., & Taub, J. (2003). Assessing the costs, cost-effectiveness, and cost-benefit of psychological assess ment: We should, we can, here's how. Psychological assessment, 15, 478-495.
100. Zarcone, J. R., Rodgers, T. A., Iwata, B. A., Rourke, D. A., & Dorsey, M. F. (1991). Reliability analysis of the Motivation Assessment Scale: A failure to replicate. Research in Developmental Disabilities, 12, 349-360.