Generalizability and dependability of behavior assessment methods to estimate academic engagement: A comparison of systematic direct observation and direct behavior rating

School Psychology Review

Volumn 39, Issue 3, 2010, Pages 408-421

  Briesch, Amy M ^a   Chafouleas, Sandra M ^b   Riley Tillman, T Chris ^c  

^a NORTHEASTERN UNIVERSITY   (United States)

^b UNIVERSITY OF CONNECTICUT   (United States)

^c EAST CAROLINA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 78649233717     PISSN: 02796015     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (28)

1. Balzer, W. K., & Sulsky, L. M. (1992). Halo and performance appraisal research: A critical examination. Journal of Applied Psychology, 77, 975-985.
2. Bergeron, R., Floyd, R. G., McCormack, A. C., & Farmer, W. L. (2008). The generalizability of externalizing behavior composites and subscale scores across time, rater, and instrument. School Psychology Review, 37, 91-108.
3. Brennan, R. L. (2001). Manual for urGENOVA (Version 2.1). Iowa City: Iowa Testing Programs.
4. Briesch, A. M., & Volpe, R. J. (2007). Important considerations in the selection of progress monitoring measures for classroom behaviors. School Psychology Forum, 1, 59-74.
5. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
6. Chafouleas, S. M., Briesch, A. M., Riley-Tillman, T. C., Christ, T. J., Black, A. C., & Kilgus, S. J. (2010). An investigation of the generalizability and dependability of Direct Behavior Rating Single Item Scales (DBRSIS) to measure academic engagement and disruptive behavior of middle school students. Journal of School Psychology, 48, 219-246.
7. Chafouleas, S. M., Christ, T. J., Riley-Tillman, T. C., Briesch, A. M., & Cháñese, J. A. M. (2007). Generalizability and dependability of direct behavior ratings to assess social behavior of preschoolers. School Psychology Review, 35, 63-79.
8. Chafouleas, S. M., Riley-Tillman, T. C., & Christ, T. J. (2009). Direct Behavior Rating (DBR): An emerging method for assessing social behavior within a tiered intervention system. Assessment for Effective Intervention, 34, 195-200.
9. Chafouleas, S. M., Riley-Tillman, T. C., & Sugai, G. (2007). School-based behavioral assessment: Informing intervention and instruction. New York: Guilford Press.
10. Christ, T. J., Riley-Tillman, T. C., & Chafouleas, S. M. (2009). Foundation for the development and use of Direct Behavior Rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention, 34, 201-213.
11. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Harcourt Brace.
12. Feeley, T. H. (2002). Comment on halo effects in rating and evaluation research. Human Communication Research, 28, 578-586.
13. Hay, L., Nelson, R., & Hay, W. (1977). Some methodological problems in the use of teachers as observers. Journal of Applied Behavior Analysis, 10, 345-348.
14. Hay, L., Nelson, R., & Hay, W. (1980). Methodological problems in the use of participant observers. Journal of Applied Behavior Analysis, 13, 501-504.
15. Hintze, J. M. (2005). Psychometrics of direct observation. School Psychology Review, 34, 507-519.
16. Hintze, J. M., & Matthews, W. J. (2004). The generalizability of systematic direct observations across time and setting: A preliminary investigation of the psychometrics of behavioral observation. School Psychology Review, 33, 258-270.
17. Hoyt, W. T., & Kems, M. D. (1999). Magnitude and moderators of bias in observer ratings: A meta-analysis. Psychological Methods, 4, 403-424.
18. Individuals with Disabilities Education Improvement Act of 2004, 20 U.S.C. 1400, Pub. L No. 108-446.
19. Kline, P. (2000). Handbook of psychological testing. New York: Routledge.
20. Marcus, R. (1980). Application of the generalizability coefficient to the study of stability of cooperative behavior of young children. Paper presented at the annual convention of the American Psychological Association (88th, Montreal, Quebec, Canada, September 1-5, 1980). 03D195357)
21. McWilliam, R. A., & Ware, W. B. (1994). The reliability of observations of young children's engagement: An application of generalizability theory. Journal of Early Intervention, 18, 34-47.
22. Merrell, K. W. (2008). Behavioral, social, and emotional assessment of children and adolescents (3rd ed.). New York: Lawrence Erlbaum.
23. Myford, G (2003). Detecting and measuring rater effects using many-facet Rasch measurement, Part I. Journal of Applied Measurement, 4, 386-421.
24. Riley-Tillman, T. C., Chafouleas, S. M., & Briesch, A. M. (2007). A practitioner's guide to using daily behavior report cards to monitor student behavior. Psychology in the Schools, 44, 77-89.
25. Riley-Tillman, T. C., Chafouleas, S. M., Briesch, A. M., & Eckert, T. (2008). Daily behavior report cards and systematic direct observation: An investigation of the acceptability, reported training and use, and decision reliability among school psychologists. Journal of Behavioral Education, 17, 313-327.
26. Saudargas, R. A., & Zanolli, K. (1990). Momentary time sampling as an estimate of percentage time: A field validation. Journal of Applied Behavior Analysis, 23, 533-537.
27. Shapiro, E. S. (2004). Academic skills problems workbook. New York: Guilford Press.
28. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory. Newbury Park, CA: Sage.