Assessing observer accuracy in continuous recording of rate and duration: Three algorithms compared

Journal of Applied Behavior Analysis

Volumn 42, Issue 3, 2009, Pages 527-539

  Mudford, Oliver C ^a   Martin, Neil T ^b   Hui, Jasmine K Y ^a   Taylor, Sarah Ann ^a  

^a UNIVERSITY OF AUCKLAND   (New Zealand)

^b Treehouse Trust   (United Kingdom)

Author keywords

Continuous recording; Interobserver agreement; Observational data; Observer accuracy; Recording and measurement

Indexed keywords

ADULT; ALGORITHM; ARTICLE; FEMALE; HUMAN; MALE; MATHEMATICAL COMPUTING; METHODOLOGY; MIDDLE AGED; OBSERVER VARIATION; SIGNAL PROCESSING; TIME; VIDEORECORDING;

ADULT; ALGORITHMS; FEMALE; HUMANS; MALE; MIDDLE AGED; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; OBSERVER VARIATION; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS; VIDEO RECORDING; YOUNG ADULT;

EID: 77952518010     PISSN: 00218855     EISSN: None     Source Type: Journal    
DOI: 10.1901/jaba.2009.42-527     Document Type: Article

References (17)

1. Bijou, S. W., Peterson, R. F., & Ault, M. H, (1968). A method to integrate descriptive and experimental field studies at the level of data and empirical concepts. Journal of Applied Behavior Analysis, 1, 175-191.
2. Boykin, R. A., & Nelson, R. O. (1981). The effect of instructions and calculation procedures on observers' accuracy, agreement, and calculation correctness. Journal of Applied Behavior Analysis, 14, 479-489.
3. Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson.
4. Fradenberg, L. A., Harrison, R. J., & Baer, D. M. (1995). The effect of some environmental factors on interobserver agreement. Research in Developmental Disabilities, 16, 425-437.
5. Hawkins, R. P., & Dotson, V. A. (1975). Reliability scores that delude: An Alice in Wonderland trip through the misleading characteristics of interobserver agreement scores in interval recording. In E. Ramp & G. Semb (Eds.), Behavior analysis: Areas of research and application (pp. 359-376). Englewood Cliffs, NJ: Prentice Hall.
6. Hopkins, B. L., & Hermann, J. A. (1977). Evaluating interobserver reliability of interval data. Journal of Applied Behavior Analysis, 10, 121-126.
7. Kapust, J. A., & Nelson, R. O. (1984). Effects of rate and spatial separation of target behaviors on observer accuracy and interobserver agreement. Behavioral Assessment, 6, 253-262.
8. MacLean, W. E., Tapp, J. T., & Johnson, W. L. (1985). Alternate methods and software for calculating interobserver agreement for continuous observation data. Journal of Psychopathology and Behavioral Assessment, 7, 65-73.
9. Martin, N. T., Oliver, C., & Hall, S. (2003). ObsWin: Observational data collection and analysis for Windows. London: Antam Ltd.
10. Mudford, O. C., Taylor, S. A., & Martin, N. T. (2009). Continuous recording and interobserver agreement algorithms reported in the Journal of Applied Behavior Analysis (1995-2005). Journal of Applied Behavior Analysis, 42, 165-169.
11. Northup, J., Wacker, D., Sasso, G., Steege, M., Cigrand, K., Cook, J., et al. (1991). A brief functional analysis of aggressive and alternative behavior in an outclinic setting. Journal of Applied Behavior Analysis, 24, 509-522.
12. Page, T. J., & Iwata, B. A. (1986). Interobserver agreement: History, theory and current methods. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 99-126). New York: Plenum.
13. Powell, J., Martindale, B., Kulp, S., Martindale, A., & Bauman, R. (1977). Taking a closer look: Time sampling and measurement error. Journal of Applied Behavior Analysis, 10, 325-332.
14. Repp, A. C., Deitz, D. E. D., Boles, S. M., Deitz, S. M., & Repp, C. F. (1976). Technical article: Differences among common methods for calculating interobserver agreement. Journal of Applied Behavior Analysis, 9, 109-113.
15. Repp, A. C., Harman, M. L., Felce, D., Van Acker, R., & Karsh, K. G. (1989). Conducting behavioral assessments on computer-collected data. Behavioral Assessment, 10, 249-268.
16. Tapp, J., & Wehby, J. H. (2000). Observational software for laptop computers and optical bar code readers. In T. Thompson, D. Felce, & F. J. Symons (Eds.), Behavioral observation: Technology and applications in developmental disabilities (pp. 71-81). Baltimore: Paul H. Brookes.
17. Van Acker, R., Grant, S. H., & Getty, J. E. (1991). Observer accuracy under two different methods of data collection: The effect of behavior frequency and predictability. Journal of Special Education Technology, 11, 155-166.