Can you believe my eyes? The importance of interobserver reliability statistics in observations of animal behaviour

Animal Behaviour

Volumn 78, Issue 6, 2009, Pages 1487-1491

  Kaufman, Allison B ^a   Rosenthal, Robert ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

behavioural observation; Cohen's kappa; focused kappa; interobserver reliability; observational methodology; omnibus kappa; percentage agreement; reliability

Indexed keywords

BEHAVIORAL ECOLOGY; COMMUNICATION BEHAVIOR; EYE; OBSERVATIONAL METHOD; RELIABILITY ANALYSIS;

ANIMALIA;

EID: 70849092064     PISSN: 00033472     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.anbehav.2009.09.014     Document Type: Note

References (20)

1. Bakeman R., and Gottman J.M. Observing Interaction: an Introduction to Sequential Analysis (1997), Cambridge University Press, Cambridge
2. Banerjee M. Beyond kappa: a review of interrater agreement measures. Canadian Journal of Statistics-Revue Canadienne de Statistique 27 (1999) 3-23
3. Cicchetti D. The precision of reliability and validity estimates re-visited: distinguishing between clinical and statistical significance of sample size requirements. Journal of Clinical and Experimental Neuropsychology 23 (2001) 695-700
4. Cicchetti D.V., and Sparrow S.S. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. American Journal of Mental Deficiency 86 (1981) 127-137
5. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20 (1960) 37-46
6. Fleiss J.L., Levin B., and Cho Paik M. Statistical Methods for Rates and Proportions (2003), J. Wiley, New York
7. Gilby I., Lonsdorf E.V., Wallauer B., and Mosher K. Chimpanzee Behaviors! (2008). http://www.discoverchimpanzees.org/behaviors/top.php Retrieved 20 October 2008 from
8. Goossens B.M.A., Dekleva M., Reader S.M., Sterck E.H.M., and Bolhuis J.J. Gaze following in monkeys is modulated by observed facial expressions. Animal Behaviour 75 (2008) 1673-1681
9. Loftus E.F. Reconstructing memory: the incredible witness. Psychology Today 8 (1974) 116-119
10. Lombard M., Snyder-Duch J., and Bracken C.C. Content analysis in mass communication: assessment and reporting of intercoder reliability. (vol 28, pg 587, 2002). Human Communication Research 29 (2002) 469-472
11. Martin F., and Bateson P. Measuring Behavior: an Introductory Guide (1986), Cambridge University Press, Cambridge
12. Palagi E. Sharing the motivation to play: the use of signals in adult bonobos. Animal Behaviour 75 (2008) 887-896
13. Perry S., Manson J.H., Muniz L., Gros-Louis J., and Vigilant L. Kin-biased social behaviour in wild adult female white-faced capuchins, Cebus capucinus. Animal Behaviour 76 (2008) 187-199
14. Riedel J., Schumann K., Kaminski J., Call J., and Tomasello M. The early ontogeny of human-dog communication. Animal Behaviour 75 (2008) 1003-1014
15. Rosenthal R. Experimenter Effects in Behavioral Research. Enlarged edn (1976), Irvington, New York
16. Rosenthal R. Conducting judgment studies: some methodological issues. In: Harrigan J.A., Rosenthal R., and Scherer K.R. (Eds). The New Handbook of Methods in Nonverbal Behavior Research (2005), Oxford University Press, New York 199-236
17. Rosenthal R., and Rosnow R.L. Essentials of Behavioral Research: Methods and Data Analysis. 3rd edn (2008), McGraw-Hill, New York
18. Rosenthal R., and Rubin D.B. A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology 74 (1982) 166-169
19. Spinney L. Line-ups on trial. Nature 453 (2008) 442-444
20. Suen H.K., and Lee P.S.C. Effects of the use of percentage agreement on behavioral observation reliabilities: a reassessment. Journal of Psychopathology and Behavioral Assessment 7 (1985) 221-234