Pseudoreplication is a Pseudoproblem

Journal of Comparative Psychology

Volumn 123, Issue 4, 2009, Pages 421-433

  Schank, Jeffrey C ^a   Koehnle, Thomas J ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HIRAM COLLEGE   (United States)

Author keywords

experimental design; pseudoreplication; statistical analysis

Indexed keywords

ANALYSIS OF VARIANCE; ANIMAL; ANIMAL BEHAVIOR; ARTICLE; ECOLOGY; EPIDEMIOLOGY; METHODOLOGY; REPRODUCIBILITY; STATISTICAL MODEL; STATISTICS;

ANALYSIS OF VARIANCE; ANIMALS; BEHAVIOR, ANIMAL; BIAS (EPIDEMIOLOGY); ECOLOGY; MODELS, STATISTICAL; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 72949087913     PISSN: 07357036     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0013579     Document Type: Article

References (50)

1. Bailey K.R., Rustay N.R., and Crawley J.N. Behavioral phenotyping of transgenic and knockout mice: Practical concerns and potential pitfalls. ILAR Journal 42 (2006) 124-131
2. Bancroft T.A. Analysis and inference for incompletely specified models involving the use of preliminary tests(s) of significance. Biometrica 20 (1964) 427-442
3. Blumberg M.S., Efimova I.V., and Alberts J.R. Ultrasonic vocalizations by rat pups: The primary importance of ambient temperature and the thermal significance of contact comfort. Developmental Psychobiology 25 (1992) 229-250
4. Burstein L. The analysis of multilevel data in educational research and evaluation. Review of Research in Education 8 (1980) 158-233
5. Cohen J. The earth is round (P<0.05). American Psychologist 49 (1994) 997-1003
6. Crawley J.N. Behavioral phenotyping of transgenic and knockout mice: Experimental design and evaluation of general health, sensory functions, motor abilities, and specific behavioral tests. Brain Research 835 (1999) 18-26
7. Cronbach L.J. Research on classrooms and schools: Formulation of questions, design, and analysis (Occasional Paper) (1976), Stanford Evaluation Consortium, Stanford, CA
8. Fisher R.A. The design of experiments (1935), Oliver and Boyd, Edinburgh
9. Freed-Brown S.G., King A.P., Miller J.L., and West M.J. Uncovering sources of variation in female sociality: Implications for the development of social preferences in female cowbirds (Molothrus ater). Behaviour 143 (2006) 1293-1315
10. Gigerenzer G., Swijtink Z., Porter T., Daston L., Beatty J., and Kruger L. The empire of chance: How probability changed science and everyday life (1989), Cambridge University Press, Cambridge, UK
11. Goldstein H. Multilevel statistical models (1995), Halsted, New York
12. Hammond J.K. Two sources of error in ecological correlations. American Sociological Review 38 (1973) 764-777
13. Heffner R.A., Butler IV M.J., and Reilly C.K. Pseudoreplication revisited. Ecology 77 (1996) 2558-2562
14. Hopkins K.D. The unit of analysis: Group means versus individual observations. American Education Research Journal 19 (1982) 5-18
15. Hox J.J. Applied multilevel analysis (1995), TT-Publikaties, Amsterdam
16. Hox J.J., and Maas M. The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling 8 (2001) 157-174
17. Hurlbert S.H. Pseudoreplication and the design of ecological field experiments. Ecological Monographs 51 (1984) 187-211
18. Hurlbert S.H. Experiments with freshwater invertebrate zooplanktivores: Quality of statistical analyses. Bulletin of Marine Science 53 (1993) 128-153
19. Hurlbert S.H. Old shibboleths and new syntheses (Book review). Trends in Ecology and Evolution 9 (1994) 495-496
20. Hurlbert S.H. Experiments in ecology (Book review). Endeavour 21 (1997) 172-173
21. Hurlbert S.H. On misinterpretations of pseudoreplication and related matters: A reply to Oksanen. Oikos 104 (2004) 591-597
22. Jenkins S.H. Data pooling and Type I errors: A comment on Leger & Didrichsons. Animal Behaviour 63 (2001) 9-11
23. Kauffman S.A. Articulation of parts explanation in biology and the rational search for them. Boston Studies in the Philosophy of Science 8 (1971) 257-272
24. Kirk R.E. Experimental design: Procedures for the behavioral sciences (1982), Brooks/Cole Publishing Co, Monterey, CA
25. Kreft I., and de Leeuw J. Multilevel analysis (1999), Sage, Thousand Oaks, CA
26. Kroodsma D.E. Suggested experimental designs for song playbacks. Animal Behaviour 37 (1989) 600-609
27. Kroodsma D.E. Using appropriate experimental designs for intended hypotheses in song playbacks, with examples for testing effects of song repertoire sizes. Animal Behaviour 40 (1990) 1138-1150
28. Kroodsma D.E., Byers B.E., Goodale E., Johnson S., and Liu W. Pseudoreplication in playback experiments, revisited a decade later. Animal Behaviour 61 (2001) 1029-1033
29. Leger D.W., and Didrichsons I.A. An assessment of data pooling and some alternatives. Animal Behaviour 48 (1994) 823-832
30. Lehrman D.S. A critique of Konrad Lorenz's theory of instinctive behavior. Quarterly Review of Biology 28 (1953) 337-363
31. Lindquist F. Statistical analysis in educational research (1940), Houghton Mifflin, New York
32. Lombardi C.M., and Hurlbert S.H. Sunfish cognition and pseudoreplication. Animal Behaviour 52 (1996) 419-422
33. McGregor P.K., Catchpole C.K., Dabelsteen T., Falls J.B., Fusani L., Gerhardt H.C., et al. Design of playback experiments: The Thornbridge Hall NATO ARW Consensus. In: McGregor P.K. (Ed). Playback and studies of animal communication (1992), Plenum Press, New York 1-9
34. Millar P.B., and Anderson M.J. Remedies for pseudoreplication. Fisheries Research 70 (2004) 397-407
35. Oakes M. Statistical inference: A commentary for the social and behavioral sciences (1986), Wiley, New York
36. Oksanen L. Logic of experiments in ecology: Is pseudoreplication a pseudoissue?. Oikos 94 (2001) 27-38
37. Oksanen L. The devil lies in details: Reply to Stuart Hurlbert. Oikos 104 (2004) 598-605
38. Pearson K. Mathematical contributions to the theory of evolution. III Regression, heredity, and panmaxia. Philosophical Transactions of the Royal Society (Series A) 187 (1896) 253-318
39. Qian S.S., and Shen Z. Ecological applications of multilevel analysis of variance. Ecology 88 (2007) 2489-2495
40. Raudenbush S.W., and Bryk A.S. Methodological advances in analyzing the effects of schools and classrooms on student learning. Review of Research in Education 15 (1988) 423-475
41. Robinson W.S. Ecological correlations and the behavior of individuals. American Sociological Review 15 (1950) 351-357
42. Sniders T., and Bosker R. Multilevel analysis (1999), Sage, Thousand Oaks, CA
43. Stamps J.A., and Blozis S.A. Effects of natal experience on habitat selection when individuals make choices in groups: A multilevel analysis. Animal Behaviour 71 (2006) 663-672
44. Tinbergen N. On aims and methods of ethology. Zeitschrift für Tierpsychologie 20 (1963) 410-429
45. Underwood A.J. Experiments in ecology: Their logical design and interpretation using analysis of variance (1997), Cambridge University Press, Cambridge, UK
46. van der Staay F.J., and Steckler T. Behavioral phenotyping of mouse mutants. Behavioural Brain Research 125 (2001) 3-12
47. van der Staay F.J., and Steckler T. The fallacy of behavioral phenotyping without standardization. Genes, Brain and Behavior 1 (2002) 9-13
48. Wiley R.H. Is there an ideal behavioural experiment?. Animal Behaviour 66 (2003) 585-588
49. Yang Z., and Schank J.C. Women do not synchronize their menstrual cycles. Human Nature 17 (2006) 333-347
50. Zhang D., and Wilson V.L. Comparing empirical power of multilevel structural equation models and hierarchical linear models: Understanding cross-level interactions. Structural Equation Modeling 13 (2006) 615-630