Four bad habits of modern psychologists

Behavioral Sciences

Volumn 7, Issue 3, 2017, Pages

  Grice, James ^a   Barrett, Paul ^b   Cota, Lisa ^a   Felix, Crystal ^a   Taylor, Zachery ^a   Garner, Samantha ^a   Medellin, Eliwid ^a   Vest, Adam ^a  

^a OKLAHOMA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF AUCKLAND   (New Zealand)

Author keywords

Inference; Measurement; Modeling; NHST; Observation Oriented Modeling; Replication

Indexed keywords

EID: 85057841280     PISSN: None     EISSN: 2076328X     Source Type: Journal    
DOI: 10.3390/bs7030053     Document Type: Article

References (57)

1. Aquinas, T. The Division and Methods of the Sciences; The Pontifical Institute of Mediaeval Studies: Toronto, ON, Canada, 1963.
2. Hubbard, R. Corrupt Research: The Case for Reconceptualizing Empirical Management and Social Science; Sage: Los Angeles, CA, USA, 2015.
3. Open Science Collaboration. Estimating the reproducibility of psychological science. Science 2015, 349, aac4716. [CrossRef]
4. Alcock, J. Back from the future: Parapsychology and the Bem affair. Skept. Inq. 2011, 35, 31-39. Available online: http://www.csicop.org/specialarticles/show/back-from-the-future (accessed on 19 March 2017).
5. Bem, D.J. Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. J. Personal. Soc. Psychol. 2011,100, 407-425. [CrossRef] [PubMed]
6. Wagenmakers, E.J.; Wetzels, R.; Borsboom, D.; van der Maas, H. Why psychologists must change the way they analyze their data: The case of psi. J. Personal. Soc. Psychol. 2011,100, 426-432. [CrossRef] [PubMed]
7. Haig, B.D. An abductive theory of scientific method. Psychol. Methods 2005,10, 371-388. [CrossRef] [PubMed]
8. Haig, B. Investigating the Psychological World; MIT Press: Cambridge, MA, USA, 2014.
9. Schmidt, J.R.; Besner, D. The Stroop effect: Why proportion congruent has nothing to do with congruency and everything to do with contingency. J. Exp. Psychol. Learn. Mem. Cogn. 2008, 34, 514-523. [CrossRef] [PubMed]
10. Cloud, M.D.; Kyc, M.M. Replication of "The Stroop Effect: Why Proportion Congruent Has Nothing to do with Congruency and Everything to do with Contingency" by JR Schmidt and D Besner (2008, JEPLMC). 2015. Available online: https://osf.io/bscfe/ (accessed on 19 March 2017).
11. Grice, J.W. Observation Oriented Modeling: Analysis of Cause in the Behavioral Sciences; Academic Press: New York, NY, USA, 2011.
12. Grice, J.W. Observation oriented modeling: Preparing students for the research in the 21st Century. Innov. Teach. 2014, 3. [CrossRef]
13. Breiman, L. Statistical modeling: The two cultures. Stat. Sci. 2001,16,199-231. [CrossRef]
14. Rychlak, J.F. The Psychology of Rigorous Humanism, 2nd ed.; New York University Press: New York, NY, USA, 1988.
15. Nairne, J.S.; Pandeirada, J.N.S.; Thompson, S.R. Adaptive memory: The comparative value of survival processing. Psychol. Sci. 2008,19,176-180. [CrossRef] [PubMed]
16. Muller, S.; Renkewitz, F. Replication of Nairne, Pandeirada, & Thompson (2008, PS, Study 2). 2015. Available online: https://osf.io/jhkpe/ (accessed on 19 March 2017).
17. Edgington, E.; Onghena, P. Randomization Tests, 4th ed.; Chapman & Hall: London, UK, 2007.
18. Nairne, J.S.; Pandeirada, J.N.S. Adaptive memory: The evolutionary significance of survival processing. Perspect. Psychol. Sci. 2016,11, 496-511. [CrossRef] [PubMed]
19. Maxwell, S.; Delaney, H. Designing Experiments and Analyzing Data: A Model Comparisons Approach, 2nd ed.; Erlbaum: Mahwah, NJ, USA, 2004.
20. Barrett, P.T. Hierarchical Multiple Linear Regression and the Correct Interpretation of the Magnitude of a Deviation R-square (AR2); Cognadev Technical Report Series; Cognadev UK Ltd.: Middlesex, UK, 2016; Available online: http://www.pbarrett.net/techpapers.html (accessed on 19 March 2017).
21. Payne, B.K.; Burkley, M.A.; Stokes, M.B. Why do implicit and explicit attitude tests diverge? The role of structural fit. J. Personal. Soc. Psychol. 2008, 94,16-31. [CrossRef] [PubMed]
22. Vianello, M. Replication of Payne, Burkley and Stokes (2008, JPSP, Study 4). 2015. Available online: https://osf.io/rc6mv/ (accessed on 19 March 2017).
23. Crowley, C.O.P. Aristotelian-Thomistic Philosophy of Measure and the International System of Units (SI); University Press of America: Lanham, MD, USA, 1996.
24. Michell, J. Measurement in Psychology: Critical History ofa Methodological Concept; Cambridge University Press: Cambridge, UK, 1999.
25. Stevens, S.S. On the theory of scales of measurement. Science 1946,103, 677-680. [CrossRef] [PubMed]
26. Jung, C.G. Psychological Types; Princeton University Press: Princeton, NJ, USA, 1971.
27. Barrett, P.T. The consequence of sustaining a pathology: Scientific stagnation-A commentary on the target article "Is psychometrics a pathological science?" by Joel Michell. Measurement 2008, 6, 78-123. [CrossRef]
28. Lovie, A.D. Commentary on Michell, Quantitative science and the definition of measurement in psychology. Br. J. Psychol. 1997, 88, 393-394. [CrossRef]
29. Michell, J. Is psychometrics pathological science? Measurement 2008, 6, 7-24. [CrossRef]
30. Exline, J.J.; Baumeister, R.F.; Zell, A.L.; Kraft, A.J.; Witvliet, C.V.O. Not so innocent: Does seeing one's own capability for wrongdoing predict forgiveness? J. Personal. Soc. Psychol. 2008, 94, 495-515. [CrossRef] [PubMed]
31. Lin, S.; Frank, M.C. Replication of Exline et al. (2008, JPSP, Study 7). 2015. Available online: https://osf.io/imrx2/ (accessed on 19 March 2017).
32. Nunnally, J. Psychometric Theory, 2nd ed.; McGraw-Hill: New York, NY, USA, 1978.
33. Dorough-Morris, S.I.; Cox, R.A.; Grice, J.W. Scale imposition as quantitative alchemy: Studies on the transitivity of self-and other-rankings with respect to neuroticism and known quantitative attributes. Basic Appl. Soc. Psychol. 2017, 39, 1-18. [CrossRef]
34. Lord, F.M.; Novick, M. Statistical Theories of Mental Test Scores; Addison-Wesley: Reading, MA, USA, 1968.
35. Lazarsfeld, P.F. Latent structure analysis. In Psychology: A Study of a Science; Koch, S., Ed.; McGraw-Hill: New York, NY, USA, 1959.
36. Grice, J.W.; Cota, L.D.; Barrett, P.T.; Wuensch, K.L.; Poteat, G.M. A simple and transparent alternative to logistic regression. Adv. Soc. Sci. Res. J. 2016, 3,147-165. [CrossRef]
37. Ferguson, C.J. "Everybody knows psychology is not a real science": Public perceptions of psychology and how we can improve our relationship with policymakers, the scientific community, and the general public. Am. Psychol. 2015, 70, 527-542. [CrossRef] [PubMed]
38. Lykken, D.T. What's wrong with psychology anyway? In Thinking Clearly about Psychology. Volume 1: Matters of Public Interest; Cicchetti, D., Grove, W.M., Eds.; University of Minnesota Press: Minneapolis, MN, USA, 1991; Chapter 1; pp. 3-39.
39. Wood, B. What's Still Wrong with Psychology, Anyway? Twenty Slow Years, Three Old Issues, and One New Methodology for Improving Psychological Research. Master's Thesis, University of Canterbury, Christchurch, New Zealand, 2011. Available online: https://ir.canterbury.ac.nz/bitstream/handle/10092/5208/thesis-ulltext.pdf?sequence=1&isAllowed=y (accessed on 19 March 2017).
40. Gigerenzer, G.; Marewski, J.N. Surrogate science: The idol of a universal method for scientific inference. J. Manag. 2015, 41, 421-440. [CrossRef]
41. Tryon, W.W.; Patelis, T.; Chajewski, M.; Lewis, C. Theory construction and data analysis. Theory Psychol. 2017, 27, 126-134. [CrossRef]
42. Trafimow, D.; Earp, B.D. Null hypothesis significance testing and Type I error: The domain problem. New Ideas Psychol. 2017, 45, 19-27. [CrossRef]
43. Freedman, D.A.; Berk, R.A. Statistical assumptions as empirical commitments. In Law, Punishment, and Social Control: Essays in Honor of Sheldon Messinger, 2nd ed.; Blomberg, T.G., Cohen, S., Eds.; Aldine de Gruyter: Hawthorne, NY, USA, 2003; pp. 235-254.
44. Henrich, J.; Heine, S.J.; Norenzayan, A. The weirdest people in the world? Behav. Brain Sci. 2010, 33, 61-135. [CrossRef] [PubMed]
45. Tryon, W.W. Underreliance on mechanistic models: Comment on Ferguson (2015). Am. Psychol. 2016, 71, 505-506. [CrossRef] [PubMed]
46. Grice, J.W.; Barrett, P.T.; Schlimgen, L.A.; Abramson, C.I. Toward a brighter future for psychology as an observation oriented science. Behav. Sci. 2012, 2,1-22. [CrossRef] [PubMed]
47. Grice, J.W. From means and variances to patterns and persons. Front. Psychol. 2015, 6. [CrossRef] [PubMed]
48. Grice, J.W.; Yepez, M.; Wilson, N.L.; Shoda, Y. Observation oriented modeling: Going beyond 'is it all a matter of chance'? Educ. Psychol. Meas. 2016. [CrossRef]
49. Powers, W.T. Behavior: The Control of Perception, 1st ed.; Aldine Publishing Company: Chicago, IL, USA, 1973.
50. Powers, W.T. Living Control Systems III: Modeling Behavior; Benchmark Publications: Montclair, NJ, USA, 2008.
51. Cevasco, J.; Marmolejo-Ramos, F. The importance of studying prosody in the comprehension of spontaneous spoken discourse. Rev. Latinoam. Psicol. 2013, 45, 21-33.
52. Lamiell, J.T. Statisticism in personality psychologists' use of trait constructs: What is it? How was it contracted? Is there a cure? New Ideas Psychol. 2013, 31, 65-71. [CrossRef]
53. Trafimow, D. The mean as a multilevel issue. Front. Psychol. 2014, 5,180. [CrossRef] [PubMed]
54. Button, K.S.; Ioannidis, J.P.A.; Mokrysz, C.; Nosek, B.A.; Flint, J.; Robinson, E.S.J.; Munafo, M.R. Power failure: Why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 2013, 14, 365-376. [CrossRef] [PubMed]
55. Ashton, J.C. Experimental power comes from powerful theories-The real problem in null hypothesis testing. Nat. Rev. Neurosci. 2013, 14, 585. [CrossRef] [PubMed]
56. Thagard, P. Being interdisciplinary: Trading zones in cognitive science. In Interdisciplinary Collaboration: An Emerging Cognitive Science; Derry, S.J., Schunn, C.D., Gernsbacher, M.A., Eds.; Erlbaum: Mahwah, NJ, USA, 2005; pp. 317-339.
57. Kirsner, K. Target definition for shipwreck hunting. Front. Psychol. Quant. Psychol. Meas. 2015, 6, 1-19. [CrossRef] [PubMed]