Has the standard cognitive reflection test become a victim of its own success?

Advances in Cognitive Psychology

Volumn 12, Issue 3, 2016, Pages 145-149

  Haigh, Matthew ^a  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

Author keywords

Bat and ball problem; Cognitive reflection test; CRT; Test security; Validity

Indexed keywords

EID: 84991102195     PISSN: 18951171     EISSN: None     Source Type: Journal    
DOI: 10.5709/acp-0193-5     Document Type: Article

References (14)

1. American Psychological Association (2016). Statement on the use of secure psychological tests in the education of graduate and undergraduate psychology students. Retrieved from http://www.apa.org/science/programs/testing/test-security.aspx
2. British Psychological Society (2016). Statement on the conduct of psychologists providing expert psychometric evidence to courts and lawyers. Retrieved from http://www.bps.org.uk/sites/default/files/documents/statement-psychometric-evidence.pdf
3. Chandler, J., Mueller, P., & Paolacci, G. (2014). Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods, 46, 112-130. doi: 10.3758/s13428-013-0365-7
4. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. Abingdon-on-Thames, England: Routledge.
5. Evans, J. S. B., & Stanovich, K. E. (2013). Dual-process theories of higher cognition advancing the debate. Perspectives on Psychological Science, 8, 223-241. doi: 10.1177/1745691612460685
6. Evans, J. S. B. (2008). Dual-processing accounts of reasoning, judgment, and social cognition. Annual Review of Psychology, 59, 255-278. doi: 10.1146/annurev. psych.59.103006.093629
7. Frederick, S. (2005). Cognitive reflection and decision making. The Journal of Economic Perspectives, 19, 25-42. doi: 10.1257/089533005775196732
8. Kahneman, D. (2011). Thinking fast and slow. London, UK: Penguin.
9. Pennycook, G., Fugelsang, J. A., & Koehler, D. J. (2015). Everyday consequences of analytic thinking. Current Directions in Psychological Science, 24, 425-432. doi: 10.1177/0963721415604610
10. Primi, C., Morsanyi, K., Chiesi, F., Donati, M. A., & Hamilton, J. (2015). The development and testing of a new version of the cognitive reflection test applying item response theory (IRTIRTIRT). Journal of Behavioral Decision Making. Advance online publication. doi: 10.1002/bdm.1883
11. Stewart, N., Ungemach, C., Harris, A. J., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015). The average laboratory samples a population of 7, 300 Amazon Mechanical Turk workers. Judgment and Decision Making, 10, 479-491.
12. Thomson, K. S., & Oppenheimer, D. M. (2016). Investigating an alternate form of the Cognitive Reflection Test. Judgment and Decision Making, 11, 99-113.
13. Toplak, M. E., West, R. F., & Stanovich, K. E. (2011). The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks. Memory & Cognition, 39, 1275-1289. doi: 10.3758/s13421-011-0104-1
14. Toplak, M. E., West, R. F., & Stanovich, K. E. (2014). Assessing miserly information processing: An expansion of the Cognitive Reflection Test. Thinking & Reasoning, 20, 147-168. doi: 10.1080/13546783.2013.844729