A test of the diffusion model explanation for the worst performance rule using preregistration and blinding

Attention, Perception, and Psychophysics

Volumn 79, Issue 3, 2017, Pages 713-725

  Dutilh, Gilles ^a   Vandekerckhove, Joachim ^b   Ly, Alexander ^c   Matzke, Dora ^c   Pedroni, Andreas ^a   Frey, Renato ^a   Rieskamp, Jörg ^a   Wagenmakers, Eric Jan ^c  

^a UNIVERSITY OF BASEL   (Switzerland)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Intelligence; Predictions; Preregistration; Response time model

Indexed keywords

ADOLESCENT; ADULT; FEMALE; HUMAN; INTELLIGENCE; MALE; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; SHORT TERM MEMORY; YOUNG ADULT;

ADOLESCENT; ADULT; FEMALE; HUMANS; INTELLIGENCE; MALE; MEMORY, SHORT-TERM; MODELS, PSYCHOLOGICAL; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

EID: 85013639852     PISSN: 19433921     EISSN: 1943393X     Source Type: Journal    
DOI: 10.3758/s13414-017-1304-y     Document Type: Article

References (36)

1. Baumeister, AA, & Kellas, G (1968). Reaction time and mental retardation. International Review of Research in Mental Retardation, 3, 163–193.
2. Chambers, CD (2013). Registered reports: A new publishing initiative at Cortex. Cortex, 49, 609–610.
3. Coyle, TR (2001). IQ Is related to the worst performance rule in a memory task involving children. Intelligence, 29, 117–129.
4. Coyle, TR (2003). A review of the worst performance rule: Evidence, theory, and alternative hypotheses. Intelligence, 31, 567– 587.
5. Dickey, JM, & Lientz, BP (1970). The weighted likelihood ratio, sharp hypotheses about chances, the order of a Markov chain. The Annals of Mathematical Statistics, 41, 214–226.
6. Dutilh, G., & Rieskamp, J. (2016). Comparing perceptual and preferential decision-making. Psychonomic Bulletin and Review, 23, 723–737.
7. Edwards, W, Lindman, H, & Savage, LJ (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193–242.
8. Howard, JV (1998). The 2 × 2 table: A discussion from a Bayesian viewpoint. Statistical Science, 13, 351–367.
9. Jeffreys, H. (1961). Theory of probability, 3rd edn. Oxford, UK: Oxford University Press.
10. Jensen, AR (1982). Reaction time and psychometric g. In: A model for intelligence (pp. 93–132). Springer.
11. Jensen, AR. (2006). Clocking the mind: Mental chronometry and individual differences. Elsevier.
12. Kass, RE, & Vaidyanathan, SK (1992). Approximate Bayes factors and orthogonal parameters, with application to testing equality of two binomial proportions. Journal of the Royal Statistical Society Series B, 54, 129–144.
13. Kass, RE, & Raftery, AE (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795.
14. Kranzler, JH (1992). A test of Larson and Alderton’s (1990) worst performance rule of reaction time variability. Personality and Individual Differences, 13, 255–261.
15. Larson, GE, & Alderton, DL (1990). Reaction time variability and intelligence: A “worst performance” analysis of individual differences. Intelligence, 14, 309–325.
16. Lee, MD, & Wagenmakers, E -J. (2013). Bayesian cognitive modeling: A practical course. Cambridge University Press.
17. Leite, FP (2009). Should IQ, perceptual speed, or both be used to explain response time? The American Journal of Psychology, 122, 517–526.
18. Lewandowsky, S, Oberauer, K, Yang, L -X, & Ecker, UKH (2010). A working memory test battery for MATLAB. Behavior Research Methods, 42, 571–585.
19. MacCoun, R, & Perlmutter, S (2015). Hide results to seek the truth. Nature, 526, 187–189.
20. Morey, RD, Rouder, JN, & Jamil, T (2014). Bayesfactor: Computation of Bayes factors for common designs. R package version 0.9, 7. Retrieved from http://CRAN.R-project.org/package=BayesFactor
21. Ratcliff, R (1978). A theory of memory retrieval. Psychological Review, 85, 59–108.
22. Ratcliff, R, & Rouder, JN (1998). Modeling response times for two-choice decisions. Psychological Science, 9, 347–356.
23. Ratcliff, R, Schmiedek, F, & McKoon, G (2008). A diffusion model explanation of the worst performance rule for reaction time and IQ. Intelligence, 36, 10–17.
24. Ratcliff, R, Thapar, A, & McKoon, G (2010). Individual differences, aging, and IQ in two-choice tasks. Cognitive Psychology, 60, 127–157.
25. Ratcliff, R, Thapar, A, & McKoon, G (2011). Effects of aging and IQ on item and associative memory. Journal of Experimental Psychology: General, 140, 464.
26. Schmiedek, F, Oberauer, K, Wilhelm, O, Süß, H -M, & Wittmann, WW (2007). Individual differences in components of reaction time distributions and their relations to working memory and intelligence. Journal of Experimental Psychology: General, 136, 414.
27. Schmitz, F, & Wilhelm, O (2016). Modeling mental speed: Decomposing response time distributions in elementary cognitive tasks and correlations with working memory capacity and fluid intelligence. Journal of Intelligence, 4, 13.
28. Unsworth, N, Redick, TS, Lakey, CE, & Young, DL (2010). Lapses in sustained attention and their relation to executive control and fluid abilities: An individual differences investigation. Intelligence, 38, 111–122.
29. Van Ravenzwaaij, D, Brown, S, & Wagenmakers, E -J (2011). An integrated perspective on the relation between response speed and intelligence. Cognition, 119, 381–393.
30. Vandekerckhove, J, & Tuerlinckx, F (2007). Fitting the Ratcliff diffusion model to experimental data. Psychonomic Bulletin and Review, 14, 1011–1026.
31. Vandekerckhove, J, & Tuerlinckx, F (2008). Diffusion model analysis with MATLAB: A DMAT primer. Behavior Research Methods, 40, 61–72.
32. Vandekerckhove, J, Tuerlinckx, F, & Lee, MD (2011). Hierarchical diffusion models for two-choice response times. Psychological Methods, 16, 44–62.
33. Wabersich, D, & Vandekerckhove, J (2014). Extending JAGS: A tutorial on adding custom distributions to JAGS (with a diffusion model example). Behavior Research Methods, 46, 15–28.
34. Wagenmakers, E -J, Lodewyckx, T, Kuriyal, H, & Grasman, R (2010). Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method. Cognitive Psychology, 60, 158–189.
35. Wiecki, TV, Sofer, I, & Frank, MJ (2013). HDDM: Hierarchical Bayesian Estimation of the drift–diffusion model in Python. Frontiers in Neuroinformatics, 7. doi:10.3389/fninf.2013.00014.
36. Wolfe, JM (2013). Registered reports and replications in Attention, Perception, and Psychophysics. Attention, Perception, and Psychophysics, 75, 781–783.