The design and analysis of state-trace experiments

Psychological Methods

Volumn 17, Issue 1, 2012, Pages 78-99

  Prince, Melissa ^a   Brown, Scott ^a   Heathcote, Andrew ^a  

^a UNIVERSITY OF NEWCASTLE   (Australia)

Author keywords

Bayes factors; Dimensional analysis; Inequality constraints; Model selection; State trace analysis

Indexed keywords

ARTICLE; BAYES THEOREM; HUMAN; METHODOLOGY; PSYCHOLOGIC TEST; PSYCHOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS;

BAYES THEOREM; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; PSYCHOLOGICAL TESTS; PSYCHOLOGY; RESEARCH DESIGN;

EID: 84865190738     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0025809     Document Type: Article

References (71)

1. Andrieu, C., de Freites, N., Doucet, A., & Jordan, M. I. (2003). An introduction to MCMC for machine learning. Machine Learning, 50, 5-43. doi:10.1023/A:1020281327116
2. Bamber, D. (1979). State-trace analysis: A method of testing simple theories of causation. Journal of Mathematical Psychology, 19, 137-181. doi:10.1016/0022-2496(79)90016-6
3. Barlow, R. E., Bartholomew, D. J., Bremner, J. M., & Brunk, H. D. (1972). Statistical inference under order restrictions. London, England: Wiley.
4. Bogartz, R. S. (1976). On the meaning of statistical interactions. Journal of Experimental Child Psychology, 22, 178-183. doi:10.1016/00220965(76)90099-0
5. Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review, 110, 203-219. doi:10.1037/0033-295X.110.2.203
6. Brainerd, C. J., Reyna, V. F., & Howe, M. L. (2009). Trichotomous processes in early memory development, aging, and neurocognitive impairment: A unified theory. Psychological Review, 116, 783-832. doi:10.1037/a0016963
7. Brainerd, C. J., Wright, R., Reyna, V. F., & Payne, D. G. (2002). Dual retrieval processes in free and associative recall. Journal of Memory and Language, 46, 120-152. doi:10.1006/jmla.2001.2796
8. Busemeyer, J. R., & Jones, L. E. (1983). Analysis of multiplicative combination rules when the causal variables are measured with error. Psychological Bulletin, 93, 549-562. doi:10.1037/0033-2909.93.3.549
9. Busey, T. A., Tunnicliff, J., Loftus, G. R., & Loftus, E. F. (2000). Accounts of the confidence-accuracy relation in recognition memory. Psychonomic Bulletin & Review, 7, 26-48. doi:10.3758/BF03210724
10. De Brauwer, J., Verguts, T., & Fias, W. (2006). The representation of multiplication facts: Developmental changes in the problem size, five, and tie effects. Journal of Experimental Child Psychology, 94, 43-56. doi:10.1016/j.jecp.2005.11.004
11. Dunn, J. C. (2004). Remember-know: A matter of confidence. Psychological Review, 111, 524-542. doi:10.1037/0033-295X.111.2.524
12. Dunn, J. C. (2008). The dimensionality of the remember-know task: A state-trace analysis. Psychological Review, 115, 426-446. doi:10.1037/ 0033-295X.115.2.426
13. Dunn, J. C., & James, R. N. (2003). Signed difference analysis: Theory and application. Journal of Mathematical Psychology, 47, 389-416. doi: 10.1016/S0022-2496(03)00049-X
14. Dunn, J. C., & Kirsner, K. (1988). Discovering functionally independent mental processes: The principle of reversed association. Psychological Review, 95, 91-101. doi:10.1037/0033-295X.95.1.91
15. Efron, B., & Tibshirani, R. J. (1998). An introduction to the bootstrap. New York, NY: CRC Press.
16. Freeman, E., Dennis, S., & Dunn, J. (2010). An examination of the ERP correlates of recognition memory using state-trace analysis. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd annual conference of the Cognitive Science Society (pp. 97-102). Austin, TX: Cognitive Science Society.
17. Gallistel, C. R. (2009). The importance of proving the null. Psychological Review, 116, 439-453. doi:10.1037/a0015251
18. Gelfand, A. E., Smith, A. F. M., & Lee, R.-M. (1992). Bayesian analysis of constrained parameter and truncated data problems. Journal of the American Statistical Association, 87, 523-532. doi:10.2307/2290286
19. Haist, F., Shimamura, A. P., & Squire, L. R. (1992). On the relationship between recall and recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 691-702. doi:10.1037/0278-7393.18.4.691
20. Hawkins, G., Prince, M., Brown, S. D., & Heathcote, A. (2010). Designing state-trace experiments to assess the number of latent psychological variables underlying binary choices. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd annual conference of the Cognitive Science Society (pp. 2224-2229). Austin, TX: Cognitive Science Society.
21. Heathcote, A., Bora, B., & Freeman, E. (2010). Modeling choice-similarity effects in episodic recognition. Journal of Memory and Language, 62, 183-203. doi:10.1016/j.jml.2009.11.003
22. Heathcote, A., Freeman, E., Etherington, J., Tonkin, J., & Bora, B. (2009). A dissociation between similarity effects in episodic face recognition. Psychonomic Bulletin & Review, 16, 824-831. doi:10.3758/PBR.16.5.824
23. Henson, R. (2006). Forward inference using functional neuroimaging: Dissociations versus associations. Trends in Cognitive Sciences, 10, 64-69. doi:10.1016/j.tics.2005.12.005
24. Hintzman, D. L. (2004). Judgment of frequency versus recognition confidence: Repetition and recursive reminding. Memory & Cognition, 32, 336-350. doi:10.3758/BF03196863
25. Jang, Y., & Nelson, T. O. (2005). How many dimensions underlie judgments of learning and recall? Evidence from state-trace methodology. Journal of Experimental Psychology: General, 134, 308-326. doi: 10.1037/0096-3445.134.3.308
26. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795. doi:10.2307/2291091
27. Kliegl, R., Maayr, U., & Krampe, R. T. (1994). Time-accuracy functions for determining process and person differences: An application to cognitive aging. Cognitive Psychology, 26, 134-164. doi:10.1006/ cogp.1994.1005
28. Klugkist, I., Kato, B., & Hoijtink, H. (2005). Bayesian model selection using encompassing priors. Statistica Neerlandica, 59, 57-69. doi: 10.1111/j.1467-9574.2005.00279.x
29. Klugkist, I., Laudy, O., & Hoijtink, H. (2005). Inequality constrained analysis of variance: A Bayesian approach. Psychological Methods, 10, 477-493. doi:10.1037/1082-989X.10.4.477
30. Lewandowsky, S., Geiger, S. M., Morrell, D. B., & Oberauer, K. (2010). Turning simple span into complex span: Time for decay or interference from distractors? Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 958-978. doi:10.1037/a0019764
31. Liu, C. C., & Aitkin, M. (2008). Bayes factors: Prior sensitivity and model generalizability. Journal of Mathematical Psychology, 52, 362-375. doi:10.1016/j.jmp.2008.03.002
32. Loftus, G. R. (1978). On interpretation of interactions. Memory & Cognition, 6, 312-319. doi:10.3758/BF03197461
33. Loftus, G. R. (2002). Analysis, interpretation, and visual presentation of experimental data. In H. Pashler (Series Ed.) & J. Wixted (Vol. Ed.), Stevens' handbook of experimental psychology: Vol. 4. Methodology in experimental psychology (pp. 339-390). New York, NY: Wiley.
34. Loftus, G. R., & Harley, E. M. (2005). Why is it easier to identify someone close than far away? Psychonomic Bulletin & Review, 12, 43-65. doi:10.3758/BF03196348
35. Loftus, G. R., & Irwin, D. E. (1998). On the relations among different measures of visible and informational persistence. Cognitive Psychology, 35, 135-199. doi:10.1006/cogp.1998.0678
36. Loftus, G. R., & Masson, M. E. J. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1, 476-490. doi:10.3758/BF03210951
37. Loftus, G. R., Oberg, M. A., & Dillon, A. M. (2004). Linear theory, dimensional theory, and the face-inversion effect. Psychological Review, 111, 835-865. doi:10.1037/0033-295X.111.4.835
38. Macmillan, T. A., & Creelman, C. D. (2005). Detection theory: A user's guide (2nd ed.). New York, NY: Cambridge University Press.
39. Maurer, D., Le Grand, R., & Mondloch, C. J. (2002). The many faces of configural processing. Trends in Cognitive Sciences, 6, 255-260. doi: 10.1016/S1364-6613(02)01903-4
40. McLachlan, G., & Peel, D. (2000). Finite mixture models. New York, NY: Wiley.
41. Myung, J., Karabatsos, G., & IIverson, G. J. (2008). A statistician's view on Bayesian evaluation of informative hypotheses. In H. Hoijtink, I. Klug-kist, & P. Boelen (Eds.), Bayesian evaluation of informative hypotheses (pp. 309-327). Berlin, Germany: Springer.
42. Newell, B. R., & Dunn, J. C. (2008). Dimensions in data: Testing psychological models using state-trace analysis. Trends in Cognitive Sciences, 12, 285-290. doi:10.1016/j.tics.2008.04.009
43. Newell, B. R., Dunn, J. C., & Kalish, M. (2010). The dimensionality of perceptual category learning: A state-trace analysis. Memory & Cognition, 38, 563-581. doi:10.3758/MC.38.5.563
44. Newell, B. R., Dunn, J. C., & Kalish, M. (2011). Systems of category learning: Fact or fantasy? Psychology of Learning and Motivation, 54, 167-215.
45. Nilsson, L., & Gardiner, J. M. (1993). Identifying exceptions in a database of recognition failure studies from 1973 to 1992. Memory & Cognition, 21, 397-410. doi:10.3758/BF03208273
46. Oberauer, K., & Lewandowsky, S. (2008). Forgetting in immediate serial recall: Decay, temporal distinctiveness, or interference? Psychological Review, 115, 544-576. doi:10.1037/0033-295X.115.3.544
47. Pitt, M. A., & Myung, I. J. (2002). When a good fit can be bad. Trends in Cognitive Sciences, 6, 421-425. doi:10.1016/S1364-6613(02) 01964-2
48. Poldrack, R. A. (2006). Can cognitive processes be inferred from neuroimaging data? Trends in Cognitive Sciences 10, 59-63. doi:10.1016/ j.tics.2005.12.004
49. Prince, M., Hawkins, G., Love, J., & Heathcote, A. (2011). An R package for state-trace analysis. Manuscript submitted for publication.
50. Prince, M., & Heathcote, A. (2009). State-trace analysis of the face-inversion effect. In N. A. Taatgen & H. van Rijn (Eds.), Proceedings of the 31st annual conference of the Cognitive Science Society (pp. 66-72). Austin, TX: Cognitive Science Society.
51. Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111-163. doi:10.2307/271063
52. Rakover, S. S. (2002). Featural vs. configurational information in faces: A conceptual and empirical analysis. British Journal of Psychology, 93, 1-30. doi:10.1348/000712602162427
53. Rakover, S. S., & Teucher, B. (1997). Facial inversion effects: Parts and whole relationship. Perception & Psychophysics, 59, 752-761. doi: 10.3758/BF03206021
54. R Development Core Team. (2010). R: A language and environment for statistical computing. Retrieved from http://www.R-project.org
55. Rock, I. (1974). The perception of disoriented figures. Scientific American, 230, 78-85. doi:10.1038/scientificamerican0174-78
56. Rouder, J., & Lu, J. (2005). An introduction to Bayesian hierarchical models with an application in the theory of signal detection. Psychonomic Bulletin & Review, 12, 573-604. doi:10.3758/BF03196750
57. Saville, D. J. (2003). Basic statistics and the inconsistency of multiple comparison procedures. Canadian Journal of Psychology, 57, 167-175.
58. Shallice, T. (1988). From neuropsychology to mental structure. New York, NY: Cambridge University Press
59. Sheather, S. J., & Jones, M. C. (1991). A reliable data-based bandwidth selection method for kernel density estimation. Journal of the Royal Statistical Society: Series B: Methodological, 53, 683-690.
60. Tulving, E. (1985). Memory and consciousness. Canadian Psychology, 26, 1-12. doi:10.1037/h0080017
61. Tulving, E., & Thomson, D. M. (1973). Encoding specificity and retrieval processes in episodic memory. Psychological Review, 80, 352-373. doi:10.1037/h0020071
62. Valentine, T. (1988). Upside-down faces: A review of the effect of inversion upon face recognition. British Journal of Psychology, 79, 471-491. doi:10.1111/j.2044-8295.1988.tb02747.x
63. Van den Broeck, W., & Geudens, A. (2011). Old and new ways to study characteristics of reading disability: The case of the nonword reading deficit. Manuscript submitted for publication.
64. Verhaeghen, P., & Cerella, J. (2002). Aging, executive control, and attention: A review of meta-analyses. Neuroscience & Biobehavioral Reviews, 26, 849-857. doi:10.1016/S0149-7634(02)00071-4
65. Verhaeghen, P., & De Meersman, L. (1998). Aging and the negative priming effect: A meta-analysis. Psychology and Aging, 13, 435-444. doi:10.1037/0882-7974.13.3.435
66. Verhaeghen, P., Steitz, D. W., Sliwinski, M. J., & Cerella, J. (2003). Aging and dual-task performance: A meta-analysis. Psychology and Aging, 18, 443-460. doi:10.1037/0882-7974.18.3.443
67. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779-804. doi:10.3758/ BF03194105
68. Wand, M. P., & Jones, M. C. (1995). Kernel smoothing. London, England: Chapman & Hall.
69. Wixted, J. T. (1990). Analyzing the empirical course of forgetting. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 927-935. doi:10.1037/0278-7393.16.5.927
70. Wixted, J. T. (2007). Dual-process theory and signal-detection theory of recognition memory. Psychological Review, 114, 152-176. doi:10.1037/ 0033-295X.114.1.152
71. Yin, R. K. (1969). Looking at upside-down faces. Journal of Experimental Psychology, 81, 141-145. doi:10.1037/h0027474