Underpowered samples, false negatives, and unconscious learning

Psychonomic Bulletin and Review

Volumn 23, Issue 1, 2016, Pages 87-102

  Vadillo, Miguel A ^a   Konstantinidis, Emmanouil ^b   Shanks, David R ^c  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Contextual cuing; False negatives; Implicit learning; Null hypothesis Significance testing Statistical power

Indexed keywords

ADULT; ASSOCIATION; AWARENESS; EGO DEVELOPMENT; FEMALE; HUMAN; LEARNING; MALE; META ANALYSIS (TOPIC); PHYSIOLOGY; STATISTICAL ANALYSIS;

ADULT; AWARENESS; CUES; DATA INTERPRETATION, STATISTICAL; FEMALE; HUMANS; LEARNING; MALE; META-ANALYSIS AS TOPIC; UNCONSCIOUS (PSYCHOLOGY);

EID: 84957435681     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-015-0892-6     Document Type: Article

References (110)

1. Bargh, J. A. (2006). What have we been priming all these years? On the development, mechanisms, and ecology of nonconscious social behavior. European Journal of Social Psychology, 36, 147–168.
2. Bargh, J. A., Chen, M., & Burrows, L. (1996). Automaticity of social behavior: Direct effects of trait construct and stereotype activation on action. Journal of Personality and Social Psychology, 71, 230–244.
3. *Barnes, K. A., Howard, J. H., Jr., Howard, D. V., Gilotty, L., Kenworthy, L., Gaillard, W. D., & Vaidya, C. J. (2008). Intact implicit learning of spatial context and temporal sequences in childhood autism spectrum disorder. Neuropsychology, 22, 563–570.
4. *Barnes, K. A., Howard, J. H., Jr., Howard, D. V., Kenealy, L., & Vaidya, C. J. (2010). Two forms of implicit learning in childhood ADHD. Developmental Neuropsychology, 35, 494–505.
5. Behara, A., Tranel, D., Damasio, H., Adolphs, R., Rockland, C., & Damasio, A. R. (1995). Double dissociation of conditioning and declarative knowledge relative to the amygdala and hippocampus in humans. Science, 269, 1115–1118.
6. *Bennett, I. J., Barnes, K. A., Howard, J. H., Jr., & Howard, D. V. (2009). An abbreviated implicit spatial context learning task that yields greater learning. Behavior Research Methods, 41, 391–395.
7. *Brady, T. F., & Chun, M. M. (2007). Spatial constraints on learning in visual search: Modeling contextual cuing. Journal of Experimental Psychology: Human Perception and Performance, 33, 798–815.
8. Brockmole, J. R., & Henderson, J. M. (2006). Using real-world scenes as contextual cues for search. Visual Cognition, 13, 99–108.
9. Brockmole, J. R., & Vo, M. L.-H. (2010). Semantic memory for contextual regularities within and across scene categories: Evidence from eye movements. Attention, Perception, & Psychophysics, 72, 1803–1813.
10. Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews, 14, 365–376.
11. *Chaumon, M., Drouet, V., & Tallon-Baudry, C. (2008). Unconscious associative memory affects visual processing before 100 ms. Journal of Vision, 8, 10.
12. *Chaumon, M., Schwartz, D., & Tallon-Baundry, C. (2008). Unconscious learning versus visual perception: Dissociable roles for gamma oscillations revealed in MEG. Journal of Cognitive Neuroscience, 21, 2287–2299.
13. *Chua, K. P., & Chun, M. M. (2003). Implicit scene learning is viewpoint dependent. Perception & Psychophysics, 65, 72–80.
14. *Chun, M. M., & Jiang, Y. (1998). Contextual cueing: Implicit learning and memory of visual context guides spatial attention. Cognitive Psychology, 36, 28–71.
15. *Chun, M. M., & Jiang, Y. (2003). Implicit, long-term spatial contextual memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 224–234.
16. *Chun, M. M., & Phelps, E. A. (1999). Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage. Nature Neuroscience, 2, 844–847.
17. Chun, M. M., & Turk-Browne, N. B. (2008). Associative learning mechanisms in vision. In S. J. Luck & A. Hollingworth (Eds.), Visual memory (pp. 209–245). New York: Oxford University Press.
18. Cohen, N. J., & Squire, L. R. (1980). Preserved learning and retention of pattern-analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science, 210, 207–210.
19. *Colagiuri, B., Livesey, E. J., & Harris, J. A. (2011). Can expectancies produce placebo effects for implicit learning? Psychonomic Bulletin & Review, 18, 399–405.
20. *Conci, M., & Müller, H. J. (2012). Contextual learning of multiple target locations in visual search. Visual Cognition, 20, 746–770.
21. *Conci, M., Sun, L., & Müller, H. J. (2011). Contextual remapping in visual search after predictable target-location changes. Psychological Research, 75, 279–289.
22. *Conci, M., & von Muhlenen, A. (2009). Region segmentation and contextual cuing in visual search. Attention, Perception, and Psychophysics, 71, 1514–1524.
23. *Conci, M., & von Mühlenen, A. (2011). Limitations of perceptual segmentation on contextual cueing in visual search. Visual Cognition, 19, 203–233.
24. Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29.
25. Dehaene, S., Naccache, L., Le Clec'H, G., Koechlin, E., Mueller, M., Dehaene-Lambertz, G.,.. Le Bihan, D. (1998). Imaging unconscious semantic priming. Nature, 395, 597–600.
26. Dienes, Z. (2011). Bayesian versus Orthodox statistics: Which side are you on? Perspectives on Psychological Sciences, 6, 274–290.
27. Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Frontiers in Psychology, 5, 781.
28. Dienes, Z. (2015). How Bayesian statistics are needed to determine whether mental states are unconscious. In M. Overgaard (Ed.), Behavioural methods in consciousness research (pp. 199–220). Oxford: Oxford University Press.
29. Dijksterhuis, A., & van Knippenberg, A. (1998). The relation between perception and behavior, or how to win a game of trivial pursuit. Journal of Personality and Social Psychology, 74, 865–877.
30. *Dixon, M. L., Zelazo, P. D., & De Rosa, E. (2010). Evidence for intact memory-guided attention in school-aged children. Developmental Science, 13, 161–169.
31. *Endo, N., & Takeda, Y. (2005). Use of spatial context is restricted by relative position in implicit learning. Psychonomic Bulletin & Review, 12, 880–885.
32. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191.
33. Fidler, F., & Loftus, G. R. (2009). Why figures with error bars should replace p values: Some conceptual arguments and empirical demonstrations. Zeitschrift für Psychologie / Journal of Psychology, 217, 27–37.
34. Fiedler, K., Kurtzner, F., & Krueger, J. I. (2012). The long way from α-error control to validity proper: Problems with a short-sighted false-positive debate. Perspectives on Psychological Science, 7, 661–669.
35. Francis, G. (2012). Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review, 19, 151–156.
36. *Geringswald, F., Baumgartner, F., & Pollmann, S. (2012). Simulated loss of foveal vision eliminates visual search advantage in repeated displays. Frontiers in Human Neuroscience, 6, 134.
37. *Geringswald, F., Herbik, A., Hoffmann, M. B., & Pollmann, S. (2013). Contextual cueing impairment in patients with age-related macular degeneration. Journal of Vision, 13, 28.
38. *Geyer, T., Baumgartner, F., Müller, H. J., & Pollmann, S. (2012). Medial temporal lobe-dependent repetition suppression and enhancement due to implicit vs. explicit processing of individual repeated search displays. Frontiers in Human Neuroscience, 6, 272.
39. *Geyer, T., Shi, Z., & Müller, H. J. (2010). Contextual cueing in multiconjunction visual search is dependent on color- and configuration-based intertrial contingencies. Journal of Experimental Psychology: Human Perception and Performance, 36, 515–532.
40. *Geyer, T., Zehetleitner, M., & Müller, H. J. (2010). Contextual cueing of pop-out visual search: When context guides the deployment of attention. Journal of Vision, 10, 20.
41. *Giesbrecht, B., Sy, J. L., & Guerin, S. A. (2013). Both memory and attention systems contribute to visual search for targets cued by implicitly learned context. Vision Research, 85, 80–89.
42. Goodale, M. A., Milner, A. D., Jakobson, L. S., & Carey, D. P. (1991). A neurological dissociation between perceiving objects and grasping them. Nature, 349, 154–156.
43. *Greene, A. J., Gross, W. L., Elsinger, C. L., & Rao, S. M. (2007). Hippocampal differentiation without recognition: An fMRI analysis of the contextual cueing task. Learning & Memory, 14, 548–553.
44. Hassin, R. R., Ferguson, M. J., Shidlovski, D., & Gross, T. (2007). Subliminal exposure to national flags affects political thought and behavior. Proceedings of the National Academy of Sciences, 104, 19757–19761.
45. Hoekstra, R., Finch, S., Kiers, H. A. L., & Johnson, A. (2006). Probability as certainty: Dichotomous thinking and the misuse of p-values. Psychonomic Bulletin & Review, 13, 1033–1037.
46. Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014). Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review, 21, 1157–1164.
47. Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005). A meta-analysis on the correlation between the implicit association test and explicit self-report measures. Personality and Social Psychology Bulletin, 31, 1369–1385.
48. *Howard, J. H., Jr., Howard, D. V., Dennis, N. A., Yankovich, H., & Vaidya, C. J. (2004). Implicit spatial contextual learning in healthy aging. Neuropsychology, 18, 124–134.
49. Hyde, J. S., Lindberg, S. M., Linn, M. C., Ellis, A. B., & Williams, C. C. (2008). Gender similarities characterize math performance. Science, 321, 494–495.
50. Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014). Publication and other reporting biases in cognitive sciences: Detection, prevalence, and prevention. Trends in Cognitive Sciences, 18, 235–241.
51. *Jiménez, L., & Vázquez, G. A. (2011). Implicit sequence learning and contextual cueing do not compete for central cognitive resources. Journal of Experimental Psychology: Human Perception and Performance, 37, 222–235.
52. *Jiménez-Fernández, G., Vaquera, J. M. M., Jiménez, L., & Defior, S. (2011). Dyslexic children show deficits in implicit sequence learning, but not in explicit sequence learning or contextual cueing. Annals of Dyslexia, 61, 85–110.
53. *Johnson, J. S., Woodman, G. F., Braun, E., & Luck, S. J. (2007). Implicit memory influences the allocation of attention in visual cortex. Psychonomic Bulletin & Review, 14, 834–839.
54. *Kawahara, J. (2003). Contextual cueing in 3D layouts defined by binocular disparity. Visual Cognition, 10, 837–852.
55. *Kourkoulou, A., Kuhn, G., Findlay, J. M., & Leekam, S. R. (2013). Eye movement difficulties in autism spectrum disorder: Implications for implicit contextual cueing. Autism Research, 6, 177–189.
56. *Kourkoulou, A., Leekam, S. R., & Findlay, J. M. (2012). Implicit learning of local context in autism spectrum disorder. Journal of Autism and Developmental Disorders, 42, 244–256.
57. *Le Dantec, C. C., Melton, E. E., & Seitz, A. R. (2012). A triple dissociation between learning of target, distractors, and spatial contexts. Journal of Vision, 12, 5.
58. List, J. A. (2002). Preference reversals of a different kind: The “more is less” phenomenon. The American Economic Review, 92, 1636–1643.
59. *Luethi, M., Meier, B., & Sandi, C. (2009). Stress effect on working memory, explicit memory, and implicit memory for neutral and emotional stimuli in healthy men. Frontiers in Behavioral Neuroscience, 2, 5.
60. *Makovski, T., & Jiang, Y. V. (2011). Investigating the role of response in spatial context learning. Quarterly Journal of Experimental Psychology, 64, 1563–1579.
61. *Manginelli, A. A., Baumgartner, F., & Pollmann, S. (2013). Dorsal and ventral working memory-related brain areas support distinct processes in contextual cueing. NeuroImage, 67, 363–374.
62. *Manginelli, A. A., Geringswald, F., & Pollmann, S. (2012). Visual search facilitation in repeated displays depends on visuospatial working memory. Experimental Psychology, 59, 47–54.
63. *Manginelli, A. A., Langer, N., Klose, D., & Pollmann, S. (2013). Contextual cueing under working memory load: Selective interference of viuospatial load with expression of learning. Attention, Perception, & Psychophysics, 75, 1103–1117.
64. *Manginelli, A. A., & Pollmann, S. (2009). Misleading contextual cues: How do they affect visual search? Psychological Research, 73, 212–221.
65. *Manns, J. R., & Squire, L. R. (2001). Perceptual learning, awareness, and the hippocampus. Hippocampus, 11, 776–782.
66. McGraw, K. O., Tew, M. D., & Williams, J. E. (2000). The integrity of web-delivered experiments: Can you trust the data? Psychological Science, 11, 502–506.
67. *Mednick, S. C., Makovski, T., Cai, D. J., & Jiang, Y. V. (2009). Sleep and rest facilitate implicit memory in a visual search task. Vision Research, 49, 2557–2565.
68. *Nabeta, T., Ono, F., & Kawahara, J.-I. (2003). Transfer of spatial context from visual to haptic search. Perception, 32, 1351–1358.
69. *Negash, S., Petersen, L. E., Geda, Y. E., Knopman, D. S., Boeve, B. F., et al. (2007). Effects of ApoE genotype and mild cognitive impairment on implicit learning. Neurobiology of Aging, 28, 885–893.
70. *Ogawa, H., & Watanabe, K. (2010). Time to learn: Evidence for two types of attentional guidance in contextual cueing. Perception, 39, 72–80.
71. *Ogawa, H., & Watanabe, K. (2011). Implicit learning increases preference for predictive visual display. Attention, Perception, & Psychophysics, 73, 1815–1822.
72. *Olson, I. R., & Chun, M. M. (2002). Perceptual constraints on implicit learning of spatial context. Visual Cognition, 9, 273–302.
73. *Oudman, E., Van der Stigchel, S., Wester, A. J., Kessels, R. P. C., & Postma, A. (2011). Intact memory for implicit contextual information in Korsakoff’s amnesia. Neuropsychologia, 49, 2848–2855.
74. *Park, H., Quinlan, J., Thornton, E., & Reder, L. M. (2004). The effects of midazolam on visual search: Implications for understanding amnesia. Proceedings of the National Academy of Sciences, 101, 17879–17883.
75. Pessiglione, M., Petrovic, P., Daunizeau, J., Palminteri, S., Dolan, R. J., & Frith, C. D. (2008). Subliminal instrumental conditioning demonstrated in the human brain. Neuron, 59, 561–567.
76. *Peterson, M. S., & Kramer, A. F. (2001). Attentional guidance of the eyes by contextual information and abrupt onsets. Perception & Psychophysics, 63, 1239–1249.
77. *Pollmann, S., & Manginelli, A. A. (2009). Anterior prefrontal involvement in implicit contextual change detection. Frontiers in Human Neuroscience, 3, 28.
78. *Pollmann, S., & Manginelli, A. A. (2010). Repeated contextual search cues lead to reduced BOLD-onset times in early visual and left inferior frontal cortex. The Open Neuroimaging Journal, 4, 9–15.
79. *Preston, A. R., & Gabrieli, J. D. E. (2008). Dissociation between explicit memory and configural memory in the human medial temporal lobe. Cerebral Cortex, 18, 2192–2207.
80. *Rausei, V., Makovski, T., & Jiang, Y. (2007). Attention dependency in implicit learning of repeated search context. Quarterly Journal of Experimental Psychology, 60, 1321–1328.
81. Rosenthal, R., & Rubin, D. B. (1994). The counternull value of an effect size: A new statistic. Psychological Science, 5, 329–334.
82. Rouder, J. N., Morey, R. D., Speckman, P. L., & Pratte, M. S. (2007). Detecting chance: A solution to the null sensitivity problem in subliminal priming. Psychonomic Bulletin & Review, 14, 597–605.
83. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225–237.
84. *Schankin, A., & Schubö, A. (2009a). Cognitive processes facilitated by contextual cueing: Evidence from event-related brain potentials. Psychophysiology, 46, 668–679.
85. *Schankin, A., & Schubö, A. (2009b). The time course of attentional guidance in contextual cueing. In L. Paletta & J. K. Tsotsos (Eds.), Attention in cognitive systems: Lecture notes in computer sciences (pp. 69–84). Berlin: Springer.
86. *Schankin, A., Stursberg, O. & Schubö, A. (2008). The role of implicit context information in guiding visual-spatial attention. In B. Caputo & M. Vincze (Eds.), Cognitive vision (pp. 93–106) Berlin: Springer.
87. *Schlagbauer, B., Müller, H. J., Zehetleitner, M., & Geyer, T. (2012). Awareness in contextual cueing of visual search as measured with concurrent access- and phenomenal-consciousness tasks. Journal of Vision, 12, 25.
88. Shanks, D. R., & Berry, C. J. (2012). Are there multiple memory systems? Tests of models of implicit and explicit memory. Quarterly Journal of Experimental Psychology, 65, 1449–1474.
89. *Shi, Z., Zang, X., Jia, L., Geyer, T., & Müller, H. J. (2013). Transfer of contextual cueing in full-icon display remapping. Journal of Vision, 13, 2.
90. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.
91. Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014). P-curve: A key to the file drawer. Journal of Experimental Psychology: General, 143, 534–547.
92. *Smyth, A. C., & Shanks, D. R. (2008). Awareness in contextual cuing with extended and concurrent explicit tests. Memory & Cognition, 36, 403–415.
93. *Smyth, A. C., & Shanks, D. R. (2011). Aging and implicit learning: Explorations in contextual cueing. Psychology and Aging, 26, 127–132.
94. *Song, J.-H., & Jiang, Y. (2005). Connecting the past with the present: How do humans match an incoming visual display with visual memory? Journal of Vision, 5, 322–330.
95. *Travers, B. G., Powell, P. S., Mussey, J. L., Klinger, L. G., Crisler, M. E., & Klinger, M. R. (2013). Spatial and identity cues differentially affect implicit contextual cueing in adolescents and adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 43, 2393–2404.
96. *Travis, S. L., Mattingley, J. B., & Dux, P. E. (2013). On the role of working memory in spatial contextual cueing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 208–219.
97. *Tseng, P., Hsu, T.-Z, Tzeng, O. J. L., Hung, D. L., & Juan, C.-H. (2011). Probabilities in implicit learning. Perception, 40, 822–829.
98. *Tseng, Y.-C., & Li, C.-S. R. (2004). Oculomotor correlates of context-guided learning in visual search. Perception & Psychophysics, 66, 1363–1378.
99. *Tseng, Y.-C., & Lleras, A. (2013). Rewarding context accelerates implicit guidance in visual search. Attention, Perception, & Psychophysics, 75, 287–298.
100. *Vaidya, C. J., Huger, M., Howard, D. V., & Howard, J. H. (2007). Developmental differences in implicit learning of spatial context. Neuropsychology, 21, 497–506.
101. *van Asselen, M., Almeida, I., Andre, R., Januário, C., Gonçalves, A. F., & Castelo-Branco, M. (2009). The role of the basal ganglia in implicit contextual learning: A study of Parkinson's disease. Neuropsychologia, 47, 1269–1273.
102. *van Asselen, M., Almeida, I., Julio, F., Januario, C., Campos, E. B., Simoes, M., & Castelo-Branco, M. (2012). Implicit contextual learning in prodromal and early stage Huntington’s disease patients. Journal of the International Neuropsychological Society, 18, 689–696.
103. *van Asselen, M., & Castelo-Branco, M. (2009). The role of peripheral vision in implicit contextual cuing. Attention, Perception, & Psychophysics, 71, 76–81.
104. Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistics Software, 36, 1–48.
105. Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E.-J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291–298.
106. Williams, L. E., & Bargh, J. A. (2008). Experiencing physical warmth promotes interpersonal warmth. Science, 322, 606–607.
107. *Zellin, M., Conci, M., von Mühlenen, A., & Müller, H. J. (2011). Two (or three) is one too many: Testing the flexibility of contextual cueing with multiple target locations. Attention, Perception, & Psychophysics, 73, 2065–2076.
108. *Zellin, M., Conci, M., von Mühlenen, A., & Müller, H. J. (2013). Here today, gone tomorrow: Adaptation to change in memory-guided visual search. PLoS ONE, 8, e59466.
109. *Zellin, M., von Mühlenen, A., Müller, H. J., & Conci, M. (2013). Statistical learning in the past modulates contextual cueing in the future. Journal of Vision, 13, 19.
110. *Zhao, G., Liu, Q., Jiao, J., Zhou, P., Li, H., & Sun, H.-J. (2012). Dual-state modulation of the contextual cueing effect: Evidence from eye movement recordings. Journal of Vision, 12, 11.