Counterbalancing for serial order carryover effects in experimental condition orders

Psychological Methods

Volumn 17, Issue 4, 2012, Pages 600-614

  Brooks, Joseph L ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Carryover effects; Condition order; Counterbalancing; Experimental design; Graph theory

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; RANDOMIZATION; REPETITION PRIMING; TIME; VISION;

FIGURAL AFTEREFFECT; HUMANS; RANDOM ALLOCATION; REPETITION PRIMING; RESEARCH DESIGN; TIME FACTORS;

EID: 84874429658     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029310     Document Type: Article

References (77)

1. Aardenne-Ehrenfest, T. van, & de Bruijn, N. G. (1951). Circuits and trees in oriented linear graphs. Simon Stevin, 28, 203-217.
2. Aguirre, G. K. (2007). Continuous carry-over designs for fMRI. Neuro-Image, 35, 1480-1494. doi:10.1016/j.neuroimage.2007.02.005
3. Bartram, D. (1974). The role of visual and semantic codes in object naming. Cognitive Psychology, 6, 325-356. doi:10.1016/0010-0285(74)90016-4
4. Baseler, H. A., Sutter, E. E., Klein, S. A., & Carney, T. (1994). The topography of visual evoked response properties across the visual field. Electroencephalography and Clinical Neurophysiology, 90, 65-81. doi: 10.1016/0013-4694(94)90114-7
5. Baylis, G. C., & Cale, E. M. (2001). The figure has a shape, but the ground does not: Evidence from a priming paradigm. Journal of Experimental Psychology: Human Perception and Performance, 27, 633-643. doi: 10.1037/0096-1523.27.3.633
6. Bernadette, E. A., & Victor, J. D. (1994). An extension of the m-sequence technique for the analysis of multi-input nonlinear systems. In V. Z. Marmarelis (Ed.), Advanced methods of physiological system modeling (Vol. 3, pp. 87-110). New York, NY: Plenum Press.
7. Biederman, I., & Cooper, E. E. (1991a). Evidence for complete translational and reflectional invariance in visual object priming. Perception, 20, 585-593. doi:10.1068/p200585
8. Biederman, I., & Cooper, E. E. (1991b). Priming contour-deleted images: Evidence for intermediate representations in visual object recognition. Cognitive Psychology, 23, 393-419. doi:10.1016/0010-0285(91)90014-F
9. Biggs, N., Lloyd, E., & Wilson, R. (1986). Graph theory, 1736-1936. New York, NY: Oxford University Press.
10. Blakemore, C., & Campbell, F. W. (1969). Adaptation to spatial stimuli. The Journal of Physiology, 200, 11P-13P.
11. Blakemore, C., & Nachmias, J. (1971). The orientation specificity of two visual after-effects. The Journal of Physiology, 213, 157-174.
12. Bradley, A., Switkes, E., & De Valois, K. (1988). Orientation and spatial frequency selectivity of adaptation to color and luminance gratings. Vision Research, 28, 841-856. doi:10.1016/0042-6989(88)90031-4
13. Bradley, J. (1958). Complete counterbalancing of immediate sequential effects in a Latin square design. Journal of the American Statistical Association, 53, 525-528.
14. Brimijoin, W. O., & O'Neill, W. E. (2010). Patterned tone sequences reveal non-linear interactions in auditory spectrotemporal receptive fields in the inferior colliculus. Hearing Research, 267, 96-110. doi: 10.1016/j.heares.2010.04.005
15. Brown, S., Marley, A. A., & Lacouture, Y. (2007). Is absolute identification always relative? Comment on Stewart, Brown, and Chater (2005). Psychological Review, 114, 528-532. doi:10.1037/0033-295X.114.2.528
16. Buracas, G. T., & Boynton, G. M. (2002). Efficient design of event-related fMRI experiments using M-sequences. NeuroImage, 16, 801-813. doi: 10.1006/nimg.2002.1116
17. Creed, P., & Cryan, M. (2010). The number of Euler tours of a random d-in/d-out graph. In M. Drmota & B. Gittenberger (Eds.), Proceedings of the 21st International Meeting on Probabilistic, Combinatorial, and Asymptotic Methods in the Analysis of Algorithms (AofA'10) (pp. 117-128). Retrieved from http://www.dmtcs.org/dmtcs-ojs/index.php/proceedings/issue/view/113
18. Davis, J., Schiffman, H. R., & Greist-Bousquet, S. (1990). Semantic context and figure-ground organization. Psychological Research/ Psychologische Forschung, 52, 306-309. doi:10.1007/BF00868062
19. Deese, J., & Kaufman, R. A. (1957). Serial effects in recall of unorganized and sequentially organized verbal material. Journal of Experimental Psychology, 54, 180-187. doi:10.1037/h0040536
20. Durier, C., Monoda, H., & Bruetschy, A. (1997). Design and analysis of factorial sensory experiments with carry-over effects. Food Quality and Preference, 8, 141-149. doi:10.1016/S0950-3293(96)00040-7
21. Edwards, A. L. (1951). Balanced Latin-square designs in psychological research. The American Journal of Psychology, 64, 598-603.
22. Elmes, D. G., Kantowitz, B. H., & Roediger, H. L. (1999). Research methods in psychology (6th ed.). Pacific Grove, CA: Brooks/Cole.
23. Esterman, M., McGlinchey-Berroth, R., Verfaellie, M., Grande, L., Kilduff, P., & Milberg, W. (2002). Aware and unaware perception in hemispatial neglect: Evidence from a stem completion priming task. Cortex, 38, 233-246. doi:10.1016/S0010-9452(08)70652-X
24. Euler, L. (1736). Solutio problematis ad geometriam situs pertinentis [The solution of a problem relating to the geometry of position]. Commentarii Academiae Scientiarum Petropolitanae, 8, 128-140.
25. Fang, F., Boyaci, H., & Kersten, D. (2009). Border ownership selectivity in human early visual cortex and its modulation by attention. The Journal of Neuroscience, 29, 460-465. doi:10.1523/JNEUROSCI.4628-08.2009
26. Faulkner, K. K., & Cogan, R. (1990). Measures of shame and conflict tactics: Effects of questionnaire order. Psychological Reports, 66(3, Pt. 2), 1217-1218.
27. Finney, D. J., & Outhwaite, A. D. (1955, October 15). Serially balanced sequences. Nature, 176, 748. doi:10.1038/176748a0
28. Finney, D. J., & Outhwaite, A. D. (1956). Serially balanced sequences in bioassay. Proceedings of the Royal Society, Series B: Biological Sciences, 145, 493-507. doi:10.1098/rspb.1956.0058
29. Fize, D., Boulanouar, K., Chatel, Y., Ranjeva, J. P., Fabre-Thorpe, M., & Thorpe, S. (2000). Brain areas involved in rapid categorization of natural images: An event-related fMRI study. NeuroImage, 11(6, Pt. 1), 634-643. doi:10.1006/nimg.2000.0585
30. Fleischner, H. (1991). Algorithms for Eulerian trails. In H. Fleischner (Ed.), Eulerian graphs and related topics: Part 1, Vol. 2 (pp. X, 1-13). Amsterdam, the Netherlands: Elsevier.
31. Fleury, M. (1883). Deux problemes de geometrie de situation [Two problems of situational geometry]. Journal de Mathematiques Elementaires, 1883, 257-261.
32. Fortune, B., Demirel, S., & Bui, B. V. (2009). Multifocal visual evoked potential responses to pattern-reversal, pattern-onset, pattern-offset, and sparse pulse stimuli. Visual Neuroscience, 26, 227-235. doi:10.1017/ S0952523808080954
33. Gama, H., Correia, S., & Lunet, N. (2009). Effect of questionnaire structure on recall of drug utilization in a population of university students. BMC Medical Research Methodology, 9, 45. doi:10.1186/1471-2288-9-45
34. Garner, W. R. (1953). An informational analysis of absolute judgments of loudness. Journal of Experimental Psychology, 46, 373-380. doi: 10.1037/h0063212
35. Gilaie-Dotan, S., Gelbard-Sagiv, H., & Malach, R. (2010). Perceptual shape sensitivity to upright and inverted faces is reflected in neuronal adaptation. NeuroImage, 50, 383-395. doi:10.1016/j.neuroimage.2009.12.077
36. Goldstein, A. G. (1958). On the after-effects of the waterfall and spiral illusions. The American Journal of Psychology, 71, 608-609. doi: 10.2307/1420264
37. Golomb, S. (1967). Shift register sequences. San Francisco, CA: Holden-Day.
38. Grill-Spector, K., & Malach, R. (2001). fMR-adaptation: A tool for studying the functional properties of human cortical neurons. Acta Psychologica, 107, 293-321. doi:10.1016/S0001-6918(01)00019-1
39. Haushofer, J., Baker, C. I., Livingstone, M. S., & Kanwisher, N. (2008).Privileged coding of convex shapes in human object-selective cortex. Journal of Neurophysiology, 100, 753-762. doi:10.1152/jn.90310.2008
40. Henson, R. N., & Rugg, M. D. (2003). Neural response suppression, haemodynamic repetition effects, and behavioural priming. Neuropsychologia, 41, 263-270. doi:10.1016/S0028-3932(02)00159-8
41. Hierholzer, C. (1873). Ueber die Möglichkeit, einen Linienzug ohne Wiederholung und ohne Unterbrechung zu umfahren [About the possibility to traverse continuous line segments without repetition or interruption]. Mathematische Annalen, 6, 30-32. doi:10.1007/BF01442866
42. Holland, M. K., & Lockhead, G. R. (1968). Sequential effects in absolute judgments of loudness. Perception & Psychophysics, 3, 409-414. doi: 10.3758/BF03205747
43. Jesteadt, W., Luce, R. D., & Green, D. M. (1977). Sequential effects in judgments of loudness. Journal of Experimental Psychology: Human Perception and Performance, 3, 92-104. doi:10.1037/0096-1523.3.1.92
44. Kandel, D., Matias, Y., Unger, R., & Winkler, P. (1996). Shuffling biological sequences. Discrete Applied Mathematics, 71, 171-185. doi: 10.1016/S0166-218X(97)81456-4
45. Krekelberg, B., Boynton, G. M., & van Wezel, R. J. A. (2006). Adaptation: From single cells to BOLD signals. Trends in Neurosciences, 29, 250-256. doi:10.1016/j.tins.2006.02.008
46. Lacouture, Y. (1997). Bow, range, and sequential effects in absolute identification: A response-time analysis. Psychological Research/ Psychologische Forschung, 60, 121-133. doi:10.1007/BF00419760
47. Làdavas, E., Paladini, R., & Cubelli, R. (1993). Implicit associative priming in a patient with left visual neglect. Neuropsychologia, 31, 1307-1320. doi:10.1016/0028-3932(93)90100-E
48. Li, Y., Bin, G., Hong, B., & Gao, X. (2010). A coded VEP method to measure interhemispheric transfer time (IHTT). Neuroscience Letters, 472, 123-127. doi:10.1016/j.neulet.2010.01.069
49. Liu, T. T. (2004). Efficiency, power, and entropy in event-related fMRI with multiple trial types. Part II: Design of experiments. NeuroImage, 21, 401-413. doi:10.1016/j.neuroimage.2003.09.031
50. Liu, T. T., & Frank, L. R. (2004). Efficiency, power, and entropy in event-related fMRI with multiple trial types. Part I: Theory. NeuroImage, 21, 387-400. doi:10.1016/j.neuroimage.2003.09.030
51. Luce, R. D., Nosofsky, R. M., Green, D. M., & Smith, A. F. (1982). The bow and sequential effects in absolute identification. Perception & Psychophysics, 32, 397-408. doi:10.3758/BF03202769
52. Matthews, W. J., & Stewart, N. (2009). The effect of interstimulus interval on sequential effects in absolute identification. The Quarterly Journal of Experimental Psychology, 62, 2014-2029. doi:10.1080/1747021 0802649285
53. McHugh, J. A. M. (1989). Algorithmic graph theory. Upper Saddle River, NJ: Prentice-Hall.
54. Miller, J. M., & Krosnick, J. A. (1998). The impact of candidate name order on election outcomes. Public Opinion Quarterly, 62, 291-330. doi:10.1086/297848
55. Muir, D. D., & Hunter, E. A. (1992). Sensory evaluation of cheddar cheese: Order of tasting and carryover effects. Food Quality and Preference, 3, 141-145. doi:10.1016/0950-3293(91)90050-O
56. Nonyane, B. A. S., & Theobald, C. M. (2007). Design sequences for sensory studies: Achieving balance for carry-over and position effects. British Journal of Mathematical and Statistical Psychology, 60, 339-349. doi:10.1348/000711006X114568
57. Pashler, H., & Baylis, G. (1991a). Procedural learning: I. Locus of practice effects in speeded choice tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17, 20-32. doi:10.1037/0278-7393.17.1.20
58. Pashler, H., & Baylis, G. (1991b). Procedural learning: II. Intertrial repetition
59. Pasley, B. N., Allen, E. A., & Freeman, R. D. (2009). State-dependent variability of neuronal responses to transcranial magnetic stimulation of the visual cortex. Neuron, 62, 291-303. doi:10.1016/j.neuron.2009.03.012
60. Paterson, L. (1983). Circuits and efficiency in incomplete block designs. Biometrika, 70, 215-225. doi:10.1093/biomet/70.1.215
61. Poulton, E. C. (1982). Influential companions: Effects of one strategy on another in the within-subjects designs of cognitive psychology. Psychological Bulletin, 91, 673-690. doi:10.1037/0033-2909.91.3.673
62. Sampford, M. R. (1957). Methods of construction and analysis of serially balanced sequences. Journal of the Royal Statistical Society, B, 19, 286-304.
63. Schlich, P. (1993). Uses of change-over designs and repeated measurements in sensory and consumer studies. Food Quality and Preference, 4, 223-235. doi:10.1016/0950-3293(93)90166-4
64. Silvanto, J., Muggleton, N., & Walsh, V. (2008). State-dependency in brain stimulation studies of perception and cognition. Trends in Cognitive Sciences, 12, 447-454. doi:10.1016/j.tics.2008.09.004
65. Sohn, H.-S., Bricker, D. L., Simon, J. R., & Hsieh, Y.-C. (1997). Optimal sequences of trials for balancing practice and repetition effects. Behavior Research Methods, Instruments & Computers, 29, 574-581. doi: 10.3758/BF03210610
66. Staddon, J. E., King, M., & Lockhead, G. R. (1980). On sequential effects in absolute judgment experiments. Journal of Experimental Psychology: Human Perception and Performance, 6, 290-301. doi:10.1037/0096-1523.6.2.290
67. Stewart, N. (2007). Absolute identification is relative: A reply to Brown, Marley, and Lacouture (2007). Psychological Review, 114, 533-538. doi:10.1037/0033-295X.114.2.533
68. Stewart, N., Brown, G. D. A., & Chater, N. (2005). Absolute identification by relative judgment. Psychological Review, 112, 881-911. doi:10.1037/ 0033-295X.112.4.881
69. Street, A. P., & Street, D. J. (1987). Combinatorics of experimental design. Oxford, England: Clarendon.
70. Tutte, W. T., & Smith, C. A. B. (1941). On unicursal paths in a network of degree 4. American Mathematical Monthly, 48, 233-237. doi:10.2307/ 2302716
71. Vuilleumier, P., Henson, R. N., Driver, J., & Dolan, R. J. (2002). Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming. Nature Neuroscience, 5, 491-499. doi:10.1038/ nn839
72. Wakeling, I. N., & MacFie, H. J. H. (1995). Designing consumer trials balanced for first and higher orders of carry-over effect when only a subset of k samples from t may be tested. Food Quality and Preference, 6, 299-308. doi:10.1016/0950-3293(95)00032-1
73. Ward, L. M., & Lockhead, G. R. (1970). Sequential effects and memory in category judgments. Journal of Experimental Psychology, 84, 27-34. doi:10.1037/h0028949
74. Ward, L. M., & Lockhead, G. R. (1971). Response system processes in absolute judgment. Perception & Psychophysics, 9, 73-78. doi:10.3758/ BF03213031
75. West, D. B. (2001). Introduction to graph theory (2nd ed.). Upper Saddle River, NJ: Prentice-Hall.
76. Williams, E. J. (1949). Experimental designs balanced for the estimation of residual effects of treatments. Australian Journal of Scientific Research, 2(A), 149-168.
77. Williams, R. M. (1952). Experimental designs for serially correlated observations. Biometrika, 39, 151-167.