Operant variability: Evidence, functions, and theory

Psychonomic Bulletin and Review

Volumn 9, Issue 4, 2002, Pages 672-705

  Neuringer, Allen ^a  

^a REED COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ANIMAL; AWARENESS; BEHAVIOR THERAPY; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; MOTIVATION; REINFORCEMENT; REVIEW; SPECIES DIFFERENCE;

ANALYSIS OF VARIANCE; ANIMALS; ASSOCIATION LEARNING; AWARENESS; BEHAVIOR THERAPY; CONDITIONING, OPERANT; HUMANS; MOTIVATION; REINFORCEMENT SCHEDULE; SPECIES SPECIFICITY;

EID: 0037631684     PISSN: 10699384     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03196324     Document Type: Article

References (192)

1. AMABILE, T. M. (1983). The social psychology of creativity. New York: Springer-Verlag.
2. ANTONITIS, J. J. (1951). Response variability in the white rat during conditioning, extinction, and reconditioning. Journal of Experimental Psychology, 42, 273-281.
3. ARCHER, J., & BIRKE, L. (1983). Exploration in animals and humans. Cambridge: Van Nostrand Reinhold.
4. ARNESEN, E. M. (2000). Reinforcement of object manipulation increases discovery. Unpublished undergraduate thesis, Reed College.
5. BADDELEY, A. D. (1966). The capacity for generating information by randomization. Quarterly Journal of Experimental Psychology, 18, 119-129.
6. BADDELEY, A. [D.], EMSLIE, H., KOLODNY, J., & DUNCAN, J. (1998). Random generation and the executive control of working memory. Quarterly Journal of Experimental Psychology, 51A, 819-852.
7. BAER, D. M., & SHERMAN, J. A. (1964). Reinforcement control of generalized imitation in young children. Journal of Experimental Child Psychology, 1, 37-49.
8. BAKER, M. J., & KOEGEL, R. L. (1999). Transforming children with autism's ritualistic behaviors into positive play interactions with siblings. Paper presented at the meeting of the California Association of Behavior Analysis, San Francisco.
9. BALSAM, P. D., DEICH, J. D., OHYAMA, T., & STOKES, P. D. (1998). Origins of new behavior. In W. O'Donohue (Ed.), Learning and behavior therapy (pp. 403-420). Boston: Allyn & Bacon.
10. BALSAM, P. D., PATERNITI, A., ZECHOWY, K., & STOKES, P. D. (2002). Outcomes and behavioral variability: Disappointment induced variation. Manuscript submitted for publication.
11. BALSAM, P. D., & SILVER, R. (1994). Behavioral change as a result of experience: Toward principles of learning and development. In J. A. Hogan & J. J. Bolhuis (Eds.). Causal mechanisms of behavioural development (pp. 327-357). Cambridge: Cambridge University Press.
12. BANDURA, A. (1982). The psychology of chance encounters and life paths. American Psychologist, 37, 747-755.
13. BANDURA, A. (1986). Social foundations of thought & action. Englewood Cliffs, NJ: Prentice-Hall.
14. BARBA, L. S., & HUNZIKER, M. H. (2002). Variabilidade comportamental produzida por dois esquemas de reforçamento (Behavioral variability produced by two reinforcement schedules). Acta Comportamentalia, 10, 5-22.
15. BARKLEY, R. (1990). Attention deficit hyperactivity disorder: A handbook for diagnosis and treatment. New York: Guilford.
16. BARON-COHEN, S. (1992). Out of sight or out of mind? Another look at deception in autism. Journal of Child Psychology & Psychiatry, 33, 1141-1155.
17. BARSALOU, L. W. (1987). The instability of graded structure: Implications for the nature of concepts. In U. Neisser (Ed.), Concepts and conceptual development: Ecological and intellectual factors in categorization (pp. 101-140). New York: Cambridge University Press.
18. BECK, A. T. (1976). Cognitive therapy and the emotional disorders. New York: International Universities Press.
19. BERRYMAN, R., GUMMING, W. W., & NEVIN, J. A. (1963). Acquisition of delayed matching in the pigeon. Journal of the Experimental Analysis of Behavior, 6, 101-107.
20. BEVERIDGE, W. I. B. (1957). The art of scientific investigation. New York: Vintage.
21. BLOUGH, D. S. (1966). The reinforcement of least frequent interresponse times. Journal of the Experimental Analysis of Behavior, 9, 581-591.
22. BLUMBERG, B., DOWNIE, M., IVANOV, Y., BERLIN, M., JOHNSON, M. P., & TOMLINSON, B. (2002). Integrated learning for interactive synthetic characters. Transactions on Graphics 21, 3 (Proceedings of ACM SIGGRAPH 2002).
23. BODEN, M. A. (1994). What is creativity? In M. A. Boden (Ed.), Dimensions of creativity (pp. 75-117). Cambridge, MA: MIT Press.
24. BOREN, J. J., MOERSCHBAECHER, J. M., & WHYTE, A. A. (1978). Variability of response location on fixed-ratio and fixed-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 30, 65-67.
25. BOUTON, M. (1994). Context, ambiguity, and classical conditioning. Current Directions in Psychological Science, 3, 49-53.
26. BOWMAN, L. G., PIAZZA, C. C., FISHER, W. W., HAGOPIAN, L. P., & KOGAN, J. S. (1997). Assessment of preference for varied versus constant reinforcers. Journal of Applied Behavior A nalysis, 30, 451-458.
27. BRELAND, K., & BRELAND, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681-684.
28. BROOKS, R. A. (1999). Cambrian intelligence: The early history of the new AI. Cambridge, MA: MIT Press.
29. BRUGGER, P. (1997). Variables that influence the generation of random sequences: An update. Perceptual & Motor Skills, 84, 627-661.
30. BRYANT, D., & CHURCH, R. M. G. (1974). The determinants of random choice. Animal Learning & Behavior, 2, 245-248.
31. BURNS, J. (1997). Training changing triangles: A new paradigm for examining behavioral variability in multiple dimensions. Unpublished undergraduate thesis, Reed College.
32. CAMERON, J., & PIERCE, W. D. (1994). Reinforcement, reward, and intrinsic motivation: A meta-analysis. Review of Educational Research, 64, 363-423.
33. CAMPBELL, D. T. (1960). Blind variation and selective retention in creative thought as in other knowledge processes. Psychological Review, 67, 380-400.
34. CARLTON, P. L. (1962). Effects of deprivation and reinforcement-magnitude on response variability. Journal of the Experimental Analysis of Behavior, 5, 481-486.
35. CATANIA, A. C. (1980). Freedom of choice: A behavioral analysis. In G. H. Bower (Ed.). The psychology of learning andmotivation (Vol. 14, pp. 97-145). New York: Academic Press.
36. CATCHPOLE, C. K., & SLATER, P. J. (1995). Bird song: Biological themes and variations. Cambridge: Cambridge University Press.
37. CHANNON, S., & BAKER, J. E. (1996). Depression and problem-solving performance on a fault-diagnosis task. Applied Cognitive Psychology, 10, 327-336.
38. CHEROT, C., JONES, A., & NEURINGER, A. (1996). Reinforced variability decreases with approach to reinforcers. Journal of Experimental Psychology: Animal Behavior Processes, 22, 497-508.
39. COHEN, L., NEURINGER, A. & RHODES, D. (1990). Effects of ethanol on reinforced variations and repetitions by rats under a multiple schedule. Journal of the Experimental Analysis of Behavior, 54, 1-12.
40. CUMMING, W. W., BERRYMAN, R., COHEN, L. R., & LANSON, R. N. (1967). Some observations on extinction of a complex discriminated operant. Psychological Reports, 20, 1328-1330.
41. DECI, E. L., KOESTNER, R., & RYAN, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627-668.
42. DEMBER, W. N., & RICHMAN, C. L. (1989). Spontaneous alternation behavior. New York: Springer-Verlag.
43. DENNEY, J., & NEURINGER, A. (1998). Behavioral variability is controlled by discriminative stimuli. Animal Learning & Behavior, 26, 154-162.
44. DEVENPORT, L. D. (1983). Spontaneous behavior: Inferences from neuroscience. In R. Mellgren (Ed.), Animal cognition and behavior (pp. 83-125). Amsterdam: North-Holland.
45. DOUGHTY, A. H., & LATTAL, K. A. (2001). Resistance to change of operant variation and repetition. Journal of the Experimental Analysis of Behavior, 76, 195-215.
46. DOVER, A., & SHORE, B. M. (1991). Giftedness and flexibility on a mathematical set-breaking task. Gifted Child Quarterly, 35, 99-105.
47. DRIVER, P. M., & HUMPHRIES, D. A. (1988). Protean behavior: The biology of unpredictability. Oxford: Oxford University Press.
48. DUNCAN, C. P. (1961). Attempts to influence performance on an insight problem. Psychological Reports, 9, 35-42.
49. ECKERMAN, D. A., & LANSON, R. N. (1969). Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement and extinction. Journal of the Experimental Analysis of Behavior, 12, 73-80.
50. EISENBERGER, R., & ARMELI, S. (1997). Can salient reward increase creative performance without reducing intrinsic creative interest? Journal of Personality & Social Psychology, 72, 652-663.
51. EISENBERGER, R., ARMELI, S., & PRETZ, J. (1998). Can the promise of reward increase creativity? Journal of Personality & Social Psychology, 74, 704-714.
52. EISENBERGER, R., & CAMERON, J. (1996). Detrimental effects of reward: Reality or myth? American Psychologist, 51, 1153-1166.
53. EISENBERGER, R., HASKINS, F., & GAMBLETON, P. (1999). Promised reward and creativity: Effects of prior experience. Journal of Experimental Social Psychology, 35, 308-325.
54. EISENBERGER, R., & SELBST, M. (1994). Does reward increase or decrease creativity? Journal of Personality & Social Psychology, 66, 1116-1127.
55. EPSTEIN, R. (1996). Cognition, creativity and behavior: Selected essays. Westport, CT: Praeger.
56. EVANS, F. J., & GRAHAM, C. (1980). Subjective random number generation and attention deployment during acquisition and overlearning of a motor skill. Bulletin of the Psychonomic Society, 15, 391-394.
57. FAGEN, R. (1981). Animal play behavior. New York: Oxford University Press.
58. FERSTER, C. B., & SKINNER, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts.
59. FISKE, D. W., & MADDI, S. R. (1961). Functions of varied experience. Homewood, IL: Dorsey.
60. GALBICKA, G. (1994). Shaping in the 21st century: Moving percentile schedules into applied settings. Journal of Applied Behavior Analysis, 27, 739-760.
61. GIGERENZER, G. (1987). Survival of the fittest probabilist: Brunswik, Thurstone, and the two disciplines of psychology. In L. Kruger, G. Gigerenzer, & M. S. Morgan (Eds.), The probabilistic revolution. Vol. 2: Ideas in the sciences (pp. 49-72). Cambridge, MA: MIT Press.
62. GOETZ, E. M., & BAER, D. M. (1973). Social control of form diversity and emergence of new forms in children's blockbuilding. Journal of Applied Behavior Analysis, 6, 209-217.
63. GORKA, E. (1993). Within session effects of ethanol on reinforced behavioral variability: Unpublished undergraduate thesis, Reed College.
64. GOTTLIEB, G. (1992). Individual development and evolution. Oxford: Oxford University Press.
65. GROTT, R. & NEURINGER, A. (1974). Group behavior of rats under schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 22, 311-321.
66. GRUNOW, A., & NEURINGER, A. (2002). Learning to vary and varying to learn Psychonomic Bulletin & Review, 9, 250-258.
67. GUTHRIE, E. R., & HORTON, G. P. (1946). Cats in a puzzle box. New York: Rinehart.
68. HEFFERLINE, R. R., & PERERA, T. B. (1963). Proprioceptive discrimination of a covert operant without its observation by the subject. Science, 139, 834-835.
69. HEIDELBERGER, M. (1987). Fechner's indeterminism: From freedom to laws of chance. In L. Kruger, L. J. Daston, & M. Heidelberger (Eds.). The probabilistic revolution. Vol. I: Ideas in history (pp. 117-156). Cambridge, MA: MIT Press.
70. HERRNSTEIN, R. J. (1961). Stereotypy and intermittent reinforcement. Science, 133, 2067-2069.
71. HERTZIG, M. E. & SHAPIRO, T. (1990). Autism and pervasive develop-mental disorders. In M. Lewis & S. M. Miller (Eds.), Handbook of developmental psychopathology (pp. 385-395). New York: Plenum.
72. HOLMAN, J., GOETZ, E. M., & BAER, D. M. (1977). The training of creativity as an operant and an examination of its generalization characteristics. In B. Etzel, J. LeBland, & D. Baer (Eds.), New developments in behavior research: Theory, method and application (pp. 441-471). Hillsdale, NJ: Erlbaum.
73. HOPKINSON, J., & NEURINGER, A. (in press). Modifying behavioral vanability in moderately depressed students. Behavior Modification.
74. HOPSON, J., BURT, D., & NEURINGER, A. (2002). Variability and repetition under a multiple schedule. Manuscript in preparation.
75. HORNE, R. L., EVANS, F. J., & ORNE, M. T. (1982). Random number generation, psychopathology, and therapeutic change. Archive of General Psychiatry, 39, 680-683.
76. HULL, D. L., LANGMAN, R. E., & GLENN, S. S. (2001). A general account of selection: Biology, immunology and behavior. Behavioral & Brain Sciences, 24, 511-573.
77. HUNZIKER, M. H. L., CARAMORI, F. C., DA SILVA, A. P.. & BARBA L. S. (1998). Efeitos da historia de reforçamento sobre a variabilidade comportamental [Effects of reinforcement history on behavioral vanability] Psicologia: Teoria e Pesquisa, 14, 149-159.
78. HUNZIKER, M. H. L., LEE, V. P Q., FERREIRA, C. C., DA SILVA, A. P., & CARAMORI, F. C. (2002). Variabilidade comportamental em humanos: Efeitos de regras e contingencias [Human behavioral variability: Effects of rules and contingencies]. Psicologia: Teoria e Pesquisa, 18, 130-147.
79. HUNZIKER, M. H. L., SALDANA, R. L., & NEURINGER, A. (1996). Behavioral variability in SHR and WKY rats as a function of rearing environment and reinforcement contingency. Journal of the Experimental Analysis of Behavior, 65, 129-144.
80. KAHNEMAN, D., & TVERSKY, A. (1984). Choices, values and frames. American Psychologist, 39, 341-350.
81. KILLEEN, P. (1981). Incentive theory. In D. J. Bernstein (Ed.), Nebraska symposium on motivation, 1981: Response structure and organization (pp. 169-216). Lincoln: University of Nebraska Press.
82. KNUTH, D. E. (1969). The art of computer programming. Reading, MA: Addison-Wesley.
83. LAMBERTY, Y., & COWER, A. J. (1990). Age-related changes in spontaneous behavior and learning in NMRI mice from maturity to middle age Physiology & Behavior, 47, 1137-1144.
84. LANGER, E. (1989). Mindfulness. Reading, MA: Addison-Wesley.
85. LANGER, E. (2000). Mindful learning. Current Directions in Psychological Science, 6, 220-223.
86. LAPP, J. E., MARINIER, R., & PIHL, R. O. (1982). Correlates of psychotropic drug use in women: Interpersonal personal problem solving and depression. Women & Health, 7, 5-16.
87. LEE, R., MCCOMAS, J. J., & JAWOR, J. (in press). The effects of differential reinforcement on varied verbal responding by individuals with autism to social questions. Journal of Applied Behavioral Analysis.
88. LEPPER, M. R., & HENDERLONG, J. (2000). Turning "play" into "work" and "work" into "play": 25 years of research on intrinsic versus extrinsic motivation. In C. Sansone & J. M. Harackiewicz (Eds.), Intrinsic and extrinsic motivation: The search for optimal motivation and performance (pp. 257-307). San Diego: Academic Press.
89. LIBET, B. (1999). Do we have free will? Journal of Consciousness Studies, 6, 47-57.
90. LOPES, L. L., & ODEN, G. C. (1987). Distinguishing between random and nonrandom events. Journal of Experimental Psychology: Learning Memory, & Cognition, 13, 392-400.
91. LUNG, C. T., & DOMINOWSKI, R. L. (1985). Effects of strategy instructions and practice on nine-dot problem solving. Journal of Experimental Psychology: Learning, Memory, & Cognition, 11, 804-811.
92. MACHADO, A. (1989). Operant conditioning of behavioral variability using a percentile reinforcement schedule. Journal of the Experimental Analysis of Behavior,. 52, 155-166.
93. MACHADO, A. (1992). Behavioral variability and frequency-dependent selection Journal of the Experimental Analysis of Behavior, 58, 241-263.
94. MACHADO, A. (1993) Learning variable and stereotypical sequences of responses: Some data and a new model. Behavioural Processes, 30, 103-130.
95. MACHADO, A. (1997). Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. Journal of the Experimental Analysis of Behavior, 68, 1-25.
96. MACHADO, A., & CEVIK, M. (1998). Acquisition and extinction under periodic reinforcement. Behavioural Processes, 44, 237-262.
97. MAIER, N. R. F. (1933). An aspect of human reasoning. British Journal of Psychology, 24, 144-155.
98. MALTZMAN, I. (1960). On the training of originality. Psychological Review, 67, 229-242.
99. MANABE, K., STADDON, J. E. R., & CLEAVELAND, J. M. (1997). Control of vocal repertoire by reward in budgerigars (Melopsittacus undulatus). Journal of Comparative Psychology, 111, 50-62.
100. MANOEL, E. J., & CONNOLLY, K. J. (1995). Variability and the development of skilled actions. International Journal of Psychophysiologv, 19, 129-147.
101. MANOEL, E. J. & CONNOLLY, K. J. (1997). Variability and stability in the development of skilled actions. In K. J. Connolly & H. Forssberg (Eds.), Neurophysiology and neuropsychology of motor development (pp 286-318). London: Mac Keith.
102. MCELROY, E., & NEURINGER, A. (1990). Effects of alcohol on reinforced repetitions and reinforced variations in rats. Psychopharmacology, 102, 49-55.
103. MECHNER, F. (1958). Sequential dependencies of the lengths oft consecutive response runs. Journal of the Experimental Analysis of Behavior, 1, 229-233.
104. MECHNER, F. (1992). Learning and practicing skilled performance. New York: Behavioral Science Applications.
105. MECHNER, F., HYTEN, C., FIELD, D. P., & MADDEN, G. (1997). Using revealed operants to study the structure and properties of human operant behavior. Psychological Record, 47, 45-68.
106. METZGER, M. A. (1994). Have subjects been shown to generate chaotic number? Commentary on Neuringer and Voss. Psychological Science, 5, 111-114.
107. MILLER, N., & NEURINGER, A. (2000). Reinforcing variability in adolescents with autism. Journal of Applied Behavior Analysis, 33, 151-165.
108. MOOK, D. M., JEFFREY, J., & NELIRINGER, A. (1993). Spontaneously hypertensive rats (SHR) readily learn to vary but not to repeat instrumental responses. Behavioral & Neural Biology, 59, 126-135.
109. MOOK, D. M., & NEURINGER, A. (1994). Different effects of amphetamine on reinforced variations versus repetitions in spontaneously hypertensive rats (SHR). Physiology & Behavior, 56, 939-944.
110. MORGAN, L., & NEURINGER, A. (1990). Behavioral variability as a function of response topography and reinforcement contingency. Animal Learning & Behavior, 18, 257-263.
111. MORRIS, C. (1987). The operant conditioning of response variability: Free-operant versus discrete-response procedures. Journal of the Experimental Analysis of Behavior, 47, 273-277.
112. MOXLEY, R. A. (1997). Skinner: From determinism to random variation. Behavior & Philosophy, 25, 3-28.
113. MOXON, E. R. (1997). The tinkerer's evolving tool-box. Nature, 387, 659-662.
114. MULLINS, M., & RINCOVER, A. (1985). Comparing autistic and normal children along the dimensions of reinforcement maximization, stimulus sampling, and responsiveness to extinction. Journal of Experimental Child Psychology, 40, 350-374.
115. MYERSON, J., & HALE, S. (1988). Choice in transition: A comparison of melioration and the kinetic model. Journal of the Experimental Analysis of Behavior, 49, 291-302.
116. NELSON, T. D. (1978). Fixed-interval matching-to-sample: Intermatching time and intermatching error runs. Journal of the Experimental Analysis of Behavior, 29, 105-113.
117. NEURINGER, A. (1981). Self-experimentation: A call for change. Behaviorism, 9, 79-94.
118. NEURINGER, A. (1986). Can people behave "randomly?": The role of feedback. Journal of Experimental Psychology: General, 115, 62-75.
119. NEURINGER, A. (1991). Operant variability and repetition as functions of interresponse time. Journal of Experimental Psychology: Animal Behavior Processes, 17, 3-12.
120. NEURINGER, A. (1992). Choosing to vary and repeat. Psychological Science, 3, 246-250.
121. NEURINGER, A. (1993). Reinforced variation and selection. Animal Learning & Behavior, 21, 83-91.
122. NEURINGER, A. (2002). Reinforcement of response-sequence variability in young chicks. Unpublished manuscript.
123. NEURINGER, A. (in press). Reinforced variability and creativity. In K. A. Lattal & P. N. Chase (Eds.), Behavior theory and philosophy. New York: Kluwer Academic/Plenum.
124. NEURINGER, A., DEISS, C., & IMIG, S. (2000). Comparing choices and variations in people and rats: Two teaching experiments. Behavior Research Methods, Instruments, & Computers, 32, 407-416.
125. NEURINGER, A., DEISS, C., & OLSON, G. (2000). Reinforced variability and operant learning. Journal of Experimental Psychology: Animal Behavior Processes, 26, 98-111.
126. NEURINGER, A., & HUNTLEY, R. W. (1992). Reinforced variability in rats: Effects of gender, age and contingency. Physiology & Behavior, 51, 145-149.
127. NEURINGER, A., KORNELL, N., & OLUFS, M. (2001). Stability and variability in extinction. Journal of Experimental Psychology: Animal Behavior Processes, 21, 79-94.
128. NEURINGER, A., & VOSS, C. (1993). Approximating chaotic behavior. Psychological Science, 4, 113-119.
129. NEURINGER, A., & VOSS, C. (2002). Approximations to chaotic responding depends on interresponse time. Unpublished manuscript.
130. NEVIN, J. A. (1967). Effects of reinforcement scheduling on simultaneous discrimination performance. Journal of the Experimental Analysis of Behavior, 10, 251-260.
131. NEVIN, J. A. (1992). An integrative model for the study of behavioral momentum. Journal of the Experimental Analysis of Behavior, 57, 301-316.
132. NOTTERMAN, J. M., & MINTZ, D. E. (1965). Dynamics of response. New York: Wiley.
133. PAGE, S., & NEURINGER, A. (1985). Variability is an operant. Journal of Experimental Psychology: Animal Behavior Processes, 11, 429-452.
134. PETERSON, I. (1997). The jungle of randomness: A mathematical safari. New York: Wiley.
135. PRYOR, K. W., HAAG, R., & O'REILLY, J. (1969). The creative porpoise: Training for novel behavior. Journal of the Experimental Analysis of Behavior, 12, 653-661.
136. RESCORLA, R. A., & WAGNER, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
137. RHINEHART, L. (1998). The dice man. Woodstock, NY: Overlook.
138. ROBERTS, S., & NEURINGER, A. (1998). Self-experimentation. In K. A. Lattal & M. Perone (Eds.), Handbook of research methods in human operant behavior (pp. 619-655). New York: Plenum.
139. ROOTS, C. (2000). A spoonful of fish food helps the repetition go down: Reinforcing variability in Betta splendens. Unpublished undergraduate thesis, Reed College.
140. ROSS, C., & NEURINGER, A. (2002). Reinforcement of variations and repetitions along three independent response dimensions. Behavioural Processes, 57, 199-209.
141. SALDANA, R. L., & NEURINGER, A. (1998). Is instrumental variability abnormally high in children exhibiting ADHD and aggressive behavior? Behavioural Brain Research, 94, 51-59.
142. SCHMIDT, R. A., & LEE, T. D. (1999). Motor control and learning: A behavioral emphasis (3rd ed.). Champaign, IL: Human Kinetics.
143. SCHOENFELD, W. N., HARRIS, A. H., & FARMER, J. (1966). Conditioning response variability. Psychological Reports, 19, 551-557.
144. SCHWARTZ, B. (1980). Development of complex stereotyped behavior in pigeons. Journal of the Experimental Analysis of Behavior, 33, 153-166.
145. SCHWARTZ, B. (1981). Reinforcement creates behavioral units. Behaviour Analysis Letters, 1, 33-41.
146. SCHWARTZ, B. (1982). Failure to produce variability with reinforcement. Journal of the Experimental Analysis of Behavior, 37, 171-181.
147. SCHWARTZ, B. (1988). The experimental synthesis of behavior: Reinforcement, behavioral stereotypy and problem solving. In G. H. Bower (Ed.), The psychology of learning ana motivation (Vol. 22, pp. 93-138). New York: Academic Press.
148. SCRIVEN, M. (1965). An essential unpredictability in human behavior. In B. Wolman (Ed.), Scientific psychology (pp. 411-425). New York: Basic Books.
149. SEARCY, W. A., & YASUKAWA, K. (1990). Use of song repertoire in intersexual and intrasexual contexts by male red-winged blackbirds. Behavioral & Ecological Sociobiology, 27, 123-128.
150. SEGAL, E. F. (1972). Induction and the provenance of operants. In R. M. Gilbert & J. R. Millenson (Eds.). Reinforcement: Behavioral analyses (pp. 1-34). New York: Academic Press.
151. SELIGMAN, M. E. P. (1975). Helplessness. San Francisco: Freeman.
152. SENKOWSKI, P. C., VOGEL, V. A., & POZULP, N. C., II (1978). Differential reinforcement of lever-press durations: Effects of deprivation level and reward magnitude. Learning & Motivation, 9, 446-465.
153. SHETTLEWORTH, S. J. (1998). Cognition, evolution, and behavior. New York: Oxford University Press.
154. SHIMP, C. P. (1967). Reinforcement of least-frequent sequences of choices. Journal of the Experimental Analysis of Behavior, 10, 57-65.
155. SIEGLER, R. S. (1996). Emerging minds: The process of change in children's thinking. New York: Oxford University Press.
156. SKINNER, B. F. (1959). Cumulative record. New York: Appleton-Century-Crofts.
157. SKINNER, B. F. (1966). The phylogeny and ontogeny of behavior. Science, 153, 1205-1213.
158. SKINNER, B. F. (1974). About behaviorism. New York: Knopf.
159. SKINNER, B. F. (1981). Selection by consequences. Science, 213, 501-504.
160. SMITH, L. D. (1992). On prediction and control: B. F. Skinner and the technological ideal of science. American Psychologist, 47, 216-223.
161. STADDON, J. E. R., & SIMMELHAG, V. L. (1971). The "superstition" experiment: A reexamination of its implications for the principles of adaptive behavior. Psychological Review, 78, 3-43.
162. STEIN, L., XUE, B. G., & BELLUZZI, J. D. (1994). In vitro reinforcement of hippocampal bursting: A search for Skinner's atoms of behavior. Journal of the Experimental Analysis of Behavior, 61, 155-168.
163. STEPHENS, D. W., & KREBS, J. R. (1986). Foraging theory. Princeton. NJ: Princeton University Press.
164. STOKES, P. D. (1995). Learned variability. Animal Learning & Behavior, 23, 164-176.
165. STOKES, P. D. (2001). Variability, constraints, and creativity: Shedding light on Claude Monet. American Psychologist, 56, 355-359.
166. STOKES, P. D., & BALSAM, P. [D.] (2001). An optimal period for setting sustained variability levels. Psychonomic Bulletin & Review, 8, 177-184.
167. STOKES, P. D., MECHNER, F., & BALSAM, P. D. (1999). Effects of different acquisition procedures on response variability. Animal Learning & Behavior, 27, 28-41.
168. SUPPES, P. (1984). Probabilistic metaphysics. New York: Basil Blackwell.
169. SUTTON, R. S., & BARTO, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
170. SUTTON-SMITH, B. (1975). The useless made useful: Play as variability training. School Review, 83, 197-214.
171. TATHAM, T., WANCHISEN, B., & HINELINE, P. (1993). Effects of fixed and variable ratios on human behavioral variability. Journal of the Experimental Analysis of Behavior, 59, 349-359.
172. TIMBERLAKE, W., & LUCAS, G. A. (1989). Behavior systems and learning: From misbehavior to general principles. In S. B. Klein & R. R. Mowrer (Eds) Contemporary learning theories: Instrumental conditioning theory and the impact of biological constraints on learning (pp 237-275). Hillsdale, NJ: Erlbaum.
173. TREMONT, P. J, (1984). Variability efforce and interresponse time under random interval reinforcement schedules. Behavioural Processes, 9, 413-420.
174. VAN DER LINDEN, M., BEERTEN, A., & PESENTI, M. (1998). Age related differences in random generation. Brain & Cognition, 38, 1-16.
175. VAN DER MEER, A. L. H., VAN DER WEEL, F. R., & LEE, D. N. (1995). The functional significance of arm movements in neonates. Science, 267, 693-695.
176. VAN HEST, A., VAN HAAREN, F., & VAN DE POLL, N. E. (1989). Operant conditioning of response variability in male and female Wistar rats. Physiology & Behavior, 45, 551-555.
177. VOLLMER, T. R., IWATA, B. A., ZARCONE, J. R., SMITH, R. G., & MAZALESKI, J. L. (1993) The role of attention in the treatment of attention-maintained self-injurious behavior: Noncontingent reinforcement and differential reinforcement of other behavior. Journal of Applied Behavior Analysis, 26, 9-21.
178. VOLLMER, T. R., RINGDAHL, J. E., ROANE, H. S., & MARCUS, B. A. (1997). Negative side effects of noncontingent reinforcement. Journal of Applied Behavior Analysis, 30, 161-164.
179. WAGENAAR, W. A. (1972). Generation of random sequences by human subjects: A critical survey of literature. Psychological Bulletin, 77, 65-72.
180. WARD, L. M. (2002). Dynamical cognitive science. Cambridge, MA: MIT Press.
181. WARD, L. M., & WEST, R. L. (1994). On chaotic behavior. Psychological Science, 5, 232-236.
182. WEISS, R. L. (1964). On producing random responses. Psychological Reports, 14, 931-941.
183. WEISS, R. U. (1965). "Variables that influence random-generation": An alternative hypothesis. Perceptual & Motor Skills, 20, 307-310.
184. WELIS, M. (1999). Teaching an old rat new tricks: The effects of age on behavioral variability. Unpublished undergraduate thesis. Reed College.
185. WILKES, G. (1996). Click & Treat Training Kit [Version 1.1]. Available from www.clickandtreat.com.
186. WILLIAMS, B. A. (1971). Non-spatial delayed alternation by the pigeon. Journal of the Experimental Analysis of Behavior, 16, 15-21.
187. WILSON, N. (1986). Standards for deviation: Tools for reinforcing variability Unpublished undergraduate thesis, Reed College.
188. WINSTON, A. S., & BAKER, J. E. (1985). Behavior analytic studies of creativity: A critical review. The Behavior Analyst, 8, 191-205.
189. WRICHT, A. A. (1997). Concept learning and learning strategies. Psychological Science, 8, 119-123.
190. WULTZ, B., SAGVOLDEN, T., MOSER, E. I., & MOSER, M. B. (1990). The spontaneously hypertensive rat as an animal model of attention-deficit hyperactivity disorder: Effects of methylphenidate on exploratory behavior Behavioral & Neural Biology, 53, 88-102.
191. YOUNG, M. E. & WASSERMAN, E. A. (2001). Entropy and variability discrimination. Journal of Experimental Psychology: Learning, Memory, & Cognition, 27, 278-293.
192. ZURIFF, G. E. (1985). Behaviorism: A conceptual reconstruction. New York: Columbia University Press.