Reinforced variability in animals and people: Implications for adaptive action

American Psychologist

Volumn 59, Issue 9, 2004, Pages 891-906

  Neuringer, Allen ^a  

^a REED COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ANIMAL BEHAVIOR; CREATIVITY; DECISION MAKING; HUMAN; INSTRUMENTAL CONDITIONING; MEMORY; PERCEPTIVE DISCRIMINATION; PROBLEM SOLVING; REINFORCEMENT; REVIEW;

ANIMALS; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CONDITIONING, OPERANT; CREATIVENESS; DISCRIMINATION (PSYCHOLOGY); HUMANS; MEMORY; PROBLEM SOLVING; REINFORCEMENT (PSYCHOLOGY);

EID: 10844248448     PISSN: 0003066X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0003-066X.59.9.891     Document Type: Review

References (90)

1. Amabile, T. M. (1996). Creativity in context. Boulder, CO: Westview Press.
2. Arnesen, E. M. (2000). Reinforcement of object manipulation increases discovery. Unpublished bachelor's thesis, Reed College.
3. Baddeley, A. D. (1966). The capacity for generating information by randomization. Quarterly Journal of Experimental Psychology, 18, 119-129.
4. Baddeley, A., Emslie, H., Kolodny, J., & Duncan, J. (1998). Random generation and the executive control of working memory. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 51(A), 819-852.
5. Balsam, P. D., Deich, J. D., Ohyama, T., & Stokes, P. D. (1998). Origins of new behavior. In W. O'Donohue (Ed.), Learning and behavior therapy (pp. 403-420). Boston: Allyn & Bacon.
6. Barba, L. S., & Hunziker, M. H. (2002). Variabilidade comportamental produzida por dois esquemas de reforçamento [Behavioral variability produced by two reinforcement schedules]. Acta Comportamentalia, 10, 5-22.
7. Barkley, R. (1990). Attention deficit hyperactivity disorder: A handbook for diagnosis and treatment. New York: Guilford Press.
8. Baron-Cohen, S. (1992). Out of sight or out of mind? Another look at deception in autism. Journal of Child Psychology and Psychiatry, 33, 1141-1155.
9. Beck, A. T. (1976). Cognitive therapy and the emotional disorders. New York: International Universities Press.
10. Blough, D. S. (1966). The reinforcement of least frequent interresponse times. Journal of the Experimental Analysis of Behavior, 9, 581-591.
11. Brugger, P. (1997). Variables that influence the generation of random sequences: An update. Perceptual and Motor Skills, 84, 627-661.
12. Cahn, S. M. (1967). Chance. In P. Edwards (Ed.), The encyclopedia of philosophy (pp. 73-75). New York: Macmillan.
13. Campbell, D. T. (1960). Blind variation and selective retention in creative thought as in other knowledge processes. Psychological Review, 67, 380-400.
14. Catchpole, C. K., & Slater, P. J. (1995). Bird song: Biological themes and variations. Cambridge, England: Cambridge University Press.
15. Channon, S., & Baker, J. E. (1996). Depression and problem-solving performance on a fault-diagnosis task. Applied Cognitive Psychology, 10, 327-336.
16. Cherot, C., Jones, A., & Neuringer, A. (1996). Reinforced variability decreases with approach to reinforcers. Journal of Experimental Psychology: Animal Behavior Processes, 22, 497-508.
17. Cohen, L., Neuringer, A., & Rhodes, D. (1990). Effects of ethanol on reinforced variations and repetitions by rats under a multiple schedule. Journal of the Experimental Analysis of Behavior, 54, 1-12.
18. Cook, R. G., Brown, M. F., & Riley, D. A. (1985). Flexible memory processing by rats: Use of prospective and retrospective information in the radial maze. Journal of Experimental Psychology: Animal Behavior Processes, 11, 453-469.
19. Dennett, D. C. (2003). Freedom evolves. New York: Viking.
20. Denney, J., & Neuringer, A. (1998). Behavioral variability is controlled by discriminative stimuli. Animal Learning & Behavior, 26, 154-162.
21. Doughty, A. H., & Lattal, K. A. (2001). Resistance to change of operant variation and repetition. Journal of the Experimental Analysis of Behavior, 76, 195-215.
22. Driver, P. M., & Humphries, D. A. (1988). Protean behavior: The biology of unpredictability. Oxford, England: Oxford University Press.
23. Eisenberger, R., & Selbst, M. (1994). Does reward increase or decrease creativity? Journal of Personality and Social Psychology, 66, 1116-1127.
24. Evans, F. J., & Graham, C. (1980). Subjective random number generation and attention deployment during acquisition and overlearning of a motor skill. Bulletin of the Psychonomic Society, 15, 391-394.
25. Gigerenzer, G. (1987). Probabilistic thinking and the fight against subjectivity. In L. Kruger, L. J. Daston, & M. Heidelberger (Eds.), The probabilistic revolution: Vol. 2. Ideas in the sciences (pp. 11-33). Cambridge, MA: MIT Press.
26. Goetz, E. M., & Baer, D. M. (1973). Social control of form diversity and emergence of new forms in children's blockbuilding. Journal of Applied Behavior Analysis, 6, 209-217.
27. Grunow, A., & Neuringer, A. (2002). Learning to vary and varying to learn. Psychonomic Bulletin & Review, 9, 250-258.
28. Heidelberger, M. (1987). Fechner's indeterminism: From freedom to laws of chance. In L. Kruger, L. J. Daston, & M. Heidelberger (Eds.), The probabilistic revolution: Vol. 1. Ideas in history (pp. 117-156). Cambridge, MA: MIT Press.
29. Hertzig, M. E., & Shapiro, T. (1990). Autism and pervasive developmental disorders. In M. Lewis & S. M. Miller (Eds.), Handbook of developmental psychopathology (pp. 385-395). New York: Plenum Press.
30. Hopkinson, J., & Neuringer, A. (2003). Modifying behavioral variability in moderately depressed students. Behavior Modification, 27, 251-264.
31. Home, R. L., Evans, F. J., & Orne, M. T. (1982). Random number generation, psychopathology, and therapeutic change. Archive of General Psychiatry, 39, 680-683.
32. Hunziker, M. H. L., Saldana, R. L., & Neuringer, A. (1996). Behavioral variability in SHR and WKY rats as a function of rearing environment and reinforcement contingency. Journal of the Experimental Analysis of Behavior, 65, 129-144.
33. James, W. (1956). The dilemma of determinism. In W. James (Ed.), The will to believe (pp. 145-183). New York: Dover. (Original work published 1884)
34. Jammer, M. (1973). Indeterminacy in physics. In P. P. Wiener (Ed.), Dictionary of the history of ideas: Volume 2. Despotism to law, common (pp. 586-594). New York: Scribner.
35. Jay, R. (2003). Dice: Deception, fate & rotten luck. New York: Norton.
36. Jensen, G., Miller, C., & Neuringer, A. (in press). Reasons to respond randomly. In E. A. Wasserman & T. R. Zentall (Eds.), Comparative cognition: Experimental exploration of animal intelligence. New York: Oxford University Press.
37. Knuth, D. E. (1969). The art of computer programming. Reading, MA: Addison-Wesley.
38. Langer, E. (1989). Mindfulness. Reading, MA: Addison-Wesley.
39. Lapp, J. E., Marinier, R., & Pihl, R. O. (1982). Correlates of psychotropic drug use in women: Interpersonal personal problem solving and depression. Women & Health, 7, 5-16.
40. Lee, R., McComas, J. J., & Jawor, J. (2002). The effects of differential and lag reinforcement schedules on varied verbal responding by individuals with autism. Journal of Applied Behavior Analysis, 35, 391-402.
41. Lung, C. T., & Dominowski, R. L. (1985). Effects of strategy instructions and practice on nine-dot problem solving. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11, 804-811.
42. Machado, A. (1989). Operant conditioning of behavioral variability using a percentile reinforcement schedule. Journal of the Experimental Analysis of Behavior, 52, 155-166.
43. Machado, A. (1992). Behavioral variability and frequency-dependent selection. Journal of the Experimental Analysis of Behavior, 58, 241-263.
44. Malone, J. C. (1987). Skinner, the behavioral unit, and current psychology. In S. Modgil & C. Modgil (Eds.), B. F. Skinner: Consensus and controversy (pp. 193-203). New York: Falmer Press.
45. Manoel, E. J., & Connolly, K. J. (1997). Variability and stability in the development of skilled actions. In K. J. Connolly & H. Forssberg (Eds.), Neurophysiology and neuropsychology of motor development (pp. 286-318). London: Mac Keith Press.
46. McElroy, E.. & Neuringer, A. (1990). Effects of alcohol on reinforced repetitions and reinforced variations in rats. Psychopharmacology, 102, 49-55.
47. McFadden, J. (2000). Quantum evolution. New York: Norton.
48. Metzger, M. A. (1994). Have subjects been shown to generate chaotic number? Commentary on Neuringer and Voss. Psychological Science, 5, 111-114.
49. Miller, N., & Neuringer, A. (2000). Reinforcing variability in adolescents with autism. Journal of Applied Behavior Analysis, 33, 151-165.
50. Mook, D. M., Jeffrey, J., & Neuringer, A. (1993). Spontaneously hypertensive rats (SHR) readily learn to vary but not to repeat instrumental responses. Behavioral and Neural Biology, 59, 126-135.
51. Mook, D. M., & Neuringer, A. (1994). Different effects of amphetamine on reinforced variations versus repetitions in spontaneously hypertensive rats (SHR). Physiology & Behavior, 56, 939-944.
52. Morris, C. (1987). The operant conditioning of response variability: Free-operant versus discrete-response procedures. Journal of the Experimental Analysis of Behavior, 47, 273-277.
53. Moss, F., & Wiesenfeld, K. (1995, August). The benefits of background noise. Scientific American, 66-69.
54. Moxley, R. A. (1997). Skinner: From determinism to random variation. Behavior and Philosophy, 25, 3-28.
55. Mullins, M., & Rincover, A. (1985). Comparing autistic and normal children along the dimensions of reinforcement maximization, stimulus sampling, and responsiveness to extinction. Journal of Experimental Child Psychology, 40, 350-374.
56. Nelson, T. D. (1978). Fixed-interval matching-to-sample: Intermatching time and intermatching error runs. Journal of the Experimental Analysis of Behavior, 29, 105-113.
57. Neuringer, A. (1986). Can people behave "randomly"? The role of feedback. Journal of Experimental Psychology: General, 115, 62-75.
58. Neuringer, A. (1991). Operant variability and repetition as functions of interresponse time. Journal of Experimental Psychology: Animal Behavior Processes, 17, 3-12.
59. Neuringer, A. (1992). Choosing to vary and repeat. Psychological Science, 3, 246-250.
60. Neuringer, A. (1993). Reinforced variation and selection. Animal Learning & Behavior, 21, 83-91.
61. Neuringer, A. (2002). Operant variability: Evidence, functions, and theory. Psychonomic Bulletin & Review, 9, 672-705.
62. Neuringer, A., Deiss, C., & Olson, G. (2000). Reinforced variability and operant learning. Journal of Experimental Psychology: Animal Behavior Processes, 26, 98-111.
63. Neuringer, A., Kornell, N., & Olufs, M. (2001). Stability and variability in extinction. Journal of Experimental Psychology: Animal Behavior Processes, 27, 79-94.
64. Neuringer, A., & Voss, C. (1993). Approximating chaotic behavior. Psychological Science, 4, 113-119.
65. Nevin, J. A. (1967). Effects of reinforcement scheduling on simultaneous discrimination performance. Journal of the Experimental Analysis of Behavior, 10, 251-260.
66. Nickerson, R. A. (2002). The production and perception of randomness. Psychological Review, 109, 330-357.
67. Page, S., & Neuringer, A. (1985). Variability is an operant. Journal of Experimental Psychology: Animal Behavior Processes, 11, 429-452.
68. Pryor, K. W., Haag, R., & O'Reilly, J. (1969). The creative porpoise: Training for novel behavior. Journal of the Experimental Analysis of Behavior, 12, 653-661.
69. Radloff, L. S. (1991). The use of the Center for Epidemiological Studies Depression Scale in adolescents and young adults. Journal of Youth and Adolescence, 20, 149-166.
70. Renner, M. J., & Rosenzweig, M. R. (1987). Enriched and impoverished environments: Effects on brain and behavior. New York: Springer-Verlag.
71. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning: II. Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
72. Rhinehart, L. (1998). The dice man. Woodstock, NY: Overlook Press.
73. Ross, C., & Neuringer, A. (2002). Reinforcement of variations and repetitions along three independent response dimensions. Behavioural Processes, 57, 199-209.
74. Sagvolden, T., Pettersen, M. B., & Larsen, M. C. (1993). Spontaneously hypertensive rats (SHR) as a putative animal model of childhood hyperkinesis: SHR behavior compared to four other rat strains. Physiology & Behavior, 54, 1047-1055.
75. Saldana, R. L., & Neuringer, A. (1998). Is instrumental variability abnormally high in children exhibiting ADHD and aggressive behavior? Behavioural Brain Research, 94, 51-59.
76. Savage, T. (2001). Shaping: A multiple contingencies analysis and its relevance to behaviour-based robotics. Connection Science, 13, 199-234.
77. Schmidt, R. A., & Lee, T. D. (1999). Conditions of practice. In R. A. Schmidt & T. D. Lee (Eds.), Motor control and learning: A behavioral emphasis (3rd ed., pp. 285-321). Champaign, IL: Human Kinetics.
78. Schwartz, B. (1980). Development of complex stereotyped behavior in pigeons. Journal of the Experimental Analysis of Behavior, 33, 153-166.
79. Schwartz, B. (1982). Failure to produce variability with reinforcement. Journal of the Experimental Analysis of Behavior, 37, 171-181.
80. Siegler, R. S. (1996). Emerging minds: The process of change in children's thinking. New York: Oxford University Press.
81. Skinner, B. F. (1950). Are theories of learning necessary? Psychological Review, 57, 193-216.
82. Skinner, B. F. (1959). The generic nature of the concepts of stimulus and response. In B. F. Skinner (Ed.). Cumulative record (pp. 347-366). New York: Appleton-Century-Crofts. (Original work published 1935)
83. Skinner, B. F. (1974). About behaviorism. New York: Knopf.
84. Stokes, P. D. (2001). Variability, constraints, and creativity: Shedding light on Claude Monet. American Psychologist, 36, 355-359.
85. Stokes, P. D., & Balsam, P. (2001). An optimal period for setting sustained variability levels. Psychonomic Bulletin & Review, 8, 177-184.
86. Stokes, P. D., & Harrison, H. M. (2002). Constraints have different concurrent effects and aftereffects on variability. Journal of Experimental Psychology: General, 131, 552-566.
87. Ward, L. M., & West, R. L. (1994). On chaotic behavior. Psychological Science, 5, 232-236.
88. Wasserman, E. A., Young, M. E., & Cook, R. G. (2004). Variability discrimination in humans and animals: Implications for adaptive action. American Psychologist, 59, 879-890.
89. Weiss, R. L. (1964). On producing random responses. Psychological Reports, 14, 931-941.
90. Wultz, B., Sagvolden, T., Moser, E. I., & Moser, M. B. (1990). The spontaneously hypertensive rat as an animal model of attention-deficit hyperactivity disorder: Effects of methylphenidate on exploratory behavior. Behavioral and Neural Biology, 53, 88-102.