Operant variability and voluntary action

Psychological Review

Volumn 117, Issue 3, 2010, Pages 972-993

  Neuringer, Allen ^a   Jensen, Greg ^a  

^a REED COLLEGE   (United States)

Author keywords

Choice; Concurrent schedules of reinforcement; Reinforced variability; Theories of free will; Voluntary action

Indexed keywords

ARTICLE; DECISION MAKING; HUMAN; INSTRUMENTAL CONDITIONING; LINGUISTICS; PERCEPTIVE DISCRIMINATION; PSYCHOLOGICAL MODEL; REINFORCEMENT; STIMULATION; UNCERTAINTY;

CHOICE BEHAVIOR; CONDITIONING, OPERANT; DISCRIMINATION (PSYCHOLOGY); HUMANS; LINGUISTICS; MODELS, PSYCHOLOGICAL; PHYSICAL STIMULATION; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; UNCERTAINTY;

EID: 77955326088     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0019499     Document Type: Article

References (87)

1. Arnesen, E. M. (2000). Reinforcement of object manipulation increases discovery. Unpublished undergraduate thesis, Reed College.
2. Baddeley A.D. The capacity for generating information by randomization. Quarterly Journal of Experimental Psychology 1966, 18:119-129.
3. Baddeley A.D., Emslie H., Kolodny J., Duncan J. Random generation and the executive control of working memory. Quarterly Journal of Experimental Psychology 1998, 51(A):819-852.
4. Bailey D.H., Crandall R.E. On the random character of fundamental constant expansions. Experimental Mathematics 2001, 10:175-190.
5. Balsam P.D., Deich J.D., Ohyama T., Stokes P.D. Origins of new behavior. Learning and behavior therapy 1998, 403-420. Allyn & Bacon, Boston, MA. W. O'Donohue (Ed.).
6. Bargh J.A. Bypassing the will: Toward demystifying the nonconscious control of social behavior. The new unconscious 2005, 19-36. Oxford University Press, New York, NY. R. Hassin, J.S. Uleman, J.A. Bargh (Eds.).
7. Barsalou L.W. The instability of graded structures in concepts. Concepts and conceptual development: Ecological and intellectual factors in categorization 1987, 101-140. Cambridge University Press, New York, NY. U. Neisser (Ed.).
8. Baum W.M. On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior 1974, 22:231-242.
9. Blough D.S. The reinforcement of least-frequent interresponse times. Journal of the Experimental Analysis of Behavior 1966, 9:581-591.
10. Brugger P. Variables that influence the generation of random sequences: An update. Perceptual and Motor Skills 1997, 84:627-661.
11. Budescu D.V., Rapoport A. Subjective randomization in one- and two-person games. Journal of Behavioral Decision Making 1994, 7:273-302.
12. Catchpole C.K., Slater P.J. Bird song: Biological themes and variations 1995, Cambridge University Press, Cambridge, England.
13. Cohen L., Neuringer A., Rhodes D. Effects of ethanol on reinforced variations and repetitions by rats under a multiple schedule. Journal of the Experimental Analysis of Behavior 1990, 54:1-12.
14. Davison M., McCarthy D. The matching law: A research review 1988, Erlbaum, Hillsdale, NJ.
15. Deiss, C. (1994). On the nature of operant variability: Evaluating dual-task interference between schedules of variability and repetition. Unpublished undergraduate thesis, Reed College, Portland, Oregon.
16. Dennett D. Brainstorms 1978, MIT Press, Cambridge, MA.
17. Dennett D. Freedom evolves 2003, Viking Adult, New York, NY.
18. Denney J., Neuringer A. Behavioral variability is controlled by discriminative stimuli. Animal Learning & Behavior 1998, 26:154-162.
19. Descartes, R. (1931). The philosophical works of Descartes (E. S. Haldane & G. R. T. Ross, trans.). New York, NY: Cambridge University Press. (Original work published 1614).
20. Doughty A.H., Lattal K.A. Resistance to change of operant variation and repetition. Journal of the Experimental Analysis of Behavior 2001, 76:195-215.
21. Doyle R. The cogito model 2009, Retrieved from the Information Philosopher website: http://www.informationphilosopher.com/freedom/cogito/.
22. Driver P.M., Humphries D.A. Protean behavior: The biology of unpredictability 1988, Oxford University Press, Oxford, England.
23. Evans F.J., Graham C. Subjective random number generation and attention deployment during acquisition and overlearning of a motor skill. Bulletin of the Psychonomic Society 1980, 15:391-394.
24. Gharib A., Gade C., Roberts S. Control of variation by reward probability. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30:271-282.
25. Gigerenzer G., Swijtink Z., Porter T., Daston L., Beatty J., Kruger L. The empire of chance: How probability changed science and everyday life 1989, Cambridge University Press, Cambridge, England.
26. Glimcher P.W. Decisions, uncertainty, and the brain 2003, MIT Press, Cambridge, MA.
27. Glimcher P.W. Indeterminacy in brain and behavior. Annual Review of Psychology 2005, 56:25-56.
28. Goetz E.M. The teaching of creativity to preschool children. Handbook of creativity 1989, 411-428. Plenum Press, New York, NY. J.A. Glover, R.R. Ronning, C.R. Reynolds (Eds.).
29. Goetz E.M., Baer D.M. Social control of form diversity and emergence of new forms in children's blockbuilding. Journal of Applied Behavior Analysis 1973, 6:209-217.
30. Grunow A., Neuringer A. Learning to vary and varying to learn. Psychonomic Bulletin & Review 2002, 9:250-258.
31. Jensen G., Miller C., Neuringer A. Truly random operant responding: Results and reasons. Comparative cognition: Experimental explorations of animal intelligence 2006, 459-480. Oxford University Press, Oxford, England. E.A. Wasserman, T.R. Zentall (Eds.).
32. Jensen G., Neuringer A. Choice as a function of reinforcer " hold": From probability learning to concurrent reinforcement. Journal of Experimental Psychology: Animal Behavior Processes 2008, 34:437-460.
33. Kane R. Free will and values 1985, SUNY Press, New York, NY.
34. Kane R. The Oxford handbook of free will 2002, Oxford University Press, Oxford, England.
35. Lee R., McComas J.J., Jawor J. The effects of differential and lag reinforcement schedules on varied verbal responding by individuals with autism. Journal of Applied Behavior Analysis 2002, 35:391-402.
36. Leshan L., Margenau H. Einstein's space and van Gogh's sky: Physical reality and beyond 1982, Macmillan, New York, NY.
37. Libet B. Unconscious cerebral initiative and the role of conscious will in voluntary action. Behavioral and Brain Science 1985, 8:529-566.
38. Machado A. Operant conditioning of behavioral variability using a percentile reinforcement schedule. Journal of the Experimental Analysis of Behavior 1989, 52:155-166.
39. Machado A. Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. Journal of the Experimental Analysis of Behavior 1997, 68:1-25.
40. Macnab R.M., Koshland D.E. The gradient-sensing mechanism in bacterial chemotaxis. Proceedings of the National Academy of Sciences, USA 1972, 69:2509-2512.
41. Maes J.H.R. Response stability and variability induced in humans by different feedback contingencies. Learning & Behavior 2003, 31:332-348.
42. Maynard Smith J. Evolution and the theory of games 1982, Cambridge University Press, Cambridge, England.
43. Miller N., Neuringer A. Reinforcing variability in adolescents with autism. Journal of Applied Behavior Analysis 2000, 33:151-165.
44. Mook D.M., Neuringer A. Differential effects of amphetamine on reinforced variations versus repetitions in spontaneously hypersensitive rats. Physiology & Behavior 1994, 56:939-944.
45. Moreh J. Randomness, game theory, and free will. Erkenntnis 1994, 41:49-64.
46. Moxley R.A. Skinner: From determinism to random variation. Behavior and Philosophy 1997, 25:3-28.
47. Nash J. Non-cooperative games. Annals of Mathematics 1951, 54:286-295.
48. Neuringer A. Can people behave " randomly" ? The role of feedback. Journal of Experimental Psychology: General 1986, 115:62-75.
49. Neuringer A. Operant variability and repetition as a function of interresponse time. Journal of Experimental Psychology: Animal Behavior Processes 1991, 17:3-12.
50. Neuringer A. Choosing to vary or repeat. Psychological Science 1992, 3:246-250.
51. Neuringer A. Operant variability: Evidence, functions, and theory. Psychonomic Bulletin & Review 2002, 9:672-705.
52. Neuringer A., Jensen G., Piff P. Stochastic matching and the voluntary nature of choice. Journal of the Experimental Analysis of Behavior 2007, 88:1-28.
53. Neuringer A., Kornell N., Olufs M. Stability and variability in extinction. Journal of Experimental Psychology: Animal Behavior Processes 2001, 27:79-94.
54. Neuringer A., Voss C. Approximating chaotic behavior. Psychological Science 1993, 4:113-119.
55. Nevin J.A. Interval reinforcement of choice behavior in discrete trials. Journal of the Experimental Analysis of Behavior 1969, 12:875-885.
56. Nickerson R.A. The production and perception of randomness. Psychological Review 2002, 109:330-357.
57. Nisbett R., Wilson T. Telling more than we can know: Verbal reports on mental processes. Psychological Review 1977, 84:231-259.
58. Opfer J.E. Identifying living and sentient kinds from dynamic information: The case of goal-directed versus aimless autonomous movement in conceptual change. Cognition 2002, 86:97-122.
59. Page S., Neuringer A. Variability is an operant. Journal of Experimental Psychology: Animal Behavior Processes 1985, 11:429-452.
60. Popper K.R., Eccles J.C. The self and its brain 1977, Springer-Verlag, New York, NY.
61. Potts R. Variability selection in hominid evolution. Evolutionary Anthropology 1998, 7:81-96.
62. Pryor K.W., Haag R., O'Reilly J. The creative porpoise: Training for novel behavior. Journal of the Experimental Analysis of Behavior 1969, 12:653-661.
63. Roberts S., Neuringer A. Self-experimentation. Handbook of research methods in human operant behavior 1998, 619-655. Plenum Press, New York, NY. K.A. Lattal, M. Perone (Eds.).
64. Robertson R., Combs A. Chaos theory in psychology and the life sciences 1995, Erlbaum, Mahwah, NJ.
65. Rosch E.H. Principles of categorization. Cognition and categorization 1978, 27-48. Erlbaum, Hillsdale, NJ. E.H. Rosch, B. Lloyd (Eds.).
66. Ross C., Neuringer A. Reinforcement of variations and repetitions along three independent response dimensions. Behavioural Processes 2002, 57:199-209.
67. Ryle G. The concept of mind 1949, Hutchinson, London, England.
68. Scriven M. An essential unpredictability in human behavior. Scientific psychology 1965, 411-425. Basic Books, New York, NY. B. Wolman (Ed.).
69. Searcy W.A. Song repertoire size and female preference in song sparrows. Behavioral Ecology & Sociobiology 1984, 14:281-286.
70. Searle J. Freedom and neurobiology: Reflections on free will, language, and political power 2007, Columbia University Press, New York, NY.
71. Silberberg A., Hamilton B., Ziriax J.M., Casey J. The structure of choice. Journal of Experimental Psychology: Animal Behavior Processes 1978, 4:368-398.
72. Skinner B.F. The behavior of organisms: An experimental analysis 1938, Appleton-Century, New York, NY.
73. Skinner B.F. The generic nature of the concepts of stimulus and response. Cumulative record 1961, 347-366. Appleton-Century-Crofts, New York, NY, (Original work published 1935). Enlarged ed.
74. Skinner B.F. About behaviorism 1974, Knopf, New York, NY.
75. Staddon J.E.R. Adaptive dynamics: The theoretical analysis of behavior 2001, MIT Press, Cambridge, MA.
76. Stokes P.D., Lai B., Holtz D., Rigsbee E., Cherrick D. Effects of practice on variability, effects of variability on transfer. Journal of Experimental Psychology: Human Perception and Performance 2008, 34:640-659.
77. Tremoulet P.D., Feldman J. Perception of animacy from the motion of a single object. Perception 2000, 29:943-951.
78. Tremoulet P.D., Feldman J. The influence of spatial context and the role of intentionality in the interpretation of animacy from motion. Perception & Psychophysics 2006, 68:1047-1058.
79. Van Inwagen P. Free will remains a mystery. Philosophical Perspectives 2000, 14:1-19.
80. Voorspoels W., Vanpaemel W.M., Storms G. Exemplars and prototypes in natural language concepts: A typicality-based evaluation. Psychonomic Bulletin & Review 2008, 15:630-637.
81. Ward L.M., West R.L. On chaotic behavior. Psychological Science 1994, 5:232-236.
82. Wasserman E.A., Young M.E., Cook R.G. Variability discrimination in humans and animals: Implications for adaptive action. American Psychologist 2004, 59:879-890.
83. Wegner D.M. The illusion of conscious will 2002, Worth, New York, NY.
84. Wegner D.M. Who is the controller of the controlled processes?. The new unconscious 2005, 19-36. Oxford University Press, New York, NY. R. Hassin, J.S. Uleman, J.A. Bargh (Eds.).
85. Weiss R.L. " Variables that influence random-generation": An alternative hypothesis. Perceptual and Motor Skills 1965, 20:307-310.
86. Williams B.A. Reinforcement, choice, and response strength. Stevens' handbook of experimental psychology 1988, 2:167-244. Wiley, New York, NY. C.R. Atkinson, R.J. Herrnstein, G. Lindzey, R.D. Luce (Eds.).
87. Zipf G.K. The psycho-biology of language: An introduction to dynamic philology 1935, Houghton-Mifflin, New York, NY.