The S-R issue: Its status in behavior analysis and in Donahoe and Palmer's learning and complex behavior

Journal of the Experimental Analysis of Behavior

Volumn 67, Issue 2, 1997, Pages 193-211

  Donahoe, John W ^a   Palmer, David C ^b   Burgos, José E ^c  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b SMITH COLLEGE   (United States)

^c UNIVERSIDAD CENTRAL DE VENEZUELA   (Venezuela)

Author keywords

Computer simulation; Contiguity; Contingencies of reinforcement; Discrimination learning; Reinforcement; Respondent conditioning; S R psychology

Indexed keywords

DOPAMINE;

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; CONDITIONED REFLEX; DISCRIMINATION LEARNING; HIPPOCAMPUS; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; PHYSIOLOGY; REINFORCEMENT; VENTRAL TEGMENTUM;

ANIMALS; ASSOCIATION LEARNING; COMPUTER SIMULATION; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; DISCRIMINATION LEARNING; DOPAMINE; HIPPOCAMPUS; HUMANS; NEURAL NETWORKS (COMPUTER); REINFORCEMENT SCHEDULE; VENTRAL TEGMENTAL AREA;

EID: 0031088259     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.1997.67-193     Document Type: Article

References (102)

1. Anger, D. (1956). The dependence of interresponse times upon the relative reinforcement of different interresponse times. Journal of Experimental Psychology, 52, 145-161.
2. Ayres, J. J. B., Benedict, J. O., & Witcher, E. S. (1975). Systematic manipulation of individual events in a truly random control with rats. Journal of Comparative and Physiological Psychology, 88, 97-103.
3. Baum, W. M. (1973). The correlation-based law of effect. Journal of the Experimental Analysis of Behavior, 20, 137-154.
4. Benedict, J. O. (1975). Response-shock delay as a reinforcer in avoidance behavior. Journal of the Experimental Analysis of Behavior, 24, 323-332.
5. Benedict, J. O., & Ayres, J. J. B. (1972). Factors affecting conditioning in the truly random control procedure in the rat. Journal of Comparative and Physiological Psychology, 78, 323-330.
6. Beninger, R. J. (1983). The role of dopamine activity in locomotor activity and learning. Brain Research Reviews, 6, 173-196.
7. Blough, D. S. (1963). Interresponse time as a function of a continuous variable: A new method and some data. Journal of the Experimental Analysis of Behavior, 6, 237-246.
8. Bolles, R. C., & Popp, R. J., Jr. (1964). Parameters affecting the acquisition of Sidman avoidance. Journal of the Experimental Analysis of Behavior, 7, 315-321.
9. Buonomano, D. V., & Merzenich, M. M. (1995). Temporal information transformed into a spatial code by a neural network with realistic properties. Science, 267, 1026-1028.
10. Catania, A. C., & Keller, K. J. (1981). Contingency, contiguity correlation, and the concept of causality. In P. Harzem & M. D. Zeiler (Eds.), Predictability, correlation, and contiguity (pp. 125-167). New York: Wiley.
11. Coleman, S. R. (1981). Historical context and systematic functions of the concept of the operant. Behaviorism, 9, 207-226.
12. Coleman, S. (1984). Background and change in B. F. Skinner's metatheory from 1930 to 1938. Journal of Mind and Behavior, 5, 471-500.
13. Dinsmoor, J. A. (1985). The role of observing and attention in establishing stimulus control. Journal of the Experimental Analysis of Behavior, 43, 365-381.
14. Dinsmoor, J. A. (1995). Stimulus control: Part I. The Behavior Analyst, 18, 51-68.
15. Donahoe, J. W. (1993). The unconventional wisdom of B. F. Skinner: The analysis-interpretation distinction. Journal of the Experimental Analysis of Behavior, 60, 453-456.
16. Donahoe, J. W. (in press-a). The necessity of neural networks. In J. W. Donahoe & V. P. Dorsel (Eds.), Neural-network models of cognition: Biobehavioral foundations. Amsterdam: Elsevier.
17. Donahoe, J. W. (in press-b). Positive reinforcement: The selection of behavior. In W. O'Donohue (Ed.), Learning and behavior therapy. Boston: Allyn & Bacon.
18. Donahoe, J. W., Burgos, J. E., & Palmer, D. C. (1993). Selectionist approach to reinforcement. Journal of the Experimental Analysis of Behavior, 60, 17-40.
19. Donahoe, J. W., Crowley, M. A., Millard, W. J., & Stickney, K. A. (1982). A unified principle of reinforcement. In M. L. Commons, R. J. Herrnstein, & H. Rachlin (Eds.), Quantitative analyses of behavior (Vol. 2, pp. 493-521). Cambridge, MA: Ballinger.
20. Donahoe, J. W., & Dorsel, V. P. (Eds.). (in press). Neural-network models of cognition: Biobehavioral foundations. Amsterdam: Elsevier.
21. Donahoe, J. W., & Palmer, D. C. (1989). The interpretation of complex human behavior: Some reactions to Parallel Distributed Processing. Journal of the Experimental Analysis of Behavior, 51, 399-416.
22. Donahoe, J. W., & Palmer, D. C. (1994). Learning and complex behavior. Boston: Allyn & Bacon.
23. Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts.
24. Frey, U. (in press). Cellular mechanisms of long-term potentiation: Late maintenance. In J. W. Donahoe & V. P. Dorset (Eds.), Neural-network models of cognition: Biobehavioral foundations. Amsterdam: Elsevier.
25. Frey, U., Huang, Y.-Y., & Kandel, E. R. (1993). Effects of cAMP simulate a late stage of LTP in hippocampus CA1 neurons. Science, 260, 1661-1664.
26. Galbicka, G. (1992). The dynamics of behavior. Journal of the Experimental Analysis of Behavior, 57, 243-248.
27. Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton-Mifflin.
28. Gormezano, I., & Kehoe, E. J. (1981). Classical conditioning and the law of contiguity. In P. Harzem & M. D. Zeiler (Eds.), Predictability, correlation, and contiguity (pp. 1-45). New York: Wiley.
29. Guthrie, E. R. (1933). Association as a function of time interval. Psychological Review, 40, 355-367.
30. Hamilton, W. (1964). The genetical theory of social behavior, I. II. Journal of Theoretical Biology, 7, 1-52.
31. Heinemann, E. G., & Rudolph, R. L. (1963). The effect of discrimination training on the gradient of stimulus generalization. American Journal of Psychology, 76, 653-656.
32. Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243-266.
33. Herrnstein, R. J. (1982). Melioration as behavioral dynamism. In M. L. Commons, R. J. Herrnstein, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 2. Matching and maximizing accounts (pp. 433-458). Cambridge, MA: Ballinger.
34. Herrnstein, R. J., & Vaughan, W., Jr. (1980). Melioration and behavioral allocation. In J. E. R. Staddon (Ed.), Limits to action: The allocation of individual behavior (pp. 143-176). New York: Academic Press.
35. Heyman, G. N. (1979). A Markov model description of changeover probabilities on concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior, 31, 41-51.
36. Hilgard, E. R., & Marquis, D. G. (1940). Conditioning and learning. New York: Appleton-Century-Crofts.
37. Hineline, P. N. (1970). Negative reinforcement without shock reduction. Journal of the Experimental Analysis of Behavior, 14, 259-268.
38. Hineline, P. N. (1981). The several roles of stimuli in negative reinforcement. In P. Harzem & M. D. Zeiler (Eds.), Predictability, correlation, and contiguity (pp. 203-246). New York: Wiley.
39. Hineline, P. N. (1986). Re-tuning the operant-respondent distinction. In T. Thompson & M. D. Zeiler (Eds.), Analysis and integration of behavioral units (pp. 55-79). Hillsdale, NJ: Erlbaum.
40. Hinson, J. M., & Staddon, J. E. R. (1983a). Hill-climbing by pigeons. Journal of the Experimental Analysis of Behavior, 39, 25-47.
41. Hinson, J. M., & Staddon, J. E. R. (1983b). Matching, maximizing, and hillclimbing. Journal of the Experimental Analysis of Behavior, 40, 321-331.
42. Hoebel, B. G. (1988). Neuroscience and motivation: Pathways and peptides that define motivational systems. In R. A. Atkinson (Ed.), Stevens' handbook of experimental psychology (Vol. 1, pp. 547-625). New York: Wiley.
43. Holland, P. C. (1977). Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. Journal of Experimental Psychology: Animal Behavior Processes, 3, 77-104.
44. Hull, C. L. (1934). The concept of habit-family hierarchy and maze learning. Psychological Review, 41, 33-54.
45. Hull, C. L. (1937). Mind, mechanism, and adaptive behavior. Psychological Review, 44, 1-32.
46. Jenkins, H. M., & Sainesbury, R. S. (1969). The development of stimulus control through differential reinforcement. In N. J. Mackintosh & W. K. Honig (Eds.), Fundamental issues in associative learning (pp. 123-161). Halifax, Nova Scotia: Dalhousie University Press.
47. Kehoe, E. J. (1988). A layered network model of associative learning: Learning to learn and configuration. Psychological Review, 95, 411-433.
48. Kehoe, E. J. (1989). Connectionist models of conditioning: A tutorial. Journal of the Experimental Analysis of Behavior, 52, 427-440.
49. Keller, R. J., Ayres, J. J. B., & Mahoney, W. J. (1977). Brief versus extended exposure to truly random control procedures. Journal of Experimental Psychology: Animal Behavior Processes, 3, 53-65.
50. Lattal, K. A., & Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 16, 27-39.
51. Lieberman, P. A. (1993). Learning: Behavior and cognition. Pacific Grove, CA: Brooks/Cole.
52. McClelland, J. L., Rumelhart, D. E., & The PDP Research Group. (Eds.). (1986). Parallel distributed processing: Explorations in microstructure of cognition (Vol. 2). Cambridge, MA: MIT Press.
53. Meazzini, P., & Ricci, C. (1986). Molar vs. molecular units of analysis. In T. Thompson & M. D. Zeiler (Eds.), Analysis and integration of behavioral units (pp. 19-43). Hillsdale, NJ: Erlbaum.
54. Minsky, M. L., & Papert, S. A. (1969). Perceptrons. Cambridge, MA: MIT Press.
55. Moore, J. (1984). Choice and transformed interrein-forcement intervals. Journal of the Experimental Analysis of Behavior, 42, 321-335.
56. Morse, W. H. (1966). Intermittent reinforcement. In W. K. Honig (Ed.), Operant behavior: Areas of research and application (pp. 52-108). New York: Appleton-Century-Crofts.
57. Morse, W. H., & Skinner, B. F. (1957). A second type of superstition in the pigeon. American Journal of Psychology, 70, 308-311.
58. Neuringer, A. J. (1967). Choice and rate of responding in the pigeon. Unpublished doctoral dissertation, Harvard University.
59. Nevin, J. A. (1969). Inter val reinforcement of choice behavior in discrete trials. Journal of the Experimental Analysis of Behavior, 12, 875-885.
60. Nevin, J. A. (1984). Quantitative analysis. Journal of the Experimental Analysis of Behavior, 42, 421-434.
61. Osgood, C. E. (1953). Method and theory in experimental psychology. New York: Oxford University Press.
62. Palmer, D. C., & Donahoe, J. W. (1992). Essentialism and selectionism in cognitive science and behavior analysis. American Psychologist, 47, 1344-1358.
63. Pear, J. J. (1985). Spatiotemporal patterns of behavior produced by variable-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 44, 217-231.
64. Platt, J. R. (1979). Interresponse-time shaping by variable-interval-like interresponse-time reinforcement contingencies. Journal of the Experimental Analysis of Behavior, 31, 3-14.
65. Quinsey, V. L. (1971). Conditioned suppression with no CS-US contingency in the rat. Canadian Journal of Psychology, 25, 69-82.
66. Rescorla, R. A. (1967). Pavlovian conditioning and its proper control procedures. Psychological Review, 74, 71-80.
67. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
68. Rosenblatt, F. (1962). Principles of neurodynamics. Washington, DC: Spartan.
69. Rumelhart, D. E., McClelland, J. L., & The PDP Research Group. (Eds.) (1986). Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1). Cambridge, MA: MIT Press.
70. Schoenfeld, W. N., & Farmer, J. (1970). Reinforcement schedules and the "behavior stream." In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 215-245). New York: Appleton-Century-Crofts.
71. Shimp, C. P. (1966). Probabilistically reinforced choice behavior in pigeons. Journal of the Experimental Analysis of Behavior, 9, 443-455.
72. Shimp, C. P. (1969). Optimal behavior in free-operant experiments. Psychological Review, 76, 97-112.
73. Shimp, C. P. (1974). Time allocation and response rate. Journal of the Experimental Analysis of Behavior, 21, 491-499.
74. Shull, R. L. (1995). Interpreting cognitive phenomena: Review of Donahoe and Palmer's Learning and Complex Behavior. Journal of the Experimental Analysis of Behavior, 63, 347-358.
75. Sidman, M. (1986). Functional analysis of emergent verbal classes. In T. Thompson & M. D. Zeiler (Eds.), Analysis and integration of behavioral units (pp. 213-245). Hillsdale, NJ: Erlbaum.
76. Silberberg, A., Hamilton, B., Ziriax, J. M., & Casey, J. (1978). The structure of choice. Journal of Experimental Psychology: Animal Behavior Processes, 4, 368-398.
77. Silberberg, A., & Ziriax, J. M. (1982). The interchangeover time as a molecular dependent variable in concurrent schedules. In M. L. Commons, R. J. Herrnstein, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 2. Matching and maximizing accounts of behavior (pp. 111-130). Cambridge, MA: Ballinger.
78. Skinner, B. F. (1931). The concept of the reflex in the study of behavior. Journal of General Psychology, 5, 427-458.
79. Skinner, B. F. (1937). Two types of conditioned reflex: A reply to Konorski and Miller. Journal of General Psychology, 16, 272-279.
80. Skinner, B. F. (1938). The behavior of organisms. New York: Appleton-Century-Crofts.
81. Skinner, B. F. (1948). "Superstition" in the pigeon. Journal of Experimental Psychology, 38, 168-172.
82. Skinner, B. F. (1953). Science and human behavior. New York: Macmillan.
83. Skinner, B. F. (1976). Farewell, my lovely! Journal of the Experimental Analysis of Behavior, 25, 218.
84. Skinner, B. F. (1983). A matter of consequences. New York: Knopf.
85. Sober, E. (1984). The nature of selection. Cambridge, MA: MIT Press.
86. Sober, E. (1993). Philosophy of biology. Boulder, CO: Westview Press.
87. Staddon, J. E. R. (1993). The conventional wisdom of behavior analysis. Journal of the Experimental Analysis of Behavior, 60, 439-447.
88. Staddon, J. E. R., & Hinson, J. M. (1983). Optimization: A result or a mechanism? Science, 221, 976-977.
89. Staddon, J. E. R., & Simmelhag, V. L. (1971). The "superstition" experiment: A reexamination of its implications for the principles of adaptive behavior. Psychological Review, 78, 3-43.
90. Stein, L., & Belluzzi, J. D. (1988). Operant conditioning of individual neurons. In M. L. Commons, R. M. Church, J. R. Stellar, & A. R. Wagner (Eds.), Quantitative analyses of behavior (Vol. 7, pp. 249-264). Hillsdale, NJ: Erlbaum.
91. Stein, L., & Belluzzi, J. D. (1989). Cellular investigations of behavioral reinforcement. Neuroscience and Biobehavioral Reviews, 13, 69-80.
92. Stein, L., Xue, B. G., & Belluzzi, J. D. (1993). A cellular analogue of operant conditioning. Journal of the Experimental Analysis of Behavior, 60, 41-53.
93. Stein, L., Xue, B. G., & Belluzzi, J. D. (1994). In vitro reinforcement of hippocampal bursting: A search for Skinner's atom of behavior. Journal of the Experimental Analysis of Behavior, 61, 155-168.
94. Timberlake, W., & Lucas, G. A. (1985). The basis of superstitious behavior: Chance contingency, stimulus substitution, or appetitive behavior? Journal of the Experimental Analysis of Behavior, 44, 279-299.
95. Tolman, E. C. (1932). Purposive behavior in animals and men. New York: Appleton-Century-Crofts.
96. Watson, J. B. (1924). Behaviorism. New York: Norton.
97. Williams, B. A. (1985). Choice behavior in a discretetrial concurrent VI-VR: A test of maximizing theories of matching. Learning and Motivation, 16, 423-443.
98. Williams, B. A. (1986). Identifying behaviorism's prototype: A review of Behaviorism: A Conceptual Reconstruction by G. E. Zuriff. The Behavior Analyst, 9, 117-122.
99. Williams, B. A. (1990). Enduring problems for molecular accounts of operant behavior. Journal of Experimental Psychology: Animal Behavior Processes, 16, 213-216.
100. Williams, D. R. (1968). The structure of response rate. Journal of the Experimental Analysis of Behavior, 11, 251-258.
101. Wise, R. A. (1989). The brain and reward. In J. M. Liebman & S. J. Cooper (Eds.), The neuropharmacological basis of reward (pp. 377-424). New York: Oxford University Press.
102. Zuriff, G. E. (1985). Behaviorism: A conceptual reconstruction. New York: Columbia University Press.