Situational descriptions of behavioral procedures: The in situ testbed

Journal of the Experimental Analysis of Behavior

Volumn 75, Issue 2, 2001, Pages 135-164

  Kemp, Steven M ^a   Eckerman, David A ^a  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

Computer simulation; Key peck; Learning theory; Neural networks; POMDP; Reinforcement schedules; Situated action

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPARATIVE STUDY; INSTRUMENTAL CONDITIONING; MOTIVATION; PIGEONS AND DOVES; REINFORCEMENT; REPRODUCIBILITY;

ANIMALS; COLUMBIDAE; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; MOTIVATION; NEURAL NETWORKS (COMPUTER); REINFORCEMENT SCHEDULE; REPRODUCIBILITY OF RESULTS;

EID: 0035290605     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2001.75-135     Document Type: Article

References (79)

1. Abelson, R. P. (1968). Simulation of social behavior. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology: Vol. 2. Research methods (2nd ed., pp. 274-356). Reading, MA: Addison-Wesley.
2. Anastasi, A. (1988). Psychological testing (6th ed.). New York: MacMillan.
3. Austin, J. L. (1962). How to do things with words (2nd ed., J. O. Urmson and M. Sbisà, Eds.). Cambridge, MA: Harvard University Press.
4. Barto, A. G., Bradtke, S. J., & Singh, S. P. (1995). Learning to act using real-time dynamic programming. Artificial Intelligence, 72, 81-138.
5. Barwise, J. (1989). The situation in logic (CSLI Lecture Notes No. 17). Stanford, CA: CSLI.
6. Barwise, J., & Perry, J. (1983). Situations and attitudes. Cambridge, MA: MIT Press.
7. Baum, W. M. (1973). The correlation-based law of effect. Journal of the Experimental Analysis of Behavior, 20, 137-153.
8. Baum, W. M., Schwendiman, J. W., & Bell, K. E. (1999). Choice, contingency discrimination, and foraging theory. Journal of the Experimental Analysis of Behavior, 71, 355-373.
9. Bellman, R. E. (1957). Dynamic programming. Princeton, NJ: Princeton University Press.
10. Burke, T. (1991). Peirce on truth and partiality. In J. Barwise, J. M. Gawron, G. Plotkin, & S. Tutiya (Eds.), Situation theory and its applications (Vol. 2, pp. 115-146). Stanford, CA: CSLI.
11. Bush, R.R., & Mosteller, F. (1951). A mathematical model for simple learning. Psychological Review, 58, 313-323.
12. Bush, R. R., & Mosteller, F. (1955). Stochastic models for learning. New York: Wiley.
13. Capehart, G. W., Eckerman, D. A., Guilkey, M., & Shull, R. L. (1980) A comparison of ratio and interval reinforcement schedules with comparable interreinforcement times. Journal of the Experimental Analysis of Behavior, 34, 61-76.
14. Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment (Quantitative Applications in the Social Sciences, No. 17). Newbury Park, CA: Sage.
15. Casti, J. L. (1997). Would-be worlds. New York: Wiley.
16. Church, R. M. (1997). Quantitative models of animal learning and cognition. Journal of Experimental Psychology: Animal Behavior Processes. 23, 379-389.
17. Clancey, W. J. (1993). Situated action: A neurophysiological interpretation response to Vera and Simon. Cognitive Science, 17, 87-116.
18. Clancey, W. J. (1997). Situated cognition: On human knowledge and compute representations. Cambridge: Cambridge University Press.
19. Daly H. B., & Daly, J. T. (1982). A mathematical model of reward and aversive nonreward: Its application in over 30 appetitive learning situations. Journal of Experimental Psychology: General, 111, 441-480.
20. Daly, H. B., & Daly, J. T. (1984). DMOD - A mathematical model of reward and aversive nonreward in appetitive learning situations: Program and instruction manual. Behavior Research Methods, Instruments. & Computers, 16, 38-52.
21. Donahoe, J. W., & Palmer, D. C. (1994). Learning and complex behavior. Boston: Allyn & Bacon.
22. Donahoe, J. W., Palmer, D. C., & Burgos, J. E. (1997). The S-R issue- Its status in behavior analysis and in Donahoe and Palmer's Learning and Complex Behavior. Journal of the Experimental Analysis of Behavior, 67, 193-211.
23. Dretske, F. I. (1981). Knowledge and the flow of information. Cambridge, MA: MIT Press.
24. Einhorn, H. J., Kleinmuntz, D. N., & Kleinmuntz, B. (1979). Linear regression and process-tracing models of judgement. Psychological Review, 86, 465-485.
25. Erev, I., & Roth, A. E. (1998). Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria. American Economic Review, 88, 848-881.
26. Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts.
27. Gleick, J. (1987). Chaos: Making a new science. New York: Viking.
28. Goldman, A. I. (1970). A theory of human action. Englewood Cliffs, NJ: Prentice Hall.
29. Guthrie, E. R. (1940). Association and the law of effect. Psychological Review, 47, 127-148.
30. Herrnstein, R. J. (1997). The matching law: Papers in psychology and economic (H. Rachlin & D. I. Laibson, Eds.). Cambridge, MA: Harvard University Press.
31. Howard, R. A. (1960). Dynamic programming and Markov processes. Cambridge, MA: MIT Press.
32. Jaakola, T., Singh, S. P., & Jordan, M. I. (1995). Reinforcement learning algorithm for partially observable Markov decision problems. In G. Tesauro, D. Touretzky & T. Leen (Eds.), Advances in neural information processing systems (Vol. 7, pp. 345-352). Cambridge, MA: MIT Press.
33. Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101, 99-134.
34. Kemp, S. M. (1996). The language ot animal learning theories: A radical behaviorist perspective. In J. Valsiner & H.-G. Voss (Eds.), The structure of learning processes (pp. 306-328). Norwood, NJ: Ablex.
35. Kemp, S. M., & Eckerman, D. A. (1995). Direct analysis oi contingencies using working models. Revista Mexicano de Analisis de la Conducta, 21, 27-46.
36. Kintsch, W. (1970). Stochastic learning theory. In M. H. Marx (Ed.), Learning: Theories (pp. 195-234). New York: MacMillan.
37. Lee, V.L. (1981). Terminological and conceptual revision in the experimental analysis of language development: Why. Behaviorism, 9, 25-53.
38. Lee, V. L. (1983). Behavior as a constituent of conduct. Behaviorism, 11, 199-224.
39. Lee, V. L. (1986). Act psychologies and the psychological nouns. The Psychological Record, 36, 167-177.
40. Lee, V. L. (1988). Beyond behaviorism. Hillsdale, NJ: Erlbaum.
41. Lee, V. L. (1996). Things done. Revista Mexicana de Analisis de la Conducta, 22, 137-158.
42. Luce, R. D. (1959). Individual choice behavior: A theoretical analysis. New York: Wiley.
43. Mackintosh, N. J. (1983). Conditioning and associative learning (Oxford Psychology Series, No. 3). Oxford: Clarendon Press.
44. Massaro, D. W. (1988). Some criticisms of connectionist models of human performance. Journal of Memory and Language, 27, 213-234.
45. Meazzini, P., & Ricci, C. (1986). Molar vs. molecular units of behavior. In T. Thompson & M. D. Zeiler (Eds.), Analysis and integration of behavioral units (pp. 19-43). Hillsdale, NJ: Erlbaum.
46. Mechner, F. (1959). A notational system for the description of behavioral procedures. Journal of the Experimental Analysis of Behavior, 2, 133-150.
47. Mechner, F. (1992). The revealed operant: A way to study the characteristics of individual occurrences of operant responses. Cambridge, MA: Cambridge Center for Behavioral Studies.
48. Millenson, J. R. (1967). Principles of behavior analysis. New York: MacMillan.
49. Monahan, G. E. (1982). A survey of partially observable Markov decision processes: Theory, models, and algorithms. Management Science, 28, 1-16.
50. Narendra, K. S., & Thathachar, M. A. L. (1989). Learning automata: An introduction. Englewood Cliffs, NJ: Prentice Hall.
51. Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.
52. Norman, D. A. (1993). Cognition in the head and in the world: An introduction to the special issue on situated action. Cognitive Science, 17, 1-16.
53. Norman, J. M. (1975). Elementary dynamic programming. London: Edward Arnold.
54. Rescorla. R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning: Vol. 2. Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
55. Roth, A. E., & Erev, I. (1995). Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term. Games and Economic Behavior. 8, 164-212.
56. SAS Institute. (1996). SAS/IML® [Computer software]. Cary, NC: Author.
57. Schmajuk, N. A., Lamoureux, J. A., & Holland, P. C. (1998). Occasion setting: A neural network approach. Psychological Review, 105, 3-32.
58. Shavelson, R. J., Webb, N. M., & Rowley, G. L. (1989). Generalizability theory. American Psychologist, 44, 922-932.
59. Shull, R. L. (1979). The postreinforcement pause: Some implications for the correlational law of effect. In M. D. Zeiler & P. Harzem (Eds.), Advances in analysis of behaviour: Vol. 1. Reinforcement and the organization of behaviour (pp. 194-221). Chichester, England: Wiley.
60. Shull, R. L. (1991). Mathematical description of operant behavior: An introduction. In I. H. Iversen & K. A. Lattal (Eds.), Techniques in the behavioral and neural sciences: Vol. 6. Experimental analysis of behavior (Part 2, pp. 243-282). Amsterdam: Elsevier.
61. Shull, R. L. (1995). Interpreting cognitive phenomena: Review of Donahoe and Palmer's Learning and Complex Behavior. Journal of the Experimental Analysis of Behavior, 63, 347-358.
62. Singh, S. P., Jaakola, T., & Jordan, M. I. (1994). Learning without state-estimation in partially observable Markovian decision processes. In W. W. Cohen & H. Hirsh (Eds.), Proceedings of the 11th International Conference on Machine Learning (pp. 284-292). San Francisco: Morgan Kaufmann.
63. Skinner, B. F. (1950). Are theories of learning necessary? Psychological Review, 54, 193-216.
64. Skinner, B. F. (1984a). Methods and theories in the experimental analysis of behavior. Behavioral and Brain Sciences, 7, 511-546.
65. Skinner, B. F. (1984b). Reply to Harnad. Behavioral and Brain Sciences, 7, 721-724.
66. Skinner, B. F. (1988a). Methods and theories in the experimental analysis of behavior. In A. C. Catania & S. Harnad (Eds.), The selection of behavior: The operant behaviorism of B. F. Skinner: Comments and consequences (pp. 77-105). Cambridge: Cambridge University Press.
67. Skinner, B. F. (1988b). Reply to Harnad. In A. C. Catania & S. Harnad (Eds.), The selection of behavior: The operant behaviorism of B. F. Skinner: Comments and consequences (pp. 468-473). Cambridge: Cambridge University Press.
68. Sondik, E. (1971). The optimal control of partially observable Markov processes. Unpublished doctoral dissertation, Stanford University, Stanford, CA.
69. Staddon, J. E. R. (1988). Quasi-dynamic choice models: Melioration and ratio invariance. Journal of the Experimental Analysis of Behavior, 49, 303-320.
70. Staddon, J. E. R., & Zhang, Y. (1991). On the assignment-of-credit problem in operant learning. In M. L. Commons, S. Grossberg, & J. E. R. Staddon (Eds.), Neural network models of conditioning and action: A volume in the quantitative analyses of behavior series (pp. 279-293). Hillsdale, NJ: Erlbaum.
71. Steinhauer, G. D. (1986). Artificial behavior: Computer simulation of psychological processes. Englewood Cliffs, NJ: Prentice Hall.
72. Suchman, L. (1993). Response to Vera and Simon's situated action: A symbolic interpretation. Cognitive Science, 17, 71-75.
73. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
74. Vera, A. H., & Simon, H. A. (1993a). Situated action: A symbolic interpretation. Cognitive Science, 17, 7-48.
75. Vera, A. H., & Simon, H. A. (1993b). Situated action: Reply to William Clancey. Cognitive Science, 17, 117-133.
76. Weingarten, K., & Mechner, F. (1966). The contingency as an independent variable of social interaction. In T. Verhave (Ed.), The experimental analysis of behavior: Selected readings (pp. 447-459). New York: Appleton-Century-Crofts.
77. Weiss, A. P. (1924). Behaviorism and behavior, I. Psychological Review, 31, 32-50.
78. Weiss, A. P. (1925). A theoretical basis of human behavior. Columbus, OH: R. G. Adams.
79. Wittgenstein, L. (1953). Philosophical investigations (G. E. M. Anscombe, Trans.). New York: MacMillan.