메뉴 건너뛰기




Volumn 89, Issue 2, 2012, Pages 77-85

The cognitive mechanisms of optimal sampling

Author keywords

Foraging; Matching law; Neural networks; Optimal sampling; Reinforcement learning; Rescorla Wagner model; Two armed bandit

Indexed keywords

ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COGNITION; LEARNING; NUMERICAL MODEL; OPTIMIZATION; SAMPLING; TRADE-OFF;

EID: 84856383116     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2011.10.004     Document Type: Article
Times cited : (11)

References (61)
  • 2
    • 67650169759 scopus 로고    scopus 로고
    • Dynamics of choice: relative rate and amount affect local preference at three different time scales
    • Aparicio C.F., Baum W.M. Dynamics of choice: relative rate and amount affect local preference at three different time scales. J. Exp. Anal. Behav. 2009, 91:293-317.
    • (2009) J. Exp. Anal. Behav. , vol.91 , pp. 293-317
    • Aparicio, C.F.1    Baum, W.M.2
  • 3
    • 0004870746 scopus 로고
    • A problem in the sequential design of experiments
    • Bellman R. A problem in the sequential design of experiments. Sankhya 1956, 16:221-229.
    • (1956) Sankhya , vol.16 , pp. 221-229
    • Bellman, R.1
  • 5
    • 0010819022 scopus 로고
    • On the design and comparison of certain dichotomous experiments
    • Bradt R.N., Karlin S. On the design and comparison of certain dichotomous experiments. Ann. Math. Stat. 1956, 27:390-409.
    • (1956) Ann. Math. Stat. , vol.27 , pp. 390-409
    • Bradt, R.N.1    Karlin, S.2
  • 6
    • 0001491619 scopus 로고
    • A mathematical model for simple learning
    • Bush R.R., Mosteller F. A mathematical model for simple learning. Psychol. Rev. 1951, 58:313-323.
    • (1951) Psychol. Rev. , vol.58 , pp. 313-323
    • Bush, R.R.1    Mosteller, F.2
  • 8
    • 0032541570 scopus 로고    scopus 로고
    • Episodic-like memory during cache recovery by scrub jays
    • Clayton N.S., Dickinson A. Episodic-like memory during cache recovery by scrub jays. Nature 1998, 395:272-274.
    • (1998) Nature , vol.395 , pp. 272-274
    • Clayton, N.S.1    Dickinson, A.2
  • 9
    • 34250348767 scopus 로고    scopus 로고
    • Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration
    • Cohen J.D., McClure S.M., Yu A.J. Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Proc. Royal Soc. B 2007, 362:933-942.
    • (2007) Proc. Royal Soc. B , vol.362 , pp. 933-942
    • Cohen, J.D.1    McClure, S.M.2    Yu, A.J.3
  • 10
    • 0002917988 scopus 로고
    • A comparative analysis of optimal foraging behavior: laboratory simulations
    • Garland, New York, A.C. Kamil, T.D. Sargent (Eds.)
    • Collier G.H., Rovee-Collier C.K. A comparative analysis of optimal foraging behavior: laboratory simulations. Foraging Behavior 1981, 39-76. Garland, New York. A.C. Kamil, T.D. Sargent (Eds.).
    • (1981) Foraging Behavior , pp. 39-76
    • Collier, G.H.1    Rovee-Collier, C.K.2
  • 11
    • 0000909101 scopus 로고
    • A model for selecting one of two medical treatments
    • Colton T. A model for selecting one of two medical treatments. J. Am. Stat. Assoc. 1963, 58:388-400.
    • (1963) J. Am. Stat. Assoc. , vol.58 , pp. 388-400
    • Colton, T.1
  • 13
    • 68949216971 scopus 로고    scopus 로고
    • Simple artificial neural networks that match probability and exploit and explore when confronting a multiarmed bandit
    • Dawson M.R.W., Dupuis B., Spetch M.L., Kelly D.M. Simple artificial neural networks that match probability and exploit and explore when confronting a multiarmed bandit. IEEE Trans. Neural Networks 2009, 20:1368-1371.
    • (2009) IEEE Trans. Neural Networks , vol.20 , pp. 1368-1371
    • Dawson, M.R.W.1    Dupuis, B.2    Spetch, M.L.3    Kelly, D.M.4
  • 14
    • 0002065902 scopus 로고
    • Foraging in a changing environment: simulations in the operant laboratory
    • Erlbaum, Hillsdale, NJ, M.L. Commons, A. Kacelnik, S.J. Shettleworth (Eds.)
    • Dow S.M., Lea S.E.G. Foraging in a changing environment: simulations in the operant laboratory. Quantitative Analyses of Behavior, vol. 6: Foraging 1987, 89-113. Erlbaum, Hillsdale, NJ. M.L. Commons, A. Kacelnik, S.J. Shettleworth (Eds.).
    • (1987) Quantitative Analyses of Behavior, vol. 6: Foraging , pp. 89-113
    • Dow, S.M.1    Lea, S.E.G.2
  • 15
    • 0345350436 scopus 로고
    • Sampling of schedule parameters by pigeons: tests of optimizing theory
    • Dow S.M., Lea S.E.G. Sampling of schedule parameters by pigeons: tests of optimizing theory. Anim. Behav. 1987, 35:102-114.
    • (1987) Anim. Behav. , vol.35 , pp. 102-114
    • Dow, S.M.1    Lea, S.E.G.2
  • 16
    • 26844491600 scopus 로고    scopus 로고
    • On adaptation, maximization, and reinforcement learning among cognitive strategies
    • Erev I., Barron G. On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychol. Rev. 2005, 112:912-931.
    • (2005) Psychol. Rev. , vol.112 , pp. 912-931
    • Erev, I.1    Barron, G.2
  • 17
    • 84980122105 scopus 로고
    • Preference and switching under concurrent scheduling
    • Findley J.D. Preference and switching under concurrent scheduling. J. Exp. Anal. Behav. 1958, 1:123-144.
    • (1958) J. Exp. Anal. Behav. , vol.1 , pp. 123-144
    • Findley, J.D.1
  • 18
    • 0000610739 scopus 로고
    • The opening of milk bottles by birds
    • Fisher J., Hinde R.A. The opening of milk bottles by birds. Br. Birds 1949, 42:347-357.
    • (1949) Br. Birds , vol.42 , pp. 347-357
    • Fisher, J.1    Hinde, R.A.2
  • 19
    • 84856382058 scopus 로고
    • Finite horizon behavior of policies for two-arm bandits
    • Fox B.L. Finite horizon behavior of policies for two-arm bandits. J. Am. Stat. Assoc. 1974, 69:963-965.
    • (1974) J. Am. Stat. Assoc. , vol.69 , pp. 963-965
    • Fox, B.L.1
  • 20
    • 0030266119 scopus 로고    scopus 로고
    • Reasoning the fast and frugal way: models of bounded rationality
    • Gigerenzer G., Goldstein D.G. Reasoning the fast and frugal way: models of bounded rationality. Psychol. Rev. 1996, 103:650-669.
    • (1996) Psychol. Rev. , vol.103 , pp. 650-669
    • Gigerenzer, G.1    Goldstein, D.G.2
  • 22
    • 27844539379 scopus 로고
    • Relative and absolute strengths of response as a function of frequency of reinforcement
    • Herrnstein R.J. Relative and absolute strengths of response as a function of frequency of reinforcement. J. Exp. Anal. Behav. 1961, 4:267-272.
    • (1961) J. Exp. Anal. Behav. , vol.4 , pp. 267-272
    • Herrnstein, R.J.1
  • 24
    • 84987278656 scopus 로고
    • Maximizing and matching on concurrent ratio schedules
    • Herrnstein R.J., Loveland D.H. Maximizing and matching on concurrent ratio schedules. J. Exp. Anal. Behav. 1975, 24:107-116.
    • (1975) J. Exp. Anal. Behav. , vol.24 , pp. 107-116
    • Herrnstein, R.J.1    Loveland, D.H.2
  • 26
    • 78650341484 scopus 로고    scopus 로고
    • Information search in decisions from experience: do our patterns of sampling foreshadow our decisions?
    • Hills T.T., Hertwig R. Information search in decisions from experience: do our patterns of sampling foreshadow our decisions?. Psychol. Sci. 2010, 21:1787-1792.
    • (2010) Psychol. Sci. , vol.21 , pp. 1787-1792
    • Hills, T.T.1    Hertwig, R.2
  • 27
    • 0001963988 scopus 로고
    • Some learning rules for acquiring information
    • Pitman, Boston, D.J. McFarland (Ed.)
    • Houston A.I., Kacelnik A., McNamara J. Some learning rules for acquiring information. Functional Ontogeny 1982, 140-191. Pitman, Boston. D.J. McFarland (Ed.).
    • (1982) Functional Ontogeny , pp. 140-191
    • Houston, A.I.1    Kacelnik, A.2    McNamara, J.3
  • 28
    • 84856399600 scopus 로고
    • Studies of foraging behaviour and time budgeting in great tits (Parus major)
    • Unpublished DPhil thesis, University of Oxford.
    • Kacelnik, A., 1979. Studies of foraging behaviour and time budgeting in great tits (Parus major). Unpublished DPhil thesis, University of Oxford.
    • (1979)
    • Kacelnik, A.1
  • 29
    • 0002476789 scopus 로고
    • Cache recovery and spatial memory in Clark's nutcrackers (Nucifraga columbiana)
    • Kamil A.C., Balda R.P. Cache recovery and spatial memory in Clark's nutcrackers (Nucifraga columbiana). J. Exp. Psychol. Anim. Behav. Proc. 1985, 11:95-111.
    • (1985) J. Exp. Psychol. Anim. Behav. Proc. , vol.11 , pp. 95-111
    • Kamil, A.C.1    Balda, R.P.2
  • 30
    • 0036862934 scopus 로고    scopus 로고
    • Bees in two-armed bandit situations: foraging choices and possible decision mechanisms
    • Keasar T., Rashkovich E., Cohen D., Shmida A. Bees in two-armed bandit situations: foraging choices and possible decision mechanisms. Behav. Ecol. 2002, 13:757-765.
    • (2002) Behav. Ecol. , vol.13 , pp. 757-765
    • Keasar, T.1    Rashkovich, E.2    Cohen, D.3    Shmida, A.4
  • 31
    • 0030476986 scopus 로고    scopus 로고
    • The rate of food processing in the oystercatcher: food intake and energy expenditure constrained by a digestive bottleneck
    • Kersten M., Visser W. The rate of food processing in the oystercatcher: food intake and energy expenditure constrained by a digestive bottleneck. Funct. Ecol. 1996, 10:440-448.
    • (1996) Funct. Ecol. , vol.10 , pp. 440-448
    • Kersten, M.1    Visser, W.2
  • 32
    • 0021284213 scopus 로고
    • Incentive theory: III. Adaptive clocks
    • Killeen P.R. Incentive theory: III. Adaptive clocks. Ann. N. Y. Acad. Sci. 1984, 423:515-527.
    • (1984) Ann. N. Y. Acad. Sci. , vol.423 , pp. 515-527
    • Killeen, P.R.1
  • 33
    • 34948834122 scopus 로고
    • Test of optimal sampling by foraging great tits
    • Krebs J.R., Kacelnik A., Taylor P. Test of optimal sampling by foraging great tits. Nature 1978, 275:27-31.
    • (1978) Nature , vol.275 , pp. 27-31
    • Krebs, J.R.1    Kacelnik, A.2    Taylor, P.3
  • 34
    • 0008631378 scopus 로고
    • Foraging and reinforcement schedules in the pigeon: optimal and non-optimal aspects of choice
    • Lea S.E.G. Foraging and reinforcement schedules in the pigeon: optimal and non-optimal aspects of choice. Anim. Behav. 1979, 27:875-886.
    • (1979) Anim. Behav. , vol.27 , pp. 875-886
    • Lea, S.E.G.1
  • 35
    • 84856387965 scopus 로고
    • Operant psychology and ethology: failures and successes in interdisciplinary interaction
    • Erlbaum, London, C.F. Lowe, M. Richelle, D.E. Blackman, C.M. Bradshaw (Eds.)
    • Lea S.E.G. Operant psychology and ethology: failures and successes in interdisciplinary interaction. Behaviour Analysis and Contemporary Psychology 1985, 43-51. Erlbaum, London. C.F. Lowe, M. Richelle, D.E. Blackman, C.M. Bradshaw (Eds.).
    • (1985) Behaviour Analysis and Contemporary Psychology , pp. 43-51
    • Lea, S.E.G.1
  • 36
    • 0021284185 scopus 로고
    • The integration of reinforcements over time
    • Lea S.E.G., Dow S.M. The integration of reinforcements over time. Ann. N. Y. Acad. Sci. 1984, 423:269-277.
    • (1984) Ann. N. Y. Acad. Sci. , vol.423 , pp. 269-277
    • Lea, S.E.G.1    Dow, S.M.2
  • 37
    • 0001608229 scopus 로고
    • On the optimal use of a patchy environment
    • MacArthur R.H., Pianka E.R. On the optimal use of a patchy environment. Am. Nat. 1966, 100:603-609.
    • (1966) Am. Nat. , vol.100 , pp. 603-609
    • MacArthur, R.H.1    Pianka, E.R.2
  • 39
    • 0026932735 scopus 로고
    • Choice behavior in transition: development of preference with ratio and interval schedules
    • Mazur J.E. Choice behavior in transition: development of preference with ratio and interval schedules. J. Exp. Psychol. Anim. Behav. Proc. 1992, 18:364-378.
    • (1992) J. Exp. Psychol. Anim. Behav. Proc. , vol.18 , pp. 364-378
    • Mazur, J.E.1
  • 40
    • 0000055553 scopus 로고
    • Optimal patch use in a stochastic environment
    • McNamara J. Optimal patch use in a stochastic environment. Theor. Popul. Biol. 1982, 21:269-288.
    • (1982) Theor. Popul. Biol. , vol.21 , pp. 269-288
    • McNamara, J.1
  • 41
    • 33746137396 scopus 로고    scopus 로고
    • Risk-prone behavior under rules which have evolved in a changing environment
    • McNamara J.M. Risk-prone behavior under rules which have evolved in a changing environment. Am. Zool. 1996, 36:484-495.
    • (1996) Am. Zool. , vol.36 , pp. 484-495
    • McNamara, J.M.1
  • 43
    • 0000748188 scopus 로고
    • The kinetics of choice: an operant systems analysis
    • Myerson J., Miezin F.M. The kinetics of choice: an operant systems analysis. Psychol. Rev. 1980, 87:160-174.
    • (1980) Psychol. Rev. , vol.87 , pp. 160-174
    • Myerson, J.1    Miezin, F.M.2
  • 44
    • 0017635796 scopus 로고
    • Optimal foraging in patches: case for stochasticity
    • Oaten A. Optimal foraging in patches: case for stochasticity. Theor. Popul. Biol. 1977, 12:263-285.
    • (1977) Theor. Popul. Biol. , vol.12 , pp. 263-285
    • Oaten, A.1
  • 45
    • 0023500493 scopus 로고
    • Oversampling by great tits: a critique of Krebs, Kacelnik, and Taylor's (1978) test of optimal sampling by great tits
    • Plowright C.M.S., Plowright R.C. Oversampling by great tits: a critique of Krebs, Kacelnik, and Taylor's (1978) test of optimal sampling by great tits. Can. J. Zool. 1987, 65:1282-1283.
    • (1987) Can. J. Zool. , vol.65 , pp. 1282-1283
    • Plowright, C.M.S.1    Plowright, R.C.2
  • 46
    • 0025763582 scopus 로고
    • Time horizon and choice by pigeons in a prey-selection task
    • Plowright C.M.S., Shettleworth S.J. Time horizon and choice by pigeons in a prey-selection task. Anim. Learn. Behav. 1991, 19:103-112.
    • (1991) Anim. Learn. Behav. , vol.19 , pp. 103-112
    • Plowright, C.M.S.1    Shettleworth, S.J.2
  • 47
    • 80051747788 scopus 로고    scopus 로고
    • Simultaneous discrimination reversal learning in pigeons and humans: anticipatory and perseverative errors
    • Rayburn-Reeves R.M., Molet M., Zentall T.R. Simultaneous discrimination reversal learning in pigeons and humans: anticipatory and perseverative errors. Learn. Behav. 2011, 39:125-137.
    • (2011) Learn. Behav. , vol.39 , pp. 125-137
    • Rayburn-Reeves, R.M.1    Molet, M.2    Zentall, T.R.3
  • 49
    • 0002109138 scopus 로고
    • A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement
    • Appleton-Century-Crofts, New York, A.H. Black, W.F. Prokasy (Eds.)
    • Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
    • (1972) Classical Conditioning II: Current Research and Theory , pp. 64-99
    • Rescorla, R.A.1    Wagner, A.R.2
  • 50
    • 38249022200 scopus 로고
    • Time horizons of pigeons on a two-armed bandit
    • Shettleworth S.J., Plowright C.M.S. Time horizons of pigeons on a two-armed bandit. Anim. Behav. 1989, 37:610-623.
    • (1989) Anim. Behav. , vol.37 , pp. 610-623
    • Shettleworth, S.J.1    Plowright, C.M.S.2
  • 51
    • 58149433367 scopus 로고
    • Rational choice and the structure of the environment
    • Simon H.A. Rational choice and the structure of the environment. Psychol. Rev. 1956, 63:129-138.
    • (1956) Psychol. Rev. , vol.63 , pp. 129-138
    • Simon, H.A.1
  • 52
    • 48949088164 scopus 로고    scopus 로고
    • Models of information use
    • Chicago University Press, Chicago, D.W. Stephens, J.S. Brown, R.C. Ydenberg (Eds.)
    • Stephens D.W. Models of information use. Foraging 2007, 31-58. Chicago University Press, Chicago. D.W. Stephens, J.S. Brown, R.C. Ydenberg (Eds.).
    • (2007) Foraging , pp. 31-58
    • Stephens, D.W.1
  • 54
    • 39049118861 scopus 로고    scopus 로고
    • Chicago University Press, Chicago, D.W. Stephens, J.S. Brown, R.C. Ydenberg (Eds.)
    • Foraging 2007, Chicago University Press, Chicago. D.W. Stephens, J.S. Brown, R.C. Ydenberg (Eds.).
    • (2007) Foraging
  • 56
    • 84965975198 scopus 로고
    • The three-spined stickleback and the two-armed bandit
    • Thomas G., Kacelnik A., Van Der Meulen J. The three-spined stickleback and the two-armed bandit. Behaviour 1985, 93:227-240.
    • (1985) Behaviour , vol.93 , pp. 227-240
    • Thomas, G.1    Kacelnik, A.2    Van Der Meulen, J.3
  • 57
    • 0001395850 scopus 로고
    • On the likelihood that one unknown probability exceeds another in view of the evidence of two samples
    • Thompson W.R. On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika 1933, 25:285-294.
    • (1933) Biometrika , vol.25 , pp. 285-294
    • Thompson, W.R.1
  • 58
    • 0000021971 scopus 로고
    • Principles of performance
    • Tolman E.C. Principles of performance. Psychol. Rev. 1955, 62:315-326.
    • (1955) Psychol. Rev. , vol.62 , pp. 315-326
    • Tolman, E.C.1
  • 59
    • 0026568024 scopus 로고
    • The role of satisficing in foraging theory
    • Ward D. The role of satisficing in foraging theory. Oikos 1992, 63:312-317.
    • (1992) Oikos , vol.63 , pp. 312-317
    • Ward, D.1
  • 60
    • 0031496254 scopus 로고    scopus 로고
    • A connectionist account of differences in gradient after discriminative and non-discriminative training
    • Wills A.J., McLaren I.P.L. A connectionist account of differences in gradient after discriminative and non-discriminative training. Q. J. Exp. Psychol. 1997, 50:607-630.
    • (1997) Q. J. Exp. Psychol. , vol.50 , pp. 607-630
    • Wills, A.J.1    McLaren, I.P.L.2
  • 61
    • 0025640637 scopus 로고
    • Digestive bottleneck limits the increase in food intake of whimbrels preparing to migrate from the Banc d'Arguin, Mauritania
    • Zwarts L., Dirksen S. Digestive bottleneck limits the increase in food intake of whimbrels preparing to migrate from the Banc d'Arguin, Mauritania. Ardea 1990, 78:257-278.
    • (1990) Ardea , vol.78 , pp. 257-278
    • Zwarts, L.1    Dirksen, S.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.