Tug-of-war model for multi-armed bandit problem

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6079 LNCS, Issue , 2010, Pages 69-80

  Kim, Song Ju ^a,b   Aono, Masashi ^a,b   Hara, Masahiko ^a,b  

^a Flucto Order Functions Research Team   (South Korea)

^b Hanyang University   (South Korea)

Author keywords

Amoeba based computing; Bio inspired computation; Multi armed bandit problem; Reinforcement learning

Indexed keywords

ACCURACY RATE; AMOEBA-BASED COMPUTING; BIO-INSPIRED COMPUTATION; CONSERVATION LAW; ENVIRONMENTAL INFORMATION; GREEDY ALGORITHMS; MULTI-ARMED BANDIT PROBLEM; NONLOCAL CORRELATIONS; OPTIMAL STRATEGIES; PARALLEL SEARCH; PHYSARUM; SEARCH AGENTS; SLIME MOLD; VOLUME INCREMENT;

ALGORITHMS; DECISION MAKING;

STATISTICS;

EID: 79956331440     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-13523-1_10     Document Type: Conference Paper

References (21)

1. Nakagaki, T., Yamada, H., Toth, A.: Maze-solving by an amoeboid organism. Nature 407, 470 (2000).
2. Tero, A., Kobayashi, R., Nakagaki, T.: Physarum solver: A biologically inspired method of road-network navigation. Physica A 363, 115-119 (2006).
3. Nakagaki, T., Iima, M., Ueda, T., Nishiura, Y., Saigusa, T., Tero, A., Kobayashi, R., Showalter, K.: Minimum-risk path finding by an adaptive amoebal network. Phys. Rev. Lett. 99, 068104 (2007).
4. Saigusa, T., Tero, A., Nakagaki, T., Kuramoto, Y.: Amoebae anticipate periodic events. Phys. Rev. Lett. 100, 018101 (2008).
5. Aono, M., Hara, M., Aihara, K.: Amoeba-based neurocomputing with chaotic dynamics. Communications of the ACM 50(9), 69-72 (2007). (Pubitemid 47366815)
6. Aono, M., Hara, M.: Spontaneous deadlock breaking on amoeba-based neurocomputer. BioSystems 91, 83-93 (2008). (Pubitemid 350297567)
7. Aono, M., Hirata, Y., Hara, M., Aihara, K.: Amoeba-based chaotic neurocomputing: Combinatorial optimization by coupled biological oscillators. New Generation Computing 27, 129-157 (2009).
8. Aono, M., Hirata, Y., Hara, M., Aihara, K.: Resource-competing oscillator network as a model of amoeba-based neurocomputer. In: Calude, C.S., Costa, J.F., Dershowitz, N., Freire, E., Rozenberg, G. (eds.) UC 2009. LNCS, vol. 5715, pp. 56-69. Springer, Heidelberg (2009).
9. Kim, S.-J., Aono, M., Hara, M.: Tug-of-war model for two-bandit problem. In: Calude, C.S., Costa, J.F., Dershowitz, N., Freire, E., Rozenberg, G. (eds.) UC 2009. LNCS, vol. 5715, p. 289. Springer, Heidelberg (2009).
10. Kim, S.-J., Aono, M., Hara, M.: Tug-of-war model for the two-bandit problem: Nonlocally-correlated parallel exploration via resource conservation. BioSystems (to appear).
11. Robbins, H.: Some aspects of the sequential design of experiments. Bull. Amer. Math. Soc. 58, 527-536 (1952).
12. Thompson, W.: On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika 25, 285-294 (1933).
13. Gittins, J., Jones, D.: A dynamic allocation index for the sequential design of experiments. In: Gans, J. (ed.) Progress in Statistics, pp. 241-266. North Holland, Amsterdam (1974).
14. Gittins, J.: Bandit processes and dynamic allocation indices. J. R. Stat. Soc. B 41, 148-177 (1979).
15. Lai, T., Robbins, H.: Asymptotically efficient adaptive allocation rules. Advances in Applied Mathematics 6, 4-22 (1985).
16. Agrawal, R.: Sample mean based index policies with O(log n) regret for the multiarmed bandit problem. Adv. Appl. Prob. 27, 1054-1078 (1995).
17. Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Machine Learning 47, 235-256 (2002). (Pubitemid 34126111)
18. Vermorel, J., Mohri, M.: Multi-armed bandit algorithms and empirical evaluation. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L., et al. (eds.) ECML 2005. LNCS (LNAI), vol. 3720, pp. 437-448. Springer, Heidelberg (2005).
19. Sutton, R., Barto, A.: Reinforcement learning: An introduction. MIT Press, Cambridge (1998).
20. Daw, N., O'Doherty, J., Dayan, P., Seymour, B., Dolan, R.: Cortical substrates for exploratory decisions in humans. Nature 441, 876-879 (2006).
21. Cohen, J., McClure, S., Yu, A.: Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Phil. Trans. R. Soc. B 362 (1481), 933-942 (2007). (Pubitemid 47056820)