Autonomous mobile acoustic relay positioning as a multi-armed bandit with switching costs

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2013, Pages 3368-3373

  Cheung, Mei Yi ^a   Leighton, Joshua ^a   Hover, Franz S ^a  

^a Massachusetts Institute of Technology Cambridge   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FIELD EXPERIMENT; GITTINS INDEX; GREEDY POLICY; MULTI ARMED BANDIT; RELAY POSITIONING; SHALLOW-WATER; SWITCHING COSTS; UNDERWATER ACOUSTIC COMMUNICATIONS;

COSTS; INTELLIGENT ROBOTS; STOCHASTIC SYSTEMS; UNDERWATER ACOUSTICS;

SWITCHING;

EID: 84893765224     PISSN: 21530858     EISSN: 21530866     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2013.6696836     Document Type: Conference Paper

References (21)

1. M. Chitre, S. Shahabudeen, and M. Stojanovic. Underwater acoustic communications and networking: Recent advances and future challenges. Marine Technology Society Journal, 42(1):103-116, 2008.
2. J. C. Preisig. Performance analysis of adaptive equalization for coherent acoustic communications in the time-varying ocean environment. Journal of the Acoustical Society of America, 118(1):263-278, 2005.
3. B. Tomasi, J. Preisig, G. B. Deane, and M. Zorzi. A study on the wide-sense stationarity of the underwater acoustic channel for noncoherent communication systems. 11th European Wireless Conference-Sustainable Wireless Technologies, pages 1-6, Apr. 2011.
4. J. B. Bowlin, J. L. Spiesberger, T. F. Duda, and L. E. Freitag. Ocean acoustical ray-tracing: Software Ray. 1992.
5. B. Tomasi, G. Zappa, K. McCoy, P. Casari, and M. Zorzi. Experimental study of the space-time properties of acoustic channels for underwater communications. In Proc. IEEE OCEANS, pages 1-9, May 2010.
6. M. Cheung, J. Leighton, and F. Hover. Multi-Armed bandit formulation for autonomous mobile acoustic relay adaptive positioning. In Proc. 2013 IEEE International Conference on Robotics and Automation (ICRA), to appear.
7. J. C. Gittins. Bandit Processes and Dynamic Allocation Indices. Journal of the Royal Statistical Society. Series B (Methodological), 41(2):148-177, 1979.
8. J. D. Holmes, W. M. Carey, J. F. Lynch, A. E. Newhall, and A. Kukulya. An autonomous underwater vehicle towed array for ocean acoustic measurements and inversions. In Proc. IEEE OCEANS-Europe, volume 2, pages 1058-1061, 2005.
9. J. S. Banks and R. K. Sundaram. Switching Costs and the Gittins index. Econometrica, 62(3):687-694, 1994.
10. M. Asawa and D. Teneketzis. Multi-Armed bandits with switching penalties. IEEE Transactions on Automatic Control, 41(3):328-348, 1996.
11. D. Bergemann and J. Välimäki. Stationary multi-choice bandit problems. Journal of Economic Dynamics and Control, 25(10):1585-1594, 2001.
12. F. Dusonchet and M.O. Hongler. Optimal hysteresis for a class of deterministic deteriorating two-Armed bandit problem with switching costs. Automatica, 39(11):1947-1955, 2003.
13. R. Agrawal, M. V. Hedge, and D. Teneketzis. Asymptotically efficient adaptive allocation rules for the multiarmed bandit problem with switching cost. IEEE Transactions on Automatic Control, 33(10):899-906, 1988.
14. J. Niño-Mora. A faster index algorithm and a computational study for bandits with switching costs. INFORMS Journal on Computing, 20(2):255-269, 2008.
15. T. Jun. A survey on the bandit problem with switching costs. De Economist, 152(4):513-541, 2004.
16. J. Vermorel and M. Mohri. Multi-Armed bandit algorithms and empirical evaluation. In Proc. 16th European Conference on Machine Learning (ECML), pages 437-448. Springer, 2005.
17. J. C. Gittins, R. Weber, and K. D. Glazebrook. Multi-Armed bandit allocation indices, volume 25. Wiley Online Library, 1989.
18. J. Niño Mora. Computing an index policy for bandits with switching penalties. In Proc. 2nd International Conference on Performance eval-uation methodologies and tools, ValueTools, pages 76:1-76:10. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 2007.
19. T. L. Lai and H. Robbins. Asymptotically efficient adaptive allocation rules. Advances in Applied Mathematics, 6(1):4-22, 1985.
20. P. Auer, N. Cesa-Bianchi, and P. Fischer. Finite-time Analysis of the Multiarmed Bandit Problem. Machine Learning, 47(2-3):235-256, 2002.
21. L. Freitag, M. Grund, S. Singh, J. Partan, P. Koski, and K. Ball. The WHOI micro-modem: an acoustic communications and navigation system for multiple platforms. In Proc. MTS/IEEE OCEANS, volume 2, pages 1086-1092, Sept. 2005.