Adaptive learning by a target-tracking system

International Journal of Intelligent Computing and Cybernetics

Volumn 1, Issue 1, 2008, Pages 46-68

  Lockery, Daniel ^a   Peters, James F ^a  

^a UNIVERSITY OF MANITOBA   (Canada)

Author keywords

Behaviour; Biology; Intelligent agents; Robots; Tracking

Indexed keywords

EID: 84986082157     PISSN: 1756378X     EISSN: 17563798     Source Type: Journal    
DOI: 10.1108/17563780810857121     Document Type: Article

References (24)

1. Jaakkola, T., Jordan, M.I. and Singh, S.P. (1994), “Convergence of stochastic iterative dynamic programming algorithms”, Neural Computation, Vol. 6, pp. 1185-201.
2. Kaelbling, L.P., Littman, M.L. and Moore, A.W. (1996), “Reinforcement learning: a survey”, Journal of Artificial Intelligence Research, Vol. 4, pp. 237-48.
3. Knudsen, B. (2006), CC5X C Compiler, B. Knudsen Data, available at: www.bknd.com/cc5x/index.shtml.
4. Linux (2003), Linux RedHat 9.0 Manuals, available at: www.redhat.com/docs/manuals/linux/RHL-9-Manual/ (accessed 1 February 2007).
5. Lockery, D. (2007), “Learning with ALiCE II”, MSc thesis, Electrical and Computer Engineering, University of Manitoba, Manitoba.
6. Microchip Technology Inc. (2006), MPLAB Integrated Development Environment, Microchip Technology Inc., Chandler, AZ, available at: www.microchip.com.
7. Orlowska, E. (1982), Semantics of Vague Concepts. Applications of Rough Sets, Report 469, Institute for Computer Science, Polish Academy of Sciences, Warszawa.
8. Orlowska, E. (1985), Semantics of Vague Concepts, In: Dorn, G. and Weingartner, P. (Eds) Foundations of Logic and Linguistics. Problems and Solutions, Plenum Press, London, pp. 465-82.
9. Pawlak, Z. (1981), Classification of Objects by Means of Attributes, Report 429, Institute for Computer Science, Polish Academy of Sciences, Warszawa, March.
10. Peters, J.F. (2005), “Rough ethology: toward a biologically-inspired study of collective behaviour in intelligent systems with approximation spaces”, Transactions on Rough Sets III, Springer LNCS 3400, Berlin, pp. 153-74.
11. Peters, J.F., Henry, C. and Gunderson, D.S. (2006a), “Biologically-inspired approximate adaptive learning control strategies: a rough set approach”, International Journal of Hybrid Intelligent Systems, Vol. 3, pp. 1-14.
12. Peters, J.F., Henry, C. and Ramanna, S. (2005), “Rough Ethograms: study of intelligent system behaviour”, in K_lopotek, M.A., Wierzcho'n, S. and Trojanowski, K. (Eds), New Trends in Intelligent Information Processing and Web Mining (IIS05), pp. 17-126.
13. Peters, J.F., Borkowski, M., Henry, C., Lockery, D., Gunderson, D. and Ramanna, S. (2006b), “Line-crawling bots that inspect electric power transmission line equipment”, Proc. 3rd Int. Conf. on Autonomous Robots and Agents (ICARA 2006), pp. 39-44.
14. Press, W.H., Teukolsky, S.A., Vetterling, W.T. and Flannery, B.P. (2002), Numerical Recipes in C++: The Art of Scientific Computing, 2nd ed., Cambridge University Press, Cambridge, pp. 278-90.
15. Rummery, G.A. and Niranjan, M. (1994), “On-line Q-learning using connectionist systems”, Technical Report CUED/F-INFENG/TR 166, Engineering Department, Cambridge University, Cambridge, September.
16. Selfridge, O.G. (1984), “Some themes and primitives in ill-defined systems”, in Selfridge, O.G., Rissland, E.L. and Arbib, M.A. (Eds), Adaptive Control of Ill-defined Systems, Plenum Press, London.
17. Singh, S.P. and Sutton, R.S. (1996), “Reinforcement learning with replacing eligibility traces”, Machine Learning, Vol. 22, pp. 123-58.
18. Singh, S.P., Jaakkola, T., Littman, M.L. and Szepesvari, C. (2000), “Convergence results for single-step on-policy reinforcement-learning algorithms”, Machine Learning, Vol. 38 No. 3, pp. 287-308.
19. Sutton, R.S. (1996), “Generalization in reinforcement learning: successful examples using sparse coarse coding”, Advances in Neural Information Processing Systems, Vol. 8, The MIT Press, Cambridge, MA, pp. 1038-44.
20. Sutton, R.S. and Barto, A.G. (1998), Reinforcement Learning: An Introduction, The MIT Press, Cambridge, MA.
21. Sutton, R.S., Barto, A.G. and Anderson, C.W. (1983), “Neuronlike adaptive elements that can solve difficult learning problems”, IEEE Transactions on Systems, Man, and Cybernetics, Vol. SMC-13 No. 5, pp. 834-47.
22. Tinbergen, N. (1963), “On aims and methods of ethology”, Zeitschrift f'ur Tierpsychologie, Vol. 20, pp. 410-33.
23. Watkins, C.J.C.H. (1989), “Learning from delayed rewards”, PhD thesis, King's College, Cambridge University, Cambridge, supervisor: Richard Young.
24. Watkins, C.J.C.H. and Dayan, P. (1992), “Technical note: Q-learning”, Machine Learning, Vol. 8, pp. 279-92.