Quantum reinforcement learning

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 5, 2008, Pages 1207-1220

  Dong, Daoyi ^a   Chen, Chunlin ^b   Li, Hanxiong ^c,d   Tarn, Txyh Jong ^e  

^a INSTITUTE OF SYSTEMS SCIENCE   (China)

^b NANJING UNIVERSITY   (China)

^c CENTRAL SOUTH UNIVERSITY   (China)

^d CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^e WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Collapse; Grover iteration; Probability amplitude; Quantum reinforcement learning (QRL); State superposition

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHLORINE COMPOUNDS; COMPUTATIONAL LINGUISTICS; LEARNING SYSTEMS; PROBABILITY; QUANTUM COMPUTERS; QUANTUM THEORY; RANDOM PROCESSES; REINFORCEMENT; REINFORCEMENT LEARNING; RISK ASSESSMENT;

COLLAPSE; COMPLEX PROBLEMS; GROVER ITERATION; MACHINE-LEARNING; OPTIMALITY; PROBABILITY AMPLITUDE; QUANTUM COMPUTATIONS; QUANTUM MEASUREMENTS; QUANTUM PARALLELISM; QUANTUM REINFORCEMENT LEARNING; QUANTUM REINFORCEMENT LEARNING (QRL); QUANTUM STATES; QUANTUM SUPERPOSITION STATE; SIMULATED EXPERIMENTS; STATE SUPERPOSITION; STATE SUPERPOSITION PRINCIPLE; UPDATING ALGORITHM;

EDUCATION;

ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BIOMIMETICS; COMPUTER SIMULATION; HUMAN; METHODOLOGY; QUANTUM THEORY; REINFORCEMENT;

ARTIFICIAL INTELLIGENCE; BIOMIMETICS; COMPUTER SIMULATION; HUMANS; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; QUANTUM THEORY; REINFORCEMENT (PSYCHOLOGY);

EID: 49049104480     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.925743     Document Type: Article

References (53)

1. R. Sutton and A. G. Barto, Reinforcement Learning: An Introduction Cambridge, MA: MIT Press, 1998.
2. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey," J. Artif. Intell. Res., vol. 4, pp. 237-287, 1996.
3. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
4. R. Sutton, "Learning to predict by the methods of temporal difference," Mach. Learn., vol. 3, no. 1, pp. 9-44, Aug. 1988.
5. C. Watkins and P. Dayan, "Q-learning," Mach. Learn., vol. 8, no. 3/4, pp. 279-292, 1992.
6. D. Vengerov, N. Bambos, and H. Berenji, "A fuzzy reinforcement learning approach to power control in wireless transmitters," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 4, pp. 768-778, Aug. 2005.
7. H. R. Beom and H. S. Cho, "A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learning," IEEE Trans. Syst., Man, Cybern., vol. 25, no. 3, pp. 464-477, Mar. 1995.
8. C. I. Connolly, "Harmonic functions and collision probabilities," Int. J. Rob. Res., vol. 16, no. 4, pp. 497-507, Aug. 1997.
9. W. D. Smart and L. P. Kaelbling, "Effective reinforcement learning for mobile robots," in Proc. IEEE Int. Conf. Robot. Autom., 2002, pp. 3404-3410.
10. T. Kondo and K. Ito, "A reinforcement learning with evolutionary state recruitment strategy for autonomous mobile robots control," Robot. Auton. Syst., vol. 46, no. 2, pp. 111-124, Feb. 2004.
11. M. Wiering and J. Schmidhuber, "HQ-learning," Adapt. Behav., vol. 6, no. 2, pp. 219-246, 1997.
12. A. G. Barto and S. Mahanevan, "Recent advances in hierarchical reinforcement learning," Discret. Event Dyn. Syst.: Theory Appl., vol. 13, no. 4, pp. 41-77, Oct. 2003.
13. R. Sutton, D. Precup, and S. Singh, "Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning," Artif. Intell., vol. 112, no. 1, pp. 181-211, Aug. 1999.
14. T. G. Dietterich, "Hierarchical reinforcement learning with the MAXQ value function decomposition," J. Artif. Intell. Res., vol. 13, pp. 227-303, 2000.
15. G. Theocharous, "Hierarchical learning and planning in partially observable Markov decision processes," Ph.D. dissertation, Michigan State Univ., East Lansing, MI, 2002.
16. A. J. Smith, "Applications of the self-organising map to reinforcement learning,"Neural Netw., vol. 15, no. 8/9, pp. 1107-1124, Oct. 2002.
17. P. Y. Glorennec and L. Jouffe, "Fuzzy Q-learning," in Proc. 6th IEEE Int. Conf. Fuzzy Syst., 1997, pp. 659-662.
18. S. G. Tzafestas and G. G. Rigatos, "Fuzzy reinforcement learning control for compliance tasks of robotic manipulators," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 1, pp. 107-113, Feb. 2002.
19. M. J. Er and C. Deng, "Online tuning of fuzzy inference systems using dynamic fuzzy Q-learning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 3, pp. 1478-1489, Jun. 2004.
20. C. L. Chen, H. X. Li, and D. Y. Dong, "Hybrid control for Robot Navigation: A hierarchical Q-learning algorithm," IEEE Robot. Autom. Mag., vol. 15, no. 2, pp. 37-47, Jun. 2008.
21. S. Whiteson and P. Stone, "Evolutionary function approximation for reinforcement learning," J. Mach. Learn. Res., vol. 7, pp. 877-917, Dec. 2006.
22. M. Kaya and R. Alhajj, "A novel approach to multiagent reinforcement learning: Utilizing OLAP mining in the learning process," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 4, pp. 582-590, Nov. 2005.
23. P. W. Shor, "Algorithms for quantum computation: Discrete logarithms and factoring," in Proc. 35th Annu. Symp. Found. Comput. Sci., 1994, pp. 124-134.
24. A. Ekert and R. Jozsa, "Quantum computation and Shor's factoring algorithm," Rev. Mod. Phys., vol. 68, no. 3, pp. 733-753, 1996.
25. L. K. Grover, "A fast quantum mechanical algorithm for database search," in Proc. 28th Annu. ACM Symp. Theory Comput., 1996, pp. 212-219.
26. L. K. Grover, "Quantum mechanics helps in searching for a needle in a haystack," Phys. Rev. Lett., vol. 79, no. 2, pp. 325-327, Jul. 1997.
27. L. M. K. Vandersypen, M. Steffen, G. Breyta, C. S. Yannoni, M. H. Sherwood, and I. L. Chuang, "Experimental realization of Shor's quantum factoring algorithm using nuclear magnetic resonance," Nature, vol. 414, no. 6866, pp. 883-887, Dec. 2001.
28. I. L. Chuang, N. Gershenfeld, and M. Kubinec, "Experimental implementation of fast quantum searching," Phys. Rev. Lett., vol. 80, no. 15, pp. 3408-3411, Apr. 1998.
29. J. A. Jones, "Fast searches with nuclear magnetic resonance computers," Science, vol. 280, no. 5361, p. 229, Apr. 1998.
30. J. A. Jones, M. Mosca, and R. H. Hansen, "Implementation of a quantum search algorithm on a quantum computer," Nature, vol. 393, no. 6683, pp. 344-346, May 1998.
31. P. G. Kwiat, J. R. Mitchell, P. D. D. Schwindt, and A. G. White, "Grover's search algorithm: An optical approach," J. Mod. Opt., vol. 47, no. 2/3, pp. 257-266, Feb. 2000.
32. M. O. Scully and M. S. Zubairy, "Quantum optical implementation of Grover's algorithm," Proc. Nat. Acad. Sci. USA, vol. 98, no. 17, pp. 9490-9493, Aug. 2001.
33. D. Ventura and T. Martinez, "Quantum associative memory," Inf. Sci. vol. 124, no. 1, pp. 273-296, May 2000.
34. A. Narayanan and T. Menneer, "Quantum artificial neural network architectures and components," Inf. Sci., vol. 128, no. 3/4, pp. 231-255, Oct. 2000.
35. S. Kak, "On quantum neural computing," Inf. Sci., vol. 83, no. 3, pp. 143-160, Mar. 1995.
36. N. Kouda, N. Matsui, H. Nishimura, and F. Peper, "Qubit neural network and its learning efficiency," Neural Comput. Appl., vol. 14, no. 2, pp. 114-121, Jul. 2005.
37. E. C. Behrman, L. R. Nash, J. E. Steck, V. G. Chandrashekar, and S. R. Skinner, "Simulations of quantum neural networks," Inf. Sci., vol. 128, no. 3, pp. 257-269, Oct. 2000.
38. G. G. Rigatos and S. G. Tzafestas, "Parallelization of a fuzzy control algorithm using quantum computation," IEEE Trans. Fuzzy Syst., vol. 10, no. 4, pp. 451-460, Aug. 2002.
39. M. Sahin, U. Atav, and M. Tomak, "Quantum genetic algorithm method in self-consistent electronic structure calculations of a quantum dot with many electrons," Int. J. Mod. Phys. C, vol. 16, no. 9, pp. 1379-1393, 2005.
40. T. Hogg and D. Portnov, "Quantum optimization," Inf. Sci., vol. 128, no. 3, pp. 181-197, Oct. 2000.
41. S. Naguleswaran and L. B. White, "Quantum search in stochastic planning," Proc. SPIE, vol. 5846, pp. 34-45, 2005.
42. D. Y. Dong, C. L. Chen, and Z. H. Chen, "Quantum reinforcement learning," in Proc. 1st Int. Conf. Natural Comput., 2005, vol. 3611, pp. 686-689.
43. J. Preskill, "Course information for Physics 229:[I#Advanced Mathematical Methods of Physics - Quantum Information and Computation Pasadena, CA: California Inst. Technol., 1998. [Online]. Available: http://www.theory, caltech.edu/people/preskill/ph229/
44. M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information. Cambridge, U.K.: Cambridge Univ. Press, 2000.
45. C.L. Chen, D. Y. Dong, and Z. H. Chen, "Quantum computation for action selection using reinforcement learning," Int. J. Quantum Inf., vol. 4, no. 6, pp. 1071-1083, 2006.
46. M. Boyer, G. Brassard, and P. Høyer, "Tight bounds on quantum searching," Fortschritte Der Physik - Progress of Physics, vol. 46, no. 45, pp. 493-506, Jun. 1998.
47. E. Even-Dar and Y. Mansour, "Learning rates for Q-learning," J. Mach. Learn. Res., vol. 5, pp. 1-25, Dec. 2003.
48. T. S. Dahl, M. J. Mataric, and G. S. Sukhatme, "Emergent robot differentiation for distributed multi-robot task allocation," in Proc. 7th Int. Symp. Distrib. Auton. Robotic Syst., 2004, pp. 191-200.
49. J. Vermorel and M. Mohri, "Multi-armed bandit algorithms and empirical evaluation," in Proc. ECML, 2005, vol. 3720, pp. 437-448.
50. M. Guo, Y. Liu, and J. Malec, "A new Q-learning algorithm based on the metropolis criterion," IEEE Trans. Syst., Man, Cybern. B, Cybern. vol. 34, no. 5, pp. 2140-2143, Oct. 2004.
51. D. Y. Dong, C. L. Chen, Z. H. Chen, and C. B. Zhang, "Quantum mechanics helps in learning for more intelligent robots," Chin. Phys. Lett. vol. 23, no. 7, pp. 1691-1694, Jul. 2006.
52. D. Y. Dong, C. L. Chen, C. B. Zhang, and Z. H. Chen, "Quantum robot: Structure, algorithms and applications," Robotica, vol. 24, no. 4, pp. 513-521, Jul. 2006.
53. P. Benioff, "Quantum robots and environments," Phys. Rev. A, Gen. Phys., vol. 58, no. 2, pp. 893-904, Aug. 1998.