Consensus-based distributed cooperative learning from closed-loop neural control systems

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 2, 2015, Pages 331-345

  Chen, Weisheng ^a   Hua, Shaoyong ^a   Zhang, Huaguang ^b  

^a XIDIAN UNIVERSITY   (China)

^b NORTHEASTERN UNIVERSITY   (China)

Author keywords

Communication topology; consensus; distributed cooperative learning (DCL); neural network (NN); nonlinear system

Indexed keywords

CLOSED LOOP CONTROL SYSTEMS; NONLINEAR SYSTEMS; OPTIMAL SYSTEMS; TOPOLOGY;

ADAPTIVE NEURAL CONTROL; COMMUNICATION TOPOLOGIES; CONSENSUS; COOPERATIVE LEARNING; DETERMINISTIC LEARNING; GENERALIZATION CAPABILITY; NEURAL NETWORK (NN); UNCERTAIN NONLINEAR SYSTEMS;

COOPERATIVE COMMUNICATION;

ALGORITHM; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; CONSENSUS; INTERPERSONAL COMMUNICATION; LEARNING; NONLINEAR SYSTEM; UNCERTAINTY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMMUNICATION; CONSENSUS; LEARNING; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; UNCERTAINTY;

EID: 84921486723     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2315535     Document Type: Article

References (58)

1. F. J. Doyle, R. K. Pearson, and B. A. Ogunnaike, Identification and Control Using Volterra Models. London, U.K.: Springer-Verlag, 2002.
2. W. Khalil and E. Dombre, Modeling, Identification and Control of Robots. London, U.K.: Butterworth, 2004.
3. J. N. Juang and M. Q. Phan, Nonlinear Identification and Control: A Neural Network Approach. London, U.K.: Cambridge Univ. Press, 2001.
4. L. X. Wang, Adaptive Fuzzy Systems and Control: Design and Stability Analysis. Englewood Cliffs, NJ, USA: Prentice-Hall, 1994.
5. J. X. Xu and Y. Tan, "Nonlinear adaptive wavelet control using constructive wavelet networks," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 115-127, Jan. 2007.
6. S. S. Ge, C. C. Hang, T. H. Lee, and T. Zhang, Stable Adaptive Neural Network Control. Boston, MA, USA: Kluwer, 2001.
7. C. Wang and D. J. Hill, "Learning from neural control," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 130-146, Jan. 2006.
8. C. Wang, D. J. Hill, and G. Chen, "Deterministic learning of nonlinear dynamical systems," in Proc. 18th IEEE Int. Symp. Intell. Control, Oct. 2003, pp. 87-92.
9. C. Wang and D. J. Hill, "Deterministic learning and rapid dynamical pattern recognition," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 617-630, May 2007.
10. C. Wang and D. J. Hill, "Rapid detection of small oscillation faults via deterministic learning," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1284-1296, Aug. 2011.
11. Z. Yuan and C. Wang, "Persistency of excitation and performance of deterministic learning," Syst. Control Lett., vol. 60, no. 12, pp. 952-959, 2011.
12. C. Wang and D. J. Hill, Deterministic Learning Theory for Identification, Recognition, and Control. London, U.K.: CRC Press, 2009.
13. A. Jadbabaie, J. Lin, and A. S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," IEEE Trans. Autom. Control, vol. 48, no. 6, pp. 988-1001, Jun. 2003.
14. T. Vicsek, A. Czirok, E. Ben-Jacob, I. Cohen, and O. Shochet, "Novel type of phase transition in a system of self-driven particles," Phys. Rev. Lett., vol. 75, no. 6, pp. 1226-1229, 1995.
15. R. Olfati-Saber, J. A. Fax, and R. M. Murray, "Consensus and cooperation in networked multi-agent systems," Proc. IEEE, vol. 95, no. 1, pp. 215-233, Jan. 2007.
16. W. Ren, R. W. Beard, and E. M. Atkins, "Information consensus in multivehicle cooperative control," IEEE Control Syst. Mag., vol. 27, no. 2, pp. 71-82, Apr. 2007.
17. W. Ren and Y. C. Cao, Distributed Coordination of Multi-Agent Networks. London, U.K.: Springer-Verlag, 2011.
18. M. Mesbahi and M. Egerstedt, Graph Theoretic Methods in Multiagent Networks. New York, NY, USA: Princeton Univ. Press, 2010.
19. Z. H. Qu, Cooperative Control of Dynamical Systems. London, U.K.: Springer-Verlag, 2009.
20. M. M. Polycarpou, "Stable adaptive neural control scheme for nonlinear systems," IEEE Trans. Autom. Control, vol. 41, no. 3, pp. 447-451, Mar. 1996.
21. D. Wang and J. Huang, "Neural network-based adaptive dynamic surface control for a class of uncertain nonlinear systems in strict-feedback form," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 195-202, Jan. 2005.
22. T. Zhang, S. S. Ge, and C. C. Hang, "Adaptive neural network control for strict-feedback nonlinear systems using backstepping design," Automatica, vol. 36, no. 12, pp. 1835-1846, 2000.
23. S. S. Ge, F. Hong, and T. H. Lee, "Adaptive neural control of nonlinear time-delay systems with unknown virtual control coefficients," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 499-516, Feb. 2004.
24. C. Hua, X. Guan, and P. Shi, "Robust output feedback tracking control for time-delay nonlinear systems using neural network," IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 495-505, Mar. 2007.
25. Z. H. Peng, D. Wang, H. W. Zhang, and G. Sun, "Distributed neural network control for adaptive synchronization of uncertain dynamical multiagent systems," IEEE Trans. Neural Netw. Learn. Syst., doi:10.1109/TNNLS.2013.2293499, 2013.
26. Y. J. Liu, C. L. P. Chen, G. X. Wen, and S. C. Tong, "Adaptive neural output feedback tracking control for a class of uncertain discretetime nonlinear systems," IEEE Trans. Neural Netw., vol. 22, no. 7, pp. 1162-1167, Jul. 2011.
27. M. Chen and S. S. Ge, "Robust adaptive neural network control for a class of uncertain MIMO nonlinear systems with input nonlinearities," IEEE Trans. Neural Netw., vol. 21, no. 5, pp. 796-812, May 2010.
28. T. S. Li, S. C. Tong, and G. G. Feng, "A novel robust adaptive-fuzzytracking control for a class of nonlinear multi-input/multi-output systems," IEEE Trans. Fuzzy Syst., vol. 18, no. 1, pp. 150-160, Feb. 2010.
29. S. Jagannathan, "Control of a class of nonlinear discrete-time system using multilayer neural networks," IEEE Trans. Neural Netw., vol. 12, no. 5, pp. 1113-1120, Sep. 2001.
30. C. Yang, S. S. Ge, C. Xiang, T. Y. Chai, and T. H. Lee, "Output feedback NN control for two classes of discrete-time systems with unknown control directions in a unified approach," IEEE Trans. Neural Netw., vol. 19, no. 11, pp. 1873-1886, Nov. 2008.
31. Y. J. Liu, S. C. Tong, D. Wang, T. S. Li, and C. Chen, "Adaptive neural output feedback controller design with reduced-order observer for a class of uncertain nonlinear SISO systems," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1328-1334, Aug. 2011.
32. A. P. Mitchell and A. D. J. Kenneth, "A cooperative coevolutionary approach to function optimization," in Proc. 3rd Parallel Problem Solving Nature, vol. 866. 1994, pp. 249-257.
33. M. Dorigo and L. M. Gambardella, "Ant colony system: A cooperative learning approach to the traveling salesman problem," IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 53-66, Apr. 1997.
34. R. C. Eberhart and J. Kennedy, "A new optimizer using particle swarm theory," in Proc. 6th Int. Symp. Micro Mach. Human Sci., 1995, pp. 39-43.
35. A. Nedic, A. Olshevsky, A. Ozdaglar, J. N. Tsitsiklis, and D. S. Bernstein, "On distributed averaging algorithms and quantization effects," IEEE Trans. Autom. Control, vol. 54, no. 11, pp. 2506-2517, Nov. 2009.
36. S. Kar and J. M. F. Moura, "Distributed consensus algorithms in sensor networks: Quantized data and random link failures," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1383-1400, Mar. 2010.
37. P. Frasca, R. Carli, F. Fagnani, and S. Zampieri, "Average consensus on networks with quantized communication," Int. J. Robust Nonlinear Control, vol. 19, no. 16, pp. 1787-1816, 2009.
38. J. Mei, W. Ren, and G. Ma, "Distributed coordinated tracking with a dynamic leader for multiple Euler-Lagrange systems," IEEE Trans. Autom. Control, vol. 56, no. 6, pp. 1415-1421, Jun. 2011.
39. J. Mei, W. Ren, and G. Ma, "Distributed containment control for Lagrangian networks with parametric uncertainties under a directed graph," Automatica, vol. 48, no. 4, pp. 653-659, 2012.
40. R. Olfati-Saber, "Flocking for multi-agent dynamic systems: Algorithms and theory," IEEE Trans. Autom. Control, vol. 51, no. 3, pp. 401-420, Mar. 2006.
41. F. Cucker and S. Smale, "Emergent behavior in flocks," IEEE Trans. Autom. Control, vol. 52, no. 5, pp. 852-862, May 2007.
42. A. Abdessameud and A. Tayebi, "Decentralized attitude alignment control of spacecraft within a formation without angular velocity measurements," in Proc. 17th World Congr. Int. Federation Autom. Control, 2008, pp. 1766-1771.
43. J. Cortes, S. Martinez, and F. Bullo, "Robust rendezvous for mobile autonomous agents via proximity graphs in arbitrary dimensions," IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1289-1298, Aug. 2006.
44. Z. G. Hou, L. Cheng, M. Tan, and X. Wang, "Distributed adaptive coordinated control of multi-manipulator systems using neural networks," in Robot Intelligence. London, U.K.: Springer-Verlag, 2010, pp. 49-69.
45. W. Chen, C. Wen, S. Hua, and C. Sun, "Distributed cooperative adaptive identification and control for a group of continuous-time systems with a cooperative PE condition via consensus," IEEE Trans. Autom. Control, vol. 59, no. 1, pp. 91-106, Jan. 2014.
46. R. Agaev and P. Chebotarev, "The matrix of maximum out forests of a digraph and its applications," Autom. Remote Control, vol. 61, no. 9, pp. 1424-1450, 2000.
47. A. J. Laub, Matrix Analysis for Scientists and Engineers. Philadelphia, PA, USA: SIAM, 2005.
48. E. Panteley, A. Loría, and A. Teel, "Relaxed persistency of excitation for uniform asymptotic stability," IEEE Trans. Autom. Control, vol. 46, no. 12, pp. 1874-1886, Dec. 2001.
49. A. J. Kurdila, F. J. Narcowich, and J. D. Ward, "Persistence of excitation in identification using radial basis function approximants," SIAM J. Control Optim., vol. 33, no. 2, pp. 625-642, 1995.
50. J. P. Desai, J. P. Ostrowski, and V. Kumar, "Modeling and control of formations of nonholonomic mobile robots," IEEE Trans. Robot. Autom., vol. 17, no. 6, pp. 905-908, Dec. 2001.
51. H. K. Khalil, Nonlinear Systems, 3rd ed. Upper Saddle River, NJ, USA: Prentice-Hall, 2002.
52. A. Loría, "Explicit convergence rates for MRAC-type systems," Automatica, vol. 40, no. 8, pp. 1465-1468, 2004.
53. T. Liu, C. Wang, and D. J. Hill, "Learning from neural control of nonlinear systems in normal form," Syst. Control Lett., vol. 58, no. 9, pp. 633-638, 2009.
54. C. Wang, W. Ming, T. Liu, and D. J. Hill, "Learning from ISS-modular adaptive NN control of nonlinear strict-feedback systems," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 10, pp. 1539-1550, Oct. 2012.
55. A. N. Njah and U. E. Vincent, "Chaos synchronization between single and double wells Duffing-Van der Pol oscillators using active control," Chaos Solitons Fractals, vol. 37, no. 5, pp. 1356-1361, 2008.
56. A. Loría and E. Panteley, "Uniform exponential stability of linear timevarying systems: Revisited," Syst. Control Lett., vol. 47, no. 1, pp. 13-24, 2002.
57. Y. Zhang, P. Ioannou, and C. Chien, "Parameter convergence of a new class of adaptive controllers," IEEE Trans. Autom. Control, vol. 41, no. 10, pp. 1489-1493, Oct. 1996.
58. M. Jankovic, "Adaptive output feedback control of non-linear feedback linearizable systems," Int. J. Adapt. Control Signal Process., vol. 10, no. 1, pp. 1-18, 1996.