Nonsmooth Neural Network for Convex Time-Dependent Constraint Satisfaction Problems

IEEE Transactions on Neural Networks and Learning Systems

Volumn 27, Issue 2, 2016, Pages 295-307

  Di Marco, Mauro ^a   Forti, Mauro ^a   Nistri, Paolo ^a   Pancioni, Luca ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

Convex functions; finite Time convergence; nonsmooth (NS) neural networks; subdifferential; time dependent (TD) constraints.

Indexed keywords

CONSTRAINT THEORY; DYNAMICS; SIGNAL PROCESSING;

CONVEX FEASIBILITY; CONVEX FEASIBILITY PROBLEM; INEQUALITY CONSTRAINT; NON-DIFFERENTIABLE; PENALTY PARAMETERS; PROGRAMMING PROBLEM; TIME-DEPENDENT CONSTRAINTS; TIME-DEPENDENT NETWORKS;

CONSTRAINT SATISFACTION PROBLEMS;

EID: 84924559355     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2015.2404773     Document Type: Article

References (62)

1. D. W. Tank and J. J. Hopfield, "Simple neural optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit, " IEEE Trans. Circuits Syst., vol. 33, no. 5, pp. 533-541, May 1986.
2. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming, " IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
3. S. Zang and A. G. Constantinides, "Lagrange programming neural networks, " IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 39, no. 7, pp. 441-452, Jul. 1992.
4. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. Chichester, U.K.: Wiley, 1993.
5. M. Forti and A. Tesi, "New conditions for global stability of neural networks with application to linear and quadratic programming problems, " IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 42, no. 7, pp. 354-366, Jul. 1995.
6. Y. Xia and J. Wang, "A general methodology for designing globally convergent optimization neural networks, " IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1331-1343, Nov. 1998.
7. X. Hu and J. Wang, "Solving pseudomonotone variational inequalities and pseudoconvex optimization problems using the projection neural network, " IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1487-1499, Nov. 2006.
8. Z. Zeng and J. Wang, "Improved conditions for global exponential stability of recurrent neural networks with time-varying delays, " IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 623-635, May 2006.
9. L. Cheng, Z.-G. Hou, and M. Tan, "A delayed projection neural network for solving linear variational inequalities, " IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 915-925, Jun. 2009.
10. Y. Xia, G. Feng, and J. Wang, "A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints, " IEEE Trans. Neural Netw., vol. 19, no. 8, pp. 1340-1353, Aug. 2008.
11. D. Guo and Y. Zhang, "Zhang neural network for online solution of time-varying linear matrix inequality aided with an equality conversion, " IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 2, pp. 370-382, Feb. 2014.
12. Y. Xia, "A compact cooperative recurrent neural network for computing general constrained L1 norm estimators, " IEEE Trans. Signal Process., vol. 57, no. 9, pp. 3693-3697, Sep. 2009.
13. M. Forti, P. Nistri, and M. Quincampoix, "Generalized neural network for nonsmooth nonlinear programming problems, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 9, pp. 1741-1754, Sep. 2004.
14. Q. Liu and J. Wang, "A one-layer projection neural network for nonsmooth optimization subject to linear equalities and bound constraints, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 812-824, May 2013.
15. G. Li, Z. Yan, and J. Wang, "A one-layer recurrent neural network for constrained nonsmooth invex optimization, " Neural Netw., vol. 50, pp. 79-89, Feb. 2014.
16. M. Forti, P. Nistri, and M. Quincampoix, "Convergence of neural networks for programming problems via a nonsmooth Lojasiewicz inequality, " IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1471-1486, Nov. 2006.
17. W. Bian and X. Chen, "Neural network for nonsmooth, nonconvex constrained minimization via smooth approximation, " IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 3, pp. 545-556, Mar. 2014.
18. D. Wang and L. Huang, "Periodicity and global exponential stability of generalized Cohen-Grossberg neural networks with discontinuous activations and mixed delays, " Neural Netw., vol. 51, pp. 80-95, Mar. 2014.
19. W. Bian and X. Xue, "Neural network for solving constrained convex optimization problems with global attractivity, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 60, no. 3, pp. 710-723, Mar. 2013.
20. Q. Liu and J. Wang, "A one-layer recurrent neural network for constrained nonsmooth optimization, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 5, pp. 1323-1333, Oct. 2011.
21. Q. Liu and J. Wang, "A one-layer recurrent neural network with a discontinuous hard-limiting activation function for quadratic programming, " IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 558-570, Apr. 2008.
22. X. Hu and J. Wang, "Design of general projection neural networks for solving monotone linear variational inequalities and linear and quadratic optimization problems, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 5, pp. 1414-1421, Oct. 2007.
23. K. Yuan and J. Cao, "An analysis of global asymptotic stability of delayed Cohen-Grossberg neural networks via nonsmooth analysis, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 52, no. 9, pp. 1854-1861, Sep. 2005.
24. W. Bian and X. Chen, "Smoothing neural network for constrained non-Lipschitz optimization with applications, " IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 399-411, Mar. 2012.
25. L. Cheng, Z.-G. Hou, Y. Lin, M. Tan, W. C. Zhang, and F.-X. Wu, "Recurrent neural network for non-smooth convex optimization problems with application to the identification of genetic regulatory networks, " IEEE Trans. Neural Netw., vol. 22, no. 5, pp. 714-726, May 2011.
26. S. Qin, W. Bian, and X. Xue, "A new one-layer recurrent neural network for nonsmooth pseudoconvex optimization, " Neurocomputing, vol. 120, pp. 655-662, Nov. 2013.
27. R. Klein, "Project scheduling with time-varying resource constraints, " Int. J. Prod. Res., vol. 38, no. 16, pp. 3937-3952, 2000.
28. B.-S. Kang, G.-J. Park, and J. S. Arora, "A review of optimization of structures subjected to transient loads, " Struct. Multidisciplinary Optim., vol. 31, no. 2, pp. 81-95, Feb. 2006.
29. H.-K. Chen, C.-F. Hsueh, and M.-S. Chang, "The real-Time timedependent vehicle routing problem, " Transp. Res. E, Logistics Transp. Rev., vol. 42, no. 5, pp. 383-408, Sep. 2006.
30. N. Kuschel and R. Rackwitz, "Optimal design under time-variant reliability constraints, " Struct. Safety, vol. 22, no. 2, pp. 113-127, Jun. 2000.
31. H. E. Doran and A. N. Rambaldi, "Applying linear time-varying constraints to econometric models: With an application to demand systems, " J. Econometrics, vol. 79, no. 1, pp. 83-95, Jul. 1997.
32. F. Belkhouche, "Reactive path planning in a dynamic environment, " IEEE Trans. Robot., vol. 25, no. 4, pp. 902-911, Aug. 2009.
33. B. C. Dean, "Algorithms for minimum-cost paths in time-dependent networks with waiting policies, " Networks, vol. 44, no. 1, pp. 41-46, Aug. 2004.
34. E. Bertolazzi, F. Biral, and M. Da Lio, "Real-Time motion planning for multibody systems: Real life application examples, " Multibody Syst. Dyn., vol. 17, nos. 2-3, pp. 119-139, Apr. 2007.
35. K. P. Tee, B. Ren, and S. S. Ge, "Control of nonlinear systems with time-varying output constraints, " Automatica, vol. 47, no. 11, pp. 2511-2516, Nov. 2011.
36. M. Tagmouti, M. Gendreau, and J.-Y. Potvin, "Arc routing problems with time-dependent service costs, " Eur. J. Oper. Res., vol. 181, no. 1, pp. 30-39, Aug. 2007.
37. H. E. Doran, "Estimation under exact linear time-varying constraints, with an application to population projections, " J. Forecast., vol. 15, no. 7, pp. 527-541, Dec. 1996.
38. X. Yi, C. H. Tan, C. K. Slew, and M. R. Syed, "Fast encryption for multimedia, " IEEE Trans. Consum. Electron., vol. 47, no. 1, pp. 101-107, Feb. 2001.
39. Z. Wan and M. V. Kothare, "Efficient robust constrained model predictive control with a time varying terminal constraint set, " Syst. Control Lett., vol. 48, no. 5, pp. 375-383, Apr. 2003.
40. M. Kunze and M. D. P. Monteiro Marques, "An introduction to Moreaus sweeping process, " in Impacts in Mechanical Systems (Lecture Notes in Physics), B. Brogliato, Ed. Berlin, Germany: Springer-Verlag, 2000.
41. J. P. Aubin and A. Cellina, Differential Inclusions. Berlin, Germany: Springer-Verlag, 1984.
42. J.-B. Hiriart-Urruty and C. Lemaréchal, Convex Analysis and Minimization Algorithms I: Fundamentals. Berlin, Germany: Springer-Verlag, 1996.
43. M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Generalized Lyapunov approach for convergence of neural networks with discontinuous or non-Lipschitz activations, " Phys. D, Nonlinear Phenomena, vol. 214, no. 1, pp. 88-99, Feb. 2006.
44. J.-P. Aubin and H. Frankowska, Set-Valued Analysis. Boston, MA, USA: Birkhäuser, 1990.
45. M. D. Wills, "Hausdorff distance and convex sets, " J. Convex Anal., vol. 14, no. 1, pp. 109-117, 2007.
46. M. Di Marco, M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Lyapunov method and convergence of the full-range model of CNNs, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 55, no. 11, pp. 3528-3541, Dec. 2008.
47. R. T. Rockafellar, "On the maximality of sums of nonlinear monotone operators, " Trans. Amer. Math. Soc., vol. 149, no. 1, pp. 75-88, May 1970.
48. Y. Zhang, D. Jiang, and J. Wang, "A recurrent neural network for solving Sylvester equation with time-varying coefficients, " IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1053-1063, Sep. 2002.
49. Y. Zhang and S. S. Ge, "Design and analysis of a general recurrent neural network model for time-varying matrix inversion, " IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1477-1490, Nov. 2005.
50. J. J. Moreau, "Evolution problem associated with a moving convex set in a Hilbert space, " J. Differ. Equ., vol. 26, no. 3, pp. 347-374, Dec. 1977.
51. J. J. Moreau, "Numerical aspects of the sweeping process, " Comput. Methods Appl. Mech. Eng., vol. 177, nos. 3-4, pp. 329-349, Jul. 1999.
52. G. Colombo, R. Henrion, N. D. Hoang, and B. S. Mordukhovich, "Optimal control of the sweeping process, " Dyn. Continuous, Discrete, Impuls. Syst. Ser. B, Appl. Algorithms, vol. 19, nos. 1-2, pp. 117-159, 2012.
53. J.-S. Pang and D. E. Stewart, "Differential variational inequalities, " Math. Program., Ser. A, vol. 113, no. 2, pp. 345-424, Jun. 2008.
54. J. F. Edmond and L. Thibault, "BV solutions of nonconvex sweeping process differential inclusion with perturbation, " J. Differ. Equ., vol. 226, no. 1, pp. 135-179, Jul. 2006.
55. H. H. Bauschke and J. M. Borwein, "On projection algorithms for solving convex feasibility problems, " SIAM Rev., vol. 38, no. 3, pp. 367-426, Sep. 1996.
56. P. L. Combettes and P. Bondon, "Hard-constrained inconsistent signal feasibility problems, " IEEE Trans. Signal Process., vol. 47, no. 9, pp. 2460-2468, Sep. 1999.
57. M. R. Gholami, H. Wymeersch, E. G. Ström, and M. Rydström, "Wireless network positioning as a convex feasibility problem, " EURASIP J. Wireless Commun. Netw., vol. 2011, no. 1, p. 161, Nov. 2011. [Online]. Available: doi:10.1186/1687-1499-2011-161
58. J. Montagnat and H. Delingette, "4D deformable models with temporal constraints: Application to 4D cardiac image segmentation, " Med. Image Anal., vol. 9, no. 1, pp. 87-100, Feb. 2005.
59. V. Bhatawadekar, D. Fehr, V. Morellas, and N. Papanikolopoulos, "A dynamic sensor placement algorithm for dense sampling, " in Proc. 14th Int. Conf. Inf. Fusion (FUSION), Chicago, IL, USA, Mar. 2011, pp. 1-7.
60. Y. Tang, W. Li, D. Ma, X. Zhang, and J. Wei, "Worst-case robust masked beamforming for secure broadcasting, " in Proc. IEEE Wireless Commun. Netw. Conf. (WCNC), Shanghai, China, Apr. 2013, pp. 4186-4191.
61. G. De Sandre, M. Forti, P. Nistri, and A. Premoli, "Dynamical analysis of full-range cellular neural networks by exploiting differential variational inequalities, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, no. 8, pp. 1736-1749, Aug. 2007.
62. L. Chisci, A. Garulli, and G. Zappa, "Recursive state bounding by parallelotopes, " Automatica, vol. 32, no. 7, pp. 1049-1055, Jul. 1996.