Fight sample degeneracy and impoverishment in particle filters: A review of intelligent approaches

Expert Systems with Applications

Volumn 41, Issue 8, 2014, Pages 3944-3954

  Li, Tiancheng ^a   Sun, Shudong ^a   Sattar, Tariq Pervez ^b   Corchado, Juan Manuel ^c  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b LONDON SOUTH BANK UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF SALAMANCA   (Spain)

Author keywords

Artificial intelligence; Impoverishment; Machine learning; Markov Chain Monte Carlo; Particle filter; Sequential Monte Carlo

Indexed keywords

ANT COLONY OPTIMIZATION; ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; GENETIC ALGORITHMS; LEARNING SYSTEMS; MACHINE LEARNING; MARKOV CHAINS; PARTICLE SWARM OPTIMIZATION (PSO);

ARTIFICIAL INTELLIGENCE ALGORITHMS; COMPUTATIONAL REQUIREMENTS; IMPOVERISHMENT; MACHINE LEARNING APPROACHES; MARKOV CHAIN MONTE CARLO METHOD; MARKOV CHAIN MONTE-CARLO; PARTICLE FILTER; SEQUENTIAL MONTE CARLO;

MONTE CARLO METHODS;

EID: 84892589545     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2013.12.031     Document Type: Review

References (114)

1. Ahmed, M. O.; Bibalan, P. T.; Freitas, N.de & Fauvel, S. (2012). Decentralized, adaptive, look-ahead particle filtering. Computing Research Repository (CoRR). arXiv:1203.2394v1[stat.ML].
2. Akhtar, S.; Ahmad, A. R.; Abdel-Rahman, E. M.; Naqvi, T. (2011). A PSO accelerated immune particle filter for dynamic state estimation. In Proceedings of 2011 Canadian conference on computer and robot vision, (pp. 72-79).
3. C. Andrieu, A. Doucet, and R. Holenstein Particle Markov Chain Monte Carlo methods Journal of the Royal Statistical Society: Series B 72 2010 269 342
4. C. Andrieu, A. Doucet, S.S. Singh, and V. Tadic Particle methods for change detection, system identification, and control Proceedings of the IEEE 92 3 2004 423 438
5. I. Arasaratnam, and S. Haykin Cubature Kalman filters IEEE Transactions on Automatic Control 54 6 2009 1254 1269
6. M.S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking IEEE Transactions on Signal Processing 50 2 2002 174 188
7. A. Banerjee, and P. Burlina Efficient particle filtering via sparse Kernel density estimation IEEE Transactions on Image Processing 19 9 2010 2480 2490
8. T. Bengtsson, P. Bickel, and B. Li Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems IMS Collections 2 2008 316 334
9. P. Bickel, B. Li, and T. Bengtsson Sharp failure rates for the bootstrap particle filter in high dimensions B. Clarke, S. Ghosal, Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh vol. 3 2008 Institute of Mathematical Statistics 318 329
10. Bouten, L.; Van Handel, R.; James, M. R. (2006). An introduction to quantum filtering. arXiv:math/0601741.
11. Brandão, B. C.; Wainer, J.; Goldenstein, S. K. (2006). Subspace hierarchical particle filter. In Proceedings of the ninteenth Brazilian symposium on computer graphics and image processing (pp. 194-204).
12. M. Bray, E. Koller-Meier, and L. Van Gool Smart particle filtering for high-dimensional tracking Computer Vision and Image Understanding 106 1 2007 116 129
13. W. Caesarendra, G. Niu, and B.-S. Yang Machine condition prognosis based on sequential Monte Carlo method Expert Systems with Applications 37 3 2010 2412 2420
14. O. Cappé, S.J. Godsill, and E. Moulines An overview of existing methods and recent advances in sequential Monte Carlo Proceedings of the IEEE 95 5 2007 899 924
15. Ceranka, S.; Niedzwiecki, M. (2003). Application of particle filtering in navigation system for blind. In The seventh international symposium on signal processing and its applications (vol. 2, pp. 495-498).
16. C. Chang, and R. Ansari Kernel particle filter for visual tracking IEEE Signal Processing Letters 12 3 2005 242 245
17. T. Chen, T.B. Schön, H. Ohlsson, and L. Ljung Decentralized particle filter with arbitrary state decomposition IEEE Transactions on Signal Processing 59 2 2011 465 478
18. N. Chopin A sequential particle filter method for static models Biometrika 89 2002 539 552
19. S. Chris, T. Bengtsson, P. Bickel, and J. Anderson Obstacles to high-dimensional particle filtering Monthly Weather Review 136 2008 4629 4640
20. D.E. Clark, and J. Bell Multi-target state estimation and track continuity for the particle PHD filter IEEE Transactions on Aerospace and Electronic Systems 43 4 2007 1441 1452
21. J. Cornebise, É. Moulines, and J. Olsson Adaptive methods for sequential importance sampling with application to state space models Statistics and Computing 18 4 2008 461 480
22. N. de Freitas, R. Dearden, F. Hutter, R. Morales-Menéndez, J. Mutch, and D. Poole Diagnosis by a waiter and a Mars explorer Proceedings of the IEEE 92 3 2004 455 468
23. P. Del Moral Nonlinear filtering: Interacting particle solution Markov Process, Related Fields 2 1996 555 579
24. P. Del Moral, A. Doucet, and A. Jasra Sequential Monte Carlo samplers Journal of the Royal Statistical Society: Series B (Statistical Methodology) 68 3 2006 411 436
25. Deutscher, J.; Blake, A.; Reid, I. (2000). Articulated body motion capture by annealed particle filtering. In: Proceedings of the IEEE conference on computer vision and pattern recognition (vol. 2, pp. 126-133).
26. Djuric, P. M.; Lu, T.; Bugallo, M. F. (2007). Multiple particle filtering. In: Proceedings of the IEEE thirty second ICASSP (pp. III-1181-III-1184).
27. P.M. Djuric, J.H. Kotecha, J. Zhang, Y. Huang, T. Ghirmai, and M.F. Bugallo et al. Particle filtering IEEE Signal Processing Magazine 20 5 2003 19 38
28. R. Douc, and E. Moulines Limit theorems for weighted samples with applications to sequential Monte Carlo Annals of Statistics 36 5 2008 2344 2376
29. A. Doucet, M. Briers, and S. Sénécal Efficient block sampling strategies for sequential Monte Carlo Journal of Computational and Graphical Statistics 15 3 2006 693 711
30. A. Doucet, N. de Freitas, and N. Gordon Sequential Monte Carlo methods in practice 2001 Springer New York, NY, USA
31. Doucet, A.; Freitas, N. de, Murphy, K.; Russell, S. (2000). Rao-Blackwellised particle filtering for dynamic Bayesian networks. In Proceedings of the sixteenth conference on uncertainty in artificial intelligence, (vol. 2, no. 2, pp. 176-183).
32. A. Doucet, S. Godsill, and C. Andrieu On sequential Monte Carlo sampling methods for Bayesian filtering Statistics and Computing 10 2000 197 208
33. A. Doucet, and A.M. Johansen A tutorial on particle filtering and smoothing: Fifteen years later E.D. Crisan, B. Rozovsky, Handbook of Nonlinear Filtering 2009 Oxford University Press Oxford
34. D. Fox Adapting the sample size in particle filters through KLD-sampling The International Journal of Robotics Research 22 12 2003 985 1003
35. D. Freund, P. Burlina, A. Banerjee, and E. Justin Comparison of Kernel based PDF estimation methods Proceedings of the SPIE 7335 2009 8 14
36. A. Gasparri, S. Panzieri, F. Pascucci, and G. Ulivi Monte Carlo filter in mobile robotics localization: A clustered evolutionary point of view Journal of Intelligent & Robotic Systems 47 2 2006 155 174
37. W.R. Gilks, and C. Berzuini Following a moving target-Monte Carlo inference for dynamic Bayesian models Journal of the Royal Statistical Society: Series B 63 part 1 2001 127 146
38. W.R. Gilks, S. Richardson, and D.J. Spiegelhalter Markov chain Monte Carlo in practice 1996 Chapman & Hall London, U.K.
39. A. Gning, B. Ristic, L. Mihaylova, and F. Abdallah An introduction to box particle filtering IEEE Signal Processing Magazine 30 4 2013 1 7
40. S.J. Godsill, and T. Clapp Improvement strategies for Monte Carlo particle filters A. Doucet, N. de Freitas, N. Gordon, Sequential Monte Carlo methods in practice 2001 Springer New York, NY, USA 139 158
41. N. Gordon, D. Salmond, and A. Smith Novel approach to nonlinear/non-Gaussian Bayesian state estimation IEEE Proceedings F Radar and Signal Processing 140 2 1993 107 113
42. F. Gustafsson Particle filter theory and practice with positioning applications IEEE Aerospace and Electronic Systems Magazine 25 7 2010 53 81
43. T. Higuchi Genetic algorithm and Monte Carlo filter Proceedings of the Institute of Statistical Mathematics 44 1 1996 19 30
44. M. Isard, and A. Blake Condensation - conditional density propagation for visual tracking International Journal of Computer Vision 29 1 1998 5 28
45. A. Jasra, A. Doucet, D.A. Stephens, and C.C. Holmes Interacting sequential Monte Carlo samplers for trans-dimensional simulation Computational Statistics & Data Analysis 52 4 2008 1765 1791
46. Johansen, A. M. (2006). Some non-standard sequential Monte Carlo methods and their applications (Ph.D. thesis). Cambridge, UK: University of Cambridge.
47. Kanazawa, K.; Koller, D.; Russel, S. (1995). Stochastic simulation algorithms for dynamic probabilistic networks. In Proceeding of eleventh conference on UAI, 1995 (pp. 346-351).
48. N. Kantas, A. Doucet, S.S. Singh, and J.M. Maciejowski An overview of sequential Monte Carlo methods for parameter estimation in general state-space models Engineering 44 Ml 2009 774 785
49. G. Kitagawa Monte-Carlo filter and smoother for non-Gaussian nonlinear state space models Journal of Computational and Graphical Statistics 1 1996 1 25
50. Koopman, S. J.; Lucas, A.; Scharth, M.; (2011). Numerically accelerated importance sampling for nonlinear non-Gaussian state space models. Available at SSRN: < http://ssrn.com/abstract=1790472 >.
51. G. Kootstra, and B. de Boer Tackling the premature convergence problem in Monte-Carlo localization Robotics and Autonomous Systems 57 11 2009 1107 1118
52. Z. Kostanjčar, B. Jeren, and J. Cerovec Particle filters in decision making problems under uncertainty AUTOMATIKA: Journal for Control, Measurement, Electronics, Computing and Communications 50 3-4 2009 245 251
53. Kwok, N. M.; Gu, F.; Zhou, W. (2005). Evolutionary particle filter: re-sampling from the genetic algorithm perspective. In 2005 IEEE/RSJ international conference on intelligent robots and systems (IROS 2005) (pp. 2935-2940).
54. Lee, H. S.; Lee, K. M. (2011). Mutiswarm particle filter for robust tracking under observation ambiguity. In Seventeenth Korea-Japan joint workshop on frontiers of computer vision (FCV 2011) (pp. 1-6).
55. Y. Li, H. Ai, T. Yamashita, S. Lao, and M. Kawade Tracking in low frame rate video: A cascade particle filter with discriminative observers of different life spans IEEE Transactions on Pattern Analysis and Machine Intelligence 30 10 2008 1728 1740
56. Li, T.; Sun, S. (2013). A gap between simulation and practice for recursive filters: On the state transition noise, Electronics Letters, submitted for publication, Preprint published on arXiv.org: http://arxiv.org/abs/1308. 1056.
57. Li, T.; Sun, S.; Duan, J. (2010). Monte Carlo localization for mobile robot using adaptive particle merging and splitting technique. In 2010 IEEE international conference on information and automation, Harbin, China (pp. 1913-1918).
58. Li, T.; Sattar, T. P.; Han, Q.; Sun, S. (2013). Roughening methods to prevent sample impoverishment in the particle PHD filter. In FUSION 2013, Istanbul Turkey (pp. 9-12).
59. Li, T.; Bolić, M.; Djurić, P. (2014). Resampling methods for particle filtering, accepted by IEEE Signal Processing Magazine, Dec. 2013. Preprint is available at https://sites.google.com/site/tianchengli85/ publications/current-work/preprint.
60. T. Li, T.P. Sattar, and S. Sun Deterministic resampling: Unbiased sampling to avoid sample impoverishment in particle filters Signal Processing 92 7 2012 1637 1645
61. T. Li, S. Sun, and T.P. Sattar Adapting sample size in particle filters through KLD-resampling Electronics Letters 46 12 2013 740 742
62. Lindsten, F.; Ohlsson, H. & Ljung, L. (2011). Clustering using sum-of-norms regularization; with application to particle filter output computation, Technical report from Automatic Control at Linköping University.
63. J. Liu, and R. Chen Blind deconvolution via sequential imputations Journal of the Royal Statistical Society: Series B 430 1995 567 576
64. J. Liu, R. Chen, and T. Logvinenko A theoretical framework for sequential importance sampling and resampling A. Doucet, N. de Freitas, N. Gordon, Sequential Monte Carlo Methods in Practice 2001 Springer New York, NY, USA 225 246
65. Z. Liu, Z. Shi, M. Zhao, and W. Xu Adaptive dynamic clustered particle filtering for mobile robots global localization Journal of Intelligent & Robotic Systems 53 2008 57 85
66. J. Liu, W. Wang, and F. Ma A regularized auxiliary particle filtering approach for system state estimation and battery life prediction Smart Materials and Structures 20 7 2011 1 9
67. J. Liu, and M. West Combined parameter and state estimation in simulation based filtering A. Doucet, N. de Freitas, N. Gordon, Sequential Monte Carlo Methods in Practice (Chapter 10) 2001 Springer New York, NY, USA
68. H.F. Lopes, and R.S. Tsay Particle filters and Bayesian inference in financial econometrics Journal of Forecasting 30 2011 168 209
69. R. Luo, B. Hong, and M. Li Coevolution based adaptive Monte Carlo localization Cutting Edge Robotics 2005 279 290
70. MacCormick, J.; Blake, A. (1999). A probabilistic exclusion principle for tracking multiple objects. In Proceedings of the seventh international conference on computer vision (pp. 572-578).
71. Maggio, E.; Cavallaro, A. (2005). Hybrid particle filter and mean shift tracker with adaptive transition model. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP '05) (vol. 2, pp. 221-224).
72. Martí, E.; García, J.; Molina, J. M. (2011). Neighborhood-based regularization of proposal distribution for improving resampling quality in particle filters. In Proceedings of the fourteenth international conference on information fusion, Chicago, USA (pp. 1-8).
73. L. Mihaylova, A.Y. Carmi, F. Septier, A. Gning, S.K. Pang, and S. Godsill Overview of Bayesian sequential Monte Carlo methods for group and extended object tracking Digital Signal Processing 2014 10.1016/j.dsp.2013.11.006
74. Milstein, A.; Snchez, J. N. & Williamson, E. T. (2002). Robust global localization using clustered particle filtering. In Proceedings of the eighteenth national conference on artificial intelligence (pp. 581-586).
75. Murray, L. (2012). GPU acceleration of the particle filter: the Metropolis resampler. arXiv:1202.6163v1[stat.CO].
76. C. Musso, N. Oudjane, and F. Legland Improving regularized particle filters A. Doucet, N. de Freitas, N. Gordon, Sequential Monte Carlo methods in practice 2001 Springer New York, NY, USA 247 272
77. Naeem, A.; Pridmore, T.; Mills, S. (2007). Managing particle spread via hybrid particle filter/kernel mean shift tracking. In Proceedings of the British machine vision conference.
78. J.C. Neddermeyer Nonparametric particle filtering and smoothing with quasi-Monte Carlo sampling Journal of Statistical Computation and Simulation 81 11 2011 1361 1379
79. U. Orguner, and F. Gustafsson Risk-sensitive particle filters for mitigating sample impoverishment IEEE Transactions on Signal Processing 56 10 2008 5001 5012
80. J.J. Pantrigo, A. Sánchez, and A.S. Montemayor Combining particle filter and population-based metaheuristics for visual articulated motion tracking Electronic Letters on Computer Vision and Image Analysis 5 3 2005 68 83
81. J.J. Pantrigo, A. Sánchez, A.S. Montemayor, and A. Duarte Multi-dimensional visual tracking using scatter search particle filter Pattern Recognition Letters 29 2008 1160 1174
82. S. Park, J.P. Hwang, E. Kim, and H. Kang A new evolutionary particle filter for the prevention of sample impoverishment IEEE Transactions on Signal Processing 13 4 2009 801 809
83. M.K. Pitt, and N. Shephard Filtering via simulation: Auxiliary particle filter Journal of American Statistical Association 94 1999 590 599
84. M.N. Radford Annealed importance sampling Statistics and Computing 11 2 2001 125 139
85. C.E. Rasmussen, and Z. Ghahramani Bayesian Monte Carlo Advances in neural information processing systems vol. 15 2003 MIT Press Cambridge, MA
86. Rebeschini, P.; Van Handel, R. (2013). Can local particle filters beat the curse of dimensionality? arXiv:1301.6585v1.
87. B. Ristic, S. Arulampalam, and N. Gordon Beyond the Kalman filter: Particle filters for tracking applications 2004 Artech House
88. T. Schön, F. Gustafsson, and P.J. Nordlund Marginalized particle filters for mixed linear/nonlinear state-space models IEEE Transactions on Signal Processing 53 7 2005 2279 2289
89. Schubert, J.; Sidenbladh, H. (2005). Sequential clustering with particle filters-Estimating the number of clusters from data. In Proceedings of the eighth international conference on information fusion (FUSION 2005) (pp. 1-8).
90. Shan, C.; Wei, Y.; Ojardias, F. (2004). Real time hand tracking by combining particle filtering and mean shift. In: Proceedings of the sixth IEEE international conference on automatic face and gesture recognition (pp. 669-674).
91. A. Simonetto, and T. Keviczky Recent developments in distributed particle filtering: Towards fast and accurate algorithms Estimation and Control of Networked Systems 1 2009
92. K. Socha, and M. Dorigo Ant colony optimization for continuous domains European Journal of Operational Research 185 2008 1155 1173
93. F. Thomas, and S. Neil Learning and filtering via simulation: smoothly jittered particle filters ReCALL 2009 1 27
94. Thrun, S. (2002). Particle filters in robotics. In Proceedings of the eighteenth annual conference on uncertainty in AI (UAI), Edmonton, Canada (pp. 511-518).
95. Tong, G.; Fang, Z.; Xu, X. (2006). A particle swarm optimized particle filter for nonlinear system state estimation. In Proceedings of IEEE congress on evolutionary computation, Vancouver, Canada (pp. 438-442).
96. Torma, P. & Szepesvári, C. (2001). LS-N-IPS: An improvement of particle filters by means of local search. In Proceedings of non-linear control systems (NOLCOS'01), St. Petersburg, Russia.
97. P. Torma, and C. Szepesvári Combining local search, neural networks and particle filters to achieve fast and reliable contour tracking 2003 IEEE
98. K. Uosaki, Y. Kimura, and T. Hatanaka Nonlinear state estimation by evolution strategies based particle filters Proceedings of Congress on Evolutionary Computation 1 2004 884 890
99. P. Vadakkepat, and L. Jing Improved particle filter in sensor fusion for tracking randomly moving object IEEE Transaction on Instrumentation and Measurement 55 5 2006 1823 1832
100. Van Der Merwe R.; Doucet, A.; De Freitasz N.; Wan E. (2000). The unscented particle filter. Technical report CUED/F-INFENG/TR 380. Cambridge University Engineering Department.
101. P.J. Van Leeuwen Particle filtering in geophysical systems Monthly Weather Review 137 12 2009 4089 4114
102. P.J. van Leeuwen Nonlinear data assimilation in geosciences: An extremely efficient particle filter Quarterly Journal of the Royal Meteorological Society, Part B 136 653 2010 1991 1999
103. N. Vaswan Particle filtering for large-dimensional state space with multimodal observation likelihood IEEE Transactions on Signal Processing 56 10 2008 4583 4597
104. Wang, Q.; Xie, L.; Liu, J.; Xiang, Z. (2006). Enhancing particle swarm optimization based particle filter tracker. In ICIC 2006 (pp. 1216-1221).
105. N. Whiteley, and A.M. Johansen Auxiliary particle filtering: recent developments D. Barber, A.T. Cemgil, S. Chiappa, Bayesian time series models 2011 Cambridge University Press Cambridge 52 81
106. V. Winschel, and M. Krätzig Solving, estimating, and selecting nonlinear dynamic models without the curse of dimensionality Econometrica 78 2 2010 803 821
107. Wu, D.; Chen, J.; Wang, Y. (2009). Bring consciousness to mobile robot being localized. In Proceedings of the 2009 IEEE international conference on robotics and biomimetics (pp. 741-746).
108. B. Xu, J. Zhu, and H. Xu An ant stochastic decision based particle filter and its convergence Signal Processing 90 2010 2731 2748
109. Yang, T.; Aitken, V. (2005). Uniform clustered particle filtering for robot localization. In 2005 American control conference, Portland, OR, US (pp. 4607-4612).
110. M. Yin, J. Zhang, H. Sun, and W. Gu Multi-cue-based CamShift guided particle filter tracking Expert Systems with Applications 38 5 2011 6313 6318
111. Y. Yu, and X. Zheng Particle filter with ant colony optimization for frequency offset estimation in OFDM systems with unknown noise distribution Signal Processing 91 3 2011 1339 1342
112. Zhang, X.; Hu, W.; Maybank, S.; Li, X.; Zhu, M. (2008). Sequential particle swarm optimization for visual tracking. In Computer vision and pattern recognition (CVPR 2008), Anchorage AK (pp. 1-8).
113. J. Zhao, and Z. Li Particle filter based on particle warm optimization resampling for vision tracking Expert Systems with Applications 37 12 2010 8910 8914
114. J. Zhong, and Y.-F. Fung Case study and proofs of ant colony optimisation improved particle filter algorithm IET Control Theory and Applications 6 5 2012 689 697