A hybrid probabilistic neural model for person tracking based on a ceiling-mounted camera

Journal of Ambient Intelligence and Smart Environments

Volumn 3, Issue 3, 2011, Pages 237-252

  Yan, Wenjie ^a   Weber, Cornelius ^a   Wermter, Stefan ^a  

^a UNIVERSITY OF HAMBURG   (Germany)

Author keywords

neural network; particle filter; Person detection; person recognition

Indexed keywords

LIVING SYSTEMS; NEURAL MODELS; PARTICLE FILTER; PERSON DETECTION; PERSON RECOGNITION; PERSON TRACKING; SHORT TERM MEMORY; SIDE VIEW; TRACKING SYSTEM;

CAMERAS; COMPUTER VISION; DISTRIBUTED COMPUTER SYSTEMS; NAVIGATION; NONLINEAR FILTERING; TARGET TRACKING;

NETWORK ARCHITECTURE;

EID: 79960764931     PISSN: 18761364     EISSN: None     Source Type: Journal    
DOI: 10.3233/AIS-2011-0111     Document Type: Article

References (62)

1. Sony interaction laboratory. http://www.sonycsl.co.jp/IL/. Date accessed: 30. November, 2010.
2. OECD demographic and labour force database, Technical report, Organisation for economic co-operation and development, 2007.
3. E. Aarts and B. Eggen, Ambient Intelligence in Homelab, Philips Research, 2002.
4. E. Aarts, R. Harwig, and M. Schuurmans, Ambient Intelligence, The Invisible Future: The Seamless Integration of Technology into Everyday Life, McGraw-Hill, Inc., New York, NY, 2001.
5. S. Bahadori, L. Iocchi, G. Leone, D. Nardi, and L. Scozzafava, Real-time people localization and tracking through fixed stereo vision, Applied Intelligence 26 (2007), 83-97. 10.1007/s10489-006-0013-3. (Pubitemid 46384916)
6. T.S. Barger, D.E. Brown, and M. Alwan, Health-status monitoring through analysis of behavioral patterns, IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 35(1) (January 2005), 22-27. (Pubitemid 40085383)
7. G. Bauer and P. Lukowicz, Developing a sub room level indoor location system for wide scale deployment in assisted living systems, in: Computers Helping People with Special Needs, K. Miesenberger, J. Klaus, W. Zagler, and A. Karshmer, eds, Lecture Notes in Computer Science, Vol. 5105, Springer, Berlin /Heidelberg, 2008, pp. 1057-1064. 10.1007/978-3-540-70540-6-158.
8. H. Bay, T. Tuytelaars, and L. Van Gool, Surf: Speeded up robust features, in: Computer Vision-ECCV 2006, A. Leonardis, H. Bischof, and A. Pinz, eds, Lecture Notes in Computer Science, Vol. 3951, Springer, Berlin /Heidelberg, 2006, pp. 404-417. 10.1007/11744023-32. (Pubitemid 44029795)
9. K. Bernardin, T. Gehrig, and R. Stiefelhagen, Multi-level particle filter fusion of features and cues for audio-visual person tracking, in: Multimodal Technologies for Perception of Humans, R. Stiefelhagen, R. Bowers, and J. Fiscus, eds, Lecture Notes in Computer Science, Vol. 4625, Springer, Berlin /Heidelberg, 2008, pp. 70-81. 10.1007/978-3-540-68585-2-5.
10. M. Broxvall, M. Gritti, A. Saffiotti, B.S. Seo, and Y.J. Cho, PEIS Ecology: integrating robots into smart environments, in: Proc. of the IEEE International Conference on Robotics and Automation, 2006. ICRA 2006, May 2006, pp. 212-218. (Pubitemid 44940077)
11. D. Comaniciu, V. Ramesh, and P. Meer, Real-time tracking of non-rigid objects using mean shift, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, Los Alamitos, CA, USA, IEEE Computer Society, 2000, pp. 2142-2150.
12. J. Czyz, B. Ristic, and B. Macq, A particle filter for joint detection and tracking of color objects, Image and Vision Computing 25(8) (2007), 1271-1281. (Pubitemid 46779018)
13. D. Fox, S. Thrun, W. Burgard, and F. Dellaert, Particle filters for mobile robot localization, in: Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, eds, Springer-Verlag, 2001, pp. 499-516.
14. S. Frintrop, A. Königs, F. Hoeller, and D. Schulz, A component-based approach to visual person tracking from a mobile platform, International Journal of Social Robotics 2 (2010), 53-62. 10.1007/s12369-009-0035-1.
15. D. Gouaillier, V. Hugel, P. Blazevic, C. Kilner, J. Monceaux, P. Lafourcade, B. Marnier, J. Serre, and B. Maisonnier, Mechatronic design of nao humanoid, in: IEEE International Conference on Robotics and Automation, 2009. ICRA '09, May 2009, pp. 769-774.
16. P.J. Green, Reversible jump Markov chain Monte Carlo computation and Bayesian model determination, Biometrika 82(4) (1995), 711.
17. C. Harris and M. Stephens, A combined corner and edge detector, in: Alvey Vision Conference, Vol. 15, Manchester, UK, 1988, p. 50.
18. F. Hecht, P. Azad, and R. Dillmann, Markerless human motion tracking with a flexible model and appearance learning, in: IEEE International Conference on Robotics and Automation, 2009. ICRA '09, May 2009, pp. 3173-3179.
19. J.M. Hootman and C.G. Helmick, Projections of US prevalence of arthritis and associated activity limitations, Arthritis & Rheumatism 54(1) (2006), 226-229. (Pubitemid 43122205)
20. A. Howard, Multi-robot simultaneous localization and mapping using particle filters, The International Journal of Robotics Research 25(12) (2006), 1243.
21. M.K. Hu, Visual pattern recognition by moment invariants, IRE Transactions on Information Theory 8(2) (February 2002), 179-187.
22. A. Hyvärinen and E. Oja, Independent component analysis: Algorithms and applications, Neural Networks 13(4-5) (2000), 411-430. (Pubitemid 30447427)
23. L. Itti, C. Koch, and E. Niebur, A model of saliency-based visual attention for rapid scene analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11) (November 1998), 1254-1259. (Pubitemid 128742001)
24. I. Jolliffe, Principal Component Analysis, John Wiley & Sons, Ltd, 2005.
25. L.P. Kaelbling, M.L. Littman, and A.R. Cassandra, Planning and acting in partially observable stochastic domains, Artificial Intelligence 101(1-2) (1998), 99-134. (Pubitemid 128387390)
26. K. Kemmotsu, Y. Koketsua, and M. Iehara, Human behavior recognition using unconscious cameras and a visible robot in a network robot system, Robotics and Autonomous Systems 56(10) (2008), 857-864.
27. B. Keni and S. Rainer, Evaluating multiple object tracking performance: The CLEAR MOT metrics, EURASIP Journal on Image and Video Processing 2008 (2008), 10.
28. S.M. Khan and M. Shah, Tracking multiple occluding people by localizing on multiple scene planes, IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (2009), 505-519.
29. A. Khotanzad and J.H. Lu, Classification of invariant image representations using a neural network, IEEE Transactions on Acoustics, Speech and Signal Processing 38(6) (June 2002), 1028-1038.
30. C. Kidd, R. Orr, G. Abowd, C. Atkeson, I. Essa, B. Mac-Intyre, E. Mynatt, T. Starner, and W. Newstetter, The aware home: A living laboratory for ubiquitous computing research, in: Cooperative Buildings. Integrating Information, Organizations, and Architecture, N. Streitz, J. Siegel, V. Hartkopf, and S. Konomi, eds, Lecture Notes in Computer Science, Vol. 1670, Springer, Berlin /Heidelberg, 1999, pp. 191-198. 10.1007/10705432-17.
31. M. Kobilarov, G. Sukhatme, J. Hyams, and P. Batavia, People tracking and following with mobile robot using an omnidirectional camera and a laser, in: Proc. of the IEEE International Conference on Robotics and Automation, 2006. ICRA 2006, May 2006, pp. 557-562. (Pubitemid 44940132)
32. J. Koch, J. Wettach, E. Bloch, and K. Berns, Indoor localisation of humans, objects, and mobile robots with RFID infrastructure, in: 7th International Conference on Hybrid Intelligent Systems, 2007. HIS 2007, Vol. 0, LosAlamitos,CA, USA, IEEE Computer Society, 2007, pp. 271-276.
33. O. Lanz and R. Brunelli, An appearance-based particle filter for visual tracking in smart rooms, in: Multimodal Technologies for Perception of Humans, R. Stiefelhagen, R. Bowers, and J. Fiscus, eds, Lecture Notes in Computer Science, Vol. 4625, Springer, Berlin /Heidelberg, 2008, pp. 57-69. 10.1007/978-3-540-68585-2-4.
34. A. Louloudi, A. Mosallam, N. Marturi, P. Janse, and V. Hernandez, Integration of the humanoid robot nao inside a smart home: A case study, in: The Swedish AI Society Workshop, Uppsala University, May 2010. http://www.ep.liu. se/ecp/048/008/.
35. D.G. Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision 60 (2004), 91-110. 10.1023/B:VISI. 0000029664.99615.94.
36. M. Mercimek, K. Gulez, and T.V. Mumcu, Real object recognition using moment invariants, Sadhana 30 (2005), 765-775. 10.1007/BF02716709. (Pubitemid 43106082)
37. R. Muñoz-Salinas, E. Aguirre, and M. García-Silvente, People detection and tracking using stereo vision and color, Image and Vision Computing 25(6) (2007), 995-1007. (Pubitemid 46528595)
38. H. Nait-Charif and S.J. McKenna, Activity summarisation and fall detection in a supportive home environment, in: Proc. of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004, Vol. 4, August 2004, pp. 323-326.
39. J. Nehmer, M. Becker, A. Karshmer, and R. Lamm, Living assistance systems: an ambient intelligence approach, in: Proc. of the 28th International Conference on Software Engineering, ICSE '06, New York, NY, USA, ACM, 2006, pp. 43-50. (Pubitemid 46600901)
40. K. Nickel, T. Gehrig, R. Stiefelhagen, and J. McDonough, A joint particle filter for audio-visual speaker tracking, in: Proc. of the 7th International Conference on Multimodal Interfaces, ICMI '05, New York, NY, USA, ACM, 2005, pp. 61-68. (Pubitemid 43218863)
41. S.K. Pal and S. Mitra, Multilayer perceptron, fuzzy sets, and classification, IEEE Transactions on Neural Networks 3(5) (September 1992), 683-697. (Pubitemid 23555783)
42. P. Perez, C. Hue, J. Vermaak, and M. Gangnet, Color-based probabilistic tracking, in: Computer Vision-ECCV 2002, A. Heyden, G. Sparr, M. Nielsen, and P. Johansen, eds, Lecture Notes in Computer Science, Vol. 2350, Springer, Berlin /Heidelberg, 2002, pp. 661-675. 10.1007/3-540-47969-4-44.
43. M. Piccardi, Background subtraction techniques: A review, in: 2004 IEEE International Conference on Systems, Man and Cybernetics, Vol. 4, 2004, pp. 3099-3104. (Pubitemid 40408308)
44. Y. Qian, G. Medioni, and I. Cohen, Multiple target tracking using spatio-temporal markov chain Monte Carlo data association, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR '07, June 2007, pp. 1-8.
45. D. Ramanan, D.A. Forsyth, and A. Zisserman, Tracking people by learning their appearance, IEEE Transactions on Pattern Analysis and Machine Intelligence 29 (2007), 65-81. (Pubitemid 46415946)
46. Y. Raoui, M. Goller, M. Devy, T. Kerscher, J.M. Zollner, R. Dillmann, and A. Coustou, RFID-based topological and metrical self-localization in a structured environment, in: International Conference on Advanced Robotics, ICAR 2009, 2009, pp. 1-6.
47. L. Rudolph, Project oxygen: Pervasive, human-centric computing-an initial experience, in: Advanced Information Systems Engineering, K. Dittrich, A. Geppert, and M. Norrie, eds, Lecture Notes in Computer Science, Vol. 2068, Springer, Berlin /Heidelberg, 2001, pp. 1-12. 10.1007/3-540-45341-5-1. (Pubitemid 33285679)
48. D.E. Rumelhart, G.E. Hintont, and R.J. Williams, Learning representations by back-propagating errors, Nature 323(6088) (1986), 533-536. (Pubitemid 16025374)
49. A. Salah, R. Morros, J. Luque, C. Segura, J. Hernando, O. Ambekar, B. Schouten, and E. Pauwels, Multimodal identification and localization of users in a smart environment, Journal on Multimodal User Interfaces 2 (2008), 75-91. 10.1007/s12193-008-0008-y.
50. B. Schiele, M. Andriluka, N. Majer, S. Roth, and C. Wojek, Visual people detection-different models, comparison and discussion, in: Proc. of the ICRA 2009 Workshop on People Detection and Tracking, K.O. Arras and O. Martinez Mozos, eds, 2009.
51. K. Smith, D. Gatica-Perez, and J.M. Odobez, Using particles to track varying numbers of interacting people, IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1 (2005), 962-969. (Pubitemid 43897296)
52. H. Steg, H. Strese, C. Loroff, J. Hull, and S. Schmidt, Europe is facing a demographic challenge Ambient Assisted Living offers solutions, IST Project Report on Ambient Assisted Living, March 2006.
53. S. Sural, G. Qian, and S. Pramanik, Segmentation and histogram generation using the hsv color space for image retrieval, in: Proc. of the International Conference on Image Processing, Vol. 2, 2002, pp. II-589-II-592.
54. M.J. Swain and D.H. Ballard, Color indexing, International Journal of Computer Vision 7 (1991), 11-32. 10.1007/BF00130487.
55. J. Triesch and C. Malsburg, Democratic integration: Selforganized integration of adaptive cues, Neural Computation 13(9) (2001), 2049-2074. (Pubitemid 33595042)
56. T.L.M. van Kasteren, G. Englebienne, and B.J.A. Kröse, Activity recognition using semi-Markov models on real world smart home datasets, Journal of Ambient Intelligence and Smart Environments 2 (2010), 311-325.
57. C. Weber and S. Wermter, A self-organizing map of sigma-pi units, Neurocomputing 70(13-15) (2007), 2552-2560. (Pubitemid 46825351)
58. S. Wermter, G. Palm, and M. Elshaw, Biomimetic Neural Learning for Intelligent Robots: Intelligent Systems, Cognitive Robotics, and Neuroscience, Lecture Notes in Computer Science, Vol. 3575, Springer, Heidelberg, 2005.
59. G. West, C. Newman, and S. Greenhill, Using a camera to implement virtual sensors in a smart house, in: From Smart Homes to Smart Care, IOS Press, 2005, pp. 83-90.
60. A.Y. Yang, R. Jafari, S.S. Sastry, and R. Bajcsy, Distributed recognition of human actions using wearable motion sensor networks, Journal of Ambient Intelligence and Smart Environments 1(2) (2009), 103-115.
61. B. Zhang and H. Muhlenbein, Synthesis of sigma-pi neural networks by the breeder genetic programming, in: Proc. of the First IEEE Conference on Evolutionary Computation, June 1994, pp. 318-323.
62. Z. Zivkovic and B. Krose, An EM-like algorithm for colorhistogram-based object tracking, in: Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004, Vol. 1, June 2004, pp. I-798-I-803.