Propagating certainty in petri nets for activity recognition

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 2, 2013, Pages 326-337

  Lavee, Gal ^a   Rudzsky, Michael ^a   Rivlin, Ehud ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Activity recognition; event recognition; particle filter; Petri net; video surveillance

Indexed keywords

ACTIVITY MODELS; ACTIVITY RECOGNITION; DATA SETS; DETERMINISTIC APPROACH; DURATION MODELS; EMPIRICAL COMPARISON; EVENT RECOGNITION; IMAGE FEATURES; PARTICLE FILTER; SEMANTIC CONCEPT; SURVEILLANCE VIDEO; TEMPORAL STRUCTURES; VIDEO PROCESSING; VIDEO SEQUENCES; VIDEO SURVEILLANCE;

EXPERIMENTS; MONITORING; MONTE CARLO METHODS; PETRI NETS; SECURITY SYSTEMS; SEMANTICS; STOCHASTIC SYSTEMS; UNCERTAINTY ANALYSIS;

VIDEO SIGNAL PROCESSING;

EID: 84873376024     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2012.2203742     Document Type: Article

References (35)

1. Activity Examples. (2012, Jul.) [Online]. Available: http://www.cs. technion.ac.il/∼gallavee/uncertain typropagation/datasetexamples.html
2. M. Albanese, R. Chellappa, N. Cuntoor, V. Moscato, A. Picariello, V. S. Subrahmanian, and O. Udrea, "PADS: A Probabilistic activity detection framework for video data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 12, pp. 2246-2261, Dec. 2010.
3. M. Albanese, R. Chellappa, V. Moscato, A. Picariello, V. S. Subrahmanian, P. Turaga, and O. Udrea, "A constrained probabilistic Petri Net framework for human activity detection in video," IEEE Trans. Multimedia, vol. 10, no. 8, pp. 1429-1443, Dec. 2008.
4. J. F. Allen and G. Ferguson, "Actions and events in interval temporal logic," Dept. Comput. Sci., Univ. Rochester, Rochester, NY, Tech. Rep. TR521, Jul. 1994.
5. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002.
6. B. Babenko, M.-H. Yang, and S. Belongie, "Visual tracking with online multiple instance learning," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 983-990.
7. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. IEEE 10th Int. Conf. Comput. Vision, Oct. 2005, pp. 1395-1402.
8. A. F. Bobick, "Movement, activity, and action: The role of knowledge in the perception of motion," in Proc. Royal Soc. Workshop Knowledge-Based Vision Man Mach., vol. B-352 1997, pp. 1257-1265.
9. F. Bremond, "Scene understanding: Perception, multi-sensor fusion, spatio-temporal reasoning and activity recognition," Ph.D. dissertation, Dept. Comput. Sci., HDR Université de Nice-Sophia Antipolis, Nice Cedex, France, Jul. 2007.
10. W. Brendel, A. Fern, and S. Todorovic, "Probabilistic event logic for interval-based event recognition," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 3329-3336.
11. C. Castel, L. Chaudron, and C. Tessier, "What is going on? A high level interpretation of sequences of images," in Proc. Eur. Conf. Comput. Vision, 1996, pp. 13-27.
12. A. Doucet and A. Johansen, "A tutorial on particle filtering and smoothing: Fifteen years later," Dept. Statist., Univ. British Columbia, Tech. Rep., 2008.
13. C. Ferńandez, P. Baiget, X. Roca, and J. Gonźalez, "Interpretation of complex situations in a semantic-based surveillance framework," J. Image Commun., vol. 23, no. 7, pp. 554-569, 2008.
14. R. Gerber and H. H. Nagel, "Representation of occurrences for road vehicle traffic," Artif. Intell., vol. 172, nos. 4-5, pp. 351-391, 2008.
15. N. Ghanem, D. DeMenthon, D. Doermann, and L. Davis, "Representation and recognition of events in surveillance video using Petri Nets," in Proc. Comput. Vision Pattern Recognit. Workshop, Jun. 2004, p. 112.
16. M. Isard and A. Blake, "Condensation: Conditional density propagation for visual tracking," Int. J. Comput. Vision, vol. 29, no. 1, pp. 5-28, 1998.
17. Y. Ivanov and A. Bobick, "Recognition of visual activities and interactions by stochastic parsing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 852-872, Aug. 2000.
18. D. Kartson, G. Balbo, S. Donatelli, G. Franceschinis, and G. Conte, Modelling with Generalized Stochastic Petri Nets. New York: Wiley.
19. S. Kwak, B. Han, and J. H. Han, "Scenario-based video event recognition by constraint flow," in Proc. IEEE Comput. Vision Pattern Recognit., 2011, pp. 3345-3352.
20. G. Lavee, A. Borzin, M. Rudzsky, and E. Rivlin, "Building Petri Nets from video event ontologies," in Proc. 3rd Int. Conf. Adv. Visual Comput., 2007, pp. 442-451.
21. G. Lavee, E. Rivlin, and M. Rudzsky, "Understanding video events: A survey of methods for automatic interpretation of semantic occurrences in video," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 39, no. 5, pp. 489-504, Sep. 2009.
22. G. Lavee, E. Rivlin, and M. Rudzsky, "Propagating certainty in Petri Nets for activity recognition," Technion, Israel Inst. of Technology, Tech. Rep. CIS-2012-04, 2012.
23. G. Lavee, M. Rudzsky, E. Rivlin, and A. Borzin, "Video event modeling and recognition in generalized stochastic Petri Nets," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 1, pp. 102-118, Jan. 2010.
24. B. Laxton, J. Lim, and D. Kriegman, "Leveraging temporal, contextual and ordering constraints for recognizing complex activities in video," in Proc. IEEE Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
25. V. I. Morariu and L. S. Davis, "Multiagent event recognition in structured scenarios," in Proc. IEEE Comput. Vision Pattern Recognit., 2011, pp. 3289-3296.
26. T. Murata, "Petri Nets: Properties, analysis and applications," Proc. IEEE, vol. 77, no. 4, pp. 541-580, Apr. 1989.
27. A. T. Nghiem, F. Bremond, M. Thonnat, and V. Valentin, "ETISEO, Performance evaluation for video surveillance systems," presented at the Conf. Adv. Video Signal Based Surveillance, London, U.K., Sep. 2007.
28. S. Oh, A. Hoogs, A. Perera, N. Cuntoor, C. chen, J. Lee, S. Mukherjee, J. Aggarwal, H. Lee, L. Davis, E. Swears, X. Wang, Q. Ji, K. Reddy, M. Shah, C. Vondrick, H. Pirsiavash, D. Ramanan, J. Yuen, A. Torralba, B. Song, A. Fong, A. Roy-Chowdhury, and M. Desai, "A large-scale benchmark dataset for event recognition in surveillance video," in Proc. IEEE Comput. Vision Pattern Recognit., Jun. 2011, pp. 3153-3160.
29. M. Perse, M. Kristan, J. Pers, G. Music, G. Vuckovic, and S. Kovacic, "Analysis of multiagent activity using Petri Nets," Pattern Recognit., vol. 43, no. 4, pp. 1491-1501, 2010.
30. R. Romdhane, F. Bremond, and M. Thonnat, "A framework dealing with uncertainty for complex event recognition," in Proc. 7th IEEE Int. Conf. Adv. Video Signal Based Surveillance, Sep. 2010, pp. 392-399.
31. M. S. Ryoo and J. K. Aggarwal, "Semantic representation and recognition of continued and recursive human activities," Int. J. Comput. Vision, vol. 82, pp. 1-24, Apr. 2009.
32. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local svm approach," in Proc. 17th Int. Conf. Pattern Recognit., 2004, 32-36.
33. Y. Shi, Y. Huang, D. Minnen, A. Bobick, and I. Essa, "Propagation networks for recognition of partially ordered sequential action," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit.,Washington, D.C., 2004, pp. 862-869.
34. S. D. Tran and L. S. Davis, "Event modeling and recognition using markov logic networks," in Proc. 10th Eur. Conf. Comput. Vision II, Berlin, Heidelberg, 2008, pp. 610-623.
35. V. Vu, F. Bremond, and M. Thonnat, "Automatic video interpretation: A novel algorithm for temporal scenario recognition," in Proc. 18th Int. Joint Conf. Artif. Intell., 2003, pp. 1295-1300.