Selective perception policies for guiding sensing and computation in multimodal systems: A comparative analysis

ICMI'03: Fifth International Conference on Multimodal Interfaces

Volumn , Issue , 2003, Pages 36-43

  Oliver, Nuria ^a   Horvitz, Eric ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

Automatic feature selection; Expected value of information; Hidden Markov models; Human behavior recognition; Multi modal interaction; Office awareness; Selective perception

Indexed keywords

DATA PROCESSING; FEATURE EXTRACTION; HEURISTIC METHODS; HUMAN COMPUTER INTERACTION; MARKOV PROCESSES; PERSONAL COMPUTERS; REAL TIME SYSTEMS; RESOURCE ALLOCATION;

AUTOMATIC FEATURE SELECTION; EXPECTED VALUE OF INFORMATION; HIDDEN MARKOV MODELS; HUMAN BEHAVIOR RECOGNITION; MULTI-MODAL INTERACTION; OFFICE AWARENESS; SELECTIVE PERCEPTION;

SENSORY PERCEPTION;

EID: 18844395613     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. M. Ben-Bassat. Myopic policies in sequential classification. IEEE Trans. Comput., 27:170-178, 1978.
2. R. Bolles. Verification vision for programmable assembly. In Proc. IJCAI'77, pages 569-575, 1977.
3. M. Brand and V. Kettnaker. Discovery and segmentation of activities in video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 2000.
4. M. Brand, N. Oliver, and A. Pentland. Coupled hidden markov models for complex action recognition. In Proc. of CVPR97, pages 994-999, 1996.
5. H. Buxton and S. Gong. Advanced Visual Surveillance using Bayesian Networks. In International Conference on Computer Vision, pages 111-123, Cambridge, Massachusetts, June 1995.
6. J. Feldman and R. Sproull. Decision theory and artificial intelligence ii: The hungry monkey. Cognitive Science, 1:158-192, 1977.
7. J. Fernyhough, A. Cohn, and D. Hogg. Building qualitative event models automatically from visual input. In ICCV'98, pages 350-355, 1998.
8. J. Forbes, T. Huang, K. Kanazawa, and S. Russell. The batmobile: Towards a bayesian automated taxi. In Proc. Fourteenth International Joint Conference on Artificial Intelligence, IJCAI'95, 1995.
9. A. Galata, N. Johnson, and D. Hogg. Learning variable length markov models of behaviour. International Journal on Computer Vision, IJCV, pages 398-413, 2001.
10. J. Garvey. Perceptual strategies for purposive vision. Technical Report 117, SRI International, 1976.
11. G. Gorry and G. Barnett. Experience with a model of sequential diagnosis. Computers and Biomedical Research, 1:490-507, 1968.
12. D. Heckerman, E. Horvitz, and B. Middleton. A nonmyopic approximation for value of information. In Proc. Seventh Conf. on Uncertainty in Artificial Intelligence, 1991.
13. J. Hoey. Hierarchical unsupervised learning of facial expression categories. In Proc. ICCV Workshop on Detection and Recognition of Events in Video, Vancouver, Canada, July 2001.
14. E. Horvitz, J. Breese, and M. Henrion. Decision theory in expert systems and artificial intelligence. International Journal of Approximate Reasoning, Special Issue on Uncertain Reasoning, 2:247-302, 1988.
15. E. Horvitz, A. Jacobs, and D. Hovel. Attention-sensitive alerting. In Proc. of Conf. on Uncertainty in Artificial Intelligence, UAI'99, pages 305-313, 1999.
16. R. Howard. Value of information lotteries. IEEE Trans. on Systems, Science and Cybernetics, SSC-3, 1:54-60, 1967.
17. S. S. Intille and A. F. Bobick. A framework for recognizing multi-agent action from visual evidence. In AAAI/IAAI'99, pages 518-525, 1999.
18. Y. Ivanov and A. Bobick. Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. on Pattern Analysis and Machine Intelligence, TPAMI, 22(8):852-872, 2000.
19. S. Li, X. Zou, Y. Hu, Z. Zhang, S. Yan, X. Peng, L. Huang, and H. Zhang. Real-time multi-view face detection, tracking, pose estimation, alignment, and recognition, 2001.
20. A. Madabhushi and J. Aggarwal. A bayesian approach to human activity recognition. In In Proc. of the 2nd International Workshop on Visual Surveillance, pages 25-30, 1999.
21. N. Oliver, E. Horvitz, and A. Garg. Layered representations for human activity recognition. In Proc. of Int. Conf. on Multimodal Interfaces, pages 3-8, 2002.
22. L. Rabiner and B. Huang. Fundamentals of Speech Recognition. 1993.
23. L. R. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proceed. of the IEEE, 77(2):257-286, Feb. 1989.
24. R. D. Rimey. Control of selective perception using bayes nets and decision theory. Technical Report TR468, 1993.
25. F. B. S. Hongeng and R. Nevatia. Representation and optimal recognition of human activities. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR'00, 2000.
26. T. Starner and A. Pentland. Real-time american sign language recognition from video using hidden markov models. In Proceed, of SCV'95, pages 265-270, 1995.
27. L. van der Gaag and M. Wessels. Selective evidence gathering for diagnostic belief networks. AISB Quarterly, (86):23-34, 1993.
28. A. Wilson and A. Bobick. Recognition and interpretation of parametric gesture. In Proc. of International Conference on Computer Vision, ICCV'98, pages 329-336, 1998.
29. H. Wu and A. Cameron. A bayesian decision theoretic approach for adaptive goal-directed sensing. ICCV, 90:563-567, 1990.