Human-centered multimedia: Representations and challenges

Proceedings of the ACM International Multimedia Conference and Exhibition

Volumn , Issue , 2006, Pages 11-18

  Elgammal, Ahmed ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

Human centered computing; Multimedia systems

Indexed keywords

COMPUTATIONAL METHODS; HUMAN COMPUTER INTERACTION; INFORMATION TECHNOLOGY; PROBLEM SOLVING; USER INTERFACES;

HUMAN-CENTERED COMPUTING (HCC); HUMAN-CENTERED MULTIMEDIA SYSTEMS; MULTIMEDIA APPLICATIONS;

MULTIMEDIA SYSTEMS;

EID: 34547264915     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1178745.1178751     Document Type: Conference Paper

References (101)

1. J. Aggarwal, Q. Cai, W. Liao, and B. Sabata. Articulated and elastic non-rigid motion: A review, 1994.
2. P. N. Belhumeur, J. Hespanha, and D. J. Kriegman. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. In ECCV (1), pages 45-58, 1996.
3. C. BenAbdelkader, R. Cutler, H. Nanda, and L. S. Davis. Eigengait: Motion-based recognition of people using image self-similarity. In Proc. Intl Conf. on Audio and Video-based Person Authentication (AVBPA), 2001.
4. A. Bissacco, A. Chiuso, Y. Ma, and S. Soatto. Recognition of human gaits. In Proc. of the IEEE CVPR, volume 2, pages 52-58, 2001.
5. M. Black and Y. Yacoob. Tracking and recognizing rigid and non-rigid facial motions using local parametric model of image motion. In Proc. of International Conference on Computer Vision, pages 374-381, 1995.
6. M. J. Black and A. D. Jepson. Eigentracking: Robust matching and tracking of articulated objects using a view-based representation. In ECCV (1), pages 329-342, 1996.
7. M. J. Black and Y. Yacoob. Recognizing facial expressions in image sequences using local parameterized models of image motion. IJCV, 25(1):23-48, 1997.
8. A. Bobick and J. Davis. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(3):257-267, 2001.
9. C. Bregler. Learning and recognizing human dynamics in video sequences. In Proc of IEEE Conference on Computer Vision and Patern Recognitioin, 1997.
10. C. Bregler. Tracking people with twists and exponential maps, 1998.
11. R. Brunelli and T. Poggio. Face recognition: Features versus templates. IEEE PAMI, 15:1042-1052, 1993.
12. L. W. Campbell and A. F. Bobick. Recognition of human body motion using phase space constraints. In ICCV, pages 624-630, 1995.
13. M. Caseia, S. Sclaroff, and V. Athitsos. Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3d models, 1999.
14. C. Cedras and M. Shah. Motion-based recognition: A survey. IVC, 13(2):129-155, March 1995.
15. T.-J. Cham and J. M. Rehg. A multiple hypothesis approach to figure tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1999.
16. Z. Chen and H. Lee. Knowledge-guided visual perception of 3-d human gait from single image sequence. IEEE SMC, 22(2):336-342, 1992.
17. R. Cutler and L. Davis. Robust periodic motion and motion symmetry detection. In Proc. IEEE CVPR, 2000.
18. T. Darrell and A. Pentland. Space-time gesture. In Proc IEEE CVPR, 1993.
19. J. Davis and M. Shah. Visual gesture recognition. Vision, Image and Signal Processing, 141(2):101-106, 1994.
20. J. Davis and M. Shah. Toward 3-d gesture recognition. International Journal of Pattern Recognition and Artificial Intelligence, 13(3):381-393, 1999.
21. J. Davis and S. Taylor. Analysis and recognition of walking movements. In International Conference on Pattern Recognition, pages 315-318, 2002.
22. N. Dimitrova. Multimedia content analysis: The next wave. In International Conference on Image and Video Retrieval, volume 2728 of Lecture Notes in Computer Science, pages 8-17, 2003.
23. A. Elgammal, D. Harwood, and L. S. Davis. Nonparametric background model for background subtraction. In Proc. of 6th European Conference of Computer Vision, 2000.
24. P. Enser and C. Sandom. Towards a comprehensive survey of the semantic gap in visual image retrieval. In International Conference on Image and Video Retrieval, volume 2728 of Lecture Notes in Computer Science, page 279287, 2003.
25. I. Essa and A. Pentland. Coding, analysis, interpretation, and recognition of facial expressions, 1997.
26. Y. Etsion, D. Tsafrir, and D. G. Feitelson. Human-centered scheduling of interactive and multimedia applications on a loaded desktop.
27. R. Fablet and M. J. Black. Automatic detection and tracking of human motion with a view-based representation. In Proc. ECCV 2002, LNCS 2350, pages 476-491, 2002.
28. N. Friedman and S. Russell. Image segmentation in video sequences: A probabilistic approach. In Uncertainty in Artificial Intelligence, 1997.
29. X. Gao and T. Boult. Error analysis of background adaption. In IEEE Conference on Computer Vision and Pattern Recognition, 2000.
30. D. Gavrila. The visual analysis of human movement: A survey. Computer Vision and Image Understanding, 73(1):82-98, Jan 1999.
31. D. Gavrila and L. Davis. 3-d model-based tracking of humans in action: a multi-view approach. In IEEE Conference on Computer Vision and Pattern Recognition, 1996.
32. D. M. Gavrila. Pedestrian detection from a moving vehicle. In Proc. of European Conference on Computer Vision, 2000.
33. R. Goldenberg, R. Kimmel, E. Rivlin, and M. Rudzsky. 'Dynamism of a dog on a leash' or behavior classification by eigen-decomposition of periodic motions. In Proceedings of the ECCV'02, pages 461-475, Copenhagen, May 2002. Springer-Verlag, LNCS 2350.
34. I. Haritaoglu, D. Harwood, and L. S. Davis. Ghost: A human body part labeling system using silhouettes. In 14th International Conference on Pattern Recognition, 1998.
35. I. Haritaoglu, D. Harwood, and L. S. Davis. W4: Who ? when ? where? what? a real time system for detecting and tracking people. In 3rd International Conference on Face and Gesture Recognition, 1998.
36. S. Y. H.E. Egeth. Visual attention: Control, representation, and time course. Annual Review Psychology, (48): 269-97, 1997.
37. D. Hogg. Model-based vision: a program to see a walking person. Image and Vision Computing, 1(1):5-20, 1983.
38. T. Horparasert, I. Haritaoglu, D. Harwood, L. Davis, C. Wren, and A. Pentland. Real-time 3d motion capture. In Second Workshop on Perceptual Interfaces, San Fransisco, 1998.
39. Howe, Leventon, and W. Freeman. Bayesian reconstruction of 3d human motion from single-camera video. In Proc. NIPS, 1999.
40. P. S. Huang, C. J. Harris, and M. S. Nixon. Comparing different template features for recognizing people by their gait. In BMVC, 1998.
41. M. Isard and J. MacCormick. Bramble: a bayesian multiple-blob tracker. In Proc. ICCV, volume II, pages 34-41, 2001.
42. Y. A. Ivanov and A. F. Bobick. Recognition of multi-agent interaction in video surveillance. In IEEE International Conferance on Compute Vision, 1999.
43. A. Jaimes. Human factors in automatic image retrieval system design and evaluation. In IS&T SPIE Proceedings of SPIE, volume 6061, Internet Imaging VII, 2006.
44. A. Jaimes and N. Sebe. Multimodal human computer interaction: A survey. In IEEE International Workshop on Human Computer Interaction in conjunction with. ICCV 2005, 2005.
45. A. Jepson, D. Fleet, and M. J. Black. A layered motion representation with occlusion and compace spatial support. In Proc. ECCV 2002, LNCS 2350, pages 692-706, 2002.
46. A. Johnson and A. Bobick. Gait recognition using static activity-specific parameters. In Proc. IEEE CVPR, 2001.
47. J.O'Rourke and Badler. Model-based image analysis of human motion using constraint propagation. IEEE PAMI, 2(6), 1980.
48. S. X. Ju, M. J. Black, and Y. Yacoob. Cardboard people: A parameterized model of articulated motion. In International Conference on Automatic Face and Gesture Recognition, pages 38-44, Killington, Vermont, 1996.
49. R. C. K. Etemad. Discriminant analysis for recognition of human face images. Journal of Optical Society of America, pages 1724-1733, 1997.
50. I. A. Kakadiaris and D. Metaxas. Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, CVPR, pages 81-87, Los Alamitos, California, U.S.A., 18-20 1996. IEEE Computer Society.
51. A. Kale, A. Rajagopalan, N. Cuntoor, and V. Krueger. Human identification using gait. In Proceedings FGR, 2002.
52. K.-P. Karmann and A. von Brandt. Moving object recognition using and adaptive background memory. In Time- Varying Image Processing and Moving Object Recognition. Elsevier Science Publishers B. V., 1990.
53. D. Koller, J. Weber, T.Huang, J.Malik, G. Ogasawara, B.Rao, and S.Russell. Towards robust automatic traffic scene analyis in real-time. In International Conference of Pattern Recognition, 1994.
54. A. Levin and A. Shashua. Principal component analysis over continuous subspaces and intersection of half-spaces. In ECCV, Copenhagen, Denmark, pages 635-650, May 2002.
55. M. Lew, N. Sebe, C. Djeraba, and R., Jain. Content-based multimedia information retrieval: State-of-the-art and challenges. In ACM Transactions on Multimedia Computing, Communication, and Applications, volume 2, 2006.
56. J. Little and J. Boyd. Recognizing people by their gait: the shape of motion. Videre, 1(2), 1998.
57. Y.-F. Ma, L. Lu, H.-J. Zhang, and M. Li. A generic framework of user attention model and its application in video summarization 1. In Proceedings of the tenth ACM international conference on Multimedia, 2002.
58. T. B. Moeslund and E. Granum. A survey of computer vision-based human motion capture. Computer Vision and Image Understanding: CVIU, 81(3):231-268, 2001.
59. M.Turk and A.Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1):71-86, 1991.
60. R. C. Nelson and R. Polana. Qualitative recognition of motion using temporal texture. CVGIP Image Understanding, 56(1):78-89, 1992.
61. S. Niyogi and E. Adelson. Analyzing and recognition walking figures in xyt. In Proc. IEEE CVPR, pages 469-474, 1994.
62. M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, and T. Poggio. Pedestrian detection using wavelet templates, 1997.
63. C. Papageorgiou, T. Evgeniou, and T. Poggio. A trainable pedestrian detection system, 1998.
64. C. Papageorgiou, M. Oren, and T. Poggio. A general framework for object detection. In Proc. ICCV, 1998.
65. J. Pelz. Portable eye-tracking in natural behavior. Journal of Vision, 4(11), 2004.
66. R. Polana and R. Nelson. Low level recognition of human motion (or how to get your man without finding his body parts). In IEEE Workshop on Non-Rigid and Articulated Motion, pages 77-82, 1994.
67. R. Polana and R. C. Nelson. Qualitative detection of motion by a moving observer. International Journal of Computer Vision, 7(1):33-46, 1991.
68. R. Polana and R. C. Nelson. Detecting activities. Journal of Visual Communication and Image Representation, June 1994.
69. F. Quek. Eyes in the interface. IVC, 13(6):511-525, August 1995.
70. J. M. Rehg and T. Kanade. Visual tracking of high DOF articulated structures: an application to human hand tracking. In ECCV (2), pages 35-46, 1994.
71. J. M. Rehg and T. Kanade. Model-based tracking of self-occluding articulated objects. In ICCV, pages 612-617, 1995.
72. J. Rittscher and A. Blake. Classification of human body motion. In IEEE International Conferance on Compute Vision, 1999.
73. K. Rohr. Towards model-based recognition of human movements in image sequence. CVGIP, 59(1):94-115, 1994.
74. R. Rosales, V. Athitsos, and S. Sclaroff. 3D hand pose reconstruction using specialized mappings. In Proc. ICCV, 2001.
75. R. Rosales and S. Sclaroff. Inferring body pose without tracking body parts. Technical Report 1999-017, 1, 1999.
76. M. Rosenblum, Y. Yacoob, and L. S. Davis. Human emotion recognition from motion using a radial basis function network architecture. Technical Report CS-TR.-3304, 1994.
77. H. A. Rowley, S. Baluja, and T. Kanade. Neural network-based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(1):23-38, 1998.
78. P. Saisan, A. Bissacco, and S. Soatto. Image-based modeling of human gaits with higher-order statistics. In Proc. of the Intl. Workshop on Dynamic Scene Analysis, Kopenhagen, June 2002.
79. H. Schneiderman and T. Kanade. Probabilistic modeling of local appearance and spatial relationships for object recognition. In Proc. IEEE CVPR, pages 45-51, 1998.
80. H. Schneiderman and T. Kanade. A statistical method for 3d object detection applied to faces and cars. In Proc. IEEE CVPR, pages 45-51, 2000.
81. G. Shakhnarovich, J. W. Fisher, and T. Darrell. Face recognition from long-term observations. In Proc. ECCV 2002, LNCS 2352, pages 851-865, 2002.
82. H. Sidenbladh, M. J. Black, and D. J. Fleet. Stochastic tracking of 3d human figures using 2d image motion. In ECCV (2), pages 702-718, 2000.
83. H. Sidenbladh, M. J. Black, and L. Sigal. Implicit probabilistic models of human motion for synthesis and tracking. In Proc. ECCV 2002, LNCS 2350, pages 784-800, 2002.
84. Y. Song, X. Feng, and P. Perona. Towards detection of human motion. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR. 2000), pages 810-817, 2000.
85. T. Starner and A. Pentland. Real-time american sign language recognition from video using hidden markov models. In SCV95, page 5B Systems and Applications, 1995.
86. Tanawongsuwan and A. Bobick. Gait recognition from time-normalized joint-angle trajectories in the walking plane. In Proc. IEEE CVPR, 2001.
87. K. Toyama and A. Blake. Probabilistic tracking in a metric space. In ICCV, pages 50-59, 2001.
88. P. Viola and M. Jones. Robust real-time object detection. International Journal of Computer Vision - to appear, 2002.
89. C. Vogler and D. Metaxas. Adapting hidden markov models for asl recognition by using three-dimensional computer vision methods. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, pages 156-161, 1997.
90. J. Wang, E. Sung, and R. Venkateswarlu. Eye gaze estimation from a single image of one eye. pages 136-143, 2003.
91. W.E.L.Grimson and C.Stauffer. Adaptive background mixture models for real-time tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1999.
92. C. R. Wem, A. Azarbayejani, T. Darrell, and A. P. Pentland. Pfinder: Real-time tracking of human body. IEEE Transaction on Pattern Analysis and Machine Intelligence, 1997.
93. A. D. Wilson and A. F. Bobick. Recognition and interpretation of parametric gesture. In ICCV, pages 329-336, 1998.
94. Y. Yacoob and M. J. Black. Parameterized modeling and recognition of activities. Computer Vision and Image Understanding: CVIU, 73(2):232-247, 1999.
95. Y. Yacoob and L. Davis. Computing spatio-temporal representations of human faces. In CVPR94, pages 70-75, 1994.
96. Y. Yacoob and L. Davis. Recognizing human facial expressions from long image sequences using optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18:636-642, 1996.
97. C. Yam, M. S. Nixon, and J. N. Carter. Extended modelbased automatic gait recognition of walking and running. In 2rd Int. Conf. on AUDIO- and VIDEO-BASED BIOMETRIC PERSON AUTHENTICATION, 2001.
98. G. Yang and T. Huang. Human face detection in a complex background. Pattern Recognition, 27:53-63, 1994.
99. Y.-H. Yang and M. D. Levine. The background primal sketch: An approach for tracking moving objects. Machine Vision and Applications, 5:17-34, 1992.
100. A. Yuille. Deformable templates for face recognition. J. of Cognitive Neurosci, 3(1):59-70, 1991.
101. W. Zhao, R. Chellappa, and A. Krishnaswamy. Discriminant analysis of principal components for face recognition. In Proc. of 3rd International Conference on Automatic Face and Gesture-Recognition, pages 336-341, 1998.