An intelligent video framework for homeland protection

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6562, Issue , 2007, Pages

  Tu, Peter H ^a   Doretto, Gianfranco ^a   Krahnstoever, Nils O ^a   Perera, A G Amitha ^a   Wheeler, Frederick W ^a   Liu, Xiaoming ^a   Rittscher, Jens ^a   Sebastian, Thomas B ^a   Yu, Ting ^a   Harding, Kevin G ^a  

^a GE GLOBAL RESEARCH   (United States)

Author keywords

Camera calibration; Crowd segmentation; Deception detection; Face modeling; Face super resolution; Intelligent video; Person detection; Person reidentification; Site wide tracking; Surveillance

Indexed keywords

COMPUTER VISION; IMAGE ACQUISITION; IMAGE SEGMENTATION; VIDEO CAMERAS; VIDEO SIGNAL PROCESSING;

CAMERA CALIBRATION; CROWD SEGMENTATION; DECEPTION DETECTION; FACE MODELING; FACE SUPER-RESOLUTION; INTELLIGENT VIDEO; PERSON DETECTION; PERSON REIDENTIFICATION; SITE WIDE TRACKING;

INTELLIGENT SYSTEMS;

EID: 35948969891     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.729215     Document Type: Conference Paper

References (92)

1. RCA. Harrison, NY, RCA Electro Optics Handbook, 1974.
2. K. Harding, "Optical considerations in machine vision," in SME Machine Vision Workshop series, 1985-. Included Machine Vision Capabilities for Industry, N. Zuech, ed., pp. 115-151, SME, 1986.
3. M. P. Coletta and K. Harding, "Lighting science - tools to guide machine vision applications," in SME Vision, (Chicago), 1989.
4. K. Harding, "Light source models for machine vision," in SPIE Conf. Optics, Illumination and Sensing for Machine Vision, Svetkoff, ed., (Philadelphia), Nov. 1989.
5. G. T. Uber and K. G. Harding, "Illumination and viewing methods for machine vision," in Opcon 90, (Boston), November 4-9 1990.
6. R. F. Rauchmiller Jr., K. G. Harding, M. A. Michniewicz, and E. A. Kaltenbacher, "Design and application of a lighting test bed," in SME Vision '90, pp. 1-14, (Detroit), November 12-15 1990.
7. K. Harding, "Machine vision-lighting," in Encyclopedia of Optical Engineering, R. G. Driggers, ed., pp. 1227-1336, Marcel Dekker, 2003.
8. K. G. Harding, "Sensors for the '90s," Manufacturing Engineering 106, pp. 57-61, April 1991.
9. K. Harding, "Three-dimensional noncontact sensing," in Encyclopedia of Optical Engineering, R. G. Driggers, ed., pp. 2818-2827, Marcel Dekker, 2003.
10. K. G. Harding, "The promise and payoff of 2D and 3D machine vision: Where arc we today?," in Two- and Three-Dimensional Vision Systems for Inspection, Control, and Metrology, B. G. Batchelor and H. Hugh, eds., 5265, pp. 1-15, February 2004.
11. B. K. P. Horn, "Obtaining shape from shading information," in The Psychology of Computer Vision, P. H. Winston, ed., pp. 115-155, McGraw-Hill, New York, 1975.
12. O. D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, Artificial Intelligence Series. MIT Press, Cambridge, USA, 1993.
13. N. Krahnstoever and P. Mendonça, "Bayesian autocalibration for surveillance," in Proc. of IEEE International Conference on Computer Vision (ICCV'05), Beijing, China, October 2005.
14. N. Krahnstoever and P. Mendonça, "Autocalibration from tracks of walking people.," in Proc. British Machine Vision Conference (BMVC), Edinburgh, UK, 4-7September, 2006.
15. D. C. Brown, "Close-range camera calibration," Photogrammetric Eng. and Remote Sensing 37, pp. 855-866, Aug. 1971.
16. R. Y Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE Journal of Robotics and Automation RA-3(4), pp. 323-344, 1987.
17. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. Pattern Analysis and Machine Intel. 22, pp. 1330-1334, Nov. 2000.
18. S. Maybank and O. D. Faugeras, "A theory of self-calibration of a moving camera," Int. Journal of Computer Vision 8, pp. 123-151, Aug. 1992.
19. B. Triggs, "Autocalibration and the absolute quadric," in Proc. Conf. Computer Vision and Pattern Recognition, pp. 609-614, (San Juan, Puerto Rico), June 1997.
20. M. Pollefeys, R. Koch, and L. Van Gool, "Self-calibration and metric reconstruction in spite of varying and unknown intrinsic camera parameters," Int. Journal of Computer Vision 32, pp. 7-25, August 1999.
21. B. Caprile and V. Torre, "Vanishing points for camera calibration," Int. Journal of Computer Vision 4, pp. 127-139, 1990.
22. M. Armstrong, A. Zisserman, and R. Hartley, "Self-calibration from image triplets," in Proc. 4th European Conf. on Computer Vision, B. Buxton and R. Cipolla, eds., Lecture Notes in Computer Science 1064 I, pp. 3-16, Springer-Verlag, (Cambridge, UK), Apr. 1996.
23. L. de Agapito, "Self-calibration of rotating and zooming cameras," Int. Journal of Computer Vision 45, pp. 107-127, Nov. 2001.
24. K.-Y. K. Wong, P. R. S. Mendonça, and R. Cipolla, "Camera calibration from surfaces of revolution," IEEE Trans. Pattern Analysis and Machine Intel. 25, pp. 147-161, Feb. 2003.
25. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. 12th IEEE Computer Vision and Pattern Recognition, Santa Barbara, CA, 2, pp. 246-252, 1998.
26. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, "Wallflower: Principles and practice of background maintenance," in Proc. 7th Int. Conf. on Computer Vision, Corfu, Greece, pp. 255-261, 1999.
27. J. Rittscher, J. Kato, S. Joga, and A. Blake, "A probabilistic background model for tracking," in Proc. 6th European Conf. Computer Vision, Dublin, Ireland, 2, pp. 336-350, 1999.
28. S. Intille, J. Davis, and A. Bobick, "Real time closed world tracking," in Proc. 11th IEEE Computer Vision and Pattern Recognition, San Jaun, PR, pp. 697-703, 1997.
29. N. Krahnstoever, P. Tu, T. Sebastian, A. Perera, and R. Collins, "Multi-view detection and tracking of travelers and luggage in mass transit environments," in Proc. Ninth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), New York, 2006.
30. A. Perera, G. Brooksby, A. Hoogs, and G. Doretto, "Moving object segmentation using scene understanding," in Proceedings of the IEEE Workshop on Perceptual Organization in Computer Vision, 2006.
31. M. Irani, P. Anandan, and D. Weinshall, "From reference frames to reference planes: Multi-view parallax geometry and applications," in Proc. 5th European Conf. on Computer Vision, H. Burkhardt and B. Neumann, eds., Lecture Notes in Computer Science 1407 II, pp. 829-845, Springer-Verlag, (Freiburg, Germany), June 1998.
32. R. Kaucic, A. G. A. Perera, G. Brooksby, J. Kaufhold, and A. Hoogs, "A unified framework for tracking through occlusions and across sensor gaps," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 990-997, 2005.
33. R. Vidal and R. Hartley, "Motion segmentation with missing data using PowerFactorization and GPCA," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, II, pp. 310-316, 2004.
34. G. J. Brostow and R. Cipolla, "Unsupervised Bayesian detection of independent motion in crowds," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, I, pp. 594-601, 2006.
35. S. Agarwal. J. Lim, L. Zelnik-Manor, P. Perona, D. J. Kriegman, and S. Belongie, "Beyond pairwise clustering." in Proc. IEEE Conference on Computer Vision and Pattern Recognition, II, pp. 838-845, 2005.
36. D. Gavrila and V. Philomin, "Real-time object detection for smart vehicles," in Proc. 7th Int. Conf. on Computer Vision, Corfu, Greece, pp. 87-93, 1999.
37. J. Giebel, D. Gavrila, and C. Schnörr, "A Bayesian framework for multi-cue 3D object tracking," in Proc. 8th European Conf. Computer Vision, Prague, Czech Republic, pp. 241-252, 2004.
38. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Intl. Conference on Computer Vision and Pattern Recognition, 2005.
39. M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, and T. Poggio, "Pedestrian detection using wavelet templates.," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 193-, 1997.
40. Q. Zhu, M.-C. Yeh, K.-T. Cheng, and S. Avidan, "Fast human detection using a cascade of histograms of oriented gradients.," in CVPR (2), pp. 1491-1498, IEEE Computer Society, 2006.
41. K. Mikolajczyk, C. Schmid, and A. Zisserman, "Human detection based on a probabilistic assembly of robust part detectors," in Proc. 8th European Conf. Computer Vision, Prague, Czech Republic, 1, pp. 69-82, 2004.
42. B. Leibe, E. Seemann, and B. Schiele, "Pedestrian detection in crowded scenes," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, 2005.
43. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern classification, John Wiley and Sons, Inc., 2nd ed., 2001.
44. D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach, Prentice Hall, Upper Saddle River, USA, 2003.
45. I. Haritaoglu, D. Harwood, and L. S. Davis, "HYDRA: Multiple people detection and tracking using silhouettes," in IEEE International Workshop on Visual Surveillance, pp. 6-13, 1999.
46. Y Song, L. Goncalves, and P. Perona, "Monocuolar perception of biological motion - clutter and partial occlusion," in Proc. 6th European Conf. Computer Vision, Dublin, Ireland, 2, pp. 719-733, 2000.
47. A. Elgammal and L. Davis, "Probabilistic framework for segmenting people under occlusion," in Proceedings Eighth IEEE International Conference on Computer Vision, Vancouver, BC, Canada, 2, pp. 145-152,2001. Endnote.
48. T. Zhao and R. R. Nevatia, "Bayesian human segmentation in crowded situations," in IEEE Computer Vision and Pattern Recognition, Madison, Wisconsin, 2, pp. 459-466, 2003.
49. P. H. Tu and J. Rittscher, "Crowd segmentation through emergent labeling," in Statistical Methods in Video Processing: ECCV 2004 Workshop SMVP2004, pp. 187-198, May 2004.
50. J. Rittscher, P. Tu, and N. Krahnstoever, "Simultaneous estimation of segmentation and shape," in Proceedings of the 2005 IEEE Conference on Computer Vision and Pattern Recognition, 2005.
51. P. Viola and M. Jones, "Robust real-time face detection," in International Conference on Computer Vision, 2, p. 747, (Vancouver, Canada), 2001.
52. F. Burgeois and J. C. Lassalle, "An extension of the Munkres algorithm for the assignment problem to rectangular matrices," Communications of the ACM 14, pp. 802-806, December 1971.
53. S. Blackman and R. Popoli, Design and Analysis of Modern Tracking Systems, Artech House Publishers, 1999.
54. C. Rasmussen and G. Hager, "Joint probabilistic techniques for tracking multi-part objects," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 16-21, 1998.
55. I. J. Cox and S. L. Hingorani, "An efficient implementation and evaluation of Reid's multiple hypothesis tracking algorithm for visual tracking," in Intl. Conference on Pattern Recognition, 1994.
56. M. Isard and J. MacCormick, "BraMBLe: A Bayesian multiple-blob tracker," in IEEE Proc. Int. Conf. Computer Vision, 2, pp. 34-41, 2001.
57. R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, "Face detection in color images," IEEE Trans, on PAMI 24, pp. 696-706, May 2002.
58. L. Wang, T. Tan, H. Ning, and W. Hu, "Silhouette analysis-based gait recognition for human identification," IEEE Trans, on PAMI25, pp. 1505-1518, Dec. 2003.
59. G. Jaffré and P. Joly, "Costume: A new feature for automatic video content indexing," in Proceedings of RIAO, pp. 314-325, 2004.
60. J. M. Seigneur, D. Solis, and F. Shevlin, "Ambient intelligence through image retrieval," in International Conference on Image and Video Retrieval, pp. 526-534, Springer, 2004.
61. F. Porikli, "Inter-camera color calibration by correlation model function," in Proc. of IEEE ICIP, 2, pp. 133-6, Sept. 14-17, 2003.
62. O. Javed. K. Shafique, and M. Shah, "Appearance modeling for tracking in multiple non-overlapping cameras," in Proc. CVPR, 2005.
63. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans, on PAMI 24, pp. 509-522, 2002.
64. D. Lowe, "Distinctive image features from scale-invariant key points," IJCV 60, pp. 91-110, 2004.
65. J. Sivic and A. Zisserman, "Video google: a text retrieval approach to object matching in videos," in Proc. CVPR, pp. 1470-1477, Oct. 13-16, 2003.
66. T. Zhao and R. Nevatia, "Car detection in low resolution aerial image," in Proc. ICCV, 1, pp. 710-717, (Vancouver, BC, Canada), 2001.
67. N. Gheissari, T. B. Sebastian, P. H. Tu. J. Rittscher, and R. Hartley, "Person reidentification using spatiotemporal appearance," in Proc. CVPR, 2, pp. 1528-1535, 2006.
68. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool, "A comparison of affine region detectors," IJCV 65(1 -2), pp. 43-72. 2006.
69. Y Amit and A. Kong, "Graphical templates for model registration," IEEE Trans, on PAMI 18, pp. 225-236, Mar. 1996.
70. P. F. Felzenszwalb, "Representation and detection of deformable shapes," IEEE Trans, on PAMI 27, pp. 208-220, Feb. 2005.
71. J. Canny, "A computational approach to edge detection," IEEE Trans. on PAMI 8, pp. 679-698, Nov. 1986.
72. D. M. Blackburn, J. M. Bone, and P. J. Phillips, FRVT 2000 Evaluation Report, February 2001.
73. F. W Wheeler, X. Liu, P. H. Tu, and R. Hoctor, "Multi-frame image restoration for face recognition," in to appear in SAFE 2007: IEEE Signal Processing Society Workshop on Signal Processing Applications for Public Security and Forensics, 2007.
74. S. Chaudhuri, ed., Super-Resolution Imaging, Kluwer Academic Publishers, 3rd ed., 2001.
75. K. R. Liu, M. G. Kang, and S. Chaudhuri, eds., IEEE Signal Processing Magazine, Special edition: Super-Resolution Image Reconstruction, vol. 20, no. 3, IEEE, May 2003.
76. M. Ng, T. Chan, M. G. Kang, and P. Milanfar, eds., EURASlP Journal on Applied Signal Processing (JASP) Special Issue on Super-Resolution Enhancement of Digital Video, Hindawi Publishing Corporation, 2006.
77. S. Borman, Topics in Multiframe Superresolution Restoration. PhD thesis, University of Notre Dame, Notre Dame, IN, May 2004.
78. F. W. Wheeler, R. T. Hoctor, and E. B. Barrett, "Super-resolution image synthesis using projections onto convex sets in the frequency domain," in Proc. of the IS&T/SPIE Symposium on Electronic Imaging, Conference on Computational Imaging, (San Jose, CA), January 2005.
79. T. Cootes, D. Cooper, C. Tylor, and J. Graham, "A trainable method of parametric shape description," in Proc. 2nd British Machine Vision Conference, pp. 54-61, Springer, September 1991.
80. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework," International Journal of Computer Vision 56, pp. 221-255, March 2004.
81. S. Baker and T. Kanade, "Super resolution optical flow," Tech. Rep. CMU-RI-TR-99-36, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, October 1999.
82. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Transactions on Pattern Analysis and Machine Intelligence 24, pp. 1167-1183, September 2002.
83. K. Chang, K. W. Bowyer, and P. J. Flynn, "Face recognition using 2D and 3D facial data," in ACM Workshop on Multimodal User Authentication, pp. 25-32, December 2003.
84. P. J. Flynn, K. W Bowyer, and P. J. Phillips, "Assessment of time dependency in face recognition: An initial study," in Audio and Video-Based Biometrie Person Authentication, pp. 44-51, 2003.
85. X. Liu, P. H. Tu, and F. W. Wheeler, "Face model fitting on low resolution images," in Proc. of the British Machine Vision Conference (BMVC), (Edinburgh, UK), 2006.
86. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution," IEEE Transactions on Image Processing 13, pp. 1327-1344, October 2004.
87. P. J. Costianes, "An overview of concealed weapons detection for homeland security," in Proceedings of the Applied Imagery and Pattern Recognition Workshop, Oct. 19-21, 2005.
88. M. G. Frank and P. Ekman, "The ability to detect deceit generalizes across different types of high-stake lies," Journal of Personality and Social Psychology 72(6), pp. 1429-1439, 1997.
89. P. Tsiamyrtzis, J. Dowdall, D. Shastri, I. T. Pavlidis, M. G. Frank, and P. Ekman, "Imaging facial physiology for the detection of deceit," IJCV 71, pp. 197-214, Feb. 2007.
90. P. Buddharaju, J. Dowdall, P. Tsiamyrtzis, D. Shastri, I. Pavlidis, and M. G. Frank, "Automatic thermal monitoring system (ATHEMOS) for deception detection," in Video Proc. CVPR, 2, June 20-25, 2005.
91. T.O. Meservy, M. L. Jensen, J. Kruse, J. K. Burgoon. J. F. J. Nunamaker, D. P. Twitchell, G. Tsechpenakis, and D. N. Metaxas, "Deception detection through automatic, unobtrusive analysis of nonverbal behavior," IEEE Intelligent Systems 20, pp. 36-43, Sept./Oct. 2005.
92. Y. Matsumoto, T. Ogasawara, and A. Zelinsky, "Behavior recognition based on head pose and gaze direction measurement," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 3, pp. 2127-2132, (Takamatsu), Oct. 31-Nov. 5, 2000.