Cost-effective solution to synchronised audio-visual data capture using multiple sensors

Image and Vision Computing

Volumn 29, Issue 10, 2011, Pages 666-680

  Lichtenauer, Jeroen ^a   Shen, Jie ^a   Valstar, Michel ^a   Pantic, Maja ^a,b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Audio recording; Multisensor systems; Synchronisation; Video recording

Indexed keywords

BEHAVIORAL RESEARCH; CAMERAS; COMPUTER HARDWARE; SECURITY SYSTEMS; SYNCHRONIZATION; VIDEO RECORDING;

AUDIO INTERFACES; AUDIO-VISUAL DATA; BEHAVIOUR ANALYSIS; COMMERCIAL OFF-THE-SHELF COMPONENTS; COST-EFFECTIVE SOLUTIONS; DATA CAPTURE SYSTEMS; DATA RATES; HIGH BANDWIDTH; MULTI-SENSOR SYSTEMS; MULTICHANNEL AUDIO; MULTIPLE CAMERAS; MULTIPLE SENSORS; SENSOR DATA; SENSOR FUSION; SERIAL PORT; TEMPORAL RESOLUTION; TIME-STAMP; TIMESTAMPING; VIDEO DATA;

SENSORS;

EID: 80053939568     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2011.07.004     Document Type: Article

References (31)

1. A. Vinciarelli, M. Pantic, and H. Bourlard Social signal processing: survey of an emerging domain Image and Vision Computing 27 12 2009 1743 1759
2. H. Gunes, and M. Pantic Automatic, dimensional and continuous emotion recognition International Journal of Synthetic Emotion 1 1 2010 68 99
3. K.W. Grant, V. van Wassenhove, and D. Poeppel Discrimination of auditory-visual synchrony International Conference on Audio-Visual Speech Processing 2003 31 35
4. M. Sargin, Y. Yemez, E. Erzin, and A. Tekalp Audio-visual synchronization and fusion using canonical correlation analysis IEEE Transactions on Multimedia 9 7 2007 1396 1403
5. R. Lienhart, I. Kozintsev, and S. Wehr Universal synchronization scheme for distributed audio-video capture on heterogeneous computing platforms The Eleventh ACM international Conference on Multimedia, ACM, Berkeley, CA, USA 2003 263 266
6. http://www.dvrsystems.net, website.
7. http://www.boulderimaging.com, website.
8. http://www.cepoint.com, website.
9. C. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski High-quality video view interpolation using a layered representation ACM SIGGRAPH, Los Angeles, CA, USA 2004 600 608
10. B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy High performance imaging using large camera arrays ACM Transactions Graphics 24 3 2005 765 776
11. S. Tan, M. Zhang, W. Wang, and W. Xu Aha: an easily extendible high-resolution camera array, in: Second Workshop on Digital Media and its Application in Museum & Heritages IEEE 2007 319 323
12. T. Svoboda, H. Hug, and L. Van Gool Viroom - low cost synchronized multicamera system and its self-calibration Proceedings of the 24th DAGM Symposium on Pattern Recognition, Vol. 2449 of Lecture Notes in Computer Science 2002 Springer-Verlag London, UK 515 522
13. X. Cao, Y. Liu, and Q. Dai A flexible client-driven 3dtv system for real-time acquisition, transmission, and display of dynamic scenes EURASIP Journal on Advances in Signal Processing 2009 15 Article ID 351452, doi:10.1155/2009/351452
14. T. Hutchinson, F. Kuester, K.-U. Doerr, and D. Lim Optimal hardware and software design of an image-based system for capturing dynamic movements IEEE Transactions on Instrumentation and Measurement 55 1 2006 164 175 (Pubitemid 43193103)
15. T. Fujii, K. Mori, K. Takeda, K. Mase, M. Tanimoto, and Y. Suenaga Multipoint measuring system for video and sound - 100-camera and microphone system IEEE International Conference on Multimedia and Expo 2006 437 440 (Pubitemid 46679747)
16. A.N. Bashkatov, E.A. Genina, V.I. Kochubey, and V.V. Tuchin Optical properties of human skin, subcutaneous and mucous tissues in the wavelength range from 400 to 2000 nm Journal of Physics D: Applied Physics 38 2005 2543 2555 (Pubitemid 41067742)
17. T. Tajbakhsh, and R. Grigat Illumination flicker correction and frequency classification methods R. Martin, J. DiCarlo, N. Sampat, Digital Photography III SPIE Vol. 6502 2007 650210
18. P. Ekman, and W.V. Friesen Facial Action Coding System: A Technique for the Measurement of Facial Movement 1978 Consulting Psychologist Press Palo Alto, CA
19. P. Ekman, W.V. Friesen, and J.C. Hager Facial Action Coding System 2002 Research Nexus eBook Salt Lake City, UT
20. H.-J. Freund, and H. Büdingen The relationship between speed and amplitude of the fastest voluntary contractions of human arm muscles Journal of Experimental Brain Research 31 1 1978 1 12 (Pubitemid 8256496)
21. A. El Gamal Trends in cmos image sensor technology and design International Electron Devices Meeting 2002 805 808
22. Allied Vision Technologies GmbH Taschenweg 2a, D-07646 Stadtroda, Germany AVT Stingray Technical Manual V4.2.0 2009 May 28
23. S. Sookman Choosing a camera interface: qualify and quantify Advanced Imaging 22 5 2007 20 24
24. O. Hoshuyama, A. Sugiyama, and A. Hirano A robust adaptive microphone array with improved spatial selectivity and its evaluation in a real environment IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) Vol. 1 1997 367
25. Norpix Streampix 4 product description http://norpix.com/products/ multicamera.php 2007
26. M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic A multi-modal affective database for affect recognition and implicit tagging, Submitted to IEEE Trans. on Affective Computing, Special Issue on Naturalistic Affect Resources for System Building and Evaluation 2010 Nov. 8th.
27. Anonymous Gigabyte boards and DPC latency, Anandtech Forum http://forums.anandtech.com/messageview.aspx?catid=29&threadid=2182171 April 2008
28. Intel Intel I/O Controller Hub 9 (ICH9) Family; Datasheet; Document Number 316972-004 August 2008
29. H. Zhou, C. Nicholls, T. Kunz, and H. Schwartz Frequency accuracy & stability dependencies of crystal oscillators Technical Report SCE-08-12 November 2008 Carleton University, Systems and Computer Engineering Ottawa, Ont., Canada
30. MOTU 8pre product description http://www.motu.com/products/motuaudio/8pre 2008
31. Tobii Technology AB User Manual: Tobii X60 & X120 Eye Trackers, Revision 3 2008 November