Toward an automatically generated soundtrack from low-level cross-modal correlations for automotive scenarios

MM'10 - Proceedings of the ACM Multimedia 2010 International Conference

Volumn , Issue , 2010, Pages 551-559

  Cristani, Marco ^a,d   Pesarin, Anna ^a   Drioli, Carlo ^a   Murino, Vittorio ^a,d   Rodà, Antonio ^b   Grapulin, Michele ^a   Sebe, Nicu ^c  

^a UNIVERSITY OF VERONA   (Italy)

^b UNIVERSITY OF UDINE   (Italy)

^c UNIVERSITY OF TRENTO   (Italy)

^d ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

audio video processing; automotive; cross modality

Indexed keywords

AUDIO AND VIDEO; AUDIO TRACK; AUTOMATICALLY GENERATED; AUTOMOTIVE; AUTOMOTIVE APPLICATIONS; CROSS MODALITY; CROSS-MODAL; CROSS-MODAL CORRELATION; FURTHER DEVELOPMENT; MIXING MECHANISMS; STATISTICAL CORRELATION; TRAINING DATASET; USER STUDY; VIDEO PROCESSING; VIDEO SEQUENCES;

VIDEO SIGNAL PROCESSING;

EID: 78650970182     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1873951.1874024     Document Type: Conference Paper

References (26)

1. R. Achanta, W. Yan, and M. Kankanhalli. Modeling intent for home video repurposing. IEEE MultiMedia, 13:46-55, 2006.
2. B. Adams, C. Dorai, and S. Venkatesh. Finding the beat: An analysis of the rhythmic elements of motion pictures. Int. Journal of Image and Graphics, 2(2):215-245, 2002.
3. R. Baecker, A. J. Rosenthal, N. Friedlander, E. Smith, and A. Cohen. A multimedia system for authoring motion pictures. In ACM MM, pages 31-42, 1996.
4. M. Barthet, R. Kronland-Martinet, and S. Ystad. Improving musical expressiveness by time-varying brightness shaping. pages 313-336, 2008.
5. S. Canazza, G. De Poli, C. Drioli, A. Rodà, and A. Vidolin. Modeling and control of expressiveness in music performance. Proceedings of the IEEE, 92(4):686-701, 2004.
6. S. Canazza, G. De Poli, and A. Rodà. Analysis of expressive intentions in piano performance. Journal of ITC Sangeet Research Academy, 16:23-62, 2002.
7. S. Canazza, G. De Poli, A. Rodà, and A. Vidolin. An abstract control space for communication of sensory expressive intentions in music performance. Journal of New Music Research, 32(3):281-294, 2003.
8. M. Davis. Garage cinema and the future of media technology. Commun. ACM, 40(2):42-48, 1997.
9. M. Davis. Editing out video editing. IEEE MultiMedia, 10(2):54-64, 2003.
10. G. De Poli, A. Rodà, and A. Vidolin. Note-by-note analysis of the influence of expressive intentions and musical structure in violin performance. Journal of New Music Research, 27(3):293-321, 1998.
11. C. Dorai and S. Venkatesh. Computational media aesthetics: Finding meaning beautiful. IEEE MultiMedia, 8(4):10-12, 2001.
12. M. Figueiredo and A. Jain. Unsupervised learning of finite mixture models. IEEE Trans. on PAMI, 24(3):381-396, 2002.
13. T. Gautama and M. van Hulle. A phase-based approach to the estimation of the optical flow field using spatial filtering. TNN, 13(5):1127-1136, 2002.
14. M. O. Jewell. Motivated Music: Automatic Soundtrack Generation for Film. PhD thesis, Univ. of Southampton, 2007.
15. A. Mood, F. Graybill, and C. Boes. Introduction to the Theory of Statistics. McGraw-Hill, 3 ed., 1974.
16. P. Mulhem, M. Kankanhalli, J. Yi, and H. Hassan. Pivot vector space approach for audio-video mixing. IEEE MultiMedia, 10(2):28-40, 2003.
17. F. Nack and A. Parkes. The application of video semantics and theme representation in automated video editing. Multimedia Tools Appl., 4(1):57-83, 1997.
18. M. Nayak, S. Srinivasan, and M. Kankanhalli. Music synthesis for home videos: an analogy based approach. In Pacific Rim Conf. on Multimedia, volume 3, pages 1556-1560, 2003.
19. S. Prince. Movie and meaning - An introduction to film. Allyn and Bacon, 2000.
20. A. Rodà and S. Canazza. Virtual performance, actual gesture: A web 2.0 system for expressive performance of music contents. In Human System Interactions, pages 474-480, 2009.
21. W. Sack and M. Davis. Idic: Assembling video sequences from story plans and content annotations. In Int. Conf. on Multimedia Computing and Systems, pages 30-36, 1994.
22. A. Salway and M. Graham. Extracting information about emotions in films. In ACM MM, pages 299-302, 2003.
23. B. T. Truong, S. Venkatesh, and C. Dorai. Application of computational media aesthetics methodology to extracting color semantics in film. In ACM MM, pages 339-342, 2002.
24. G. Tzanetakis and P. Cook. Musical genre classification of audio signals. IEEE Transactions on SAP, 10(5):293-302, 2002.
25. J.-C. Yoon, I.-K. Lee, and S. Byun. Automated music video generation using multi-level feature-based segmentation. Multimedia Tools Appl., 41(2):197-214, 2009.
26. H. Zettl. Sight, sound, motion: Applied media aesthetics. Wadsworth Pub., 1999.