A domain-specific metamodel for multimedia processing systems

IEEE Transactions on Multimedia

Volumn 9, Issue 6, 2007, Pages 1284-1298

  Amatriain, Xavier ^a,b  

^a Santa Barbara   (United States)

^b TELEFONICA RESEARCH   (Spain)

Author keywords

Dataflow graphs; Modeling; Multimedia systems; Object oriented methods; Systems engineering; Visual languages

Indexed keywords

COMPUTER PROGRAMMING LANGUAGES; DATA FLOW ANALYSIS; MATHEMATICAL MODELS; MULTIMEDIA SERVICES; SIGNAL PROCESSING; SYSTEMS ENGINEERING;

DATAFLOW GRAPHS; METAMODELS; OBJECT ORIENTED METHODS; VISUAL LANGUAGES;

MULTIMEDIA SYSTEMS;

EID: 34648851354     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.902885     Document Type: Article

References (65)

1. K. Rao, Z. Bojkovic, and D. A. Milovanovic, Multimedia Communication Systems. Techniques, Standards and Networks. Englewood Cliffs, NJ: Prentice-Hall, 2002.
2. M. K. Mandal, Multimedia Signals and Systems. Norwell, MA: Kluwer, 2002.
3. R. Earnshaw and J. Vince, Eds., Multimedia Systems and Applications. New York: Academic, 1995.
4. S. Hashimoto, Ed., Multimedia Modeling. Modeling Multimedia Information and Systems. Singapore: World Scientific, 1995.
5. D. A. Manolescu, "A dataflow pattern language," in Proc. 4th Patt. Lang. Programm. Conf., 1997.
6. P. Arumi, D. Garcia, and X. Amatriain, "A dataflow pattern language for sound and music computing," in Proc. Patt. Lang. Programm. (PloP'06), 2006.
7. C. Hylands et al., "Overview of the Ptolemy Project," Tech. Rep., Dept. Elect. Eng. Comput. Sci., Univ. California, Berkeley, 2003.
8. W. Rowe, "Why system, science and cybernetics?," IEEE Trans. Syst. Cybern., vol. SSC-1, no. 1, pp. 2-3, Nov. 1965.
9. A. Hall and R. Fagen, "Definition of system," in Yearbook of the Society for the Advancement of General Systems Theory. Ann Arbor, MI: General Systems, 1956.
10. E. Seidewitz, "What models mean," IEEE Softw., vol. 20, no. 5, pp. 26-32, Sep./Oct. 2003.
11. S. J. Meiler, A. M. Clark, and T. Futagami, "Model driven development," IEEE Softw., Sep. 2003.
12. A. G. Kleppe, J. Warmer, and W. Bast, MDA Explained: The Model Driven Architecture: Practice and Promise. Boston, MA: Addison-Wesley, 2003.
13. ACM Object Management Group, Unified Modeling Language (UML) Specification: Infrastructure, Version 2.0 Mar. 2006.
14. Object Management Group, Meta Object Facility (MOF) 2.0 Query/View/Transformation Specification Nov. 2005.
15. H. Knublauch, "Ontology-driven software development in the context of the semantic web: An example scenario with protege/owl," in Proc. Int. Workshop Model-Driven Semantic Web, Monterey, CA, 2004.
16. V. Devedzic, "Understanding ontological engineering," Commun. ACM, vol. 45, no. 4, Apr. 2002.
17. S. Cook, "Domain-specific modeling and model driven architecture," MDA J., pp. 2-10, Jan. 2004.
18. X. Amatriain, "An Object-Oriented Metamodel for Digital Signal Processing With a Focus on Audio and Music," Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2005.
19. D. M. Buede, The Engineering Design of Systems. New York: Wiley, 1999.
20. G. Kahn, "The semantics of a simple language for parallel programming," Inf. Process., pp. 471-475, 1974.
21. T. M. Parks, "Bounded Schedule of Process Networks," Ph.D. dissertation, Univ. California, Berkeley, 1995.
22. E. Lee and T. Parks, "Dataflow process networks," Proc. IEEE, vol. 83, no. 5, pp. 773-799, May 1995.
23. H. Storrle, "Semantics and verification of data flow in uml 2.0 activities," Electron. Notes Theoret. Comput. Sci., vol. 127, no. 4, 2005.
24. S. Sauer and G. Engels, "Extending uml for modeling of multimedia applications," in Proc. IEEE Symp. Vis. Lang., 1999, pp. 80-87.
25. D. K. Mellinger, G. E. Garnett, and B. Mont-Reynaud, "Virtual digital signal processing in an object-oriented system," in The Well-Tempered Object. Musical Applications of Object-Oriented Software Technology. Cambridge, MA: MIT Press, 1991, pp. 188-194.
26. E. Gamma, R. Helm, R. Johnson, and J. Vlissides, Design Patterns - Elements of Reusable Object-Oriented Software. Reading, MA: Addison-Wesley, 1995.
27. T. Grotker, R. Schoenen, and H. Meyr, "Unified specification of control and data flow," in Proc. 1997 IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'97), 1997, p. 271.
28. D. Ziegenbein, K. Richter, R. Ernst, L. Thiele, and J. Teich, "Spi - A system model for heterogeneously specified embedded systems," IEEE Trans. Very Large Scale Integration(VLSI), vol. 10, no. 4, pp. 379-389, Aug. 2002.
29. O. Levia and C. Ussery, "Directed control data-flow networks: A new semantic model for the system-on-chip era," in Proc. FDL'99, Lyon, France, Sep. 1999, pp. 548-560.
30. H. W. van Dijk, H. J. Sips, and E. F. Deprettere, "On context-aware process networks," in Proc. . Int. Symp. Mobile Multimed. Appl. (MMSA'02), Dec. 2002.
31. M. Geilen and T. Basten, "Requirements on the execution of kahn process networks," in Proc. Eur. Symp. Programm. Lang. Syst., 2003, pp. 319-334.
32. J. Buck and E. A. Lee, "The token flow model," in Advanced Topics in Dataflow Computing and Multithreading. New York: IEEE Computer Society Press, 1994.
33. E. A. Lee and D. G. Messerschmitt, "Static scheduling of synchronous data flow programs for digital signal processing," IEEE Trans. Comput., vol. 36, no. 1, pp. 24-35, Jan. 1987.
34. N. Burroughs, A. Parkin, and G. Tzanetakis, "Flexible scheduling for dataflow audio processing," in Proc. Int. Comput. Music Conf., 2006, pp. 79-82.
35. M. Zelkowitz and D. Wallace, "Experimental validation in software engineering," Inform. Softw. Technol., vol. 39, no. 11, Nov. 1997.
36. T. R. G. Green and M. Petre, "Usability analysis of visual programming environments: A 'cognitive dimensions' framework," J. Vis. Lang. Comput. vol. 7, no. 2, pp. 131-174, 1996 [Online]. Available: htpp://citeseer.ist.psu.edu/green96usability.html
37. X. Amatriain, P. Arumi, and D. Garcia, "Clam: A framework for efficient and rapid development of cross-platform, audio applications," in Proc. ACM Multimed., 2006.
38. X. Amatriain, "Clam: A framework for audio and music application development," IEEE Softw., vol. 24, no. 1, pp. 82-85, Jan./Feb. 2007.
39. D. Roberts and R. Johnson, "Evolve frameworks into domain-specific languages," in Proc. 3rd Int. Conf. Pattern Languages Programm., Monticello, IL, Sep. 1996.
40. X. Amatriain and P. Arumi, "Developing cross-platform audio and music applications with the CLAM framework," in Proc. Int. Comput. Music Conf., 2005.
41. D. Garcia, P. Arumi, and X. Amatriain, "Visual prototyping of audio applications," in Proc. 2007 Linux Audio Conf., 2007.
42. X. Amatriain, J. Bonada, A. Loscos, and X. Serra, "Spectral processing," in DAFX: Digital Audio Effects (Udo Zoelzer, ed.). New York: Wiley, 2002, pp. 373-438.
43. X. Amatriain, J. Massaguer, D. Garcia, and I. Mosquera, "The CLAM annotator: A cross-platform audio descriptors editing tool," in Proc. 6th Int. Conf. Music Inform. Retrieval, London, U.K., 2005.
44. S. T. Pope and C. Ramakrishnan, "The create signal library ('Sizzle'): Design, issues and applications," in Proc. Int. Comput. Music Conf. (ICMC'03), 2003.
45. S. T. Pope, X. Amatriain, L. Putnam, J. Castellanos, and R. Avery, "Metamoodels and design patterns in CSL4," in Proc. Int. Comput. Music Conf. (ICMC'06), 2006.
46. S. Bray and G. Tzanetakis, "Implicit patching for dataflow-based audio analysis and synthesis," in Proc. Int. Comput. Music Conf. (ICMC'05), 2005.
47. J. Castellanos, "Design of a Framework for Spatial-Audio Rendering," M.S. thesis, Univ. California, Santa Barbara, 2006.
48. J. Prats, "Blackfinger: Artificial Vision and Hand Recognition System," M.S. thesis, Univ. Pompeu Fabra (UPF), Barcelona, Spain, 2006.
49. K. Mayer-Patel and L. Rowe, "Design and performance of the Berkeley continuous media toolkit," in Proc. Multimed. Comput. Network., San Jose, CA, 1997, pp. 194-206.
50. P. Ackermann, "Direct manipulation of temporal structures in a multi-media application framework," in Proc. ACM Multimedia Conf., 1994.
51. A. R. François and G. G. Medioni, "A modular middleware flow scheduling framework," in Proc. ACM Multimedia'00, Los Angeles, CA, Nov. 2000, pp. 371-374.
52. C. J. Lindblad and D. L. Tennenhouse, "The VuSystem: A programming system for compute-intensive multimedia," IEEE J. Select. Areas Commun., vol. 14, no. 7, pp. 1298-1313, Jul. 1996.
53. R. Willrich, P. D. Saqui-Sannes, P. Senac, and M. Diaz, "Multimedia authoring with, hierarchical timed stream Petri nets and java," Multimed. Tools Applic., vol. 16, no. 1-2, pp. 7-27, 2002.
54. G. Tzanetakis and P. Cook, "Marsyas3D: A prototype audio browser-editor using a large-scale immersive visual and audio display," in Proc. Int. Conf. Auditory Display (ICAD), 2001.
55. P. Cook, "Synthesis toolkit in C++," in Proc. 1996 SIGGRAPH, 1996.
56. A. Chaudhary, A. Freed, and M. Wright, "An open architecture for real-time audio processing software," in Proc. Audio Eng. Soc. 107th Conv., 1999, pp. 1-4.
57. V. Lazzarini, "Sound processing with the SndObj library: An overview," in Proc. 4th Int. Conf. Dig. Aud. Effects (DAFX'01), 2001.
58. M. Young, D. Argiro, and S. Kubica, "Cantata: Visual programming environment for the khoros system," Comput. Graph., vol. 29, no. 2, pp. 22-24, 1995.
59. T. Lourens, "TiViPE - Tino's visual programming environment," in Proc. 28th Annu. Int. Comput. Softw. Appl. Conf. (COMPSAC'04), 2004, pp. 10-15.
60. C. Upson et al., "The application visualization system: A computational environment for scientific visualization," IEEE Comput. Graph. Applicat., vol. CGA-9, no. 4, pp. 32-40, Jul. 1989.
61. A. R. François and G. G. Medioni, "A modular software architecture for real-time video processing," in Proc. IEEE Int. Workshop Comput. Vis. Syst., Vancouver, BC, Canada, Jul. 2001, pp. 35-49.
62. S. S. G. Engels, "Object-oriented modeling of multimedia applications," in Handbook of Software Engineering and Knowledge Engineering. Singapore: World Scientific, 2002, vol. 2, pp. 21-53.
63. V. Zivkovic and P. Lieverse, "An overview of methodologies and tools in the field of system-level design," in Proc. Embedded Processor Design Challenges, 2002, pp. 74-88.
64. J. Sztipanovits, G. Karsai, and T. Bapty, "Self-adaptive software for signal processing," Commun. ACM, vol. 41, no. 5, pp. 66-73, May 1998.
65. S. Zachariadis, C. Mascolo, and W. Emmerich, "The satin component system-a metamodel for engineering adaptable mobile systems," IEEE Trans. Softw. Eng., vol. 32, no. 11, pp. 910-927, Nov. 2006.