Reinforcement learning for dynamic multimedia adaptation

Journal of Network and Computer Applications

Volumn 30, Issue 3, 2007, Pages 1034-1058

  Charvillat, Vincent ^a   Grigoraş, Romulus ^a  

^a IRIT   (France)

Author keywords

Markov decision process; Multimedia adaptation; Prefetching policies; Reinforcement learning; Ubiquitous streaming

Indexed keywords

COMPUTER SIMULATION; DECISION THEORY; MARKOV PROCESSES; PROBLEM SOLVING; REINFORCEMENT LEARNING; UBIQUITOUS COMPUTING;

MARKOV DECISION PROCESS; MULTIMEDIA ADAPTATION; PREFETCHING POLICIES; UBIQUITOUS STREAMING;

MULTIMEDIA SERVICES;

EID: 33947678716     PISSN: 10848045     EISSN: 10958592     Source Type: Journal    
DOI: 10.1016/j.jnca.2005.12.010     Document Type: Article

References (37)

1. Apteker R.T., Fisher J.A., Kisimov V.S., and Neishlos H. Video acceptability and frame rate. IEEE MultiMedia 2 3 (1995) 32-40
2. Asadi MK. Multimedia content adaptation with mpeg-21. PhD thesis, ENST Paris; June 2005.
3. Asadi M.K., and Dufourd J.-C. Multimedia adaptation by transmoding in mpeg-21. Proceedings of the international workshop on image analysis for multimedia interactive services (WIAMIS'04) (2004)
4. Bellman R.E. Dynamic programming (1957), Princeton University Press, Princeton, NJ
5. Bertsekas D., and Tsitsikis J. Neurodynamic programming (1996), Athena Scientific, Belmond, MA
6. Bra PD, Stash N. Multimedia adaptation using AHA!. In: ED-MEDIA 2004 conference, Lugano, Switzerland; 2004.
7. Brunie L., Kosch H., and Mostefaoui A. Semantic based prefetching in news-on-demand video servers. Multimedia Tools Appl J 18 2 (2002) 159-179
8. Brusilovsky P. Adaptive hypermedia. User Modeling User-Adapted Interaction 11 1-2 (2001)
9. Brusilovsky P., and Maybury M.T. From adaptive hypermedia to the adaptive web. Commun ACM 45 5 (2002) 30-33
10. Chen S., Wang H., Zhang X., Shen B., and Wee S. Segment-based proxy caching for internet streaming media delivery. IEEE Multimedia 12 3 (2005) 59-67
11. Divakaran A., Peker K.A., Radhakrishnan R., Xiong Z., and Cabasson R. Video summarization using MPEG-7 motion activity and audio descriptors in video mining (2003), Kluwer Academic Publishers, Dodrecht
12. Fitzek F.H.P., and Reisslein M. A prefetching protocol for continuous media streaming in wireless environments. IEEE J Sel Areas Commun 19 10 (2001) 2015-2028
13. Ghinea G., and Magoulas G. Quality of service for perceptual considerations: an integrated perspective. Proceedings of IEEE international conference on multimedia & expo (ICME) (2001) 146
14. Girod B., Kalman M., Liang Y.J., and Zhang R. Advances in channel-adaptive video streaming. Proceedings of IEEE international conference on image processing (ICIP) (2002) 1-8
15. Grigoraş R. Hypermedia stream management: optimized prefetching policies and causal ordering. PhD thesis, INP Toulouse France; 2003 [in French].
16. Grigoraş R., Charvillat V., and Douze M. Optimizing hypervideo navigation using a Markov decision process approach. Proceedings of ACM multimedia (2002)
17. Gulliver S.R., Serif T., and Ghinea G. Pervasive and standalone computing: the perceptual effects of variable multimedia quality. Int J Human-Comput Stud 60 5-6 (2004) 640-665
18. Khan J.I., and Tao Q. Partial prefetch for faster surfing in composite hypermedia. Proceedings of the third USENIX symposium on internet technologies and systems (USITS) (2001)
19. Kim T., and Ammar M.H. A comparison of layering and stream replication video multicast schemes. NOSSDAV'01: Proceedings of the 11th international workshop on network and operating systems support for digital audio and video (2001), ACM Press, New York, NY, USA 63-72
20. Kosch H., Moustefaoui A., Bszrmnyi L., and Brunie L. Heuristics for optimizing multi-clip queries in video databases. Multimedia Tools Appl 22 3 (2004) 253-262
21. Kosch H., Boszormenyi L., Doller M., Libsie M., and Schojer P. The life cycle of multimedia metadata. IEEE Multimedia 12 1 (2005) 80-86
22. Kunz T. Mobile code middleware for mobile multimedia information access. ACM SIGMOBILE Mobile Comput Commun Rev Arch 6 4 (2002) 68-70
23. Layaida O., Atallah S.B., and Hagimont D. A framework for the dynamic configuration and reconfiguration of network-based media adaptation. J Internet Technol 5 4 (2004) [Special Issue on Real time media delivery over the Internet]
24. Lemlouma T., and Layaida N. Media resources adaptation for limited devices. Proceedings of the seventh international conference on electronic publishing (ICCC/IFIP) (2003) 209-218
25. Lemlouma T., and Layaida N. Encoding multimedia presentation for user preferences and limited environments. Proceedings of IEEE international conference on multimedia & expo (ICME) (2003) 165-168
26. Margaritidis M., and Polyzos G.C. Adaptation techniques for ubiquitous internet multimedia. J Wireless Commun Mobile Comput 1 2 (2000) 141-163
27. Puterman M. Markov decision processes: discrete stochastic dynamic programming. 1st ed. (1994), Wiley-Interscience, New York
28. Rejaie R., Yu H., Handley M., and Estrin D. Multimedia proxy caching mechanism for quality adaptive streaming applications in the internet. Proceedings of INFOCOM vol. 2 (2000) 980-989
29. Ruiz P.M., Botia J., and Gomez-Skarmeta A. Seamless multimedia communications in heterogeneous mobile access networks. Proceedings of Terena networking conference (2004) 36-44
30. Ruiz P.M., Botia J., and Gomez-Skarmeta A. Providing qos through machine learning driven adaptive multimedia applications. IEEE Trans Syst Man Cybernet 34 3 (2004) 1398-1411
31. Sen S., Rexford J., and Towsley D.F. Proxy prefix caching for multimedia streams. Proceedings of INFOCOM vol. 3 (1999) 1310-1319
32. Sutton R.S., and Barto A.G. Reinforcement learning: an introduction (1998), MIT Press, Cambridge, MA
33. Syeda-Mahmood T. Learning and tracking browsing behavior of users using hidden markov models. Proceedings of IBM make it easy conference (2001)
34. Timmerer C., and Hellwagner H. Interoperable adaptive multimedia communication. IEEE MultiMedia 12 1 (2005) 74-79
35. Wijesekera D., Srivastava J., Nerode A., and Foresti M. Experimental evaluation of loss perception in continuous media. Multimedia Syst 7 6 (1999) 486-499
36. Yu F., Zhang Q., Zhu W., and Zhang Y. Qos-adaptive proxy-caching for multimedia streaming over the internet. IEEE Trans Circuits Syst Video Technol 13 3 (2003) 257-269
37. Zukerman I., and Albrecht D. Predictive statistical models for user modeling. User Modeling User-Adapted Interact 11 1-2 (2001) 5-18