Medical QoS provision based on reinforcement learning in ultrasound streaming over 3.5G wireless systems

IEEE Journal on Selected Areas in Communications

Volumn 27, Issue 4, 2009, Pages 566-574

  Istepanian, Robert ^a   Philip, Nada ^a   Martini, Maria ^a  

^a KINGSTON UNIVERSITY   (United Kingdom)

Author keywords

Q learning; medical video streaming; wireless telemedicine; m health; rate control; medical QoS; robotic ultrasonography

Indexed keywords

4G WIRELESS NETWORKS; EXPERIMENTAL STUDIES; MHEALTH; MOBILE HEALTH CARE; MULTI OBJECTIVE; OPTIMAL RATE; PERFORMANCE IMPROVEMENTS; Q-LEARNING MEDICAL VIDEO STREAMING WIRELESS TELEMEDICINE M-HEALTH RATE-CONTROL MEDICAL QOS ROBOTIC ULTRASONOGRAPHY; QOS REQUIREMENTS; RATE-CONTROL MECHANISM; TELEMEDICAL APPLICATIONS; VIDEO IMAGE; WIRELESS SYSTEMS;

ACOUSTIC STREAMING; ACOUSTIC WAVES; DISTRIBUTED COMPUTER SYSTEMS; EDUCATION; ENCODING (SYMBOLS); HEALTH; REINFORCEMENT; ROBOTICS; TELEMEDICINE; ULTRASONIC IMAGING; ULTRASONICS; ULTRASONOGRAPHY; VIDEO STREAMING; VIDEOTEX; WIRELESS NETWORKS;

QUALITY OF SERVICE;

EID: 67349180186     PISSN: 07338716     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSAC.2009.090517     Document Type: Article

References (39)

1. R. S. H. Istepanian, S. Laxminarayan, and C. C. Pattichis, M-Health - Emerging Mobile Health Systems,Springer, 2006.
2. R. S. H. Istepanian, E. Jovanov, and Y. T. Zhang, "m-health: Beyond seamless mobility for global wireless healthcare connectivity - Editorial," IEEE Trans. Information Technology in Biomedicine,vol. 8, no. 4, pp. 405-414, Dec 2004.
3. M. G. Martini, "Wireless broadband multimedia health services: Current status and emerging concepts," in Proc. IEEE Personal Indoor and Mobile Radio Communications (PIMRC),Cannes, France, Sept. 2008.
4. M. G. Martini and M. Mazzotti, "Quality-driven wireless video transmission for medical applications," in IEEE Engineering in Medicine and Biology Conference (EMBC) 2006,New York, USA, Aug. 2006.
5. M. G. Martini, R. S. H. Istepanian, M.Mazzotti, and N.Philip, "Robust multi-layer control for enhanced wireless tele-medical video streaming," IEEE Trans. on Mobile Computing,2009, in press.
6. N. Xiong, A. V. Vasilakos, L. T. Yang, L. Song, Y. Pan, R. Kannan, and Y. Li, "Comparative analysis of quality of service and memory usage for adaptive failure detectors in healthcare systems," IEEE Journal on Sel. Areas in Communications,May 2009.
7. H. Holma and A. Toskala, HSDPA/HSUPA for UMTS - High Speed Radio Access for Mobile Communications, Wiley, John & Sons Ltd, 2006.
8. 3GPP TS 25.308 V5.4.0 (2002-10) High Speed Downlink Packet Access (HSDPA) Stage 2 - Release 5
9. S. A. Garawi, R. S. H. Istepanian, and M. A. Abu-Rgheff, "3G wireless communication for mobile robotic tele-ultrasonography systems," IEEE Comms Mag, vol. 44, no. 4, pp. 91-96, April 2006.
10. F. Courreges, P. Vieyres, R. S. H. Istepanian, P. Arbeille, and C. Bru, "Clinical trials and evaluation of a mobile, robotic tele-ultrasound system," Journal of Telemedicine and Telecare (JTT),vol. 11, no. 1, pp. 46-49, 2005.
11. A. Jamalipour, The Wireless Mobile Internet: Architectures, Protocols, and Services,John Wiley & Sons, 2003.
12. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: from error measurement to structural similarity," IEEE Trans Image Processing,vol. 13, no. 4, pp. 600-612, 2004.
13. D. S. Hands, Q. Huynh-Thu, A. W. Rix, A. G. Davis, and R. M. Voel-cker, "Objective perceptual quality measurement of 3G video services,"in IEE Fifth International Conference on 3G Mobile communication Technologies,London, UK, Oct. 2004.
14. S. Floyd et al., "Equation-based congestion control for unicast applications," ACM SIGCOMM,Aug. 2000.
15. Y. Chen, C. Chang, and F. Ren, "Q-learning-based multirate transmission control scheme for RRM in multimedia WCDMA systems," IEEE Transactions on Vehicular Technology,vol. 53, no. 1, pp. 38-48, January 2004.
16. F. Yang, Q. Zhang, W. Zhu, and Y. Zhang, "End-to-end TCP-friendly streaming protocol and bit allocation for scalable video over wireless internet," IEEE Journal on Selected Areas in Communications,vol. 22, no. 4, pp. 777-790, May 2004.
17. H. Balakrishnan, "A comparison of mechanisims for improving TCP performance over wireless links," IEEE/ACM Transactions on Networking,vol. 5, no. 6, pp. 256-269, 1997.
18. H. Balakrishnan and R. Katz, "Explicit loss notification and wireless web performance," in Proc. IEEE Globecom Internet Mini-Conference,Sydney, Australia, 1998.
19. J. Tang, "RCS: A rate control scheme for real time traffic in networks with high bandwidth delay products and high bit error rates," Proc IEEE Infocom 2001,pp. 114-122, 2001.
20. S. Cen, P. Cosman, and G. Voelker, "End-to-end differentiation of congestion and wireless losses," IEEE/ACM Transactions on Networking,vol. 11, no. 5, pp. 703-717, 2003.
21. M. Chen and A. Zakhor, "Rate control for streaming video over wireless," IEEE Wireless Communications,vol. 12, no. 4, pp. 32-41, 2005.
22. S. Biaz and N. Vaidya, "Discriminating congestion losses from wireless losses using inter-arrival times at the receiver," in IEEE Symp Application-Specific Systems and Software Engineering and Technology,Richardson, TX, 1999, pp. 10-17.
23. D. O'Shaughnessy, Speech Communications: Human and Machine, Chapter 8,Addison-Wesley, 1987.
24. C. Hsu, A. Ortega, and M. Khansari, "Rate control for robust video transmission over burst-error wireless channels," IEEE Journal on Selected Areas in Communications,vol. 17, no. 5, pp. 759-773, May 1999.
25. G. Cheung, W. Tan, and T. Yoshimura, "Real-time video transport optimization using streaming agent over 3G wireless networks," IEEE Transactions on Multimedia,vol. 7, no. 4, pp. 777-785, August 2005.
26. Z. Chen and K. N. Ngan, "Recent advances in rate control for video coding," Signal Processing: Image Communication,vol. 22, no. 1, pp. 19-38, January 2007.
27. P. Chou and Z. Miao, "Rate-distortion optimized streaming of packetized media," IEEE Transactions on Multimedia,vol. 8, no. 2, pp. 390-404, 2006.
28. M. G. Martini, M. Mazzotti, C. Lamy-Bergot, J. Huusko, and P. Amon, "Content adaptive network aware joint optimization of wireless video transmission," IEEE Communications Magazine,vol. 45, no. 1, pp. 84-90, January 2007.
29. T. Stockhammer, M. Hannuksela, and T. Wiegand, "H.264/AVC in wireless environments," IEEE Transactions on Circuits and Systems for Video Technology,vol. 13, no. 7, pp. 657-672, July 2003.
30. C. J. C. H. Watkins and P. Dayan, "Q-learning technical note," Machine Learning,vol. 8, pp. 279-292, 1992.
31. J. Nie and S. Haykin, "A Q-learning-based dynamic channel assignment technique for mobile communication systems," IEEE Transactions on Vehicular Technology,vol. 48, pp. 1676-1687, Sept. 1999.
32. J. F. Whidborne, D. Gu, and I. Postlethwaite, "Simulated annealing for multiobjective control system design," IEE Proc -Control Theory Appl,vol. 144, no. 6, pp. 582-588, November 1997.
33. G. P. Liu, J. B. Yang, and J. F. Whidborne, Multiobjective Optimization and Control,Research Studies Press, 2003.
34. R. E. Bellman and E. Dreyfus, Applied Dynamic Programming,Princeton University Press, 1962.
35. Yoo-Sok Saw, Rate-Quality Optimized Video coding,Kluwer academic Publishers, 1999.
36. Joint Video Team, "Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec H.264 ISO/IEC 14496-10 AVC)", ISO/IEC MPEG and ITU-T VCEG, JVT-G050, 2003.
37. A. H. Sadka, Compressed Video Communications,John Wiley & Sons, 2002.
38. H. Holma and A. Toskala, WCDMAfor UMTS, Radio Access for Third Generation Mobile Communications,John Wiley & Sons, U.K., 2000.
39. T. Tunali and K. Anar, "Adaptive available bandwidth estimation for internet video streaming," Signal Processing: Image Communication, vol. 21, pp. 217-234, 2006.