Opportunistic File Transfer over a Fading Channel: A POMDP Search Theory Formulation with Optimal Threshold Policies

IEEE Transactions on Wireless Communications

Volumn 5, Issue 2, 2006, Pages 394-405

  Krishnamurthy, Vikram ^b  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

ARQ protocol; Gilbert Elliott channel; optimal search theory; Partially observed Markov decision process; threshold policy

Indexed keywords

EID: 85008042438     PISSN: 15361276     EISSN: None     Source Type: Journal    
DOI: 10.1109/TWC.2006.1611063     Document Type: Article

References (23)

1. S. Wicker, Error Control Systems for Digital Communication and Storage. Upper Saddle River, NJ: Prentice Hall, 1995.
2. V. Krishnamurthy, “Algorithms for optimal scheduling and management of hidden markov model sensors,” IEEE Trans. Signal Processing, vol. 50, pp. 1382–1397, June 2002.
3. A. Cassandra, M. Littman, and N. Zhang, “Incremental pruning: A simple fast exact method for partially observed Markov decision processes,” Proc. 13th Annual Conference on Uncertainty in Arficial Intelligence, 1997.
4. L. Stone, “What's happened in search theory since the 1975 Lanchester prize,” Operations Research, vol. 37, pp. 501–506, May-June 1989.
5. S. Ross, Introduction to Stochastic Dynamic Programming. San Diego: Academic Press, 1983.
6. I. MacPhee and B. Jordan, “Optimal search for a moving target,” Probability in the Engineering and Information Sciences, vol. 9, pp. 159–182, 1995.
7. S. Singh and V. Krishnamurthy, “The optimal search for a Markovian target when the search path is constrained: the infinite horizon case,” IEEE Trans. Automat. Contr., vol. 48, pp. 487–492, Mar. 2003.
8. M. Zorzi and R. Rao, “On the statistics of block errors in data transmission over fading channels,” IEEE Trans. Commun., vol. 45, pp. 660–667, June 1997.
9. M. Zorzi and R. Rao, “Error control and energy consumption in communications for nomadic computing,” IEEE Trans. Comput., vol. 46, pp. 279–289, 1997.
10. M. Zorzi, R. Rao, and L. Milstein, “Error statistics in data transmission over fading channels,” IEEE Trans. Commun., vol. 46, pp. 1468–1477, Nov. 1998.
11. J. Cavers, “An analysis of pilot-symbol assisted modulation for Rayleigh fading channels,” IEEE Trans. Veh. Technol., vol. 40, pp. 686–693, Nov. 1991.
12. P. Spasojevic and C. Georghiades, “Complementary sequences for ISI channel estimation,” IEEE Trans. Inform. Theory, vol. 3, pp. 1145–1152, Mar. 2001.
13. L. Tong and S. Perreau, “Multichannel blind identification: From sub-space to maximum likelihood methods,” Proc. IEEE, vol. 86, no. 10, pp. 1951–1968, 1998.
14. H. Wang and N. Mandayam, “Opportunistic file tranfer over a fading channel under energy and delay constraints,” IEEE Trans. Commun., vol. 53, no. 4, pp. 632–644, Apr. 2005.
15. G. Koole, Z. Liu, and R. Righter, “Optimal transmission policies for noisy channels,” Operations Research, vol. 49, pp. 892–899, Nov.-Dec. 2001.
16. D. Zhang and K. M. Wasserman, “Energy efficient data communication over fading channels,” Proc. IEEE Wireless Communcations and Networking Conference, pp. 986–991, 2000.
17. M. Zorzi, R. R. Rao, and L. B. Milstein, “On the accuracy of a first-order Markov model for data transmission on fading channels,” Prof. IEEE Universal Pers. Commun. Conf, pp. 211–215, 1995.
18. S. Pollock, “A simple model of search for a moving target,” Operations Research, vol. 18, pp. 893–903, 1970.
19. D. Bertsekas, Dynamic Programming and Optimal Control, vols. 1 and 2. Belmont, MA: Athena Scientific, 1995.
20. W. Lovejoy, “A survey of algorithmic methods for partially observed Markov decision processes,” Annals of Operations Research, vol. 28, pp. 47–66, 1991.
21. A. Cassandra, “Tony's POMDP page.” Available: http://www.cs.brown.edu/research/ai/pomdp/index.html.
22. W. Lovejoy, “Computationally feasible bounds for partially observed Markov decision processes,” Operations Research, vol. 39, pp. 162–175, Jan.-Feb. 1991.
23. V. Krishnamurthy, “Emission management for low probability intercept sensors in network centric warfare,” IEEE Trans. Aerosp. Electron. Syst., vol. 41, issue 1, pp. 133–151, Jan. 2005.