Optimal energy allocation for kalman filtering over packet dropping links with imperfect acknowledgments and energy harvesting constraints

IEEE Transactions on Automatic Control

Volumn 59, Issue 8, 2014, Pages 2128-2143

  Nourian, Mojtaba ^a   Leong, Alex S ^a   Dey, Subhrakanti ^b  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UPPSALA UNIVERSITY   (Sweden)

Author keywords

Dynamic programming; energy harvesting; energy power control; Markov decision processes with imperfect state information; Sensor networks; state estimation with packet dropouts

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); DYNAMIC PROGRAMMING; FADING CHANNELS; MARKOV PROCESSES; SENSOR NETWORKS; STATE ESTIMATION;

FEEDBACK COMMUNICATIONS; OPTIMAL ENERGY ALLOCATIONS; OPTIMAL STATE ESTIMATION; PACKET DROPOUTS; REMOTE STATE ESTIMATIONS; STATE INFORMATION; STOCHASTIC DYNAMICAL SYSTEM; WIRELESS FADING CHANNELS;

ENERGY HARVESTING;

EID: 84905196805     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2014.2319011     Document Type: Article

References (47)

1. I. F. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci, "A survey on sensor networks," IEEE Commun. Mag., vol. 40, no. 8, pp. 102-114, Aug. 2002.
2. E. J. Duarte-Melo and M. Liu, "Data-gathering wireless sensor networks: Organization and capacity," Computer Networks, vol. 43, no. 4, pp. 519-537, 2003.
3. A. LaMarca, W. Brunette, D. Koizumi, M. Lease, S. B. Sigurdsson, K. Sikorski, D. Fox, and G. Borriello, Making Sensor Networks Practical With Robots, vol. 2414. Berlin, Germany: Springer, 2002, pp. 152-166.
4. C.-Y. Chong and S. P. Kumar, "Sensor networks: Evolution, opportunities and challenges," Proc. IEEE, vol. 91, no. 8, pp. 1247-1256, Apr. 2003. (Pubitemid 40890834)
5. V. C. Gungor, B. Lu, and G. P. Hancke, "Opportunities and challenges of wireless sensor networks in smart grid," IEEE Trans. Ind. Electron., vol. 57, no. 10, pp. 3557-3564, Oct. 2010.
6. M. Erol-Kantarci and H. T. Mouftah, "Wireless sensor networks for costefficient residential energy management in the smart grid," IEEE Trans. Smart Grid, vol. 2, no. 2, pp. 314-325, Jun. 2011.
7. S. Roundy, P. K. Wright, and J. M. Rabaey, Energy Scavenging for Wireless Sensor Networks. New York: Springer, 2004.
8. D. Niyato, E. Hossain, M. Rashid, and V. Bhargava, "Wireless sensor networks with energy harvesting technologies: A game-theoretic approach to optimal energy management," IEEE Trans. Wireless Commun., vol. 14, no. 4, pp. 90-96, Aug. 2007. (Pubitemid 47397738)
9. V. Sharma, U. Mukherji, V. Joseph, and S. Gupta, "Optimal energy management policies for energy harvesting sensor nodes," IEEE Trans. Wireless Commun., vol. 9, no. 4, pp. 1326-1336, Apr. 2010.
10. O. Ozel, K. Tutuncuoglu, J. Yang, S. Ulukus, and A. Yener, "Transmission with energy harvesting nodes in fading wireless channels: Optimal policies," IEEE J. Sel. Areas Commun., vol. 29, no. 8, pp. 1732-1743, 2011.
11. C. K. Ho and R. Zhang, "Optimal energy allocation for wireless communications with energy harvesting constraints," IEEE Trans. Signal Process., vol. 60, no. 9, pp. 4808-4818, Sep. 2012.
12. M. Kashef and A. Ephremides, "Optimal packet scheduling for energy harvesting sources on time varying wireless channels," J. Commun. and Networks, vol. 14, no. 2, pp. 121-129, Apr. 2012.
13. A. Nayyar, T. Basar, D. Teneketzis, and V. V. Veeravalli, "Optimal strategies for communication and remote estimation with an energy harvesting sensor," IEEE Trans. Autom. Control, vol. 58, no. 9, pp. 2246-2260, Sep. 2013.
14. B. Sinopoli et al., "Kalman filtering with intermittent observations," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1453-1464, Sep. 2004.
15. X. Liu and A. J. Goldsmith, "Kalman filtering with partial observation losses," in Proc. 43rd IEEE CDC, Bahamas, 2004, pp. 1413-1418.
16. Y. Xu and J. P. Hespanha, "Estimation under uncontrolled and controlled communications in networked control systems," in Proc. 44th IEEE CDC, Seville, Spain, Dec. 2005, pp. 842-847. (Pubitemid 46297072)
17. M. Huang and S. Dey, "Stability of Kalman filtering with Markovian packet losses," Automatica, vol. 43, pp. 598-607, 2007. (Pubitemid 46341248)
18. M. Epstein, L. Shi, A. Tiwari, and R. M. Murray, "Probabilistic performance of state estimation across a lossy network," Automatica, vol. 44, pp. 3046-3053, 2008.
19. L. Schenato, "Optimal estimation in networked control systems subject to random delay and packet drop," IEEE Trans. Autom. Control, vol. 53, no. 5, pp. 1311-1317, 2008.
20. Y. Mo and B. Sinopoli, "A characterization of the critical value for Kalman filtering with intermittent observations," in Proc. 47th IEEE CDC, Cancun, Mexico, 2008, pp. 2692-2697.
21. D. E. Quevedo, A. Ahlén, A. S. Leong, and S. Dey, "On Kalman filtering over fading wireless channels with controlled transmission powers," Automatica, vol. 48, no. 7, pp. 1306-1316, 2012.
22. L. Schenato, B. Sinopoli, M. Franceschetti, K. Poolla, and S. S. Sastry, "Foundations of control and estimation over lossy networks," Proc. IEEE, vol. 95, no. 1, pp. 163-187, Jun. 2007.
23. D. E. Quevedo, A. Ahlén, and J. Østergaard, "Energy efficient state estimation with wireless sensors through the use of predictive power control and coding," IEEE Trans. Signal Process., vol. 58, no. 9, pp. 4811-4823, 2010.
24. A. S. Leong and S. Dey, "Power allocation for error covariance minimization in Kalman filtering over packet dropping links," in Proc. 51st IEEE CDC, Maui, HI, Dec. 2012, pp. 3335-3340.
25. L. Shi, P. Cheng, and J. Chen, "Sensor data scheduling for optimal state estimation with communication energy constraint," Automatica, vol. 47, no. 8, pp. 1693-1698, 2011.
26. Y. Xu and J. H. and, "Optimal communication logics in networked control systems," in Proc. 43rd IEEE CDC, Atlantis, Paradise Islands, Bahamas, Dec. 2004, pp. 3527-3532. (Pubitemid 40286954)
27. C. K. Ho, P. D. Khoa, and P. C. Ming, "Markovian models for harvested energy in wireless communications," in IEEE Int. Conf. Commun. Sys. (ICCS), Singapore, Nov. 2010, pp. 311-315.
28. M. Nourian, A. S. Leong, and S. Dey, "Optimal energy allocation for Kalman filtering over packet dropping links with energy harvesting constraints," in Proc. 4th IFAC NecSys Workshop, Koblenz, Germany, Sep. 2013, pp. 261-268.
29. D. M. Topkis, Supermodularity and Complementarity. Princeton, NJ: Princeton Univ. Press, 2001.
30. S. Cui, J.-J. Xiao, A. Goldsmith, Z.-Q. Luo, and H. V. Poor, "Estimation diversity and energy efficiency in distributed sensing," IEEE Trans. Signal Process., vol. 55, no. 9, pp. 4683-4695, 2007. (Pubitemid 47323639)
31. J. G. Proakis, Digital Communications., 4th ed. New York: McGraw- Hill, 2001.
32. D. E. Quevedo, A. Ahlén, and K. H. Johannson, "State estimation over sensor networks with correlated wireless fading channels," IEEE Trans. Autom. Control, vol. 58, no. 3, pp. 581-593, 2013.
33. T. S. Rappaport, Wireless Communications: Principles and Practice, 2nd ed. Upper Saddle River, NJ: Prentice Hall, 2002.
34. C. Ramesh, H. Sandberg, and K. H. Johansson, "Design of state-based schedulers for a network of control loops," IEEE Trans. Autom. Control, vol. 58, no. 8, pp. 1962-1975, Aug. 2012.
35. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. Hoboken, NJ: Wiley, 2006.
36. O. C. Imer, S. Yüksel, and T. Ba̧sar, "Optimal control of LTI systems over unreliable communication links," Automatica, vol. 42, no. 9, pp. 1429-1439, Sep. 2006. (Pubitemid 44080724)
37. E. Altman, Constrained Markov Decision Processes, vol. 7: CRC Press, 1999.
38. P. R. Kumar and P. Varaiya, Stochastic Systems: Estimation, Identification and Adaptive Control. Englewood Cliffs, NJ: Prentice-Hall, 1986.
39. D. P. Bertsekas, Dynamic Programming and optimal Control, 2nd ed, vol. 1. Belmont, MA: Athena Scientific, 1995.
40. A. Arapostathis, V. S. Borkar, E. Fernández-Gaucherand, M. K. Ghosh, and S. I. Marcus, "Discrete-time controlled markov processes with average cost criterion: A survey," SIAM J. Control Optim., vol. 31, no. 2, pp. 282-344, 1993. (Pubitemid 23641394)
41. H. Yu and D. P. Bertsekas, "Discretized approximations for POMDP with average cost," in Proc. 20th Conf. Uncertainty in Artifical Intelligence, Banff, Canada, 2004, pp. 619-627.
42. D. Simchi-Levi, X. Chen, and J. Bramel, The Logic of Logistics: Theory, Algorithms, Applications for Logistics and Supply Chain Management. Berlin, Germany: Springer-Verlag, 2004.
43. V. Krishnamurthy, R. Bitmead, M. Gevers, and E. Miehling, "Sequential detection with mutual information stopping cost," IEEE Trans. Signal Process., vol. 60, no. 2, pp. 700-714, Feb. 2012.
44. J. C. Spall, Introduction to Stochastic Search and Optimization: Estimation, Simulation, Control. New York: Wiley, 2005.
45. M. Schäl, "Average optimality in dynamic programming with general state space," Mathemat. Oper. Res., vol. 18, no. 1, pp. 163-172, Feb. 1993.
46. M. Huang and S. Dey, "Dynamic quantizer design for hiddenMarkov state estimation via multiple sensors with fusion center feedback," IEEE Trans. Signal Process., vol. 54, no. 8, pp. 2887-2896, 2006. (Pubitemid 44131744)
47. O. Hernández-Lerma and J. B. Lasserre, Discrete-Time Markov Control Processes: Basic Optimality Criteria. New York: Springer-Verlag, 1996.