Optimal Data Scheduling and Admission Control for Backscatter Sensor Networks

IEEE Transactions on Communications

Volumn 65, Issue 5, 2017, Pages 2062-2077

  Hoang, Dinh Thai ^a   Niyato, Dusit ^a   Wang, Ping ^a   Kim, Dong In ^b   Le, Long Bao ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b Sungkyunkwan University   (South Korea)

^c INSTITUT NATIONAL DE LA RECHERCHE SCIENTIFIQUE   (Canada)

Author keywords

Backscatter communications; MDPs; passive RFID; Q learning; SARSA with linear function approximation; sensor networks

Indexed keywords

APPROXIMATION ALGORITHMS; BACKSCATTERING; DATA ACQUISITION; LEARNING ALGORITHMS; MARKOV PROCESSES; REINFORCEMENT LEARNING; SCHEDULING; SENSOR NETWORKS; SENSOR NODES;

ADMISSION CONTROL POLICIES; IMPLEMENTATION COST; LINEAR FUNCTIONS; MARKOV DECISION PROCESSES; MDPS; OPTIMIZATION SOLUTION; PASSIVE RFID; Q-LEARNING;

GATEWAYS (COMPUTER NETWORKS);

EID: 85028062832     PISSN: 00906778     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCOMM.2017.2669981     Document Type: Article

References (40)

1. H. Liu, M. Bolic, A. Nayak, and I. Stojmenovic, "Taxonomy and challenges of the integration of RFID and wireless sensor networks," IEEE Netw., vol. 22, no. 6, pp. 26-35, Nov. 2008.
2. E. Kampianakis, J. Kimionis, K. Tountas, C. Konstantopoulos, E. Koutroulis, and A. Bletsas, "Wireless environmental sensor networking with analog scatter radio and timer principles," IEEE Sensors J., vol. 14, no. 10, pp. 3365-3376, Oct. 2014.
3. W. Xu, R. J. Piechocki, and G. Hilton, "Probabilistic data association for wireless passive body sensor networks," in Proc. IEEE 15th Int. Conf. e-Health Netw., Appl. Services, Lisbon, Portugal, Oct. 2013, pp. 140-144.
4. W. C. Wilson and P. D. Juarez, "Emerging needs for pervasive passive wireless sensor networks on aerospace vehicles," in Proc. 5th Int. Conf. Emerg. Ubiquitous Syst. Pervasive Netw., Halifax, NS, Canada, Sep. 2014, pp. 101-108.
5. C. Liu et al., "RSS distribution-based passive localization and its application in sensor networks," IEEE Trans. Wireless Commun., vol. 15, no. 4, pp. 2883-2895, Apr. 2016.
6. K. Finkenzeller, RFID Handbook: Fundamentals and Applications in Contactless Smart Cards, Radio Frequency Identification and Near-Field Communication, 3rd ed. West Sussex, U.K.: Wiley, 2010.
7. I. I. Veen, Q. Liu, P. Pawelczak, and A. Parks, "BLISP: Enhancing backscatter radio with active radio for computational RFIDs," in Proc. IEEE Int. Conf. (RFID), Orlando, FL, USA, May 2016, pp. 1-4.
8. R. Correia, N. B. Carvalho, and S. Kawasaki, "Continuously power delivering for passive backscatter wireless sensor networks," IEEE Trans. Microw. Theory Techn., vol. 64, no. 11, pp. 3723-3731, Nov. 2016.
9. L. Zhang and Z. Wang, "Integration of RFID into wireless sensor networks: Architectures, opportunities and challenging problems," in Proc. 5th Int. Conf. Grid Cooperat. Comput. Workshops, Hunan, China, Oct. 2006, pp. 463-469.
10. O. B. Akan, M. T. Isik, and B. Baykal, "Wireless passive sensor networks," IEEE Commun. Mag., vol. 47, no. 8, pp. 92-99, Aug. 2009.
11. J. Kimionis, A. Bletsas, and J. N. Sahalos, "Increased range bistatic scatter radio," IEEE Trans. Commun., vol. 62, no. 3, pp. 1091-1104, Mar. 2014.
12. N. Fasarakis-Hilliard, P. N. Alevizos, and A. Bletsas, "Coherent detection and channel coding for bistatic scatter radio sensor networking," IEEE Trans. Commun., vol. 63, no. 5, pp. 1798-1810, May 2015.
13. P. N. Alevizos and A. Bletsas, "Noncoherent composite hypothesis testing receivers for extended range bistatic scatter radio WSNs," in Proc. IEEE Int. Conf. Commun. (ICC), London, U.K., Jun. 2015, pp. 4448-4453.
14. G. Vannucci, A. Bletsas, and D. Leigh, "Implementing backscatter radio for wireless sensor networks," in Proc. 18th Annu. IEEE Int. Symp. Pers., Indoor Mobile Radio Commun., Athens, Greece, Sep. 2007, pp. 1-5.
15. A. Bereketli and O. B. Akan, "Communication coverage in wireless passive sensor networks," IEEE Commun. Lett., vol. 13, no. 2, pp. 133-135, Feb. 2009.
16. F. Iannello, O. Simeone, and U. Spagnolini, "Energy management policies for passive RFID sensors with RF-energy harvesting," in Proc. IEEE Int. Conf. Commun., Cape Town, South Africa, May 2010, pp. 1-6.
17. R. Correia, N. B. de Carvalho, G. Fukudat, A. Miyajit, and S. Kawasakit, "Backscatter wireless sensor network with WPT capabilities," in IEEE MTT-S Int. Microw. Symp. Dig., Phoenix, AZ, USA, May 2015, pp. 1-4.
18. R. D. Fernandes, A. S. Boaventura, N. B. Carvalho, and J. N. Matos, "Increasing the range of wireless passive sensor nodes using multisines," in Proc. IEEE Int. Conf. RFID-Technol. Appl., Sitges, Spain, Sep. 2011, pp. 549-553.
19. P. Zhang, P. Hu, V. Pasikanti, and D. Ganesan, "EkhoNet: High speed ultra low-power backscatter for next generation sensors," in Proc. 20th Annu. Int. Conf. Mobile Comput. Netw., Maui, HI, USA, Sep. 2014, pp. 557-568.
20. A. N. Parks, A. Liu, S. Gollakota, and J. R. Smith, "Turbocharging ambient backscatter communication," ACM SIGCOMM Comput. Commun. Rev., vol. 44, no. 4, pp. 619-630, Aug. 2014.
21. P. Zhang, J. Gummeson, and D. Ganesan, "BLINK: A high throughput link layer for backscatter communication," in Proc. 10th Int. Conf. Mobile Syst., Appl., Services, Ambleside, U.K., Jun. 2012, pp. 99-112.
22. J. Gummeson, P. Zhang, and D. Ganesan, "Flit: A bulk transmission protocol for RFID-scale sensors," in Proc. 10th Int. Conf. Mobile Syst., Appl., Services, Lake District, U.K., Jun. 2012, pp. 71-84.
23. J. Ou, M. Li, and Y. Zheng, "Come and be served: Parallel decoding for COTS RFID tags," in Proc. 21st Annu. Int. Conf. Mobile Comput. Netw., Paris, France, Sep. 2015, pp. 500-511.
24. P. Hu, P. Zhang, and D. Ganesan, "Laissez-faire: Fully asymmetric backscatter communication," ACM SIGCOMM Comput. Commun. Rev., vol. 45, no. 4, pp. 255-267, Oct. 2015.
25. J. Wang, H. Hassanieh, D. Katabi, and P. Indyk, "Efficient and reliable low-power backscatter networks," in Proc. ACM SIGCOMM Conf. Appl., Technol., Archit., Protocols Comput. Commun., Helsinki, Finland, Aug. 2012, pp. 61-72.
26. A. Bletsas, S. Siachalou, and J. N. Sahalos, "Anti-collision backscatter sensor networks," IEEE Trans. Wireless Commun., vol. 8, no. 10, pp. 5018-5029, Oct. 2009.
27. M. T. Isik and O. B. Akan, "PADRE: Modulated backscattering-based passive data REtrieval in wireless sensor networks," in Proc. IEEE Wireless Commun. Netw. Conf., Budapest, Hungary, Apr. 2009, pp. 1-6.
28. W. Dabney, "Adaptive step-sizes for reinforcement learning," Ph.D. dissertation, Comput. Sci., Univ. Massachusetts Amherst, MA, USA, May 2014.
29. C. J. C. H. Watkins and P. Dayan, "Q-learning," Mach. Learn., vol. 8, nos. 3-4, pp. 279-292, 1992.
30. S. Singh, T. Jaakkola, M. L. Littman, and C. Szepesvári, "Convergence results for single-step on-policy reinforcement-learning algorithms," Mach. Learn., vol. 38, no. 3, pp. 287-308, Mar. 2000.
31. B. Efron, "Bootstrap methods: Another look at the jackknife," Ann. Statist., vol. 7, no. 1, pp. 1-26, 1979.
32. M. Geist and O. Pietquin, "A brief survey of parametric value function approximation," Supelec Techn. Rep. 57070, Metz, France, Sep. 2010.
33. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
34. J. N. Tsitsiklis and B. V. Roy, "Feature-based methods for large scale dynamic programming," Mach. Learn., vol. 22, nos. 1-3, pp. 59-94, Mar. 1996.
35. A. Geramifard, T. J. Walsh, S. Tellex, G. Chowdhary, N. Roy, and J. P. How, "A tutorial on linear function approximators for dynamic programming and reinforcement learning," Found. Trends Mach. Learn., vol. 6, no. 4, pp. 375-451, 2013.
36. J. C. Butcher, Numerical Methods for Ordinary Differential Equations. Hoboken, NJ, USA: Wiley, 2008.
37. A. Benveniste, M. Métivier, and P. Priouret, "Adaptive algorithms and stochastic approximations," in Application of Mathematics, vol. 22. Berlin, Germany: Springer-Varlag, 1990.
38. D. P. de Farias and B. Van Roy, "On the existence of fixed points for approximate value iteration and temporal-difference learning," J. Optim. Theory Appl., vol. 105, no. 3, pp. 589-608, Jun. 2000.
39. G. H. Golub and C. F. Van Loan, Matrix Computations. Baltimore, MD, USA: The Johns Hopkins Univ. Press, 1996.
40. J. N. Tsitsiklis and B. Van Roy, "An analysis of temporal-difference learning with function approximation," IEEE Trans. Autom. Control, vol. 42, no. 5, pp. 674-690, May 1997.