Multi-armed bandit channel access scheme with cognitive radio technology in wireless sensor networks for the Internet of Things

IEEE Access

Volumn 4, Issue , 2016, Pages 4609-4617

  Zhu, Jiang ^a   Song, Yonghui ^a   Jiang, Dingde ^b   Song, Houbing ^c  

^a CHONGQING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b NORTHEASTERN UNIVERSITY   (China)

^c West Virginia University   (United States)

Author keywords

Channel grouping; Fairness access scheme; I.I.D. multi armed bandit; Modified UCB tuned

Indexed keywords

INTERNET; INTERNET OF THINGS; LEARNING ALGORITHMS; PROBLEM SOLVING; RADIO SYSTEMS; WIRELESS SENSOR NETWORKS; WIRELESS TELECOMMUNICATION SYSTEMS;

ACCESS SCHEMES; CHANNEL-GROUPING; COGNITIVE RADIO TECHNOLOGIES; DISTRIBUTED LEARNING ALGORITHMS; ENVIRONMENT MONITORING; INTERNET OF THING (IOT); MODIFIED UCB-TUNED; MULTI ARMED BANDIT;

COGNITIVE RADIO;

EID: 84988422866     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2016.2600633     Document Type: Article

References (50)

1. L. Mainetti, L. Patrono, and A. Vilei, "Evolution of wireless sensor networks towards the Internet of Things: A survey," in Proc. IEEE Int. Conf. Softw., Telecommun. Comput. Netw., Sep. 2011, pp. 1-6.
2. T. Hua, M. Zheng, J. Tan, L. Zhu, and W. Miao, "Intelligent photovoltaic monitoring based on solar irradiance big data and wireless sensor networks," Ad Hoc Netw., vol. 35, no. 5, pp. 127-136, 2015.
3. B. He and Y. Li, "Big data reduction and optimization in sensor monitoring network," J. Appl. Math., vol. 2014. pp. 1-8, Mar. 2014.
4. Y. Lin, J. Yang, Z. Lv, W. Wei, and H. Song, "A self-assessment stereo capture model applicable to the Internet of Things," Sensors, vol. 15, no. 8, pp. 20925-20944, 2015.
5. R. Roman, C. Alcaraz, J. Lopez, and N. Sklavos, "Key management systems for sensor networks in the context of the Internet of Things," Comput. Elect. Eng., vol. 37, no. 2, pp. 147-159, 2011.
6. J. Yang, S. He, Y. Lin, and Z. Lv, "Multimedia cloud transmission andstorage system based on Internet of Things," Multimedia Tools Appl., pp. 1-16, Oct. 2015.
7. E. Yaacoub, A. Kadri, and A. Abu-Dayya, "Cooperative wireless sensor networks for green Internet of Things," in Proc. 8th ACM Symp. QoS Secur. Wireless Mobile Netw. (Q2SWinet), New York, NY, USA, 2012, pp. 79-80.
8. G. Li and J. Shi, "Wireless sensor network technology and its application potentials for service innovation in supply chain management," Int. J. Appl. Logistics, vol. 1, no. 4, pp. 30-51, 2010.
9. G. G. Messier and I. G. Finvers, "Traffic models for medical wireless sensor networks," IEEE Commun. Lett., vol. 11, no. 1, pp. 13-15, Jan. 2007.
10. Y. Sun et al., "Design of medical wireless sensor network," Adv. Mater. Res., vols. 314-316, pp. 2486-2490, Aug. 2011.
11. D. Goldsmith, F. Liarokapis, G. Malone, and J. Kemp, "Augmented reality environmental monitoring using wireless sensor networks," in Proc. IEEE 12th Int. Conf. Inf. Vis. (IV), London, U.K., Jul. 2008, pp. 539-544.
12. T. Gulrez and M. Kavakli, "Precision position tracking in virtual reality environments using sensor networks," in Proc. IEEE Int. Symp. Ind. Electron. (ISIE), Vigo, Spain, Jun. 2007, pp. 1997-2003.
13. J. Hu, W. Wan, R. Wang, and X. Yu, "Virtual reality platform for smart city based on sensor network and OSG engine," in Proc. IEEE Int. Conf. Audio, Lang. Image Process. (ICALIP), Shanghai, China, Jul. 2012, pp. 1167-1171.
14. M. Othman and K. Shazali, "Wireless sensor network applications: A study in environment monitoring system," Proc. Eng., vol. 41, pp. 1204-1210, Jul. 2012.
15. J. Yang, J. Zhou, Z. Lv, W. Wei, and H. Song, "A real-time monitoring system of industry carbon monoxide based on wireless sensor networks," Sensors, vol. 15, no. 11, pp. 29535-29546, 2015.
16. J. Hwang, C. Shin, and H. Yoe, "Study on an agricultural environment monitoring server system using wireless sensor networks," Sensors, vol. 10, no. 12, pp. 11189-11211, 2010.
17. D. Jiang, Z. Xu, W. Wang, Y. Wang, and Y. Han, "A collaborative multihop routing algorithm for maximum achievable rate," J. Netw. Comput. Appl., vol. 57, pp. 182-191, Nov. 2015.
18. I. F. Akyildiz, T. Melodia, and K. R. Chowdhury, "A survey on wireless multimedia sensor networks," Comput. Netw., vol. 51, no. 4, pp. 921-959, 2007.
19. D. Jiang, Z. Xu, P. Zhang, and T. Zhu, "Atransform domain-based anomaly detection approach to network-wide traffic," J. Netw. Comput. Appl., vol. 40, no. 2, pp. 292-306, Apr. 2014.
20. H. Z. Eldin, M. A. Elhosseini, and H. A. AliAuthor, "Image compression algorithms in wireless multimedia sensor networks: A survey," Ain Shams Eng. J., vol. 6, no. 2, pp. 481-490, 2015.
21. D. Jiang, Z. Xu, Z. Chen, Y. Han, and H. Xu, "Joint time-frequency sparse estimation of large-scale network traffic," Comput. Netw., vol. 55, no. 10, pp. 3533-3547, Oct. 2011.
22. H. Shen, G. Bai, L. Zhao, and Z. Tang, "An adaptive opportunistic network coding mechanism in wireless multimedia sensor networks," Int. J. Distrib. Sensor Netw., vol. 8, no. 12, pp. 1-13, 2012.
23. P. G. V. Naranjo, M. Shojafar, H. Mostafaei, Z. Pooranian, and E. Baccarelli, "P-SEP: A prolong stable election routing algorithm for energy-limited heterogeneous fog-supported wireless sensor networks," J. Supercomput., vol. 72, pp. 1-23, Jun. 2016.
24. B. Wang and K. J. R. Liu, "Advances in cognitive radio networks: A survey," IEEE J. Sel. Topics Signal Process., vol. 5, no. 1, pp. 5-23, Feb. 2011.
25. N. Cordeschi, D. Amendola, M. Shojafar, and E. Baccarelli, "Distributed and adaptive resource management in cloud-assisted cognitive radio vehicular networks with hard reliability guarantees," Veh. Commun., vol. 2, no. 1, pp. 1-12, 2015.
26. T. Haustein et al., "Cognitive wireless communications-A paradigm shift in dealing with radio resources as a prerequisite for the wireless network of the future-An overview on the topic of cognitive wireless technologies," Frequenz, vol. 70, nos. 7-8, pp. 281-288, 2016.
27. D. Jiang, Y. Wang, C. Yao, and Y. Han, "An effective dynamic spectrum access algorithm for multi-hop cognitive wireless networks," Comput. Netw., vol. 19, vol. 84, no. 19, pp. 1-16, Jun. 2015.
28. Z. Lin and M. van der Schaar, "Autonomic and distributed joint routing and power control for delay-sensitive applications in multi-hop wireless networks," IEEE Trans. Wireless Commun., vol. 10, no. 1, pp. 102-113, Jan. 2011.
29. Y. Chen, G. Yu, Z. Zhang, H.-H. Chen, and P. Qiu, "On cognitive radio networks with opportunistic power control strategies in fading channels," IEEE Trans. Wireless Commun., vol. 7, no. 7, pp. 2752-2761, Jul. 2008.
30. D. Jiang, Z. Xu, W. Li, and Z. Chen, "Network coding-based energyefficient multicast routing algorithm for multi-hop wireless networks," J. Syst. Softw., vol. 104, pp. 152-165, Mar. 2015.
31. S. M. Sanchez, R. D. Souza, E. M. G. Fernandez, and V. A. Reguera, "Rate and energy efficient power control in a cognitive radio ad hoc network," IEEE Signal Process. Lett., vol. 20, no. 5, pp. 451-454, May 2013.
32. D. Jiang, Z. Xu, J. Liu, and W. Zhao, "An optimization-based robust routing algorithm to energy-efficient networks for cloud computing," Telecommun. Syst., vol. 63, no. 1, pp. 89-98, Mar. 2015.
33. S. Gao, L. Qian, and D. R. Vaman, "Distributed energy efficient spectrum access in wireless cognitive radio sensor networks," in Proc. IEEE Wireless Commun. Netw. Conf. (WCNC), Las Vegas, NV, USA, Mar. 2008, pp. 1442-1447.
34. J. Yang, B. Chen, J. Zhou, and Z. Lv, "A low-power and portable biomedical device for respiratory monitoring with a stable power source," Sensors, vol. 15, no. 8, pp. 19618-19632, 2015.
35. S. Maghsudi and S. Stanczak, "Hybrid centralized-distributed resource allocation for device-to-device communication underlaying cellular networks," IEEE Trans. Veh. Technol., vol. 65, no. 4, pp. 2481-2495, Apr. 2016.
36. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem," Mach. Learn., vol. 47, no. 2, pp. 235-256, 2002.
37. T. A. Myrvoll and J. E. Håkegård, "Dynamic spectrum access in realistic environments using reinforcement learning," in Proc. Int. Symp. Commun. Inf. Technol. (ISCIT), 2012, pp. 465-470.
38. K. Liu and Q. Zhao, "Distributed learning in cognitive radio networks: Multi-armed bandit with distributed multiple players," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Mar. 2010, pp. 3010-3013.
39. K. Liu and Q. Zhao, "Distributed learning in multi-armed bandit with multiple players," IEEE Trans. Signal Process., vol. 58, no. 11, pp. 5667-5681, Nov. 2010.
40. Y. Xu, J. Wang, Q. Wu, A. Anpalagan, and Y.-D. Yao, "Opportunistic spectrum access in unknown dynamic environment: A game-theoretic stochastic learning solution," IEEE Trans. Wireless Commun., vol. 11, no. 4, pp. 1380-1391, Apr. 2012.
41. S. Vakili, K. Liu, and Q. Zhao, "Deterministic sequencing of exploration and exploitation for multi-armed bandit problems," IEEE J. Sel. Topics Signal Process., vol. 59, no. 3, pp. 1902-1916, Oct. 2013.
42. A. Anandkumar, N. Michael, A. Tang, and A. Swami, "Distributed algorithms for learning and cognitive medium access with logarithmic regret," IEEE J. Sel. Areas Commun., vol. 29, no. 4, pp. 731-745, Apr. 2011.
43. Y. Gai and B. Krishnamachari, "Decentralized online learning algorithms for opportunistic spectrum access," in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2011, pp. 1-6.
44. Y. Gai and B. Krishnamachari, "Distributed stochastic online learning policies for opportunistic spectrum access," IEEE Trans. Signal Process., vol. 62, no. 23, pp. 6184-6193, Dec. 2014.
45. D. Kalathil, N. Nayyar, and R. Jain, "Decentralized learning for multiplayer multiarmed bandits," IEEE Trans. Inf. Theory, vol. 60, no. 4, pp. 2331-2345, Apr. 2014.
46. M. Zandi, M. Dong, and A. Grami, "Decentralized spectrum learning and access adaptive to channel availability distribution in primary network," in Proc. Signal Process. Adv. Wireless Commun. (SPAWC), 2013, pp. 130-134.
47. M. Lelarge, A. Proutiere, and M. S. Talebi, "Spectrum bandit optimization," in Proc. Inf. Theory Workshop (ITW), Sep. 2013, pp. 1-5.
48. P. Tehrani, Q. Zhao, and L. Tong, "Multi-channel opportunistic spectrum access in unslotted primary systems with unknown models," in Proc. Comput. Adv. Multi-Sensor Adapt. Process. (CAMSAP), 2011, pp. 157-160.
49. N. Torabi, K. Rostamzadeh, and V. C. M. Leung, "Rank-optimal channel selection strategy in cognitive networks," in Proc. IEEE Global Commun. Conf. (GLOBECOM), Dec. 2012, pp. 410-415.
50. D. Pollard, Convergence of Stochastic Processes. Berlin, Germany: Springer, 1984.