A reinforcement-learning-based assisted power management with QoR provisioning for human-electric hybrid bicycle

IEEE Transactions on Industrial Electronics

Volumn 59, Issue 8, 2012, Pages 3350-3359

  Hsu, Roy Chaoming ^a   Liu, Cheng Ting ^a   Chan, Din Yuen ^a  

^a NATIONAL CHIAYI UNIVERSITY   (Taiwan)

Author keywords

Assisted power management; human electric hybrid bicycle; quality of riding (QoR); reinforcement learning (RL)

Indexed keywords

ACHIEVABILITY; MOTOR POWER; PEDAL FORCES; POWER MANAGEMENTS; POWER METHOD;

BICYCLES; ELECTRIC VEHICLES; ENERGY UTILIZATION; REINFORCEMENT LEARNING;

ELECTRIC POWER MEASUREMENT;

EID: 84859710800     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2011.2141092     Document Type: Article

References (33)

1. T. Onoda and T. Gueret, "Fuel efficient road vehicle non-engine components: Potential saving and policy recommendations, " Int. Energy Agency Inf. Paper, pp. 1-24, Oct. 2007.
2. H. Seki, K. Ishihara, and S. Tadakuma, "Novel regenerative braking control of electric power-assisted wheelchair for safety downhill road driving, " IEEE Trans. Ind. Electron., vol. 56, no. 5, pp. 1393-1400, May 2009.
3. C. C. Tsai, H. C. Huang, and S. C. Lin, "Adaptive neural network control of a self-balancing two-wheeled scooter, " IEEE Trans. Ind. Electron., vol. 57, no. 4, pp. 1420-1428, Apr. 2010.
4. A. Emadi, Y. J. Lee, and K. Rajashekara, "Power electronics and motor drives in electric, hybrid electric, and plug-in hybrid electric vehicles, " IEEE Trans. Ind. Electron., vol. 55, no. 6, pp. 2237-2245, Jun. 2008.
5. A. Muetze and Y. C. Tan, "Electric bicycles: A performance evaluation, " IEEE Ind. Appl. Mag., vol. 13, no. 4, pp. 12-21, Jul./Aug. 2007.
6. Y. Tanaka and T. Murakami, "A study on straight-line tracking and posture control in electric bicycle, " IEEE Trans. Ind. Electron., vol. 56, no. 1, pp. 159-168, Jan. 2009.
7. M. Defoort and T. Murakami, "Sliding-mode control scheme for an intelligent bicycle, " IEEE Trans. Ind. Electron., vol. 56, no. 9, pp. 3357-3368, Sep. 2009.
8. E. A. Lomonova, A. J. A. Vandenput, J. Rubacek, B. d'Herripon, and G. Roovers, "Development of an improved electrically assisted bicycle, " in Conf. Rec. IEEE IAS Annu. Meeting, 2002, vol. 1, pp. 384-389. (Pubitemid 35413451)
9. P. Fairley, "China's cyclists take charge: Electric bicycles are selling by the millions despite efforts to ban them, " IEEE Spectr., vol. 42, no. 6, pp. 54-59, Jun. 2005.
10. N. Somchaiwong and W. Ponglangka, "Regenerative power control for electric bicycle, " in Proc. IEEE Int. Joint Conf. SICE-ICASE, 2006, pp. 4362-4365. (Pubitemid 46949602)
11. M. J. Yang, H. L. Jhou, B. Y. Ma, and K. K. Shyu, "A cost-effective method of electric brake with energy regeneration for electric vehicles, " IEEE Trans. Ind. Electron., vol. 56, no. 6, pp. 2203-2212, Jun. 2009.
12. D. Schneider, "Easy rider: Convert your bicycle to a human-electric hybrid, " IEEE Spectr., vol. 46, no. 9, pp. 26-27, Sep. 2009.
13. W. Du, D. Zhang, and X. Zhao, "Research on battery to ride comfort of electric bicycle based on multi-body dynamics theory, " in Proc. IEEE Int. Conf. Autom. Logistics, Aug. 2009, pp. 1722-1726.
14. F. Yu, D. F. Li, and D. A. Crolla, "Integrated vehicle dynamics control-State-of-the art review, " in Proc. IEEE Int. Conf. Veh. Power Propulsion, Sep. 2008, pp. 1-6.
15. J. Cao, H. Liu, P. Li, and D. Brown, "State of the art in vehicle active suspension adaptive control systems based on intelligent methodologies, " IEEE Trans. Intell. Transp. Syst., vol. 9, no. 3, pp. 392-405, Sep. 2008.
16. D. Yin, S. Oh, and Y. Hori, "A novel traction control for EV based on maximum transmissible torque estimation, " IEEE Trans. Ind. Electron., vol. 56, no. 6, pp. 2086-2094, Jun. 2009.
17. J. Park, Z. Chen, L. Kiliaris, M. L. Kuang, M. A. Masrur, A. M. Phillips, and Y. L. Murphey, "Intelligent vehicle power control based on machine learning of optimal control parameters and prediction of road type and traffic congestion, " IEEE Trans. Veh. Technol., vol. 58, no. 9, pp. 4741-4756, Nov. 2009.
18. R. C. Hsu, W. M. Lee, C. T. Liu, and C. H. Chen, "A reinforcement learning based power assisted mechanism with comfort of riding for light electric vehicle, " in Proc. IEEE Int. Conf. Veh. Technol., 2010, pp. 1-5.
19. A. Haddoun, M. E. H. Benbouzid, D. Diallo, R. Abdessemed, J. Ghouili, and K. Srairi, "Modeling, analysis, and neural network control of an EV electrical differential, " IEEE Trans. Ind. Electron., vol. 55, no. 6, pp. 2286-2294, Jun. 2008.
20. A. Chaibet, C. Larouci, and E. Grunn, "An electric simulator of a vehicle transmission chain coupled to a vehicle dynamic model, " in Proc. IEEE IECON, 2008, pp. 1578-1583.
21. C. Larouci, A. Chaibet, and M. Boukhnifer, "A vehicle transmission simulator applied to the automated driving, " in Proc. IEEE Int. Conf. Veh. Technol., 2009, pp. 1-5.
22. K. Masatoku, "Regulations on electric bicycles in Japan, " in Proc. Jpn. Conf. Safety Popularization Elect. Assist Bicycles, 2001, pp. 1-5.
23. L. Cai, A. B. Rad, and W. L. Chan, "An intelligent longitudinal controller for application in semiautonomous vehicles, " IEEE Trans. Ind. Electron., vol. 57, no. 4, pp. 1487-1497, Apr. 2010.
24. T. Li and Y. Fujimoto, "Control system with high-speed and realtime communication links, " IEEE Trans. Ind. Electron., vol. 55, no. 4, pp. 1548-1557, Apr. 2008. (Pubitemid 351585968)
25. S. Cong and Y. Liang, "PID-like neural network nonlinear adaptive control for uncertain multivariable motion control system, " IEEE Trans. Ind. Electron., vol. 56, no. 10, pp. 3872-3879, Oct. 2009.
26. F. Moreno, J. Alarcon, R. Salvador, and T. Riesgo, "Reconfigurable hardware architecture of a shape recognition system based on specialized tiny neural networks with online training, " IEEE Trans. Ind. Electron., vol. 56, no. 8, pp. 3253-3263, Aug. 2009.
27. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey, " J. Artif. Intell. Res., vol. 4, pp. 237-285, 1996. (Pubitemid 126646155)
28. L. Hu, C. Zhou, and Z. Sun, "Estimating biped gait using spline-based probability distribution function with Q-learning, " IEEE Trans. Ind. Electron., vol. 55, no. 3, pp. 1444-1452, Mar. 2008. (Pubitemid 351447585)
29. K. S. Hwang, Y. J. Chen, and C. H. Lee, "Reinforcement learning in strategy selection for a coordinated multirobot system, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 6, pp. 1151-1157, Nov. 2007.
30. C. F. Juang and C. H. Hsu, "Reinforcement ant optimized fuzzy controller for mobile-robot wall-following control, " IEEE Trans. Ind. Electron., vol. 56, no. 10, pp. 3931-3940, Oct. 2009.
31. C. T. Liu and R. C. Hsu, "Adaptive power management based on reinforcement learning for embedded system, " in Proc. Int. Conf. IEA/AIE, Jun. 2008, vol. 5027, pp. 513-522.
32. P. Y. Yin, "Maximum entropy-based optimal threshold selection using deterministic reinforcement learning with controlled randomization, " Signal Process., vol. 82, no. 7, pp. 993-1006, Jul. 2002.
33. V. Trifa, C. Marginean, and E. Trifu, "Contributions regarding the development of a light urban transportation vehicle-Motor and PWM inverter design, " in Proc. IEEE Int. Conf. Optim. Elect. Electron. Equipment, 2008, pp. 307-312.