Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm

Authors

Ruchen Huang
Hongwen He
Xuyang Zhao
Yunlong Wang
Menglin Li

Document Type

Journal Article

Publication Date

2022

Subject Area

mode - bus, place - urban, technology - alternative fuels, economics - operating costs, planning - methods

Keywords

Hybrid electric bus, Energy management, Battery health, Driving cycle construction, Twin delayed deep deterministic policy gradient (TD3)

Abstract

Energy management is critical to reduce energy consumption and extend the service life of hybrid power systems. This article proposes an energy management strategy based on deep reinforcement learning with awareness of battery health for an urban power-split hybrid electric bus. In this article, a specific driving cycle of the test bus route is constructed through a naturalistic data-driven method to evaluate the practical operating costs of the hybrid electric bus accurately. Furthermore, an energy management strategy based on twin delayed deep deterministic policy gradient algorithm considering battery health is innovatively designed to minimize the total operating cost with a tradeoff between fuel consumption and battery degradation. Finally, the superiority of the proposed strategy over other state-of-the-art deep reinforcement learning-based strategies including deep deterministic policy gradient and double deep Q-learning is validated. Simulation results show that the constructed driving cycle can effectively reflect the real traffic conditions of the test bus route, and the proposed strategy can reduce the total operating cost while extending the battery life efficiently. This article makes contribution to the reliable evaluation of the practical operating costs and the extension of the battery life for urban hybrid electric buses through deep reinforcement learning methods.

Rights

Permission to publish the abstract has been given by Elsevier, copyright remains with them.

Comments

Applied Energy Home Page:

http://www.sciencedirect.com/science/journal/03062619

Recommended Citation

Huang, R., He, H., Zhao, X., Wang, Y., & Li, M. (2022). Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm. Applied Energy, Vol. 321, 11935.