Title: Multi-objective control and energy management strategy based on deep Q-network for parallel hybrid electric vehicles

Authors: Shiyi Zhang; Jiaxin Chen; Xiaolin Tang

Addresses: School of Automotive Engineering, Chongqing Jiaotong University, Chongqing, 400074, China ' School of Automotive Engineering, Chongqing Jiaotong University, Chongqing, 400074, China ' School of Automotive Engineering, Chongqing Jiaotong University, Chongqing, 400074, China

Abstract: To promote the energy management strategy of hybrid electric vehicles towards the direction of intelligence, this paper proposes a control model to design the learning-based energy management strategy for a parallel hybrid electric vehicle, which uses the deep Q-network (DQN) algorithm of deep reinforcement learning to control the engine and continuously variable transmission (CVT) synchronously. After completing the offline training of the control model, the near-optimal control strategy fitted by the neural network parameters is saved, and it is loaded and tested directly during the online test, which can reflect if the neural network has learned the mapping relationship between a random state and the optimal action. The simulation result of the online test shows that the DQN-based EMS can achieve a fuel economy of 5.31L/100km, and the consuming time is 1.67s when running the testing cycle of 1686s, which can ensure the real-time application potential, adaptability, and robustness.

Keywords: hybrid electric vehicle; multi-objective control; energy management strategy; deep reinforcement learning.

DOI: 10.1504/IJVP.2022.125943

International Journal of Vehicle Performance, 2022 Vol.8 No.4, pp.371 - 386

Received: 09 Dec 2020
Accepted: 08 Apr 2021
Published online: 04 Oct 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article