Title: Object detection method for improving the generalisation of deep reinforcement learning

Authors: Junyu Sun; Fan He; Yong Liu; Menhua Zheng

Addresses: College of Computer and Information Technology, China Three Gorges University, Yichang, Hubei, China ' College of Computer and Information Technology, China Three Gorges University, Yichang, Hubei, China ' Institute of Computer and Information Technology, Beijing, China ' State Grid Hubei Electric Power Co., Ltd., State Grid Jingzhou Power Supply Company, Hebei, Jingzhou, China

Abstract: One key reason for the gap between deep reinforcement learning goals and applications is that trained intelligences overfit local training data features, and models trained with perception-decision in a single network are sensitive to small environmental changes. This restricts the agents from learning real rules from experience. In this paper, we use a target detection model to recognise objects in a visual scene, learn perceptual level knowledge and use the generalisation ability of the target detection model to reduce the observation overfitting of the agent and improve the robustness of the agent in vision. After the object instances are extracted by the target detection model, we use a model structure equipped with a relational inference mechanism to model the relationships between the objects, which further improves the model's ability to generalise to unseen scenes by introducing a relational inductive bias.

Keywords: DRL; DQN; moving object detection; relation network; self-supervised reinforcement learning.

DOI: 10.1504/IJWMC.2025.145473

International Journal of Wireless and Mobile Computing, 2025 Vol.28 No.3, pp.313 - 322

Received: 19 Mar 2024
Accepted: 07 Oct 2024
Published online: 01 Apr 2025 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article