Title: A dynamic displacement map based on deep Q-network to assist the rendering of stylised 3D models
Authors: Hao Zheng; Houqun Yang; Mengshi Huang; Yizhen Wang
Addresses: School of Computer Science and Technology, Hainan University, Haikou, Hainan, China ' School of Computer Science and Technology, Hainan University, Haikou, Hainan, China ' School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, Sichuan, China ' College of Physics and Electronic Engineering, Hainan Normal University, Haikou, Hainan, China
Abstract: In the process of rendering with NPR, there will often be a problem of reduced perception of the NPR effect caused by the fixed spatial structure of the static mesh. Therefore, this research first establishes a convolutional neural network to conduct supervised training on numerous hand-drawn target stylised images, and perform continuous angle recognition through stylised images then output its angle vector. Secondly, the displacement map is generated in real-time by inputting the observation angle through the fully connected neural network model. After that, the real-time displacement map is sampled to dynamically generate the deformation of the model. In the end, the goal of breaking the model's sense of space and enhancing the NPR rendering effect can be achieved. Besides, the experimental results of this study verify the effectiveness of the method.
Keywords: non-photorealistic rendering; displacement map; stylised rendering; deep reinforcement learning.
DOI: 10.1504/IJWMC.2023.131297
International Journal of Wireless and Mobile Computing, 2023 Vol.24 No.3/4, pp.226 - 234
Received: 23 Sep 2021
Accepted: 02 Apr 2022
Published online: 06 Jun 2023 *