Title: A dynamic displacement map based on deep Q-network to assist the rendering of stylised 3D models

Authors: Hao Zheng; Houqun Yang; Mengshi Huang; Yizhen Wang

Addresses: School of Computer Science and Technology, Hainan University, Haikou, Hainan, China ' School of Computer Science and Technology, Hainan University, Haikou, Hainan, China ' School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, Sichuan, China ' College of Physics and Electronic Engineering, Hainan Normal University, Haikou, Hainan, China

Abstract: In the process of rendering with NPR, there will often be a problem of reduced perception of the NPR effect caused by the fixed spatial structure of the static mesh. Therefore, this research first establishes a convolutional neural network to conduct supervised training on numerous hand-drawn target stylised images, and perform continuous angle recognition through stylised images then output its angle vector. Secondly, the displacement map is generated in real-time by inputting the observation angle through the fully connected neural network model. After that, the real-time displacement map is sampled to dynamically generate the deformation of the model. In the end, the goal of breaking the model's sense of space and enhancing the NPR rendering effect can be achieved. Besides, the experimental results of this study verify the effectiveness of the method.

Keywords: non-photorealistic rendering; displacement map; stylised rendering; deep reinforcement learning.

DOI: 10.1504/IJWMC.2023.131297

International Journal of Wireless and Mobile Computing, 2023 Vol.24 No.3/4, pp.226 - 234

Received: 23 Sep 2021
Accepted: 02 Apr 2022
Published online: 06 Jun 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article