Title: A new framework for 3D face reconstruction for self-occluded images

Authors: A. Srinivasan; V. Balamurugan

Addresses: Department of Information Technology, MNM Jain Engineering College, Thorapakkam, OMR Road, Chennai, Tamil Nadu, Pin: 600097, India ' Department of Computer Science and Engineering, Chandy College of Engineering, Chandy Nagar, Mullakkadu, Thoothukudi – 628 005, Tamil Nadu, India

Abstract: Human heads are three-dimensional objects in 3D space with variations in position and in its structure. Consequently, 3D face modelling is largely acknowledged in face recognition application for uncooperative subjects. Structure from motion (SfM), 3D face reconstruction technique model a 3D facial shape by means of multiple 2D images sequence. In view of self-occluded 2D face image, this technique is susceptible to point correspondence error reducing its performance. To eliminate point correspondence error a matrix called shape conversion matrix (SCM) is appraised to obtain the true location of self-occluded facial feature points (FFPs). In the proposed system, a new SfM method called multi-stage linear approach is adopted. A novel face alignment algorithm called RASL is incorporated with the system. A more resourceful feature localisation technique called simultaneous inverse compositional algorithm is modified. A generalised polycube trivariant spline-based 3D dense mean model adaptation is integrated. By applying these methods, a proficient framework for robust 3D face reconstruction for self-occlusion is proposed in this paper.

Keywords: face recognition; occlusion; 3D modelling; face modelling; face reconstruction; self-occluded images; shape conversion matrix; facial feature points; face alignment; feature localisation.

DOI: 10.1504/IJCVR.2013.059108

International Journal of Computational Vision and Robotics, 2013 Vol.3 No.4, pp.308 - 325

Received: 15 Aug 2013
Accepted: 05 Nov 2013

Published online: 18 Jul 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article