Title: GPU accelerated video super resolution using transformed spatio-temporal exemplars
Authors: Chaitanya Pavan Tanay Kondapalli; Srikanth Khanna; Venkatachalam Chandrasekaran; Pallav Kumar Baruah; Diwakar Kartheek Pingali; Sai Hareesh Anamandra
Addresses: Department of Mathematics and Computer Science, Sri Sathya Sai Institute of Higher Learning, Puttaparthi, Andhra Pradesh 515134, India ' Department of Mathematics and Computer Science, Sri Sathya Sai Institute of Higher Learning, Puttaparthi, Andhra Pradesh 515134, India ' Department of Mathematics and Computer Science, Sri Sathya Sai Institute of Higher Learning, Puttaparthi, Andhra Pradesh 515134, India ' Department of Mathematics and Computer Science, Sri Sathya Sai Institute of Higher Learning, Puttaparthi, Andhra Pradesh 515134, India ' Department of Mathematics and Computer Science, Sri Sathya Sai Institute of Higher Learning, Puttaparthi, Andhra Pradesh 515134, India ' GE Global Research, Bangalore, Karnataka 560066, India
Abstract: Super-resolution (SR) is the method of obtaining high-resolution (HR) images or image sequences from one or more low-resolution (LR) images of a scene. Huang et al. in 2015 proposed a transformed self-exemplar internal database technique which takes advantage of fractal nature in an image by expanding patch search space using geometric variations. This method fails if there is no patch redundancy within and across image scales and also if there is a failure in detecting vanishing points (VP) which are used to determine perspective transformation between LR image and its sub-sampled form. In this paper, we expand the patch search space by taking advantage of temporal dimension of image frames in the scene video and also use an efficient vanishing point (VP) detection technique by Lezama et al. in 2014 and are thereby able to successfully super-resolve even the failure cases of Huang et al. and an overall improvement in PSNR. We also focused on reducing the computation time by exploiting the embarrassingly parallel nature of the algorithm. We achieved a speedup of six on multi-core, up to 11 on GPU, around 16 on hybrid platform of multi-core and GPU by parallelising the proposed algorithm. Using our hybrid implementation, we achieved 32x super-resolution factor in limited time.
Keywords: super resolution; self-exemplar; perspective geometry; temporal dimension; vanishing point; GPU; multi-core.
DOI: 10.1504/IJGUC.2019.100860
International Journal of Grid and Utility Computing, 2019 Vol.10 No.4, pp.295 - 307
Received: 01 Mar 2017
Accepted: 06 Apr 2017
Published online: 19 Jul 2019 *