Title: Assessment of deep learning algorithms for damage segmentation in Indian murals

Authors: Anshul Kumar Yadav; Ronit Kunkolienker; Dhiraj

Addresses: CSIR-Central Electronics Engineering Research Institute (CSIR-CEERI), Pilani, Rajasthan, 333031, India ' BITS Pilani, KK Birla Goa Campus, Sancoale, Goa, 403726, India ' CSIR-Central Electronics Engineering Research Institute (CSIR-CEERI), Pilani, Rajasthan, 333031, India; Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, Uttar Pradesh, 201002, India

Abstract: Murals on walls of the havelis in Rajasthan have become damaged, and image inpainting has emerged as a potent solution to the problem. Masking damage is a crucial step for inpainting algorithms to avoid learning from damaged regions. Therefore, this study focuses on damage identification, utilising prominent architectures, including U-Net and its derivatives, as well as adversarial networks. The study also explores the effect of dense conditional random field (dCRF) and major voting ensemble algorithm. The results show that using dCRF modelling and an ensemble approach improves the average structural similarity index measure (SSIM) score from 0.9672 to 0.9703 for the test dataset. Alone, dCRF improves the output of the worst-performing model, Pix2Pix (modified), by 5.02%. The suggested method also outperforms the generic adversarial image translation networks for mural damage segmentation on the test dataset by up to 5.45% in the mIoU and 3.61% in the mean DSC score.

Keywords: damage annotation; mural restoration; convolutional neural networks; generative adversarial networks; ensemble learning.

DOI: 10.1504/IJART.2025.150017

International Journal of Arts and Technology, 2025 Vol.15 No.4, pp.393 - 413

Received: 14 Oct 2024
Accepted: 20 Dec 2024
Published online: 21 Nov 2025 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article