Article: Identification based on feature fusion of multimodal biometrics and deep learning Journal: International Journal of Biometrics (IJBM) 2023 Vol.15 No.3/4 pp.521 - 538 Abstract: This paper proposes a novel methodology for individuals identification based on convolutional neural network (CNN) and machine learning (ML) algorithms. The technique is based on fusioning biometric modalities at the feature level. For this purpose, several hybrid multimodal-biometric systems are used as a benchmark to measure accuracy of identification. In these systems, a CNN is used for each modality to extract modality-specific features for pattern of datasets. Machine learning algorithms are used to identify (classify) individuals. In this paper, we emphasise on performing fusion of biometric modalities at the feature level. We propose to apply the proposed algorithms on two challenging databases: FEI face database and IITD Palm Print V1 dataset. The results are showing good accuracies with many proposed multimodal biometric person identification systems. Through experimental runs on several multi-modal systems, it is clearly shown that best identification performance is obtained when using ResNet18 as deep learning tools for feature extraction along with linear discrimination machine learning algorithm. Inderscience Publishers - linking academia, business and industry through research

Title: Identification based on feature fusion of multimodal biometrics and deep learning

Authors: Chahreddine Medjahed; Freha Mezzoudj; Abdellatif Rahmoun; Christophe Charrier

Addresses: EEDIS Laboratory, Department of Computer Science, University of Djillali Liabes, Sidi Bel-Abbes, Algeria ' Department of Computer Science, Hassiba Benbouali University of Chlef, Chlef, Algeria ' Department of Computer Science, The Higher School of Computer Science (ESI-SBA, Algeria), Sidi Bel-Abbes, Algeria ' GREYC Laboratory, Department of Multimedia and Internet, University of Caen Normandie, Caen, France

Abstract: This paper proposes a novel methodology for individuals identification based on convolutional neural network (CNN) and machine learning (ML) algorithms. The technique is based on fusioning biometric modalities at the feature level. For this purpose, several hybrid multimodal-biometric systems are used as a benchmark to measure accuracy of identification. In these systems, a CNN is used for each modality to extract modality-specific features for pattern of datasets. Machine learning algorithms are used to identify (classify) individuals. In this paper, we emphasise on performing fusion of biometric modalities at the feature level. We propose to apply the proposed algorithms on two challenging databases: FEI face database and IITD Palm Print V1 dataset. The results are showing good accuracies with many proposed multimodal biometric person identification systems. Through experimental runs on several multi-modal systems, it is clearly shown that best identification performance is obtained when using ResNet18 as deep learning tools for feature extraction along with linear discrimination machine learning algorithm.

Keywords: biometrics; multi-biometric system; feature level fusion; score level fusion; deep learning; machine learning.

DOI: 10.1504/IJBM.2023.130649

International Journal of Biometrics, 2023 Vol.15 No.3/4, pp.521 - 538

Received: 04 Nov 2021
Accepted: 09 Mar 2022
Published online: 02 May 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: Identification based on feature fusion of multimodal biometrics and deep learning

Keep up-to-date