Article: Real-time speech enhancement using temporal envelope modulation and hybrid neural network algorithms for improved speech-to-text conversion Journal: International Journal of Intelligent Engineering Informatics (IJIEI) 2026 Vol.14 No.2 pp.205 - 230 Abstract: The algorithm converts improved speech into text for speech synthesis applications. This approach combines hybrid neural networks and offers superior quality and intelligibility while minimising word error rates by incorporating temporal envelope modulation analysis at the speech prosody level. The algorithm works with enhanced speech with adaptive gain control having 16-channel BPFs, envelope detectors, and LPFs and combining CNNs and LSTMNs to reduce background noise and enhance accuracy. Then, the output will be text using HMM on the enhanced speech. Various types of noise, such as babble SSN, were tested through experimental evaluations on real-time recorded samples using PRAAT software and TIMIT and Noizeus noise databases at various SNR levels. The algorithm showed a drastic performance improvement, evaluated through PESQ, STOI, and cosine similarity scores, thus showing a gain of 39% in PESQ and 33.3% in STOI. In addition, compared with noisy speech, up to 3% reduction in word error rate was found, along with improved recognition accuracy of spoken words by up to 90% for phrases of 8-10. Inderscience Publishers - linking academia, business and industry through research

Title: Real-time speech enhancement using temporal envelope modulation and hybrid neural network algorithms for improved speech-to-text conversion

Authors: M.R. Anitha; B. Vijayalakshmi

Addresses: Department of Electronics and Communication Engineering, B.S. Abdur Rahman Crescent Institute of Science and Technology, Chennai, Tamil Nadu, India ' Department of Electronics and Communication Engineering, B.S. Abdur Rahman Crescent Institute of Science and Technology, Chennai, Tamil Nadu, India

Abstract: The algorithm converts improved speech into text for speech synthesis applications. This approach combines hybrid neural networks and offers superior quality and intelligibility while minimising word error rates by incorporating temporal envelope modulation analysis at the speech prosody level. The algorithm works with enhanced speech with adaptive gain control having 16-channel BPFs, envelope detectors, and LPFs and combining CNNs and LSTMNs to reduce background noise and enhance accuracy. Then, the output will be text using HMM on the enhanced speech. Various types of noise, such as babble SSN, were tested through experimental evaluations on real-time recorded samples using PRAAT software and TIMIT and Noizeus noise databases at various SNR levels. The algorithm showed a drastic performance improvement, evaluated through PESQ, STOI, and cosine similarity scores, thus showing a gain of 39% in PESQ and 33.3% in STOI. In addition, compared with noisy speech, up to 3% reduction in word error rate was found, along with improved recognition accuracy of spoken words by up to 90% for phrases of 8-10.

Keywords: speech enhancement; convolutional neural network; CNN; speech to text conversion; long short-term memory; LSTM; speech intelligibility; speech quality; temporal envelopes.

DOI: 10.1504/IJIEI.2026.154020

International Journal of Intelligent Engineering Informatics, 2026 Vol.14 No.2, pp.205 - 230

Received: 18 Jun 2024
Accepted: 12 Oct 2024
Published online: 10 Jun 2026 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: Real-time speech enhancement using temporal envelope modulation and hybrid neural network algorithms for improved speech-to-text conversion

Keep up-to-date