Title: A text classification network model combining machine learning and deep learning

Authors: Hao Chen; Haifei Zhang; Yuwei Yang; Long He

Addresses: School of Computer and Information Engineering, Nantong Institute of Technology, Nantong 226002, China ' School of Computer and Information Engineering, Nantong Institute of Technology, Nantong 226002, China ' School of Computer and Information Engineering, Nantong Institute of Technology, Nantong 226002, China ' School of Computer and Information Engineering, Nantong Institute of Technology, Nantong 226002, China

Abstract: Text classification is significant in natural language processing tasks, which can deal with a large amount of data scientifically. However, for text feature extraction, it is not easy to simultaneously consider the characteristics of short and long texts. Moreover, it does not reflect the importance of words in the text, resulting in unsatisfactory text classification results. Therefore, this paper proposes a machine learning and deep learning model. Specifically, text features are extracted by joint training, and then an attention mechanism is introduced to classify short texts and long texts. Firstly, the pre-processed data is subjected to term frequency-inverse document frequency, text convolutional neural networks and rotary transformer models for joint extraction of text features. Subsequently, the attention mechanism is introduced for the weight distribution problem after model fusion to improve the focus on keywords. Eventually, the experimental results indicate that the model proposed in this paper has a good effect on long and short-text classification. We achieved 95.8%, 92.5% and 95.4% accuracy on three public datasets, respectively. In this way, the proposed model is significant in text classification.

Keywords: text classification; neural networks; machine learning; deep learning; term frequency-inverse document frequency; TF-IDF; text convolutional neural networks; TextCNN; rotary transformer; RoFormer; attention mechanism.

DOI: 10.1504/IJSNET.2024.137333

International Journal of Sensor Networks, 2024 Vol.44 No.3, pp.182 - 192

Received: 20 Oct 2023
Accepted: 31 Oct 2023
Published online: 12 Mar 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article