Title: Natural language processing systems and Big Data analytics

Authors: Lidong Wang; Guanghui Wang; Cheryl Ann Alexander

Addresses: Department of Engineering Technology, Mississippi Valley State University, USA ' State Key Laboratory of Severe Weather, Chinese Academy of Meteorological Sciences, China ' Technology and Healthcare Solutions, Inc., 1321 Commons, Vicksburg, MS 39180, USA

Abstract: Natural language processing (NLP) systems have been used in text mining including information extraction, topic models, text summarisation, classification, clustering, and opinion mining, etc. Big Data has great impacts on scientific discoveries and value creation. NLP and Big Data analytics can work together and form powerful systems for handling Big Data at massive scales to discover knowledge, perform text analysis and opinion mining, and facilitate decision-making for business and management. This paper introduces methods of NLP, technologies related to Big Data, and some applications of NLP and Big Data. The challenges of NLP and Big Data are discussed. Some technology progress of NLP and Big Data are also presented.

Keywords: big data analytics; NLP; natural language processing; knowledge discovery; artificial intelligence; text mining; stream processing; data mining; real-time systems; text analysis; opinion mining; decision making.

DOI: 10.1504/IJCSYSE.2015.077052

International Journal of Computational Systems Engineering, 2015 Vol.2 No.2, pp.76 - 84

Received: 19 Aug 2015
Accepted: 24 Oct 2015

Published online: 20 Jun 2016 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article