Title: Keyword extraction rules based on a part-of-speech hierarchy

Authors: Richard Khoury, Fakhreddine Karray, Mohamed S. Kamel

Addresses: Electrical and Computer Engineering Department, University of Waterloo, 200 University Ave. W., Waterloo, ON, N2L 3G1, Canada. ' Electrical and Computer Engineering Department, University of Waterloo, 200 University Ave. W., Waterloo, ON, N2L 3G1, Canada. ' Electrical and Computer Engineering Department, University of Waterloo, 200 University Ave. W., Waterloo, ON, N2L 3G1, Canada

Abstract: In this paper, we set out to present an original rule learning algorithm for symbolic Natural Language Processing (NLP), designed to learn the rules of extraction of keywords marked in its training sentences. What really sets our methodology apart from other recent developments in the field of NLP is the implementation of a hierarchy of parts-of-speech at the very core of the algorithm. This makes the rules dependent only on the sentence|s structure rather than on context and domain-specific information. The theoretical development and the experimental results support the conclusion that this improved methodology can be used to obtain an in-depth analysis of the text without being limited to a single domain of application. Consequently, it has the advantage of outperforming both traditional statistical and symbolic NLP methodologies.

Keywords: parts of speech hierarchy; knowledge acquisition; keyword extraction; language models; natural language processing; NLP; text analysis; extraction rules; rule learning algorithms.

DOI: 10.1504/IJAMC.2008.018504

International Journal of Advanced Media and Communication, 2008 Vol.2 No.2, pp.138 - 153

Published online: 26 May 2008 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article