Training and evaluation of TreeTagger on Amazigh corpus Online publication date: Wed, 24-Jul-2019
by Amri Samir; Zenkouar Lahbib
International Journal of Intelligent Enterprise (IJIE), Vol. 6, No. 2/3/4, 2019
Abstract: Part-of-speech (POS) tagging has high importance in the domain of natural language processing (NLP). POS tagging determines grammatical category to any token, such as noun, verb, adjective, person, gender, etc. Some of the words are ambiguous in their categories and what tagging does is to clear of ambiguous word according to their context. Many taggers are designed with different approaches to reach high accuracy. In this paper we present a Machine Learning algorithm, which combines decision trees model and HMM model to tag Amazigh unknown words. In case of statistical methods such as TreeTagger, this will have added practical advantages also. This paper presents creation of a POS tagged corpus and evaluation of TreeTagger on Amazigh text. The results of experiments on Amazigh text show that TreeTagger provides overall tagging accuracy of 93.19%, specifically, 94.10% on known words and 70.29% on unknown words.
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Intelligent Enterprise (IJIE):
Login with your Inderscience username and password:
Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.
If you still need assistance, please email subs@inderscience.com