Parallel, massive processing in SuperMatrix: a general tool for distributional semantic analysis of corpora Online publication date: Thu, 07-Feb-2013
by Bartosz Broda; Maciej Piasecki
International Journal of Data Mining, Modelling and Management (IJDMMM), Vol. 5, No. 1, 2013
Abstract: This article presents an extended version of the SuperMatrix system - a general tool supporting automatic acquisition of lexical semantic relations from corpora. Extensions focus mainly on parallel processing of massive amounts of data. The construction of the system is discussed. Three distributed parts of the system are presented, i.e., distributed construction of co-incidence matrices from corpora, computation of similarity matrix and parallel solving of synonymy tests. An evaluation of a proposed approach to parallel processing is shown. Parallelisation of similarity matrix computation demonstrates almost linear speedup. The smallest improvements were achieved for construction of matrices, as this process is mostly bound by reading huge amounts of data. Areas of application of the system are described.
Online publication date: Thu, 07-Feb-2013
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Data Mining, Modelling and Management (IJDMMM):
Login with your Inderscience username and password:
Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.
If you still need assistance, please email firstname.lastname@example.org