Title: Syntactic concordancing and multi-word expression detection

Authors: V. Seretan; E. Wehrli

Addresses: Institute for Language, Cognition and Computation, Human Communication Research Centre, University of Edinburgh, 10 Crichton Street, Edinburgh EH8 9AB, UK ' Language Technology Laboratory, Department of Linguistics, University of Geneva, 5 rue de Candolle, CH-1211 Geneva, Switzerland

Abstract: Concordancers are tools that display the contexts of a given word in a corpus. Also called key word in context (KWIC), these tools are nowadays indispensable in the work of lexicographers, linguists, and translators. We present an enhanced type of concordancer that integrates syntactic information on sentence structure as well as statistical information on word cooccurrence in order to detect and display those words from the context that are most strongly related to the word under investigation. This tool considerably alleviates the users' task, by highlighting syntactically well-formed word combinations that are likely to form complex lexical units, i.e., multi-word expressions. One of the key distinctive features of the tool is its multilingualism, as syntax-based multi-word expression detection is available for multiple languages and parallel concordancing enables users to consult the version of a source context in another language, when multilingual parallel corpora are available. In this article, we describe the underlying methodology and resources used by the system, its architecture, and its recently developed online version. We also provide relevant performance evaluation results for the main system components, focusing on the comparison between syntax-based and syntax-free approaches.

Keywords: collocation extraction; collocations; concordancers; key word in context; KWIC; lexical acquisition; lexical resources; linguistic analysis; multilingualism; multi-word expression detection; multi-word expressions; MWE; natural language processing; NLP; parallel concordancing tool; syntactic analysis; syntactic concordancing; syntax; translation; word cooccurrence.

DOI: 10.1504/IJDMMM.2013.053694

International Journal of Data Mining, Modelling and Management, 2013 Vol.5 No.2, pp.158 - 181

Published online: 29 Jul 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article