Title: Learning word sense disambiguation in biomedical text with difference between training and test distributions

Authors: Jeong-Woo Son; Seong-Bae Park

Addresses: Department of Computer Engineering, Kyungpook National University, Daegu 702-701, Korea ' Department of Computer Engineering, Kyungpook National University, Daegu 702-701, Korea

Abstract: Word Sense Disambiguation methods based on machine learning techniques with lexical features suffer from the discordance between distributions of the training and test documents, due to the diversity of lexical space. To tackle this problem, this paper proposes Support Vector Machines with Example-wise Weights. In this method, the training distribution is matched with the test distribution by weighting training examples according to their similarity to all test data. The experimental results show the distribution change between the training and test data is actually recognised and the proposed method which considers this change in its training phase outperforms ordinary SVMs.

Keywords: distribution difference; SVM; support vector machines; covariate shift; WSD; word sense disambiguation; robustness; data mining; bioinformatics; biomedical text; biomedical documents; machine learning; training distribution; test distribution.

DOI: 10.1504/IJDMB.2012.048199

International Journal of Data Mining and Bioinformatics, 2012 Vol.6 No.2, pp.216 - 237

Published online: 17 Dec 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article