Title: Comparing text corpora via topic modelling

Authors: Fedor Krasnov; Mikhail Shvartsman; Alexander Dimentov

Addresses: Gazpromneft Science and Technology Centre, 75–79 Liter D Moika River Emb., St. Petersburg, 190000, Russia ' National Electronic Information Consortium, Russian State Library, 4/5 Letnikovskaia St., Moscow, 115114, Russia ' National Electronic Information Consortium, Russian State Library, 4/5 Letnikovskaia St., Moscow, 115114, Russia

Abstract: A method is developed for conducting comparative analysis on the content of full text patents collections. Named T4C, the approach is based on topic modelling and machine learning and extends comparative text mining. The idea of T4C was inspired by the possibility of precise topics extracting from a joint collection of texts and following analysing the parts of collection on the topics. The different aspects of meta information of the patents full texts collection are considered. The ownership of a patent in a particular country can be identified with an accuracy of 97.5% by using supervised machine learning. By studying how patents vary with time, those belonging to a specific period can be identified with an accuracy of 85% for a given country. Also developed is a visual representation of the thematic correlation between groups of patents. In terms of the text composition of patent descriptions, Chinese patents differ fundamentally from US patents. T4C method is valid for structured medium-sized collections of texts in English. The experimental results are used to manage the patenting process at GazpromNeft STC.

Keywords: topic modelling; text classification; ARTM; additive regularisation of topic models; PLSA; random forest; comparing text collections.

DOI: 10.1504/IJDMMM.2022.125259

International Journal of Data Mining, Modelling and Management, 2022 Vol.14 No.3, pp.203 - 216

Received: 25 Apr 2019
Accepted: 15 Feb 2020
Published online: 05 Sep 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article