Extracting the Component Composition Data of Inventions from Russian Patents using Dependency Tree Analysis

The paper presents a methodology for extracting device components and relationships between them from the Russian-language patent claims. Information about the components of the device is the most useful and important part. It can be used in various tasks of patent analysis. The objective of this study is to evaluate the the quality of data extraction using dependency tree analysis for Russian language. The dependency tree for a sentence is the result of syntactic parsing by natural language processing tools. There are several parsers were chosen for comparison: UdPipe, Stanza, DeepPavlov, spaCy and Trankit. The output data are presented in the form of SAO structures (Subject-Action-Object). The quality of data extraction has been evaluated using precision, recall and F1 metrics. For this purpose, 20 patent claims with 252 SAO structures were manually marked. Under the current methodological constraints, on the test dataset, at best we are able to extract 81% of the SAO structures according to the recall metric with a non-strict data evaluation, i.e. without considering the completeness of a noun phrases. The F1-measure is lower and ranges from 48% to 69% depending on evaluation type. The current level of parsers efficiency in the investigated area is summarized. The results can be useful for developing efficient approaches to extracting structured data from patent arrays.