BERTScore for Russian

E. P. Bruches^a, D. T. Baturova^a, I. Yu. Bondarenko<sup>b

a</sup> Siberian Neuronets
^b Novosibirsk State University

Abstract: This paper presents a study on the selection of the most relevant vector representations for texts in Russian, which are used in the BERTScore metric. This metric is used to assess the quality of generated texts, which can be obtained as a result of solving tasks such as automatic text summarization, machine translation, etc.

Keywords: BERTScore metric, text generation, automatic evaluation.

DOI: 10.15514/ISPRAS-2025-37(3)-10