SYSTEM ANALYSIS, INFORMATION MANAGEMENT AND PROCESSING, STATISTICS

Analysis of software code preprocessing methods to improve the effectiveness of using large language models in vulnerability detection tasks

V. V. Charugin, V. V. Charugin, A. V. Stavtsev, A. N. Chesalin

MIREA – Russian Technological University

Abstract: As software systems grow in scale and complexity, the need for intelligent methods of vulnerability detection increases. One such method involves the use of large language models trained on source code, which are capable of analyzing and classifying vulnerable code segments at early stages of development. The effectiveness of these models depends on how the code is represented and how the input data is prepared. Preprocessing methods can significantly impact the accuracy and robustness of the model. The purpose of the study: to analyze the impact of various code preprocessing methods on the accuracy and robustness of large language models (CodeBERT, GraphCodeBERT, UniXcoder) in vulnerability detection tasks. The analysis is conducted using source code changes extracted from commits associated with vulnerabilities documented in the CVE database. The research methodology is an experimental analysis based on evaluation of the effectiveness and robustness of CodeBERT, GraphCodeBERT, and UniXcoder in the task of vulnerability classification. The models are assessed based on their performance using Accuracy and F1 score metrics. Research results: estimates of the effectiveness of different code preprocessing methods when applying large language models to vulnerability classification tasks.

Keywords: large language models, code preprocessing, vulnerability analysis, software security, vulnerability categories, statistical analysis.

UDC: 004.032.26

DOI: 10.33693/2313-223X-2025-12-3-67-79