PereFlex: a tool for automated evaluation of error recovery in parsers

O. I. Bachishche^a, Ya. S. Vorobiev^b, G. R. Raykin^a, D. V. Vasina^a, D. S. Shushakov^a, S. V. Grigor'ev<sup>c

a</sup> ITMO University
^b National Research University Higher School of Economics
^c Saint Petersburg State University

Abstract: Error recovery is a critical component of parsing technology, particularly in applications such as IDEs and compilers, where a single syntax error should not prevent further analysis of the input. This paper presents PereFlex – a tool for extensive experimental evaluation of error recovery in JVM-based parsers. Our evaluation is based on real-world parsers for Java and users' erroneous programs. The results demonstrate that while some strategies are fast, they often fail to provide meaningful recovery, whereas advanced methods offer better recovery quality at the cost of increased computational overhead.

Keywords: error recovery, parsing, IDE, evaluation

Language: English

DOI: 10.15514/ISPRAS-2025-37(6)-40