This article is cited in 2 papers

Theory of probability and Mathematical statistics

On outlier detection with the chebyshev type inequalities

M. A. Chepulis, G. L. Shevlyakov

Peter the Great St. Petersburg Polytechnic University, 29 Polytechnicheskaya Street, Saint Petersburg 195251, Russia

Abstract: This work considers algorithms of outlier detection based on the Chebyshev inequality. It compares these algorithms with such classical methods as Tukey’s boxplot, the $N$-sigma rule and its robust modifications based on $MAD$ and $FQ$ scale estimates. To adjust the parameters of the algorithms, a selection procedure is proposed based on the complete knowledge of the data distribution model. Areas of suboptimal parameters are also determined in case of incomplete knowledge of the distribution model. It is concluded that the direct use of the Chebyshev inequality implies the classical $N$-sigma rule. With the non-classical Chebyshev inequality, a robust outlier detection method is obtained, which slightly outperforms other considered algorithms.

Keywords: anomaly; outlier detection; Chebyshev inequality; robustness.

UDC: 519.254

Received: 28.09.2020

Language: English

DOI: 10.33581/2520-6508-2020-3-28-35