This article is cited in 1 paper

Algorithm for Efficient Entropy Estimation

E. A. Timofeev

P. G. Demidov Yaroslavl State University, Sovetskaya str., 14, Yaroslavl, 150000, Russia

Abstract: We consider the problem of the nonparametric entropy estimation of a stationary ergodic process. Our approach is based on the nearest-neighbor distances. We propose a broad class of metrics on the space $\Omega = A^{\mathbb{N}}$ of right-sided infinite sequences drawn from a finite alphabet $A$. The new metric has a parameter which is a non-increasing function. We apply this metrics to nearest-neighbor entropy estimators. We prove that, under certain conditions, the estimators has a small variance. We show that a special selection of the metric parameters reduction of the estimator's bias. The article is published in the author's wording.

Keywords: entropy, nonparametric statistic, metric, ball, Bernoulli’s measure.

UDC: 519.987

Received: 15.04.2013

Language: English