A rule for the addition of entropies for underdetermined data

L. A. Sholomov

Institute of System Analysis RAS, Moscow, Russia

Abstract: The basic information characteristics for underdetermined data are introduced. For underdetermined data of the general form, it is proved that the entropy addition rule $H(X)+H(Y|X)=H(XY)$ of classic Information theory turns into a more complicated expression. The form of the expression is found. In addition, the necessary and sufficient conditions for it to coincide with the ordinary entropy addition rule are obtained. Bibliogr. 11.

Keywords: underdetermined data, information characteristics, entropy, conditional entropy, specification, best specification, entropy addition rule.

UDC: 519.174

Received: 18.02.2010
Revised: 26.05.2010

 English version: Journal of Applied and Industrial Mathematics, 2011, 5:3, 431–447

Bibliographic databases:

• 
• 
•