To use all functions of this page, please activate cookies in your browser.
my.chemeurope.com
With an accout for my.chemeurope.com you can always see everything at a glance – and you can configure your own website and individual newsletter.
 My watch list
 My saved searches
 My saved topics
 My newsletter
SelfinformationIn information theory (elaborated by Claude E. Shannon, 1948), selfinformation is a measure of the information content associated with the outcome of a random variable. It is expressed in a unit of information, for example bits, nats, or hartleys (also known as digits, dits, bans), depending on the base of the logarithm used in its definition. Additional recommended knowledgeBy definition, the amount of selfinformation contained in a probabilistic event depends only on the probability of that event: the smaller its probability, the larger the selfinformation associated with receiving the information that the event indeed occurred. Further, by definition, the measure of selfinformation has the following property. If an event C is composed of two mutually independent events A and B, then the amount of information at the proclamation that C has happened, equals the sum of the amounts of information at proclamations of event A and event B respectively. Taking into account these properties, the selfinformation I(ω_{n}) (measured in bits) associated with outcome ω_{n} is: This definition, using the binary logarithm function, complies with the above conditions. In the above definition, the logarithm of base 2 was used, and thus the unit of is in bit. When using the logarithm of base , the unit will be in nat. For the log of base 10, the unit will be in hartley. This measure has also been called surprisal, as it represents the "surprise" of seeing the outcome (a highly probable outcome is not surprising). This term was coined by Myron Tribus in his 1961 book Thermostatics and Thermodynamics. The information entropy of a random event is the expected value of its selfinformation. Selfinformation is an example of a proper scoring rule. Examples
References

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "Selfinformation". A list of authors is available in Wikipedia. 