Shannon criterion

In such theories the partial or uncertain knowledge of the observer is represented by probabilities, each of which is assigned to one of the possible "actual states." The assignment is achieved by using a postulate or a hypothesis in addition to the laws of mechanics. Recently, the most prevalent postulate is Shannon s criterion. (1, 2, 3, 4) It defines the measure of uncertainty of the observer about the state of the system in terms of the probabilities assigned to the possible "actual states."... 

However, application of an established criterion, called the Shannon criterion, indicates the presence of an oscillation based on at least two measured points in each period (Shannon and Weaver, 1963). The results of our experiment calculated for rats either as individuals or in groups... 

As has been shown in the preceding section, it is this distance criterion that has been used in defining self-consistent sets of ionic radii of which the tabulation of Shannon is the most complete one. With respect to the radius ratio, the quantitative significance is low, at best (see Section 1.1), and a materials scientist is better off in interpreting this part of the first rule as being mostly qualitative in nature. 

Although linear prediction can be used to extract spectral data directly from a FID ( parametric LP ), it is commonly used to extrapolate the experimental time-domain data, which are then weighted and transformed as normal. Maximum entropy reconstruction, in contrast, seeks to fit the experimental FID with a model function that contains the minimum amount of information consistent with fitting experiment to within the estimated noise level. The criterion of minimum information corresponds to the maximum Shannon informational entropy S(p), which for a probability distribution p is defined as... 

Belief decision tree is the combination of standard decision tree and belief fimctions. Basic elements of a belief decision tree consisted of a decision node, an edge, and a leaf with uncertain label. Averaging approach was selected to define the attributes selection measures based on extended gain criterion of the information theoiy of Shannon. A mean value was used as partitioning strategy. The growth process of belief decision tree was stopped when there are no more attributes to be tested [13]. 

---