Information theory and statistics

Kaiser H (1970) Quantitation in elemental analysis. Anal Chem 42(2) 24A, 42(4) 26A Kerridge DF (1961) Inaccuaracy and inference. J R Statist Soc B23 184 Kullback S (1959) Information theory and statistics. Wiley, New York... 

Jaynes ET. 1957. Information theory and statistical mechanics. Phys Rev 106 620-630. 

Modern Information Theory is based on the invaricntivc double density functional f p(x) log [p(x)iq(x) dx. In classical or quantum mechanics a basic time-independent q(x) exists. In the case considered here, q(x) = 1 by Liouville s theorem. Cf S. Kullback, Information Theory and Statistics, Wiley, New York, 1959. 

S. Kullback, Information Theory and Statistics, Wiley, New York, 1959. 

A. M. Mathai and P. M. Raihie, Basic Concepts in Information Theory and Statistics Axiomatic Foundations and Applications, Wiley, New York, 1975. 

The intersection of the microscopic scale with information presents a vast literature. To list a sampling most helpful to the author, one begins with the information theory and statistical thermodynamics work of Jaynes [4], and the later text by Baierlein on atoms and information [5]. At a less advanced but still highly illuminating level are books by Morowitz [6,7]. Information casts a wide net in chemistry. Levine and coworkers have long championed information theory applied to molecular processes such as relaxation and internal energy redistribution [8,9]. Biopolymers plus information yield the field of bioinformatics. Recommended is the text by Tramontano for the landmaik questions posed [10]. The research of Schneider has addressed in depth the information attributes of biopolymers [11,12]. 

Jaynes, E. T. 1957. Information Theory and Statistical Mechanics, Phys. Rev. 106,620 Information Theory and Statistical Mechanics II, Phys. Rev. 108,171. 

S. Kullback Information Theory and Statistics Wiley, New York 1959... 

Mathai A (1975) Basic concepts in information theory and statistics axiomatic foundations and applications. Wiley Eastern, New Delhi... 

A. Isomorphism between Information Theory and Statistical Mechanics... 

Jaynes, E.T. (1963). Information theory and statistical mechanics. In Statistical Physics 111., Ford, K.W. (ed.). Lectures from Brandeis Summer Institute 1962. New York W.A. Benjamin, Inc., 1963., p.181. 

---