Minimum description length

J. Rissanen, A universal prior for integers and estimation by minimum description length, Annals of Statistics 11 (1983). 416-431. 

N. Saito, Simultaneous noise suppression and signal compression using a library of orthonormal bases and the minimum description length criterion, available via internet... 

N. Saito, Simultaneous Noise Suppression and Signal Compression Using a Library of Orthonormal Bases and the Minimum Description Length Criterion, Wavelets in Geophysics, (eds. E. Foufoula-Georgiou and P.Kumar), Academic Press, New York, (1994). 

The loss function is also an estimate of the noise covariance 8, what explains the notation. Other criteria include penalties for model complexity like Akaike s final prediction error (FPE) criterion or Rissanen s minimum description length criterion. 

Dimensional homogeneity is fundamental to equations relating variables in the description of natural processes. The recognition of this basic attribute is the substance of dimensional analysis, which results in the reduction of relevant parameters to the essential minimum. Physical quantities comprise combinations of one or more basic dimensions. Table 2.2 shows some commonly used physical quantities in engineering expressed in terms of basic dimensions (mass, M length, L time, T, temperature, 0). 

---