Momentum space entropy

The maximum entropy method (MEM) is an information-theory-based technique that was first developed in the field of radioastronomy to enhance the information obtained from noisy data (Gull and Daniell 1978). The theory is based on the same equations that are the foundation of statistical thermodynamics. Both the statistical entropy and the information entropy deal with the most probable distribution. In the case of statistical thermodynamics, this is the distribution of the particles over position and momentum space ( phase space ), while in the case of information theory, the distribution of numerical quantities over the ensemble of pixels is considered. 

The unattainabiiity formulation of the Third Law of Thermodynamics is briefly reviewed in Sect. 2.1. It puts limitations of the quest for absolute zero, and in its strongest mode forbids the attainment of absolute zero by any method whatsoever. But typically it is stated principally with respect to thermal-entropy-reduction refrigeration (TSRR). TSRR entails reduction of a refrigerated system s thermal entropy, i.e., its localization in the momentum part of phase space (in momentum space for short). The possibility or impossibility of overcoming these limitations via TSRR is considered, in Sects. 2.2. and 2.3. with respect to standard TSRR, and in Sect. 2.4. with respect to absorption TSRR. (In standard TSRR, refrigeration is achieved at the expense of work input in absorption TSRR, at the expense of high-temperature heat input.)... 

Using the position and momentum space entropies, Bialynicki-Birula and Mycielski [109] derived a stronger version of the Heisenberg uncertainty principle of quantum mechanics. The entropy sum, in D-dimensions, satisfies the inequality [110]... 

Some studies on atomic similarity, using magnitudes closely related to D or to relative Shannon entropies, have also been reported [50, 51]. Very recently a comparative analysis of I and D shows that they both vary similarly with Z within the neutral atoms, exhibiting the same maxima and minima, but Fisher information presents a significantly enhanced sensitivity in the position and momentum spaces in all systems considered [52]. 

Analyzing the main information-theoretic properties of many-electron systems has been a field widely studied by means of different procedures and quantities, in particular, for atomic and molecular systems in both position and momentum spaces. It is worthy to remark the pioneering works of Gadre et al. [62,63] where the Shannon entropy plays a fundamental role, as well as the more recent ones concerning electronic structural complexity [27, 64], the connection between information measures (e.g., disequilibrium, Fisher information) and experimentally accessible quantities such as the ionization potentials or the static dipole polarizabilities [44], interpretation of chemical phenomena from momentum Shannon entropy [65, 66], applications of the LMC complexity [36, 37] and the quantum similarity measure [47] to the study of neutral atoms, and their extension to the FS and CR complexities [52, 60] as well as to ionized systems [39, 54, 59,67]. 

The Shannon entropies - in the position space and momentum space are... 

The observation that the entropy of solid He can sometimes be lower than that of the liquid appears at first sight to be quite astonishing considering that entropy gives a measure of the disorder in a system and that a liquid is usually considered to be in a highly disordered state compared to a crystalline solid. The resolution of this apparent paradox lies in the fact that, actually, liquid He really is a highly ordered system but one in which the ordering takes place in momentum space, rather than in ordinary Cartesian space. 

Macroscopic and Microscopic Balances Three postulates, regarded as laws of physics, are fundamental in fluid mechanics. These are conservation of mass, conservation of momentum, and con-servation of energy. In addition, two other postulates, conservation of moment of momentum (angular momentum) and the entropy inequality (second law of thermodynamics) have occasional use. The conservation principles may be applied either to material systems or to control volumes in space. Most often, control volumes are used. The control volumes may be either of finite or differential size, resulting in either algebraic or differential consei vation equations, respectively. These are often called macroscopic and microscopic balance equations. 

Yet another indirect connection between momentum and coordinate space charge densities is derived via a quantity called the Shannon information entropy... 

The information entropy of a probability distribution is defined as S[p(] = — p, In ph where p, forms the set of probabilities of a distribution. For continuous probability distributions such as momentum densities, the information entropy is given by. S yj = - Jy(p) In y(p) d3p, with an analogous definition in position space... 

For the establishment of the realistic limit, one has to take account of the rates of processes in which mass, heat, momentum, and chemical energy are transferred. In this so-called finite-time, finite-size thermodynamics, it is usually possible to establish optimal conditions for operating the process, namely, with a minimum, but nonzero, entropy generation and loss of work. Such optima seem to be characterized by a universal principle equiparti-tioning of the process s driving forces in time and space. The optima may eventually be shifted by including economic and environmental parameters such as fixed and variable costs and emissions. For this aspect, we refer to Chapter 13. 

---