The law of large numbers

The law of large numbers is fundamental to probabilistic thinking and stochastic modeling. Simply put, if a random variable with several possible outcomes is repeatedly measured, the frequency of a possible outcome approaches its probability as the number of measurements increases. The weak law of large numbers states that the average of N identically distributed independent random variables approaches the mean of their distribution. 

These laws are the fundamental reason why objects in the macroscopic world behave deterministically while individual atoms and molecules are under constant irregular motion. If there is a sufficient number of atoms and molecules in a system, the stochasticity tends to be canceled out and the system exhibits the average behavior in a deterministic way. 

As a generic description of a stochastic system, consider a system with N possible states, labeled 1, 2, , N. Since the system is stochastic, we cannot define equations that determine the specific state that the system adopts at a specific time. Rather, we look for equations that govern the probability pm(l) that the system is in state in at time t. 

The rate of change in pm(t) is equal to the rate of transition from other states / to m minus the rate of transition from state m to other states. The simplest model for how the probabilities change with time is the Markov chain, which assumes that the transition probabilities are dependent only on the current state and independent of all past (and future) states. Formally, 

2 Essential materials from probability theory 11.2.1 The law of large numbers 

---

In everyday analytical work it is improbable that a large number of repeat measurements is performed most likely one has to make do with less than 20 replications of any detemunation. No matter which statistical standards are adhered to, such numbers are considered to be small , and hence, the law of large numbers, that is the normal distribution, does not strictly apply. The /-distributions will have to be used the plural derives from the fact that the probability density functions vary systematically with the number of degrees of freedom,/. (Cf. Figs. 1.14 through 1.16.)... 

Show that the distribution follows the law of large numbers (Poisson distribution). 

Since only a few molecules of the Y species exist in the MC state, a structural change to them strongly influences the catalytic activity of the protocell. On the other hand, a change to X molecules has a weaker influence, on average, since the deviation of the average catalytic activity caused by such a change is smaller, as can be deduced from the law of large numbers. Hence the MC state is important for a protocell to realize evolvability. 

A.A.Markov, Extension of the Law of Large numbers to Dependent Events, Bulletin of the Society of the Physics Mathematics, Kazan, 15(1906)155-156. 

In clinical trials we do not know what the probability of observing a particular serious adverse event is, but we observe a large number of outcomes (for example, participants exposed to a new treatment) to estimate it. As the sample size increases the estimate becomes more precise (that is, closer to the truth). An illustration of the "law of large numbers" is provided in Figure 6.5. Suppose that a relatively uncommon adverse... 

Naturally, approximation generally improves with increasing n the law of large numbers [90,107-109] assures us that this procedure asymptotically converges [and all other central moments of/(z)] thus we are assured that... 

Let Vjv and % denote the optimal objective value and an optimal solution of the sample average problem (32), respectively. By the law of large numbers we have that gf/(x) converges to g x) w.p.l as A — =0. It is possible to show that under mild additional conditions, and Xf, converge w.p.l to the optimal objective value and tm optimal solution of the true problem (11), respectively. That is, Vjv and % are consistent estimators of their true coimterparts. 

Each retailer s overstock is dependent on its random primary demand, so P2 will also be stochastic. However, for very large n (an assumed property of Internet-based markets), the Law of Large Numbers affords a limiting approximation of total retail overstock, and by extension a tractable form for the limiting value of the equilibrium p2. 

Nonlinear electrostatics. The distribution of ions in function of the distance or of the electric potential is classically called distribution of Boltzmann. It is indeed based on Boltzmann statistics, which relies on the law of large numbers for giving an exponential shape to the function describing this distribution. 

Roughly speaking the law of large numbers is (at least for finite time in the thermodynamic limit) ... 

To imderstand systems consisting of many elements with the aid of thermodynamics and mechanics is the objective of statistical thermod5mamics. The advent of single macromolecule experimental methods emphasizes the importance of the study of mesoscopic systems and fluctuations. Macroscopic and mesoscopic observables (henceforth simply called macro-observables) are interpreted as sums of many microscopic quantities or coarse-grained stochastic quantities. Thus, elucidating macroscopic or mesoscopic behavior in terms of the properties of elements inevitably becomes statistical. The laws of large numbers and the large deviation principle (8) become the key mathematical tools. 

To understand the fundamental significance of a source s entropy, recall that it follows from the law of large numbers that if k is large, then for a binary DMS it is highly probable that about kp bits of the fc-bit source block u are Is that is, defining the set... 

For a large N, the binomial distribution approaches a normal distribution. This rule applies to other discrete distributions as well and, in general, is called the law of large numbers or the central limit theorem. When N 1, the final position x of the random walker is virtually continuously distributed along x. 

The distribution is shown in Figure 1.58. We notice that the log-normal distribution has almost the same shape as that of the Poisson distribution or the exponential distribution. The similarity is due to the law of large numbers. 

---