ML Wiki
Machine Learning Wiki - A collection of ML concepts, algorithms, and resources.

Laws of Large Numbers

Law of Large Numbers

The general idea behind the laws of large numbers is the combined effect of a large number of identical and independent random factors.

A sequence of random variables $X_1, X_2, …, X_n$ satisfies the law of large numbers if

$\cfrac{X_1, X_2, …, X_n}{n} - \cfrac{\mathbb{E}[X_1], \mathbb{E}[X_2], …, \mathbb{E}[X_n]}{n} \rightarrow_{p} 0$ as $n \rightarrow \infty$

Types of laws of large numbers:

Sources