Chebyshev's inequality is an inequality that sets bounds to the probability of deviation of a random variable. Given a RV , Chebyshev's inequality states
where is a positive real number, is the standard deviation of and is its mean. Only the cases is significant. When , then , which is a trivial bound since always.
> and thus > $$P(h(x)\geq k)=\frac{E[h(x)]}{k}If we call and , we get the inequality.
This inequality says is that the probability that deviates from its mean by is at most . For instance, it states that there is at most a chance that assumes a value that is or higher from the mean. Seeing it the other way around, it says that at least of values sampled from must be within of the mean.
This inequality is almost universal: it applies to all RVs with a finite mean and variance, regardless of their probability distribution. This provides universal bounds across almost all distributions, but because it's so general, it is rather imprecise compared to distribution-specific arguments. For example, this inequality states that there must be at least , and of values within , and . The Gaussian distribution on the other hand is known to instead require a minimum of , and of values within the same ranges.