Lecture 8: Continuous Random Variables

Continuous Random Variables and PDFs

𐰋𐰍𐰃𐰤

Gaussian (normal) PDF

Important in the theory of probability: Centrail limit theorem.

If you have a phenomenon in which you measure a certain quantity, but that quantity is made up of lots and lots of random contributions.

Then your random variable is actually the sum of lots and lots of independent little random variable. And no matter what kind of distribution the little random variables have, their sum will turn out to have approximately a normal distribution.

$\rightarrow$ This makes the normal distribution to arise very nartually in lots and lots of context. Whenever you have noise that’s comprise of lots of different independent pieces of noise, then the end result will be a random normal variable.

Standard normal (Gaussian) random variables

  • So what is standard normal?
    𐰋𐰍𐰃𐰤 STANDARD NORMAL
    $$X \sim \mathcal{N}(0, 1): f_X(x) = \frac{1}{\sqrt{2\pi}} e^{-x^2/2}$$
    why $\frac{1}{\sqrt{2\pi}}$ ? $\int_{-\infty}^{\infty}e^{-x^2/2} , dx = \sqrt{2\pi}$

“Standard Normal Explanation”

  • $\mathbb{E}[X] = 0$
  • $\text{Var}(X) = \mathbb{E}[X^2] - 0 = 1$
    Integrate by parts $ u = x $ $ dv = xe^{-x^2/2} \, dx \rightarrow v = -e^{-x^2/2} $ $$ \int udv = uv - \int vdu = \frac{1}{\sqrt{2\pi}}(-xe^{-x^2/2}\Big|_{-\infty}^{\infty} + \int_{-\infty}^{\infty} e^{-x^2/2} \, dx) = 0 + 1 = 1 $$

Example 3.10: Memorylessness of the exponential PDF