What is the fundamental difference between $E(X^2)$ and $[E(X)]^2$?

$E(X^2)$ is the expected value of the squared outcomes (mean of squares), whereas $[E(X)]^2$ is the square of the expected value (square of the mean). In statistics, $E(X^2)$ is almost always greater than $[E(X)]^2$, and their difference defines the variance.

How does the calculation of $E(X)$ differ from the calculation of $E(2X + 1)$?

To find $E(X)$, you sum $x \cdot P(X=x)$. To find $E(2X+1)$, you transform each outcome $x$ into $(2x+1)$ and then multiply by the original probabilities $P(X=x)$ before summing. Alternatively, you can use the property $E(aX+b) = aE(X) + b$.

When is the Expected Value $E(X)$ equal to the Median of a discrete random variable?

The Expected Value is equal to the Median when the probability distribution is perfectly symmetrical. In such cases, the 'balance point' of the probabilities coincides with the middle value of the ordered outcomes.

What is a common mistake when using the formula $Var(X) = E(X^2) - [E(X)]^2$?

A frequent error is forgetting to square the $E(X)$ term or confusing the order of the two terms. This often results in a negative variance, which is mathematically impossible since variance measures squared distances.

Why is it incorrect to assume $E(1/X) = 1/E(X)$?

Expectation is a linear operator, but it does not distribute over non-linear functions like reciprocals or squares. $E(1/X)$ must be calculated by summing $(1/x) \cdot P(X=x)$ for all possible values of $x$.

What happens to the Variance if you round the Mean ($E(X)$) too early in a calculation?

Rounding the mean prematurely introduces 'rounding error propagation.' Since the mean is squared in the variance formula, even a small rounding error can be amplified, leading to an inaccurate final result for $Var(X)$.

State the formula for the Expected Value of a discrete random variable $X$.

The formula is $E(X) = \sum x P(X=x)$, where the sum is taken over all possible values $x$ that the random variable can take.

Define Variance in terms of Expected Values.

Variance is defined as $Var(X) = E(X^2) - [E(X)]^2$. It represents the average of the squared deviations of the variable from its mean.

What is the relationship between Standard Deviation and Variance?

Standard Deviation ($\sigma$) is the positive square root of the Variance ($Var(X)$). It is used to express the spread of the distribution in the same units as the original data.

What does it mean if $Var(X) = 0$?

If the variance is zero, it means there is no spread in the data; the random variable $X$ takes a single constant value with a probability of 1. There is no 'randomness' in the outcome.

Library Podcasts

Courses

Referral & Rewards

Revision Notes

AS-Level

Cambridge International Examinations

Maths

Probability And Statistics 1

Statistical Distributions

E(X) & Var(X) (Discrete)

Summary

The expected value $E(X)$ and variance $Var(X)$ are fundamental measures used to describe the central tendency and dispersion of a discrete random variable. While $E(X)$ represents the long-term average outcome (the mean), $Var(X)$ quantifies the spread of the data around that mean, providing a complete picture of the distribution's behavior.

1. Definition & Core Concepts

A vertical line graph showing a discrete probability distribution with a fulcrum (triangle) at the expected value, illustrating it as the balance point or center of mass of the distribution.

2. Underlying Principles

3. Methods & Techniques

4. Key Distinctions

5. Exam Strategy & Tips

E(X) & Var(X) (Discrete)

Summary

1. Definition & Core Concepts

The Expected Value, denoted as $E(X)$ or $\mu$ , is the theoretical mean of a discrete random variable. It represents the average value one would expect to see if an experiment were repeated an infinite number of times.

For a discrete random variable $X$ , the expected value is calculated by taking the sum of each possible outcome multiplied by its associated probability: $E(X) = \sum x P(X = x)$ This can be viewed as a weighted average where the weights are the probabilities.

The Variance, denoted as $Var(X)$ or $\sigma^2$ , measures the 'spread' of the random variable. It is defined as the expected value of the squared deviations from the mean: $Var(X) = E[(X - \mu)^2]$ .

A vertical line graph showing a discrete probability distribution with a fulcrum (triangle) at the expected value, illustrating it as the balance point or center of mass of the distribution.

2. Underlying Principles

The principle of Linearity of Expectation allows us to find the expected value of functions of $X$ . To find $E(f(X))$ , we apply the function $f$ to each outcome $x$ before multiplying by the probability: $E(f(X)) = \sum f(x) P(X = x)$ This is known as the Law of the Unconscious Statistician.

A critical application of this is finding $E(X^2)$ , which is the mean of the squares of the outcomes. This value is essential for calculating variance but does not represent the square of the mean.

Symmetry Principle: If a probability distribution is perfectly symmetrical about a central value, the expected value $E(X)$ will always be equal to that central value, which is also the median of the distribution.

3. Methods & Techniques

Calculating Variance Step-by-Step

Step 1: Calculate $E(X)$ by summing $x \cdot P(X=x)$ for all values in the distribution table.
Step 2: Calculate $E(X^2)$ by squaring each $x$ value, then summing $x^2 \cdot P(X=x)$ .
Step 3: Apply the computational formula for variance: $Var(X) = E(X^2) - [E(X)]^2$
Standard Deviation: Once the variance is found, the standard deviation $\sigma$ is calculated as $\sqrt{Var(X)}$ . This returns the measure of spread to the original units of the random variable.

Handling Unknowns

If a probability or outcome is unknown (represented by a variable like $k$ ), first use the property that $\sum P(X=x) = 1$ to solve for the unknown before attempting to find $E(X)$ or $Var(X)$ .