The fundamental logic of the t-test relies on the Standard Error, which is the estimated standard deviation of the sampling distribution of the mean. Because we use the sample standard deviation instead of the population , the resulting test statistic follows a t-distribution rather than a normal distribution.
The Null Hypothesis () represents the status quo or the assumption that no change has occurred, typically stated as . The Alternative Hypothesis () represents the researcher's claim, which can be one-tailed (greater than or less than) or two-tailed (not equal to).
The p-value represents the probability of obtaining a sample mean as extreme as, or more extreme than, the one observed, assuming the null hypothesis is true. A small p-value suggests that the observed data is unlikely under the null hypothesis, providing evidence in favor of the alternative.
It is critical to distinguish between when to use a z-test versus a t-test for means. The primary deciding factor is whether the population standard deviation is known or unknown.
| Feature | z-test | t-test |
|---|---|---|
| Known | Unknown (use ) | |
| Distribution | Standard Normal () | t-distribution () |
| Parameters | Mean () | Mean () and |
| Sample Size | Usually large | Any (if normality met) |
In a two-tailed test, the p-value is the sum of the areas in both tails of the distribution. When using a table that provides one-tail areas, you must double the resulting p-value to account for both directions of deviation from the mean.
Always define your parameters: When writing hypotheses, explicitly state what represents in the context of the problem (e.g., 'where is the true mean height of all plants').
Check the Normality condition carefully: If , you must check for outliers or strong skewness in the sample data. If the problem states the population is normal, you do not need to check the sample distribution.
Degrees of Freedom: A common mistake is forgetting to subtract 1 from the sample size () when looking up critical values or calculating p-values.
Interpret in Context: Never just say 'Reject '. Always follow up with a sentence like 'There is sufficient evidence to suggest that the mean [variable] has [increased/decreased/changed].'