Correlations

Numerical Range: The correlation coefficient is a numerical value ranging from $-1.0$ to $+1.0$. The sign ($+$ or $-$) indicates the direction of the relationship, while the absolute value indicates the strength.

Strength Interpretation: A coefficient of $\pm 1.0$ represents a perfect linear relationship, while $0$ represents no relationship. Generally, values between $0.1$ and $0.3$ are considered weak, $0.4$ to $0.6$ moderate, and $0.7$ to $0.9$ strong.

Coefficient of Determination ($r^2$): Squaring the correlation coefficient provides the proportion of variance in one variable that is predictable from the other. For instance, an $r$ of $0.7$ results in an $r^2$ of $0.49$, meaning $49\%$ of the variance is shared between the variables.

The Causality Gap: A high correlation coefficient does not imply that one variable causes the other to change. It only indicates that they vary together, which could be due to a variety of reasons other than direct influence.

The Third Variable Problem: Often, a correlation between two variables is actually caused by a third, unmeasured variable (an extraneous or confounding variable). For example, a correlation between ice cream sales and drowning incidents is actually caused by the third variable of hot weather.

Interpreting the Sign: Always distinguish between the direction and the strength. A correlation of $-0.8$ is stronger than a correlation of $+0.5$, even though the latter is a positive number.

Scatter Plot Analysis: When asked to describe a scatter plot, always mention the direction (positive/negative), the strength (how close the points are to a line), and whether the relationship appears linear.

Identifying Outliers: Be vigilant for individual data points that fall far from the general cluster. These outliers can disproportionately affect the correlation coefficient, making a relationship seem stronger or weaker than it truly is.

Non-Linear Relationships: Pearson's $r$ only measures linear relationships. If the data follows a curve (curvilinear), the correlation coefficient might be near zero even if a very strong relationship exists.

Directionality Confusion: Students often assume that if A and B are correlated, A must lead to B. In reality, B could lead to A, or they could both be influenced by an external factor.

Sample Size Sensitivity: Small samples can produce high correlation coefficients by chance. It is essential to consider the sample size and statistical significance before concluding that a relationship is meaningful.