Regression & Correlation

Understanding relationships between variables. Does studying more lead to higher grades?

Correlation Coefficient ($r$)

Measures the strength and direction of a linear relationship. Ranges from -1 to +1.

  • $r = 1$: Perfect positive correlation.
  • $r = -1$: Perfect negative correlation.
  • $r = 0$: No linear correlation.

Simple Linear Regression

Fitting a straight line to the data to predict $Y$ based on $X$.

$$ \hat{Y} = b_0 + b_1X $$
$b_0$ = Y-intercept
$b_1$ = Slope

Method of Least Squares: Minimizes the sum of squared errors (residuals).

Coefficient of Determination ($R^2$)

The percentage of variation in $Y$ that is explained by $X$.

If $r = 0.8$, then $R^2 = 0.64$. This means 64% of the change in $Y$ is due to $X$.

Advanced Topics

Test Yourself

Q1: If $r = -0.9$, the relationship is:

  • Weak and Positive
  • Strong and Negative
  • Weak and Negative