In a multiple regression model, i.e. $y \sim x_1 + x_2 + x_3$, where $x_1$ and $x_2$ are collinear (e.g. present high correlation around 0.8), it is well known that many problems arise regarding parameter estimation or hypothesis testing (on $x_1$ and $x_2$). But how does collinearity affect the third non-collinear variable, $x_3$?
Asked
Active
Viewed 47 times
1 Answers
3
(Assume a linear model, OLS.)
Multicollinearity has its bad effects through the variance inflation factor (VIF), which is calculated by using all but one of the regression features to predict the remaining regression feature. That regression has its $R^2$ calculated, and then $\frac{1}{1-R^2}$ is the VIF.
If that remaining variable is independent of the others, then that $R^2=0$, and the $VIF=1$. Thus, the multicollinearity does not cross-contaminate the standard error for the coefficient of that independent variable.
Dave
- 62,186