0

I've been recently learning about GLM's after learning about ordinary linear regression. In simple linear regression, I believe that an error term is used in order to account for randomness in the actual response when we predict values, like the equation below:

Yi= β0+ βxi+ ϵi

Where ϵi follows a normal distribution with expectation 0 and variance sigma^2. However I believe that this assumes that our Y variable follows a normal distribution.

I was wondering what would be the equivalent error term (if any) for GLM's that we model assuming Y follows another distribution (such as Poisson or Gamma), and if it relates anyway to the "link" function used in GLMS.

Thanks!

Sushiix
  • 1

1 Answers1

0

For a GLM, instead of errors $\epsilon$, we model uncertainty with probabilities.

Link functions constrain our output from all real numbers (linear regression) to whatever we specify it to be. This is because with GLMs, not every distribution works with all real numbers.

John Stud
  • 319
  • 1
  • 13
  • Hi John!

    Thank you for explaining link functions - I think i get that part now. Just with the errors component, would you be able to elaborate more?

    Say if I am modelling count using a GLM assuming it follows a Poisson Distribution with a log link, how can we model uncertainty with probabilities? - do we look at the prediction /confidence interval?]

     – Sushiix Nov 22 '20 at 10:27
  • The uncertainty is inherent in the confidence interval. Example: We believe with 95% confidence that the true coefficient is between x and y." If we were to take repeated samples from the same population, and run the same regression on each data set we draw, then the true population parameter would be covered by 95% of these models’ 95% confidence intervals. – John Stud Nov 22 '20 at 16:00