3

This is loosely tied to the answer here

In GLMs we model the natural parameter (assume we’re using the canonical link) using a linear predictor. What supports this assumption of linearity?

Couldn’t the natural parameter be related to explanatory variables in a non-linear manner? If so, why does that not seem to be a major concern for practitioners using GLMs?

tvbc
  • 154
  • We can model nonlinear behavior by, for instance, squaring a variable or using an interaction term, and the regression remains (generalized) linear. 2) The relationship may be truly nonlinear in the sense of the parameters not having linearity, but that’s true for linear regression, too.
  • – Dave Dec 06 '19 at 03:40
  • @Dave it seems reasonable that we can; however, the go-to predictor for the most common GLMs (Poisson, Binomial) is linear, and so far I’ve been unable to find a source that explains why. Even more confusing is the fact that it doesn’t seem to be common practice to plot the natural parameter versus the explanatory variables to justify the choice of a linear model, we just go with the linear model. – tvbc Dec 06 '19 at 04:25
  • There's an argument here that the linear model (the basic one) is "just" a Taylor approximation to $Y = f(x) + \epsilon$, which implies linear models are used because they are "good enough" maybe https://www.stats.ox.ac.uk/pub/MASS3/Exegeses.pdf – Paul Hewson Dec 06 '19 at 12:41