The asymptotic distribution
$$\hat{\theta} - \theta_a \rightarrow^D N(0,I^{-1}(\theta))$$
can be rewritten as
$$\hat{\theta} \rightarrow^D N(\theta_a,I^{-1}(\theta))$$
and it becomes easy to compute p-values for different hypothetical values $\theta_a$ and associated confidence intervals.
This expression $\hat{\theta} - \theta_a$ is a simple translation. This is not the case for $L(\hat{\theta}) - L(\theta_a)$.
A complication is $I^{-1}(\theta)$ which is probably gonna need to be $I^{-1}(\theta_a)$ and changing the value of $\theta_a$ might be not the same as a simple translation (but also change the variance). An example is the Wilson score interval for a binomial proportion.