1

Variance for Hit-and-Miss Monte Carlo is given by $Var(\theta)=\frac{\Theta*(1-\Theta)}{N}$ where $\theta$ is the estimated probability of Hit and N is the number of simulations. Can someone explain why? And what will be the variance when Importance Sampling is used?

manu
  • 23
  • How do you define importance sampling in connection with hit-and-miss Monte Carlo? With no restriction, the minimal variance of an importance sampling estimate is zero. – Xi'an Apr 12 '13 at 20:14

1 Answers1

2

The first is just the variance of $\hat{p} = X/n$ in a binomial.

If $X$ is the number of "hits" in $n$ trials,

$$\newcommand{\Var}{\operatorname{Var}}\Var(X) = n\theta(1-\theta)$$

(Wikipedia on the Binomial Distribution).

So

$$\Var(X/n) = \frac{1}{n^2} n\theta(1-\theta) = \frac{\theta(1-\theta)}{n}.$$

For a comparison of the variance between the plain binomial case and importance sampling, see this section of the Wikipedia article on importance sampling.

whuber
  • 322,774
Glen_b
  • 282,281