Questions tagged [sufficient-statistics]

A sufficient statistic is a lower dimensional function of the data which contains all relevant information about a certain parameter in itself.

Consider $n$ independent observations from a random variable $X: X_1, X_2,...,X_n$ such that $f(x_1,...,x_n|\theta)=\prod_{i=1}^{n}p(x_{i}|\theta)$ where $\theta$ is a parameter to be estimated. A sufficient statistic reduces the whole data into a function of $x$ that carries all relevant information about $\theta$.

As an example let $X \sim \operatorname{Exponential}(\lambda)$ and suppose $x_i > 0$, then the joint probability $$f(x_1,...,x_n|\lambda) = \prod_{i=1}^{n} \lambda e^{-\lambda x_{i}}$$ can be written as $$f(x_1,...,x_n|\lambda) = \lambda^{n} e^{-\lambda \sum x_{i}}$$ reducing the data to the sufficient statistic $\sum x_{i}$. Knowing the sample average and the number of observations then allows us to calculate an estimate of $\lambda$ without considering the whole data vector $x_i$.

456 questions
8
votes
2 answers

Conditioning in the definition of sufficient statistics

Let $X_1,...,X_n$ be an i.i.d. sample with parameter $\theta$ and $T$ a statistics. The statistics is called sufficient if, given a value $t$, the distribution $P_{\theta}(X_1,..,X_n|T=t)$ does not depend on $\theta$. But what is the range of $t$ ?…
Thomas
  • 880
  • 4
  • 16
8
votes
1 answer

Does Basu's Theorem require minimal sufficiency?

Casella & Berger state Basu's Theorem (Th 6.2.24) as follows: If $T(X)$ is a complete and minimally sufficient statistic, then $T(X)$ is independent of every ancillary statistic. However, in lecture, I saw a proof of the theorem that used only…
half-pass
  • 3,740
4
votes
2 answers

If the dimension of a sufficient statistic $T(X)$ equals the dimension of parameter space, $T(X)$ is minimal sufficient?

I came cross an interesting comment saying If the dimension of a sufficient statistic $T(X)$ is the same as that of the parameter space, then $T(X)$ is minimal sufficient. Is this is true? I examined some examples e.g. full-rank exponential…
Tan
  • 1,479
4
votes
1 answer

What is the difference between $T(x)$ and $T(X)$?

Suppose that we observe the discrete random variable $X = (X_1, . . . , X_n) $ with state space $S$, whose distribution we do not know but we are assuming that its joint p.m.f. belongs to a known family $\{f_θ : θ ∈ Θ\}$. We derive a sufficient…
user255658
3
votes
1 answer

Understanding Sufficient Statistics

As I began my study of sufficient statistics I stumbled upon a definition that puzzled me. The conditional probability distribution of the sample values given an estimator $\hat{\Theta}=\hat{\theta} $ is given by $$ f\left(…
JohnK
  • 20,366
2
votes
1 answer

How do we conclude that a statistic is sufficient but not minimal sufficient?

I want to show that the statistic $\left(\sum_{i = 1}^n Y_i, \sum_{i = 1}^n Y_i^2 \right)$ is sufficient for $\mu$ but not minimal sufficient where $(Y_1, \dots, Y_n)$ is a random sample from $N(\mu, \mu)$ for $\mu > 0$. I have already shown that…
The Pointer
  • 1,932
1
vote
1 answer

How do we conclude that a statistic is sufficient but not minimal sufficient? #2

This is related to a question I recently asked. I want to show that the statistic $\left(\sum_{i = 1}^n Y_i, \sum_{i = 1}^n Y_i^2 \right)$ is sufficient for $\mu$ but not minimal sufficient where $(Y_1, \dots, Y_n)$ is a random sample from $N(\mu,…
The Pointer
  • 1,932
1
vote
1 answer

Did I show sufficiency and minimal sufficiency correctly?

I am currently trying to show that the statistic $\sum\limits_{y = 1}^n Y_i^2$ is minimal sufficient for $\mu$ where $Y_1, \dots, Y_n$ is a random sample from $N(\mu,\mu)$ for $\mu > 0$. The textbook All of Statistics: A Concise Course in…
The Pointer
  • 1,932
1
vote
1 answer

Why does this theorem for minimal sufficient from the "All of Statistics" textbook by Wasserman have these exponents of $n$?

In the textbook All of Statistics: A Concise Course in Statistical Inference by Larry Wasserman, the definition of minimal sufficient is given as follows: 9.35 Definition. A statistic $T$ is minimal sufficient if (i) it is sufficient; and (ii) it…
The Pointer
  • 1,932
1
vote
0 answers

Are the two definitions of a sufficient statistic equivalent?

I am confused about the fundamental definition of a sufficient statistic. I found two different definitions and I wounder if they are equal. with data $X$ sufficient statistics $t$ parameter $\theta$ Definition 1, e.g. from Wikipedia: "A statistic…
1
vote
1 answer

Proving that $T(X)$ is a sufficient statistic for $\theta$

I have that $X=(X_1,...,X_n)$ is a rv consisting of $n$ iid exponential rv's where $\theta$ is the parameter (and thus mean $1\over \theta$) . I have to prove that $T(X)=\sum^n_{i=1}X_i$ is a sufficient statistic for $\theta$ using the theorem in my…
user255658
1
vote
1 answer

Sufficient statistic for sample without replacement

This is an exercise that I faced today: Let $\mathcal{M}$ be a population of ’individuals’ with identification numbers in $\mathbb{Z}$. We assume that the set of all identification numbers equals $\{a, . . . , b\}$ with unknown integers $a, b$. We…
Melina
  • 113
1
vote
0 answers

How can we consider only unbiased estimator of zero 'based on sufficient statistic'?

According to this answer : https://stats.stackexchange.com/a/37710/138097 I understand the logic, except following sentense: [ note: because of sufficiency, we have reduced the problem of showing uncorrelatedness with every estimator of 0 to only…
zzingae
  • 45
0
votes
0 answers

Find a two dimensional sufficient statistic for $\theta$

Let $\{X_i\}_{i=1}^n$ be conditional independent given $\theta$ with distribution $$p_{X_i | \theta} (x |\theta) = \frac{1}{2i\theta}, \ -i\theta
Oskar
  • 245
0
votes
0 answers

How do $g(S(\mathbf{y}_1), \theta)$ and $g(S(\mathbf{y}_2), \theta)$ cancel?

My notes introduce the concept of minimal sufficient statistics as follows: Definition A sufficient statistic $T(\mathbf{Y})$ is called a minimal sufficient statistic if it is a function of any other sufficient statistic. Remark Except for several…
The Pointer
  • 1,932
1
2