Questions tagged [moments]

Moments are summaries of random variables' characteristics (e.g., location, scale). Use also for fractional moments.

Moments are summaries of random variables' characteristics. Specifically, the $j$th moment of a random variable $X$ is defined as $$ \mu_j^{'} = {\rm E} (X^j), \quad j = 1, 2, \ldots $$ and the $j$th central moment of $X$ is $$ \mu_j = {\rm E} [(X -\mu_1^{'})^j], \quad j = 1, 2, \ldots . $$

The first moment $\mu_1^{'}$ is the expectation of $X$, often denoted $\mu = {\rm E} (X)$, and the second central moment is the variance, often denoted $\sigma^2 = {\rm var}(X) = {\rm E} [(X - \mu_1^{'})^2]$.

Analogous definitions hold for batches of data where the expectation is taken with respect to the empirical distribution function. Equivalently, "$E$" is replaced by averaging over the data. When the batch is a sample (of a population or process) these are known as "sample moments."

A notable use of moments is the method of moments, a procedure for statistical inference, which estimates the population distribution by matching its moments to (specified) empirical moments.

594 questions
18
votes
1 answer

Does finite kth moment imply lesser moments are finite?

Possible Duplicate: Proof that if higher moment exists then lower moment also exists For a random variable $X$, lets say I know $E[X^k]$ is finite and I know that $E[X]$ is finite. Can I say that all moments between first and kth moment are…
bdeonovic
  • 10,127
6
votes
1 answer

Converting central moments to non-central moments (and back)

The central moments of a probability distribution $p(x)$ are defined as: $$\theta_n = \langle (x - \langle x \rangle)^n \rangle $$ while the non-central moments are the standard: $$\mu_n = \langle x^n \rangle $$ By the binomial theorem, we…
a06e
  • 4,410
  • 1
  • 22
  • 50
5
votes
1 answer

What is the variance of $X^2$ (without assuming normality)?

If $X \sim \text{N}(0, \sigma^2)$ then it is well-known that $X^2/\sigma^2 \sim \text{ChiSq}(1)$ which gives $\mathbb{V}(X^2) = 2 \sigma^4$. However, this variance holds only for the normal distribution with zero mean. What is the general formula…
Ben
  • 124,856
4
votes
1 answer

Advantage of central moment over moment?

Is there any advantage of using "central moments" over "moments" when approximating a distribution to a known distribution using moment matching? I have noticed that in lot of papers.
4
votes
1 answer

Does a scaling and shift of first two moments change higher moments too?

For a given random variable $X$ with mean $\mu_{\mathrm{old}}$ and standard deviation $\sigma_{\mathrm{old}}$ I would like to perform a transformation $g$ to obtain a new random variable $Y := g(X)$ which has a desired mean and standard deviation…
math
  • 345
3
votes
0 answers

Simplified table for computing higher order cumulants

I'm looking for a simplified table that shows how to compute the cumulant cum(x1, x2, ... xn) for multiple variables, n > 4. I know that the 2nd and 3rd order cumulants are equivalent to the compound moments of the same order. For the 4th order…
3
votes
1 answer

Proving that central moment is finite

I'm having trouble showing that the 2nd central moment is finite. I have $X_1,\ldots,X_n \overset{iid}{\sim} f(x)$ with $E[X_1]=\mu$ and $E[X_1^k]$ exists and is finite for any integer $k \geq 1$. I would like to use Law of Large Numbers, so I need…
bdeonovic
  • 10,127
3
votes
1 answer

Why the first moment is standardized before computing higher moments, but higher moments are not?

Wikipedia says: For the second and higher moments, the central moments (moments about the mean, with c being the mean) are usually used rather than the moments about zero, because they provide clearer information about the distribution's…
user541686
  • 1,185
2
votes
0 answers

Moment Generating Function - Why anyone would think there is such a thing as MGF in the first place?

Most probability books start by talking about four very different things: mean, variance, skewness and kurtosis and then miraculously there is a common thread across all these - these are all so-called "moments" of a distribution. To make matters…
2
votes
1 answer

The law of the total third central moment

On Wikipedia you can read in the article: The law of total variance as follows. In probability theory, the law of total variance or variance decomposition formula or conditional variance formulas or law of iterated variances also known as Eve's law,…
Ad van der Ven
  • 305
  • 1
  • 9
2
votes
1 answer

Are there forms of error which affect kurtosis?

I am currently taking a research methods course online. Today we talked about systematic and random error. The instructor pointed out that systematic error is expected to influence the mean of an estimate, while random error is expected to influence…
1
vote
0 answers

What is a 'data moment'?

I know a moment of a random variable is the expected value of the random variable raised to a given power (possibly with the mean subtracted). I was reading a paper published in Econometrica in which they speak of 'data moments' such as 'job…
MHall
  • 285
1
vote
1 answer

Proving $E[xx'\otimes xx'] \succ E[xx']\otimes E[xx']$

I suspect the following relation is true for random variable in $\mathbb{R}^d$ can someone suggest a way of proving it? $$E[xx'\otimes xx'] \succ E[xx']\otimes E[xx']$$ Using Loewner order symbol $\succ$ and Kronecker product symbol $\otimes$
Yaroslav Bulatov
  • 6,199
  • 2
  • 28
  • 42
1
vote
1 answer

Inequality of first three moments for positive random variable

Let $X$ be a positive random variable (let's say finitely supported). Let $\mu_r = \mathbb{E} X^r$ be the $r$-th moment. Is it true that $$\mu_3 \geq \mu_1 \cdot \mu_2$$
1
vote
1 answer

2-dimensional moment and rotation

Is it possible to get a simple formula linking a central moment to the same moment in a rotated frame, such as the relation between the central moment and the moment about the origin? The formula I am using is…
Flavian
  • 267
1
2