Questions tagged [covariance]

Covariance is a quantity used to measure the strength and direction of the linear relationship between two variables. The covariance is unscaled, & thus often difficult to interpret; when scaled by the variables' SDs, it becomes Pearson's correlation coefficient.

Covariance is a quantity used to measure the strength and direction of the linear relationship between two variables. The covariance between $X$ and $Y$ is defined as $${\rm cov}(X,Y) = E \left[ \left( X-E(X) \right) \left( Y-E(Y) \right) \right] = E(XY) - E(X)E(Y) $$ Since the magnitude is difficult to interpret in isolation, the covariance is often scaled by the standard deviations of $X$ and $Y$ to produce the Pearson product-moment correlation coefficient.

1756 questions
39
votes
1 answer

Covariance of a random vector after a linear transformation

If $\mathbf {Z}$ is random vector and $A$ is a fixed matrix, could someone explain why $$\mathrm{cov}[A \mathbf {Z}]= A \mathrm{cov}[\mathbf {Z}]A^\top.$$
user92612
  • 745
9
votes
1 answer

What is the difference between the sum of two covariance matrices and the covariance matrix of the sum of two variables?

I'm wondering if someone could help to explain the difference between two covariance matrices. Suppose that ${\bf K}_X$ and ${\bf K}_Y$ are two covariance matrices of real random vectors. What is the difference between ${\bf K}_X+{\bf K}_Y$ and…
nomad2986
  • 103
8
votes
2 answers

if covariance is -150, what is the type of relationship between two variables?

The covariance of of two variables has been calculated to be -150. what does the statistics telling about the relationship between two variables ?
Sameera
  • 81
8
votes
1 answer

Signs of related covariances

Assume $X$ and $Y$ are two positive RVs and $Cov(X,Y)>0$. Does this imply that $Cov(X,1/Y)<0$, or is more information needed?
sunga
  • 125
  • 4
8
votes
3 answers

Covariance of Non-Random Vectors Equal to Zero

BACKGROUND: This is probably an extremely simple question to answer, but it's one of the downsides of being self-taught to get ensnarled in unexpected difficulties with basic stuff. This question stems from the last sentence in this post and the…
8
votes
2 answers

How to calculate the covariance between two observations of the same variable?

I'm getting confused about what I read about covariance. I know how to calculate covariance between two different variables, but not between two observations of the same variable. Imagine you have many observations of a variable $X$. What does this…
asho
  • 83
7
votes
1 answer

Covariance of random sums

How can I compute $$cov(\sum^N a_k,\sum^{N'}a_k)$$ where $N$, $N'$ are random dependent variables and $a_k$ iid random variables , as a function of (but not necessarily) cov(N,N'), $var(N)$, $var(N')$, $var(a_k)$ and all of their expectation value…
DarkBulle
  • 213
6
votes
1 answer

Is it possible to compute a covariance matrix with unequal sample sizes?

I'm not sure if this question is correct, but is there a way to construct a covariance matrix for two vectors that have different lengths? If so, how? And would it have a size of $(m+n) \times (m+n)$ (assuming the two vectors are of length $m$ and…
Jawad
  • 141
6
votes
1 answer

What does the covariance of a quaternion *mean*?

If I have a set of Euler angles (representing the orientation of an object) and I find the covariance of those angles then I have some intuition that $\sigma^2$ is in units of $\text{rad}^2$ and I can visualize what a normal distribution of angles…
5
votes
2 answers

Calculate E[X/Y] from E[XY] for two random variables with zero mean

I have two random variables $X$ and $Y$, both with zero mean. $\newcommand{\E}{\mathrm{E}}$ $\newcommand{\Var}{\mathrm{Var}}$ $\newcommand{\Cov}{\mathrm{Cov}}$ Let's suppose I only know their covariance, which is, in this case, simply…
4
votes
2 answers

Does $Cov(X,Y)=0$ imply that the sample covariance between realizations of $X$ and $Y$ is always zero?

For instance, in linear regression, we have that $$ Cov(e,\hat Y) = 0 $$ That is, the residuals and fitted values are uncorrelated. Is this always true in any sample realization of residuals and fitted values? I think the answer is yes, but I'm…
mai
  • 797
4
votes
1 answer

Within-class covariance matrix

Let $\textbf{X}$ be an $n \times p$ matrix with the rows containing observations and the columns containing features. Also assume that the features are centered at $0$. Let $C_k\subset \{1, \dots n \}$ contain the indices of the observations that…
Damien
  • 773
4
votes
1 answer

A trivial question about Covariance

I'm just learning about Covariance and encountered something I don't quite understand. Assume we have two random variables X and Y, where the respective joint-probability function assigns equal weights to each event. According to wikipedia the…
meow
  • 242
4
votes
1 answer

Covariance Decomposition

I have the returns of three stocks, $R_{1t}$, $R_{2t}$, $R_{3t}$, with 100 monthly observations for each return series. Lets suppose that I create a portfolio consisting of stocks 1 and 2, $P_t=w_{1t}R_{1t}+w_{2t}R_{2t}$. $w_{1t}$ and $w_{2t}$ are…
4
votes
1 answer

Why cov(AX)=A cov(X) A'

I cannot verify the following theorem. Maybe I am doing something wrong, but I don't know what?! Additionally, I'm not sure about the meaning of a constant matrix in the theorem. Theorem: cov(AX)=Acov(X)A' if A is a constant matrix. (A' means…
remo
  • 267
1
2 3 4 5 6