Questions tagged [dirichlet-distribution]

The Dirichlet distribution refers to a family of multivariate distributions, which are the generalization of the univariate beta distribution.

The Dirichlet distribution refers to a family of multivariate distributions, which are the generalization of the univariate beta distribution. The probability density function of an $n$ dimensional Dirichlet distribution is:

$$p(x_1,x_2,\ldots,x_n;\alpha_1,\alpha_2,\ldots,\alpha_n) = \frac{\Gamma(\sum_{i=1}^n \alpha_i)}{\prod_{i=1}^n \Gamma (\alpha_i)} \prod_{i=1}^n x_i^{\alpha_i-1}$$

The support of the function is $x_i \in (0,1)$ for all $i = 1, ..., n$, with the additional condition $\sum_{i=1}^n x_i = 1$. Note that $n \geq 2$, where $n$ is the number of categories.

The distribution is mostly used in Bayesian statistics as a prior for multinomial likelihood functions.

311 questions
11
votes
1 answer

Dirichlet posterior

I have a question about the Dirichlet posterior distribution. Given a multinomial likelihood function it's known that the posterior is $Dir({\alpha_i + N_i})$, where $N_i$ is the number of times we've seen $i^{th}$ observation. What happens if we…
Max
  • 111
6
votes
1 answer

Calculating Log Prob. of Dirichlet distribution in High Dimensions

I'm interested in calculating the log probability of data drawn from a Dirichlet distribution. In particular, I'm interested in calculations that are stable in high dimensions, perhaps 1000 dimensions or more. I've tried to use the…
Mike Hughes
  • 1,003
3
votes
2 answers

Dirichlet multinomial for adverse event data

I am trying to see which distribution will best fit the data I am working on. The dataset is as following: Site Nausea headache Abdominal Distension 1 17 5 10 2 12 …
3
votes
1 answer

Characterize linear transformation of Dirichlet distributed variables

Let $X=(X_1,....,X_K)\sim{}\text{Dir}(\alpha_1,...,\alpha_K)$ be a Dirichlet distribution with parameters $\alpha_1,...,\alpha_K$. Let $A$ be a non-singular linear map and $(Y_1,....,Y_K)=A(X_1,....,X_K)$. Is $(Y_1,....,Y_K)$ Dirichlet…
Helmut
  • 405
  • 3
  • 9
2
votes
1 answer

What is the Dirichlet equivalent of a Beta (1,1) distribution?

If parameter p ~ Beta(1,1), this would reflect we know nothing about parameter $p$. Generalizing to the multivariate case, how would the same be said about a vector $P$ of probability parameters $p_i$?
2
votes
0 answers

Mode of dirichlet distribution with parameters between 0 and 1

I have a dirichlet distribution with three dependent variables.What is the range in which the dirichlet parameters (alphas) should lie? I read in a reference only a condition near the pdf of dirichlet…
1
vote
1 answer

Calculate log likelihood of Dirichlet distribution using Gamma distribution

Let $X_1,\dots,X_{k+1}$ be mutually independent random variables, each having a gamma distribution with parameters $\alpha_i,i=1,2,\dots,k+1$ show that $Y_i=\frac{X_i}{X_1+\cdots+X_{k+1}},i=1,\dots,k$, have a joint ditribution as…
alryosha
  • 261
1
vote
1 answer

dirichlet likelihood simplified

I am looking for derivation of eqn 5 in C.Moody's paper https://arxiv.org/pdf/1605.02019.pdf where it says the loss function coming from dirichlet enforcement of sparsity is $L^d=\lambda\sum_{jk}(\alpha-1)logp_{jk}$ When you look up a formal paper,…
bhomass
  • 557
0
votes
0 answers

Parameters of a dirichlet distribution and posterior mode

What is the range in which the dirichlet parameters (alphas) should lie? I saw the condition that alphas must be greater than 0. Then can I have alpha values between 0 and 1?