Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [combining-p-values]

Methods for combining p-values from several hypothesis tests with the same null hypothesis into one aggregate p-value, such as e.g. Fisher's method and Stouffer's method.

Techniques for combining the outcomes of several independent hypothesis tests with the same null hypothesis into one aggregate outcome. There exist various methods that take a set of $p$-values from individual tests and yield one aggregate $p$-value; two most common ones are Fisher's method and Stouffer's method.

See also .

93 questions
6
votes
0 answers

Can one use Stouffer's method to integrate t-values?

I would like to integrate T-statistics values from multiple, independent tests. How can this be done? Since my degrees of freedom are many ($n>1000$) I was thinking to use the Stouffer's method, which is really for Z-statistics score. However,…
Federico Giorgi
  • 209
  • 2
  • 12
2
votes
1 answer

What can I do if I want to apply Fisher's method (or some other method of combining p-values), but my p-values have unknown (positive) dependence?

I have p-values from several tests (k~50) that I'd like to combine. I don't have a model of their correlation structure. They aren't independent. In the worst-case scenario, my effective sample size might be more more like 15. I'm dealing with…
MRule
  • 251
0
votes
1 answer

How can we infer from the combined p-value of Fisher's method whether the null hypotheses are all true?

Using the R package oolong (oolong), I used Fisher's method to combine the p-values of three binomial tests. I have difficulty understanding the combined p-value. I understood it to mean that the combined p-value tells me whether all null hypotheses…
Mary-Jane
  • 1
0
votes
1 answer

Probability density Function for p-value product

I am running an experiment where I get 22,152,480 p-values in a given order, ranging from 0 to 1, but strongly tilted toward 1 (i.e. not uniformly distributed). I want to say that a given series of them is significant between two samples. For…
con
  • 133