Journal Article

<i>Post hoc</i> power estimation in large-scale multiple testing problems

Sonja Zehetmayer and Martin Posch

in Bioinformatics

Volume 26, issue 8, pages 1050-1056
Published in print April 2010 | ISSN: 1367-4803
Published online February 2010 | e-ISSN: 1460-2059 | DOI:
Post hoc power estimation in large-scale multiple testing problems

More Like This

Show all results sharing this subject:

  • Bioinformatics and Computational Biology


Show Summary Details


Background: The statistical power or multiple Type II error rate in large-scale multiple testing problems as, for example, in gene expression microarray experiments, depends on typically unknown parameters and is therefore difficult to assess a priori. However, it has been suggested to estimate the multiple Type II error rate post hoc, based on the observed data.

Methods: We consider a class of post hoc estimators that are functions of the estimated proportion of true null hypotheses among all hypotheses. Numerous estimators for this proportion have been proposed and we investigate the statistical properties of the derived multiple Type II error rate estimators in an extensive simulation study.

Results: The performance of the estimators in terms of the mean squared error depends sensitively on the distributional scenario. Estimators based on empirical distributions of the null hypotheses are superior in the presence of strongly correlated test statistics.

Availability: R-code to compute all considered estimators based on P-values and supplementary material is available on the authors web page


Supplementary information: Supplementary data are available at Bioinformatics online.

Journal Article.  6976 words.  Illustrated.

Subjects: Bioinformatics and Computational Biology

Full text: subscription required

How to subscribe Recommend to my Librarian

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.