
doi: 10.1002/jrsm.19
pmid: 26061464
AbstractMeta‐analysis has major strengths, but sometimes it can often lead to wrong and misleading answers. In this SRSM presidential address, I discuss some case studies that exemplify these problems, including examples from meta‐analyses of both clinical trials and observational associations. I also discuss issues of effect size estimation, bias (in particular significance‐chasing biases), and credibility in meta‐research. I examine the factors that affect the credibility of meta‐analyses, including magnitude of effects, multiplicity of analyses, scale of data, flexibility of analyses, reporting, and conflicts of interest. Under the current circumstances, a survey of expert meta‐analysts attending the SRSM meeting showed that most of them believe that the true effect is practically equally likely to lie within the 95% confidence interval of a meta‐analysis or outside of it. Finally, I address the placement of meta‐analysis in the wider current research agenda and make a plea for adoption of more prospective meta‐designs. In many/most/all fields, all primary original research may be designed, executed, and interpreted as a prospective meta‐analysis. Copyright © 2011 John Wiley & Sons, Ltd.
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 199 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 1% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
