What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
Michael J. Sweeting, Alex J. Sutton, Paul C. Lambert · Statistics in Medicine · 2004
OBJECTIVES: To compare the performance of different meta-analysis methods for pooling odds ratios when applied to sparse event data with emphasis on the use of continuity corrections. BACKGROUND: Meta-analysis of side effects from RCTs or risk factors for rare diseases in epidemiological studies frequently requires the synthesis of data with sparse event rates. Combining such data can be problematic when zero events exist in one or both arms of a study as continuity corrections are often needed, but, these can influence results and conclusions. METHODS: A simulation study was undertaken comparing several meta-analysis methods for combining odds ratios (using various classical and Bayesian methods of estimation) on sparse event data. Where required, the routine use of a constant and two alternative continuity corrections; one based on a function of the reciprocal of the opposite group arm size; and the other an empirical estimate of the pooled effect size from the remaining studies in the meta-analysis, were also compared. A number of meta-analysis scenarios were simulated and replicated 1000 times, varying the ratio of the study arm sizes. RESULTS: Mantel-Haenszel summary estimates using the alternative continuity correction factors gave the least biased results for all group size imbalances. Logistic regression was virtually unbiased for all scenarios and gave good coverage properties. The Peto method provided unbiased results for balanced treatment groups but bias increased with the ratio of the study arm sizes. The Bayesian fixed effect model provided good coverage for all group size imbalances. The two alternative continuity corrections outperformed the constant correction factor in nearly all situations. The inverse variance method performed consistently badly, irrespective of the continuity correction used. CONCLUSIONS: Many routinely used summary methods provide widely ranging estimates when applied to sparse data with high imbalance between the size of the studies' arms. A sensitivity analysis using several methods and continuity correction factors is advocated for routine practice.
Cited by 1,725 works. doi:10.1002/sim.1761
Authors
References
- Meta-analysis in clinical trials
- Beta blockade during and after myocardial infarction: An overview of the randomized trials
- Systematic Reviews in Health Care : Meta-Analysis in Context
- The Interpretation of Interaction in Contingency Tables
- A general parametric approach to the meta‐analysis of randomized clinical trials
- Bayesian approaches to random‐effects meta‐analysis: A comparative study
- A comparison of statistical methods for combining event rates from clinical trials
- A LIKELIHOOD APPROACH TO META-ANALYSIS WITH RANDOM EFFECTS
- Controversies in meta-analysis: the case of the trials of serum cholesterol reduction
- INCORPORATING VARIABILITY IN ESTIMATES OF HETEROGENEITY IN THE RANDOM EFFECTS MODEL IN META-ANALYSIS