Pocock boundary explained

The Pocock boundary is a method for determining whether to stop a clinical trial prematurely. The typical clinical trial compares two groups of patients. One group are given a placebo or conventional treatment, while the other group of patients are given the treatment that is being tested. The investigators running the clinical trial will wish to stop the trial early for ethical reasons if the treatment group clearly shows evidence of benefit. In other words, "when early results proved so promising it was no longer fair to keep patients on the older drugs for comparison, without giving them the opportunity to change."[1]

The concept was introduced by the medical statistician Stuart Pocock in 1977. The many reasons underlying when to stop a clinical trial for benefit were discussed in his editorial from 2005.[2]

__TOC__

Details

The Pocock boundary[3] gives a p-value threshold for each interim analysis which guides the data monitoring committee on whether to stop the trial. The boundary used depends on the number of interim analyses.

List of p-values used at each interim analysis, assuming the overall p-value for the trial is 0.05
Number of planned analysesInterim analysisp-value threshold
2 1 0.0294
2 (final) 0.0294
3 1 0.0221
2 0.0221
3 (final) 0.0221
4 1 0.0182
2 0.0182
3 0.0182
4 (final) 0.0182
5 1 0.0158
2 0.0158
3 0.0158
4 0.0158
5 (final) 0.0158

The Pocock boundary is simple to use in that the p-value threshold is the same at each interim analysis. The disadvantages are that the number of interim analyses must be fixed at the start and it is not possible under this scheme to add analyses after the trial has started. Another disadvantage is that investigators and readers frequently do not understand how the p-values are reported: for example, if there are five interim analyses planned, but the trial is stopped after the third interim analysis because the p-value was 0.01, then the overall p-value for the trial is still reported as <0.05 and not as 0.01.[4]

See also

Notes and References

  1. News: Hall C. Heart attacks may be cut by half. Daily Telegraph. 5 September 2005. 1.
  2. 10.1001/jama.294.17.2228. Pocock S. Stuart Pocock. When (not) to stop a clinical trial for benefit. JAMA. 2005. 294. 17. 2228–2230. 16264167.
  3. 10.1093/biomet/64.2.191 . Pocock SJ . Stuart Pocock . Group sequential methods in the design and analysis of clinical trials . Biometrika . 1977 . 64 . 2 . 191–9 . 2335684.
  4. Lancet . 365 . 9471 . 1657–1661. 2005 . 10.1016/S0140-6736(05)66516-6 . Multiplicity in randomised trials II: subgroup and interim analyses . Schulz KF, Grimes DA . 15885299. 26299736 .