Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery
David J. Spiegelhalter · International Journal for Quality in Health Care · 2003
OBJECTIVE: To investigate the use of the risk-adjusted sequential probability ratio test in monitoring the cumulative occurrence of adverse clinical outcomes. DESIGN: Retrospective analysis of three longitudinal datasets. SUBJECTS: Patients aged 65 years and over under the care of Harold Shipman between 1979 and 1997, patients under 1 year of age undergoing paediatric heart surgery in Bristol Royal Infirmary between 1984 and 1995, adult patients receiving cardiac surgery from a team of cardiac surgeons in London,UK. MAIN OUTCOME MEASURE: Annual and 30-day mortality rates. RESULTS: Using reasonable boundaries, the procedure could have indicated an 'alarm' in Bristol after publication of the 1991 Cardiac Surgical Register, and in 1985 or 1997 for Harold Shipman depending on the data source and the comparator. The cardiac surgeons showed no significant deviation from expected performance. CONCLUSIONS: The risk-adjusted sequential probability test is simple to implement, can be applied in a variety of contexts, and might have been useful to detect specific instances of past divergent performance. The use of this and related techniques deserves further attention in the context of prospectively monitoring adverse clinical outcomes.
Cited by 229 works. doi:10.1093/intqhc/15.1.7
Authors
References
- Statistics: The Problem of Examining Accumulating Data More Than Once
- Sequential Tests of Statistical Hypotheses
- SEQUENTIAL TESTS IN PROPHYLACTIC AND THERAPEUTIC TRIALS
- Learning from Bristol: report of the public inquiry into children's heart surgery at Bristol Royal Infirmary 1984-1995
- League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
- Analysis of a cluster of surgical failures: Application to a series of neonatal arterial switch operations
- Monitoring the results of cardiac surgery by variable life-adjusted display
- Cumulative risk adjusted mortality chart for detecting changes in death rate: observational study of heart surgery
- Bristol, Shipman, and clinical governance: Shewhart's forgotten lessons
- Improving the Statistical Approach to Health Care Provider Profiling