Using magpie for request extraction and workload modelling
Paul Barham, Austin Donnelly, Rebecca Isaacs et al. · Operating Systems Design and Implementation · 2004
Tools to understand complex system behaviour are essential for many performance analysis and debugging tasks, yet there are many open research problems in their development. Magpie is a toolchain for automatically extracting a system's workload under realistic operating conditions. Using low-overhead instrumentation, we monitor the system to record fine-grained events generated by kernel, middleware and application components. The Magpie request extraction tool uses an application-specific event schema to correlate these events, and hence precisely capture the control flow and resource consumption of each and every request. By removing scheduling artefacts, whilst preserving causal dependencies, we obtain canonical request descriptions from which we can construct concise workload models suitable for performance prediction and change detection. In this paper we describe and evaluate the capability of Magpie to accurately extract requests and construct representative models of system behaviour.
Cited by 564 works.
Authors
References
- The vision of autonomic computing
- Evaluation techniques for storage hierarchies
- Performance debugging for distributed systems of black boxes
- Dynamic instrumentation of production systems
- Monitoring distributed systems
- Path-based faliure and evolution management
- Whole program paths
- Magpie: online modelling and performance-aware systems
- Debugging heterogeneous distributed systems using event-based models of behavior
- Measuring and characterizing system behavior using kernel-level event logging