Generating representative Web workloads for network and server performance evaluation
Paul Barford, Mark E. Crovella · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · 1998
One role for workload generation is as a means for understanding how servers and networks respond to variation in load. This enables management and capacity planning based on current and projected usage. This paper applies a number of observations of Web server usage to create a realistic Web workload generation tool which mimics a set of real users accessing a server. The tool, called Surge (Scalable URL Reference Generator) generates references matching empirical measurements of 1) server file size distribution; 2) request size distribution; 3) relative file popularity; 4) embedded file references; 5) temporal locality of reference; and 6) idle periods of individual users. This paper reviews the essential elements required in the generation of a representative Web workload. It also addresses the technical challenges to satisfying this large set of simultaneous constraints on the properties of the reference stream, the solutions we adopted, and their associated accuracy. Finally, we present evidence that Surge exercises servers in a manner significantly different from other Web server benchmarks.
Cited by 1,431 works. doi:10.1145/277851.277897
Authors
References
- Human behavior and the principle of least effort
- On the self-similar nature of Ethernet traffic (extended version)
- Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level
- Evaluation techniques for storage hierarchies
- Empirically derived analytic models of wide-area TCP connections
- Characteristics of WWW Client-based Traces
- Web server workload characterization
- Self-similarity in World Wide Web traffic
- Measuring the Web
- Characterizing reference locality in the WWW