Predicting Inter-Thread Cache Contention on a Chip Multi-Processor Architecture
Dhruba Chandra, Fei Guo, Seongbeom Kim et al. · Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings · 2005
This paper studies the impact of L2 cache sharing on threads that simultaneously share the cache, on a chip multi-processor (CMP) architecture. Cache sharing impacts threads nonuniformly, where some threads may be slowed down significantly, while others are not. This may cause severe performance problems such as sub-optimal throughput, cache thrashing, and thread starvation for threads that fail to occupy sufficient cache space to make good progress. Unfortunately, there is no existing model that allows extensive investigation of the impact of cache sharing. To allow such a study, we propose three performance models that predict the impact of cache sharing on co-scheduled threads. The input to our models is the isolated L2 cache stack distance or circular sequence profile of each thread, which can be easily obtained on-line or off-line. The output of the models is the number of extra L2 cache misses for each thread due to cache sharing. The models differ by their complexity and prediction accuracy. We validate the models against a cycle-accurate simulation that implements a dual-core CMP architecture, on fourteen pairs of mostly SPEC benchmarks. The most accurate model, the inductive probability model, achieves an average error of only 3.9%. Finally, to demonstrate the usefulness and practicality of the model, a case study that details the relationship between an application's temporal reuse behavior and its cache sharing impact is presented.
Cited by 524 works. doi:10.1109/hpca.2005.27
Authors
References
- Evaluation techniques for storage hierarchies
- Symbiotic jobscheduling for a simultaneous mutlithreading processor
- Symbiotic jobscheduling for a simultaneous multithreaded processor
- On the inclusion properties for multi-level cache hierarchies
- An analytical cache model
- A new memory monitoring scheme for memory-aware scheduling and partitioning
- Phase tracking and prediction
- Footprints in the cache
- On the inclusion properties for multi-level cache hierarchies
- Cache miss equations