Optimizing instruction cache performance for operating system intensive workloads
Josep Torrellas, Chun Xia, Robert Daigle · 2002
High instruction cache hit rates are key to high performance. One known technique to improve the hit rate of caches is to use an optimizing compiler to minimize cache interference via an improved layout of the code. This technique, however, has been applied to application code only, even though there is evidence that the operating system often uses the cache heavily and with less uniform patterns than applications. Therefore, it is unknown how well existing optimizations perform for systems code and whether better optimizations can be found. We address this problem in this paper. This paper characterizes in detail the locality patterns of the operating system code and shows that there is substantial locality. Unfortunately, caches are not able to extract much of it: rarely-executed special-case code disrupts spatial locality, loops with few iterations that call routines make loop locality hard to exploit, and plenty of loop-less code hampers temporal locality. As a result, interference within popular execution paths dominates instruction cache misses. Based on our observations, we propose an algorithm to expose these localities and reduce interference. For a range of cache sizes, associativities, lines sizes, and other organizations we show that we reduce total instruction miss rates by 31-86% (up to 2.9 absolute points). Using a simple model this corresponds to execution time reductions in the order of 12-26%. In addition, our optimized operating system combines well with optimized or unoptimized applications.>
Cited by 62 works. doi:10.1109/hpca.1995.386527
Authors
References
- Why Aren't Operating Systems Getting Faster As Fast as Hardware?
- The Perfect Club Benchmarks: Effective Performance Evaluation of Supercomputers
- The interaction of architecture and operating system design
- Page placement algorithms for large real-indexed caches
- The impact of operating system structure on memory system performance
- Program optimization for instruction caches
- Cache Performance in the VAX-11/780
- Cache performance of operating system and multiprogramming workloads
- Program optimization for instruction caches
- Characterizing the caching and synchronization performance of a multiprocessor operating system