Efficient virtual memory for big memory servers
Arkaprava Basu, Jayneel Gandhi, Jichuan Chang et al. · ACM SIGARCH Computer Architecture News · 2013
Our analysis shows that many "big-memory" server workloads, such as databases, in-memory caches, and graph analytics, pay a high cost for page-based virtual memory. They consume as much as 10% of execution cycles on TLB misses, even using large pages. On the other hand, we find that these workloads use read-write permission on most pages, are provisioned not to swap, and rarely benefit from the full flexibility of page-based virtual memory. To remove the TLB miss overhead for big-memory workloads, we propose mapping part of a process's linear virtual address space with a direct segment , while page mapping the rest of the virtual address space. Direct segments use minimal hardware---base, limit and offset registers per core---to map contiguous virtual memory regions directly to contiguous physical memory. They eliminate the possibility of TLB misses for key data structures such as database buffer pools and in-memory key-value stores. Memory mapped by a direct segment may be converted back to paging when needed. We prototype direct-segment software support for x86-64 in Linux and emulate direct-segment hardware. For our workloads, direct segments eliminate almost all TLB misses and reduce the execution time wasted on TLB misses to less than 0.5%.
Cited by 57 works. doi:10.1145/2508148.2485943
Authors
References
- The gem5 simulator
- Virtual Memory
- A comparison of software and hardware techniques for x86 virtualization
- A Characterization of Processor Performance in the vax-11/780
- Virtual memory, processes, and sharing in MULTICS
- Heterogeneity and dynamicity of clouds at scale
- Clearing the clouds
- A simulation based study of TLB performance
- Mnemosyne
- Bubble-Up