Mooncake Performance

This section collects Mooncake performance evaluations and benchmark results for Mooncake core components.

Document	Area	Key Findings
Storage Benchmark	Mooncake Store storage	Measures end-to-end storage performance across Mooncake Store operations and deployment configurations.
Allocator Benchmark	Segment allocation	The optimized OffsetAllocator significantly improves utilization for uniform-size LLM KV cache allocation patterns.
Allocation Strategy Benchmark	Allocation routing	Compares random and free-ratio-first allocation across segments, replicas, skewed capacity, and DSA-style KV+indexer workloads.
SSD Offload Benchmark	Cache hierarchy	SSD offload extends the KV cache hierarchy with NVMe, reducing the performance cliff after DRAM cache capacity is exhausted in long multi-turn conversations.
Store-RS Benchmark Guide	Rust-native Mooncake Store	CLI reference for throughput, latency, correctness verification, and soak runs.
Store-RS Cold-Tier Performance Design	Cold-tier storage	Optimization priorities and profiling guidance for ExtentStore; this page records design direction rather than benchmark results.
Guide for tebench	Transfer Engine	End-to-end bandwidth and latency benchmarking for classic TE and TENT backends across block size, batch size, and concurrency.