KV cache calculator
Calculate KV cache memory requirements for any model on supported GPU systems
Tested: Nemotron, DeepSeek V4, Gemma 4, Kimi, ... — search by size (“70b”), type (“vision”, “moe”) or precision (“fp8”)
Gated model? Add your HF token in Settings →