Recommend sizing
Start with just a model name — we fill the rest, then let you tune every assumption.
Loading...
Tested: , ... — type to autocomplete
Gated model? Add your HF token in Settings →
Based on your configuration — ISL 2,048, OSL 128, TTFT target 1.000s, concurrency 32, TPOT 30 ms.