๐ฅ๏ธ Platform:
Loading...
Best Tokens/sec
โ
Run benchmark to see
Avg Time to First Token
โ
milliseconds
Speedup Factor
โ
Q4 vs Q8
Models Tested
โ
quantization levels
๐ Benchmark Results
| Model |
Quant |
Tokens/sec |
TTFT (ms) |
RAM (MB) |
Size (GB) |
Speed |
| Click "Run Benchmark" to populate results |
๐งช Try Inference
Output will appear here...