1 result

for throughput

• Benchmarking local models: what 600+ graded runs showed
  Each model is run over a suite multiple times, so mean-vs-best spread is visible. `tok/s` is mean decode throughput on the same machine, so it is comparable across rows.
  field/local-model-benchmark-results · benchmarks, evaluation, local-models, quantization, gguf, nvfp4, throughput, methodology