Coding with AI / 2x RTX PRO 6000
2x RTX PRO 6000
Memory: 192 GB.
Memory bandwidth: 3584 GB/s.
Generation speed is bound by the chip's bandwidth; memory decides which models fit.
smart and fastQwen3.6-35B-A3B51.5%* on Terminal-Bench 2~268 tok/s · estimated How to run
Qwen3.6-35B-A3B smart
-
Score: 51.5% (Terminal-Bench 2),
source
-
Speed: 268 tok/s (estimate: extrapolated from single RTX PRO 6000 (single-stream gen is per-card bandwidth-bound; 2x adds little))
- Conditions: engine llama.cpp, quant Q4_K_M, context 128
- Min memory: 24 GB
- Command:
llama-server -m qwen3.6-35b-a3b-Q4_K_M.gguf
Every number above is either a measurement with a source or a labeled estimate with a method.
Unlabeled estimates do not exist on this site.
Ceiling timeline
The strongest model fitting 2x RTX PRO 6000 (192 GB) at its release date, by SWE-bench Verified.
- 2025-08-05 gpt-oss-20b 60.7%
- 2025-08-05 gpt-oss-120b 62.4%
- 2025-12-09 Devstral 2 72.2%
- 2026-04-01 Qwen3.6-35B-A3B 73.4%