RTX PRO 6000 Blackwell LLM Wiki
This repository is a field wiki for running frontier LLMs on NVIDIA RTX PRO
6000 Blackwell / SM120 PCIe systems. It is more than a few launch snippets: it
contains reproducible Docker builds, exact vLLM and SGLang runbooks, benchmark
tables, KLD quality checks, quantization notes, DCP/MTP/DSpark/DFlash debugging,
PCIe topology work, and regression history.
Start Here
For GLM-5.3, Qwen3.8-Flash-Next, DeepSeek V4 text/Vision and V4.1, start with
the shared Docker launch guide. One image
provides model profiles, speculation, GPU selection and optional LMCache.
Each model page has a complete launch command, exact option examples and
recorded speeds. Use the recipe archive
to reproduce a preceding release without changing the recommended model URLs.
| Model family | Start here | Scope |
|---|
| GLM-5.3-Flash | GLM-5.3-Flash | Unified TP4 profile, NVFP4 target, no-spec/MTP3/MXFP8 DFlash2 choices, bounded decode/prefill/Sieve measurements and quality reports. |
| GLM-5.3-Flash Spark | Two-GPU recipe | Memory-tuned Spark checkpoint preset for two 96-GB GPUs, MTP3 and optional RAM/disk prefix storage. |
| GLM-5.2 | GLM-5.2 Runbook Hub | Fathomless vLLM, NVFP4, online FP8/MXFP8, B12X, DCP, MTP, KLD. |
| DeepSeek-V4.1-Flash | DeepSeek-V4.1-Flash | Unified TP4 profile, native text/vision, adaptive DSpark K7, RAM/SSD Engram tables, bounded API and throughput evidence. |
| DeepSeek-V4-Flash / DSpark | DeepSeek V4 text, DeepSeek V4 Vision | Unified TP2 profiles, fixed DSpark K5/K3, B12X, optional LMCache and measured image comparisons. |
| Kimi | Kimi Runbook Hub | Kimi-K2.7-Code, DFlash, parser/tool-call runtime. |
| Xiaomi MiMo | MiMo Runbook Hub | MiMo V2.5 Pro FP4-DFlash. |
| Qwen3.8-Flash-Next | Qwen3.8-Flash-Next | Unified TP1/TP2 profile, MTP3, CPU PLE tables, optional vision and FP8 KV. |
| Qwen3.8-27B | Qwen3.8-27B on RTX PRO 6000 Blackwell, readable QSRT K5 training result, exact QSRT K5 specification | TP1, TP2, and TP4 throughput evidence plus the QSRT K5 training interpretation, artifact, fidelity, runtime, and source contract. |
| GLM-5.1 | GLM-5.1 Runbook Hub | Historical GLM-5.1, KLD methodology, older B12X/SGLang work. |
| Legacy / secondary models | Legacy Model Runbooks | DeepSeek-V4-Pro, GLM-4.7, Qwen, MiniMax, older Kimi pages. |
Need the complete map of every Markdown page?
What Is In This Repository?
| Need | Where |
|---|
| Shared image launch, speculation and cache settings | Unified Docker guide, then the relevant model profile page. Other model families retain their own runbooks. |
| Rebuild the unified image | Versioned runtime configuration and assembly sources; historical recipes remain in model release pages and scripts. |
| Compare backend speed | Model benchmark tables plus Benchmark Results. |
| Check quantization fidelity | General KLD methodology, GLM-5.2 KLD, and model-specific KLD sections. |
| Compare model output quality on a real Czech tutoring workload | Czech tutoring quality comparison: DeepSeek-V4-Flash, V4.1-Flash, Qwen3.8-Flash-Next and GLM-5.3-Flash per reasoning mode, with a reproducible runner. |
| Understand MTP, DSpark, or DFlash | Speculative Decoding, DS4/Kimi/MiMo pages. |
| Debug topology or PCIe behavior | Topology, PCIe Bandwidth, GPU Configurations. |
| Avoid known runtime footguns | Common Issues, model caveats, and daily summaries. |
This is the beginning of the README. Read the rest at the original. Read the full README ↗
