FX100 KV-Cache Benchmark (480B, TP8 long-context, signed)
Scope
Qwen3-Coder-480B-FP8, single 8-GPU instance (TP=8 standard production topology), long-context cold recovery, three-way comparison across concurrency levels.
Original filename: test/AISSD5000-KVCache性能测试报告（480B·TP8长上下文·正式版）.pdf
Test platform (free)
8× AMD Instinct MI308X (192 GB HBM each, gfx942); 2× AMD EPYC 9654 (384 threads), ≈1.5 TB RAM; ROCm 7.2; vLLM 0.20.1+rocm721; LMCache (built from upstream mainline source, 2026-06-29). Device under test: Mingxin FX100 all-flash NVMe-oF array: 4-drive RAID0 (14 TB, XFS), RoCEv2, single 100 GbE port. Baseline: Local single NVMe drive (PCIe Gen4, 2 TB); no-external-storage re-compute.
Measured figures backed by this report (free)
These figures are not behind the paywall — they are the performance claims this site makes publicly, so anyone should be able to check them for free. What is paid for is the report itself: full method, per-level raw data, charts, screenshots and signatures.
480B production topology, long-context cold-recovery load: +29% at concurrency 8 (lower bound), +40% at the optimal operating point (concurrency 16), +35–36% whole-machine TP4×2.
Provenance: Measured, R2/R3
480B TP8, three concurrency levels: TTFT p50 down from 10.17–35.73 s to 7.53–26.35 s.
Provenance: Measured, R2
Re-compute baseline TTFT p50 149.5 s (conc 16) vs 11.85 s on FX100; throughput 4.1 vs 74.9 tok/s.
Provenance: Measured, R2
Sample: three-way comparison (free)
| Concurrency | FX100 TTFT p50 | Local disk TTFT p50 | Re-compute TTFT p50 | FX100 throughput | Local disk throughput |
|---|---|---|---|---|---|
| 8 | 7.53 s | 10.17 s | — | 56.6 tok/s | 43.9 tok/s |
| 16 | 11.85 s | 17.31 s | 149.48 s | 74.9 tok/s | 53.6 tok/s |
| 32 | 26.35 s | 35.73 s | — | 71.6 tok/s | 53.9 tok/s |
Measured, R2 (TTFT in seconds, throughput in tok/s; re-compute measured at conc 16 only).
Solutions backed by this report
Get the complete report
One payment unlocks 2 files: the signed Chinese original plus the English reference translation (we do not charge twice for the same research in two languages). The download link is valid for 7 days and allows up to 10 downloads. Files are available on the page immediately after payment, and the link is also emailed to you.
Seller: Wang Qiyuan (individual). Merchant of record: Creem, which invoices you and files VAT/GST in your jurisdiction. Checkout accepts credit/debit cards, Apple Pay and Google Pay. Questions and refunds:support@mingxinstorage.xyz— see theTerms of Servicefor the licence and refund policy.
English PDFs are AI-produced reference translations with machine-verified number fidelity; the signed Chinese originals remain authoritative — figures, screenshots, signatures and stamps are only in the originals. Nothing on this page is investment advice.