#speculative-decoding
1 articles
- 2026-10-07
NVIDIA's Tri-Mode Model Doesn't Just Draft — It Switches Gears
NVIDIA's Nemotron-Labs-Diffusion unifies AR, diffusion, and self-speculation in one architecture. It can switch modes mid-generation. The paper claims 6× more tokens per forward than AR — but the real story is how tri-mode changes what hardware you need.