ORL speeds diffusion language models: 2,788 tokens/s on a single RTX 5090 with LLaDA-2.1-mini + ORL and up to 6.9× end-to-end throughput improvements on QwenDLM-4B with ORL using dlmrt
Read original on r/LocalLLaMA ↗Hey r/LocalLLaMA! We're excited to share ORL (On-Policy Residual Learning), our new research on making diffusion language models (dLLMs) significantly faster without sacrificing generation quality. With ORL and our...
Original headline: "[Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source)"
Timeline
- October 16, 2026 [Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source) r/LocalLLaMA