Basalt: Flash-Next achieves 665 tok/s structured and 354 prose on a 5090 + 5060 Ti with 2.6x Strata performance
Read the original at www.reddit.com→Basalt: Blackwell inference engine Hi all! So over the last week I've been working on a Strata fork that's heavily tuned and can achieve throughput up to 2.6x what Strata usually does on the same weights. It's...
Original headline: "Basalt: Flash-Next at 665 tok/s structured, 354 prose on a 5090 + 5060 Ti (2.6x Strata)"
Coverage timeline
- Oct 10, 00:58 UTC r/LocalLLaMA lead source Basalt: Flash-Next at 665 tok/s structured, 354 prose on a 5090 + 5060 Ti (2.6x Strata)
- Oct 10, 08:03 UTC r/LocalLLaMA Sharing my latest project: strata-mlx
- Oct 10, 09:50 UTC r/LocalLLaMA Strata with Qwen3.8 Flash Next UD-Q4_K_XL
- Oct 11, 04:27 UTC r/LocalLLaMA Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards