Qwen3.8 27b with 200K context and MTP on 12GB Ampere cards
Read the original at www.reddit.com→Hello all! Thank you to everyone that contributed their feedback and notes for LlamAmpere the last time I posted. I've continued to chip away at improvements for the 3090 crowd -- this release is modestly faster...
Original headline: "Qwen3.8 27b with 200K ctx + MTP on 12GB Ampere Cards"
Coverage timeline
- Oct 9, 21:39 UTC r/LocalLLaMA lead source Qwen3.8 27b with 200K ctx + MTP on 12GB Ampere Cards
- Oct 9, 22:54 UTC r/LocalLLaMA Qwen3.8-27B UD-IQ4_XS Heretic + MTP on a 16 GB card with 55-68 tok/s (24gb and 12gb versions available too)
- Oct 10, 05:41 UTC r/LocalLLaMA Qwen 3.6 35B A3B: 131K context + vision on 6GB VRAM
- Oct 10, 13:01 UTC r/LocalLLaMA Qwen3.8-27B on a single 3090: 140 tok/s on code with a custom megakernel
- Oct 10, 16:11 UTC r/LocalLLaMA 48Gb VRAM speed AND quality ! (Qwen 3.8 27B Swift 1.5 W8A16)
- Oct 11, 13:04 UTC r/LocalLLaMA UPDATE: Qwen 3.8 27B 140 tok/s on single RTX 3090 Megakernel: KL divergence 0.0009 vs llama.cpp