Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k KV + vision on 16GB VRAM @ 80t/s and 1500pp
Read the original at www.reddit.com→I get a lot of hate whenever I tell people I run a Q4 quant of Qwen3.8 27B with 262k KV 80t/s with vision, all while running 2 screens on windows on the same card. People seem to think I am lying or making it up. I...
Original headline: "Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp"
Coverage timeline
- Oct 12, 20:14 UTC r/LocalLLaMA lead source Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp