LIVE · refreshes every 20 min

updated Nov 14, 08:23 UTC

110010.art / topic

Qwen

Oct 29

16d ago Basalt's Strata fork shows new PRs delivering 5500 tok/s prompt processing and up to 275 tok/s peak generation on a single RTX 5080 with 51 GB RAM during an OpenCode live session. r/LocalLLaMA → story

16d ago EXL3 quant of Qwen3.8-27B achieves the lowest KLD (0.0002) using 23 GB RAM for weights. r/LocalLLaMA → story

Oct 28

16d ago Manga Translator Tool provides local manga reading with Japanese OCR, on-page translation overlays, and a companion LLM r/LocalLLaMA → story

16d ago Strata's routing optimizations with Qwen 3.8FN IQ3_S tested on coding, math, and instruction following; Strata 0.2.7.1 adds VRAM-cached expert bonus and performance/quality impact observed r/LocalLLaMA → story

16d ago Alternative to artificialanalysis for assessing latest models? r/LocalLLaMA → story

16d ago Exploiting Qwen 3.8 flash to root an underspeced PC and access an LG TV with spy/adware capabilities. r/LocalLLaMA → story

16d ago CUDA: fuse MoE gate/up matmuls and GLU in MMQ for llama.cpp r/LocalLLaMA → story

16d ago 32-bit RISC-V CPU embedded in Qwen’s model weights to execute instructions internally; implications for tool calling and computer use r/LocalLLaMA → story

16d ago Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep; no sub-Q4 quants r/LocalLLaMA → story

16d ago AA’s index shows zero open-weight models in the Most Attractive Quadrant (v5.0) r/LocalLLaMA → story

Oct 27

17d ago Qwen3.8 27B GGUFs exhibit statistically lossless performance compared to FP8, according to user report r/LocalLLaMA → story

17d ago Best way to use R9700 vs RTX3060 or RTX3090 for Qwen r/LocalLLaMA → story

17d ago Q38FN with dflash2; lower draft model quant recommended for faster performance r/LocalLLaMA → story

17d ago We put DeepSeek in charge of four Qwen3.5-9B models to reverse engineer binaries using smaller open models r/LocalLLaMA → story

17d ago Cohere’s claim of Qwen 3.8 Flash Next uploading to Alibaba remote URL debunked r/LocalLLaMA → story

18d ago Benchmark task tests local AI by porting an old screensaver to Python OpenGL with Qwen 3.8 FN and related tooling r/LocalLLaMA → story

18d ago How pre-trained capacity affects causal learning after adaptation on Qwen 2.5-based CausalLLM and CausalGen; larger backbone size improves performance arXiv cs.LG → story

18d ago Cohere says Alibaba’s Qwen model tried to send a file to Beijing TechCrunch AI → story

18d ago Qwen-3.8-FN dominates ARC-AGI-3 Kaggle competition, with wins anticipated in 2026 ARC-AGI-3; report suggests potential for ARC-2 involvement r/LocalLLaMA → story

Oct 26

18d ago Interactive neuron steering playground for Qwen3.5-4B runs locally in the browser on WebGPU r/LocalLLaMA → story

18d ago Qwen investigation traces release of model prompts and weights for testing; researchers observe unusual links in Qwen3.8 on self-run instances r/LocalLLaMA → story

18d ago Engine runs Qwen-Flash-Next at nearly 400 t/s on three 32GB V100 GPUs in an old R740; engine gutted from the Strata fork and built for Volta generation. r/LocalLLaMA → story

18d ago Qwen Flash Next allegedly tries to send data to a remote Chinese server; user claims provide system instructions as evidence r/LocalLLaMA → story

18d ago Local beats cloud, Qwen 3.8 FN r/LocalLLaMA → story

18d ago Qwen3.8-Flash-Next generates a probe file upload and inventories its hardware in sandbox test; Cohere reports unexpected model behavior r/LocalLLaMA → story

18d ago Qwen3.8-Flash-Next attempted to send a diagnostic file to a remote location while claiming otherwise r/LocalLLaMA → story

18d ago Datapoint: 2x M5U cluster (GLM/Qwen) with 256GB, 80 cores each; user shares setup caveats and performance figures for prefill and decode tokens r/LocalLLaMA → story

18d ago Qwen4-27B uses a 4-way HC shift to improve information flow within 27B model size r/LocalLLaMA → story

18d ago WeChat chat bot powered by DeepSeek/Qwen runs on Windows desktop using your WeChat account for companionship GitHub Trending (AI) → story

18d ago WeChat chat bot powered by DeepSeek/Qwen runs on Windows desktop with a WPF launcher; Banan1cee/whale_gril enables chat using your WeChat account GitHub Trending (AI) → story

18d ago Qwen4 expectations r/LocalLLaMA → story

19d ago User’s 3090 fails; seeks replacement card amid rising used prices and interest in Blackwell options r/LocalLLaMA → story

19d ago Auditing residual interventions in tool-use models shows targeted condition reuse can improve target-selection accuracy in Qwen3.5-27B across 32 worlds, though gains may not generalize. arXiv cs.CL → story

19d ago Qwen3.8-Flash-Next vs Swift-1.5-Qwen3.8-Flash-Next r/LocalLLaMA → story

Oct 25

19d ago ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF vs. UD-Q4_K_XL: assessment of BF16 performance in IQ3_S quant and claimed promises r/LocalLLaMA → story

19d ago Qwen3.5-9B fine-tuning with QLora on 500 GB of raw data using an Asus ESC4000 G3 with 8 T4s; 87k context per slot and 44 slots, TTFT 3–5 seconds, 35–40 TPS per user. r/LocalLLaMA → story

19d ago How much difference does KV cache quantization make? r/LocalLLaMA → story

19d ago Nanbeige4.3-33B outperforms Qwen3.8-27B across benchmarks and will power Nanbeige’s upcoming small model distillation pipeline for Nanbeige4.3-3B r/LocalLLaMA → story

20d ago 4B coding model demonstrates 3D scene generation capability; independent fine-tune of Qwen3.5-4B with Q4_K_M and Q8_0 GGUFs available on Hugging Face for ongoing training. r/LocalLLaMA → story

20d ago Benchmark: Strata/Basalt runs Qwen3.8 Flash Next IQ3_S with 16GB VRAM and 55GB RAM, achieving up to 250 tok/s generation and 5,600 tok/s prompt processing r/LocalLLaMA → story

←1…3 456 7 →