LIVE · refreshes every 20 min

updated Nov 14, 08:23 UTC

110010.art / topic

Qwen

Oct 24

20d ago High-Performance llama.cpp fork adds Kepler support, CUDA Graphs & Windows NCCL for legacy GPUs r/LocalLLaMA → story

20d ago Fine-tuned models for Blender and 3D modeling; evaluating modern-model finetunes (e.g., Qwen 3.8 27B/Flash Next) to improve 3D asset creation and editing capabilities r/LocalLLaMA → story

20d ago ik_llama.cpp fork update seeks feedback; reports speed comparisons on 6GB VRAM RTX 2060 and prefills speeds, with Strata benchmarks discussed r/LocalLLaMA → story

20d ago Local Qwen3.8 Flash Next used with Remotion to create motion graphics similar to Opus 5.5 demos r/LocalLLaMA → story

20d ago qwen3.8 27B on a 3090 closely matches Opus 5.5 on a Korean RAG benchmark, with qwen3.8 achieving 77.3% and Opus 5.5 76.6%. r/LocalLLaMA → story

Oct 23

21d ago One of the cheapest and performant local AI inferences setups (~€1600) with i7-14700KF, 64 GB RAM, and Radeon RX 9070XT 16GB for Qwen3.8-Flash-Next-GSQ-RCO-Q2_0 model at 70–90 tokens/sec r/LocalLLaMA → story

21d ago Qwen4exp: build the QSA selection without the kq_mask; ggml-org/llama.cpp PR 30965 r/LocalLLaMA → story

21d ago Qwen 3.8 FN engines benchmarked on a single 5090 with 128GB RAM; results and methodology are provided by Basalt’s developer. r/LocalLLaMA → story

21d ago China ranks third again in KIMI K3.1 PRO results; Qwen and Deepseek (pro) models are forthcoming in November. r/LocalLLaMA → story

21d ago Strata adds Qwen 3.6 35B support; performance on decode speed varies by build r/LocalLLaMA → story

21d ago Baseten releases elephant-1, a 9B decision model post-trained from Qwen3.5-9B, with open weights and lower cost on the AA Decision Index. r/LocalLLaMA → story

21d ago Qwen 3.8 Flash Next Gyro Coder is released. r/LocalLLaMA → story

Oct 22

22d ago Strata-Ready Uncensored Swift 1.5 Qwen 3.8 FN; Unslloth Dynamic IQ4_XS update adds strata-ready artifacts and per-tensor quantization for agentic work r/LocalLLaMA → story

22d ago HuggingFaceBio/Carbon-X: a 14.8B decoder-only model trained on DNA and natural language for mutation classification and DNA sequence prediction r/LocalLLaMA → story

22d ago Is 128GB RAM worth it for running Deepseek v4.1 1017 and GLM 5.3 Flash at low quantization with around 20T/s, given 48GB VRAM (2x3090 24GB) and 48GB DDR4 RAM, compared to Qwen 3.8 Flash Next? r/LocalLLaMA → story

22d ago MacBook M1 Pro 16GB 2021 benchmarks Qwen 3.5 4B, 9B Q4s, 35B and Nemotron Dory 4B, Nano 9B/v2 using Kapitsa on Apple Silicon r/LocalLLaMA → story

22d ago Researchers debate optimal quantization: larger quantization fits hardware but may slow model reasoning; prompts and token generation speed may not compensate for longer thinking blocks. r/LocalLLaMA → story

23d ago Sage-A1.5 released based on Qwen3.6-35B MoE with benchmarks claiming highly competitive performance against Kimi-K3, GLM-5.3, and GPT-5.6-sol r/LocalLLaMA → story

23d ago What’s your favorite medium to large MOE model (~50–150B params) besides Qwen flash next? r/LocalLLaMA → story

23d ago Assessing whether upgrading to 64GB RAM supports running flash-next with Qwen4 on a 3090/3060 system r/LocalLLaMA → story

23d ago I may be late to the game but this is fun r/LocalLLaMA → story

Oct 21

23d ago Qwen3.8 35B shows strong performance in coding benchmarks, surpassing Qwen3.6-35B-A3B in TerminalBench 2.1 and SWE-bench Pro v2; 262k context and 3:1 SWA:full attention reported. r/LocalLLaMA → story

23d ago Qwen researching Qwen; user asks to investigate system requirements for "Qwen 3.8 Flash Next" across 20 sources, shows uncertainty about existence r/LocalLLaMA → story

23d ago Free 3090 speedup hack yields 22–30% prompt-processing and 1–5% generation speed gains, tests show r/LocalLLaMA → story

23d ago Qwen 3.8 Flash Next gains traction in strata in user review r/LocalLLaMA → story

23d ago Opencode sends chats to its server by default for features like title retrieval and compaction, per user question about data collection with a local qwen3.8 instance. r/LocalLLaMA → story

23d ago Running Qwen3.6-35B-A3B on 2x 4090 with sglang for GitLab code review r/LocalLLaMA → story

23d ago OvisOCR3: a 0.8B OCR model with structured output and cross-page table reconstruction r/LocalLLaMA → story

23d ago Sage‑A1.5 is a 35B mixture-of-experts agentic model based on Qwen3.6-35B-A3B designed to advance long-horizon scientific problem solving through adaptive capability composition. r/LocalLLaMA → story

23d ago User reports ASCII pruning of gguf files reduces Qwen3.8 27B gguf by about 0.6GB and asks whether there is a negative impact. r/LocalLLaMA → story

24d ago Artificial Analysis plots the Intelligence Index against total or active parameters, including optional horizontal lines for closed-frontier models and MOE/lookup-table models such as Qwen3.8. r/LocalLLaMA → story

24d ago Fast LoRA in llama.cpp lacks fast kernels, according to updates and examples showing LoRA usage with Qwen3.8-Flash-Next models r/LocalLLaMA → story

24d ago High-dimensional layer-state trajectories reveal the internal dynamics of transformer inference arXiv cs.LG → story

Oct 20

24d ago EAGLE-4 release achieves faster performance than DFlash2 and DSpark, with MTP, DSpark, DFlash 2, and EAGLE-4 benchmarks showing speedups; Qwen 3.8-27B currently supported r/LocalLLaMA → story

24d ago Strata with CachyOS achieves higher throughput than Unsloth on a 9t/s to 48t/s range; 32k context size fits 8GB GPU, 42k feasible but 64k requires more VRAM r/LocalLLaMA → story

24d ago Open_rknpu2_lm_infer runs an open NPU inference engine on Rockchip RK3588, enabling Qwen3.5-4B at ~10 tok/s without proprietary libraries. r/LocalLLaMA → story

24d ago Running 35B MoE models on a Tesla K80 (2014) at about 21 tokens per second in plain C r/LocalLLaMA → story

24d ago Agnes-3.0-qwen achieves strong agentic performance and reliable instruction following with a 1M-token context window r/LocalLLaMA → story

24d ago Experimental decision models for medical Q&A shown at Lithuanian AI in Medicine conference; demonstrates medical abstracts, questions, and choices (AIML.lt lab) r/LocalLLaMA → story

24d ago Qwen3.8-Flash-Next vs Opus 5.5: six-way benchmark on a real Rust feature with Claude Code and Pi r/LocalLLaMA → story

←1…4 567 →