LIVE · refreshes every 20 min

updated Nov 14, 08:03 UTC

110010.art / topic

Qwen

Nov 8

5d ago Tencent reportedly develops a speculative decoding method claiming 3x faster decoding for 27B models r/LocalLLaMA → story

5d ago Fine-tuned Qwen3.5-0.8B turns plain English into bash commands with a deterministic risk checker; dale achieves 89.2% accuracy on 471 requests across English and Spanish. r/LocalLLaMA → story

5d ago Qwen 3.8 flash next exhibits role-playing of an API error in Hermes harness locally. r/LocalLLaMA → story

5d ago Proposal to uncensor LoRAs by posting single LoRA per model for broad applicability r/LocalLLaMA → story

5d ago Can a dual GTX 1080 Ti setup run qwen3.8 27b with 22 GB VRAM? r/LocalLLaMA → story

5d ago Increasing tokens per second by splitting workload across multiple slots on the same GPU for Qwen 3.8 27b, noting context reduction per slot and VRAM overlap considerations r/LocalLLaMA → story

5d ago Qwopus3.8-27B-Coder-Flash is a 27B coding-focused model extending the Qwopus Flash approach for software-engineering tasks r/LocalLLaMA → story

5d ago 2x256gb m5u: clustering yields better results with separate models; current clustering tech and decode concurrency limitations hinder improvement r/LocalLLaMA → story

5d ago Local document processing remains feasible with non-Chinese OCR options like Granite-Docling, LiteParse, Tesseract, and Gemma, after contracts exclude Chinese software and models. r/LocalLLaMA → story

5d ago 35 domain-expert LoRAs on a MoE (Qwen3.6-35B-A3B) trained with MLX on Mac Studio; findings include BF16-only adapter hot-swapping and performance details for serving with per-request adapter swaps. r/LocalLLaMA → story

6d ago Apex 35B and Axion 35B finetunes appear for Qwen 3.6 35B; discussion and details elusive r/LocalLLaMA → story

6d ago Qwen-4-Flash-Early (codename hawk) added to GameFeel Bench; audio score calculated r/LocalLLaMA → story

6d ago Gradient-free weight editing reduces overthinking in Qwen3.8-27B; analysis code and evaluation artifacts are disclosed GitHub Trending (AI) → story

Nov 7

6d ago Qwen3.8-Flash-Next URL issue raised while refactoring Neovim config, with API key and aliyuncs URL access observed r/LocalLLaMA → story

6d ago Testing Qoduck (Maybe qwen4) on Qoder; native image and video generation observed r/LocalLLaMA → story

6d ago Qwen3.8-Flash-Next Gyro S on a Valve Steam Machine achieves about 18 t/s decode and about 235 t/s prefill with 8 GB GPU and 32 GB RAM on SteamOS 3.9.5 r/LocalLLaMA → story

7d ago Change in number of parameters in models over time r/LocalLLaMA → story

7d ago Astra uses weight space programming to optimize production Qwen 3.8 4-bit models; user reports reduced anxiety and faster task completion with Calmer-Qwen-3.8 r/LocalLLaMA → story

7d ago What made your custom research/task harness effective; how to reduce micromanaging r/LocalLLaMA → story

Nov 6

7d ago Local LLMs enter a new phase as Qwen 27B, Flash-Next, and upcoming Qwen 4 push frontier-level capabilities; Unsloth and ISTA-DASLab quantizations improve accessibility without sacrificing quality r/LocalLLaMA → story

7d ago NousResearch/Arete-27B post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model; Arete-27B released as an open-source alternative r/LocalLLaMA → story

7d ago Cooling significantly boosts performance: increasing fan speed from 6-8 to 17-20 gt/s yields higher throughput. r/LocalLLaMA → story

7d ago Ripple 65B preview compared with Qwen 3.8 27B and Qwen 3.8 FN in benchmark results r/LocalLLaMA → story

7d ago Dual V100s sought for Qwen3.8 27b: user requests hard data on PP and TPS for high quants (q6–q8) with large context windows; aims to quantify speedup over MI60. r/LocalLLaMA → story

7d ago Oc-e-Non-v1 reduces Qwen3-4B-Instruct-2507's mean response length by 50% while aiming for more concise outputs. r/LocalLLaMA → story

7d ago Qwen Flash Next performance with different languages; user asks how German input affects quality and reasoning tokens compared to other languages r/LocalLLaMA → story

7d ago Qwen Developers on X: “Qwhen? Qsoon!”; poster includes Chinese text for international audience r/LocalLLaMA → story

7d ago Edge devices get attention as researchers explore small-model efficiency and edge-harnesses rather than large, costly models r/LocalLLaMA → story

7d ago Qwen 4.5 and Qwen 5 to expand model scales; Anthropic model leak concerns rise r/LocalLLaMA → story

7d ago Qwen 4 stealth announces its arrival; corroboration: Qwen—the becoming begins r/LocalLLaMA → story

7d ago Has anyone tried using Qwen or other LLMs to directly edit ACE-Step weights? r/LocalLLaMA → story

7d ago Qwen4 will be released next week r/LocalLLaMA → story

7d ago CyberTiel35BA3B works on Blender rigging via MCP with 8GB VRAM and 16GB RAM; llama.cpp used r/LocalLLaMA → story

7d ago Open-source tool uses Steam tag data to inspire game design ideas; runs fully in-browser with daily-updated catalog r/LocalLLaMA → story

8d ago Embedding-space fingerprinting of LoRA fine-tunes; recovering the training-data domain from the model artifact alone arXiv cs.AI → story

Nov 5

8d ago Qwen3.8-27B benchmark compares 6 inference engines, GGUF vs NInfer, 256k context, assessing speed and quality r/LocalLLaMA → story

8d ago OrcaCyber-Nano-1.0 praised as a top finetune with strong Bash command chain performance and resilience comparable to base Qwen 3 r/LocalLLaMA → story

8d ago Deepseek fixes HDMI display issues; user reports slower results with Qwen 3.8 flash and describes hardware and throughput details r/LocalLLaMA → story

8d ago Opus weight-space edits to Qwen3.8-27B to reduce refusal are not localized; refusals are distributed across the model r/LocalLLaMA → story

8d ago SpecOPD: Branch-Parallel on-policy distillation for speculative decoding r/LocalLLaMA → story

←123 4…7 →