LIVE · refreshes every 20 min

updated Sep 12, 04:23 UTC

← 110010.art all stories

r/LocalLLaMA ·27d ago

Quantized AI9Stars' G9v3-39A5B to GGUF and created a llama.cpp fork to support it

Read the original at old.reddit.com→

submitted by /u/linuxid10t [link] [comments]

Coverage timeline

Aug 15, 04:35 UTC r/LocalLLaMA lead source Quantized AI9Stars' G9v3-39A5B to GGUF and created a llama.cpp fork to support it

Related stories

Qwen 3.8 27b—Acquarium panel failure; Q8_K_XL_unsloth

r/LocalLLaMA · 26d ago · source ↗

Qwen3.8 27B Q2 vs Q3 and Qwen3.6 35B-A3B MoE on 12GB VRAM

r/LocalLLaMA · 26d ago · source ↗

Qwen 3.8 27b shows 22 t/s performance with Q4, max context, llama.cpp, and MTP enabled; user reports and configurations posted on Reddit

r/LocalLLaMA · 26d ago · source ↗

Qwen 3.8 27B Q8 faster than Q6 with MTP on Apple Silicon using llama.cpp and lmstudio gguf

r/LocalLLaMA · 27d ago · source ↗

LLMs temper Bayesian priors using a single unembedding direction, the direction of ignorance

arXiv cs.LG · 8d ago · source ↗