LIVE · refreshes every 20 min

updated Nov 14, 07:43 UTC

110010.art / topic

CUDA

Nov 12

2d ago Inflect v3 releases a lightweight local TTS family (Mini, Micro, Atom) with Mini at 34.31M parameters, six voices, and reference voice tuning r/LocalLLaMA → story

Nov 10

4d ago CUDA+ROCm dual-backends LLM inference for mixed-vendor GPUs (up to 48% faster) r/LocalLLaMA → story

Nov 9

4d ago RustingStrata runs DeepSeek-V4.1-Flash (249 GB) on a single RTX 3060 with 30 GB RAM using CUDA and Vulkan backends r/LocalLLaMA → story

Nov 8

5d ago Resurrecting 2013 E-Waste: Native CUDA Mamba-1 & PyTorch 2.7.1 on Windows for legacy GPUs (Kepler–Turing, SM 3.5–7.5) r/LocalLLaMA → story

Nov 5

8d ago CUDA hour is late; who made the R9700 this fast? r/LocalLLaMA → story

8d ago Ask HN: Can current AI models reverse engineer CUDA drivers? Hacker News (AI) → story

Nov 4

9d ago LFM3 1.7b performs well; 2b VL also good but with half the context, and is fast on CUDA with RTX 3090 Ti r/LocalLLaMA → story

Nov 2

11d ago Llama.cpp: fix unified KV for multi-seq with flash_attn_ext_rows on CUDA r/LocalLLaMA → story

11d ago Local quants compare performance of 9 real bugs between a home engine and Claude models on private history data r/LocalLLaMA → story

12d ago Berth, a lightweight Go-based GPU resource manager, coordinates GPU access via leases, priorities, and a queue to manage when apps use VRAM and hand control to the next task. r/LocalLLaMA → story

Oct 31

13d ago Ternary Bonsai 2 runs with native CUDA offload and fast CPU in ik_llama.cpp, bringing full compatibility outside PrismML’s fork. r/LocalLLaMA → story

Oct 28

16d ago CUDA: fuse MoE gate/up matmuls and GLU in MMQ for llama.cpp r/LocalLLaMA → story

Oct 27

17d ago Running Local AI on Nvidia DGX Spark without CUDA Hacker News (AI) → story

Oct 26

18d ago GPU FP32 accumulation unlocks on RTX 20/30/40; consumer Blackwell RTX 50 remains restricted, causing misconceptions r/LocalLLaMA → story

18d ago $10–12K local agentic coding rig: 1× RTX 5090 vs 4× RTX 3090 vs hybrid vs PRO 6000 vs Mac Studio? r/LocalLLaMA → story

Oct 24

20d ago High-Performance llama.cpp fork adds Kepler support, CUDA Graphs & Windows NCCL for legacy GPUs r/LocalLLaMA → story

Oct 23

21d ago NVIDIA RTX 3090s reportedly unlock full FP16/TFLOPS performance via GPU-unlock before driver load; user claims 3090 gains 1.9x BF16 tensor math after unlocking. r/LocalLLaMA → story

Oct 21

24d ago PolyGraph: Plan-buffer CUDA Graphs for Adaptive Speculative Decoding arXiv cs.LG → story

Oct 20

24d ago Running 35B MoE models on a Tesla K80 (2014) at about 21 tokens per second in plain C r/LocalLLaMA → story

Oct 19

25d ago RTX 5090 Laptop on Linux experiences GPU hangs (Xid 8) during local LLMs; CUDA graphs issue noted with GGML and a workaround is to disable CUDA graphs. r/LocalLLaMA → story

25d ago Intel D270 GPU: specs include up to 480 Gb VRAM LPDDR5, 1.5T/s memory bandwidth, and interference optimized; user asks about pricing, workstation vs server use, and driver support r/LocalLLaMA → story

Oct 17

27d ago CUDA shows big speedup for low-bit MMVQ types like Q2_K and Q3_K in llama.cpp pull request 30517 r/LocalLLaMA → story