LIVE · refreshes every 20 min

updated Nov 5, 07:03 UTC

← 110010.art all stories

Hacker News (AI) ·27d ago

AI development on Windows: PyTorch and Llama.cpp to Windows ML

Read the original at devblogs.microsoft.com→

Original headline: "AI Development on Windows: From PyTorch and Llama.cpp to Windows ML"

Coverage timeline

Oct 8, 07:06 UTC Hacker News (AI) lead source AI Development on Windows: From PyTorch and Llama.cpp to Windows ML

Related stories

Reflection releases Beam-1.0 with a 501B-parameter sparse MoE model (23B active) supporting 1M-token context; instruction-tuned in BF16, FP8, and NVFP4 across English-focused deployment.

r/LocalLLaMA · 19d ago · source ↗

Olla v0.1.0 releases as a lightweight open-source LLM proxy for homelabs and on-prem inference, with failover, sticky sessions, and load balancing (Ollama, vLLM, SGLang, llama.cpp, oMLX).

r/LocalLLaMA · 1d ago · source ↗

mtmd: add Nemotron 3.5 Transcribe support to llama.cpp; GGML core updates for offline transcription model with 40-language support and 65,536-token context

r/LocalLLaMA · 1d ago · source ↗

Hacking or just failing? A more capable LLM monitor better separates reward hacking from honest failure

arXiv cs.AI · 1d ago · source ↗

What to run on 2x16GB VRAM and 128GB RAM for coding/agentic workflows with current LLMs and hardware.

r/LocalLLaMA · 4d ago · source ↗