Lightweight model with 0.4B parameters trained on USENET posts, web scrapes, and fiction; 16,384-token context window
Read the original at www.reddit.com→At only 0.4B parameters with a 16,384-token context window, this model combines versatility with knowledge and memory. submitted by /u/CommodoreCarbonate [link] [comments]
Original headline: "HDTenEightyP/GPT-USENET-6 · A new, lightweight model trained on USENET posts(including UTZOO), web scrapes, and fiction."
Coverage timeline
- Oct 15, 10:09 UTC r/LocalLLaMA lead source HDTenEightyP/GPT-USENET-6 · A new, lightweight model trained on USENET posts(including UTZOO), web scrapes, and fiction.