Unsloth releases Kimi K3 model variants with UD-Q1_0 466GB, TQ2_0 551GB, and larger configurations; Hugging Face page linked.
Read the original at old.reddit.com→The smallest UD-Q1_0 is 466GB, TQ2_0 551GB. Well done team Unsloth! https://huggingface.co/unsloth/Kimi-K3-GGUF submitted by /u/Hannibalj2ca [link] [comments]
Original headline: "New Unsloth KImi K3 drops! Q1_0 (466GB), TQ1_0(509GB), IQ1_M(649),TQ2_0(551GB)!!"
Coverage timeline
- Aug 7, 08:47 UTC r/LocalLLaMA lead source New Unsloth KImi K3 drops! Q1_0 (466GB), TQ1_0(509GB), IQ1_M(649),TQ2_0(551GB)!!
- Aug 8, 23:47 UTC r/LocalLLaMA Kimi K3 (Unsloth) IQ2-XXS from 711GB down to 478GB!!! Only Multi-language was removed to trim the size
- Aug 9, 02:31 UTC r/LocalLLaMA ds4 flash 0731 UD-IQ2_M wrote a custom metal kernal for kimi k2 IQ1_0 in about 50 minutes