d3-edge (0.6B) fine-tuned outperforms d3 (27B) decision model
Read original on r/LocalLLaMA ↗Took vLLM-SR d3-edge (0.6B), fine-tuned it with simple SFT + LoRA, and compared it against the much larger d3 (27B). With just a few thousand training examples, the 0.6B model actually outperformed the 27B model on...
Original headline: "d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model"
Timeline
- October 16, 2026 d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model r/LocalLLaMA