Yandex/AliceAI 80B-A3B fine-tune progress hits ~40% completion; loss curve explains spike from using last micro-step loss instead of step average
Read the original at www.reddit.com→loss curve (taken from the last micro of every step, to explain the variation) some help from gemini 3.8 flash high About 40% of the way done with the initial fine tune. The loss is so spiky because I accidentally...
Original headline: "Update: Yandex/AliceAI 80B-A3B fine tune progress"
Coverage timeline
- Sep 30, 16:30 UTC r/LocalLLaMA lead source Update: Yandex/AliceAI 80B-A3B fine tune progress
- Oct 1, 17:22 UTC r/LocalLLaMA Update #2: Post training yandex/AliceAI-80B-A3B [instruct!] from scratch
- Oct 2, 16:30 UTC r/LocalLLaMA Update #3: Post training yandex/AliceAI-80B-A3B [instruct!] from scratch