Learning to Read Out: unembedding dynamics in language model pretraining
Read original on arXiv cs.CL ↗arXiv:2610.21025v1 Announce Type: new Abstract: When does a language model acquire a capability? Developmental studies usually answer this by tracking when models start producing the correct token. But that...
Original headline: "Learning to Read Out: Unembedding Dynamics in Language Model Pretraining"
Timeline
- October 16, 2026 Learning to Read Out: Unembedding Dynamics in Language Model Pretraining arXiv cs.CL