Task-phase routing metrics do not reliably indicate quantization sensitivity in MoE FFN tensors
Read original on arXiv cs.LG ↗arXiv:2610.20826v1 Announce Type: new Abstract: We investigate whether per-layer, per-task-phase (prompt/reasoning/response) expert-routing statistics in a Mixture-of-Experts (MoE) language model can guide...
Original headline: "Task-Phase-Conditioned Expert Routing Is Not a Reliable Proxy for Quantization Sensitivity in MoE FFN Tensors"
Timeline
- October 16, 2026 Task-Phase-Conditioned Expert Routing Is Not a Reliable Proxy for Quantization Sensitivity in MoE FFN Tensors arXiv cs.LG