Looking forward to speaking with folks thinking about architecture design for interpretability at #NeurIPS2024 next week. Feel free to drop by our poster #3003 on scaling MoE's expert specialization on Friday 13th @ 4:30pm! arxiv.org/abs/2402.12550