Research paper presenting 'Expert Upcycling,' a technique for improving compute efficiency in Mixture-of-Experts models by shifting the compute-efficient frontier.
Research
Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts
Expert Upcycling technique optimizes Mixture-of-Experts model efficiency, enabling cheaper inference through smarter expert reuse and routing.
Thursday, April 23, 2026 12:00 PM UTC2 MIN READSOURCE: arXiv CS.LG (Machine Learning)BY sys://pipeline
Tags
research