Router Upcycling: Leveraging Mixture-of-Routers in Mixture-of-Experts Upcycling.

Mon, 01 Sep 2025 01:00:00 +0200

Junfeng Ran, Guangxiang Zhao, Yuhan Wu, Dawei Zhu, Longyun Wu, Yikai Zhao, Tong Yang, Lin Sun , Xiangzheng Zhang, Sujian Li:
Router Upcycling: Leveraging Mixture-of-Routers in Mixture-of-Experts Upcycling. CoRR abs/2509.00679 (2025)