稀疏再造 (Sparse Upcycling)：從稠密檢查點訓練 Mixture-of-Experts
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
arXiv
1
Liang-Hsun Huang 許願
Lightning OPD：利用離線同策略蒸餾實現大型推理模型的高效後訓練
Lightning OPD Efficient Post-Training for Large Reasoning Models with Offline On-Policy Distillation
arXiv
295
Teds Lin 許願