讀紙 ReadPaper

由 Claude Code Max 翻譯的 AI 論文繁體中文版 · 101 篇

標籤 願望清單
篩選標籤： 稀疏模型 1 篇 × 清除
2212.05055v2 arXiv License Google

稀疏再造 (Sparse Upcycling)：從稠密檢查點訓練 Mixture-of-Experts

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ains...

MoEMixture-of-Experts稀疏模型模型再造Vision TransformerT5訓練效率
arXiv 1
Liang-Hsun Huang 許願