2404.06395v3
CC BY 4.0
MiniCPM：以可擴展的訓練策略揭示小型語言模型的潛力
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
Shengding Hu、Yuge Tu、Xu Han、Chaoqun He、Ganqu Cui、Xiang Long、Zhi Zheng、Yewei Fang、Yuxiang Huang 等（清華大...
Small Language ModelWSD SchedulerScaling LawPre-trainingMoELong Context開源模型
Liang-Hsun Huang 許願