2305.16264v5
arXiv License
Hugging Face、Harvard University、University of Turku、Cornell University
資料受限下的語言模型 Scaling
Scaling Data-Constrained Language Models
Niklas Muennighoff、Alexander M. Rush、Boaz Barak、Teven Le Scao、Aleksandra Piktus、Nouamane Tazi、Sampo ...
LLMScaling LawPre-trainingDataChinchillaRepeated DataNeurIPS
Liang-Hsun Huang 許願