1812.06162v1
arXiv License
OpenAI
大批次訓練的一個經驗模型
An Empirical Model of Large-Batch Training
Sam McCandlish、Jared Kaplan、Dario Amodei、以及 OpenAI Dota Team(OpenAI;Jared Kaplan 亦屬 Johns Hopkins Un...
Large-Batch TrainingGradient Noise ScaleData ParallelismOptimizationSGDScalingOpenAI
Liang-Hsun Huang 許願