2412.06464v3
CC BY 4.0
MIT
門控 Delta 網路:用 Delta 規則改進 Mamba2
Gated Delta Networks: Improving Mamba2 with Delta Rule
Songlin Yang(MIT CSAIL,工作於 NVIDIA 實習期間完成)、Jan Kautz(NVIDIA)、Ali Hatamizadeh(NVIDIA)
Linear AttentionMamba2DeltaNetDelta RuleGatingLinear RNNHybrid Model
Liang-Hsun Huang 許願