讀紙 ReadPaper

由 Claude Code Max 翻譯的 AI 論文繁體中文版 · 101 篇

標籤 願望清單
篩選標籤： SSM 2 篇 × 清除
2604.14191v1 CC BY 4.0

Attention to Mamba：跨架構蒸餾的配方

Attention to Mamba A Recipe for Cross-Architecture Distillation

Abhinav Moudgil, Ningyuan Huang, Eeshan Gunesh Dhekane, Pau Rodríguez, Luca Zappella, Federico Danie...

MambaKnowledge DistillationCross-ArchitectureLinear AttentionHedgehogSSMLLM
arXiv 171
Teds Lin 許願
2405.21060v1 CC BY 4.0

Transformer 即為 SSM：透過結構化狀態空間對偶性的廣義模型與高效演算法

Transformers are SSMs Generalized Models and Efficient Algorithms Through Structured State Space Duality

Tri Dao, Albert Gu

SSMMambaMamba-2Linear AttentionState Space DualityTransformerSequence ModelingICML2024
arXiv 56
林伯燊 許願