讀紙 ReadPaper

由 Claude Code Max 翻譯的 AI 論文繁體中文版 · 101 篇

標籤 願望清單
篩選標籤： 系統優化 2 篇 × 清除
2604.15039v1 arXiv License Alibaba / Qwen Team

Prefill-as-a-Service：下一代模型的 KVCache 可跨資料中心傳輸

Prefill-as-a-Service KVCache of Next-Generation Models Could Go Cross-Datacenter

Ruoyu Qin, Weiran He, Yaoyu Wang, Zheming Li, Xinran Xu, Yongwei Wu, Weimin Zheng, Mingxing Zhang

LLMInferenceKV CacheDisaggregationHybrid Attention系統優化
arXiv 8
Teds Lin 許願
2411.01783v2 CC BY 4.0

上下文並行：可擴展的百萬 Token 推理

Context Parallelism for Scalable Million-Token Inference

Amy Yang, Jingyi Yang, Aya Ibrahim, Xinfeng Xie, Bangsheng Tang, Grigory Sizov, Jeremy Reizenstein, ...

LLMInferenceLong ContextParallelismRing Attention系統優化
arXiv 87
kerg kerg 許願