2604.15039v1
arXiv License
Alibaba / Qwen Team
Prefill-as-a-Service：下一代模型的 KVCache 可跨資料中心傳輸
Prefill-as-a-Service KVCache of Next-Generation Models Could Go Cross-Datacenter
Ruoyu Qin, Weiran He, Yaoyu Wang, Zheming Li, Xinran Xu, Yongwei Wu, Weimin Zheng, Mingxing Zhang
LLMInferenceKV CacheDisaggregationHybrid Attention系統優化
Teds Lin 許願