When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers

(arxiv.org)

2 points | by wondersky 8 hours ago ago