2.3x KV Cache Compression at 32k Context – Cut VRAM Costs by 50%

 (github.com)

1 points | by JamieObala 9 hours ago ago

2 comments