1 points | by devrob 5 hours ago ago
1 comments
LLM caches only work for 100% input matches for all previous text, which will never happen outside of a single session.
Things such as system prompts are already cached.
LLM caches only work for 100% input matches for all previous text, which will never happen outside of a single session.
Things such as system prompts are already cached.