The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA!
Introducing Context Language Models (CLMs)
- Natively manage their own context
- Treat context as a file
- Learn policies in CLM weights, no harness
Check out our paper, code, and play with CLM!
Paper: arxiv.org/abs/2609.37725
Code: github.com/facebookresearch/context-language-models
HF paper: huggingface.co/papers/2609.37725
The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA!
Introducing Context Language Models (CLMs) - Natively manage their own context - Treat context as a file - Learn policies in CLM weights, no harness
Check out our paper, code, and play with CLM! Paper: arxiv.org/abs/2609.37725 Code: github.com/facebookresearch/context-language-models HF paper: huggingface.co/papers/2609.37725