Towards Data Science

Context Rot: Why Claude Code Sessions Decay, and How to Govern Them

Long sessions rot quietly, well before any token limit is reached. Here’s why, and how to govern your context in Claude Code.

Hugging Face Trending Papers
Aug 5

OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling

Context lengths of language models (LMs) have dramatically increased, driven by the demands for in-context learning, self-improvement, and long-horizon agentic workflows. Existing long-context corpora, however, are dominated by books, academic articles, and code repositories, which are finite resources and often scarce in long-distance dependencies.