Long contexts aren’t that good. See KV caches aren’t all that > long contexts aren’t actually that good for a starter.

Super long contexts get bad:

There are also fundamental limitations about how much information can be carried forward by each token in long contexts, and some prompts are BAPO-Hard Problems: Limits & LLM Failures. This is why global information questions suffer for very long contexts:

  • “Based on everything we’ve discussed, what is the single most important theme connecting all the topics we covered?”
  • “Given all of this, what should I prioritize working on first?”
  • “What assumptions am I making that I haven’t explicitly stated?”

These will do poorly with longer prefixes because they are inferential and distributed across the entire context.

So what’s better? Agents.