context starvation▌
1.The failure mode where an AI agent produces wrong or degraded output not because its context is polluted, but because it never received the context it needed — evicted by truncation, missed by retrieval, or summarized away.
Context rot is dying from what's in the window. Context starvation is dying from what isn't.
Watch an agent starve
A support agent is asked to remotely reboot a user's machine. Drag the context budget down and watch which facts get evicted — and how the answer degrades from correct to confidently wrong.
Context window
Agent output
Four ways agents starve
Aggressive truncation
The window fills, so the runtime drops the oldest turns. Relevance isn't consulted — recency is. The critical constraint from message #3 is gone by message #40.
Retrieval misses
RAG returned five chunks; the one that mattered ranked sixth. The agent doesn't know a better chunk existed — it reasons confidently over an incomplete picture.
Memory eviction
Persistent agent memory has quotas too. Facts get scored, compacted, and expired. What survives eviction may not be what the next task needs.
Over-summarization
Long histories get compressed into summaries to save tokens. Summaries keep the plot and lose the detail — “discussed server config” instead of the actual IP.
Context starvation vs. context rot
They're opposite failure modes of the same resource — and they get misdiagnosed for each other constantly. Fixing one often triggers the other.
| Context rot | Context starvation | |
|---|---|---|
| Failure | Too much / degraded context in the window | Missing context that was needed |
| Symptom | Distraction, contradiction, drift over long sessions | Confident answers built on incomplete facts |
| Common trigger | Ever-growing histories, noisy tool output | Truncation, retrieval misses, memory eviction |
| The trap | You fix rot by trimming context… | …and the trimming causes starvation. |
How to detect it in production
- Log what was evicted, not just what was sent. If you can't reconstruct what the model didn't see, every starvation bug looks like a model quality problem.
- Watch for confident wrongness after long sessions. Starved agents don't hedge — the missing fact isn't there to create doubt.
- Diff answers at full vs. trimmed context. Replay failed tasks with the complete history. If the answer flips, you've found an eviction casualty.
- Audit retrieval recall, not just precision. Measure how often the needed chunk existed in the corpus but never made the top-k.
- Flag summary round-trips. Any fact that only survives inside a summary is one compression pass away from being gone.