1.1 KiB
1.1 KiB
Context Drift
Definition
A failure mode in LLM interactions where the model gradually loses focus on the original task or context, veering off-topic as the conversation progresses. The LLM "forgets" the original goal and generates responses that may be locally coherent but globally irrelevant.
Causes
- Long conversations that exceed the model's effective context window
- Cumulative token budget leading to attention dilution
- Poor initial prompt definition
- Model's tendency to follow the most recent instructions over original ones
Impact on Multi-Agent Systems
- Can propagate errors through agent chains
- Workers in a Hierarchy may drift from Planner's intended tasks
- Debates may veer off the original proposition being evaluated
- Knock-out agents may lose sight of the evaluation criteria
Mitigation
- Break long tasks into atomic steps (Hierarchy pattern)
- Use explicit task validation at each step
- Keep agent contexts focused and limited
- Reset context periodically rather than accumulating