The persona that erodes
By turn 20, your warm, terse support agent has become a chatty, hedging assistant who apologizes too much. The model isn't broken — it's mirroring the user's longer messages, hedging because it saw hedging earlier in context, and slowly forgetting the system prompt's tone clauses under the weight of the conversation.
Three drift mechanisms
- Mirroring — model adopts the user's tone, length, and vocabulary.
- Self-imitation — once it hedges once, hedging is in context, so it hedges more.
- System-prompt dilution — system is 200 tokens; turn-50 history is 20,000 tokens; the system's relative weight drops.
Counter-drift tactics
- Re-anchor periodically (every N turns, re-inject a one-line tone reminder).
- Use compaction to remove drift-y assistant turns from history.
- Add explicit anti-drift sentences ("Do not adopt the user's tone").
- Run a tone classifier on assistant outputs and alert on drift.