C.W.K.
Stream
Lesson 10 of 10 · published

Editing Drift — Why Instructions Stack Badly

~16 min · instructions, maintenance, drift

Level 0Apprentice
0 XP0/100 lessons0/14 achievements
0/120 XP to next level120 XP to go0% complete

The frankenstein prompt

You write a prompt. Someone reports a bug. You add a sentence. Another bug — another sentence. Six months later the prompt is 4,000 words and contains contradictions you didn't notice. This is editing drift, and it's the most common quality failure in production prompting.

Symptoms

  • Sentences that contradict each other ("be concise" + "include all relevant context").
  • Stale fixes — instructions for bugs that were repaired upstream months ago.
  • Cargo-cult sentences inherited from prompts no one remembers.
  • Response shape spec drifting away from the actual schema.

The hygiene routine

  1. Diff before adding — read the existing prompt before adding a new sentence.
  2. Replace, don't append — if a new instruction overlaps an old one, edit the old one.
  3. Date stale fixes — comment with the date and reason; remove when the cause is gone.
  4. Periodic prompt review — every quarter, run the eval suite and rewrite the worst-performing prompt from scratch. Most are shorter when rewritten clean.
  5. One owner — a prompt with shared edit access drifts faster than one with a named owner.

Code

Comment-based hygiene markers·markdown
<!-- 2026-04-12: tighten output JSON; was leaking markdown fences. owner: Alice -->
Return JSON only. No code fences. No preamble.

<!-- 2026-02-08: stop apology preambles. owner: Bob -->
Open with the verdict, not an apology.

<!-- TODO 2026-Q3: revisit; the underlying parser was fixed -->
<!-- The next sentence is probably stale: -->
If the model output is malformed, reformat it to JSON before returning.

External links

Exercise

Pick your oldest production prompt. Identify three sentences that are likely stale (predate a fixed bug, contradict newer rules, or are pure cargo). Remove them and run the eval set. Note what (if anything) regressed.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.