Skip to content
C.W.K.
Stream
Lesson 04 of 04 · published

The 2.68 Million Warning

~13 min · cost, circuit-breaker, agentic-loop, failure

Level 0Trace
0 XP0/36 lessons0/12 achievements
0/100 XP to next level100 XP to go0% complete

Thirty-four characters became 2.68 million

A super soul's request about its own memory was thirty-four characters. The request was not the expensive part. An agentic Sidekick turn carried full context through roughly one hundred tool steps, reaching 2.68 million cumulative input tokens.

The ending was worse: an actor-blind super gate rejected the final write. The entire cost had been paid and source remained unchanged. Context economy and permission correctness amplified each other inside one flow.

Large context is not a one-time number

Remaining under a context-window limit says little about an agentic loop. Twenty-five thousand carried tokens repeated one hundred times become 2.5 million cumulative input.

Elapsed time alone hides the bill. Expose cumulative input, tool steps, and last progress marker, then pause or request approval at a budget threshold.

A circuit breaker is not surrendering quality

Step caps, token budgets, and no-progress detection do not make a brain less capable. They force premise review when the same action and error repeat.

When the breaker opens, keep partial work out of source while preserving task state and evidence. Dad may narrow scope, hand off to the queue, or choose another provider. Blind automatic fallback merely moves cost among vendors.

The incident changed architecture

Sidekick remains the consultation surface while heavy pipelines move into queued terminal sessions. The queue makes operand, base hash, stage, cost, and lifetime explicit.

The measurement is public because it carries the decision. No request content or conversation identifier is necessary. Thirty-four characters, about one hundred steps, 2.68 million input, and a denied write explain the lane split.

Agentic cost explodes as repeated context multiplied by steps, not prompt length alone. Check permission before spend and build cumulative budgets plus no-progress breakers into the lane.

Code

A cumulative-context budget breaker·python
context_tokens = 25000
step_budget = 40
token_budget = 750000
spent = 0
for step in range(1, 101):
    spent += context_tokens
    if step >= step_budget or spent >= token_budget:
        state = {"status": "paused", "step": step, "spent": spent}
        break
assert state["status"] == "paused"
assert state["spent"] <= token_budget + context_tokens

External links

Exercise

For one agentic workflow, estimate carried context, average tool steps, and cumulative input. Design step, token, and no-progress limits plus the handoff state after a breaker.
Hint
Add the context resent at every step, not only the initial prompt.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.