Skip to content
C.W.K.
Stream
Lesson 05 of 05 · published

A Rule You Can Apply Without Arguing

~11 min · policy, data-sources, governance, provenance

Level 0Raw Ore
0 XP0/36 lessons0/12 achievements
0/100 XP to next level100 XP to go0% complete
"A gauge may use a keyless public source listed in its row below. Nothing that needs a new key, a login, or scraping-against-ToS enters the roster."

Restating a rule when it stops fitting

The product started with a hard budget: no new API keys. Three providers, that is the whole allowance. It is a good rule — every key is a credential to provision, rotate, secure, and eventually leak.

Then the gauge spec ran into a fact: index-level valuation data is not fully reachable through those three, and some of it lives in keyless public statistical sources — a published CSV, a set of daily figures, the same class of thing the macro provider itself is.

What the spec did next is the interesting part. It did not quietly make an exception, and it did not hold the original rule and ship a worse product. It restated the rule, in a section explicitly headed as restating the provider budget honestly.

Why the new form is stronger

The new rule has four properties the vague version lacked, and each one does work.

It names the real concern. The worry was never "external data", it was credentials and access agreements. A keyless public dataset carries neither, so it was never the thing the rule was protecting against.

It draws a checkable line. Does this need a key, a login, or scraping past a gate? Three yes-or-no questions. Nobody has to arbitrate a judgment call about whether a source is "official enough".

It is per-gauge, not global. Each admitted source is listed in its own gauge's row. A source is not blanket-approved for the product; it is approved for the specific measurement that justified it.

It keeps provenance mandatory. Every stored value carries its source string regardless. Loosening which sources are allowed does not loosen the requirement to record which one produced each number.

When a rule blocks something it was never meant to block, restate it — do not carve an exception. An exception leaves the wrong rule standing and adds a special case, and the next similar situation reopens the whole argument. A restatement fixes the rule at its root, and the fact that it needed restating is itself worth recording, because the original wording will otherwise be quoted back at you.

The gate that stayed closed

The strongest evidence that this is a real rule rather than a rationalization is that it refused something. When sector aggregates for one market were investigated, one path required a session, one sat behind a bot wall, and both were closed by citing this spec's own rule — no scraping past a gate.

A loosening that only ever admits things is not a rule, it is a preference discovered after the fact. This one loosened in a specific direction, held in another, and the record shows both.

Give every admitted source a resilience posture at admission time. Each keyless source enters with the same terms: cache the last-good value, show a staleness indicator, and never let it become a hard dependency for serving. A public dataset with no contract behind it will eventually move, rename, or go quiet — planning for that at admission is much cheaper than discovering it on the morning it happens.

Code

The rule, and the three questions that apply it·text
ADMISSIBLE:
  keyless public statistical sources, listed per gauge
  (published CSV / XLS, published daily figures --
   the same class of thing the macro provider itself is)

NOT ADMISSIBLE:
  needs a NEW KEY        -> out
  needs a LOGIN          -> out
  needs SCRAPING past a
    terms-of-service gate-> out

UNCHANGED BY THE LOOSENING:
  every stored value carries its source string
  every admitted source gets a resilience posture:
    cache last-good + staleness chip,
    never a hard dependency for serving

APPLIED IN PRACTICE -- three sector paths, one market:
  official endpoint   -> session-gated       -> REFUSED
  archive route       -> bot wall            -> REFUSED
  local sector ETFs   -> no fundamentals     -> unavailable

# A rule that has never refused anything is not a rule.

External links

Exercise

Find a rule in your team that people regularly work around. Write down what it says, then write down what it was actually protecting against. If those differ, draft the restatement — and include the three checkable questions that let anyone apply it without escalating. Then look for a case where the restated rule would still refuse something; if you cannot find one, you have written a preference, not a rule.
Hint
Rules that get worked around are usually proxies: 'no new dependencies' for 'no unmaintained code', 'no new services' for 'no new on-call surface', 'no new keys' for 'no new credentials to manage'. Naming the real concern almost always produces a rule that is simultaneously more permissive and more precise.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.