Make the output auditable
For high-stakes outputs (compliance, finance, support, decisions affecting users), it should be possible after the fact to trace every claim in the response back to a source: a chunk, a tool result, a step in the reasoning trace. Without that trace, you cannot debug a wrong answer or defend a right one.
Three levels of traceability
- Provenance fields — every output object includes
sources(chunk ids, tool call ids). - Native citations — Anthropic's Citations feature returns spans-of-output → spans-of-input.
- Trace logs — full request, prompt version, model version, retrieved chunks, tool calls, response. Persisted with the response id.
Why this is a prompt design concern
You can't bolt traceability on. The prompt has to require sources in the output schema, the chunks have to have stable ids, the tools have to log structured arguments and results. Build it in early; it's expensive to retrofit.