Prompt-cache-safe context editing is a distributed-systems problem, and the answer is serving bytes as a pure function of the conversation — not a session dict.
- architecture
- caching
Prompt-cache-safe context editing is a distributed-systems problem, and the answer is serving bytes as a pure function of the conversation — not a session dict.
parsec's savings number is a per-request count_tokens counterfactual, stored in a ledger you can read — and a failed probe records a hole, never a zero.