Engineering
Notes from the team building Codot.
Prefix Stability Across Four Prompt-Cache Mechanisms
Prompt caches differ in who creates an entry, where it is stored, and the scope in which it can be reused. We classify four mechanisms, show how prefix invalidation propagates through a serialized prompt, and describe the prompt layout and routing we use for each.