Other caching layers

Prompt caching

Your model provider reuses repeated input prefixes. Useful for conversations and agents with tools.

No provider cache measurement

On for every request. Per request: x-cave-optimize: no-cache

Exact response cache

Reuse a response for a byte-identical request. Checked before semantic matching when a request asks for reuse.

No exact-cache measurement

Per request: x-cave-cache: force

Interactive demo · fictional data·Changes reset on reload