Investigate unexpected overlooks with the diagnostics system
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
★ Tier-1 Source
Higher cache hit rates and new tools to help persistent agents run faster and cost less.
Key facts
- GPT‑6 enables persistent agents to work for hours on complex tasks, from refactoring codebases to producing well-researched documents and presentations
- With the GPT‑6 family, they launched an improved prompt caching system that delivers higher cache hit rates by default
- On GPT‑6 models, you can now change reasoning effort between responses without breaking cache
- OpenAI caches that shared context to reuse computation across requests, reducing response times and giving developers discounts of up to 90% on cached input tokens
Summary
GPT‑6 enables persistent agents to work for hours on complex tasks, from refactoring codebases to producing well-researched documents and presentations. With the GPT‑6 family, they launched an improved prompt caching system that delivers higher cache hit rates by default. The new Prompt Caching Dashboard shows how much of your application’s input is served from cache. When you see an unexpected cache miss, use the prompt caching diagnostics tool to understand what happened.