ainewsblitz.com

Breaking

OpenAI Upgrades GPT-6 API Prompt Caching to Cut Agent Latency and Input Costs

  • Foundation Models
  • AI Agents
  • Software Dev & Coding

OpenAI has upgraded prompt caching for GPT-6 in the API, aiming to raise cache-hit rates by default so long-running agents can reuse more context, respond faster and qualify for cached-input discounts of up to 90%. The September 22 update also adds monitoring, diagnostics and controls for developers who need to understand why cache misses happen and where reusable prompt prefixes should end.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.

$20
Read this article
$29/month
Unlimited — all 27,226 articles, the full archive, and comprehension quizzes
Save 72%
$98/year
≈ $8.17/month
Unlimited, billed once a year