Valkey 9.2 & AI Caching
3 steps1 pieces5 Sources
Valkey, the open-source in-memory datastore governed by the Linux Foundation, released version 9.2 on November 19, 2026. The update introduces distributed key-value (KV) caching designed to reduce AI inference costs by reusing computed work across GPU fleets. While Valkey claims this can lower spending by up to 40% and time-to-first-token by up to 80%, independent benchmarks suggest benefits are workload-dependent, with one test showing a 25% increase in requests served but a 15% rise in GPU bills due to cache overhead. The release also includes forkless snapshots to prevent memory spikes during backups and B+ tree sorted sets for better performance on large datasets.
How it got here
October 20, 2026: Valkey publishes a technical deep dive on KV caching, describing how shared caches beyond GPU/host memory can serve ~25% more requests.
valkey.io ↗November 19, 2026: Valkey 9.2 is generally available, featuring Path Hash, forkless snapshots, and replication compression.
linuxfoundation.org ↗November 19, 2026: AWS announces general availability of fully managed distributed KV caching with Amazon ElastiCache for Valkey.
aws.amazon.com ↗