LecturaInvestigaciónRadarMarco de inversión
Iniciar sesión / Registrarse
← Volver a la lectura
NoticiasResumen rápido1 min de lecturaEditorial de DisconfirmAI

Iterate Launches Lifeboat Engine

Vendor claims new engine doubles agent concurrency per GPU with confidential computing.

2026-10-05 21:00 GMT+8

Iterate.ai launched Lifeboat, an inference engine claiming to support 2,048 concurrent AI agent sessions on a single Nvidia RTX PRO 6000 GPU.

The engine boosts effective capacity by two to six times through key-value cache optimization and fair scheduling. It addresses memory overflow in long-context tasks by loading only necessary experts from mixture-of-experts models while keeping weights at full precision.

Each session runs in an isolated security capsule with hardware attestation for confidential computing. A free developer license is available, with the top-tier Confidential Computing edition priced at $499.99 per month.

Fuentes

  • siliconangle.com↗
Continuar investigando →
Iniciar sesión / Registrarse
LecturaInvestigaciónRadarMarco de inversión