Iterate Launches Lifeboat Engine
Vendor claims new engine doubles agent concurrency per GPU with confidential computing.
ImportanceLocalPreuvesE2 non réplicableTraitementRapide
Iterate.ai launched Lifeboat, an inference engine claiming to support 2,048 concurrent AI agent sessions on a single Nvidia RTX PRO 6000 GPU.
The engine boosts effective capacity by two to six times through key-value cache optimization and fair scheduling. It addresses memory overflow in long-context tasks by loading only necessary experts from mixture-of-experts models while keeping weights at full precision.
Each session runs in an isolated security capsule with hardware attestation for confidential computing. A free developer license is available, with the top-tier Confidential Computing edition priced at $499.99 per month.